Monday, March 14, 2005

So much data...so little time: In honor of Jack Carroll

As a quantoid with access to many large databases, I, like many other quantoid’s, have a "pleasant problem." I often run late night analyses to investigate questions or hypotheses that my mind generates or which are posed by others on listserv’s or at conferences. I always have the best of intentions to write up the results either as an IAP research report (to be posted to my web page) or to be submitted to a journal for possible publication. Unfortunately, the demands of work call me away or a new analyses capture my attention and the interesting results, insights, and discoveries of yesterday end up being buried in my hard drive forever (although I do integrate many of the results into my PowerPoint presentations when on the “road.”).

One reason for creating this blog is to provide a quicker and more efficient means by which to share some of these unpublished delights. Of course, they will need to be taken with a grain of salt as the results will not have benefited from peer review (I hope to address this issue in a subsequent post) and will not have extensive explanatory text regarding methodology, literature reviews, etc. But heck….the results and conclusions are provided free of charge.

My first planned set of postings will be in honor of John (Jack) Carroll. I was fortunate to have been the last professional to visit Jack at his daughter’s house in Alaska one month prior to his passing away. He personally instructed me on the use and interpretation of his custom (self-written) suite of DOS-based programs for conducting exploratory factor analyses as per the procedures used in his seminal treatise (Human Cognitive Abilities: A Survey of Factor-Analytic Studies, 1993). Following this trip I applied what I had learned to the complete set of WJ3 (including the Diagnostic Supplement) test variables. The results where extremely interesting and have been simmering on my hard drive since Sept, 2003.

My plan is to post a summary of the results and then, possibly in a series of posts (strung across a period of time) highlight and discuss the key findings and insights. By making this public post I hope to place enough pressure on myself to get this done. These data need to see the light of day and will not if I continue to wait for the right time to pump out a nice APA-style research report.