ArticlePDF Available

I–O Psychologists and Intelligence Research: Active, Aware, and Applied

Authors:
186
B.E. Postlethwaite, T.L. Giluk, and F.L. Schmidt
IO Psychologists and Intelligence
Research: Active, Aware, and Applied
BENNETT E. POSTLETHWAITE
Pepperdine University
TAMARA L. GILUK
Xavier University
FRANK L. SCHMIDT
University of Iowa
Scherbaum, Goldstein, Yusko, Ryan, and
Hanges (2012) have challenged indus-
trial–organizational (I–O) psychologists to
‘‘launch a new research agenda’’ on intel-
ligence. Although we enthusiastically sup-
port the authors’ call for more intelligence
research, we believe that several of their
claims depict the current state of affairs
as more dire than is actually the case.
We argue that I–O psychologists are more
active in the area of intelligence research
than the authors present, maintain that
Correspondence concerning this article should be
addressed to Bennett E. Postlethwaite.
E-mail: ben.postlethwaite@pepperdine.edu
Address: Seaver College, Pepperdine University,
24255 Pacific Coast Highway, Malibu, CA 90263-
4237
All authors contributed equally to this commentary.
many I–O psychologists are aware of intel-
ligence research published in non-I–O out-
lets, and contend that a primary focus on
applied research is desirable.
I–O Psychologists Are Conducting
Intelligence Research
Scherbaum et al. maintain that I–O psy-
chology’s contribution to intelligence re-
search has been decreasing over time. On
the basis of their cursory analysis of
Journal
of Applied Psychology
(
JAP
) and
Personnel
Psychology
(
PPsych
), the authors estimate
that 2–3% of content in these journals is
related to intelligence. We sought to deter-
mine the extent to which I–O psychologists
are publishing intelligence-related research
in other outlets.
Active, Aware, and Applied
187
First, we replicated Scherbaum et al.’s
search. We then adapted their search
by altering the term
general cognitive
ability
(less commonly used) to
cognitive
ability
(more widely used). This small
change more than doubled the number
of relevant articles returned. Whereas
the authors located 35 intelligence-related
articles published in
JAP
and
PPsych
from
2000 to 2011, our revised search revealed
81 articles. Likewise, the authors found
five articles published in
JAP
during 2010
(Volume 95). They estimated the percent
of intelligence research as 1%, based on
a reported 430 articles in total (5/430 =
1.1%). However, we noted that there
were only 85 articles (excluding editorial
material) published in
JAP
in 2010. This
suggests that approximately 5.9%, rather
than 1%, of articles in that volume were
concerned with intelligence.
We also examined a sample of I–O psy-
chology, general, and social psychology
journals from 2000 to 2011. Our results
indicate that I–O psychologists are inves-
tigating intelligence to a greater degree
than Scherbaum et al. suggest. Much of
this research appears in journals with an
I–O psychology focus. For example, I–O
psychologists authored 13.9% (58/416) of
articles in
International Journal of Selection
and Assessment
and 18% (44/244) of arti-
cles in
Human Performance
that examined
intelligence to some degree. In compari-
son, the percentages for
JAP
and
PPsych
were 4.6% (57/1,246) and 8% (24/300),
respectively.
I–O psychologists are also publish-
ing intelligence research in other out-
lets. We sampled 5 years (2000–2002 and
2010–2011) of the journal
Intelligence
and
found 9.1% (17/187) of articles had at least
one I–O psychologist author. Interestingly,
with the exception of
Intelligence
, general
and social psychology journals (e.g.,
Journal
of Experimental Psychology: Applied
,
Jour-
nal of Personality and Social Psychology
,
and
Psychological Bulletin
) had consider-
ably lower percentages (1.8–2.3% from
2000 to 2011, considering both I–O and
non-I–O authors) of articles examining
general intelligence than did I–O psy-
chology journals. Thus, I–O psychologists
are doing research on general intelligence,
and I–O journals are publishing it to a
greater extent than non-I–O journals. Alter-
natively, other journals may be publishing
research on cognitive processes; however,
this research (e.g., working memory) is not
being captured by the keywords intelli-
gence, general mental ability, or cognitive
ability.
We acknowledge, as did Scherbaum
et al., that our search process was rudi-
mentary. However, we believe our results
present a more optimistic assessment of the
attention that I–O psychologists are paying
to the construct of intelligence. Neverthe-
less, we agree with the authors that the field
of I–O psychology would benefit from a
renewed interest in the construct.
I–O Psychologists Are Aware of
Research in Non-I–O Outlets
Scherbaum et al. comment that I–O psy-
chologists doing intelligence research tend
to publish in ‘‘journals that the typical
I–O psychologist does not read,’’ implying
that other I–O psychologists are unaware
of this research. To assess this possibil-
ity, we examined the reference lists of the
81 intelligence-related articles in
JAP
and
PPsych
from 2000 to 2011 for citations to
three journals:
Journal of Experimental Psy-
chology: General
,
Journal of Experimental
Psychology: Applied
, and
Intelligence
.We
found that 42% (34/81) of articles cited
at least one of these journals. Of these,
the average number of citations is 2.59
(
SD
=2.26, range =1–13). These numbers
are likely an underestimate; the reviewed
articles frequently cited other sources on
intelligence (e.g., other specialist journals
and book chapters).
Our results indicate that although I–O
psychologists may not regularly read non-
I–O journals, they are aware of research
published in these outlets and reference
it when relevant. Given the large number
of journals, it would be difficult for the
typical I–O psychologist to regularly read
188
B.E. Postlethwaite, T.L. Giluk, and F.L. Schmidt
all those containing research in their field.
The ease of electronic searching makes it
less essential for I–O psychologists to read a
particular journal than to comprehensively
search across journals to remain abreast of
developments in their area of expertise.
I–O Psychology Is an Applied
Science
Scherbaum et al. argue that I O psycholo-
gists need to broaden their ‘‘narrow focus’’
on applied research and increase research
on the nature of the intelligence construct.
We contend that a primary focus on appli-
cation is appropriate; the fact that others
(e.g., cognitive psychologists and neuropsy-
chologists) may take the lead on basic
research, whereas IO psychologists have
a more applied focus, is not as problematic
as the authors assert.
IO psychologists are scientist-practiti-
oners (Society for Industrial and Organi-
zational Psychology [SIOP], 2011a); IO
psychology is a field in which ‘‘rigor and
methods of psychology are applied to issues
of critical relevance to business’’ (SIOP,
2011b). Thus, by definition, the primary
focus is application. We agree that basic
research on the construct, nature, and mea-
surement of intelligence is important. There
is value in IO psychologists contributing to
this effort. However, a shift in focus
toward
basic research means a shift in focus
away
from
applied research and the very defini-
tion of IO psychology.
In addition, psychologists who focus on
basic research rely on IO psychologists
to investigate the applications of their
research to the workplace. We assert that
researchers are most effectively leveraged
doing the type of research for which
their training, skill sets, and resources best
position them. Most IO psychologists are
trained in the scientist-practitioner model
and have an understanding of the work
context that non-IO psychologists lack.
They also have resources required for
applied research (e.g., access to work
samples) that others may not; conversely,
cognitive psychologists have access to
resources for basic research (e.g., functional
magnetic resonance imaging) that IO
psychologists lack. This offers opportunities
for collaboration; nevertheless, the typical
IO psychologist is better positioned for
applied research.
Moreover, Scherbaum et al. appear to
present applied and basic research as
mutually exclusive. We argue that applied
research can contribute to knowledge about
the nature of intelligence. For example, one
of our current projects has an applied focus
in that it examines the relationship between
fluid and crystallized intelligence and mul-
tiple performance criteria; however, the
results will also have theoretical implica-
tions about the nature of intelligence.
In conclusion, we believe Scherbaum
et al. have highlighted important consider-
ations regarding the role of IO psycholo-
gists in intelligence research. However, we
argue that IO psychologists are making
more robust contributions than the authors
suggest. Nevertheless, we echo Scherbaum
et al.’s call to increase research efforts on
this critical construct.
References
Scherbaum, C. A., Goldstein, H. W., Yusko, K. P.,
Ryan, R., & Hanges, P. J. (2012). Intelligence
2.0: Reestablishing a research program on
g
in
I– O psychology.
Industrial and Organizational
Psychology: Perspectives on Science and Practice
,
5
, 128– 148.
Society for Industrial and Organizational Psychol-
ogy. (2011a).
Maximizing human potential within
organizations: Learning the science behind tal-
ent management
. Retrieved from http://www.
siop.org/visibilitybrochure/siopbrochure.aspx.
Society for Industrial and Organizational Psychol-
ogy. (2011b).
What is I– O?
Retrieved from
www.siop.org.
... Researchers have indicated that a gap exists in the literature on empirical studies of cognitive ability on job performance (Durso & Manning, 2008;Postlethwaite, Giluk, & Schmidt, 2012). They suggested that future studies should continue to leverage the extant research on cognitive ability on job performance and focus on the construct, nature, and measure of intelligence that are relevant to the critical issues in business applications. ...
... Industrial organizational (IO) researchers identified an existing gap in the GMA literature, calling for additional studies on job performance using predictor variables related to the GMA constructs in workplace job tasks (Durso & Manning, 2008;Postlethwaite et al., 2012). Specifically, extant research should be leveraged on the construct, nature, and measure of intelligence that are relevant to the critical issues in business applications. ...
... A quantitative analysis was the appropriate method for this study because the sample populations for both PS and NG controllers were sizable. The rationale for using a quantitative design was to fill an existing gap in the IO literature that lacked empirical studies on job performance using constructs of cognitive ability (Durso & Manning, 2008;Postlethwaite et al., 2012). ...
Thesis
Full-text available
The Federal Aviation Administration (FAA) has experienced decreased return on investment caused by hiring too many air traffic controller specialists (ATCSs) who performed poorly in field training, thus failing to become certified professional controllers (CPCs). Based on Schmidt and Hunter’s theory of job performance and biodata theory, this quantitative, archival study examined whether factors of cognitive ability and biodata could predict job performance status of 2 generations of ATCSs, poststrike (PS) and next generation (NG) controllers. For each generation of controllers, binary logistic regression analysis was conducted to determine if any of the independent variables—transmuted composite (TMC) score for PS controllers, Air Traffic and Selection and Training (AT-SAT) test score for NG controllers, average of high school arithmetic/math letter grade, overall high school average letter grade, self-estimation of time to become fully effective in the ATCS role, self-estimation of percentile ranking in the FAA program relative to the class, size of neighborhood raised, or socioeconomic status—are significant predictors of job performance status for controllers as measured by whether they pass the field OJT (i.e., certified or still in training, or failed certification or left training). The regression results for the PS and NG controllers were found to be statistically significant (χ2 (23) = 68.377, p < .001) and (χ2 (17) = 99.496, p < .001), respectively. Findings that overall high school grade point average and socioeconomic status significantly predicted ATCS job performance for both PS and NG controllers could influence the FAA’s use of revised biodata to better predict ATCS job performance. Further research should include studies of socioeconomic status, gender, and race to address new evidence that the AT-SAT has adverse impact.
... With perhaps one exception (i.e., Cucina, Gast, & Su, 2012), the commentaries appear to agree that intelligence deserves to be a ''hotter'' and more prominent topic of inquiry within our field than it is currently. Even if the groups differ a bit about exactly how dire the situation is, most of the commentaries tend to agree that more research should be carried out on this important construct (e.g., Postlethwaite, Giluk, & Schmidt, 2012). In fact, many of the commentaries cite new and exciting theoretical and empirical research being conducted on intelligence that currently has not been focused on in our field but could arguably serve as viable starting points for studying intelligence in applied settings across the subfields of I-O psychology. ...
... Specifically, after a cursory review, we estimated that only 2-3% of articles published in the Journal of Applied Psychology (JAP) and Personnel Psychology (PP) were related to intelligence. Postlethwaite et al. (2012) disagreed with this estimate, and they estimated that 4.6% of the JAP articles and 8% of the PP articles focused on intelligence. Even if these larger estimates are used, we believe that our initial argument is still valid. ...
... Thus, although we might quibble over how dire the situation is, there seems to be agreement that relatively little research is being published in our journals regarding this key construct. Postlethwaite et al. (2012) make an excellent point that I-O psychologists might be publishing their research on intelligence in non-I-O journals. Although this is promising and suggests that I-O psychologists might not have abandoned this area of inquiry, it leads to a second and perhaps more important question that we should ask as an entire field: Why are these researchers publishing these articles outside of I-O? Are articles being submitted to I-O journals only to be rejected and, thus, eventually being published outside of the mainstream of our field? ...
... With perhaps one exception (i.e., Cucina, Gast, & Su, 2012), the commentaries appear to agree that intelligence deserves to be a ''hotter'' and more prominent topic of inquiry within our field than it is currently. Even if the groups differ a bit about exactly how dire the situation is, most of the commentaries tend to agree that more research should be carried out on this important construct (e.g., Postlethwaite, Giluk, & Schmidt, 2012). In fact, many of the commentaries cite new and exciting theoretical and empirical research being conducted on intelligence that currently has not been focused on in our field but could arguably serve as viable starting points for studying intelligence in applied settings across the subfields of I-O psychology. ...
... Specifically, after a cursory review, we estimated that only 2-3% of articles published in the Journal of Applied Psychology (JAP) and Personnel Psychology (PP) were related to intelligence. Postlethwaite et al. (2012) disagreed with this estimate, and they estimated that 4.6% of the JAP articles and 8% of the PP articles focused on intelligence. Even if these larger estimates are used, we believe that our initial argument is still valid. ...
... Thus, although we might quibble over how dire the situation is, there seems to be agreement that relatively little research is being published in our journals regarding this key construct. Postlethwaite et al. (2012) make an excellent point that I-O psychologists might be publishing their research on intelligence in non-I-O journals. Although this is promising and suggests that I-O psychologists might not have abandoned this area of inquiry, it leads to a second and perhaps more important question that we should ask as an entire field: Why are these researchers publishing these articles outside of I-O? Are articles being submitted to I-O journals only to be rejected and, thus, eventually being published outside of the mainstream of our field? ...
Article
The goal of our focal article was to initiate a conversation on how I–O psychology can reengage in research on intelligence. We are encouraged by the ways in which the commentators have furthered this conversation. We discuss 4 overarching themes in the set of commentaries: the extent that I–O psychology is contributing to the intelligence field, outsiders' impressions of I–O psychology's contributions to intelligence research, ways I–O psychology can contribute to intelligence research, and ideas about what prevents us from doing this research. We hope this collection of articles serves to truly ignite research by our field on this critical construct.
Article
Full-text available
Over 100 years of psychological research on employee selection has yielded many advances, but the field continues to tackle controversies and challenging problems, revisit once-settled topics, and expand its borders. This review discusses recent advances in designing, implementing, and evaluating selection systems. Key trends such as expanding the criterion space, improving situational judgment tests, and tackling socially desirable responding are discussed. Particular attention is paid to the ways in which technology has substantially altered the selection research and practice landscape. Other areas where practice lacks a research base are noted, and directions for future research are discussed. Expected final online publication date for the Annual Review of Psychology Volume 65 is January 03, 2014. Please see http://www.annualreviews.org/catalog/pubdates.aspx for revised estimates.
Article
Intelligence (i.e., g, general mental ability) is an individual difference that is arguably more important than ever for success in the constantly changing, ever more complex world of business (Boal, 2004; Gatewood, Field, & Barrick, 2011). Although the field of industrial–organizational (I–O) psychology initially made substantial contributions to the study of intelligence and its use in applied settings (e.g., Hunter, 1980; Schmidt & Hunter, 1981), we have done relatively little in recent times about studying the nature of the intelligence construct and its measurement. Instead, we have focused predominately on using intelligence to predict performance outcomes and examine racial subgroup differences on intelligence test scores. Although the field of I–O psychology continues to approach intelligence at a surface level, other fields (e.g., clinical psychology, developmental and educational research, and neuropsychology) have continued to study this construct with greater depth and have consequently made more substantial progress in understanding this critical and complex construct. The purpose of this article is to note this lack of progress in I–O psychology and to challenge our field to mount new research initiatives on this critical construct.
Maximizing human potential within organizations: Learning the science behind talent management
Society for Industrial and Organizational Psychology. (2011a). Maximizing human potential within organizations: Learning the science behind talent management. Retrieved from http://www. siop.org/visibilitybrochure/siopbrochure.aspx. Society for Industrial and Organizational Psychology. (2011b). What is I-O? Retrieved from www.siop.org.