About
72
Publications
155,304
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
8,474
Citations
Introduction
Current institution
Publications
Publications (72)
In the current study, we present a more accurate method for correcting for range restriction (Case V) that expands upon Bryant and Gokhale’s (1972) method. We further present detailed steps to incorporate the Case V method into Schmidt and Hunter’s (2015; Hunter & Schmidt, 2004) psychometric meta-analysis methods (both individual correction and art...
Using an expanded person-environment fit (P-E fit) model, we conducted 2 studies to test the combined effects of 2 individual difference factors, ability-demand fit and interest-vocation fit, in predicting college student choice of and persistence in the science, technology, engineering, and mathematics (STEM) fields. Analysis results based on data...
The relationships between personality traits and performance are often assumed to be linear. This assumption has been challenged conceptually and empirically, but results to date have been inconclusive. In the current study, we took a theory-driven approach in systematically addressing this issue. Results based on two different samples generally su...
Construct empirical redundancy may be a major problem in organizational research today. In this paper, we explain and empirically illustrate a method for investigating this potential problem. We applied the method to examine the empirical redundancy of job satisfaction (JS) and organizational commitment (OC), two well-established organizational con...
Using computer simulation, the authors assessed the accuracy of J. E. Hunter, F. L. Schmidt, and H. Le's (2006) procedure for correcting for indirect range restriction, the most common type of range restriction, in comparison with the conventional practice of applying the Thorndike Case II correction for direct range restriction. Hunter et al.'s pr...
Recent advancements in range restriction (RR) correction research suggest that Case V (Dahlke & Wiernik, 2020; Le et al., 2016) is one of the most accurate approaches to correct for (indirect) RR. However, researchers have had difficulty applying the Case V approach, especially in validation and meta-analytic (including validity generalization) stu...
A recent attempt to generate an updated ranking for the operational validity of 25 selection procedures, using a process labeled “conservative estimation” (Sackett et al., 2022), is flawed and misleading. When conservative estimation's treatment of range restriction (RR) is used, it is unclear if reported validity differences among predictors refle...
Sackett et al. (2022) recommend against correcting for range restriction (RR) in concurrent validation studies. The main rationale behind their recommendation is that unless "rzx" (an unrestricted true-score correlation between the third variable Z where actual selection occurred in a top-down manner [a.k.a., suitability] and the predictor of inter...
Justice scholars have raised concerns about the potential redundancy of organizational justice constructs as their measures were often found to be highly correlated with one another. However, investigation into the problem has been difficult because measurement artifacts attenuated correlations between measures, masking the true extent of construct...
This meta-analytic path analysis presents evidence that first-year academic performance (FYAP), measured by first-year grade point average (FYGPA) plays the major role in determining second-year student retention and that socioeconomic status (SES), measured by parental income, plays a negligible role. Based on large sample data used in a previous...
The other published literature: Attrition modeling in the U.S. military as a bridge between turnover science and practice - Volume 12 Issue 3 - Dan J. Putka, Rodney A. McCloy, Chad H. Van Iddekinge, Huy Le
Meta-analysis has become a well-accepted method for synthesizing empirical research about a given phenomenon. Many meta-analyses focus on synthesizing correlations across primary studies, but some primary studies do not report correlations. Peterson and Brown (2005) suggested that researchers could use standardized regression weights (i.e., beta co...
To address a long-standing concern regarding a gap between organizational science and practice, scholars called for more intuitive and meaningful ways of communicating research results to users of academic research. In this article, we develop a common language effect size index (CLβ) that can help translate research results to practice. We demonst...
The lengthy and complex focal article by Tett, Hundley, and Christiansen (2017) is based on a fundamental misunderstanding of the nature of validity generalization (VG): It is based on the assumption that what is generalized in VG is the estimated value of mean rho ( $\bar{\rho}$ ). This erroneous assumption is stated repeatedly throughout the arti...
Correcting validity estimates for selection procedures for range restriction typically involves comparing variance in predictor scores between all job applicants and applicants who were selected. However, some research on criterion-related and differential validity of cognitive ability tests has relied on range restriction corrections based on data...
Purpose
– The purpose of this paper is to focus on developing and validating a multidimensional measure of work-related age-based stereotypes (WAS) scale.
Design/methodology/approach
– Based upon a review of the literature, a three-dimensional stereotype content model including both negative (incompetence, inadaptability) and positive (warmth) ste...
This meta-analysis examines the strength of the relationships of ACT® Composite scores, high school grades, and socioeconomic status (SES) with academic performance and persistence into the 2nd and 3rd years at 4-year colleges and universities. Based upon a sample of 189,612 students at 50 institutions, ACT Composite scores and high school grade po...
All measurements must contend with unreliability. No measure is free of measurement error. More attention must be paid to measurement error in all psychological research. The problem of reliability is more severe when rating scales are involved. Many of the constructs in industrial–organizational (I–O) psychology and organizational behav-ior/human...
The present study examines the incremental validity of Honesty–Humility (H-H), a measure of the tendency to be fair and genuine in dealing with others, for supervisory ratings of job performance (including both task and contextual performance) over cognitive ability and the Big Five personality traits. Specifically, we explore the incremental valid...
The concept of differential validity suggests that cognitive ability tests are associated with varying levels of validity across ethnic groups, such that validity is lower in certain ethnic subgroups than in others. A recent meta-analysis has revived the viability of this concept. Unfortunately, data were not available in this meta-analysis to corr...
The present study examines the incremental validity of Honesty-Humility (H-H), a measure of the tendency to be fair and genuine in dealing with others, for supervisory ratings of job performance (including both task and contextual performance) over cognitive ability and the Big Five personality traits. Specifically, we explore the incremental valid...
We examined the interactive effects of levels of individualism–collectivism (I–C) on cooperation at work by meta-analytically combining results obtained from 201 studies, representing 225 independent samples. I–C was operationalized at the individual, organizational, and societal levels of analyses. Cooperation was conceptualized at both individual...
Relations between constructs are estimated based on correlations between measures of constructs corrected for measurement error. This process assumes that the true scores on the measure are linearly related to construct scores, an assumption that may not hold. We examined the extent to which differences in distribution shape reduce the correlation...
This study used Monte Carlo simulation to examine the properties of the overall odds ratio (OOR), which was recently introduced as an index for overall effect size in multiple logistic regression. It was found that the OOR was relatively independent of study base rate and performed better than most commonly used R-square analogs in indexing model s...
Using survey methodology, this study examines employee perceptions of two key organizational design factors (employee empowerment and alignment of safety practices) and their relationship with nonreporting of employee injuries and near misses. Results show employee perceptions of alignment of safety practices are related to decreased levels of unre...
The authors illustrate a problem with confirmatory factor analysis (CFA)-based strategies to model disaggregated multitrait—multirater (MTMR) data—the potential to find markedly different results with the same sample of ratees simply as a result of how one selects and identifies raters within the data set one has gathered for analysis. Using perfor...
We examined the influence of Individualism and Collectivism (I–C) on co-operation in workgroups at three levels (societal, organizational, and personal). Data were from 153 American business students representing an individualistic society and 207 Vietnamese counterparts (a collectivistic society). Participants role-played managers for a simulated...
Understanding the factors responsible for successful interactions between cultures has been an ongoing investigation among anthropologists, social workers, and organizational psychologists. The need for employees who are able to function effectively across cultures has resulted in a great deal of research examining which factors enable expatriate e...
Concerns that the military as a whole is not prepared to conduct operations in a way that understands other cultures has sparked a surge of research into areas related to cross-cultural competence. Instances of stereotyping, racism, and abuses of power by military members have showcased the ways in which the U.S. military might alienate the local p...
Using both organizational and educational perspectives, the authors proposed and tested theoretical models on the mediating roles that psychosocial factors (PSFs; motivational, emotional, and social control factors) play between college interventions (academic skill, self-management, socialization, and First-Year-Experience interventions) and colle...
We used a rational-empirical approach to construct the Tendency toward Presence Inventory (TPI), constructing scales to measure the individual difference human factors hypothesized to predict a person's tendency to experience the cognitive state of presence. The initial pool of 105 items was administered to 499 undergraduate psychology students at...
This research reports the results of a comprehensive investigation into the effectiveness of team building. The article serves to update and extend Salas, Rozell, Mullen, and Driskell's (1999) team-building meta-analysis by assessing a larger database and examining a broader set of outcomes. Our study considers the impact of four specific team-buil...
The methods presented in this chapter for correcting meta-analysis results for sampling error and biases in individual study results might appear complicated, but the reader should be aware that more elaborated and extended descriptions of these procedures are presented in Hunter and Schmidt (2004) and that Windows-based software (Schmidt and Le 20...
This study examines the relationship that employee perceptions of supervisor support and risk of injury have with unreported employee injuries requiring doctors' attention, first-aid cases, and near misses. Study results indicate that increased employee perceptions of supervisor support for safety are associated with a decrease in the number of unr...
Users of logistic regression models often need to describe the overall predictive strength, or effect size, of the model’s predictors. Analogs of R2 have been developed, but none of these measures are interpretable on the same scale as effects of individual predictors. Furthermore, R2 analogs are not invariant to the base rate (overall proportion o...
Recent research in the field of meta-analysis has provided a procedure of improved accuracy to correct for range restriction, which allows for more accurate calibrations of the validities of various admission and selection tools. For illustrative purposes, we reanalyzed the database meta-analyzed by Kuncel, Credé , and Thomas (2007) on the validity...
Organizational research and practice involving ratings are rife with what the authors term ill-structured measurement designs (ISMDs)--designs in which raters and ratees are neither fully crossed nor nested. This article explores the implications of ISMDs for estimating interrater reliability. The authors first provide a mock example that illustrat...
Measurement artifacts, including measurement errors and scale-specific factors, distort observed correlations between measures of psychological and organizational constructs. The authors discuss two alternative procedures, one using the generalized coefficient of equivalence and stability (GCES) and one based on structural equation modeling, to cor...
We discuss how meta-analysis, a method for synthesizing research findings, can meaningfully impact personnel selection practices. Specifically, we review important changes in professional and legal practices from the past 30 years resulting from meta-analytic findings. The implications of using meta-analysis methods for evaluating utilities of sele...
We respond to the three comments on our recent article in the August issue of Academy of Management Perspectives (Le, Oh, Shaffer, & Schmidt, 2007), which highlights the importance of methodological advances in human resource research. By concentrating on tangential aspects of our article, these comments miss its central points. Further, the commen...
Executive Overview We respond to the three comments on our recent article in the August issue of Academy of Management Perspectives (Le, Oh, Shaffer, & Schmidt, 2007), which highlights the importance of methodological advances in human resource research. By concentrating on tangential aspects of our article, these comments miss its central points....
Executive Overview We respond to the three comments on our recent article in the August issue of Academy of Management Perspectives (Le, Oh, Shaffer, & Schmidt, 2007), which highlights the importance of methodological advances in human resource research. By concentrating on tangential aspects of our article, these comments miss its central points....
The authors report on a large-scale study examining the effects of self-reported psychosocial factors on 1st-year college outcomes. Using a sample of 14,464 students from 48 institutions, the authors constructed hierarchical regression models to measure the predictive validity of the Student Readiness Inventory, a measure of psychosocial factors. C...
There has been controversy over the years about whether specific mental abilities increment validity for predicting performance above and beyond the validity for general mental ability (GMA). Despite its appeal, specific aptitude theory has received only sporadic empirical support. Using more exact statistical and measurement methods and a larger d...
Data originally collected to validate a questionnaire measuring Soldiers' readiness to attend the eArmyU were reanalyzed. eArmyU is a portal to online college-level courses offered by a consortium of universities. The current study applies analytical procedures that provide methodological improvements to the original analysis. Specifically, explora...
Range restriction in most data sets is indirect, but the meta-analysis methods used to date have applied the correction for direct range restriction to data in which range restriction is indirect. The authors show that this results in substantial undercorrections for the effects of range restriction, and they present meta-analysis methods for makin...
The common practice in meta-analyses and in individual studies of correcting for direct range restriction even though range restriction is actually indirect has long been known to lead to undercorrection, but this error has been assumed to be small. Using validity generalization data sets for 4 jobs, this study calibrated this error by comparing me...
The authors report on a large-scale study examining the effects of self-reported psychosocial factors on 1st-year college outcomes. Using a sample of 14,464 students from 48 institutions, the authors constructed hierarchical regression models to measure the predictive validity of the Student Readiness Inventory, a measure of psychosocial factors. C...
Theoretically, low correlations between implicit and explicit measures can be due to (a) motivational biases in explicit self reports, (b) lack of introspective access to implicitly assessed representations, (c) factors influencing the retrieval of information from memory, (d) method-related characteristics of the two measures, or (e) complete inde...
The authors used a rational-empirical approach to construct the Student Readiness Inventory, measuring psychosocial and academic-related skill factors found to predict two important college outcomes, academic performance and retention, in a recent meta-analysis. The initial item pool was administered to 5,970 first-year college students and high sc...
Replies to Weissberg and Owen (2005; see record
2005-04167-005). Citing selective evidence does not substitute for meta-analytic findings when examining potential moderator effects of institutional status and demographic subgroups on psychosocial and study skill predictors of college outcomes. Motivational factors in particular are central to the...
This paper investigates the extent to which differences in the likelihood of emerging as leaders are explained by genetic differences between individuals. Results indicated that approximately 17% of the variance in the latent construct of leadership emergence is explained by genetic effects that are mediated by intelligence and the Big Five persona...
This study examines the relationship between psychosocial and study skill factors (PSFs) and college outcomes by meta-analyzing 109 studies. On the basis of educational persistence and motivational theory models, the PSFs were categorized into 9 broad constructs: achievement motivation, academic goals, institutional commitment, perceived social sup...
On the basis of an empirical study of measures of constructs from the cognitive domain, the personality domain, and the domain of affective traits, the authors of this study examine the implications of transient measurement error for the measurement of frequently studied individual differences variables. The authors clarify relevant reliability con...
The construct meaning of assessment center evaluations is an important unresolved issue in I/O psychology. This study hypothesized that Cognitive Ability and personality traits are primary correlates of evaluators’ overall assessment ratings (OARs). Meta–analysis results based on 65 correlations indicate the following mean construct–level correlati...
Typescript (photocopy). Thesis (Ph. D.)--University of Iowa, 2003. Includes bibliographical references (leaves 234-243).