Publications (17) View all
-
Article: On reconciling conflicting meta-analytic findings regarding integrity test validity.
[show abstract] [hide abstract]
ABSTRACT: We react to the Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012a) meta-analysis of the relationship between integrity test scores and work-related criteria, the earlier Ones, Viswesvaran, and Schmidt (1993) meta-analysis of those relationships, the Harris et al. (2012) and Ones, Viswesvaran, and Schmidt (2012) responses, and the Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012b) rebuttal. We highlight differences between the findings of the 2 meta-analyses by focusing on studies that used predictive designs, applicant samples, and non-self-report criteria. We conclude that study exclusion criteria, correction for artifacts, and second order sampling error are not likely explanations for the differences in findings. The lack of detailed documentation of all effect size estimates used in either meta-analysis makes it impossible to ascertain the bases for the differences in findings. We call for increased detail in meta-analytic reporting and for better information sharing among the parties producing and meta-analytically integrating validity evidence.Journal of Applied Psychology 05/2012; 97(3):550-6. · 4.31 Impact Factor -
Article: How Far Does Stereotype Threat Reach? The Potential Detriment of Face Validity in Cognitive Ability Testing
[show abstract] [hide abstract]
ABSTRACT: A common belief is that improvements in a test's face validity have a positive impact on the performance and perceptions of test takers. However, the stereotype threat literature suggests adding job relevant context to tests could negatively impact the performance of women if that context is traditionally male stereotyped. To test this prediction, 345 participants (n = 236 female) completed either a face valid or generic version of a mathematical and mechanical ability test under conditions of explicit or no explicit stereotype threat. Contrary to stereotype threat theory predictions, face validity had either beneficial or nonsignificant effects on test performance and test perceptions and did not affect the psychometric properties of either test. Implications and recommendations for future research regarding the study of face validity and stereotype threat are discussed.Human Performance 01/2011; 24(1):1-28. · 0.85 Impact Factor -
Article: PERCEIVED INGROUP AND OUTGROUP PREFERENCE: A LONGITUDINAL CAUSAL INVESTIGATION
[show abstract] [hide abstract]
ABSTRACT: Although there has been substantial research on perceptions of preference in hiring, there is considerably less focus on perceptions of preference in organizational activities more generally. Researchers seldom assess perceptions of preference for both historically high- and low-status groups and for both one's own group and others. Using a three-wave longitudinal survey of 1,094 employees, the causal direction between perceived preference and satisfaction with management, moderators of that relationship, and whether responses to perceived preference differed by group were examined. On average, groups perceived more outgroup than ingroup preference. The satisfaction to perceived preference causal direction was significantly stronger than the reverse for outgroup preference, suggesting that increased satisfaction with management leads to decreased future perceptions of outgroup preference more so than vice versa. The relationship between satisfaction with management and perceived outgroup preference was moderated by perceived organizational tolerance of discrimination, suggesting that positive diversity climate can alleviate the negative effects of dissatisfaction with management on perceived outgroup preference.Personnel Psychology 11/2010; 63(4):845 - 879. · 2.93 Impact Factor -
Article: Prediction of 4-year college student performance using cognitive and noncognitive predictors and the impact on demographic status of admitted students.
[show abstract] [hide abstract]
ABSTRACT: This study was conducted to determine the validity of noncognitive and cognitive predictors of the performance of college students at the end of their 4th year in college. Results indicate that the primary predictors of cumulative college grade point average (GPA) were Scholastic Assessment Test/American College Testing Assessment (SAT/ACT) scores and high school GPA (HSGPA) though biographical data and situational judgment measures added incrementally to this prediction. SAT/ACT scores and HSGPA were collected and used in various ways by participating institutions in the admissions process while situational judgment measures and biodata were collected for research purposes only during the first few weeks of the participating students' freshman year. Alternative outcomes such as a self-report of performance on a range of student performance dimensions and a measure of organizational citizenship behavior, as well as class absenteeism, were best predicted by noncognitive measures. The racial composition of a student body selected with only cognitive measures or both cognitive and noncognitive measures under various levels of selectivity as well as the performance of students admitted under these scenarios is also reported. The authors concluded that both the biodata and situational judgment measures could be useful supplements to cognitive indexes of student potential in college admissions.Journal of Applied Psychology 11/2009; 94(6):1479-97. · 4.31 Impact Factor -
Article: Dimensionality and psychometric invariance of the Youth Self-Report Form of the Child Behavior Checklist in cross-national settings.
[show abstract] [hide abstract]
ABSTRACT: The Youth Self-Report Form's (YSR's) factor model was derived from traditional exploratory factor analytical procedures. Assuming appropriate model specification, psychometrically invariant items, and that its items provide useful psychometric information across nations omitted from its normative samples, the YSR is widely used in cross-national studies of nonreferred children. Item response theory analytical procedures reveal (a) 2 dimensions partly overlapping with the YSR's Internalizing and Externalizing second-order factors; (b) variance (i.e., differential item functioning) in how well a few items discriminate for nonreferred children across two nations; and (c) variance in estimating severity levels in children with identical psychopathological severity cross-nationally. Addressing psychometric variance, limiting redundancy, and matching children's psychopathological severity levels with items measuring this severity might promote more accurate and economical assessment.Assessment 10/2007; 14(3):231-45. · 2.01 Impact Factor
