No full-text available
To read the full-text of this research,
you can request a copy directly from the author.
The Validity and Utility of Selection Methods in Personnel Psychology: Practical and Theoretical Implications of 100 Years of Research Findings
... Konkret bedeutet dies, dass neben der Analyse von Bewerbungsunterlagen häufig Arbeitsproben und strukturierte Interviews bei der Personalauswahl in Unternehmen durchgeführt werden. Diese beiden Instrumente haben eine gute Prognosekraft für beruflichen Erfolg (Schmidt et al., 2016;Schmidt & Hunter, 1998; siehe Kapitel 3 Kriteriumsvalidität in dieser Dissertation). Im Folgenden werden die Verwendungshäufigkeiten bei der Personalauswahl von Studierenden, Promovierenden und Professor:innen berichtet. ...
... Die Zusammenhänge zwischen der allgemeinen Intelligenz und objektiven Erfolgsmaßen werden vermutlich unterschätzt, da es innerhalb der Population zu einer Varianzeinschränkung beim Prädiktor kommt (Stadler et al., 2016). Für diese Annahme der Unterschätzung spricht auch, dass kognitiv komplexere Jobs von der allgemeinen Intelligenz besser vorhergesagt werden als weniger komplexe Jobs (Schmidt et al., 2016;Schmidt & Hunter, 1998). Studieren dürfte zu den komplexeren Tätigkeiten zählen. ...
... Eine stärkere Standardisierung verbessert die Vorhersagekraft, die bei der Metaanalyse von Schmidt und Hunter (1998) r = .54 betrug und in einem Update (Schmidt et al., 2016) und einer weiteren Metaanalyse jeweils r = .33 (Roth et al., 2005). ...
Die Personalausauswahl an Universitäten ist von hoher Relevanz. Die vorliegende Disseratation beschäftigt sich mit den Auswahlprozessen von Studierenden, Promovierenden und Postdocs und den Berufungsverfahren von Professor:innen. Der Fokus liegt auf drei elementaren Punkten der Prozesse: Verwendungshäufigkeit, Kriteriumsvalidität und Akzeptanz. Die Arbeit beantwortet die Fragen, welche Verfahren bei der Personalauswahl an Universitäten genutzt werden, wie gut sich mit verschiedenen Verfahren und Konstrukten der Erfolg von Studierenden, Promovierenden und Postdocs, und Professor:innen vorhersagen lässt und wie akzeptiert verschiedene Verfahren bei Personalauswahlverfahren an Universitäten sind. In zwei eigenen Studien werden Forschungslücken geschlossen und neue Erkenntnisse der Literatur ergänzt. Für Studie 1 wurde bei N = 164 Promovierenden erhoben, wie diese tatsächlich ausgewählt wurden. Promotionsstellen wurden am häufigsten durch frei geführte Auswahlgespräche und persönliche Kontakte besetzt. Bei N = 170 potenziellen Bewerbenden für eine Promotionsstelle wurden die Akzeptanzurteile für Auswahlverfahren erfragt. Frei geführte Auswahlgespräche, berufliche Erfahrungen, Arbeitsproben und strukturierte Auswahlgespräche erhielten die höchsten Akzeptanzwerte. Studie 2 beleuchtet die Kriteriumsvalidität und identifizierte Prädiktoren, die in einem Längsschnittdesign sowohl den objektiven als auch den subjektiven Laufbahnerfolg zwei Jahre nach Abschluss der Promotion bei N = 2 104 erfolgreich Promovierten vorhersagen konnten. Die Big Five Persönlichkeitseigenschaften Offenheit für neue Erfahrungen und Neurotizismus waren Prädiktoren für objektiven Laufbahnerfolg. Verträglichkeit und Neurotizismus konnten unterschiedliche Aspekte von subjektivem Laufbahnerfolg vorhersagen. Darüber hinaus konnte mittels Response Surface Analysen ein Persönlichkeits-Anforderungs-Fit in Offenheit für neue Erfahrungen und Extraversion objektiven Laufbahnerfolg vorhersagen.
... The second most valid combination (0.76) is a GMA test and a structured interview. These two are also deemed to be the best combinations as they are less expensive to implement (Schmidt, Oh & Shaffer 2016). ...
... The use of pre-screening devices has hence become increasingly popular. The popularity of the application blank evaluation technique centres on the fact that it facilitates the easy comparison and filtering of applications helps to quickly reduce large pools of applicants (Wickramasinghe 2007) and is believed to be, in part, an indirect assessment of GMA (Schmidt et al. 2016). ...
... The academic qualifications and extracurricular activities of applicants, as documented on their CV are strongly correlated with higher employability (Cole et al. 2007). Educational achievements are also a key determinant of the job level, quality and income a person can attain (Brewer 2013;Schmidt et al. 2016). The type of secondary education (incorporating subject choice) held by applicants was informative in revealing their general and technical aptitudes. ...
Orientation: The artisan job family is the number one area of concern with regard to filling
vacancies both nationally and globally. Hence, artisanship has been identified as a scarce and critical skill. The domestic economy and the effectiveness and success of many organisations could be strengthened if the artisanal crisis is adequately addressed.
Research purpose: This article proposes a screening process for organisations to use during the selection of apprentices. The selection process has four phases: application review, rating of application documentation, aptitude testing and skills-based teamwork assessment, and interviews. The effect of the selection phases on the survival of the applicants was investigated.
Motivation for the study: This study adds to the limited body of literature on artisans,
apprentices and the selection of individuals for these technical positions. In addition, it
provides recommendations to optimise the selection process for this job family.
Research design, approach and method: Large amounts of archived data from an annual
apprentice selection process at a large multinational automotive firm were accessed.
A quantitative measure, survival analysis, was used to assess whether the survival curves
were statistically different across the groups.
Main findings: The four selection phases had a significant effect on the survival time of the applicants in the selection process. The significance of the Gehan–Wilcoxon statistic suggests that the survival distribution across the applicants was not because of chance but rather indicates a true difference in the data. The constructs assessed at each phase had a significant effect on the selection success of the apprentice applicants. The termination rate of applicants was steady across all four selection phases.
Practical/managerial implications: The multiple-hurdle selection process employed in this
study should be replicated and employed as the national selection tool for apprentices. The use of standardised application documentation is recommended, and job preparation
workshops should be provided to assist apprentice applicants.
Contribution/value-add: The findings of this study are relevant to the South African
automotive industry, as well as the manufacturing sector. The findings are also of value to
human resource practitioners, educators, social scientists, and industrial and organisational psychologists.
Keywords: apprentice; artisan; human resource; selection; selection process; staffing.
... Individuals with higher intelligence are more likely to advance professionally and earn higher incomes (Schmidt and Hunter, 2004;Schmidt, 2009). Numerous meta-analyses show a positive relationship between intelligence and job performance (Hunter, 1986;Schmidt and Hunter, 1998;Gottfredson, 2003;Kuncel et al., 2004;Schmidt, 2009;Wai, 2014;Schmidt et al., 2016;Murtza et al., 2020), where the strength of the relationship may be overestimated due to the methods used (Richardson and Norgate, 2015). Meta-analyses show a higher correlation during training (r = 0.63) than after training (r = 0.55), but intelligence remains the best predictor of job performance even with increasing work experience (Schmidt and Hunter, 2004). ...
... A higher expression of general intelligence appears to lead to higher performance in all occupations. Thus, general intelligence predicts occupational performance better than special talents as well as non-cognitive factors such as occupational interest and other personality traits (Hunter, 1986;Ree et al., 1994;Schmidt andHunter, 1998, 2004;Gottfredson, 2003;Schmidt et al., 2016). Additionally, intelligence correlates positively with job satisfaction in most studies (Wulff et al., 2009;Thompson and Lane, 2014;Murtza et al., 2020). ...
... In addition, they frequently hold positions with personnel responsibility. This confirms previous results of meta-analyses on the occupational situation of highly intelligent individuals (Kuncel et al., 2004;Schmidt and Hunter, 2004;Schmidt, 2009;Herrnstein and Murray, 2010;Pässler et al., 2015;Schmidt et al., 2016;Murtza et al., 2020). It seems that gifted people also realize their potential at work. ...
A person's intelligence level positively influences his or her professional success. Gifted and highly intelligent individuals should therefore be successful in their careers. However, previous findings on the occupational situation of gifted adults are mainly known from popular scientific sources in the fields of coaching and self-help groups and confirm prevailing stereotypes that gifted people have difficulties at work. Reliable studies are scarce. This systematic literature review examines 40 studies with a total of 22 job-related variables. Results are shown in general for (a) the employment situation and more specific for the occupational aspects (b) career, (c) personality and behavior, (d) satisfaction, (e) organization, and (f) influence of giftedness on the profession. Moreover, possible differences between female and male gifted individuals and gifted and non-gifted individuals are analyzed. Based on these findings, implications for practice as well as further research are discussed.
... The second most valid combination (0.76) is a GMA test and a structured interview. These two are also deemed to be the best combinations as they are less expensive to implement (Schmidt, Oh & Shaffer 2016). ...
... The use of pre-screening devices has hence become increasingly popular. The popularity of the application blank evaluation technique centres on the fact that it facilitates the easy comparison and filtering of applications helps to quickly reduce large pools of applicants (Wickramasinghe 2007) and is believed to be, in part, an indirect assessment of GMA (Schmidt et al. 2016). ...
... The academic qualifications and extracurricular activities of applicants, as documented on their CV are strongly correlated with higher employability (Cole et al. 2007). Educational achievements are also a key determinant of the job level, quality and income a person can attain (Brewer 2013;Schmidt et al. 2016). The type of secondary education (incorporating subject choice) held by applicants was informative in revealing their general and technical aptitudes. ...
Orientation: The artisan job family is the number one area of concern with regard to filling vacancies both nationally and globally. Hence, artisanship has been identified as a scarce and critical skill. The domestic economy and the effectiveness and success of many organisations could be strengthened if the artisanal crisis is adequately addressed.
Research purpose: This article proposes a screening process for organisations to use during the selection of apprentices. The selection process has four phases: application review, rating of application documentation, aptitude testing and skills-based teamwork assessment, and interviews. The effect of the selection phases on the survival of the applicants was investigated.
Motivation for the study: This study adds to the limited body of literature on artisans, apprentices and the selection of individuals for these technical positions. In addition, it provides recommendations to optimise the selection process for this job family.
Research design, approach and method: Large amounts of archived data from an annual apprentice selection process at a large multinational automotive firm were accessed. A quantitative measure, survival analysis, was used to assess whether the survival curves were statistically different across the groups.
Main findings: The four selection phases had a significant effect on the survival time of the applicants in the selection process. The significance of the Gehan–Wilcoxon statistic suggests that the survival distribution across the applicants was not because of chance but rather indicates a true difference in the data. The constructs assessed at each phase had a significant effect on the selection success of the apprentice applicants. The termination rate of applicants was steady across all four selection phases.
Practical/managerial implications: The multiple-hurdle selection process employed in this study should be replicated and employed as the national selection tool for apprentices. The use of standardised application documentation is recommended, and job preparation workshops should be provided to assist apprentice applicants.
Contribution/value-add: The findings of this study are relevant to the South African automotive industry, as well as the manufacturing sector. The findings are also of value to human resource practitioners, educators, social scientists, and industrial and organisational psychologists.
... In the final stage of the assessment process, each candidate is thoroughly discussed and the judges recommend either hiring or not hiring them. However, a recent meta-analysis of personnel selection procedures in general found the predictive validity of ACs to be markedly below the criterion validity of other selection procedures (Schmidt, Oh, and Shaffer 2016). Consequently, more research above and beyond the classic studies (Bray and Campbell 1968;Burroughs and White 1996;Cron et al. 2005;Randall et al. 1985) is missing on how to improve the selection and recruitment of salespersons based on ACs (Kleinmann and Ingold 2019). ...
... A recent meta-analysis of personnel selection procedures reports that ACs have substantial operational validity (.36) for overall job performance; nevertheless, this is markedly below the criterion validity of other selection procedures, such as employment interviews (.58) or general mental ability (GMA) tests (.65;Schmidt, Oh, and Shaffer 2016). Although GMA is a powerful predictor of job performance in many jobs, a meta-analysis has shown that GMA does not predict objective sales volume among professional salespeople, while verbal intelligence actually negatively predicts sales performance with correlations varying between −.05 and −.54 (Verbeke et al. 2008;Vinchur et al. 1998). ...
... In order to assess the operational validity (Hunter and Schmidt 2014;Schmidt, Oh, and Shaffer 2016) of the socioanalytic approach to AC selection processes, we corrected for range restriction in the 'motivation for sales success x social competence' predictor from Hypothesis 4 in Table 6 (Model 2: ß = .42, Model 3a: ß = .32, ...
Assessment centers (AC) are one of the most common selection and recruitment methods in today’s business world, with very high acceptance in practice. The AC research literature, however, has focused on managerial performance and neglected sales performance. Therefore, we assessed the features of ACs for sales positions. The results indicated that AC ratings designed for sales positions exhibited good interrater agreement and were distinct. The criterion-related validity of AC observer ratings was in the normal range of ACs designed for managerial jobs in terms of overall assessment rating scores. Additionally, we tested a new approach to ACs for salesperson selection based on the socioanalytic theory of personality. We hypothesized and found that motivation for sales success combined with social competence predicts field sales performance one year later. This interaction effect explained incremental variance in objective performance above and beyond exercises and overall assessment rating scores. Operational validity compared to the traditional approach increased by 25%. The true score criterion validity of the new approach was .49. We discuss implications and limitations.
... Cognitive ability tests assess a candidate's ability to reason, verbal and mathematical ability, problem-solving skills, memorization, and perceptual and processing speed. Although not without its own problematic history (Hunter and Schmidt 1996;Ployhart and Holtz 2008), cognitive ability has remained an important construct to measure in job selection due to its strong and well-established relationship to job performance (Kuncel et al. 2010;Schmidt and Hunter 1998;Schmidt and Hunter 2004;Schmidt et al. 2016) and is widely used in applied settings today (Bertua et al. 2005;Schmidt and Hunter 2004). The tests usually administered by organizations are typically shorter and narrower in scope than the intelligence tests administered by medical professionals (e.g., Kuo and Eack 2020). ...
... Game-based measures of cognitive ability were considered in this study for several reasons. First, prior research indicates that cognitive ability is one of the strongest predictors of future job performance (Schmidt et al. 2016), making it a valuable tool in job selection. Second, assessing non-social cognitive traits in a non-social manner may provide a fair way to assess both autistic and neurotypical candidates' readiness Figures 1 and 2, the proportional distribution of scores appear roughly equal across both game packages. ...
... Game-based measures of cognitive ability were considered in this study for several reasons. First, prior research indicates that cognitive ability is one of the strongest predictors of future job performance (Schmidt et al. 2016), making it a valuable tool in job selection. Second, assessing non-social cognitive traits in a non-social manner may provide a fair way to assess both autistic and neurotypical candidates' readiness ...
Although people with autism are protected under the Americans with Disabilities Act of 1990, there is little theoretical or practical effort to determine whether traditional pre-employment assessments unfairly impact autistic job seekers. Due to the lack of emphasis on social communication, game-based assessments (GBAs) may offer a way of assessing candidate ability without disadvantaging autistic candidates. A total of 263 autistic job seekers took one of two game-based assessment packages designed to measure cognitive ability. After comparing their results to 323 college-graduate job seekers in the general population, we found that performance on the GBAs was generally similar in both populations, although some small differences were detected. Implications for hiring decisions are discussed.
... To enable this to be put into practice, psychometric standards such as reliability, validity, and fairness are applied in the decisionmaking process, which generally follows a systematic, logical, or sequential order (Yusko et al., 2017). Also, when evaluating the outcomes of selection decisions, the practical utility and cost-effectiveness of recruitment and selection methods and procedures are of major concern for industrial psychologists and managers alike (Schmidt et al., 2016). ...
... for biographical information, 5% for years of job experience, 1% for years of education, and 0% for age (Schmidt et al., 2016). Attribution errors, based on visible characteristics or spelling in the applicant blank or résumé, might bias evaluators' perception of candidates' suitability for a position (Lacroux & Martin-Lacroux, 2020;Martin-Lacroux, 2017). ...
... Most organisations attempt to confirm the accuracy of biographical information by contacting former employers and the persons named as references. According to Schmidt et al. (2016), the incremental validity of reference checks over cognitive ability is estimated to be 8%. However, references might be perceived to be distorted in an overly positive direction so that they may be useless in distinguishing among applicants. ...
Organisational success, to a large extent, depends on the quality of people employed. The race for talented personnel or workers is becoming increasingly more competitive amidst technological
advances and employers’ accessibility to talented people across the globe. Effective recruitment and selection processes that are sufficiently advanced and based on evidence of job competency and
person-organisation, -job and -team fit are crucial for the expansion or replenishment of talented employees in the modern workplace. This chapter reviews the theory and practice of recruitment and selection from the perspective of personnel psychology. The application of psychometric standards in the decision-making process is discussed, including the aspects of employment equity and fairness in the recruitment and selection process.
... A. Terpstra et al., 1999). Additionally, the structured interview provides incremental validity beyond other selection measures and is typically facevalid to the applicant (Schmidt et al., 2016). Given this, organizations should take the design and conduct of interviews seriously if they wish to get the most out of the employment interview. ...
... In contrast, they found that low structure interviews had a mean criterion-validity of only .20 (SD = .08). This difference in predicting job performance is largely due to the fact that structured interviews have greater reliability (Schmidt et al., 2016). ...
... Structured interviews also offer excellent incremental validity, or additional predictive power, to selection procedures that use cognitive ability as a lone predictor of job performance (Campion et al., 1994Cortina et al., 2000;Dipboye, 1994;Schmidt et al., 2016). In a recent meta-analytic review by Schmidt et al. (2016) where they examined 100 years of research in personnel psychology, they found that behind tests of general mental ability and integrity tests (mean validity of .78), ...
Despite the numerous benefits structured interviews offer, prior research and literature has shown that hiring professionals are inclined to use unstructured interviews over structured interviews. While unstructured interviews are convenient, they pose several severe limitations when compared to structured interviews. Namely, unstructured interviews can result in adverse legal outcomes, significantly worse predictive validity, and difficulty in comparing applicants. Our research examines if three variables: Interviewer conventional personality, interviewer training, and recording improve the acceptance and use of structured interviews. Our study included 171 hiring managers from the SIOP user directory, SIUE alumni from the I/O psychology program, Human Resource managers from the Society for Human Resources Management (SHRM), and managers recruited through Amazon’s Mechanical Turk (MTurk). Our survey found that interviewer training helped improve acceptance and content standardization of the interview. Neither interviewer conventional personality nor recording of the interview improved structured interview acceptance or use. However, our results did find that structured interviews are used more often than previously thought and that recording was used by a third of respondents to compare applicants or for legal defense. We found marginal support that interviewers who recorded their interviews reported using lower content standardization. Given our findings, we recommend that interviewer training be used to improve structured interview acceptance and use above and beyond recording.
... In the general population, educational level and cognitive ability correlate about r = .55 (Schmidt, Oh, & Shaffer, 2016;Strenze, 2007). However, relations between cognitive ability and educational level can be expected to be much lower in job applicant samples, due to educational requirements (e.g., college degree, JD, MD) for occupational entry. ...
... Worldwide, they remain a common method used in personnel selection, though in the United States the legal climate during the last quarter of the twentieth century caused a decline in their use. Even though over 30 states have enacted laws that limit legal liability from providing bona fide job references, these legislations have not had a major impact on the willingness of US employers providing anything more than information on the dates of employment and the positions that the former employee held (Schmidt et al., 2016). Employers possess rich and probably highly predictive information about their previous employees (e.g., disciplinary record, productivity), but such information remains inaccessible to subsequent employers at least in the US. ...
... N = 2,018). However, Schmidt et al. (2016) argued that the validity of reference checks is unlikely to reach similar levels in current organizations, at least in the US. We believe that traditional reference checks are outmoded in this day and age of technology and are being replaced by background checks that involve social and technological media (Roth, Bobko, Van Iddekinge, & Thatcher, 2016). ...
... If the outcomes cannot be trusted, then significant harm could be done to the psychological contract. Due to this risk, literature has alerted researchers and practitioners to the need for deep evaluation of the measurement properties of assessments (Schmidt, Oh, & Shaffer, 2016). ...
... Validity, in turn, is concerned with the correct application of the assessment tool or technique (Dick & Hagerty, 1971). However, when it comes to trusting assessment results, organisations and assessment users are often more interested in the assessments' practical value, which is also known as the assessment tool's utility (Schmidt et al., 2016). Assessment utility is determined through understanding the tool's predictive validity i.e. the tool's ability to predict, for example, future job performance, job-related learning and an employee's ability to adapt to complexity (Schmidt et al., 2016). ...
... However, when it comes to trusting assessment results, organisations and assessment users are often more interested in the assessments' practical value, which is also known as the assessment tool's utility (Schmidt et al., 2016). Assessment utility is determined through understanding the tool's predictive validity i.e. the tool's ability to predict, for example, future job performance, job-related learning and an employee's ability to adapt to complexity (Schmidt et al., 2016). ...
The definition of work has been significantly impacted by the rise of the open talent economy and a greater focus on outcome-based work design. These changes have led to a reconceptualisation of the psychological contract as organisations seek new ways of work to achieve sustainable success, whilst employees are expecting work design as part of an attractive employee value proposition. With the acceleration of the changing world of work it has become imperative to explore how organisations respond to the changing psychological contract. The chapter provides a high-level and speculative perspective on the trends that will impact the world of work over the coming years and positions these trends as changes to what we refer to as ‘work’.
... Reasoning, also known as fluid intelligence (Gf), has commonly been acknowledged as an essential aspect of fundamental cognitive abilities and has been regarded as the best measure of Spearman's g-factor (general mental ability; Carroll, 1993). In turn, general intelligence has been considered to be one of the best predictors of academic and professional success (e.g., Carroll, 1993;Mittring & Rost, 2008;Schmidt et al., 2016). Thus, the assessment of reasoning abilityin the most reliable, valid, and fair way possibleis a widely used approach for determining aptitude for schools, universities, and occupational careers. ...
... Reasoning ability has commonly been regarded as one of the best predictors of success in academic and occupational careers (e.g., Schmidt et al., 2016), and although reasoning tasks rank among the most employed cognitive assessments, test developers have stuck to the same response format for decades. Furthermore, most existing reasoning tests were developed for average performance groups (Ostapczuk et al., 2011), and as the leaking of test items is a current problem (International Test Commission, 2014), we created a novel figural matrices test for highstakes aptitude assessments at advanced cognitive performance levels. ...
Reasoning ability has commonly been regarded as the best predictor of academic and occupational success. Due to concerns about the validity of multiple-choice (MC) formats, test security breaches, and the fact that the difficulty levels of most existing reasoning assessments target the population mean, there is a constant need for new reliable and valid test instruments that can be applied to assess fluid intelligence in advanced cognitive performance areas. We developed a novel computerized figural matrices test to assess nonverbal reasoning for university student aptitude assessment. In two studies, we generated, revised, and empirically validated the Isometric Matrices Test (IMT). Our results show that the IMT is less prone to test-wiseness strategies than existing reasoning tests. In a third study, we created and evaluated an innovative Find the Mistake (FtM) response format as an alternative to classical multiple-choice formats. Overall, both response formats revealed satisfactory psychometric quality in terms of item difficulties and discrimination, test-retest reliability, construct and criterion validity, and Rasch or two-parameter logistic (2PL) model fit, but in one MC version, the internal consistency was low due to negative discrimination indices. The MC response format turned out to be easier than the FtM format, with men slightly outperforming women in both response modes. We propose the IMT as a useful tool for assessing nonverbal reasoning ability in above-average performance areas and discuss the automatic generation of larger IMT item pools for adaptive testing in order to increase test security and reliability.
... The Brazilian context for selecting millions of people for the public sector has been a noble concern for decades, especially toward fighting personalisms, but it overshadows other important concerns. Little or no attention has been paid, for example, to the predictive capacity of selections and to a greater incremental validity of examinations in disagreement with relevant international literature on such subjects (Hunter, Schmidt, & Judiesch, 1990;Joseph, Jinh, Newman, & O'Boyle, 2015;Schmidt & Hunter, 1998, 2015Schmidt, Oh, & Shaffer, 2016). ...
... In addition, the international literature also considers other factors ranging from the refinement of self-reported emotional intelligence (Joseph et al., 2015) to the relevance and validity of structured interviews, as mapped by Schmidt and Hunter (1998) with theoretical and empirical data during a period of 85 years, extended to 100 years (Schmidt et al., 2016). Such aspects seem almost unthinkable in the exam model that has dominated Brazil for more than half a century, although a small minority of positions (prosecutors, federal professors, public defenders, etc.) have procedures similar to interviews. ...
When 58% of administrative staff and 87% of physicians were selected based solely on theoretical multiple-choice tests, is there meritocracy? No experience required, no discursive or practical assessments. Just mark an "x"... This article seeks to answer a historically constructed assumption and assimilated as a kind of myth in Brazil: the idea that the current model for filling government positions would be meritocratic. The extreme objectivity of these public examinations reduces the Brazilian tradition of nepotism, but the evaluation model has serious flaws. One of the flaws is academicism, which overvalues educational titles and theoretical knowledge at the expense of essential skills for many government positions. Calls for civil service entrance examinations to fill administrative and medical positions in federal institutions of higher education throughout Brazil were verified using the descriptive statistics method (via frequency analysis), tabulating the evaluative types used in each selection and
generating related tables and graphs. Based on the results, the study suggests adopting assessments that are more broadly connected with the competencies of the positions and that instead of privileging theoretical knowledge of little or no applicability, prioritize
skills and practical behaviors inherent to the positions. The study points out alternatives for a nation with more than 200 million inhabitants, the vast majority of which do not realize the incalculable damage of real academicism and an illusory meritocracy.
... Psychological testing is often used in the real world in making important decisions such as school admittance; employee hiring and promotion; military personnel selection, placement, and enrollment into training programs; family court rulings; and criminal culpability (e.g., Amrein & Berliner, 2002;Erickson et al., 2007;Hartmann et al., 2003;Heilbrun, 1992;Nwafor & Adesuwa, 2014). A consistent finding in this area is that general mental ability (namely, psychometric intelligence) is the best predictor of academic performance, training success, job performance, and career potential (Bosco et al., 2015;Gottfredson, 1986;Kuncel et al., 2004;Ree & Earles, 1992;Schmidt et al., 2016;Schmidt & Hunter, 1998;Song et al., 2010)-hence, why many personnel selection tests place heavy demands on accumulated knowledge (crystalized intelligence) and reasoning ability (fluid intelligence). ...
... But it is still imperative from a legal, moral, and practical (e.g., economical) standpoint that researchers and practitioners strive to minimize the extent to which these differences are reflected in test scores, and consequently the extent to which tests result in adverse impact (see Burgoyne et al., 2021;Ceci & Papierno, 2005). Critical reviews and examinations have found that one of the most effective strategies for combating subgroup differences, and thus adverse impact, is to use noncognitive selection methods such as personality assessments (e.g., integrity and conscientiousness), biographical data, and structured interviews, as these methods can reduce or even eliminate subgroup differences and may improve prediction of job performance when used in addition to cognitive tests (Bobko et al., 1999;Newman & Lyon, 2009;Ployhart & Holtz, 2008;Pulakos & Schmitt, 1996;Roth et al., 2001;Schmidt et al., 2016;Schmitt et al., 1997;Sinha et al., 2011). However, adding noncognitive tests is not universally practiced because it results in increased administration time and some practitioners are concerned that using this approach reduces overall predictive validity (the so-called diversity-validity dilemma; see Campion et al., 2001;Ployhart & Holtz, 2008). ...
Working memory capacity is an important psychological construct, and many real-world phenomena are strongly associated with individual differences in working memory functioning. Although working memory and attention are intertwined, several studies have recently shown that individual differences in the general ability to control attention is more strongly predictive of human behavior than working memory capacity. In this review, we argue that researchers would therefore generally be better suited to studying the role of attention control rather than memory-based abilities in explaining real-world behavior and performance in humans. The review begins with a discussion of relevant literature on the nature and measurement of both working memory capacity and attention control, including recent developments in the study of individual differences of attention control. We then selectively review existing literature on the role of both working memory and attention in various applied settings and explain, in each case, why a switch in emphasis to attention control is warranted. Topics covered include psychological testing, cognitive training, education, sports, police decision-making, human factors, and disorders within clinical psychology. The review concludes with general recommendations and best practices for researchers interested in conducting studies of individual differences in attention control.
... According to individual-environmental fit theories (Edwards, 2008;Kristof-Brown & Guay, 2011;Su et al., 2015), the congruence between characteristics of employees and characteristics of working environment (e. g. compatibility of personality traits, abilities, and values with job requirements and organizational culture) is essential in the field of career counselling, personnel management and industrial and organizational psychology. Although research on individual differences has been ongoing for over 100 years (Sackett et al., 2017), vocational interests are also valid predictor of job performance (Nye et al., 2012(Nye et al., , 2017 above and beyond cognitive abilities and personality, in addition to cognitive abilities and personality traits that are stable individual characteristics for predicting job performance Salgado, 2017;Schmidt et al., 2016;Schmidt & Hunter, 1998). As workplaces change rapidly, the needs of future employees also may change -such skills as flexibility and learning are among the 21 st century employability skills (De Fruyt et al., 2015), therefore additional predictors of job performance may be explored. ...
... Personality as a stable individual characteristic of employees has been researched in work settings (Rojon et al., 2015;Sackett & Walmsley, 2014;Salgado, 1997Salgado, , 2017Schmidt et al., 2016;Schmidt & Hunter, 1998). Costa (1996) states that personality can be explained by five core factors -extraversion, agreeableness, openness to experience, conscientiousness, and neuroticism. ...
The present study was designed to distinguish non-cognitive predictors of job performance for various job groups in order to develop a method for identification of the suitability of an employee for positions and career development in organizational settings. This study included personality traits, vocational interests, grit, growth mindset, resistance to change, goal orientation and self-efficacy as potential predictors of job performance from several individual characteristics related to training, learning and job performance found in the literature. The study sample included customer service specialists, support specialists and managers from five different companies in Latvia. The results show that grit, social, conventional, and enterprising interests are significant predictors of subjective job performance. Personality traits, self-efficacy, growth mindset, resistance to change and goal orientation did not predict job performance in this sample. The relationship between subjective job performance and personality traits for conscientiousness and neuroticism is weak. The results are partly in line with other studies. Possible explanations of results and future directions are offered.
... A pioneering and influential meta-analysis examining the validity of selection tools to predict job and training performance has been conducted by Schmidt and Hunter (1998), with still ongoing follow-up investigations (Schmidt, Oh, & Shaffer, 2016). Overall, this metaanalytic work learned that general mental ability showed consistent substantive positive relationships with both job and training performance, with validity coefficients around .50. ...
... Congruency measures predicted these criteria better than interest assessments alone. For an extensive review of different measures and methods see Schmidt et al. (2016). ...
Laburpena: Ebidentzia gehiago erabiltzen bada, kalitate hobekoa eta garrantzitsua, arazoa zehaztasun handiagoz identifikatuko da eta emaitza hobeak lortuko dira giza baliabideen politikak eta estrategiak diseinatzerakoan erabakiak hartzean. Dokumentu honek helburu du ebidentzian oinarritutako erreklutamendu- eta hautaketa-prozesu baten alde egitea, ikerketa aurreratu baten berrikuspenaren bidez. Hautaketako eta langile-hautaketako profesionalentzako lau erronka nagusi hauei buruzko ikerketa berrikusiko da: talentua definitzea, erakartzea, ebaluatzea eta garatzea. Izan ere, hautaketak eta garapenak batera joan behar dute. Gainera, azpimarratzen du zeinen garrantzitsua den konstruktu eta metodoak aintzat hartzea lan-jarduera aurreikusteko, erakundeek ebidentzian oinarritutako garapen- eta hautaketa-politika bat diseinatu behar dutenean. Azkenik, jarraibide batzuk ematen dira, ebidentzian oinarritutako gomendioak ezartzeari buruz, erakundearen estrategian eta jarduera operatiboetan. Resumen: El uso de más evidencia, de mejor calidad y relevante, resultará en una identificación más precisa del problema y mejores resultados en la toma de decisiones al diseñar políticas y estrategias de recursos humanos. El objetivo de este documento es abogar por un proceso de reclutamiento y selección basado en la evidencia mediante la revisión de la investigación más avanzada sobre cuatro desafíos principales para los profesionales de selección y selección de personal: definir, atraer, evaluar y desarrollar talento, ya que la selección y el desarrollo deben ir de la mano. Además, enfatiza la importancia de considerar la validez de constructos y métodos para predecir el desempeño laboral al diseñar una política de desarrollo y selección basada en la evidencia dentro de las organizaciones. Finalmente, se proporcionan directrices sobre cómo implementar recomendaciones basadas en evidencia en la estrategia de la organización y las actividades operativas. Abstract: Using more, better quality, and relevant evidence is likely to result in more accurate problem identification and better decision-making outcomes when designing HR policies and strategies. The aim of this paper is to advocate for an evidence-based recruitment and selection process by reviewing the state-of-the-art research on four major challenges for staffing and selection professionals: defining, attracting, assessing, and developing talent, as selection and development should go hand-inhand. Furthermore, it stresses the importance of considering the validity of constructs and methods to predict job performance when designing an evidence-based selection and development policy within the organizations. Finally, guidelines on how to implement evidence-based recommendations into the organization’s strategy and operational activities are provided.
... Psychological testing is often used in the real world in making important decisions such as school admittance; employee hiring and promotion; military personnel selection, placement, and enrollment into training programs; family court rulings; and criminal culpability (e.g., Amrein & Berliner, 2002;Erickson et al., 2007;Hartmann et al., 2003;Heilbrun, 1992;Nwafor & Adesuwa, 2014). A consistent finding in this area is that general mental ability (namely, psychometric intelligence) is the best predictor of academic performance, training success, job performance, and career potential (Bosco et al., 2015;Gottfredson, 1986;Kuncel et al., 2004;Ree & Earles, 1992;Schmidt & Hunter, 1998;Schmidt et al., 2016;Song et al., 2010), hence why many personnel selection tests place heavy demands on accumulated knowledge (crystalized intelligence) and reasoning ability (fluid intelligence). ...
... But it is still imperative from a legal, moral, and practical (e.g., economical) standpoint that researchers and practitioners strive to minimize the extent to which these differences are reflected in test scores, and consequently the extent to which tests result in adverse impact (see Burgoyne et al., 2021;Ceci & Papierno, 2005). Critical reviews and examinations have found that one of the most effective strategies for combating subgroup differences, and thus adverse impact, is to use non-cognitive selection methods such as personality assessments (e.g., integrity and conscientiousness), biographical data, and structured interviews, as these methods can reduce or even eliminate subgroup differences and may improve prediction of job performance when used in addition to cognitive tests (Bobko et al., 1999;Newman & Lyon, 2009;Ployhart & Holtz, 2008;Pulakos & Schmitt, 1996;Roth et al., 2001;Schmidt, 2016;Schmitt et al., 1997;Sinha et al., 2011). However, adding non-cognitive tests is not universally practiced because it results in increased administration time and some practitioners are concerned that using this approach reduces overall predictive validity (the so-called diversity-validity dilemma, see Campion et al., 2001;Ployhart & Holtz, 2008). ...
Working memory capacity is an important psychological construct and many real-world phenomena are strongly associated with individual differences in working memory functioning. Although working memory and attention are intertwined, several studies have recently shown that individual differences in the general ability to control attention is more strongly predictive of human behavior than working memory capacity. In this review, we argue that researchers would therefore generally be better suited to studying the role of attention control rather than memory-based abilities in explaining real-world behavior and performance in humans. The review begins with a discussion of relevant literature on the nature and measurement of both working memory capacity and attention control, including recent developments in the study of individual differences of attention control. We then selectively review existing literature on the role of both working memory and attention in various applied settings and explain, in each case, why a switch in emphasis to attention control is warranted. Topics covered include psychological testing, cognitive training, education, sports, police decision making, human factors, and disorders within clinical psychology. The review concludes with general recommendations and best practices for researchers interested in conducting studies of individual differences in attention control.
... Wanneer de interessedomeinen wel matchen met overeenkomstige functies, zien we aanzienlijk hogere correlatiecoëfficiënten (r = .31; Schmidt, Oh, & Shaffer, 2016). Maar niet alle interessevragenlijsten zijn even valide. ...
... Kandidaten krijgen korte situaties voorgelegd en er wordt gevraagd om elke situatie te (Corstjens, Lievens, & Krumm, 2017). Deze opvattingen hebben implicaties voor de ontwikkeling van SJT's: Items worden eerder deductief dan inductief ontwikkeld, er wordt minder context aangeboden en er wordt een beperkter aantal (soms slechts één) antwoordalternatief voorgelegd aan sollicitanten (single response SJT's, Motowidlo, Crook, Kell, & Naemi, 2009 (Schmidt en Hunter, 1998;Schmidt, et al., 2016). Soms is de voorspellende waarde van gedragsproeven iets lager. ...
Het selecteren van goede werknemers is van groot belang voor het garanderen van goed functionerende organisaties. Allereerst bekijken we de huidige wetenschappelijk stand van zaken met betrekking tot het selecteren van werknemers. We bespreken de verschillende fases van een selectieprocedure, perspectieven om naar selectie te kijken en het selectiemodel. We eindigen het eerste deel met een kritische bespreking van de voornaamste selectie-instrumenten op basis van de best beschikbare wetenschappelijke evidentie en een samenvattende testwijzer. Vervolgens illustreren we een aantal recente uitdagingen voor werving en selectie aan de hand van casussen; we eindigen met een kritische noot over de zogenoemde scientist-practitioner gap (de kloof tussen wetenschap en praktijk) en wat we hieraan kunnen doen.
... Cognitive assessment is usually carried out by means of cognitive tests, often described in the literature as standardised tools that allow cognitive abilities to be assessed in a "reliable, standardised and objective" way (Ones, Dilchert, Viswesvaran, & Salgado, 2010). Their use is ideal both for the power of their prediction on certain business outcomes and for their lower cost of application (Schmidt & Hunter, 1998;Sonnentag, Volmer, & Spychala, 2008;Salgado, 2017;Schmidt, Oh, & Shaffer, 2016). As intelligence models have been developed and tested for more than a century, the theoretical foundations of cognitive tests are stronger than those of other selection methods (Schmidt, Oh & Shaffer, 2016;Salgado, 2017). ...
... Their use is ideal both for the power of their prediction on certain business outcomes and for their lower cost of application (Schmidt & Hunter, 1998;Sonnentag, Volmer, & Spychala, 2008;Salgado, 2017;Schmidt, Oh, & Shaffer, 2016). As intelligence models have been developed and tested for more than a century, the theoretical foundations of cognitive tests are stronger than those of other selection methods (Schmidt, Oh & Shaffer, 2016;Salgado, 2017). Nevertheless, the tests recognised in the literature do not have a digital version that is much more adapted to the professional environment and the advances of the 21st century. ...
"Recruiting today is no longer what it used to be. Digital transformation has deeply changed the company, and particularly the recruitment process. The challenges linked to this transformation are two-fold: practical and scientific. Indeed, the world of human resources needs new tools to detect potentials. Research must meet this need by adapting, modernizing and scientifically validating the tools. To predict job performance, cognitive and soft skills, often referred to as ""21st century skills"", are now central to recruitment, talent development and career management. The objective of our study was to create digital versions of cognitive tests, based on reliable and well-known theoretical foundations. We want to present in detail the conception and construct validity of two of our online tests: the first one inspired by the Stroop effect (Stroop, 1935), the second one based on corsi blocks (Corsi, 1972). We hypothesise that the tests we created are positively correlated to the original ones. 91 participants were interviewed, aged between 18 and 58 (average = 34.57 years old, SD = 10.91). The proportion of women was 76.6% (n = 69), compared to 24.4% of men (n = 22). They all answered the original tests first, face-to-face, and a few months later, the digital ones we had created. We observed positive correlations between the two series of results. These very encouraging results will be clarified and discussed. These two new versions shed light on the candidates' attention and memory abilities that should be enriched during an interview focused on soft skills. In fact, the highest predictability is guaranteed by a method which necessarily combines cognitive evaluations and with other types of assessments, such as personality tests (Güler, Bayrak & Ocaks, 2019). This is why it is important to continue research efforts on the adaptation of digital cognitive tests in a professional environment."
... This requires a latent construct that is suitable for automatic item generation and useful in the context of personnel selection. Since intelligence is the best singular predictor of job performance (e.g., Ree et al., 1994;Schmidt et al., 2016;Schmidt & Hunter, 1981, 1998Ziegler et al., 2011) and working memory is a good predictor of intelligence (e.g., Gignac, 2014;Kane et al., 2005;Oberauer et al., 2005), working memory seems to be excellent for personnel selection purposes, especially for OA. Moreover, working memory is highly suitable for automatic item generation because most test procedures that measure working memory involve repetitive tasks that differ only in their length or semantic content, for example. ...
... It is common knowledge that intelligence is the best predictor of job performance when only one predictor is considered (Ganzach & Pankaj, 2018;Ree et al., 1994;Scherbaum, Goldstein, Yusko, Ryan, & Hanges, 2012;Schmidt et al., 2016;Schmidt & Hunter, 1981, 1998Ziegler et al., 2011). This is unsurprising considering that different cognitive abilities correlate more strongly with each other as time goes on and are closely interwoven with one another (Breit, Brunner, & Preckel, 2020). ...
Wie die meisten westlichen Streitkräfte, bewegt sich die Bundeswehr im Spannungsfeld zwischen hohem Personalbedarf und Fachkräftemangel. Durch ein Onlineassessment kann der Bewerbungsprozess dahingehend optimiert werden, dass fähiges Personal schneller gebunden wird. Onlineassessment hat diverse Vorteile, gleichzeitig sind damit jedoch Herausforderungen verbunden. Die wahrscheinlich größte ist es, Betrug zu minimieren, da Onlineassessment in einer weitestgehend unkontrollierten Umgebung stattfindet. Zur Entgegnung dieser Problematik dienen verschiedene Ansätze, wie beispielsweise große Itempools, wodurch einer Verbreitung der Lösung im Internet entgegengewirkt werden kann. Dieser Ansatz ist jedoch mit hohen Kosten verbunden. Automatische Itemgenerierung hingegen ermöglicht es, kostengünstig und zeiteffizient psychometrisch hochwertige Items zu erstellen. Aus diesem Grund wurden in der vorliegenden Arbeit zwei Arbeitsgedächtnistests mit automatischer Itemgenerierung für das Onlineassessment der Bundeswehr entwickelt und evaluiert, mit dem Ziel einer hohen prädiktiven Validität auf die Diagnostik vor Ort. In der ersten Studie (N = 330) wurde gezeigt, dass automatische Itemgenerierung für die entwickelten Arbeitsgedächtnistests eingesetzt werden kann. Hierbei wurden zudem zwei verschiedene zeitliche Varianten untersucht, wobei sich diejenige mit der längeren Stimulusrepräsentationszeit als vorteilhafter erwies. In der zweiten Studie (N = 621) wurden Nachweise für Reliabilität und Validität erbracht. Die Tests zeigten eine gute konvergente und diskriminante Validität. Zudem konnte einer der beiden Tests eine sehr gute prädiktive Validität aufweisen. Unter Gesamtberücksichtigung der Testgütekriterien wurde dieser Test schließlich für das Onlineassessment der Bundeswehr vorgeschlagen. Somit steht der Bundeswehr nun ein wissenschaftlich fundierter Arbeitsgedächtnistest für das Onlineassessment zur Verfügung.
... Integrity at work has become one of the most distinctive evidence-based research areas for understanding the relationships between personality and work outcomes (Cortina & Luchman, 2013). Integrity at work, i.e., the occurrence of honesty, trustworthiness, truthfulness, fairness, and commitment to morality (Schlenker, 2008), is considered the third most important personality predictor of overall job performance after conscientiousness and general mental ability (Schmidt et al., 2016). Moreover, integrity at work is one of the most robust predictors of counterproductive work behavior (CWB; Ones et al., 1993). ...
Interest in the diagnostics of integrity by work and organizational psychology researchers and practitioners alike has been steadily increasing. In two studies we report results on the development of the Occupational Integrity Scale (OIS), a novel, openly available scale. The first study tested the psychometric properties of the OIS in a sample of 870 adult public education employees. The second study replicated the factor structure of the OIS in a sample of 147 company employees and tested the validity against self-reported Big Five and supervisor-reported employee CWB two months later. A three-factor solution was identified. The OIS demonstrated consistent relationships with personality criteria and limited associations to supervisor assessment of CWB.
... Because intelligence test scores are a strong predictor of job performance (Schmidt et al., 2016), ethnic gaps in mean intelligence within occupations will also result in job performance differences; these have also been meta-analyzed (Roth et al., 2003(Roth et al., , 2008. For survey workers, job performance would consist of following instructions, not using multiple accounts, not filling in responses dishonestly and so on (Arthur et al., 2021). ...
This brief report analyzes data from a series of studies carried out by Bates and Gignac (2022), collected from paid survey takers on the Prolific platform (total n = 3357). In this UK sample, Black-White gap sizes on cognitive tests were substantial with an overall effect size d of 0.99 standard deviations adjusted for unreliability (unadjusted means = 0.84 d). Testing for measurement invariance via differential item functioning found either no bias or bias of trivial magnitude. We conclude that the Black-White intelligence gap seen in Prolific workers is of similar magnitude to the gap seen elsewhere in America.
... Dabei wissen diese Psychologen und Personalberater gut, nur zu gut, und zwar schon seit vielen Jahren, dass es eine mindestens genau so gute, wahrscheinlich aber wesentlich e ektivere und e zientere Alternative gibt, nämlich Intelligenztests. Kognitive Leistungstests erfordern nur einen Bruchteil des für die Durchführung von ACs benötigten zeitlichen, personellen und nanziellen Aufwandes und können, wie in diversen Meta-Analysen gezeigt wurde, weitaus valider die Bewährung im Beruf vorhersagen, insbesondere bei komplexeren Berufsanforderungen (Schmidt & Hunter, 1998;Kramer, 2009;Schmidt et al., 2016). Interessant ist, dass ACs, in die keine Intelligenztests oder intelligenztestähnliche Aufgaben eingebaut werden, lediglich eine mittlere Validität von ρ = .25 ...
Viele Methodenbücher sind leider staubtrocken geschrieben und zudem noch voll von mathematischen Ableitungen und Formeln. Dieses Studienbuch ist bewusst anders. Statt Kaffeesatzleserei bietet es praxisrelevantes Wissen. Es zeigt außergewöhnlich verständlich, wie man empirische Untersuchungen liest, sachkundig interpretiert und kritisch bewertet. Es bedient sich dabei einer lockeren und alltagsnahen Sprache. Formeln kommen praktisch nicht vor. Grundlegende empirische Methoden und Konzepte kann man nämlich auch verstehen, wenn man kein Mathefreak oder Statistikguru ist. Die über 100 Beispiele stammen aus dem konkreten Forschungsalltag. Der Blick auf Problemzonen empirischer Forschung wird durch mehr als 160 Fragen geschärft. Diese eignen sich zugleich gut als Leitlinien für eigene empirische Studien. Zu den einzelnen Themen gibt es außerdem kommentierte ein- und weiterführende Literaturhinweise. Die 4. Auflage ist in allen Teilen umfassend überarbeitet und erweitert worden.
-----------------
Many method books are unfortunately written dry as dust and are also full of mathematical formulas. This textbook is deliberately different. Instead of coffee-table reading, it offers knowledge that is relevant to practice. It shows in an exceptionally comprehensible way how to read, interpret and critically evaluate empirical studies. It uses a relaxed language that is close to everyday life. Formulas are virtually absent. Basic empirical methods and concepts can be understood even if you are not a math freak or statistics guru. The more than 100 examples are taken from actual everyday research. The view on problem areas of empirical research is sharpened by more than 160 questions. These are also well suited as guidelines for your own empirical studies. In addition, there are annotated introductory and further references to the individual topics. The 4th edition has been extensively revised and expanded in all parts.
... They have dominated this top position since 2010 (ManpowerGroup 2018). Abounding literature indicates that firms with welldeveloped selection practices will have significantly lower employee turnover, higher productivity and overall financial performance(Hoffman, Kahn & Li 2018;Schmidt, Oh & Shaffer 2016). Furthermore, weaknesses in HRS processes could have dire and widespread consequences for a firm(Aladwan, Bhanugopan & D'Netto 2015;Ekwoaba, Ikeije & Ufoma 2015;Trindale 2015). ...
Apprentice selection: A systematic literature review from 1990 to 2020
... Selection methods have been used in recruitment for over 100 years to evaluate candidate suitability and predict future job performance (Ryan and Ployhart 2013;Schmidt et al. 2016;Schmidt and Hunter 1998), with around 40 million assessments being completed globally by candidates each year (Chamorro-Premuzic 2017). The most valid predictor of job performance is cognitive ability (Schmitt 2014), with validity estimates of r = 0.51 (Schmidt and Hunter 1998), a value that increases when combined with integrity tests (r = 0.65), work sample tests (r = 0.63), structured interviews (r = 0.63), or tests of conscientiousness (r = 0.60) (Schmidt and Hunter 1998). ...
Selection methods are commonly used in talent acquisition to predict future job performance and to find the best candidates, but questionnaire-based assessments can be lengthy and lead to candidate fatigue and poor engagement, affecting completion rates and producing poor data. Gamification can mitigate some of these issues through greater engagement and shorter testing times. One avenue of gamification is image-based tests. Although such assessments are starting to gain traction in personnel selection, few studies describing their validity and psychometric properties exist. The current study explores the potential of a five-minute, forced-choice, image-based assessment of the Big Five personality traits to be used in selection. Study 1 describes the creation of the image pairs and the selection of the 150 best-performing items based on a sample of 300 respondents. Study 2 describes the creation of machine-learning-based scoring algorithms and tests of their convergent and discriminate validity and adverse impact based on a sample of 431 respondents. All models showed good levels of convergent validity with the IPIP-NEO-120 (openness r = .71, conscientiousness r = .70, extraversion r = .78, agreeableness r = .60, and emotional stability r = .70) and were largely free from potential adverse impact. The implications for recruitment policy and practice and the need for further validation are discussed.
... We argue no: our new ability validity estimate of .31 fits with the .33 for work samples of Schmidt et al. (2016). So, there is a coherent pattern. ...
This paper systematically revisits prior meta-analytic conclusions about the criterion-related validity of personnel selection procedures, and particularly the effect of range restriction corrections on those validity estimates. Corrections for range restriction in meta-analyses of predictor-criterion relationships in personnel selection contexts typically involve the use of an artifact distribution. After outlining and critiquing five approaches that have commonly been used to create and apply range restriction artifact distributions, we conclude that each has significant issues that often result in substantial overcorrection and that therefore the validity of many selection procedures for predicting job performance has been substantially overestimated. Revisiting prior meta-analytic conclusions produces revised validity estimates. Key findings are that most of the same selection procedures that ranked high in prior summaries remain high in rank, but with mean validity estimates reduced by .10-.20 points. Structured interviews emerged as the top-ranked selection procedure. We also pair validity estimates with information about mean Black-White subgroup differences per selection procedure, providing information about validity-diversity tradeoffs. We conclude that our selection procedures remain useful, but selection predictor-criterion relationships are considerably lower than previously thought. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
... They have dominated this top position since 2010 (ManpowerGroup 2018). Abounding literature indicates that firms with welldeveloped selection practices will have significantly lower employee turnover, higher productivity and overall financial performance(Hoffman, Kahn & Li 2018;Schmidt, Oh & Shaffer 2016). Furthermore, weaknesses in HRS processes could have dire and widespread consequences for a firm(Aladwan, Bhanugopan & D'Netto 2015;Ekwoaba, Ikeije & Ufoma 2015;Trindale 2015). ...
Orientation: Technological innovations and developments in methods of productivity have resulted in an increased demand for technically-oriented artisans. However, the supply of qualified artisans is insufficient to meet the demand.
Research purpose: This article is the product of a systematic investigation into the extent and nature of empirical literature related to human resource selection practices used for apprentices.
Motivation for the study: The authors noted inadequate research into the selection practices used for apprentices. This investigation was motivated by the need to systematically verify the extent and nature of the empirical literature on apprentice selection, both internationally and nationally.
Research design, approach and method: A systematic literature review of published empirical research articles (for the period 1990–2020) in scholarly databases was conducted. The literature was accessed through relevant databases within the business management, human resource management and industrial psychology fields. The literature was restricted to scholarly (i.e., peer reviewed journals), English full textual data. Twelve combinations of two clusters of key words were used in the search function. The first cluster was apprentice, apprenticeship and artisan, with the second cluster being selection, selection process, staffing and recruitment. Four exclusion categories were used to reject literature that were unrelated, dissimilar and unconnected with the purpose of the literature review.
Main findings: From the comprehensive review of the literature, 12 articles were found to have content related to the selection of apprentices. Five core themes, with 11 sub-themes, were identified from this literature. A research agenda is proposed with research questions identified for each theme.
Practical/managerial implications: This literature review has provided a synthesised summary of the available literature on apprentice selection. Through the provision of a research agenda, this article contributes by providing a foundation for further research in the field.
Contribution/value-add: This article adds to the current literature available on apprentice selection practices. This should alert researchers of the need to further explore this area to enhance knowledge and understanding of the best practices employed in the selection of apprentices.
... Traditional self-report measures of personality, particularly those for conscientiousness, have long been found to be predictors of job performance, organizational citizenship behaviors, and counterproductive work behaviors (Barrick & Mount, 1991;Motowidlo & Kell, 2012;Schmidt et al., 2016). However, some researchers have argued that self-report measures may tend to have lower construct validities due to contaminants such as faking or other forms of social desirability, and thus they have called for alternatives to self-report measures of personality that might prevent faking and improve construct validity (Morgeson et al., 2007). ...
Using game-based assessments (GBAs) to assess and select job applicants presents the dual challenges of measuring intended job-relevant constructs while analyzing GBA data that contain more predictors than observations. Exploring those challenges, we analyzed two GBAs that were designed to measure conscientiousness facets (i.e., achievement striving, self-discipline, and cautiousness). Scores on traditional measures of personality and cognitive ability were modeled using either a restricted set of GBA predictors using cross-validated ordinary least squares (OLS) regression or by the fuller set (p = 248) using random forests regression. Overall, the prediction of personality was near-zero; but the latter approach explained 14%–30% of the variance in predicting cognitive ability. Our findings warn of GBAs potentially measuring unintended constructs rather than their intended constructs.
Practitioner points
• Game-based assessment (GBA) vendors often claim to measure individual differences, but related GBA research is often lacking.
• The current study developed two GBAs intended to measure conscientiousness and its facets.
• Results demonstrated that our GBAs were measuring cognitive ability instead of conscientiousness, despite deliberate design attempts to avoid the former.
• Results suggested the usefulness of machine learning to understand GBA data and the constructs underlying them.
... A primary emphasis in personnel selection research identifies determinants of future work performance, where tests of general mental ability and personality traits, employment interviews, and work sample tests are examples of established and valid predictors (Hunter & Schmidt, 1998;Schmidt et al., 2016). However, some selection methods, such as work sample tests (e.g., assessment center exercises) and interviews, are more complex relative to psychometric tests in terms of measurement methodology. ...
... Other AI-based recruitment systems focus on the psychometric characteristics of candidates, with Traitify offering image-based measures of personality and HireVue using game-based versions of traditional psychometric assessments to estimate attributes such as personality, intelligence and emotional intelligence. Additionally, companies such as Cammio offer AI-based tools to analyze video interviews and predict psychological traits such as personality, with these psychometric traits being able to predict how well applicants will perform in a future role (Schmidt and Hunter 2016). The models used in these recruitment solutions are typically informed by the work of business psychologists who often work closely with the developers of these tools to create algorithms that can predict how a hiring manager would evaluate a candidate, reducing the need for psychologists or trained recruiters to be involved in assessing applicants. ...
Business psychologists study and assess relevant individual differences, such as intelligence and personality, in the context of work. Such studies have informed the development of artificial intelligence systems (AI) designed to measure individual differences. This has been capitalized on by companies who have developed AI-driven recruitment solutions that include aggregation of appropriate candidates (Hiretual), interviewing through a chatbot (Paradox), video interview assessment (MyInterview), and CV-analysis (Textio), as well as estimation of psychometric characteristics through image-(Traitify) and game-based assessments (HireVue) and video interviews (Cammio). However, driven by concern that such high-impact technology must be used responsibly due to the potential for unfair hiring to result from the algorithms used by these tools, there is an active effort towards proving mechanisms of governance for such automation. In this article, we apply a systematic algorithm audit framework in the context of the ethically critical industry of algorithmic recruitment systems, exploring how audit assessments on AI-driven systems can be used to assure that such systems are being responsibly deployed in a fair and well-governed manner. We outline sources of risk for the use of algorithmic hiring tools, suggest the most appropriate opportunities for audits to take place, recommend ways to measure bias in algorithms, and discuss the transparency of algorithms.
... A profile of high scores on Honesty-Humility, Extraversion, Conscientiousness, Openness to Experience, and low scores on Emotionality increases the likelihood of achieving a higher social position. The role of Conscientiousness and Openness is not strange given the relationship of both traits with educational achievement (e.g., Moshagen et al., 2019), and Conscientiousness with work achievement (Schmidt et al., 2016). Note that the relationships between the FFM and social position are replicated (Bucciol et al., 2015). ...
Objectives
The present paper tests the cross-national stability of the HEXACO-60 structure across 18 countries from four continents. Gender and age differences across countries will be examined. Finally, this is the first study to explicitly analyze the relationships between the HEXACO and social position.
Method
10,298 subjects (5,410 women and 4,888 men) from 18 countries and 13 languages were analyzed. Confirmatory factor analysis techniques were used to test configural, metric and scalar invariance models. Congruence coefficients with the original structure of the HEXACO-60 were computed for every culture. Effect sizes of gender, age, and social position factors across countries were also computed.
Results
HEXACO-60 demonstrates configural and metric invariance, but not scalar invariance. Congruence coefficients show a great equivalence in almost all countries and factors. Only Emotionality presents a large gender difference across countries. No relevant effect of age is observed. A profile of high scores on Honesty-Humility, Extraversion, Conscientiousness, and Openness to Experience, and low scores on Emotionality increases the likelihood of achieving a higher social position, although the effect sizes are small.
Conclusions
HEXACO-60 is a useful instrument to conduct personality trait research and practice around the world. Implications of gender, social position and country differences are discussed.
... Ezért a teljesítmény tesztek eredményének főkomponens-elemzése -vagy a gyakorlatban, az IQ-tesztek kiértékelésekor sokszor azok egyszerű összpontszáma -révén a teszteket kitöltő, illetve elvégző személyeknél egy területáltalános kognitív képesség (g-faktor, "intelligencia") számítható vagy becsülhető. Az így mért pszichometriai intelligencia időben stabil (Deary, Pattie, & Starr, 2013;Gow és mtsai, 2011;Larsen, Hartmann, & Nyborg, 2008;Lyons és mtsai, 2009), a különböző tesztek között magas konvergens validitást mutat (Floyd, Reynolds, Farmer, & Kranzler, 2013;Johnson, Bouchard, Krueger, McGue, & Gottesman, 2004;Johnson, Nijenhuis, & Bouchard, 2008;Major, Johnson, & Bouchard, 2011), és prospektív vizsgálatokban nemcsak az iskolai teljesít ménnyel (Roth és mtsai, 2015), hanem a széles körben vett társadalmi siker legkülönbözőbb mutatóival, például a jövedelemmel, az iskolai végzettség gel, a végzett munka presztízsével, a korai iskolaelhagyással, a bűnözés sel vagy a szociális juttatások igénybevételével is összefügg (Hegelund, Flensborg-Madsen, Dammeyer, & Mortensen, 2018;Hegelund, Flensborg-Madsen, Dammeyer, Mortensen, & Mortensen, 2019;Herrnstein & Murray, 2010;Schmidt, Oh, & Shaffer, 2016;Strenze, 2007Strenze, , 2015. A kognitív epide miológia tudománya az intelligenciateszteknek egy speciális területen -nevezetesen az egészségi mutatókkal kapcsolatban -való prediktív validitásával foglalkozik . ...
A kognitív epidemiológia az intelligencia és az egészségi állapot összefüggésének tudo- mánya. A modern, sokszor több százezer fős, teljes populációkon végzett kognitív epide- miológiai vizsgálatok eredményei alapján a magasabb premorbid intelligencia gya- korlatilag valamennyi mentális betegség, illetve pszichiátriai probléma alacsonyabb kockázatával függ össze. A magasabb premorbid intelligencia a halálozás, a szív- és ér- rendszeri betegségek, a metabolikus betegségek, a rossz egészség-magatartás és számos kisebb népegészségügyi jelentőségű betegség előfordulásával is negatívan függ össze; a légzőszervi betegségekkel és a dohányzáshoz nem köthető daganatokkal azonban gyen- ge vagy hiányzik az összefüggés. A mentális betegségekkel való összefüggést nem, a szo- matikus betegségekkel és a mortalitással való összefüggést azonban részben mediálják a felnőttkori szocioökonómiai státusz mutatói. A speciális vizsgálati elrendezések – úgymint ikerkontroll-vizsgálatok, pszeudoexperimentális vizsgálatok, valamint a mendeli ran- domizáció módszerét használó molekuláris genetikai vizsgálatok – eredményei arra utal- nak, hogy az intelligencia és az egészség közötti kapcsolat jelentős részét genetikai ténye- zők közvetítik, de a szomatikus egészségre a magasabb intelligencia következményeként elérhető jobb szocioökonómiai státusz is szerény hatást gyakorol.
Cognitive epidemiology is the science of the relationship between intelligence and health. Modern studies of cognitive epidemiology, often with samples of several hundreds of thousands of individuals, have revealed that higher premorbid intelligence is associated with a lower risk of virtually all of mental illnesses and psychiatric problems. Higher premorbid intelligence is also associated negatively with the incidence of mortality, circulatory illness, metabolic illness, poor health behavior and many diseases of lower epidemiological significance, but its relationship to respiratory illness and non-smoking related cancers is weaker or non-existent. Indicators of adult socioeconomic status do not mediate the association between intelligence and mental illness, but they do partially mediate the relationship with somatic illness and mortality. Studies with special designs -twin control studies, pseudo-experimental studies and molecular genetic studies using Mendelian randomization – suggest that the relationship between intelligence and health is heavily mediated by genetic factors, but somatic health may be modestly but causally improved by better social status as a consequence of higher intelligence.
... Au niveau de la recherche académique, la question de la validité (prédictive et de construit) des outils de sélection digitaux est un sujet nouveau, et il n'existe pas suffisamment de résultats de recherches pouvant servir de guide au praticien (Woods & West, 2019). Si la méta-analyse récente de Schmidt et al. (2016) analyse la validité prédictive de nombreuses méthodes de sélection, la validité prédictive des nouvelles techniques issues de la digitalisation demeure inconnue. ...
Le marché des outils d’aide au recrutement intégrant des
modules d’intelligence artificielle est en plein essor. Parmi
les arguments utilisés pour promouvoir ces dispositifs,
figure la promesse que ceux-ci permettraient de favoriser un
recrutement non discriminatoire, en raison de leur capacité
supposée à éliminer les biais de jugement humains. L’objectif
de cette revue des recherches est de montrer que ces promesses
sont difficilement tenables, car la correction de certains biais
de jugement est contrecarrée par l’émergence de nouveaux
biais induits par l’usage de l’IA.
... 1. Immigrant groups from countries with higher human capital should fare better than those from countries with lower human capital, in particular, cognitive ability as the most important component of human capital (Christainsen, 2013(Christainsen, , 2020O'Boyle et al., 2011;Rindermann, 2018;Schmidt et al., 2016). ...
Immigrants to Western countries typically have worse social outcomes than natives, but country of origin immigrant groups differ widely. We studied school performance in Denmark for 116 immigrant groups measured by the grade point average (GPA) of the 9th grade exam at the end of compulsory schooling. General intelligence is a strong causal factor of school outcomes and life outcomes in general for individuals. We accordingly predicted that country of origin average intelligence (national IQ) will predict immigrant group outcomes. We furthermore included as covariates immigrant generation (first vs. second) as well as the Muslim percentage of country of origin. Results show that GPA in Denmark can be predicted by national IQ r = .47 (n = 81), Muslim percentage r = -.40 (n = 81), and educational selectivity of immigrants entering Denmark r = .35 (n = 71). Regression modeling indicated that each predictor is informative when combined. The final model explained 46.3% of the variance with first generation (binary) β = -0.65, βIQ = 0.29, βMuslim = -0.21, and β education selectivity index = 0.27 (all predictors p < .001, n = 97). Our results are in line with existing research on cognitive stratification and immigration.
... 22 Clark (2014), Raven (1991Raven ( , 1997Raven ( , 2014, Suggate (2012). These measures have little predictive validity outside the educational system (Schmidt et al., 2016). The measurement of differential change (eg more vs less "academic" pupils) in response to some intervention is even more problematic (Kazdin, 2006;Prieler & Raven, 2008). ...
In this paper, problems with the philosophy and research relating to various interpretations of "closing the gap" in educational achievement are used to open up a discussion of, and illustrate, the process whereby a narrow interpretation of "science" and neglect of systemic thinking result in the generation of huge amounts of dangerous and misleading misinformation and thence the generation of draconian and destructive policies. The paper opens by returning to an unfinished debate arising out of a summary of the unanticipated and counterin-tuitive effects of interventions designed to close the "attainment" gap between more and less advantaged pupils. This is used to illustrate the importance of studying the unintended as well as intended outcomes of interventions and the importance of considering whether those outcomes are desirable. More of the problems facing those who seek to contribute to evidence-based policy are then illustrated, via a discussion of an "illuminative" evaluation of competency-oriented , project-based, education conducted in the environment around a number of schools, to open a discussion of the need for comprehensive evaluation of educational-and other-projects and policies. "Comprehensive evaluation" implies the evaluation of all short and long term, personal and social, desired and desirable, and undesired and undesirable effects of the programmes and policies under investigation. when this criterion is applied to the vast number of published evaluations of school effectiveness it emerges that most fall well short of the mark. worse than that, most of their conclusions are nothing less than seriously misleading and damaging. The generation of such misleading information is much more widespread and serious than that exposed by the "replication crisis." It is argued that, in essence, it stems from the pervasive deployment of non-systemic (viz. "reductionist") science. A range of serious deficits in the thinking and methodology of psychologists and educational researchers associated with this approach are then discussed. It is concluded that it is vital for social scientists to do what they can to rectify the situation.
... For example, one outcome of the IEA and PISA studies is that, by the time children are 11 years of age, there are no differences in the much sought after areas of educational attainment between school systems which admit children from all ages from 4 to 8. 6 But even here it is not always clear that the researchers concerned have fully understood what they are doing but have, for example, simply fed their data into off-the-shelf statistical packages yielding esoteric indices. 7 Hunter & Hunter (1984), Schmidt et al (2016) 8 For a fuller discussion of this process see eg Raven (1991) 9 Stephenson (2001), . 10 While such observations have led many outstanding researchers (eg Hamilton et al, 1977) to, at least partially reject quantitative evaluation, and others to desert the field entirely, the alternatives are usually dismissed as "unscientific" and, as a result, unlikely to be funded by government departments. ...
In this article I argue that the majority of studies purporting to offer evaluations of educational policies and programmes are seriously misleading; indeed, viewed from a wider perspective, they cannot be considered to constitute good science. As a result, they lead to, or support, policies which have many harmful consequences. These studies, and the policies associated with them, must therefore be considered unethical1. Worse, the failure of the researchers concerned to draw attention to the limitations of their work, or challenge the policies based upon them, must be considered unprofessional and unethical. This does not mean that those studies tell us nothing ... simply that they are not fit for purpose. Conversely, the thoughtways and social practices they recursively cement need to be radically reconsidered.
One further implication of the defects in the studies reviewed is that, as with the “replication crisis”, there are very few conclusions that can be accepted uncritically. This has pervasive implications for many of those offering conventional courses in psychology.
Technology-driven human resource management is the order of the day. The knowledge of available technologies and their implications in some HRM functions is critical for today's managers. The focus of the chapter is to discuss the challenges and issues in traditional HRM, and the impact of the integration of technologies in some of the HRM functions like human resource planning, candidate tracking, workforce management, talent acquisition and recruitment, career management, employee relationship management, compensation, training, succession planning, retention, and others. The chapter also provides a list of software tools available for various HRM functions and their purpose, information technologies in Industry 5.0
The goal of the current study was to develop a resilience selection tool for combat officers that would augment the test battery at the Israel Defense Force (IDF) Officer Selection Center (OSC). To enable this goal, we sought to explore the underlying structure of resilience in a diverse number of resilience predictors. Participants were 1,533 male candidates at the IDF OSC. Using Exploratory Factor Analysis followed by Confirmatory Factor Analysis, 159 items from 13 separate resilience scales were refined into a single, 18-item psychological resilience scale. The new scale emphasizes self-efficacy, competency and overall positive self-perception. The new scale is tailored specifically to military combat officers. Initial construct validity was demonstrated against Big Five dimensions and psychological evaluations at IDF OSC. Predictive validity was demonstrated against command and peer evaluations from IDF Officer Training School (OTS). Medium to strong positive correlations were found between the resilience scale and Big Five dimensions of Extroversion and Conscientiousness, as well as a medium negative correlation with Neuroticism. Low but significant correlations were found between the resilience measure and psychological evaluations of combat officer vocational congruence. Low but significant correlations were also found with command and peer evaluations from Officer Training School. Resilience scale scores were found to predict OTS commander evaluations, but not OTS peer evaluations, beyond standard OSC scores when controlling for demographic variables. The theoretical importance of findings as well as implications for military officer selection are discussed.
Literaturverzeichnis und Sachregister:
Rost, D.H. (2022). Interpretation und Bewertung pädagogischer und psychologischer Studien. Eine Einführung. Bad Heilbrunn: Klinkhardt.
--------------------
References and subject index:
Rost, D.H. (2022). Interpretation and evaluation of educational and psychological studies. An introduction. Bad Heilbrunn: Klinkhardt.
Rapid rises in technology and digitisation in Talent Assessment practices have not been met with an equal advance in empirical research, methodology, and rigor as applies guidelines for best practice use. This risks an inevitable quality deficit in the application of these technologies and leave HR Practitioners unempowered to optimise the benefits of a democratised assessment environment. Multi-trait multi-method (MTMM) assessment protocols provide for a framework for best use application of emerging digital talent assessment tools. In this synthesis review study, we outline guidelines for use of digital talent management and development tools and propose a range of practical strategies. We conclude by providing a practical framework for occupationally specific competence assessment suggestions for future research.
This study investigated whether a multi-method assessment approach increases variance for predicting future job performance compared to a single-method approach measuring similar constructs. Participants were managers (n = 539, female = 29%, average age 38 years, SD = 7 years) across a variety of organisations, including the utilities (n = 145), mining (n= 83), telecommunications (n = 98), Information Technology and professional service sectors (n = 213), drawn from samples across Namibia (n = 54), Nigeria (n = 53), Saudi Arabia (n = 105), South Africa (n = 177), the United Arab Emirates (n = 88), and the United Kingdom (n = 62). The managers used a digital platform to complete multi-trait multi-method (MTMM) measures which included competency-based video interviewing, work-related self-report measures, work simulations and aptitude assessments, each measuring work-related competencies. Structural equation modelling was used to determine paths between measures and work performance. Acceptable model fit for the measurement model was established through confirmatory factor analysis. A constrained and baseline model was used to investigate predictive paths to job performance. The baseline model proved to explain greater variance between measures and job performance than the constrained model. This provides support for deploying a multi-method assessment approach, including both self-rated and expert rated content, in a modern organisational context; and using an integrated digital platform.
El presente artículo tiene como objetivo aportar la metodología
aplicada en los procedimientos de Adscripción Provisional en la
Administración General del País Vasco, para la cobertura de puestos
de responsabilidad. Esta metodología está basada en el análisis de la
experiencia previa como elemento para determinar los puestos acordes
a la misma y garantizar la adecuación al puesto de la persona que
se va a adscribir. Para ello, se analiza la Adscripción Provisional como
forma de provisión para el personal funcionario de carrera dentro del
sistema de provisión de puestos de trabajo en la Función Pública, la
normativa autonómica de aplicación y se desarrolla en profundidad el
proceso para informar sobre el ajuste de la persona a adscribir. El producto de este trabajo es el Informe de Adecuación donde se establece
el grado de adecuación de la experiencia reciente de la persona a adscribir a los puestos disponibles en orden de prelación. Se plantean
también limitaciones metodológicas y normativas y se proponen mejoras
encaminadas a cumplir con la gestión eficiente de los Recursos Humanos en la Administración Pública.
Palabras clave: Adecuación persona puesto, adscripción provisional,
carrera administrativa, Función Pública, provisión de puestos de trabajo.
This article aims to provide the methodology applied in Provisional
Assignment procedures in the General Administration of the
Basque Country, for the coverage of positions of responsibility. This
methodology is based on the analysis of previous experience as an element to determine the positions according to it and guarantee the adequacy of employees to the position to which they are going to be assigned. To this end, the Provisional assignment is analyzed as a form
of provision for civil servant career personnel within the system for the
provision of jobs in the Civil Service, the applicable regional regulations
and the process for informing about the adjustment is developed in
depth of the person to enroll. The product of this work is the Adequacy
Report where the degree of suitability of the recent experience of the
person to be assigned to the available positions in order of priority is
established. Methodological and regulatory limitations are also raised
and improvements aimed at complying with the efficient management
of Human Resources in the Public Administration are proposed.
Keywords: Job-person match, provisional affiliation, administrative career,
Public Function, provision of Jobs.
In diesem Kapitel wird die Relevanz Psychologischer Diagnostik im Zuge der Feststellung der Passung zwischen Individuen und Arbeitskontexten betont. Die Rolle der Psychologischen Diagnostik im Allgemeinen sowie von spezifischen diagnostischen Zugängen im Speziellen wird mit Bezug zu den Themenbereichen Organisationsdiagnostik, Personalauswahl und -entwicklung sowie Berufs- und Ausbildungswahl erläutert. Zudem wird der derzeitige Kenntnisstand zur Evaluation des diagnostischen Vorgehens in diesen Anwendungsbereichen präsentiert. Schließlich erfolgt eine Einführung in die DIN 33430 für berufsbezogene Eignungsbeurteilungen.
In a recently-featured commentary, Winston [1] defined scientific racism as “the use of scientific concepts
and data to create and justify ideas of an enduring, biologically based hierarchy” [1, p. 425]. Winston further argued that
scientific racism persists because of the “social genealogy and history” of the research program, rather than because it is
an open empirical question as to whether some inherited behavioral differences exist between ethnic and racial groups.
Finally, Winston called out one of us (BJP) for exemplifying scientific racism in a paper concerning Cold Winter’s Theory.
Specifically, the article [2] tested whether Cold Winter’s Theory could account for race differences in intelligence across
the 50 U.S. states. Unfortunately, Winston mischaracterized the article’s position on this matter. We therefore write here to
correct the mischaracterization, and to illustrate that the study of race differences is part of a progressive research program
on psychological differences
Online-Assessments haben sich fest in der Personalgewinnung etabliert, vor allem in jüngeren Zielgruppen wie Schüler/Auszubildende, Praktikanten, Hochschulabsolventen und Young Professionals. Zunehmend werden diese mittlerweile nicht mehr nur von großen Konzernen, sondern auch von mittleren und kleinen Unternehmen eingesetzt.
The construct of general intelligence (g) is one of psychology’s most replicated and predictively useful constructs. Although research indicates that g is a highly heritable trait, deeply rooted in brain physiology, to date neither a strong biological correlate nor a comprehensive explanatory model involving neuronal mechanisms have been established. In this article I aim to do so by hypothesising that the von Economo neuron (VEN), a unique nerve cell thus far implicated in social cognition and interoception, may in fact represent a central biological constituent of g. After presenting supportive evidence from neuroscience, psychiatry/neurology, clinical gerontology, and comparative psychology, an integrated reductionist framework is outlined, which reaches from the level of cognitive theory to the level of single neurons. Based thereon, it is concluded that the VENs might contribute to individual differences in g by rapidly inducing the coherence of neuronal oscillations within a functionally invariant parieto-frontal network underlying higher-order cognition, thereby facilitating mental efficiency.
Talent assessment continues to evolve at a rapid pace. A demanding and dynamic business environment and the advent of exponential technologies places renewed importance on conducting talent assessment protocols in a manner that strengthens the psychological contract between employers and employees. This chapter provides a framework for conducting contemporary talent assessments in an inclusive, ethical and responsible manner. It focuses on the candidate experience as a key part of the talent assessment process and incorporates the learning of modern Talent Management principles in delivering impactful assessment journeys. The chapter has three broad focus areas: Firstly, it evaluates the expansion of modern talent assessment and the effect this has on the experience of psychological contract. Secondly, it provides a framework for conducting talent assessment in a manner that supports and expands the psychological contract. Thirdly, the role of technology in scaling talent assessment is evaluated, considering specifically potential risks and opportunities for the psychological contract in digitally enabled assessment approaches. Practical recommendations are provided.
Over recent years, Russia’s government has been expanding its presence in domestic state-owned enterprises (SOEs) and instituting numerous regulatory revisions. However, research is inconclusive over the government’s underlying economic intentions, and intervention outcomes, vis-à-vis SOEs. Likewise, it remains imprecise in relation to various characteristics of government–SOE interaction. To mitigate these issues, this paper develops a new state predation model relevant to large Russian SOEs. It argues, using the NOC (national oil company) mid-management recruitment and selection case, that SOEs are being re-oriented into centers of active regime support. Accordingly, the Russian government is prioritizing the placement of loyal clients, into NOC structures, who advance the SOEs’ growing political obligations. It is also rewarding them, in a performance-curbing manner, through tolerating their inadequate economic competence and heightened engagement in corporate corruption. At the same time, non-clients, including top international talent, are experiencing diminishing recruitment numbers and opportunities. This status quo, then, is being maintained via informal (closed and procedure-less) practices, though certain formal rules support it too. Consequently, the above-outlined state predation insights are important to understanding SOE political over-embeddedness and patron–client relations in emerging market SOEs.
General mental ability (intelligence) is the dominant determinant of the large individual differences in work output on the job revealed by research, but highly visible individual differences in citizenship behavior on the job make the intelligence-performance relationship harder to observe in everyday life. Over time, the validity of job experience for predicting performance declines, while that of ability remains constant or increases. Path analyses indicate that the major reason ability predicts performance so well is that higher ability individuals learn relevant job knowledge more quickly and team more of it. The current social policy that strongly discourages use of mental ability in hiring is counterproductive and has produced severe performance decrements. This policy should be changed to encourage the use of ability measures. However, it should also encourage the use of personality measures that increase overall predictive validity while simultaneously reducing differences in minority-majority hiring rates.
Data from four different jobs (N = 1,474) were used to evaluate three hypotheses of the joint relation of job experience and general mental ability to job performance as measured by (a) work sample measures, (b) job knowledge measures, and (c) supervisory ratings of job performance. The divergence hypothesis predicts an increasing difference and the convergence hypothesis predicts a decreasing difference in the job performance of high- and low-mental-ability employees as employees gain increasing experience on the job. The noninteractive hypothesis, by contrast, predicts that the performance difference will be constant over time. For all three measures of job performance, results supported the noninteractive hypothesis. Also, consistent with the noninteractive hypothesis, correlational analyses showed essentially constant validities for general mental ability (measured earlier) out to 5 years of experience on the job. In addition to their theoretical implications, these findings have an important practical implication: They indicate that the concerns that employment test validities may decrease over time, complicating estimates of selection utility, are probably unwarranted.
This study uses meta-analysis of an extensive predictive validity database to explore the boundary conditions for the validity of the structured interview as presented by McDaniel, Whetzel, Schmidt, and Maurer (1994). The interview examined here differs from traditional structured interviews in being empirically constructed, administered by telephone, and scored later based on a taped transcript. Despite these and other differences, this nontraditional employment interview was found to have essentially the same level of criterion-related validity for supervisory ratings of job performance reported by McDaniel for other structured employment interviews. These findings suggest that a variety of different approaches to the construction, administration, and scoring of structured employment interviews may lead to comparable levels of validity. We hypothesize that this result obtains because different types of structured interviews all measure to varying degrees constructs with known generalizable validity (e.g., conscientiousness and general mental ability). The interview examined here was also found to be a valid predictor of production records, sales volume, absenteeism, and job tenure.
This article summarizes the practical and theoretical implications of 85 years of research in personnel selection. On the basis of meta-analytic findings, this article presents the validity of 19 selection procedures for predicting job performance and training performance and the validity of paired combinations of general mental ability (GMA) and the 18 other selection procedures. Overall, the 3 combinations with the highest multivariate validity and utility for job performance were GMA plus a work sample test (mean validity of .63), GMA plus an integrity test (mean validity of .65), and GMA plus a structured interview (mean validity of .63). A further advantage of the latter 2 combinations is that they can be used for both entry level selection and selection of experienced employees. The practical utility implications of these summary findings are substantial. The implications of these research findings for the development of theories of job performance are discussed.
This meta-analytic review presents the findings of a project investigating the validity of the employment interview. Analyses are based on 245 coefficients derived from 86,311 individuals. Results show that interview validity depends on the content of the interview (situational, job related, or psychological), how the interview is conducted (structured vs. unstructured; board vs. individual), and the nature of the criterion (job performance, training performance, and tenure; research or administrative ratings). Situational interviews had higher validity than did job-related interviews, which, in turn, had higher validity than did psychologically based interviews. Structured interviews were found to have higher validity than unstructured interviews. Interviews showed similar validity for job performance and training performance criteria, but validity for the tenure criteria was lower.
How should data be interpreted to optimize the possibilities for cumulative scientific knowledge? Many believe that traditional data interpretation procedures based on statistical significance tests reduce the impact of sampling error on scientific inference. Meta-analysis shows that the significance test actually obscures underlying regularities and processes in individual studies and in research literatures, leading to systematically erroneous conclusions. Meta-analysis methods can solve these problems-and have done so in some areas. However, mela-analysis represents more than merely a change in methods of data analysis. It requires major changes in the way psychologists view the general research process. Views of the scientific value of the individual empirical study, the current reward structure in research, and even the fundamental nature of scientific discovery may change.
The purpose of this article is to examine the nature and magnitude of the relationship between cognitive abilities and vocational interests — two important measures of individual differences. Our meta-analysis of 27 studies with 29 independent samples and an overall sample size of 55,297 participants demonstrated meaningful relations between cognitive abilities and vocational interests. Meta-analytic coefficients ranged from −0.29 to 0.47; their strength and direction were comparable for females and males. Furthermore, we established both age and birth cohort as moderators of the relation between interests and cognitive abilities. Limitations and implications for future research are discussed.
Recent empirical reviews have claimed a surprisingly strong relationship between job performance and self-reported emotional intelligence (also commonly called trait EI or mixed EI), suggesting self-reported/mixed EI is one of the best known predictors of job performance (e.g., ρ̂ = .47; Joseph & Newman, 2010b). Results further suggest mixed EI can robustly predict job performance beyond cognitive ability and Big Five personality traits (Joseph & Newman, 2010b; O'Boyle, Humphrey, Pollack, Hawver, & Story, 2011). These criterion-related validity results are problematic, given the paucity of evidence and the questionable construct validity of mixed EI measures themselves. In the current research, we update and reevaluate existing evidence for mixed EI, in light of prior work regarding the content of mixed EI measures. Results of the current meta-analysis demonstrate that (a) the content of mixed EI measures strongly overlaps with a set of well-known psychological constructs (i.e., ability EI, self-efficacy, and self-rated performance, in addition to Conscientiousness, Emotional Stability, Extraversion, and general mental ability; multiple R = .79), (b) an updated estimate of the meta-analytic correlation between mixed EI and supervisor-rated job performance is ρ̂ = .29, and (c) the mixed EI-job performance relationship becomes nil (β = -.02) after controlling for the set of covariates listed above. Findings help to establish the construct validity of mixed EI measures and further support an intuitive theoretical explanation for the uncommonly high association between mixed EI and job performance-mixed EI instruments assess a combination of ability EI and self-perceptions, in addition to personality and cognitive ability. (PsycINFO Database Record (c) 2014 APA, all rights reserved).
In this article, I present a theory that explains the origin of sex differences in technical aptitudes. The theory takes as proven that there are no sex differences in general mental ability (GMA), and it postulates that sex differences in technical aptitude (TA) stem from differences in experience in technical areas, which is in turn based on sex differences in technical interests. Using a large data set, I tested and found support for four predictions made by this theory: (a) the construct level correlation between technical aptitude and GMA is larger for females than males, (b) the observed and true score variability of technical aptitude is greater among males than females, (c) at every level of GMA females have lower levels of technical aptitude, and (d) technical aptitude measures used as estimates of GMA for decision purposes would result in underestimation of GMA levels for girls and women. Given that GMA carries the weight of prediction of job performance, the support found for this last prediction suggests that, for many jobs, technical aptitude tests may underpredict the job performance of female applicants and employees. Future research should examine this question.
© Association for Psychological Science 2011.
Employment interviews are one of the most widely used selection tools across organizations, industries, and countries (Dipboye, 1992, 1997; Dip-boye & Jackson, 1999; Ryan, McFarland, Baron, & Page, 1999; Salgado, Viswesvaran, & Ones, 2001; Wilk & Cappelli, 2003, Table 1). Interviews also play an important role in government employment decisions, particularly at the Federal level (U.S. Merit Systems Protection Board, 2003). Likewise, employment interviews have long been a focus of both laboratory (e.g., Highhouse & Bottrill, 1995; Motowidlo & Burnett, 1995; Paunonen, Jack-son, & Oberman, 1987; Purkiss, Perrewe, Gillespie, Mayes, & Ferris, 2006) and field (e.g., Chapman & Zweig, 2005; Maurer & Solamon, 2006; van der Zee, Bakker, & Bakker, 2002) research. Although the use of employment interviews is widespread, a wealth of research indicates that not all inter-views are equally valid predictors of future job performance. In particular,
Employment interviews are one of the most widely used selection tools across organizations, industries, and countries (Dipboye, 1992, 1997; Dip-boye & Jackson, 1999; Ryan, McFarland, Baron, & Page, 1999; Salgado, Viswesvaran, & Ones, 2001; Wilk & Cappelli, 2003, Table 1). Interviews also play an important role in government employment decisions, particularly at the Federal level (U.S. Merit Systems Protection Board, 2003). Likewise, employment interviews have long been a focus of both laboratory (e.g., Highhouse & Bottrill, 1995; Motowidlo & Burnett, 1995; Paunonen, Jack-son, & Oberman, 1987; Purkiss, Perrewe, Gillespie, Mayes, & Ferris, 2006) and field (e.g., Chapman & Zweig, 2005; Maurer & Solamon, 2006; van der Zee, Bakker, & Bakker, 2002) research. Although the use of employment interviews is widespread, a wealth of research indicates that not all inter-views are equally valid predictors of future job performance. In particular,
The practical value to organizations and to society of even small increments to validity from suppressor effects may be substantial. This study empirically examined the potential importance of suppressor variables in the personality domain. Of the five suppressor variables tentatively identified in the initial validation sample, four were found to hold up in an independent cross-validation sample. The suppressor variables increased the cross-validated multiple r from .61 to .68 (an 11% increase). The authors argue that, in addition to potential increments to prediction, suppressor variables in the personality domain may also contribute to substantive knowledge and theory development. The authors recommend that examination of potential suppressors be a more frequent component of research and analysis in the personality domain.
In recent years, it has been advocated that capital budgeting and financial accounting techniques be used in evaluating the utility of human resources programs such as selection, training, and performance appraisal (Cronshaw & Alexander, 1985; Boudreau, 1983a, 1983b). We have demonstrated that many of these methods are often conceptually and logically inappropriate. We also showed that even in cases in which these techniques are logically applicable, their use may have unintended negative consequences. Finally, we discussed the question of the appropriate conceptual definition of utility. We conclude that different conceptual definitions of utility are useful under different circumstances; there is no single "correct" definition of utility. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Given the overwhelming research evidence showing the strong link between general cognitive ability (GCA) and job performance, it is not logically possible for industrial -organizational (I/O) psychologists to have a serious debate over whether GCA is important for job performance. However, even if none of this evidence existed in I/O psychology, research findings in differential psychology on the nature and correlates of GCA provide a sufficient basis for the conclusion that GCA is strongly related to job performance. In I/O psychology, the theoretical basis for the empirical evidence linking GCA and job performance is rarely presented, but is critical to understanding and acceptance of these findings. The theory explains the why behind the empirical findings. From the viewpoint of the kind of world we would like to live in - and would like to believe we live in - the research findings on GCA are not what most people would hope for and are not welcome. However, if we want to remain a science-based field, we cannot reject what we know to be true in favor of what we would like to be true.
This article presents a series of meta-analyses carried out, exploring the construct validity of personnel selection interviews. Accordingly, the interviews were divided into two different groups: conventional interviews and behavior interviews. Conventional interviews are typically composed of questions directed at checking credentials, description of experience, and self-evaluative information. Behavior interviews mainly include questions concerning job knowledge, job experience, and behavior descriptions. The results showed that conventional interviews assessed general mental ability, job experience, the Big Five personality dimensions, and social skills, whereas behavior interviews mainly assessed job knowledge, job experience, situational judgment, and social skills. According to these findings, conventional and behavior interviews seem to be different interviews.
Meta-analysis is arguably the most important methodological innovation in the social and behavioral sciences in the last 25 years. Developed to offer researchers an informative account of which methods are most useful in integrating research findings across studies, this book will enable the reader to apply, as well as understand, meta-analytic methods. Rather than taking an encyclopedic approach, the authors have focused on carefully developing those techniques that are most applicable to social science research, and have given a general conceptual description of more complex and rarely-used techniques. Fully revised and updated, Methods of Meta-Analysis, Second Edition is the most comprehensive text on meta-analysis available today. New to the Second Edition: * An evaluation of fixed versus random effects models for meta-analysis* New methods for correcting for indirect range restriction in meta-analysis* New developments in corrections for measurement error* A discussion of a new Windows-based program package for applying the meta-analysis methods presented in the book* A presentation of the theories of data underlying different approaches to meta-analysis
Despite early claims that vocational interests could be used to distinguish successful workers and superior students from their peers, interest measures are generally ignored in the employee selection literature. Nevertheless, theoretical descriptions of vocational interests from vocational and educational psychology have proposed that interest constructs should be related to performance and persistence in work and academic settings. Moreover, on the basis of Holland's (1959, 1997) theoretical predictions, congruence indices, which quantify the degree of similarity or person-environment fit between individuals and their occupations, should be more strongly related to performance than interest scores alone. Using a comprehensive review of the interest literature that spans more than 60 years of research, a meta-analysis was conducted to examine the veracity of these claims. A literature search identified 60 studies and approximately 568 correlations that addressed the relationship between interests and performance. Results showed that interests are indeed related to performance and persistence in work and academic contexts. In addition, the correlations between congruence indices and performance were stronger than for interest scores alone. Thus, consistent with interest theory, the fit between individuals and their environment was more predictive of performance than interest alone.
© The Author(s) 2012.
Based on data from 4 independent studies reported by R. Vineberg and E. N. Taylor (1972) with a total sample size of 1,474, path analysis was used to examine the causal impact of job experience on job knowledge, performance capability as measured by job sample tests, and supervisory ratings of job performance. Findings support the conclusion that (1) when mean job experience is 2–3 yrs, there is substantial variance in job experience and (2) when the jobs are of an intermediate complexity level, job experience has a substantial direct impact on job knowledge and a smaller direct impact on performance capabilities as assessed by job sample measures. Job experience also has a substantial indirect effect on work sample performance through its effect on job knowledge, which, in turn, was found to be the strongest determinant of work sample performance. The pattern and magnitude of causal effects of general mental ability were similar to those of job experience. The effect of job knowledge on supervisory ratings was several times stronger than the effect of job sample performance, confirming the findings of J. E. Hunter (1983). When job experience was held constant, the direct impact of ability on the acquisition of job knowledge increased substantially, and this, in turn, increased the indirect effect of ability on job sample performance. (28 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Claims that cognitive ability tests of the kind generally used in personnel selection are valid predictors of successful performance for jobs in all settings. This controversial stance is supported by analyses that recast findings of invalid tests as instances of Type I error. Ideally, if an employer has large enough samples, perfectly reliable tests, and an unrestricted range of ability in the applicant pool, the most widely used types of standardized tests should be valid in all job situations, and the notion of job-specific validity would no longer hold. The authors argue against previous reservations about the suitability of cognitive ability tests for employee selection that were made on the basis of their supposed limited applicability, their bias, and their ultimate contribution to workforce productivity. (56 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Personnel psychologists have traditionally believed that employment test validities are situation specific. This study presents a Bayesian statistical model that is based on the alternate hypothesis that variation in validity outcomes from study to study for similar jobs and tests is artifactual in nature. Certain outcomes using this model permit validity generalization to new settings without carrying out a validation study of any kind. Where such generalization is not justified, the procedure is considered to provide an improved method of data analysis and decision making for the necessary situational validity study. Application to 4 distributions of empirical validity coefficients is presented to demonstrate the power of the model. (22 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
The purpose of this investigation was to explore the extent to which employment interview evaluations reflect cognitive ability. A meta-analysis of 49 studies found a corrected mean correlation of .40 between interview ratings and ability test scores, suggesting that on average about 16% of the variance in interview constructs represents cognitive ability. Analysis of several design characteristics that could moderate the relationship between interview scores and ability suggested that (a) the correlation with ability tends to decrease as the level of structure increases; (b) the type of questions asked can have considerable influence on the magnitude of the correlation with ability; (c) the reflection of ability in the ratings tends to increase when ability test scores are made available to interviewers; and (d) the correlation with ability generally is higher for low-complexity jobs. Moreover, results suggest that interview ratings that correlate higher with cognitive ability tend to be better predictors of job performance. Implications for incremental validity are discussed, and recommendations for selection strategies are outlined. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
A literature review indicates that the standard deviation of employee output averaged 20% of mean output under nonpiecework compensation systems and 15% under piecework systems. For both systems, variability around the mean was small. Implications for selection and workforce productivity are discussed. (25 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Used decision theoretic equations to estimate the impact of the Programmer Aptitude Test (PAT) on productivity if used to select new computer programers for 1 yr in the federal government and the national economy. A newly developed technique was used to estimate the standard deviation of the dollar value of employee job performance, which in the past has been the most difficult and expensive item of required information. For the federal government and the US economy separately, results are presented for different selection ratios and for different assumed values for the validity of previously used selection procedures. The impact of the PAT on programmer productivity was substantial for all combinations of assumptions. Results support the conclusion that hundreds of millions of dollars in increased productivity could be realized by increasing the validity of selection decisions in this occupation. Similarities between computer programers and other occupations are discussed. It is concluded that the impact of valid selection procedures on work-force productivity is considerably greater than most personnel psychologists have believed. (37 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Using a large database, this study examined 3 refinements of validity generalization procedures: (1) a more accurate procedure for correcting the residual standard deviation (SD) for range restriction to estimate SD
p, (2) use of
r̄ instead of study-observed
rs in the formula for sampling error variance, and (3) removal of non-Pearson
rs. The 1st procedure does not affect the amount of variance accounted for by artifacts. The addition of the 2nd and 3rd procedures increased the mean percentage of validity variance accounted for by artifacts from 70 to 82%, a 17% increase. The cumulative addition of all 3 procedures decreased the mean SD
p estimate from .150 to .106, a 29% decrease. Six additional variance-producing artifacts were identified that could not be corrected for. In light of these it was concluded that the obtained estimates of mean SD
p and mean validity variance accounted for were consistent with the hypothesis that the true mean SD
p value is close to zero. These findings provide further evidence against the situational specificity hypothesis. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
How should data be interpreted to optimize the possibilities for cumulative scientific knowledge? Many believe that traditional data interpretation procedures based on statistical significance tests reduce the impact of sampling error on scientific inference. Meta-analysis shows that the significance test actually obscures underlying regularities and processes in individual studies and in research literatures, leading to systematically erroneous conclusions. Meta-analysis methods can solve these problems, and have done so in some areas. However, meta-analysis represents more than merely a change in methods of data analysis. It requires major changes in the way psychologists view the general research process. Views of the scientific value of the individual empirical study, the current reward structure in research, and even the fundamental nature of scientific discovery may change. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Two studies, with a total sample size of 400,000 Ss and with the US Department of Labor's
Dictionary of Occupational Job Titles (1977), examined the traditional belief that between-job task differences cause aptitude tests to be valid for some jobs but not for others. Results indicate that aptitude tests are valid across jobs, since the moderating effect of tasks(a) is negligible even when jobs differ grossly in task makeup and (b) is probably nonexistent when task differences are less extreme. Findings have implications for validity generalization, the use of task-oriented job analysis in selection research, criterion construction, moderator research, and proper interpretation of the US's
Uniform Guidelines on Employee Selection Procedures. It is concluded that the belief that tasks are important moderators of test validities can be traced to behaviorist assumptions introduced into personnel psychology in the early 1960's and that, in retrospect, these assumptions are false. (44 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Quantifying the economic impact of psychological programs in organizations requires determination of (a) the size and variability of the resulting increase in job performance and (b) the economic value of the increase in job performance. New methods of meta-analysis allow attainment of the 1st of these; and in relation to the 2nd, utility analysis methods provide the ability to translate job performance increases into estimates of the economic value of the program. In the area of personnel selection, many meta-analytic studies have resulted in precise and generalizable estimates of the validity of cognitive ability tests and other selection procedures. Utility analyses show that the job performance increases resulting from use of valid selection methods have substantial economic value. Valid selection produces major increases in work-force productivity. It is concluded that the combined effects of selection and nonselection interventions can be expected to produce substantial increases in workforce productivity. (29 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Previous studies have suggested handwriting analysis (HA) as potentially useful in the screening of job applicants. The present study examined 4 issues pertinent to this application of HA: (a) interjudge reliability of graphological inferences, (b) criterion-related validity of graphological inferences, (c) effect of what is written (content) rather than how it is written, and (d) the knowledge or skill level involved in HA. 103 adult writers were asked to supply 2 samples of their handwriting—"neutral" in content and autobiographical. Criterion data included supervisory ratings, self-ratings, and sales productivity. 20 professional graphologists were used to analyze the handwriting samples. 24 undergraduates with no prior experience with graphology or HA were asked to provide "inferences" from the same script samples given to the graphologists. Results provide only minimal support for an analysis of inferences based on handwriting. Whereas there was some evidence for interrater reliability among the graphologists, no evidence for validity was detected. Type of script sample did not appear to make a difference. Implications for industry are discussed. (21 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Cognitively loaded tests of knowledge, skill, and ability often contribute to decisions regarding educpation, jobs, licensure, or certification. Users of such tests often face difficult choices when trying to optimize both the performance and ethnic diversity of chosen individuals. The authors describe the nature of this quandary, review research on different strategies to address it, and recommend using selection materials that assess the full range of relevant attributes using a format that minimizes verbal content as much as is consistent with the outcome one is trying to achieve. They also recommend the use of test preparation, face-valid assessments, and the consideration of relevant job or life experiences. Regardless of the strategy adopted, it is unreasonable to expect that one can maximize both the performance and ethnic diversity of selected individuals.
In the current study, we present a more accurate method for correcting for range restriction (Case V) that expands upon Bryant and Gokhale’s (1972) method. We further present detailed steps to incorporate the Case V method into Schmidt and Hunter’s (2015; Hunter & Schmidt, 2004) psychometric meta-analysis methods (both individual correction and artifact distribution approaches). We then evaluate the accuracy of the Case V method vis-à-vis existing methods. Monte-Carlo simulation results indicate that the Case V method provides very accurate estimates for the mean true score correlation and reasonably accurate estimates for the true standard deviation. More importantly, Case V almost always provides more accurate results than alternative methods (particularly, Case IV). To illustrate how the Case V method works with real data, we conduct a reanalysis of Judge, Heller, and Mount’s (2002) meta-analysis examining the relationships between the Big Five personality traits and job satisfaction. Results indicate that the true score correlations between the Big Five traits and job satisfaction have been underestimated, whereas their true standard deviations have been overestimated. Implications for range restriction corrections in organizational research are discussed.
The empirical evidence that has accumulated in support of the notion that personality is a valid predictor of employee performance is vast, yet debate on the matter continues. This study investigates frame‐of‐reference effects as they relate to the validity of self‐report measures of personality. Specifically, we compare the validities of general, noncontextualized personality measures and work‐specific, contextualized measures. The findings suggest that personality measures are a more valid predictor of performance when the scale items or instructions are framed specifically so as to reference work‐specific behaviors. We found that the validities for noncontextualized measures of personality ranged from .02 to .22, with a mean validity of .11. The validities for contextualized measures ranged from .19 to .30, with a mean of .25. Additional moderator analyses were conducted in an effort to examine several alternate explanations for these validity differences. Specifically, we examined differences between the developmental purpose (general use vs. workplace use) and reliabilities of each type of personality measure. We also compared the validities from published studies to those from unpublished studies. Results suggest that these moderators did not have an impact on the validity differences between noncontextualized and contextualized measures.