ArticlePublisher preview available

Reducing Racial Similarity Bias in Interviews by Increasing Structure: A Quasi-Experiment Using Multilevel Analysis

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

We used a quasi-experiment to examine the relationship between interview structure and racial bias in simulated employment interviews. Although recent meta-analytic findings suggest that high-structure interviews (as compared to low-structure interviews) reduce same-race bias in interview ratings, this claim has not been tested using research designs that allow for stronger inference about the potential links between interview structure and bias. We showed videotaped interviews to 386 business students and, within both high- and low-structure conditions, determined levels of racial similarity bias using multilevel analysis. Our study used a fully-crossed design within each condition, where all raters evaluated all applicants. As we expected, findings indicated that interviewers favored racially similar applicants less in high structure interviews than in low structure interviews. Our findings provide quasi-experimental evidence that increased interview structure may be effective to suppress racial similarity bias in employment interview ratings.
Reducing Racial Similarity Bias in Interviews by Increasing
Structure: A Quasi-Experiment Using Multilevel Analysis
François S. de Kock
University of Cape Town
Daniël B. Hauptfleisch
Stellenbosch University
We used a quasi-experiment to examine the relationship between interview structure and
racial bias in simulated employment interviews. Although recent meta-analytic findings
suggest that high-structure interviews (as compared with low-structure interviews) reduce
same-race bias in interview ratings, this claim has not been tested using research designs
that allow for stronger inference about the potential links between interview structure and
bias. We showed videotaped interviews to 386 business students and, within both high- and
low-structure conditions, determined levels of racial similarity bias using multilevel anal-
ysis. Our study used a fully crossed design within each condition, where all raters evaluated
all applicants. As we expected, findings indicated that interviewers favored racially similar
applicants less in high-structure interviews than in low-structure interviews. Our findings
provide quasi-experimental evidence that increased interview structure may be effective to
suppress racial similarity bias in employment interview ratings.
Impact and Implications
Our findings illustrate the benefits of imposing structure in personnel selection inter-
views to reduce racial bias in interview ratings. Organizations that rely on high-
structured interviews, rather than the more commonplace low-structure interview type,
are likely to observe lower levels of racial similarity bias in ratings. The persistent and
widespread use of unstructured interviews in organizations exposes applicants to unfair
selection practices and increases the risk to organizations of employment discrimination
litigation. Furthermore, these interviews withhold the benefits to organizations (e.g.,
better selection decisions) and applicants (e.g., fair employment practice) that accrue
from interview ratings undistorted by bias. Given the focus of our research on fairness
issues in employment and organizations, our findings may be important to help meet the
following 2016 –2030 United Nations Sustainable Development Goals: help organiza-
tions to promote inclusive, productive, and decent work for all (number 8); reduce
inequality within countries (number 10); and promote peaceful and inclusive societies,
provide access to justice for all, and build effective, accountable, and inclusive institu-
tions at all levels (number 16).
Keywords: interviews, structure, similarity bias, judgment, multilevel analysis
François S. de Kock, Section for Organizational Psy-
chology, School of Management Studies, University of
Cape Town; Daniël B. Hauptfleisch, Department of Indus-
trial Psychology, Stellenbosch University.
We thank Gert Huysamen and Ines Meyer for comments
on a draft of this article. We acknowledge funding support
from the Andrew W. Mellon Foundation (USA) and the
National Research Fund (South Africa). An earlier version
of results from this study was presented at the 30th Inter-
national Congress of Psychology, Cape Town, South Af-
rica.
Correspondence concerning this article should be ad-
dressed to François S. de Kock, Section of Organizational
Psychology, School of Management Studies, University of
Cape Town, Private Bag, Rondebosch, Cape Town 7701,
South Africa. E-mail: francois.dekock@uct.ac.za
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
International Perspectives in Psychology:
Research, Practice, Consultation
© 2018 American Psychological Association 2018, Vol. 7, No. 3, 137–154
2157-3883/18/$12.00 http://dx.doi.org/10.1037/ipp0000091
137
... Recent studies raise the question of whether many biases, such as halo effect and the availability heuristic are different versions of the confirmation bias (Oeberst & Imhoff, 2023). Confirmation bias is also related to similarity bias, describes the tendency of people to prefer and be more receptive to those who are similar to them, and can influence a range of decisions and behaviors (de Kock & Hauptfleisch, 2018;Lin et al., 1992;Quintero et al., 2009). Similarity bias is directly related to gender discrimination (Pedersen & Nielsen, 2020), with studies indicating that male-dominated workplaces exhibit higher levels of discrimination against women (Gaines, 2017;Meeussen et al., 2022). ...
Article
The study of cognitive biases in job interviews has garnered significant attention due to its far-reaching implications for the economy and society. However, little research has focused on the biases exhibited by expert psychologists serving on psychology specialization examination committees. As such, this study has conducted a comprehensive examination of biases within the specialization exam in Israel. One additional objective of the research is to assess the levels of distress experienced by examinees following the examination. Questionnaires were administered to 418 psychologists participating in the clinical and educational psychology specialization exams. The findings unveiled several noteworthy outcomes. Firstly, several biases were identified, including ethnic stereotypes, biases stemming from cognitive load, and more. Secondly, examinees who presented a cognitive-behavioral therapy (CBT) case experienced a higher failure rate. Thirdly, a positive association was found between exam failure and personal distress and this effect was stronger for educational examinees compared to clinical examinees. The most intriguing discovery was that all biases, without exception, occurred among clinical psychologists, whereas educational psychologists displayed no biases. This outcome contrasted with initial expectations. Consequently, the present study aims to expand the existing knowledge about psychological biases and stereotypes by elucidate the reasons behind this discrepancy between the two disciplines while considering the advantages and disadvantages associated with a sense of "expertise" in the realm of adult diagnostics.
... In this case, we provisionally echo the recommendation from past research that interviewers use highly structured interviews regardless of the constructs of interest(Roulin et al., 2019). In general, structured interviewing is more valid, less likely to lead to bias and discrimination(de Kock & Hauptfleisch, 2018), and may be more legally defensible(Highhouse et al., 2016) than less structured interview formats. ...
Article
Full-text available
The employment interview is used to assess myriad constructs to inform personnel selection decisions. This article describes the first meta‐analytic review of the criterion‐related validity of interview‐based assessments of specific constructs (i.e., related to task and contextual performance). As such, this study explores the suitability of the interview for predicting specific dimensions of performance, and furthermore, if and how interviews should be designed to inform the assessment of distinct constructs. A comprehensive search process identified k = 37 studies comprising N = 30,646 participants ( N = 4449 with the removal of one study). Results suggest that constructs related to task ( ρ = .30) and contextual ( ρ = .28) performance are assessed with similar levels of criterion‐related validity. Although interview evaluations of task and contextual performance constructs did not show discriminant validity within the interview itself, interview evaluations were more predictive of the targeted criterion construct than of alternative constructs. We further found evidence that evaluations of contextual performance constructs might particularly benefit from the adoption of more structured interview scoring procedures. However, we expect that new research on interview design factors may find additional moderating effects and we point to critical gaps in our current body of literature on employment interviews. These results illustrate how a construct‐specific approach to interview validity can spur new developments in the modeling, assessment, and selection of specific work performance constructs.
... 31 ; What are other people choosing? 32 ; or Which specialty has the most people like me? 33 Each of these substitutions results in a deviation from the target attribute and may contribute to subsequent dissatisfaction with the decisions made. ...
Article
Full-text available
Background For medical training to be deemed successful, in addition to gaining the skills required to make appropriate clinical decisions, trainees must learn how to make good personal decisions. These decisions may affect satisfaction with career choice, work–life balance, and their ability to maintain/improve clinical performance over time—outcomes that can impact future wellness. Here, the authors introduce a decision‐making framework with the goal of improving our understanding of personal decisions. Methods Stemming from the business world, the Cynefin framework describes five decision‐making domains: clear , complicated , complex , chaotic , and confusion , and a key inference of this framework is that decision‐making can be improved by first identifying the decision‐making domain. Personal decisions are largely complex—so applying linear decision‐making strategies is unlikely to help in this domain. Results The available data suggest that the outcomes of personal decisions are suboptimal, and the authors propose three mechanisms to explain these findings: (1) Complex decision is susceptible to attribute substitution where we subconsciously trade these decisions for easier decisions; (2) predictions are prone to cognitive biases, such as assuming our situation will remain constant (linear projection fallacy), believing that accomplishing a goal will deliver lasting happiness (arrival bias), or overestimating benefits and underestimating costs of future tasks (planning fallacy); and (3) complex decisions have an inherently higher failure rate than complicated decisions because they are the result of an ongoing, dynamic person‐by‐situation interaction and, as such, have more time to fail and more ways to do so. Discussion Based upon their view that personal decisions are complex, the authors propose strategies to improve satisfaction with personal decisions, including increasing awareness of biases that may impact personal decisions. Recognising that the outcome of personal decisions can change over time, they also suggest additional interventions to manage these decisions, such as different forms of mentoring.
... During the interview process, this bias can very easily cause the interviewer to unconsciously favor a group that is similar to them, resulting in serious group bias. Scholars have observed that to solve the problem by implementing a more robust interview structure, the presence of similarity bias could also be effectively suppressed, while unstructured interviews are more likely to engage in similarity bias [18][19] [20]. This is due to the high degree of validity of structured interviews, as well as the fact that strictly limiting the content of the interview reduces the influence that the interviewer brings to the interview. ...
Article
Full-text available
Interviews plays a crucial role in the hiring process, influencing decisions that can significantly organizations and individuals. This literature review comprehensively examines the role of interviews in the hiring process, focusing on three dimensions: structure, response bias, and interviewee experience. It begins by defining each interview structure and discussing the shortcomings of unstructured interviews in terms of reliability and validity, the flexibility of semi-structured interviews, and the high validity of structured interviews. In addition, this paper addresses the issues of response bias and interviewee experience that frequently arise in interviews. Potential solutions to these issues are explored, leveraging the distinctive features of the three structures. And the finding suggests that structured interviews are more effective in mitigating bias, while semi-structured interviews prioritize the interviewees experience. The strong replicability of structured interviews makes them suitable for extensive study and future improvement. Therefore, this paper proposes that enhancing interviewee experience in structured interviews should be a key area of future research.
... Similarly, political conservatives tend to be more prejudiced against members of many disadvantaged groups (Badaan & Jost, 2020). Studies linking interviewer characteristics to bias have tended to focus on whether interviewers share the same race (de Kock & Hauptfleisch, 2018), gender, or other demographic variables with applicants (Graves & Powell, 1996); whereas we are directly examining the interviewer characteristics that are only weakly related to these demographic variables. ...
Article
Full-text available
The current study examines the riskiest forms and sources of potential bias in the employment interview. A mixed methods survey focused on interviewers' attention to various potentially biasing applicant characteristics, how interviewers learn about such characteristics, the traits of interviewers who are sensitive to such characteristics, and how knowledge of such characteristics affects interviewers' opinions of applicants. Participants were 680 professional interviewers from the U.S., U.K., and Canada. High risks of bias were associated with six applicant characteristics (as targets of bias), three interviewer characteristics (as predisposing toward bias), and three sources of information in the interview process. Interviewers commonly rationalized their judgments in job‐relevant terms. These results have implications for understanding and limiting the risk of common selection biases.
... The strong preference towards choosing White advisors may be explained in a number of ways. Given that 72.3% of our subjects identified as White, this preference may be a result of similarity or affinity bias which has been studied and demonstrated to be influential in decision-making (Roth et al. 2020;Ye et al. 2017;de Kock and Hauptfleisch 2018). Secondly, since subjects were asked to create a profile which they believe will successfully obtain funding from the government, the strong preference towards White advisors can be a result of people's belief that there is existing bias in high-stakes decision-making that favors White individuals and existing discrimination towards people from other races which would make a White advisor more likely to succeed in obtaining funding (Dehon et al. 2017;Capers IV et al. 2017;Einstein and Glick 2017). ...
Article
Bias can have devastating outcomes on everyday life, and may manifest in subtle preferences for particular attributes (age, gender, ethnicity, profession). Understanding bias is complex, but first requires identifying the variety and interplay of individual preferences. In this study, we deployed a sociotechnical, web-based human-subject experiment to quantify individual preferences in the context of selecting an advisor to successfully pitch a government-expense. We utilized conjoint analysis to rank the preferences of 722 U.S. based subjects, and observed that their ideal advisor was White, middle-aged, and of either a government or STEM-related profession (0.68 AUROC, p < 0.05). The results motivate the simultaneous measurement of preferences as a strategy to offset preferences that may yield negative consequences (e.g. prejudice, disenfranchisement) in contexts where social interests are being represented.
Article
Full-text available
The authors describe the residency match as a two-step process. The first step, the Choice, is where students use a combination of intuitive and analytic information processing to select the specialty that they believe will provide fulfilment and work-life balance over their entire career. The second step, the Match, uses a “deferred-acceptance” algorithm to optimize pairing of students and their specialty choices. Despite being the rate-limiting step, outcomes of the Choice have typically been eclipsed by the outcomes of the Match. A recently published study found that during their second year of residency training, 1 in 14 physicians reported specialty choice regret, which associates with symptoms of burnout in residents. While the obvious solution is to design interventions that improve the specialty choices of students, this approach faces significant challenges, including the fact that: 1) satisfaction with specialty choice is a difficult-to-define construct; 2) specialty choice regret may be misattributed to a poor choice; and 3) choosing is a more complicated process than matching. The authors end by suggesting that if we hope to improve satisfaction with specialty choice then we should begin by defining this, deciding when to assess it, and then creating assessment tools for which there is validity evidence and that can identify the underlying causes of specialty choice regret.
Chapter
Extending discussion of wage differentials and inequalities, racist wages can be addressed through the lenses of geography and mobility. This chapter considers wage and wellbeing through three such focal domains: In your own land; in another land; and in a shared land. In each of these domains, research find racist wages. Research and theory have also identified key reasons for their persistence, and thereby ways to tackle their deleterious effects on wellbeing. Addressing them includes creating far better, less easily corrupted wage opportunity structures. These include for example at interviews, in performance appraisals, and through affirmative action policies within organisations. These mid-level structural measures need to be further backed by more macro-level government laws. Only through cross-level partnerships like these can racist wages and their ill-effects on personal and social wellbeing be sustainably eliminated.
Chapter
Chapter 10 offers a set of interrelated Policy Briefs - a wage policy suite. Integrating preceding chapters, each brief identifies a core wage policy issue and matched wellbeing issue. The briefs are pitched at multiple levels of policy-making, from SME to MNE, civic to civil society, multinational to multilateral; along global supply chains and all the way up to the UN itself. Inter-organisational. Together they call for a harmonised (a) paradigm shift on how wage is researched, from criterion-to-predictor and nominal-to-interval variable; (b) a full figure-ground reversal between efficiency vs. wellbeing; and (c) formal jobs vs. sustainable livelihoods; (d) combating economic slavery with all-of-supply-chain fair/living wage trademarks; that (e) raise minimum to living wage levels; then (f) capping maximum wages against minimum living wage; and finally (g) instead of trying to shift sexist, racist and ageist mentalities, restructuring wages first, via fair quotas and living wages.
Chapter
Menschliche Entscheidungen sind fehleranfällig und unterliegen oft kognitiven Verzerrungen. Insbesondere bei Entscheidungen, die von Unsicherheit, Dringlichkeit und Komplexität gekennzeichnet sind, ist dies der Fall. Hierbei gilt es zwischen Fehlern, die durchaus bedeutsam für den Erkenntnisgewinn sein können und dem Irrtum zu differenzieren. Letzteres basiert auf einer inkorrekten Einschätzung und kann nicht immer als solche bestimmt werden. Diverse Managemententscheidungen unterliegen ebenfalls Fehlern und kommen als Verzerrungen in Personalentscheidungen oder im strategisch organisationalen Kontext zu tragen. Der Einsatz von Künstlicher Intelligenz (KI) im Management kann menschlichen Verzerrungen entgegenwirken und Transparenz in Entscheidungsprozessen bringen. Zudem kann der Einsatz von KI die zunehmende Komplexität, Ambiguität und Unsicherheiten im Umgang mit großen Datenstrukturen reduzieren. Dabei gilt es jedoch auf potentielle Fallstricke zu achten, da eine KI durchaus auch fehleranfällig sein kann und diese strukturellen Fehler (z. B. verzerrte Trainingsdaten) dementsprechend in praktischen Szenarien anwendet. Darüber hinaus gilt es ethische und moralische Aspekte in der Interaktion zwischen Menschen und KI in symbiotischen Entscheidungsprozessen zu berücksichtigen und zu implementieren. Dieses Kapitel beleuchtet den Einsatz von KI in Managemententscheidungen und den damit verbundenen Vorteilen sowie Herausforderungen, die dem aktuellen Stand der Technologie zugrunde legen.
Article
Full-text available
There has been a growing interest in understanding what constructs are assessed in the employment interview and the properties of those assessments. To address these issues, the authors developed a comprehensive taxonomy of 7 types of constructs that the interview could assess. Analysis of 338 ratings from 47 actual interview studies indicated that basic personality and applied social skills were the most frequently rated constructs in this taxonomy, followed by mental capability and job knowledge and skills. Further analysis suggested that high-and low-structure interviews tend to focus on different constructs. Taking both frequency and validity results into consideration, the findings suggest that at least part of the reason why structured interviews tend to have higher validity is because they focus more on constructs that have a stronger relationship with job performance. Limitations and directions for future research are discussed.
Article
Full-text available
Rater bias is a substantial sourer of error in psychological research. Bias distorts observed effect sizes beyond the expected level of attenuation due to intrarater error, and the impact of bias is not accurately estimated using conventional methods of correction for attenuation. Using a model based on multivariate generalizability theory, this article illustrates how bias affects research results. The model identifies 4 types of bias that may affect findings in research using observer ratings, including the biases traditionally termed leniency and halo errors. The impact of bias depends on which of 4 classes of rating design is used, and formulas are derived for correcting observed effect sizes for attenuation (due to bias variance) and inflation (due to bias covariance) in each of these classes. The rater bias model suggests procedures for researchers seeking to minimize adverse impact of bias on study findings.
Article
Full-text available
Dispositional reasoning is defined as general reasoning about traits, behaviors, and situations. Although earlier accuracy studies found that it predicted interview judgment accuracy, they did not distinguish between its underlying components (i.e., trait induction, trait extrapolation, and trait contextualization). This drawback has hampered insight into the nature of the dispositional reasoning construct. Therefore, we use a componential approach to test if dispositional reasoning adheres to classical criteria for an intelligence. Results from 146 managerial interviewers who observed videotaped interviewees showed that the dispositional reasoning components had positive manifold and predicted interview accuracy. Moreover, they demonstrated discriminant validity with personality and incremental validity over cognitive ability in predicting interview accuracy. Together, findings suggest that dispositional reasoning broadly adheres to the classical criteria for an intelligence.
Book
This second edition provides managers and students the nuts and bolts of assessment processes and selection techniques. With this knowledge, managers learn to make informed personnel decisions based on the results of tests and assessments. The book emphasizes that employee performance predictions require well-formed hypotheses about personal characteristics that may be related to valued behavior at work. It also stresses the need for developing a theory of the attribute one hypothesizes as a predictor—a thought process too often missing from work on selection procedures. Topics such as team-member selection, situational judgment tests, nontraditional tests, individual assessment, and testing for diversity are explored. The book covers both basic and advanced concepts in personnel selection in a straightforward, readable style intended to be used in both undergraduate and graduate courses in Personnel Selection and Assessment.
Article
This chapter reviews the research on the most frequently used of all instruments of employee selection: the interview. When considered as a means of assessing applicant job qualifications, the interview is typically discussed from the interviewer's perspective. We propose in the present chapter that the quality of the interview as a tool of assessment depends on taking into consideration both the interviewer and the applicant perspective. Interviewers attempt to gather information on applicants and select among them. Although it is apparent that structuring the process improves the reliability and validity of their assessments, interviewers must balance the goal of selection with other goals such as recruitment. On the other hand, applicants manage impressions, gather information, and judge the position and the work environment. We discuss the alternative objectives that both interviewer and applicant bring to the interview and how these objectives can clash. We conclude by considering strategies for improving the interview as a means of assessment by dealing with tensions that can exist between and within interviewer and applicant.
Article
The job interview is one of the most widely used assessment tools in the selection process. Despite its popularity in practice, interview outcomes can be prone to bias. Although our knowledge of stigmatizing applicant characteristics that elicit subgroup differences has grown exponentially, research continuously highlights the need for a framework underlying interview bias. This paper proposes a framework for interview bias based on the dual-process theory, which is a widely applicable theoretical framework that has influenced research on social-interactions, information processing, and decision making. Specifically, we investigate how stigmatizing applicant characteristics affect interviewers’ information processing during the three main stages of the interview (i.e., pre-interview, interview, decision-making), we discuss situational and interviewer factors as moderators, and describe the impact on interview outcomes (like interview bias). Building on the dual-process theory, we formulate key propositions, related to each of the interview stages. Finally, we discuss the implications of this framework for future interview and stigma research and for organizations’ interviewing practice.