ArticlePublisher preview available

Employee Time Theft: Conceptualization, Measure Development, and Validation

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

Despite its prevalence, high cost, and practical import, employee time theft has received scant research attention. To facilitate future scholarship on this important topic, the present research endeavors to clarify the conceptualization of time theft and advance understanding regarding the range of its behavioral manifestations, develop and validate an instrument to assess time theft, and provide preliminary insights into its nomological net. Results, gathered across nine samples of employees who are paid on an hourly wage scale, suggest that time theft is a multidimensional formative construct, is distinct from other deviant work behaviors (e.g., withdrawal, property theft), and is influenced by instrumental (e.g., pay satisfaction) and expressive motives (e.g., boredom). Finally, time theft explained incremental variance in criterion variables (e.g., receipt or enactment of interpersonal help) controlling for the effects of other discrete manifestations of deviance (e.g., withdrawal). Implications for future scholarship and managerial practice are discussed. This article is protected by copyright. All rights reserved
Received: 6 March 2020 Revised: 23 July 2021 Accepted: 4 August 2021
DOI: 10.1111/peps.12477
ORIGINAL ARTICLE
Employee time theft: Conceptualization, measure
development, and validation
Crystal M. Harold1Biyun Hu2,3Joel Koopman4
1Department of Human Resource
Management, Fox School of Business, Temple
University, Philadelphia, USA
2Business Administration, School of Business
and Management, Shanghai International
Studies University, Shanghai, China
3Institute of Organizational Behavior and
Organizational Neuroscience, Shanghai
International Studies University, Shanghai,
China
4Department of Management, Mays Business
School, Texas A&M University, Texas, USA
Correspondence
Crystal M. Harold, 355 Alter Hall, 1801 Lia-
couras Walk,Philadelphia PA 19122, USA.
Email: charold@temple.edu
Abstract
Despite its prevalence, high cost, and practical import,
employee time theft has received scant research attention.
To facilitate future scholarship on this important topic, the
present research endeavors to clarify the conceptualiza-
tion of time theft and advance understanding regarding the
range of its behavioral manifestations, develop and validate
an instrument to assess time theft, and provide preliminary
insights into its nomological net. Results, gathered across
nine samples of employees who are paid on an hourly wage
scale, suggest that time theft is a multidimensional forma-
tive construct, is distinct from other deviant work behaviors
(e.g., withdrawal, property theft), and is influenced by instru-
mental (e.g., pay satisfaction) and expressive motives (e.g.,
boredom). Finally, time theft explained incremental variance
in criterion variables (e.g., receipt or enactment of interper-
sonal help) controlling for the effects of other discrete man-
ifestations of deviance (e.g., withdrawal). Implications for
future scholarship and managerial practice are discussed.
KEYWORDS
construct validation, employee time theft, hourly employees
1INTRODUCTION
In the summer of 2018, the California Department of Motor Vehiclesmade national headlines when the State Auditor’s
office revealed that, over the course of 4 years, an employee slept on the job for roughly 3 hours each day (California
State Auditor, 2018). In this same report, investigators uncovered extensive time abuses by two other State employ-
ees who would regularly arrive to work at the start of the workday only to immediately proceed to take extended
breaks and even leave their worksite without permission. Over a 4-year period, the Auditor’s report estimated that
Personnel Psychology. 2022;75:347–382. © 2021 Wiley Periodicals, Inc. 347wileyonlinelibrary.com/journal/peps
... Similarly, time theft causes more than $177 billion in losses to US corporations each year (Xu et al., 2023). Therefore, a lot of scholars are curious to determine how business organizations can curb these two unethical behaviours of employees Harold et al., 2022;Lorinkova & Perry, 2017;Offergelt & Venz, 2023). As an emerging technology, AAI in the organization, is bound to exhibit a significant impact on employees' behaviour, but whether the technology will have an impact on employee unethical behaviour is unknown. ...
... Similarly, employees may lack crisis awareness and assume that the organization is satisfied with their current status (i.e., less job insecurity), at a high level of POS, hence, believing that there is no need to spend excessive time to master new skills and knowledge (De Cuyper et al., 2022;Van Hootegem et al., 2023). Further, AAI encourages staff members to save more time and resources, but this part of working time may be used to deal with their personal affairs; resultantly, employees may exercise more time theft (Hu et al., 2022;Zhao et al., 2022). Therefore, the following research hypotheses are proposed: ...
... We measured time theft with the 15-item from Harold et al. (2022). A sample item was "I took unapproved breaks (e.g., coffee breaks, cigarette breaks, bathroom breaks)". ...
Article
Based on cognitive appraisal theory, this paper performs two studies using time-lag design to explore the influential mechanism of the application of artificial intelligence (AAI) on employ-ees' unethical behaviours (i.e. knowledge hiding and time theft). Study 1 indicates that AAI demonstrates a significant positive impact on knowledge hiding, while job insecurity plays a mediating role in the aforementioned relationship. Study 2 not only confirms the research findings of Study 1 but also establishes that AAI exerts a significant negative influence on time theft, whereas job insecurity plays a mediating role in the above relationship. Meanwhile, perceived organizational support is capable to weaken the positive effect of AAI on job insecurity, while also weakening the indirect impact of AAI on knowledge hiding and time theft. Overall, this study unveils why, how, and when AAI shall affect employees' unethical behaviours.
... All managers want their organizations' employees to be productive during the workday (Brock Baskin et al., 2017;Diamantidis & Chatzoglou, 2019). However, the amount of time employees waste at work is considerable and few people can ensure that they are 100% productive at work (Brock et al., 2013;Harold et al., 2022). Moreover, the length of time employees waste at work has consistently climbed (Brock Baskin & McKee, 2019). ...
... Moreover, the length of time employees waste at work has consistently climbed (Brock Baskin & McKee, 2019). A large number of employees perform non-work-related tasks or deliberately fail to report the number of their work hours, but still get payment for this time (Elrehail et al., 2021;Harold et al., 2022). This behavior of wasting or not working time within the allotted working hours is essentially time theft (Henle et al., 2010;Brock Baskin et al., 2017;Ding et al., 2018). ...
... Time theft has been recognized as a form of organizational deviant behavior (Robinson & Greenberg, 1998;Henle et al., 2010;Harold et al., 2022). The motivations for this behavior can be broadly divided into two categories: (1) Instrumental motivations arising from feelings of unfairness, to improve the condition or restore fairness; (2) Expressive motivations arising from negative emotions, to vent anger or frustration (Robinson & Bennett, 1997). ...
Article
Full-text available
Time theft is an organizational deviant behavior that can have a serious negative impact on both the organization and the individual employees. There are two dimensions of time theft that are easily overlooked due to their high level of concealment: manipulating the speed of work and faking work hours. Based on self-presentation theory, this study constructs a theoretical model of the effects of careerist orientation on manipulating the speed of work and faking work hours, and examines the mediating role of self-monitoring and the moderating role of moral identity. Data were collected through a questionnaire survey of 306 employees in Chinese companies and analyzed by structural equation modeling. The results of the study show that careerist orientation can positively influence falsifying working hours and manipulating the speed of work not only directly but also indirectly through self-monitoring. In addition, moral identity can inhibit employees with careerist orientation from achieving their career goals because of falsifying working hours and manipulating the speed of work. This paper contributes to the literature by providing empirical evidence that careerist orientation positively influences time theft behaviors through self-monitoring, highlighting the role of individual traits in organizational deviance. Furthermore, it enriches the field by demonstrating the moderating effect of moral identity, which inhibits the tendency of careerist-oriented employees to engage in time theft, offering new insights into the boundary conditions of unethical conduct in the workplace.
... As time is invisible, time theft is difficult to detect but damages a lot (Xu et al., 2023). According to the American Payroll Association, the 75% of businesses in the U.S. are afflicted by these inconspicuous misconducts and the average hourly employee steals four hours per week, resulting in an approximate 7% annual payroll loss for businesses (Harold et al., 2022). Given the detrimental effects of time theft, human resource practitioners urgently need Bo Lv and Jie Xiao have contributed equally to this paper. ...
... To a certain extent, such behavior satisfies employees' interests, such as completing other things during work time to ensure that they can rest after work, or just slacking off at work to recover their resources (Henle et al., 2010). However, it is at the expense of the organization's economic interests because time theft diminishes motivation, morale and productivity, impairs interpersonal relationship with coworkers or supervisors, and causes large amounts of organizational financial loss (Harold et al., 2022;Henle et al., 2010;Liu & Berry, 2013). In summary, time theft represents the destruction for others in nature and violation for the ethical rules, which runs counter to the other-oriented ethical code emphasized by SRHRM. ...
Article
Full-text available
Time theft represents an inconspicuous yet pervasive form of unethical misconduct in the workplace, engendering significant losses for organizations. It is thus incumbent upon companies to take measures to mitigate such conduct. Human resource management (HRM) constitutes a pivotal approach through which organizations can regulate employee actions and curb organizational misconduct; however, its role has been largely underexplored in the extant literature. Recognizing the moral foundations of socially responsible HRM (SRHRM), we synthesize signaling theory with cue consistency theory to posit that SRHRM exerts a negative influence on employee time theft via enhanced moral awareness. Furthermore, we contend that ethical leadership acts as a critical contingency factor that reinforces the negative relationship between SRHRM and time theft through heightened moral awareness. Employing two-wave survey studies and a scenario-based experiment, our hypotheses were empirically supported. Our findings contribute to both theoretical and practical understandings within the domains of SRHRM and time theft research. Additionally, we discuss limitations and propose future research directions.
... Using a critical incident approach, we came to realize that the most critical distinguishing factor across venting episodes involved the target of the venting-supervisor, coworker, clients, work itself, or one's family or personal life. Using these narratives, in Phase 2 we generated 58 items (51 of which capture the specific targets about which people vent, and 7 which capture venting in a "global" sense based on our a priori expectation [see Phase 4] that venting is a formative construct; Diamantopoulos 2017a, 2017b;Harold, Hu, and Koopman 2022;Li, Kristof-Brown, and Nielsen 2019;MacKenzie, Podsakoff, and Podsakoff 2011) and tested their content validity. This allowed us to reduce our items to five per dimension (30 items total-25 capturing the specific dimensions of venting and 5 global items). ...
... 7 In total, we included 15 items. We also included a three-item global measure of venting, as this is necessary to model venting as a formative construct in the CFA (e.g., Harold, Hu, and Koopman 2022). Participants responded to each item on a five-point scale ranging from 1 = "not at all" to 5 = "a great deal." ...
Article
Full-text available
As a form of social communication at work, venting—expressing negative feelings about a person or event to others—is fairly ubiquitous. Yet little is known about how those who are the recipients of venting react affectively and behaviorally to this experience at work. To advance our understanding of venting receipt in the workplace, we integrate the archaic view of vicarious emotions into research related to venting at work to develop theory regarding how receiving venting is likely to evoke feelings of personal distress and empathy as employees react to and process this social information. In turn, we theorize that while personal distress leads to venting enactment, empathy leads to helping that can promote more positive social relations, highlighting the double‐edged nature of this phenomenon. Finally, beyond clarifying the theoretical ways that venting recipients react, we also consider how the broader social context—namely, coworker similarity—has the potential to shape these reactions. Across two within‐person field studies, both of which utilize a newly developed measure of venting receipt at work, and a supplemental recall experiment, our research highlights why and when venting at work can have divergent effects on venting recipients.
... Following best practices for construct validation (e.g., Djurdjevic et al., 2017;Gorbatov et al., 2021;Harold et al., 2022), we explored the discriminant validity of our measure using a series of one-and two-factor CFAs in which the items for wasted time and one orbiting construct (interruptions or justice) were loaded onto the same factor or two separate factors. Here, we aim to assess the distinctiveness of wasted time perceptions in relation to each orbiting construct individually. ...
... We also encourage research aimed at expanding our understanding of the potential effects of wasted time perceptions beyond the outcomes from this study. For exploratory purposes, in our incremental validity investigation (Sample 4), we also examined whether employees might engage in specific forms of CWB (i.e., withdrawal & time theft ;Harold, et al., 2022) in response to others wasting their time (see Tables A6 and A7 of the online supplement). Results suggest that wasted time perceptions explained unique variance in withdrawal (∆R 2 = .05), ...
... Following best practices for construct validation (e.g., Djurdjevic et al., 2017;Gorbatov et al., 2021;Harold et al., 2022), we explored the discriminant validity of our measure using a series of one-and two-factor CFAs in which the items for wasted time and one orbiting construct (interruptions or justice) were loaded onto the same factor or two separate factors. Here, we aim to assess the distinctiveness of wasted time perceptions in relation to each orbiting construct individually. ...
... We also encourage research aimed at expanding our understanding of the potential effects of wasted time perceptions beyond the outcomes from this study. For exploratory purposes, in our incremental validity investigation (Sample 4), we also examined whether employees might engage in specific forms of CWB (i.e., withdrawal & time theft ;Harold, et al., 2022) in response to others wasting their time (see Tables A6 and A7 of the online supplement). Results suggest that wasted time perceptions explained unique variance in withdrawal (∆R 2 = .05), ...
Article
Anecdotal evidence in popular literature abounds about how perceiving that others have wasted one’s time is a common workplace experience with potentially negative consequences. Yet, there is a dearth of rigorous empirical research into the subjective nature of this psychological experience and its effect on employees. A lack of construct clarity and the absence of a validated measure to assess perceptions of having one’s time wasted have held scholarship back. To stimulate research on this topic, building on the recent focus on subjective time in the literature on time and adopting an entity-based approach, we offer a definition of wasted time perceptions and develop and validate a measure of this construct. Our five-item measure of wasted time perceptions demonstrated strong psychometric properties across seven independent samples. Further, building on frustration–aggression theory, we demonstrate that wasted time perceptions predict core affective and behavioral outcomes in the management literature, above and beyond previously established predictors. We also show that our new measure is easily adaptable to, and differentiates across, different focal entities (e.g., boss, coworker, subordinate, customer) relevant to organizational scholars. Implications and future research directions are discussed.
Article
Full-text available
Although information and communication technologies are advantageous for enhancing employee performance, excessive use of technologies during non-working hours may increase employees’ experience of techno-invasion. Techno-invasion may cause them such emotional exhaustion that they will need to deal with non-work-related matters during working hours in order to relieve stress and preserve their limited time resources. Little research has systematically examined the role of techno-invasion in time banditry. The study treated in this paper explored why there is a positive relationship between techno-invasion and time banditry and its boundary conditions. The study used conservation of resources theory to address this research gap. Over four weeks, three hundred and seventy-eight working adults completed two waves of time-lagged surveys measuring techno-invasion, emotional exhaustion, time banditry, and meaningful work. The results showed that techno-invasion positively predicted a high level of time banditry, and emotional exhaustion played a mediating role in the positive relationship between techno-invasion and time banditry. Importantly, this study found that meaningful work acted as a buffer on the relationship between emotional exhaustion and time banditry. These findings extend our understanding of the negative consequences of techno-invasion and shed light on how to deal with them.
Article
Full-text available
Purpose The main objective of this study was to understand why employees engage in time theft behavior and what is the behavioral consequence of this deviant behavior. To do this, the conservation of resources theory helps to examine the role of organizational cronyism behind employee time theft behavior and decreased proactive behavior. Design/methodology/approach A three-wave self-administered employee survey was used for data collection. The data were collected through an adopted questionnaire from nurses working in the public sector hospitals of Pakistan. Structural equation modeling (SEM) was used to analyze data collected from 256 respondents. Findings The results of this three-wave study supported the hypotheses which are: (1) Organizational cronyism positively predicts employee involvement in time theft behavior. (2) Employee time theft behavior negatively impacts their proactive behavior. (3) Organizational cronyism is detrimental to employee proactive behavior. (4) The relationship between organizational cronyism and proactive behavior is mediated by time theft. Practical implications In the presence of organizational cronyism, employees use time theft as a dysfunctional coping strategy to conserve their valued resources rather than allowing the organization to consume them. Organizational leaders of public sector hospitals must promote merit-based HRM practices to discourage time theft behavior as well as to improve the proactive performances of the nurses. Originality/value This study is one of the initial attempts to extend the scant literature on the antecedents and consequences of time theft behavior and its dimensions in the South Asian context.
Preprint
Full-text available
Time banditry, or the tendency of employees to engage in non-work-related activities during work hours, presents a significant cost to organizations. Despite its impact, the underlying causes of this behavior remain underexplored. This study investigates the relationship between Dark Triad personality traits—psychopathy, Machiavellianism, and narcissism—and situational factors such as general loneliness, social media addiction, and workplace boredom, with the various dimensions of time banditry: classic, technological, and social. We surveyed 264 employees from both private and public sectors in Sakarya, Turkey. The research revealed that psychopathy had the strongest association with time banditry behaviors. Interestingly, narcissism did not correlate with any form of time banditry. The study also found that workplace boredom and social media addiction were significantly linked to time banditry. These factors diminished the influence of Dark Triad traits when factored into regression analyses. General loneliness showed no connection to time banditry, and demographic variables such as gender, age, and marital status had no discernible effect. The paper delves into the broader conceptual implications of these findings, particularly within the context of Turkey's traditional collectivist culture. It concludes by offering directions for future research and practical strategies to mitigate time banditry in the workplace.
Article
Full-text available
An immense amount of work has investigated how adverse situations affect anxiety using chronic (i.e., average) or episodic conceptualizations. However, less attention has been paid to circumstances that unfold continuously over time, inhibiting theoretical testing and leading to possible erroneous conclusions about how stressors are dynamically appraised across time. Because stressor novelty, predictability, and patterns are central components of appraisal theories, we use the COVID-19 crisis as a context to illustrate how variation in the phenomenon’s patterns of change (specifically, total cases [average level] but also the rate of linear [velocity] and nonlinear growth [acceleration] in cases) influence anxiety. We also show the implications of anxiety for next-day functioning at work. These effects are tested in data drawn from a sample of employed adults in a daily diary study conducted in four overlapping waves. The data span the emergence, exponential rise, and initial tapering of the virus in the United States (February 10, 2020 to April 28, 2020). Our results show that although the impact of level of COVID-19 cases on anxiety decreases over time, the effect of change in cases (velocity and acceleration) increases over time. Anxiety is then associated with next-day work functioning (engagement, performance, and emotional exhaustion).
Article
Full-text available
Counterproductive work behavior (CWB) is a topic of considerable importance for organizational scholars and practitioners. Yet, despite a wide-ranging consensus that negative affect (NA) is a precursor to CWB, there is surprisingly little consensus as to whether CWB enactment will subsequently lead to lower or higher levels of NA. That is, scholars disagree as to whether CWB has a reparative (negative) or generative (positive) effect on subsequent NA. We submit that both perspectives have validity, and thus the question should not be whether CWB is associated with lower or higher subsequent levels of NA, but rather for whom. This article is dedicated to answering this question. Drawing from the behavioral concordance model, we position empathy as a moderator of this relationship, such that CWB will be reparative for those with lower levels of empathy and generative for those with higher levels of empathy. Findings across 3 experience-sampling studies support our hypotheses and highlight a number of interesting directions for future research. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Article
Full-text available
We investigate the psychological recovery process of full-time employees during the 2-week period at the onset of the Coronavirus pandemic (COVID-19). Past research suggests that recovery processes start after stressors abate and can take months or years to unfold. In contrast, we build on autonomy restoration theory to suggest that recovery of impaired autonomy starts immediately even as a stressor is ongoing. Using growth curve modeling, we examined the temporal trajectories of two manifestations of impaired autonomy—powerlessness and (lack of) authenticity—to test whether recovery began as the pandemic unfolded. We tested our predictions using a unique experience-sampling dataset collected over a 2-week period beginning on the Monday after COVID-19 was declared a “global pandemic” by the World Health Organization and a “national emergency” by the U.S. Government (March 16–27, 2020). Results suggest that autonomy restoration was activated even as the pandemic worsened. Employees reported decreasing powerlessness and increasing authenticity during this period, despite their subjective stress-levels not improving. Further, the trajectories of recovery for both powerlessness and authenticity were steeper for employees higher (vs. lower) in neuroticism, a personality characteristic central to stress reactions. Importantly, these patterns do not emerge in a second experience-sampling study collected prior to the COVID-19 crisis (September 9–20, 2019), highlighting how the pandemic initially threatened employee autonomy, but also how employees began to recover their sense of autonomy almost immediately. The present research provides novel insights into employee well-being during the COVID-19 pandemic and suggests that psychological recovery can begin during a stressful experience.
Article
Full-text available
The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn't clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one to have sufficient confidence in conclusions regarding constructs. The purposes of the present article are to (a) examine current scale development and evaluation practices in JAP; (b) compare these practices to recommended practices, previous practices, and practices in other journals; and (c) use these comparisons to make recommendations for reviewers, editors, and investigators regarding the creation and evaluation of measures including Excel-based calculators for various indices. Finally, given that model complexity appears to have increased the need for short scales, we offer a user-friendly R Shiny app (https://orgscience.uncc.edu/about-us/resources) that identifies the subset of items that maximize a variety of psychometric criteria rather than merely maximizing alpha. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Article
Full-text available
Crafting a personal brand has become an important factor for career success. Despite the growing literature on topics associated with personal brands, the conceptualization and measurement of personal brand equity (PBE) have received little attention. By drawing upon and integrating the marketing and careers literatures on branding, we reconceptualized the definition of PBE and delineated its dimensions and conceptual boundaries. Furthermore, we developed a 12‐item scale to measure PBE. Among seven different samples (total N = 3,273), including two samples of employees, this study tested the construct and criterion‐related validity of the PBE scale. First, exploratory and confirmatory factor analyses supported a three‐dimensional structure of PBE (brand appeal, brand differentiation, and brand recognition). In two samples, the convergent and discriminant validity of the PBE scale was established. Finally, this study showed that PBE predicts perceived employability, career success, and job performance. The PBE scale offers new opportunities to understand and measure career behaviors by considering individuals’ personal brand positioning. This article is protected by copyright. All rights reserved
Article
Full-text available
Research on emotional labor-the process through which employees enact emotion regulation (i.e., surface and deep acting) to alter their emotional displays-has predominately focused on service-based exchanges between employees and customers where emotions are commoditized for wage. Yet, recent research has begun to focus on the outcomes of employees engaging in emotion regulation, and surface acting in particular, with coworkers. Given that coworker interactions are qualitatively distinct from those with customers, we build on the emotional labor and emotion regulation literatures to understand why such acts of emotion regulation occur in coworker-based exchanges, and whether there are well-being and social capital costs and/or benefits for doing so. Across 3 complementary studies spanning over 2,500 full-time employees, we adopt a person-centered approach and demonstrate that four distinct profiles of emotion regulation emerge in coworker exchanges: deep actors, nonactors, low actors, and regulators. Further, our results suggest that certain employees are driven to regulate their emotions with coworkers for prosocial reasons (deep actors), whereas others are more driven by impression management motives (regulators). Our results also suggest that while nonactors and deep actors similarly incur well-being benefits (i.e., lower emotional exhaustion and felt inauthenticity), deep actors alone experience social capital gains in the form of higher receipt of help from coworkers, as well as increased goal progress and trust in their coworkers. Combined, our research delineates the motives that drive emotion regulation with coworkers and identifies when such regulatory efforts yield social capital gains for employees. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Article
Full-text available
Workplace deviance research has expanded rapidly over the past decade. Despite the expansive body of research available, we have an incomplete understanding of the measurement, magnitude, and direction of relationships within workplace deviance's nomological network. We draw from 235 empirical samples of data (k = 235, N = 66,990) to conduct random-effects meta-analyses of interpersonal (k = 156, N = 42,239) and organizational (k = 206, N = 60,008) workplace deviance research so we can build the solid foundation necessary to advance the conversation in this literature. We use an exploratory meta-analytic approach and the horizontal contrasting method of theory elaboration to provide a nuanced understanding of the relationship between interpersonal and organizational deviance (ρ = .67, k = 110, N = 30,426) as well as determine the magnitude and generalizability (i.e., external validity) of relationships within their nomological networks. We find some evidence of differences (i.e., heterogeneity) in the measurement and magnitude of relationships across contexts. Overall, we conduct a state-of-the-art meta-analysis that leverages contemporary meta-analytic techniques and the extensive body of empirical workplace deviance research available to improve our understanding of the measurement of workplace deviance and relationships Acknowledgments: We thank Ernest O'Boyle and two anonymous reviewers for their thoughtful and supportive feedback. We thank Katherine Alexander, Phil Andolena, Sami Berrada, and Nataliya Potapenko for their help coding the meta-analytic data for our study.
Article
Full-text available
Several reviews have been critical of the degree to which scales in industrial/organizational psychology and organizational behavior adequately reflect the content of their construct. One potential reason for that circumstance is a tendency for scholars to focus less on content validation than on other validation methods (e.g., establishing reliability, performing convergent, discriminant, and criterion-related validation, and examining factor structure). We provide clear evaluation criteria for 2 commonly used content validation approaches: Anderson and Gerbing (1991) and Hinkin and Tracey (1999). To create those guidelines, we gathered all new scales introduced in Journal of Applied Psychology, Academy of Management Journal, Personnel Psychology, and Organizational Behavior and Human Decision Processes from 2010 to 2016. We then subjected those 112 scales to Anderson and Gerbing's (1991) and Hinkin and Tracey's (1999) approaches using 6,240 participants from Amazon's Mechanical Turk with detailed, transparent, and replicable instructions. For both approaches, our results provide evaluation criteria for definitional correspondence-the degree to which a scale's items correspond to the construct's definition-and definitional distinctiveness-the degree to which a scale's items correspond more to the construct's definition than to the definitions of other orbiting constructs.