Sven Kepes

Virginia Commonwealth University | VCU · Department of Management

Purpose: The purpose of this study was to review the Meta-Analysis Reporting Standards (MARS) of the American Psychological Association (APA) and highlight opportunities for improvement of meta-analytic reviews in the organizational sciences. Design/Methodology/Approach: The paper reviews MARS, describes "best" meta-analytic practices across two sc...

Questionable research practices (QRPs) among researchers have been a source of concern in many fields of study. QRPs are often used to enhance the probability of achieving statistical significance which affects the likelihood of a paper being published. Using a sample of researchers from ten top research‐productive management programs, we compared...

Meta-analytic reviews are a primary avenue for the generation of cumulative knowledge in the organizational and psychological sciences. Over the past decade or two, concern has been raised about the possibility of publication bias influencing meta-analytic results, which can distort our cumulative knowledge and lead to erroneous practical recommend...

Heterogeneity refers to the variability in effect sizes across different samples and is one of the major criteria to judge the importance and advancement of a scientific area. To determine how studies in the organizational sciences address heterogeneity, we conduct two studies. In study 1, we examine how meta-analytic studies conduct heterogeneity...

Rapid growth in the gig economy has been facilitated by the increased use of algorithmic management (AM) in online platforms (OPs) coordinating gig work. There has been a concomitant increase in scholarship related to AM across scientific domains (e.g., computer science, engineering, operations management, management, sociology , and law). However,...

Situational judgment tests (SJTs) are popular assessment approaches that present scenarios describing situations that one may experience in a job. Due to its long history and cross-disciplinary nature, today's SJT literature is quite fragmented. In this integrative review, we start by systematically taking stock and synthesizing the SJT literature...

The confluence of changing employment norms and technological innovations is bringing forth a work ecosystem characterized by increases in episodic work, virtuality, individualization of labour, and transformation of jobs. Our paper builds upon existing scholarship, and data on labour trends to propose a framework that views the interactions betwee...

Purpose The purpose of this manuscript is to provide a step-by-step primer on systematic and meta-analytic reviews across the service field, to systematically analyze the quality of meta-analytic reporting in the service domain, to provide detailed protocols authors may follow when conducting and reporting these analyses and to offer recommendation...

The rapid escalation of technology-driven transformation has spawned scholarship across disciplines related to the future of work. We conducted a systematic bibliometric analysis of peer-reviewed publications across multiple disciplines (business, computer science, decision science, economics, engineering, psychology, and social science) to discove...

The goal of industrial/organizational (IO) psychology, is to build and organize trustworthy knowledge about people-related phenomena in the workplace. Unfortunately, as with other scientific disciplines, our discipline may be experiencing a "crisis of confidence" stemming from the lack of reproducibility and replicability of many of our field's res...

When does pay dispersion elicit positive or negative employee attitudes? A review of the pay dispersion literature indicates a controversy around this vital question and suggests that numerous contingency factors moderate the effects of pay dispersion. In an empirical study of four Finnish companies consisting of 141 work units, we examine continge...

Our meta-analysis provides a comprehensive examination of the correlation between cognitive ability and creativity. Introducing an integrative typology of creativity, we assess how, at the individual level, cognitive ability at Stratum III, as well as different cognitive ability dimensions at Stratum II from Carroll's (1993) Three-Stratum Theory, c...

To address the low reproducibility and replicability of research, Open Science Practices (OSPs) have been developed. Yet, despite increasing awareness of their potential benefits, there has been only little implementation. As journals can act as gatekeepers for scientific discoveries, a potential tendency not to mention OSPs on their websites may h...

Purpose Employing a service-profit chain (S-PC) framework, this manuscript investigates the relationship between employee engagement (EE) and customer engagement (CE) within service contexts and explores how a mediating mechanism, service employee work performance (SEWP), links EE with CE. Design/methodology/approach Meta-analytic procedures ascer...

Women are often depicted as sex objects rather than as human beings in the media (e.g., magazines, television programs, films, and video games). Theoretically, media de-pictions of females as sex objects could lead to negative attitudes and even aggressive behavior toward them in the real world. Using the General Aggression Model (Anderson & Bushma...

Tournament theory posits that some organizations are modeled after sports tournaments whereby individuals are incentivized to compete and win against other members of the organization. A persistent criticism of tournament theory is that rank-order success of employees is entirely dependent on non-interacting or at least non-cooperating entities. To...

Although systematic reviews are considered the primary means for generating cumulative knowledge and their results are often used to inform evidence-based practice, the robustness of their meta-analytic summary estimates is rarely investigated. Consequently, the results of published systematic reviews and, by extension, our cumulative knowledge hav...

Guns are associated with aggression. A landmark 1967 study showed that simply seeing a gun can increase aggression—called the “weapons effect.” This meta-analysis integrates the findings of weapons effect studies conducted from 1967 to 2017. It includes 162 effect-size estimates from 78 independent studies involving 7,668 participants. The theoreti...

The focal article (Grand et al., 2018) addresses one of the most important issues across virtually all areas of science (Goldstein, 2010): the trustworthiness and credibility of a scientific discipline. Once these attributes are lost, it is difficult to regain them within a reasonable time frame, if ever. In contrast to previous articles on this to...

Tipping represents a form of compensation valued at over $50 billion a year in the U.S. alone. Tipping can be used as an incentive mechanism to reduce a principal-agent problem. An agency problem occurs when the interests of a principal and agent are misaligned and it is challenging for the principal to monitor or control the activities of the agen...

Meta-analytic studies serve to generate cumulative knowledge and guide evidence-based practice. However, publication bias and outliers threaten the accuracy and robustness of meta-analytic results. Unfortunately, most meta-analytic studies in information systems (IS) research do not assess the presence of these phenomena. Furthermore, some methods...

A large meta-analysis by Anderson et al. (2010) found that violent video games increased aggressive thoughts, angry feelings, physiological arousal, and aggressive behavior and decreased empathic feelings and helping behavior. Hilgard, Engelhardt, and Rouder (2017) reanalyzed the data of Anderson et al. (2010) using newer publication bias methods (...

The construct validity of situational judgment tests (SJTs) is a “hot mess.” The suggestions of Lievens and Motowidlo (2016) concerning a strategy to make the constructs assessed by an SJT more “clear and explicit” (p. 5) are worthy of serious consideration. In this commentary, we highlight two challenges that will likely need to be addressed befor...

Introduction: Sensitivity analyses refer to investigations of the degree to which the results of a meta-analysis remain stable when conditions of the data or the analysis change. To the extent that results remain stable, one can refer to them as robust. Sensitivity analyses are rarely conducted in the organizational science literature. Despite cons...

Applicant attraction is a critical objective of recruitment. Common predictor variables of applicant attraction are limited in that they do not provide a comprehensive understanding of the process that shapes the perceptions and beliefs of job applicants about the firms for which they aspire to work for. Because individuals have the inherent desire...

Research has often called for studies to explain the complex causal chain known as the “black box” between human resource management (HRM) activities and individual-, unit-, and firm-level outcomes. To explore the dynamics within the “black box,” this article describes the influence of HRM activities (e.g., HRM policies, practices, and processes) o...

When does pay dispersion elicit positive employee attitudes and when not? A recent review of the pay dispersion literature indicates a dearth of research on this vital issue and the likelihood that numerous contingency factors moderate the relationship between pay dispersion and outcomes across levels of analysis (Shaw, 2014). In an empirical study...

Spearman's Hypothesis holds that the magnitude of mean White–Black differences on cognitive tests covaries with the extent to which a test is saturated with g. This paper evaluates Spearman's Hypothesis by manipulating the g saturation of cognitive composites. Using a sample of 16,384 people from the General Aptitude Test Battery database, we show...

In this study, we examine the cross-cultural differences in human resource (HR) managers’ beliefs in effective HR practices by surveying HR practitioners in Finland (N = 86), South Korea (N = 147), and Spain (N = 196). Similar to previous studies from the United States, the Netherlands, and Australia, there are large discrepancies between HR practi...

The promise of evidence-based management (EBMgt) is that educators and practitioners can access cumulative scientific information to guide their teaching and decision making. We argue that the EBMgt movement may be unable to live up to this promise to the extent that our cumulative scientific knowledge is not trustworthy. We review why the manageme...

Meta-analytic reviews are an important tool for advancing science and guiding evidence-based practice. Publication bias is one of the greatest threats to meta-analytic reviews. This paper assesses the degree of publication bias in four previously published meta-analytic datasets from various fields of study in the organizational sciences. Of these...

Meta-analytic reviews are an important tool for advancing science and guiding evidence-based practice. Publication bias is one of the greatest threats to meta-analytic reviews. This paper assesses the degree of publication bias in four previously published meta-analytic datasets from various fields of study in the organizational sciences. Of these...

The trustworthiness of research findings has been questioned in many domains of science. This article calls for a review of the trustworthiness of the scientific literature in industrial–organizational (I–O) psychology and a reconsideration of common practices that may harm the credibility of our literature. We note that most hypotheses in I–O psyc...

We developed a focused, context-specific measure of sales self-efficacy and assessed its incremental validity against the broad Big 5 personality traits with department store salespersons, using (a) both a concurrent and a predictive design and (b) both objective sales measures and supervisory ratings of performance. We found that in the concurrent...

Meta-analytic reviews are an important tool for advancing science and guiding evidence-based practice. Publication bias is one of the greatest threats to meta-analytic reviews. This paper assesses the degree of publi-cation bias in four previously published meta-analytic datasets from various fields of study in the organizational sciences. Of these...

Publication bias poses multiple threats to the accuracy of meta-analytically derived effect sizes and related statistics. Unfortunately, a review of the literature indicates that unlike meta-analytic reviews in medicine, research in the organizational sciences tends to pay little attention to this issue. In this article, the authors introduce advan...

This article offers three contributions for conducting meta-analytic reviews in education research. First, we review publication bias and the challenges it presents for meta-analytic researchers. Second, we review the most recent and optimal techniques for evaluating the presence and influence of publication bias in meta-analyses. We then re-analyz...

Human resource professionals in Finland (N=86), South Korea (N=147) and Spain (N=196), were surveyed regarding the extent to which they agreed with various HR research findings. Similar to previous studies from the U.S., the Netherlands, and Australia, there were large discrepancies between HR practitioner beliefs and research findings, particularl...

Previous research has introduced the threat of publication bias to meta-analytic reviews in management and industrial/organizational (I/O) psychology research. However, a compre-hensive review of top-tier journals demonstrates that more than two thirds of meta-analytic studies in management and I/O psychology ignore the issue. Of the studies that d...

This response summarizes commentaries on the M. A. McDaniel, S. Kepes, and G. C. Banks (2011) article, which argued that the Uniform Guidelines on Employee Selection Procedures are a detriment to the field of personnel selection. Several themes were present in the commentaries. No compelling arguments were presented to dispute the assertion that me...

The primary federal regulation concerning employment testing has not been revised in over 3 decades. The regulation is substantially inconsistent with scientific knowledge and professional guidelines and practice. We summarize these inconsistencies and outline the problems faced by U.S. employers in complying with the regulations. We describe chall...

The degree of pay spread can influence many organizational level outcomes (e.g., workforce productivity and organizational performance), but empirical studies are inconsistent about the directionality of the effect. We argue that it is not simply the width of the pay range but also the factors responsible for the width that explain the effects of t...

The article discusses strategic human resource management. Personnel management can have a direct impact on the efficiency of an organization in both positive and negative fashions. Synergy, negative and positive, can come from effective personnel management and ineffective management strategies. Interactive regression analysis is instituted to res...

This study tested a model of the interactive effects of perceived job characteristics and potentially destructive leader traits on the physical and psychological strain of their subordinates and their job attitudes and commitment to the organization. A composite measure of the characteristics of enriched jobs (job scope) was positively related to m...

Previous reviews of the fit perspectives in SHRM have had a pessimistic tone and concluded that there was little evidence of the assumption that 'fit' leads to organizational success, although most reviews did not specifically focus on internal fit. This article aims to revisit the theoretical foundation of internal fit and provide a review of the...

Purpose Fast‐paced, hyper‐competitive environments require organizations to use flexible resources and delegate decision making. This paper aims to examine the synergistic effects of operators' involvement in decision making (IIDM) and equipment reliability across operations on mix flexibility when speed is emphasized. A theoretical framework integ...