Frederick L Oswald

Frederick L Oswald
Rice University · Department of Psychology

PhD, University of Minnesota

About

178
Publications
340,461
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
9,767
Citations
Additional affiliations
August 2008 - present
January 2000 - May 2008
Michigan State University
August 1998 - May 2000
Purdue University
Education
September 1993 - May 1998
University of Minnesota Twin Cities
Field of study
  • Industrial-Organizational Psychology

Publications

Publications (178)
Article
Full-text available
Industrial and organizational personality researchers and practitioners contend with ever-changing requirements of the workplace, and therefore, it is important to reevaluate and innovate with respect to useful organizational research. Much research evidence documents the importance of personality variables in determining behavior and performance i...
Article
Full-text available
Open science refers to an array of practices that promote openness, integrity, and reproducibility in research; the merits of which are being vigorously debated and developed across academic journals, listservs, conference sessions, and professional associations. The current paper identifies and clarifies major issues related to the use of open sci...
Article
Full-text available
Dominance analysis (DA) has been established as a useful tool for practitioners and researchers to identify the relative importance of predictors in a linear regression. This article examines the joint impact of two common and pervasive artifacts—sampling error variance and measurement unreliability—on the accuracy of DA. We present Monte Carlo sim...
Article
Full-text available
Big data and artificial intelligence (AI) have become quite compelling-and relevant, ideally-to organizations and the consulting services that help manage them. Researchers and practitioners in industrial-organizational psychology (IOP) and human resource management (HRM) can add significant value to big data and AI by offering their substantive ex...
Preprint
Full-text available
Organizations are increasingly turning toward personnel selection tools that rely on artificial intelligence (AI) technologies and machine learning algorithms that, together, intend to predict the future success of employees better than traditional tools. These new forms of assessment include online games, video-based interviews, and the use of lar...
Article
Full-text available
Collecting job analysis ratings for a large number of jobs via surveys, interviews, or focus groups can put a very large burden on organizations. In this study, we describe and evaluate a streamlined, natural language processing-based approach to estimating (a) the importance of various knowledges, skills, abilities, and other characteristics (KSAO...
Preprint
For over three decades in psychology, meta-analysis has been a popular methodological tool for summarizing effect sizes within a given research domain. Statistical meta-analytic summaries typically reflect a mean and associated variance (heterogeneity) estimate, and visual summaries of constituent effect sizes typically use forest and funnel plots....
Preprint
Historically, industrial-organizational (I-O) psychology has fully embraced frequentist statistics and null hypothesis significance testing (NHST). Bayesian statistics is an underused alternative paradigm offering numerous benefits for I-O researchers and practitioners: e.g., accumulating direct evidence for the null hypothesis (vs. ‘fail to reject...
Article
Full-text available
Background The purpose of this article is to illustrate the application of an evidence-based, structured performance measurement methodology to identify, prioritize, and (when appropriate) generate new measures of health care quality, using primary care as a case example. Primary health care is central to the health care system and health of the Am...
Article
It is essential to democracy that voters trust voting systems enough to participate in elections and use these systems. Unfortunately, voter trust has been found to be low in many situations, which could detrimentally impact human-computer interactions in voting. Therefore, it is important to understand the degree to which voters trust any specific...
Article
Full-text available
Using game-based assessments (GBAs) to assess and select job applicants presents the dual challenges of measuring intended job-relevant constructs while analyzing GBA data that contain more predictors than observations. Exploring those challenges, we analyzed two GBAs that were designed to measure conscientiousness facets (i.e., achievement strivin...
Article
Recent years have seen dramatic changes in research practices in psychological science. In particular, preregistration of study plans before conducting a study has been identified as an important tool to help increase the transparency of science and to improve the robustness of psychological research findings. This article presents the Psychologica...
Article
Full-text available
Organizations are increasingly turning toward personnel selection tools that rely on artificial intelligence (AI) technologies and machine learning algorithms that, together, intend to predict the future success of employees better than traditional tools. These new forms of assessment include online games, video-based interviews, and big data pulle...
Preprint
Full-text available
Backgrond and Objective: Primary health care has a central role in the workings of the health care system and health of the American public. Thus, a high-performing, high-quality primary care system is essential. As a result, measurement frameworks are needed to assess the quality of the infrastructure, workforce configurations, and processes avail...
Article
Full-text available
University science, technology, engineering, and math (STEM) summer bridge programs provide incoming STEM university students additional course work and preparation before they begin their studies. These programs are designed to reduce attrition and increase the diversity of students pursuing STEM majors and STEM career paths. A meta-analysis of 16...
Preprint
Full-text available
We examined the measurement characteristics and cross-cultural measurement invariance of growth mindset, mastery orientation, and grit among Indonesian (N=55,964) and US (N =440) adolescents. We found support for strong invariance across males and females for all factors in both contexts. Indonesian females reported higher growth mindset and master...
Article
Full-text available
As a multifaceted construct reflecting one’s self-esteem, generalized self-efficacy, locus of control, and emotional stability, core self-evaluations (CSE) has become popular to measure in applied psychology research, especially given its conceptual importance and empirical usefulness for understanding the dispositional effects on employee attitude...
Preprint
Recent years have seen dramatic changes in research practices in psychological science. In particular, preregistration of study plans prior to conducting a study has been identified as an important tool to help increase the transparency of science and to improve the robustness of psychological research findings. This article presents the Psychologi...
Article
Developing good psychological measures benefits from the input of content experts. For many constructs or domains, however, who constitutes an ‘expert’ might be ill-defined. Novices—such as students, customers, or co-workers—may possess the same knowledge as experts. Moreover, as convenience samples, novices are more readily available and less cost...
Article
Full-text available
This conceptual paper examines the promises and critical challenges posed by contemporary personality measurement using big data. More specifically, the paper provides (i) an introduction to the type of technologies that give rise to big data, (ii) an overview of how big data is used in personality research and how it might be used in the future, (...
Article
Full-text available
The System Usability Scale (SUS) is a widely used instrument that measures the subjective usability of products and systems. Although past research has demonstrated the psychometric reliability and criterion-related validity of the SUS in specific languages, the approach and methodology of validating the translations has been somewhat inconsistent....
Article
Full-text available
The question of what explains individual differences in expertise within complex domains such as music, games, sports, science, and medicine is currently a major topic of interest in a diverse range of fields, including psychology, education, and sports science, to name just a few. Ericsson and colleagues’ deliberate practice view is a highly influ...
Preprint
Leadership traits and behaviors are observed early in development, and although an improved understanding of youth leadership would provide benefits in many contexts (e.g., education, parenting, policy), most empirical work on the topic has been limited to adult populations. This review emphasizes that adolescence is a critical period for leadershi...
Article
Full-text available
We describe adaptations at the Journal of Management to increase robust, reliable, and replicable research. We begin with the premise that a condition of information asymmetry exists within the submission review process. On one side, authors may or may not report material judgment calls with respect to methodological decisions and reporting of anal...
Article
Full-text available
Resilience is a topic of growing interest in the workplace; however, regarding its definition and measurement, a wide range of perspectives and idiosyncrasies persist. We take a closer look at the state of resilience through item-level analyses of 14 publicly available measures. In Study 1, relevance ratings revealed that many items from the measur...
Article
Full-text available
Methodological checklists for improving research quality and reporting consistency - Volume 13 Issue 1 - Lillian T. Eby, Kristen M. Shockley, Talya N. Bauer, Bryan Edwards, Astrid C. Homan, Russell Johnson, Jonas W. B. Lang, Scott B. Morris, Frederick L. Oswald
Article
Objective The goal of the research presented in this paper was to determine if the positively worded System Usability Scale (SUS) can be used in place of the positively and negatively worded standard SUS instrument for the subjective assessment of usability, and whether the results found here replicate those of Sauro and Lewis. Background Sauro an...
Article
Full-text available
Artificial intelligence (AI) and machine learning (ML) have seen widespread adoption by organizations seeking to identify and hire high-quality job applicants. Yet the volume, variety, and velocity of professional involvement among I-O psychologists remains relatively limited when it comes to developing and evaluating AI/ML applications for talent...
Article
The essence of measurement invariance (MI) analysis is to test the assumption that observed scores on a scale accurately reflect respondents’ standings on a measured construct. Based on exploratory structural equation modeling, the current study examines gender-based MI in two Big Five measures of personality: the Mini-IPIP, and the Big Five Invent...
Article
The proper role of research skills and training to conduct research in professional psychology education has been controversial throughout the history of the field. An extensive effort was undertaken recently to address that issue and identify ways the field might move forward in a more unified manner. In 2015, the American Psychological Associatio...
Article
Full-text available
To model data from multi-item scales, many researchers default to a confirmatory factor analysis (CFA) approach that restricts cross-loadings and residual correlations to zero. This often leads to problems of measurement-model misfit while also ignoring theoretically relevant alternatives. Existing research mostly offers solutions by relaxing assum...
Chapter
Full-text available
People with high levels of expertise in domains such as science, business, law, and music contribute to the prosperity of nations, the competitive advantage of organizations, and the well-being of families and communities. These individuals are often revered by society for their contributions—think of Marie Curie in science, The Beatles in popular...
Article
Full-text available
Background The science of effective teams is well documented; far less is known, however, about how specific team configurations may impact primary care team effectiveness. Further, teams experiencing frequent personnel changes (perhaps as a consequence of poor implementation) may have difficulty delivering effective, continuous, well-coordinated c...
Chapter
This chapter reviews evidence concerning the contribution of cognitive ability to individual differences in expertise. The review covers research in traditional domains for expertise research such as music, sports, and chess, as well as research from industrial–organizational psychology on job performance. The specific question that we seek to addr...
Article
Full-text available
The Society for Industrial and Organizational Psychology (SIOP) is pleased to offer the fifth edition of the Principles for the Validation and Use of Personnel Selection Procedures , which was approved by the APA Council of Representatives in August 2018 as an authoritative guidelines document for employee selection testing and an official statemen...
Article
Full-text available
Compensatory selection is generally more reliable than multiple-hurdle selection. Yet, practitioners may lean toward multiple-hurdle models, because administering an entire predictor battery to every applicant can be time-consuming, labor-intensive, and costly. Using Monte Carlo simulation, we considered some specific cases to illustrate, in terms...
Article
Full-text available
The Usefulness, Satisfaction, and Ease of Use Questionnaire (USE, Lund, 2001) measures the subjective usability of a product or service. It is a 30-item survey that examines four dimensions of usability: usefulness, ease of use, ease of learning, and satisfaction. This metric can be applied to various scenarios of usability assessment because it is...
Article
Full-text available
This panel will discuss the System Usability Scale. Panelists all have extensive experience using the SUS within a broad range of contexts: diverse people (e.g., abilities, languages); different types of products; and different testing scenarios. Members of the audience will have the opportunity to ask questions about new research on the validity o...
Chapter
Full-text available
Introduction The number of first-generation college students (FGCS) in the United States is perhaps higher than many people realize. Given the U.S. Department of Education data we have available for the 2011-2012 academic year, it is estimated that college students whose parents did not attend college themselves made up nearly 48% of the student po...
Book
Cambridge Core - Applied Psychology - The First Year of College - edited by Robert S. Feldman
Preprint
Full-text available
Although the research literature has established that Conscientiousness predicts task performanceacross a variety of achievement contexts (e.g., Barrick & Mount, 1991; O’Connor & Paunonen, 2007), comparatively less is known about the processes that underlie these relations. To the latter end, the current research examines effortful strategies and a...
Article
Full-text available
Operational validities are important to personnel selection research because they estimate how well a predictor in practical use correlates with a criterion construct, if the criterion measure were purged of measurement error variance. Because range restriction on a predictor or predictor composite creates incidental range restriction on the criter...
Article
Full-text available
The System Usability Scale (SUS) has been widely employed in both the field and the laboratory as a valid and reliable measure of system usability. Although its psychometric properties are relatively well understood, the impact that differences in users’ personality traits have on their perceived usability of products, services, and systems has not...
Article
Full-text available
Big data and artificial intelligence (AI) have become quite compelling—and relevant, ideally—to organizations and the consulting services that help manage them. Researchers and practitioners in industrial-organizational psychology (IOP) and human resource management (HRM) can add significant value to big data and AI by offering their substantive ex...
Chapter
Full-text available
This chapter is based on the proposition that three major forces, taken together, have fundamentally changed the nature of work in the 21st century. These three forces are technology, the rise of the service economy, and globalization, and they drive organizations to seek employees who possess what are called 21st century skills. After reviewing th...
Article
Full-text available
The introduction to this special issue on psychological research involving big data summarizes the highlights of 10 articles that address a number of important and inspiring perspectives, issues, and applications. Four common themes that emerge in the articles with respect to psychological research conducted in the area of big data are mentioned, i...
Chapter
Full-text available
Organizations have a keen concern for avoiding adverse impact in personnel decision making. The most obvious reasons are typically financial and reputational in nature (e.g., avoiding class action lawsuits), but equally important may be ethical and diversity reasons tied to the organizational mission (e.g., seeking to hire a range of diversity as r...
Article
Full-text available
Second language (L2) research relies heavily and increasingly on ANOVA (analysis of variance)-based results as a means to advance theory and practice. This fact alone should merit some reflection on the utility and value of ANOVA. It is possible that we could use this procedure more appropriately and, as argued here, other analyses such as multiple...
Article
Full-text available
The educational literature, the popular press, and educated laypeople have all echoed a conclusion from the book Academically Adrift by Richard Arum and Josipa Roksa (which has now become received wisdom), namely, that 45% of college students showed no significant gains in critical thinking skills. Similar results were reported by Pascarella, Blaic...
Article
Full-text available
Although volumes have been written on spanning the science–practice gap in applied psychology, surprisingly few tangible components of that bridge have actually been constructed. We describe the metaBUS platform that addresses 3 challenges of one gap contributor: information overload. In particular, we describe challenges stemming from: (a) lack of...
Article
Full-text available
Nonresponse to organizational surveys is a vexing problem. Although scholars have a reasonable understanding of how systematic nonresponse influences estimates of population means, they are likely to have less context for understanding how it impacts correlations. We present the results of a simulation study designed to provide a frame of reference...
Article
Full-text available
This article analyzes data from U.S. Navy sailors (N = 8,956), with the central measure being the Navy Computer Adaptive Personality Scales (NCAPS). Analyses and results from this article extend and qualify those from previous research efforts by examining the properties of the NCAPS and its adaptive structure in more detail. Specifically, this art...
Article
Full-text available
It is safe to assume that an accurate performance appraisal (PA) is an important prerequisite to an effective performance management (PM) system, because with accurate PA information, management, teams, and employees can engage in the process of identifying and developing a wide range of job-relevant knowledge or skills to improve job performance....
Article
Full-text available
Greenwald, Banaji, and Nosek (2015) present a reanalysis of the meta-analysis by Oswald, Mitchell, Blanton, Jaccard, and Tetlock (2013) that examined the effect sizes of Implicit Association Tests (IATs) designed to predict racial and ethnic discrimination. We discuss points of agreement and disagreement with respect to methods used to synthesize t...
Article
Greenwald, Banaji and Nosek (2015) present a reanalysis of the meta-analysis by Oswald, Mitchell, Blanton, Jaccard and Tetlock (2013) that examined the effect sizes of Implicit Association Tests designed to predict racial and ethnic discrimination. We discuss points of agreement and disagreement with respect to methods used to synthesize the IAT st...
Chapter
Full-text available
Organizational researchers are motivated by the idea that the data that we collect on workplace phenomena (e.g., data on employees, on teams, on the work environment) are ultimately supposed to provide better information and guidance than human intuition provides on its own. A considerable amount of empirical research has demonstrated experts are c...