Figure - uploaded by Melvin S. Marsh
Content may be subject to copyright.
Source publication
Drawing on the concept of a gale of creative destruction in a capitalistic economy, we argue that initiatives to assess the robustness of findings in the organizational literature should aim to simultaneously test competing ideas operating in the same theoretical space. In other words, replication efforts should seek not just to support or question...
Context in source publication
Context 1
... other words, they may prefer women over men for stereotypically male jobs, and provide female candidates with more favorable evaluations in general, in order to avoid appearing sexist. Table 6, the creative destruction effort yielded empirical patterns in many ways directly opposite to those in the original studies targeted for replication. The original studies observed discrimination in selection decisions against female candidates that was most evident among male evaluators whose sense of their own objectivity was activated (Uhlmann & Cohen, 2005. ...Similar publications
The emergence of Financial Technology (Fintech) has brought to forefront the importance of technology in the delivery of banking services. Banking services are being driven by innovative business models, and technology is causing creative destruction in the financial system. This study assessed the level of adoption of Fintech among Nigerian commer...
Citations
... Underlying these definitional differences are shared values in the conduct and dissemination of science, and the need to move toward the principles and behaviors of open science has been widely recognized across the sciences. Research communities across many disciplines have begun to develop stronger norms inspired by open science, including psychology [2,[14][15][16], genetics [17], biomedicine [18], animal behavior [4,19], economics [20][21][22][23][24], education [21,[25][26][27][28][29], political science [30], public health [31,32], science and technology studies [33], scientometrics [34], and sociology [35,36], among others (see ( [37]). Despite some progress, all stakeholders in the system need to do better at adopting and implementing open science practices, and our focus is on how to help editors accomplish this. ...
Journal editors have a large amount of power to advance open science in their respective fields by incentivising and mandating open policies and practices at their journals. The Data PASS Journal Editors Discussion Interface (JEDI, an online community for social science journal editors: www.dpjedi.org ) has collated several resources on embedding open science in journal editing ( www.dpjedi.org/resources ). However, it can be overwhelming as an editor new to open science practices to know where to start. For this reason, we created a guide for journal editors on how to get started with open science. The guide outlines steps that editors can take to implement open policies and practices within their journal, and goes through the what, why, how, and worries of each policy and practice. This manuscript introduces and summarizes the guide (full guide: https://doi.org/10.31219/osf.io/hstcx ).
... As an extreme methodological example, the practice lens in the social science inquiry, which is widely used in the management field under notions such as -entrepreneurship as practice‖ and -strategy as practice‖ is founded on abduction and supposes every case as a distinct case embedded in its own unique context, and therefore, needs distinct explanation (Antonacopoulou and Fuller 2020;Jarzabkowski 2004;Jarzabkowski andSpee 2009 Johannisson 2011;Steyaert 2007). Similarly, notions such as -replication 2.0‖ aim to replicate previous studies not to confirm them but to find differences and inconsistencies between the studies (Tierney et al. 2020). ...
Recently, the Systemic Abductive Method was introduced to help scholars with redefining controversial concepts in managerial, social, and behavioral sciences. This paper elaborates on the Method and its logic in relation to different schools of scientific thought and argues why the Method is pluralistic. Moreover, we suggest a set of practical recommendations based on a case study. Our contributions to theory-building include: 1) Arguing why researchers should use the terms concept, construct, and variable interchangeably. 2) Juxtaposing different approaches to conceptualizing abstraction levels. 3) Arguing systems thinking and abduction help theory building at the intersections of different schools of thought.
... Prediction markets of research credibility. In recent years, researchers have employed prediction markets to assess the credibility of research findings [94][95][96][97][98][99] . Here, researchers invite experts or non-experts to estimate the replicability of different studies or claims. ...
The emergence of large-scale replication projects yielding successful rates substantially lower than expected caused the behavioural, cognitive, and social sciences to experience a so-called ‘replication crisis’. In this Perspective, we reframe this ‘crisis’ through the lens of a credibility revolution, focusing on positive structural, procedural and community-driven changes. Second, we outline a path to expand ongoing advances and improvements. The credibility revolution has been an impetus to several substantive changes which will have a positive, long-term impact on our research environment.
... Authors must set aside a proportion of their research projects (in terms of time, money, and resources) to Big Team Science projects and international collaborations across multiple countries. Examples of this are plenty in psychology, including social psychology (see Bago et al., 2022;Klein et al., 2018;Moshontz et al., 2018;Pownall et al., 2021, van Bavel et al., 2022, cognitive psychology (Chen et al., 2023), linguistics (Coretta et al., 2022) and economics (Delios et al., 2022;Tierney et al., 2020Tierney et al., , 2021. Although such studies are very time-and resource-intensive, depending on the study characteristics and the role of the author, this is one benefit to ensure that our findings are universal and generalizable. ...
Conversations about the internationalization of psychological sciences have occurred over a few decades with very little progress. Previous work shows up to 95% of participants in the studies published in mainstream journals are from Western, Educated, Industrialized, Rich, Democratic nations. Similarly, a large proportion of authors are based in North America. This imbalance is well-documented across a range of subfields in psychology, yet the specific steps and best practices to bridge publication and data gaps across world regions are still unclear. To address this issue, we conducted a hackathon at the Society for the Improvement of Psychological Science 2021 conference to develop guidelines to improve international representation of authors and participants, adapted for various stakeholders in the production of psychological knowledge. Based on this hackathon, we discuss specific guidelines and practices that funding bodies, academic institutions, professional academic societies, journal editors and reviewers, and researchers should engage with to ensure psychology is the scientific discipline of human behavior and cognition across the world. These recommendations will help us develop a more valid and fairer science of human sociality.
... A large-scale and systematic comparison of free recall and recognition memory, with and without a space inserted between lexemes, is important to test the integrated view of the AoA effect, perhaps using a creative destruction approach (i.e. pre-specifying alternative results by competing hypotheses on a complex set of experimental findings; Delios et al., 2022;Tierney et al., 2020Tierney et al., ,2021. ...
The age at which a person acquires knowledge of an item is a strong predictor of item retrieval, hereon defined as the Age of Acquisition (AoA) effect. This effect is such that early-acquired words are processed more quickly and accurately than late-acquired items. One account to explain this effect is the integrated account, where the AoA effect occurs in the early processes of lexical retrieval and hence should increase in tasks necessitating greater semantic processing. Importantly, this account has been applied to lexical processing, but not, to date, memory tasks. The current study aimed to assess whether the integrated account could explain memory tasks, using compound words, which differ from monomorphemic words regarding ease of mapping and semantic processes. Four-hundred-and-eighty participants were split into four groups of 120 participants for each of four experiments. Participants were required to recall unspaced and spaced compound words (Experiments 1 and 2, respectively) or make a recognition decision for unspaced and spaced compound words (Experiments 3 and 4, respectively). This approach allowed us to establish how semantic processing was involved in recalling and recognising the items. We found that AoA was related to all tasks such that irrespective of space, early-acquired compound words were recalled more accurately than late-acquired compound words in free recall. In recognition memory, late-acquired compound words were recognised more accurately than early-acquired compound words. However, the slope for the AoA was semantic processing influenced free recall to a greater extent than the recognition memory, with the AoA effect being larger in free recall than recognition memory. In addition, the AoA effect for the compound word was larger in spaced compound words than unspaced compound words. This demonstrates that the AoA effect in memory has multiple sources.
... In recent years, researchers have employed prediction markets to assess the credibility of research findings [137][138][139][140][141][142] . Here, researchers invite experts or non-experts to estimate the replicability of different studies or claims. ...
The emergence of large-scale replication projects yielding successful rates substantially lower than expected caused the behavioural, cognitive, and social sciences to experience a so-called ‘replication crisis’. In this Perspective, we reframe this ‘crisis’ through the lens of a credibility revolution, focusing on positive structural, procedural and community-driven changes. Second, we outline a path to expand ongoing advances and improvements. The credibility revolution has been an impetus to several substantive changes which will have a positive, long-term impact on our research environment.
... Open Sci. 10: 221255 3 [6][7][8]), open materials, code and/or data [9], open access publishing [10] and a focus on replication studies [11][12][13][14]. The usefulness of such tools is not confined to the social sciences and they have also been considered across other disciplines (e.g. ...
... Open Sci. 10: 221255 13 ...
In recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, characterized by increased interest and promotion of open and transparent research practices. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Specifically, a critical overview of the literature which investigates how integrating open and reproducible science may influence student outcomes is needed. In this paper, we provide the first critical review of literature surrounding the integration of open and reproducible scholarship into teaching and learning and its associated outcomes in students. Our review highlighted how embedding open and reproducible scholarship appears to be associated with (i) students' scientific literacies (i.e. students’ understanding of open research, consumption of science and the development of transferable skills); (ii) student engagement (i.e. motivation and engagement with learning, collaboration and engagement in open research) and (iii) students' attitudes towards science (i.e. trust in science and confidence in research findings). However, our review also identified a need for more robust and rigorous methods within pedagogical research, including more interventional and experimental evaluations of teaching practice. We discuss implications for teaching and learning scholarship.
... The forecasting of scientific outcomes can help to improve science [30,31,[38][39][40][41]. In previous projects, it has been shown that forecasters can predict replicability of published studies [30,40], and effect sizes [42,43]. While earlier studies used forecasting to predict the rating of publications in review exercises such as the Research Excellence Framework [44], this is the first project to forecast outcomes pertinent to specific preprints. ...
Many publications on COVID-19 were released on preprint servers such as medRxiv and bioRxiv. It is unknown how reliable these preprints are, and which ones will eventually be published in scientific journals. In this study, we use crowdsourced human forecasts to predict publication outcomes and future citation counts for a sample of 400 preprints with high Altmetric score. Most of these preprints were published within 1 year of upload on a preprint server (70%), with a considerable fraction (45%) appearing in a high-impact journal with a journal impact factor of at least 10. On average, the preprints received 162 citations within the first year. We found that forecasters can predict if preprints will be published after 1 year and if the publishing journal has high impact. Forecasts are also informative with respect to Google Scholar citations within 1 year of upload on a preprint server. For both types of assessment, we found statistically significant positive correlations between forecasts and observed outcomes. While the forecasts can help to provide a preliminary assessment of preprints at a faster pace than traditional peer-review, it remains to be investigated if such an assessment is suited to identify methodological problems in preprints.
... The above suggests that after a quarter century, the implicit measurement approach to implicit bias has suffered from significant paradigm degeneration (Lakatos, 1970). To maintain itself, auxiliary assumptions such as multiple moderators in conjunction lead to respectable predictive validity correlations (Kurdi et al., 2019), social desirability bias on laboratory behavioral measures (Tierney et al., 2020), the cumulative consequences of minute discriminatory biases (Greenwald et al., 2015;Hardy et al., 2022), mismatched and suboptimal behavioral outcomes in studies examining causality (Gawronski et al., this issue), and aggregate-level crowd biases (Payne et al., 2017) must be invoked. Some or even all these defenses may hold empirically. ...
... Largescale replication methods are best positioned to answer these questions, and to prevent researcher bias toward any specific answer. New data collections should further engage in conceptual replications (Simons, 2014), optimizing designs based on expert feedback (Vohs et al., 2021) and adding further measures and conditions facilitating competitive theorytesting (Tierney et al., 2020). ...
... Gawronski et al. (this issue) cite Uhlmann andCohen's (2005, 2007) investigations of constructed criteria and illusions of objectivity in selection decisions, highlighting how such processes may contribute to implicit behavioral bias (see also Hodson, Dovidio, & Gaertner, 2002;Norton, Vandello, & Darley, 2004, for similar results). Tierney et al. (2020) recently conducted a largesample self-replication that validated these processes but inverted the direction of the social cue effect. In a mirror image of the results from Uhlmann andCohen (2005, 2007), participants constructed criteria biased against male candidates for the job of police chief and engaged in greater discrimination against men when led to feel objective. ...
To revitalize the study of unconscious bias, Gawronski, Ledgerwood, and Eastwick (this issue) propose a paradigm shift away from implicit measures of intergroup attitudes and beliefs. Specifically, researchers should capture discriminatory biases and demonstrate that participants are unaware of the influence of social category cues on their judgments and actions. Individual differences in scores on implicit measures will be useful to predict and better understand implicitly prejudiced behaviors, but the latter should be the collective focus of researchers interested in unconscious biases against social groups.
We welcome Gawronski et al.’s (this issue) proposal and seek to build on their insights. We begin by summarizing recent empirical challenges to the implicit measurement approach, which has for the last quarter century focused heavily on capturing individual differences and examining their potential antecedents and consequences. In our view, Gawronski et al. (this issue) underestimate the problems the subfield of implicit bias research is currently facing; the need for a paradigm shift in focus and approach is truly urgent.
Although we strongly agree with their basic thesis, we also stress the importance of avoiding various forms of potential bias in the search for implicit bias. First, research in this area should leverage open science innovations such as pre-registration of competing predictions to allow for intellectually and ideologically dissonant conclusions of equal treatment and “reverse” discrimination against members of historically privileged groups. Second, in assessing awareness of bias, researchers should avoid equating unconsciousness with the null hypothesis that evidence of awareness will not emerge, and instead seek positive evidence that the behavioral bias is implicit in nature. Finally, to avoid underestimating the pervasiveness of intergroup bias, scientists should continue to develop and attempt to validate implicit measures of attitudes and beliefs, which may tap latent prejudices expressed in only a small subset of overt actions.
... On the other hand, the social support literature has suggested that organizational support is a strong contrast to destructive forms of leadership and this contrast enhances distress by putting a spotlight on the leader's threatening behavior -what they call a negative exacerbator effect (referred to as negative exacerbator view; see Bavik et al., 2020, p. 735). In addressing this puzzle, we follow scholarly recommendation by testing contrasting predictions and replicating findings to provide robust illustrative inferences (Leavitt, Mitchell, & Peterson, 2010;Tierney et al., 2020). ...
... Finally, we also contribute to the literature by examining the role of POS in the stress experience from unethical leader behavior, which separate literatures have extrapolated two contrasting views on the moderating effect of POS. Utilizing a multi-study design allows for a constructive replication, shedding light on the critical role of organizational support (Leavitt et al., 2010;Tierney et al., 2020). Through this multi-study design, we also respond to calls to integrate experiments in the abusive supervision literature (Fischer, Tian, Lee, & Hughes, 2021). ...
... Given the theoretical relevance of both the stress-resource view and the negative exacerbator view, we followed scholarly recommendations to construct two studies that can offer replication and provide robust inferences on the proposals (Leavitt et al., 2010;Tierney et al., 2020). Study 1 offers a full test of our predictions using a time-separated survey design of working adults, and Study 2 utilized an experimental design of working adults to heighten the generalizability and causal inferences of our findings. ...
We explore how the impacts of unethical leadership are influenced either beneficially or detrimentally by perceived organizational support. A stress–resource view suggests organizational support is a resource that should offset the negative implications of unethical leadership. The negative exacerbator view suggests that receiving organizational support in light of unethical leadership should heighten the threat because it draws a stronger focus on and salience to the harm of the leader’s behavior for the employee. The results of a time-separated survey study and an experiment support our model and the negative exacerbator view. The findings show that unethical leader behavior elicits negative affect and indirectly (through negative affect) diminishes employees’ well-being and has a stronger effect when perceived organizational support was higher rather than lower.
