Figure - uploaded by Timo B. Roettger
Content may be subject to copyright.
Main measured variables (see the coding form table for the full operationalization and questions to coders: https://doi.org/10.17605/OSF.IO/H8DFT).
Source publication
Scientific studies of language span across many disciplines and provide evidence for social, cultural, cognitive, technological, and biomedical studies of human nature and behavior. By becoming increasingly empirical and quantitative, linguistics has been facing challenges and limitations of the scientific practices that pose barriers to reproducib...
Contexts in source publication
Context 1
... the prescreened sample (n = 600), each analysis coder (AB, JC, LK, MR, TR) assessed individual articles for each measured variable (according to Table 1, except for Open Access, see below), recording outcomes using a Google Form (see exported form in shared materials: ...Context 2
... defined two types of discrepancies (post hoc): overlapping response, in which one coder's response was a superset of the second coder's response (e.g., coder 1 described the nature of the raw data as audio and text, and coder 2 described it as text only); and disagreement, in which coders described an item in non-overlapping terms (e.g., coder 1 described the nature of the raw data as audio, and coder 2 described it as text). We assessed the prevalence of disagreements for each preregistered coding category individually (according to Table 1). If a section was characterized by disagreements in more than 20% of articles, said section would be assigned to the same second independent coder for all articles of the corpus. ...