ArticlePDF Available

Open Science, Closed Doors? Countering Marginalization through an Agenda for Ethical, Inclusive Research in Communication

Authors:

Abstract

The open science (OS) movement has advocated for increased transparency in certain aspects of research. Communication is taking its first steps towards OS as some journals have adopted OS guidelines codified by another discipline. We find this pursuit troubling as OS prioritizes openness while insufficiently addressing essential ethical principles: respect for persons, beneficence, and justice. Some recommended open science practices (OSPs) increase the potential for harm for marginalized participants, communities, and researchers. We elaborate how OS can serve a marginalizing force within academia and the research community, as it overlooks the needs of marginalized scholars and excludes some forms of scholarship. We challenge the current instantiation of OS and propose a divergent agenda for the future of Communication research centered on ethical, inclusive research practices.
OPEN SCIENCE AND MARGINALIZATION 1
Open Science, Closed Doors? Countering Marginalization through an Agenda for Ethical,
Inclusive Research in Communication
Jesse Fox, Ph.D., Ohio State University, Columbus, OH, USA; Katy E. Pearce, University of
Washington, Seattle, WA, USA; Adrienne L. Massanari, University of Illinois at Chicago,
Chicago, IL, USA; Julius Matthew Riles, University of Missouri, Columbia, MO, USA; Łukasz
Szulc, University of Sheffield, Sheffield, UK; Yerina S. Ranjit, University of Missouri,
Columbia, MO, USA; Filippo Trevisan, American University, Washington, DC, USA; Cheryll
Ruth R. Soriano, De La Salle University, Manila, Philippines; Jessica Vitak, University of
Maryland, College Park, MD, USA; Payal Arora, Erasmus University Rotterdam, Rotterdam,
The Netherlands; Sun Joo (Grace) Ahn, University of Georgia, Athens, GA, USA; Meryl Alper,
Northeastern University, Boston, MA, USA; Andrew Gambino, The Pennsylvania State
University, State College, PA, USA; Carmen Gonzalez, University of Washington, Seattle, WA,
USA; Teresa Lynch, Ohio State University, Columbus, OH, USA; Lillie D. Williamson,
University of Wisconsin-Madison, Madison, WI, USA; Amy L. Gonzales, University of
California, Santa Barbara, Santa Barbara, CA, USA
OPEN SCIENCE AND MARGINALIZATION 2
Abstract
The open science (OS) movement has advocated for increased transparency in certain
aspects of research. Communication is taking its first steps towards OS as some journals have
adopted OS guidelines codified by another discipline. We find this pursuit troubling as OS
prioritizes openness while insufficiently addressing essential ethical principles: respect for
persons, beneficence, and justice. Some recommended open science practices (OSPs) increase
the potential for harm for marginalized participants, communities, and researchers. We elaborate
how OS can serve a marginalizing force within academia and the research community, as it
overlooks the needs of marginalized scholars and excludes some forms of scholarship. We
challenge the current instantiation of OS and propose a divergent agenda for the future of
Communication research centered on ethical, inclusive research practices.
Keywords: open science, marginalization, discrimination, inequality, research ethics, social
identity, ethical research practices, research risks, open data, reidentification
Fox, J., Pearce, K. E., Massanari, A. L., Riles, J. M., Szulc, Ł., Ranjit, Y. S., Trevisan, F.,
Soriano, C. R. R., Vitak, J., Arora, P., Ahn, S. J., Alper, M., Gambino, A., Gonzalez, C.,
Lynch, T., Williamson, L. D., & Gonzales, A. L. (2021). Open science, closed doors?
Countering marginalization through an agenda for ethical, inclusive research in
Communication. Journal of Communication. Advance online publication.
https://doi.org/10.1093/joc/jqab029
Please click the link above for updated citation information and the final version. The entire
special issue will be open access in October December 2021.
OPEN SCIENCE AND MARGINALIZATION 3
In the past few years, a growing number of social scientists have advocated for a
paradigmatic shift in research practices. The open science (OS) movement, described as a
“revolution” or “Renaissance,” advocates for greater transparency in research and publication
processes (e.g., Nelson et al., 2018; Nosek et al., 2015). Recently, the movement has made
inroads in the field of Communication. In 2020, the International Communication Association
(ICA) announced it would abide by certain OS guidelines at its conference and journals,
including the Journal of Communication.
Although we see value in some open science practices (OSPs) in safe and appropriate
circumstances, we have serious concerns regarding the hurried embrace of OS in
Communication. We present an urgently needed counterpoint considering people whom have
been disempowered, discriminated against, ignored, or otherwise excluded from equitable
participation in society. We believe current OS priorities and practices perpetuate, rather than
resolve, such marginalization.
We agree with many OS advocates that the social sciences would benefit from a profound
reconsideration of research practices. We diverge, however, in what we consider the most crucial
ethical issues for Communication research, what values we believe should be prioritized, and
how to enact a potential paradigm shift for our field. Here, we invite Communication scholars to
reflect on the underlying principles and priorities that have informed the current OS movement in
social science; the implications of OSPs for marginalized research participants and marginalized
scholars; and the potential consequences for Communication, research, and society. We advocate
for a people-centered approach rather than OS’s prioritization of transparency, and we offer a
contrasting agenda to promote ethical, inclusive research in Communication.
Research Ethics and Values
OPEN SCIENCE AND MARGINALIZATION 4
Our analysis draws from several codes for research ethics that emerged in the 20th
century, including the Nuremberg Code, the Declaration of Helsinki, and the Belmont Report.
Recognizing the ongoing maltreatment of marginalized people, the Belmont Report (1979)
elaborated three guiding ethical principles for human subjects research: respect for persons,
beneficence, and justice. We adopt the Belmont principles as a lens for our critique given the
centrality of marginalized groups and the inclusion of these principles in ICA’s Code of Ethics
(Humphreys et al., 2019), and we apply them to both participants and scholars.
First, respect for persons entails treating people as autonomous while also considering
that some populations warrant special considerations. People should be empowered with the
ability to make informed, voluntary decisions about research. The research community must also
recognize and accommodate the needs of diverse and disempowered participants and scholars.
Second, beneficence is an obligation for research to not just minimize harm, but also provide
benefits. We argue that benefits and harms must be weighed considering individuals,
communities, and society as a whole. Finally, we conceptualize justice as fairness and equity in
all facets of research. Individuals, communities, and social groups should have equitable
opportunities to be participants, researchers, consumers, and beneficiaries of research. These
three principles are fundamental to safe, humane, ethical research.
The Open Science Movement
History and Philosophy
Initiatives for data sharing and other OSPs have appeared across various disciplines for
many years. The current OS movement in Communication emerged directly from Psychology.
Over the past decade, several prominent cases of data fabrication and questionable research
practices (e.g., p-hacking) were uncovered, and scientists declared a “replication crisis” after
OPEN SCIENCE AND MARGINALIZATION 5
attempts to repeat seminal experiments failed. These incidents prompted greater skepticism about
researchers and their findings (Nelson et al., 2018). In response, the Open Science Framework
was launched online in 2012, and the Center for Open Science (COS) was established in 2013 to
build infrastructure and promote OS adoption.1 The COS is now a powerhouse, driving the
priorities and agenda of the current OS movement.
The OS movement argues that openness is imperative to science: Mandated transparency
can help thwart unethical research, reduce errors, enable replication, and promote greater access
to resources (Nosek & Bar-Anan, 2012; Nosek et al., 2015). OS advocates claim transparency
lowers barriers for participation in science by increasing accessibility to resources, which also
facilitates a second priority of OS: efficiency. Easy access enables scientists to work faster and
find solutions more quickly, ostensibly benefiting everyone (Munafò et al., 2017).
Practices
OSPs encourage openness across several research processes and audiences, including
other researchers, reviewers, funding agencies, taxpayers, and the public. Some OSPs have been
formally codified and incentivized by the COS. For example, the COS’s (2020) Transparency
and Openness Promotion (TOP) guidelines provide a ruleset and scoring for pre-registration
(sharing hypotheses, variables, methods, sample size, and analyses before running a study), open
1 The Open Science Framework allows researchers to share data and materials and post their study plans
(i.e., preregistration). The COS is a nonprofit organization founded by Brian Nosek and Jeffrey Spies, two
Psychology researchers who had spearheaded collaborations to replicate studies. They struggled to find
funding until billionaire and former Enron employee John Arnold took an interest in the project
(https://www.wired.com/2017/01/john-arnold-waging-war-on-bad-science/ ). Arnold’s philanthropic
efforts have been controversial, including funding a Baltimore police aerial surveillance project and
developing an algorithm to determine whether arrestees should be released on bail
(https://theintercept.com/2020/04/09/baltimore-police-aerial-surveillance/ ). Arnold’s foundation has
remained the COS's primary donor, although the COS has secured funding from several other sources,
including NIH and DARPA. The COS is open about its sponsorship and discloses funding at
https://www.cos.io/about/our-sponsors.
OPEN SCIENCE AND MARGINALIZATION 6
materials (posting stimuli, measures, code, etc.), and open data (posting datasets online, such as
participants’ survey responses or physiological data). Other OSPs are not included in the TOP
guidelines or incentivized by the COS. Open access makes published papers freely accessible
rather than hidden behind journal paywalls (Nosek & Bar-Anan, 2012). Open review seeks to
make the evaluation of research transparent and public rather than closed and private (Nosek &
Bar-Anan, 2012). Open workflow suggests that researchers should be transparent at every stage
from idea generation to execution, sharing their notes, plans, and progress (Nosek & Bar-Anan,
2012).
Critiques
Several notable critiques of OS have come from scholars who support open science in
principle, but express serious reservations about its inclusiveness. Albornoz (2018) noted that OS
is often framed in terms of efficiency and competition rather than prosocial functions like
addressing societal problems or helping citizens enact their rights. OS has been described as
inaccessible to many (Bahlai et al., 2019) and only practicable by “a very narrow demographic”
of privileged researchers (Whitaker & Guest, 2020, p. 34). Marginalizing discourse and
aggressive behavior by some OS advocates have been referred to as “bropenscience” (Whitaker
& Guest, 2020) and “open-splaining” (Bahlai et al., 2019). Collectively, these critiques illustrate
how OS may further marginalize both participants and researchers. Although we recognize
promise in elements of OS, our critique emerges from similar concerns. In short, we ask: whom
is open science really for?
Threats to Marginalized Participants and Communities
One of our primary contentions with OS is the lack of consideration for participants.
Despite ethical codes urging researchers to focus on participant needs and potential harms, the
OPEN SCIENCE AND MARGINALIZATION 7
OS movement focuses on the benefits of transparency and efficiency for researchers, rarely
mentioning associated participant risks (Cummings et al., 2015). For example, the TOP
guidelines do not mention transparency with participants (COS, 2020). Given the long history of
marginalized groups being disenfranchised and harmed by researchers (c.f., Belmont Report,
1979), we find this oversight concerning.
Researchers have an ethical obligation to understand a broad scope of risks involving the
participants and communities they research, the topics they study, and the methods they use
(Belmont Report, 1979). OSPs present a new set of risks, as putting information on the open
internet increases its visibility, searchability, persistence, and accessibility to an unknown global
audience (Trevisan & Reilly, 2014). Given the control and privacy of one’s information can be
crucial to the wellbeing and even survival of marginalized people (Pearce, 2020), it is imperative
that both participants and researchers understand how OSPs compound existing research risks.
Sensitivity, Identifiability, and Participant Risks
The sensitivity of data can be assessed by the severity of possible individual, community,
or group level harms associated with disclosure in a given context. The European Union’s
General Data Protection Regulation (2016) classifies identities such as a racial or ethnic origin,
religious beliefs, sexual orientation, and health or disability status as sensitive because of the way
aggregated data from a group of marginalized participants could be leveraged against a larger
group sharing the same identity (e.g., creating a biased algorithm). Given the need to
contextualize these assessments, it is unlikely a researcher can grasp the entirety of potential
harms associated with marginalized participants’ open data. The sensitivity of information can
also vary over time. For example, an open dataset including individuals’ political affiliations
may not seem sensitive now, but would be accessible to a future oppressive regime seeking to
OPEN SCIENCE AND MARGINALIZATION 8
imprison dissidents (Pearce, 2020).
In this scenario, the threat would be contingent on whether these data are identifiable and
could be associated with specific individuals. Unfortunately, researchers hold many
misconceptions about data, such as that they are protected as long as the participant’s name is
removed (i.e., data are “anonymous”; Sweeney et al., 2018). Rather, data may be directly
identifiable (e.g., videorecordings, photographs, or biospecimens with DNA or RNA) or
indirectly identifiable (e.g., IP addresses, geolocation data). Other data at higher risk for
identification include rich qualitative data (Bishop & Gray, 2018); dyadic, family, social
network, and organizational data with linked ties (Joel et al., 2018); and social media data, given
usernames, photos, and text may be public and easily searchable (Trevisan & Reilly, 2014).
Combinations of information can increase identifiability (e.g., postal code plus demographic
characteristics). As marginalized individuals are often a statistical minority in broader samples,
they may be more identifiable than others (Sweeney et al., 2018), especially in small or closed
populations (e.g., a university’s Communication students).
Many researchers may consider identifying the dissidents in this scenario unlikely, as
surely these open data were de-identified. Current data de-identification practices are rarely
sufficient, however (Sweeney et al., 2018). Unfortunately, researchers are rarely trained on the
de-identification procedures and safe handling required by open data (Joel et al., 2018). Even if a
single dataset lacks clear identifiers, participants’ distinct attributes, such as intersectional
identities, may be linked across multiple datasets to re-identify them. In a recent study, only a
few variables were needed to identify most participants in a dataset through existing open data
sources; with more attributes, they were able to re-identify 99.98% of participants (Rocher et al.,
2019). In this way, even nonsensitive open datasets increase risks for participants, as these could
OPEN SCIENCE AND MARGINALIZATION 9
serve as a key to unlock sensitive data.
One last consideration is how these linkages extend the risks and potential harms beyond
the participants of any particular study to their ties. If our hypothetical dissidents are identified,
linking to other data could threaten more than just the original study participants. Using public or
government records (birth records, marriage records, addresses) or social media, the regime
could identify and implicate family, neighbors, friends, or co-workers. For marginalized
communities and groups, this networked outing could be devastating. Researchers must consider
how the growing accumulation of open datasets increase both individual and collective risks.
Open to Harm
The ICA Code of Ethics states that scholars have a “social responsibility to enhance the
public good,” including considering “the ways our research might get taken up by organizations,
industries, and politics” (Humphreys et al., 2019, p. 3). Researchers must acknowledge that
government agencies, corporations, and other actors may capitalize on freely available data for
malicious purposes (Bishop & Gray, 2018; Pearce, 2020). Individuals could be targeted for
social engineering, outing, blackmail, or identity theft (Rocher et al., 2019). Collective
information about a marginalized group may also facilitate harm. Open data could be used to
surveil (Rocher et al., 2019) or attack historically targeted groups such as queer communities,
subnational minorities, or Indigenous peoples (Carlson & Fraser, 2020). They could inform
algorithms that governments use for discriminatory profiling or predictive policing (Bishop &
Gray, 2018). In authoritarian regimes, open data could inform targeted efforts to curtail civil and
political rights through hate speech, harassment, imprisonment, and even death (Pearce, 2020).
Even well-intentioned researchers or journalists could increase risks: With limited or no
awareness of the context surrounding marginalized groups, these parties may re-use open data in
OPEN SCIENCE AND MARGINALIZATION 10
a way that inadvertently endangers participants.
Although some risks may be apparent now, researchers must also anticipate future risks.
What data might appear safe in the present may endanger participants later given sociopolitical
shifts. In one case, authorities in a dictatorial regime used archived social media data to examine
connections among users and contrive a conspiratorial association years later (Pearce, 2020).
Recent studies have demonstrated that the range of data that should be considered identifiable is
expanding, including web browsing history, expenditures, and body movement (e.g., Rocher et
al., 2019). If data are freely available to any internet user and we later learn these data have
become identifiable or dangerous, it is too late; it would be impossible to recover and destroy
this information. Unbridled openness means researchers lose control of data and place
participants at undeterminable and indefinite risk.
Potential Effects on Research
Social science hinges on people being willing to participate in research studies. Making
participants feel comfortable and safe enough to share their experiences with researchers is
crucial, particularly for marginalized groups (Campbell et al., 2019; Carlson & Fraser, 2020).
Knowing that researchers will post their information, responses, or behaviors publicly on the
internet may magnify participants’ self-censorship or socially desirable behavior, leading to
response bias, skewed data, and misrepresentations of phenomena (e.g., stigmatized behavior,
prejudice). This may affect marginalized people especially when participating in research
concerning their social identity or community.
Alternatively, if marginalized participants have concerns about openness and their safety,
they may decide not to participate in research. Although it warrants further study, there is
preliminary evidence that researchers’ adoption of OSPs may discourage participation (Campbell
OPEN SCIENCE AND MARGINALIZATION 11
et al., 2019). Some studies have shown that people, including members of marginalized
communities, are not comfortable with their data being shared widely or being re-used for
purposes outside of the study (Albornoz, 2018; Cummings et al., 2015). Participants have
expressed concern about many of the risks we have outlined, including being identified or
governments, corporations, and other entities accessing their data (Albornoz, 2018; Cummings et
al., 2015). There is also a long history of the maltreatment of marginalized groups in scientific
research (Belmont Report, 1979). If OS is practiced ethically and marginalized participants are
informed about additional risks engendered by OSPs, this knowledge may further reduce their
interest in participating in research and possibly their trust in researchers.
In sum, researchers should be concerned that OSPs may increase participants’ self-
censorship or deter people from participation due to greater risks, particularly if they are from
marginalized groups. Samples will be less representative, data will be more biased, and scientific
findings will be diminished in both accuracy and generalizability. A researcher’s preeminent
goal must be to maintain the respect for persons, beneficence, and justice that all research should
be offering participants and the greater community. Although some goals of OS merit pursuit, it
is incumbent upon researchers not to overlook the people from whom research evidence is
derived and for whom the ultimate benefits should be directed. OS must be approached with due
deference to, and in collaboration with, the stakeholders assuming the risks of participating in
Communication research.
Threats to Marginalized Researchers and Research
Extensive research over decades has demonstrated the systemic and relentless
mistreatment of marginalized scholars in academia: their expertise and capability are questioned;
their work is subject to greater scrutiny and exiled from mainstream journals; they are subject to
OPEN SCIENCE AND MARGINALIZATION 12
bullying and harassment; they are less likely to be tenured and promoted; and they must manage
emotional labor and safety labor daily in response to these inequities (see reviews in Ferber,
2018; Hendrix, 2005). As a field, Communication should foster equitable participation among
diverse scholars employing diverse methods to research diverse topics and populations; however,
we are falling short of these goals (e.g., Afifi & Cornejo, 2020; Chakravartty et al., 2018;
Hendrix, 2005). In 2019, the ICA Executive Board acknowledged ongoing disparities, affirmed
that “promoting mechanisms to enhance inclusion, diversity, equity, and access in ICA is
intrinsic to our mission,” and launched several initiatives (p. 1, emphasis theirs).
In 2020, ICA announced the adoption of some of the COS’s recommendations for
promoting OS. Although ICA (2020) has acknowledged that some concerns have been raised,
the potential harms to scholars and to the field remain unaddressed, and the adopted COS
policies remain in place. Here, we explain how elements of OS present new risks and exacerbate
potential harms to researchers experiencing identity-based marginalization (IMRs) based on their
social identities or scholarship-based marginalization (SMRs) based on their research methods or
topics.
Open Review
Open review has been referred to as “a cornerstone of the OS agenda” (Ross-Hellauer et
al, 2017, p. 1). There is no consensus on how open review should function; proposed models
vary in the layers of transparency they employ. One layer, open identities, makes authors and
reviewers known to each other; in open reports, peer reviews are published alongside articles.
Advocates claim these layers of transparency increase fairness and collegiality. Further, Nosek
and Bar-Anan (2012) suggest that open reports could incentivize reviewers, as they can be
recognized as good reviewers, earn a publication for their critique, and even garner citations. A
OPEN SCIENCE AND MARGINALIZATION 13
third layer is open pre-review: for example, Nosek and Bar-Anan (2012) propose a Yelp-like,
crowdsourced platform where any scholar could review a manuscript before publication and a
cumulative score would be displayed. A final layer offers open final-version commenting,
wherein the public can comment on published articles, and authors are expected to engage with
commenters to promote public communication about science (Ross-Hellauer et al., 2017).
All four of these layers present new risks that are higher for IMRs or SMRs. Masked
review has been employed to reduce bias and discrimination; open identities may increase bias
and discrimination against IMRs (Bahlai et al., 2019). As reviewers, IMRs may be more likely
face retaliation if their review is strenuous or unfavorable, forcing them to self-censor (Bahlai et
al., 2019). Open reports present similar risks and would further disadvantage masked IMRs, as
they would lose out on the reputation, publications, and citations available to those who have the
power to publish their reviews unmasked. In open pre-review, IMRs and SMRs cannot avoid
reviewers who are unduly hostile toward them or their work; in traditional reviewing, they can
indicate non-preferred reviewers or appeal to the editor. In the worst case, motivated parties
could brigade to harass IMRs and SMRs with hostile reviews, diminish a paper’s score, or
discredit the work. Even without deliberate efforts, crowdsourced scores mean that majority
groups and perspectives are further empowered over marginalized ones by this model. Open
final-version commenting is particularly disturbing. Given that IMRs and SMRs are targeted for
harassment (Ferber, 2018), forcing them to make public commentary visible alongside their
publications or interact with commenters as a condition of publication is inconceivable.
Openness to Harassment
A significant concern with the demand for transparency is that it may put researchers and
their research at greater risk, as some IMRs and SMRs have been targeted for harassment by
OPEN SCIENCE AND MARGINALIZATION 14
people who take issue with their social identities, the topics they study, or their findings (Ferber,
2018). Harassers have attacked researchers on social media, doxed their private information, and
interfered with their research and employment (Ferber, 2018; Massanari, 2018). Openness may
amplify these risks. For example, Communication scholars were targeted by the Gamergate
harassment campaign, which uncovered a Google document shared from a conference session on
diversity and games research and then worked to identify each of the session’s participants and
connect them to a “social justice warrior” conspiracy (Chess & Shaw, 2015). This example
illustrates how open workflow or open data can be used in unintended ways, such as identifying
participants, enabling harassment, and undermining the credibility of IMRs and SMRs.
It is not just explicit harassment that IMRs and SMRs may face; they may also be
disproportionately targeted by organized efforts to undermine or discredit their research (Ferber,
2018). OSPs could make researchers vulnerable to malicious actors who may use open
workflow, open materials, or open data to allege misconduct or malfeasance. Alternatively, these
parties could identify study procedures through open workflow or pre-registration and sabotage
recruitment or data collection. Dealing with harassment and discrediting campaigns can have
considerable costs for IMRs and SMRs: lost time, drained financial and institutional resources,
and hindered or ruined research projects (Ferber, 2018). Such incidents may affect both
researchers’ productivity and their mental health, exacerbating existing disparities (Ferber,
2018).
OS Incentives and the Gamification of Research: Rankings, Rewards, and Reputation
Many OS initiatives create new quantitative rankings and rewards that OS advocates
argue will incentivize researchers and journal editors (e.g., Dienlin et al., 2021; Nosek & Bar-
Anan, 2012). The COS’s journal ranking system awards points based on how strictly journals
OPEN SCIENCE AND MARGINALIZATION 15
adhere to the TOP guidelines.2 In 2020, ICA announced their journals would join the rankings
and enforce TOP guidelines more strictly in the future (ICA, 2020). ICA also adopted COS’s
badge system for its conference and journals. Authors may earn badges for three OSPs:
preregistration, open materials, and open data.
Another structure proposed by OS advocates is a comprehensive online research platform
designed to “quantify the credibility of scientific findings” (LeBel et al., 2018, p. 389).
CurateScience,3 which has received funding from the COS, allows researchers to search articles
based on their “credibility” metrics: how many COS badges they have, whether they posted
preprints for public comment, and if analyses are “robust” enough. CurateScience also calculates
scores for individual researchers and categorizes them as “compliant” or “noncompliant.” This
platform echoes the desires of Dienlin et al. (2021), who argued that adherence to OS is a
“quality indicator” of scholars and should be used to determine their hiring, tenure, and
promotion.4 ICA has not indicated whether they plan to integrate their journals with
CurateScience, require authors to join, or otherwise encourage its members to create profiles and
be scored publicly on their “quality.”
These gamified systems are presented as objective ways to judge the quality of journals,
articles, and researchers themselves, yet these badges and high “credibility” scores are less
accessible for IMRs and SMRs given the risks of compulsory transparency (e.g., Schwartz-Shea
et al., 2016). If people start using badges as a quality heuristic, IMRs’ and SMRs’ audience,
2 https://www.topfactor.org/
3 https://curatescience.org/app/home
4 On its homepage, CurateScience advertises its purpose to universities: “Ensure your professors’
published research meets accepted minimum transparency standards and survives follow-up
scrutiny…Base hiring and promotion decisions on researchers’ transparency track record and
impact…Our Curate University product makes universities accountable to their stakeholders: (1) tuition-
fee paying students, (2) the government/taxpayer (for public universities), and/or (3) private/corporate
donors” (Curate Science, 2020, n.p.).
OPEN SCIENCE AND MARGINALIZATION 16
citations, press coverage, collaboration opportunities, and visibility in the field are in jeopardy.
They may feel forced to sacrifice their safety or their participants’ safety; otherwise, they will
lose.
OS incentives are also problematic in the research practices they encourage and those
they exclude or may inadvertently discourage. For example, there is no badge for evaluating
beneficence and choosing not to share participants’ data because the risks outweigh the benefits.
There is no badge for openness with participants, yet practices such as informed consent reflect
respect for persons. There is no badge for promoting justice by employing inclusive sampling,
reaching understudied populations, or providing direct benefits to marginalized groups. In
general, we question why OS promotes gamification, competitive framing, and artificial
hierarchies as desirable solutions given the drawbacks of cultivating envy, hostility, and
shaming; alienating and demoralizing those who cannot improve their rank; and inspiring people
to “game the system” to receive rewards (Schell, 2014). Collectively, OS’s gamification reflects
the broader cultural values of its creators (competition, capitalism) and is designed to reward
similar researchers (see Dutta, 2020).
Research Methods and Topics Marginalized by OS
Finally, it is critical to note that OS represents certain ontological and epistemological
assumptions that marginalize entire areas of research (Schwartz-Shea et al., 2016). OS assumes
the existence of an objective truth revealed by an objective researcher, which is reflected in foci
such as replicability and pre-registration (Dienlin et al., 2021; Nosek et al., 2015). Other
approaches argue that truth is subjective, and findings do not necessarily replicate across studies
or even across researchers analyzing the same data. OS advocates also define “quality” and
OPEN SCIENCE AND MARGINALIZATION 17
“credibility” in ways that are exclusive to quantitative research (e.g., Dienlin et al., 2021; LeBel
et al., 2018; Nosek et al., 2015).
In these ways, OS discounts and excludes approaches that are integral to Communication.
Notably, the approaches typically overlooked by OS (qualitative, participatory, and critical
methods) are central to research that challenges the White, male, elite, and Western bias of
academia (Dutta, 2020; McMillan Cottom, 2015). Further, these approaches often seek to
acknowledge the lived experiences of marginalized people and empower their voices (McMillan
Cottom, 2015), promoting justice and respect for persons. By marginalizing these approaches to
research, OS further marginalizes these perspectives.
The relentless push for transparency also threatens to dissuade investigation into certain
topics central to Communication and essential to marginalized groups. Due to the elevated risks
of openness, scholars may be hesitant to study controversial topics (e.g., health, economic, and
other disparities); aggressive or defensive communities like hate groups, conspiracy groups, and
extremists; or populations that are in danger of being “outed” in some way. As a result, scholarly
growth and knowledge in these areas could decline. Crucial societal problems, especially those
that impact marginalized communities, are at risk of being understudied and underserved by
Communication scholarship.
Altogether, we fear many aspects of OS will hamper the diversity and inclusiveness of
Communication as a field, both in terms of scholars and scholarship. A recent statement by
ICA’s Executive Committee (2019) claimed: “We strive for a discipline in which all are equally
able to participate and be recognized for excellence” (p. 2). Yet, as we have demonstrated, many
elements of OS refute these goals by prohibiting equal participation by IMRs and SMRs,
OPEN SCIENCE AND MARGINALIZATION 18
creating new hierarchies and inequities, and introducing reward systems that are inaccessible to
many scholars and types of scholarship rather than fostering equal participation and recognition.
An Agenda for Ethical, Inclusive Research
In light of existing recommendations by OS advocates (including Dienlin et al., 2021, and
Munafò et al., 2017), we offer a significantly different lens for the future of research. Rather than
prioritizing transparency, we resituate it within an agenda wherein respect for persons,
beneficence, and justice are superordinate. Within our agenda, we highlight ethical research
practices (ERPs) tied to these principles, including some OSPs modified to offer a more
inclusive and flexible approach to transparency. (See Table 1.) We offer six recommendations
for Communication research wherein research participants are humanized instead of datafied,
and the diversity of participants, scholars, and scholarship is valued.
1. Cultivate ethical, inclusive research practices early & often
Some scholars embrace a procedural approach to learning and practicing ethics (Ellis,
2017): As long as they passed ethics training or have received ethics board approval for a
project, they feel they have met their ethical obligations. We endorse formal ethics training but
also believe a crucial ERP is ongoing ethical reflection and growth as promoting the safety and
well-being of participants and other stakeholders is a continuous process (Ellis, 2017).
We advocate for research ethics to be a mandatory, pervasive component of the
Communication curriculum to train graduate and undergraduate students to be more critical
readers and conductors of research. We believe this effort should include ethical and inclusive
study design; ethical issues surrounding certain topics and samples, particularly regarding
marginalized participants and communities; and ethical considerations and dilemmas across
diverse methods and topics. Researchers should pursue additional training as their
methodological skills and topics of interest broaden. Further, researchers must understand that
OPEN SCIENCE AND MARGINALIZATION 19
training cannot possibly cover the needs of specific populations. Researchers must listen to
marginalized people to identify and address ethical concerns.
Continuing education is also necessary to stay current on evolving ethical issues.
Developing technologies present continual new questions and challenges including new types of
data and new ways data may be re-identified (Rocher et al., 2019), as well as introducing new
risks to marginalized populations. Historical events and sociopolitical forces may change which
populations are at risk or what those risks entail (Ganann, 2013; Pearce, 2020). Ongoing learning
and ethical deliberation are necessary for researchers to continue to promote respect for persons,
beneficence, and justice in an everchanging world.
2. Practice reflexivity
A second recommendation is to recognize one’s positionality and practice reflexivity
that is, a reflection about how researchers’ social identities, power, context, and experiences
influence their research topics, approaches, and interpretations. Researchers should evaluate their
power and privileges, asking themselves how the theories they employ, the hypotheses they
make, the research questions they ask, and the methods they use affect their research and the
people they study. They should interrogate how their positionality also affects the jobs they are
offered, the journals they can publish in, the reviews they receive, and the opportunities that are
open to them. Practicing reflexivity may pose uneasy challenges, such as questioning the
appropriateness of a scholar conducting some types of research.
Reflexivity may also help researchers recognize the ways their positionality is different
than their participants’ or their colleagues’ and challenge their existing assumptions. For
example, researchers may consider how their experiences shape their perceptions regarding the
sensitivity of a topic, the likelihood of risks, or the severity of potential harms, and how these
OPEN SCIENCE AND MARGINALIZATION 20
evaluations may differ for participants. Or, they may consider how power and positionality
govern existing research systems, including what values are prioritized, who benefits, and who is
overlooked (Dutta, 2020).
3. Respect and empower diverse people
Despite the emphasis on transparency, we are surprised by how frequently OS advocacy
fails to mention openness with research participants as well as the lack of participant-oriented
OSPs (e.g., COS, 2020). We believe respect for persons is essential and that OS practitioners
must address this oversight. Consistent with the ICA Code of Ethics (Humphreys et al., 2019),
researchers should employ thorough, clear, and accessible informed consent. This process should
include an explanation of how participants’ data will be handled, who will be able to see it, and
what risks may result. We advise researchers to provide modular consent to empower people
with choices, such as agreeing to participate, but opting out of data sharing. Generally,
researchers should also consider consent a process rather than a static one-time event. For
example, participants may wish to withdraw their consent to open data sharing when they learn
more about the research and its objectives.
Another way researchers can promote this aim is through the ERP of inclusive study
design. For every study, researchers should evaluate how they can recruit participants equitably,
how they will accommodate people with diverse needs, how accessible materials are, and how
they will address inequities that may emerge (Afifi & Cornejo, 2020; Ganann, 2013).
Researchers should ask participants about their experiences in the study to inform future design.
One inclusive approach is participatory research, which requires collaborative reflection on the
research process at all stages, including recognizing local forms of knowledge and decision-
making, involving participants as co-researchers in making sense of data, and sharing research
OPEN SCIENCE AND MARGINALIZATION 21
results with the marginalized communities under study in a form accessible to them (Ganann,
2013). Such involvement helps promote justice, maximizing benefits to participants and the
community.
Scholars should also engage in inclusive reviewing, respecting the diversity of
participants and scholarship when evaluating research rather than serving as a marginalizing
force (Chakravartty et al., 2018). Reviewers and editors must avoid “othering” groups, such as
suggesting that a study on marginalized groups or a non-WEIRD sample belongs in a specialty
journal or requires comparison to “normal” groups (Hendrix, 2005). Although OS considers
diversifying samples less effective for conducting replications, researchers should recognize the
value to scientific and societal progress.
We should also elevate marginalized scholars and approaches to scholarship rather than
questioning and alienating them. Unfortunately some aspects of OS appear to erect, rather than
erode, barriers for participation. Forcing researchers to request exemptions or defend their
reasoning for not engaging in OSPs positions them as lesser scholars (Schwartz-Shea et al.,
2016). Labeling those who practice OS “high quality” and “credible” scholars (e.g., Dienlin et
al., 2021; LeBel et al., 2018) implies that other scholars are deficient or untrustworthy. Hostile
discourse surrounding OS makes scholars feel unwelcome (Schwartz-Shea et al., 2016; Whitaker
& Guest, 2020). We can do better to foster inclusive dialogue and a healthy, diverse research
community in Communication.
4. Promote ethical transparency
We believe some OS guidelines are helpful in promoting greater ethical transparency by
authors, including disclosing individual contributions to an article (COS, 2020), but we believe
existing recommendations fall short. For example, conflict of interest policies are often specific
OPEN SCIENCE AND MARGINALIZATION 22
to disclosing funding, giving authors leeway to omit affiliations that may illuminate existing
power structures (e.g., their current editorial role at the journal) and potential sources of bias
(e.g., founder of a startup related to the research). Readers can then assess how these affiliations
shape the questions that are being asked or create competing interests (e.g., being less willing to
run a study or publish results that would challenge their startup’s claims). Reviewers should also
be required to make such disclosures for editors’ consideration. We thus advocate for a broader
scope of conflict of interest disclosures.
Researchers should also provide, and Communication journals should mandate, an ethics
section for papers involving participants or their data. Merely noting ethics board approval is
insufficient for demonstrating beneficence, respect for persons, and justice through every step of
the research process; indeed, ethics boards may lack the expertise to fully evaluate a project,
particularly if it involves a marginalized group they do not understand. Researchers should value
the opportunity to be transparent regarding how the study was designed in an inclusive fashion,
which factors informed risk-benefit assessments, how they ensured people were making
informed decisions about participation, or how the study addressed justice. Such reflections may
improve researchers’ own practices as well as educate others regarding ethical considerations.
5. Handle data responsibly
OS’s approach to data requires a major revision. Openness should not be the priority; the
safety of participants should be. Moreover, researchers should not be incentivized to put
participants’ information on the open internet. Rather, Communication should be encouraging
responsible data handling and, if appropriate, safer data sharing. First, researchers should
consider whether it is ethically appropriate to share data. Whereas Dienlin et al. (2021) argue that
authors should be required to explain why they are not sharing data, we argue data sharing
OPEN SCIENCE AND MARGINALIZATION 23
disclosures should be required for authors to justify why they are sharing data and why they
think it is safe and ethical to do so: what participants were told, who will have access to the data,
what efforts were made at deidentification, and what the additional or increased risks are for
participants, particularly marginalized groups (Chapter III of the GDPR, 2016, clarifies several
criteria). Second, closed repositories with data use agreements should be the default for any data
sharing rather than openly posting participants’ information on the internet (see Dienlin et al.,
2021, p. 17, for other solutions). Unfortunately, few closed repositories exist (Joel et al., 2018);
ICA could play an important role in addressing this need. An ideal repository would require all
users to complete annually updated training on data handling; give researchers the option to
control who can access data they submit (e.g., allow university affiliated researchers by default,
but require approval for other requests) and how it may be used; and require a data use
agreement. Third, if data must be shared openly, we recommend that they meet established
standards for de-identification (e.g., HIPAA requirements in the U.S.5), although this should only
be a starting point given these lists may be insufficient for some datasets (Sweeney et al., 2018).
Just as data analyses are reviewed for their suitability and appropriate execution, we
believe shared datasets should undergo review by experts who a) understand the topic, the
method, the marginalized populations under study, and their intersections, and b) have up-to-date
training in data de-identification and risk assessment--perhaps something ICA could sponsor for
members, editors, and reviewers. Datasets should be reviewed in careful consideration of the
participants’ characteristics, sensitivity of the data, the extent to which data are identifiable,
current risks, and potential future risks. Consent forms should also be reviewed to ensure
5 https://www.hhs.gov/hipaa/for-professionals/privacy/special-topics/de-identification/
index.html
OPEN SCIENCE AND MARGINALIZATION 24
researchers informed participants how their data would be handled and shared, as well as what
the risks were. These processes will help uphold respect for persons, beneficence, and justice for
participants through the handling of their information. We must acknowledge, however, that this
may present more labor if data require translation for review in a different language.
6. Share resources and knowledge
We fully support disseminating published research as widely as possible. However, we
note that most “open” access journals force authors to pay hefty publishing fees, which creates
inequity and makes publishing inaccessible to many marginalized researchers. Thus, we support
truly open access where paywalls do not block audiences or authors. We also support open
materials in most cases, although researchers must scrutinize potential harms to themselves or
others associated with openness. For example, if experimental stimuli successfully promoted
dangerous misinformation, these open materials could be repurposed by political operatives or
trolls.
The ERP of resource sharing can help promote justice and equity within the research
community. Scholars with greater resources can help support others in small ways (e.g.,
responding to a #ICanHazPDF request and sharing a requested article) or larger ways (e.g.,
inviting collaborators onto projects that would otherwise be cost-prohibitive). Similar to
Albornoz et al. (2017), we encourage equitable collaboration, wherein scholars can exchange
resources, knowledge, and experiences with other scholars or participants as co-researchers.
It is crucial for scholars to engage in the public communication of research. Although
open access makes publications available, they are not comprehensible to many audiences. If
feasible, researchers should consider more inclusive and accessible forms communication, such
as blog posts, lay abstracts, data visualization, or videos. We also strongly encourage
OPEN SCIENCE AND MARGINALIZATION 25
communicating research to the press and policy makers when possible. Sharing findings with
those who can implement evidence-based policies to make structural change is critical;
circulating white papers and responding to requests for comment when prompted by
policymakers are important ways to optimize the public benefits of research. Accepting media
appearances with credible outlets and public speaking engagements with stakeholders can also
help reach broader audiences and the people that may benefit most from scholarship.
Conclusion
Overall, we believe that Communication research is ready for a re-evaluation of its
priorities and practices; however, we do not believe that conversation should be centered around
the values and practices advocated by the current OS movement. We do not believe it is
inclusive of nor welcoming to marginalized people and communities. We do not feel it supports
the diversity of scholars and scholarship that comprise and enrich our field. Instead, we
encourage scholars to direct this energy and desire for change toward a commitment to ethical,
inclusive research that we hope will elevate all stakeholders and challenge marginalizing forces
both in our field and in our world. We hope the ethical practices and recommendations in our
agenda spark crucial conversations about how we can continue to improve Communication
research.
OPEN SCIENCE AND MARGINALIZATION 26
References
Afifi, W. A., & Cornejo, M. (2020). #CommSoWEIRD: The question of sample
representativeness in interpersonal communication research. In M. L. Doerfel & J. L.
Gibbs (Eds.), Organizing inclusion: Moving diversity from demographics to
communication processes (pp. 238-259). Taylor & Francis.
Albornoz, D. A. (2018). Reimagining open science through a feminist lens. Retrieved October
19, 2020, from https://medium.com/@denalbz/reimagining-open-science-through-a-
feminist-lens-546f3d10fa65
Albornoz, D., Posada, A., Okune, A., Hillyer, R., & Chan, L. (2017). Co-constructing an open
and collaborative manifesto to reclaim the open science narrative. In L. Chan & F.
Loizides (Eds.), Expanding perspectives on open science: Communities, cultures, and
diversity in concepts and practices (pp. 293-304). IOS Press.
Bahlai, C., Bartlett, L. J., Burgio, K. R., Fournier, A. M., Keiser, C. N., Poisot, T., & Whitney,
K. S. (2019). Open science isn’t always open to all scientists. American Scientist, 107(2),
78-82. https://doi.org/10.1511/2019.107.2.78
Belmont Report. (1979). The Belmont Report: Ethical principles and guidelines for the
protection of human subjects of research (DHEW Publication No. 78-0012).
National Commission for the Protection of Human Subjects of Biomedical and
Behavioral Research. https://www.hhs.gov/ohrp/sites/default/files/ the-belmont-report-
508c_FINAL.pdf
Bishop, L., & Gray, D. (2017). Ethical challenges of publishing and sharing social media
research data. In K. Woodfield (Ed.), The ethics of online research (pp. 159–187).
Emerald. https://doi.org/10.1108/S2398-601820180000002007
OPEN SCIENCE AND MARGINALIZATION 27
Campbell, R., Goodman-Williams, R., & Javorka, M. (2019). A trauma-informed approach to
sexual violence research ethics and open science. Journal of Interpersonal Violence,
34(23–24), 4765–4793. https://doi.org/10.1177/0886260519871530
Carlson, B., & Frazer, R. (2020). “They got filters”: Indigenous social media, the settler gaze,
and a politics of hope. Social Media + Society, 6(2), 205630512092526.
https://doi.org/10.1177/2056305120925261
Center for Open Science. (2020). TOP guidelines. https://www.cos.io/initiatives/top-guidelines
Chakravartty, P., Kuo, R., Grubbs, V., & McIlwain, C. (2018). #CommunicationSoWhite.
Journal of Communication, 68(2), 254-266. https://doi.org/10.1093/joc/jqy003
Chess, S., & Shaw, A. (2015). A conspiracy of fishes, or, how we learned to stop worrying about
#GamerGate and embrace hegemonic masculinity. Journal of Broadcasting & Electronic
Media, 59(1), 208-220. https://doi.org/10.1080/08838151.2014.999917
Cummings, J. A., Zagrodney, J. M., & Day, T. E. (2015). Impact of open data policies on
consent to participate in human subjects research: Discrepancies between participant
action and reported concerns. PLOS One, 10(5), 1-11.
https://doi.org/10.1371/journal.pone.0125208
Dienlin, T., Johannes, N., Bowman, N. D., Masur, P. K., Engesser, S., Kümpel, A. S., Lukito, J.,
Bier, L. M., Zhang, R., Johnson, B. K., Huskey, R., Schneider, F. M., Breuer, J., Parry,
D. A., Vermeulen, I., Fisher, J. T., Banks, J., Weber, R., Ellis, D. A., . . . & de Vreese, C.
(2021). An agenda for open science in Communication. Journal of Communication,
71(1), 1-26. https://doi.org/10.1093/joc/jqz052
Dutta, M. J. (2020). Whiteness, internationalization, and erasure: Decolonizing futures from the
Global South. Communication and Critical/Cultural Studies, 17(2), 228-235.
OPEN SCIENCE AND MARGINALIZATION 28
https://doi.org/10.1080/14791420.2020.1770825
Ellis, C. (2017). Compassionate research: Interviewing and storytelling from a relational ethics
of care. In I. Goodson, A. Antikainen, & P. Sikes (Eds.), The Routledge international
handbook on narrative and life history (pp. 431–445). Routledge.
European Union. (2016). General data protection regulation. https://gdprinfo.eu
Ferber, A. L. (2018). “Are you willing to die for this work?” Public targeted online harassment in
higher education. Gender & Society, 32(3), 301-320.
https://doi.org/10.1177/0891243218766831
Ganann, R. (2013). Opportunities and challenges associated with engaging immigrant women in
participatory action research. Journal of Immigrant and Minority Health, 15(2), 341–349.
https://doi.org/10.1007/s10903-012-9622-6
Hendrix, K. G. (2005). An invitation to dialogue: Do communication journal reviewers mute the
race‐related research of scholars of color? Southern Journal of Communication, 70(4),
329-345. https://doi.org/10.1080/10417940509373338
Humphreys, L., Ng, E., David, P., Erni, J., Kenski, K., Piotrowski, J., Powers, M., &
Rothenbuhler, E. (2019). ICA Code of Ethics. https://cdn.ymaws.com/www.icahdq.org/
resource/resmgr/governance_documents/ica.code.of.ethics.may2019.pdf
International Communication Association. (2020). Open scholarship.
https://www.icahdq.org/page/OpenScholarship
International Communication Association Executive Committee. (2019). On inclusion, diversity,
equity, and access: Statement from the Executive Committee of the International
Communication Association (ICA). https://cdn.ymaws.com/www.icahdq.org/resource/
resmgr/docs/ica_diversity.pdf
OPEN SCIENCE AND MARGINALIZATION 29
Joel, S., Eastwick, P. W., & Finkel, E. J. (2018). Open sharing of data on close relationships and
other sensitive social psychological topics: Challenges, tools, and future directions.
Advances in Methods and Practices in Psychological Science, 1(1), 86–94.
https://doi.org/10.1177/2515245917744281
LeBel, E. P., McCarthy, R. J., Earp, B. D., Elson, M., & Vanpaemel, W. (2018). A unified
framework to quantify the credibility of scientific findings. Advances in Methods &
Practices in Psychological Science, 1(3), 389-402.
https://doi.org/10.1177/2515245918787489
Massanari, A. L. (2018). Rethinking research ethics, power, and the risk of visibility in the era of
the “alt-right” gaze. Social Media + Society, 4(2).
https://doi.org/10.1177/2056305118768302
McMillan Cottom, T. (2015). “Who do you think you are?”: When marginality meets academic
microcelebrity. Ada: A Journal of Gender, New Media, and Technology (7).
https://doi.org/10.7264/N3319T5T
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert,
N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017). A
manifesto for reproducible science. Nature Human Behavior, 1, article 0021.
https://doi.org/10.1038/s41562-016-0021
Nelson, L. D., Simmons, J., & Simonsohn, U. (2018). Psychology’s renaissance. Annual Review
of Psychology, 69, 511-534. https://doi.org/10.1146/annurev-psych-122216-011836
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., ... &
Contestabile, M. (2015). Promoting an open research culture. Science, 348(6242),
1422-1425. https://doi.org/10.1126/science.aab2374
OPEN SCIENCE AND MARGINALIZATION 30
Nosek, B. A., & Bar-Anan, Y. (2012). Scientific utopia: I. Opening scientific communication.
Psychological Inquiry, 23(3), 217-243. https://doi.org/10.1080/1047840X.2012.692215
Pearce, K. E. (2020). Unintended consequences of using digital methods in difficult research
environments. In B. Foucault Welles & S. González-Bailón (Eds.), The Oxford handbook
of networked communication (pp. 576–597). Oxford University Press.
Rocher, L., Hendrickx, J. M., & De Montjoye, Y. A. (2019). Estimating the success of re-
identifications in incomplete datasets using generative models. Nature Communications,
10(1), 1-9. https://doi.org/10.1038/s41467-019-10933-3
Ross-Hellauer, T., Deppe, A., & Schmidt, B. (2017). Survey on open peer review: Attitudes and
experience amongst editors, authors and reviewers. PloS One, 12(12), e0189311.
https://doi.org/10.1371/journal.pone.0189311
Schell, J. (2014). The art of game design: A book of lenses. CRC Press.
Schwartz-Shea, P., Yanow, D., & Hamburger, K. (2016). Legitimizing political science or
splitting the discipline? Reflections on DA-RT and the policy-making role of a
professional association. Politics & Gender, 12(3), 1-19.
https://doi.org/10.1017/S1743923X16000428
Sweeney, L., von Loewenfeldt, M., & Perry, M. (2018). Saying it’s anonymous doesn’t make it
so: Re-identifications of “anonymized” law school data. Technology Science, article
2018111301. https://techscience.org/a/2018111301/
Trevisan, F., & Reilly, P. (2014). Ethical dilemmas in researching sensitive issues online:
Lessons from the study of British disability dissent networks. Information,
Communication & Society, 17(9), 1131–1146.
https://doi.org/10.1080/1369118X.2014.889188
OPEN SCIENCE AND MARGINALIZATION 31
Whitaker, K., & Guest, O. (2020). #bropenscience is broken science. The Psychologist, 33,
34-37. https://thepsychologist.bps.org.uk/volume-33/november-2020/bropenscience
-broken-science
OPEN SCIENCE AND MARGINALIZATION 32
Table 1
Agenda for Ethical, Inclusive Research
Agenda item
Ethical, inclusive
research practices
Benefits
1. Cultivate ethical,
inclusive research
practices early & often
Ethics training
Early exposure and mandatory training
establish ethics as foundation of research
Ongoing ethical
reflection & growth
Continuous learning improves research;
up-to-date on evolving issues
2. Practice reflexivity
Recognizing
positionality
Acknowledge power and privilege relative
to others
Reflexivity
Become aware of how power, privilege,
and biases shape our research
3. Respect and
empower people
Accessible informed
consent
Transparency with participants about
procedures and how their data will be
handled
Inclusive study design
Meet participants’ needs, diversify
samples, improve validity of research
Inclusive reviewing
Respect the diversity of participants and
approaches when evaluating research
Inclusive dialogue
Building community among researchers;
greater trust in research by public
4. Promote ethical
transparency
Disclosing contributions
Make everyone’s roles and
responsibilities visible, ensure appropriate
credit
Conflicts of interest
disclosure
Audiences can assess potential bias and
interpret research accordingly
Ethics sections in
research articles
Inform audiences about ethical criteria,
procedures, and decision-making
5. Handle data
responsibly
Responsible data
handling
Needs of participants and marginalized
groups are considered in collecting,
storing, deidentifying, and sharing data
Safer data sharing
If sharing, researchers err on the side of
protecting participants’ information (e.g.,
closed repositories); data are reviewed
before sharing; deidentification standards
Data sharing disclosures
Justification for why it is ethical and safe
to share data
6. Share resources and
knowledge
Truly open access
Journals do not have paywalls for
audiences or authors
Open materials
Increase accessibility of stimuli,
measures, guides, coding schemes,
research tools, etc.
OPEN SCIENCE AND MARGINALIZATION 33
Resource sharing
Share research related resources with
collaborators in need to foster equity
Equitable collaboration
Exchanging a variety of research goods
(knowledge, experience, resources) to
benefit and enrich the group
Public communication
of research
Perform outreach and share knowledge in
accessible formats; facilitate change
through press and policy makers
Note: Some OSPs are excluded as they were deemed to have limited utility (open workflow) or
unresolvable ethical issues (open review, gamification/incentives/rankings).
OPEN SCIENCE AND MARGINALIZATION 34
Author Contributions and Disclosures
The seeds of this paper originated in a panel presented at the 2020 ICA conference
organized by K.E.P. (J.F., A.L.M., Ł.S., C.R.R.S., F.T., and J.V. participated). For the paper, J.F.
was the main wrangler; K.E.P., A.L.M, and J.F. wrangled three writing groups responsible for
the bulk of the paper. J.F., K.E.P., A.L.M., J.M.R., Ł.S., Y.S.R., F.T., C.R.R.S., J.V., and P.A.
were involved in writing, editing, and revising the draft throughout the process. S.J.A., M.A.,
A.G., C.G., T.L., & L.D.W. (listed in alphabetical order) helped generate ideas, offered
feedback, and/or suggested revisions on the full draft. A.L.G. was the compass and managing
editor who oversaw editing, rewriting, and revising throughout.
We would like to acknowledge some of our various identities for further context. We
compiled these in a way to reduce identifiability and are not suggesting these identities are
monolithic or not intersectional. Our identities include, in random order: BIPOC, neuroatypical,
woman, LGBTQ, bi-ethnic/racial, spoonie, migrant, Global South scholar, immigrant,
Indigenous, man, Asian, Black, U.S. American, queer, Asian-American, able, White,
heterosexual, pansexual, Jewish, cisgender, disabled, straight, and first generation.
Article
Naturalistic body stimuli are necessary for understanding many aspects of human psychology, yet there are no centralized databases of body stimuli. Furthermore, there are a high number of independently developed stimulus sets lacking in standardization and reproducibility potential, and a general lack of organization, contributing to issues of both replicability and generalizability in body-related research. We conducted a comprehensive scoping review to index and explore existing naturalistic whole-body stimuli. Our research questions were as follows: (1) What sets of naturalistic human whole-body stimuli are present in the literature? And (2) On what factors (e.g., demographics, emotion expression) do these stimuli vary? To be included, stimulus sets had to (1) include human bodies as stimuli; (2) be photographs, videos, or other depictions of real human bodies (not computer generated, drawn, etc.); (3) include the whole body (defined as torso, arms, and legs); and (4) could include edited images, but still had to be recognizable as human bodies. We identified a relatively large number of existing stimulus sets (N = 79) which offered relative variability in terms of main manipulated factors and the degree of visual information included (i.e., inclusion of heads and/or faces). However, stimulus sets were demographically homogenous, skewed towards White, young adult, and female bodies. We identified significant issues in reporting and availability practices, posing a challenge to the generalizability, reliability, and reproducibility of body-related research. Accordingly, we urge researchers to adopt transparent and accessible practices and to take steps to diversify body stimuli.
Article
Full-text available
Social media technologies have had ambivalent political implications for Indigenous peoples and communities. On one hand, they constitute new horizons toward which settler colonial forces of marginalization, disenfranchisement, and elimination can extend and strengthen their power. On the other hand, social media have also offered opportunities to resist and reject the violence of colonization and its ideological counterparts of domination and racial superiority, and work toward imagining and realizing alternative futures. In this article, we draw on insights from settler colonial studies and affect theory to chart the politics of “affect” through the stories of Indigenous Australian social media users. We first argue that the online practices of Indigenous social media users are often mediated by an awareness of the ‘settler gaze’—that is, a latent audience of non-Indigenous others observing in bad faith. We then outline two responses to this presence described by participants: policing the online behaviors of friends and family, and circulating hopeful, inspiring, and positive content. If “policing” is about delimiting the things of which online bodies are capable, then an affective politics of hope is about expanding a body’s capacity to act and imagining other possible futures for Indigenous people.
Article
Full-text available
In the last 10 years, many canonical findings in the social sciences appear unreliable. This so-called “replication crisis” has spurred calls for open science practices, which aim to increase the reproducibility, replicability, and generalizability of findings. Communication research is subject to many of the same challenges that have caused low replicability in other fields. As a result, we propose an agenda for adopting open science practices in Communication, which includes the following seven suggestions: (1) publish materials, data, and code; (2) preregister studies and submit registered reports; (3) conduct replications; (4) collaborate; (5) foster open science skills; (6) implement Transparency and Openness Promotion Guidelines; and (7) incentivize open science practices. Although in our agenda we focus mostly on quantitative research, we also reflect on open science practices relevant to qualitative research. We conclude by discussing potential objections and concerns associated with open science practices.
Article
Full-text available
While rich medical, behavioral, and socio-demographic data are key to modern data-driven research, their collection and use raise legitimate privacy concerns. Anonymizing datasets through de-identification and sampling before sharing them has been the main tool used to address those concerns. We here propose a generative copula-based method that can accurately estimate the likelihood of a specific person to be correctly re-identified, even in a heavily incomplete dataset. On 210 populations, our method obtains AUC scores for predicting individual uniqueness ranging from 0.84 to 0.97, with low false-discovery rate. Using our model, we find that 99.98% of Americans would be correctly re-identified in any dataset using 15 demographic attributes. Our results suggest that even heavily sampled anonymized datasets are unlikely to satisfy the modern standards for anonymization set forth by GDPR and seriously challenge the technical and legal adequacy of the de-identification release-and-forget model.
Article
Full-text available
Societies invest in scientific studies to better understand the world, and attempt to harness such improved understanding to address pressing societal problems. Published research, however, can only be useful for theory or application if it is credible. In science, a credible finding is one that has repeatedly survived risky falsification attempts. However, state-of-the-art meta-analytic approaches cannot determine the credibility of an eect because they do not account for the extent to which each included study has survived such attempted falsification. To overcome this problem, the following paper outlines a unified framework to estimate the credibility of published research by examining four fundamental falsifiability-related dimensions: (1) method/data transparency, (2) analytic reproducibility, (3) analytic robustness, and (4) eect replicability. A standardized workflow is proposed to quantify the degree to which a finding has survived scrutiny along these four credibility facets. The framework is demonstrated by applying it to published replications in the psychology literature. A web platform implementation of the framework is outlined, and we conclude by encouraging the community of researchers to contribute to the development and crowdsourcing of the platform.
Article
Full-text available
This address examines a growing problem in academia: the public targeted online harassment of faculty. This harassment, organized and carried out by the alt-right and supported by other sectors of the right wing across the spectrum from mainstream to extreme, are intended to silence faculty and censor the curriculum. I examine a range of contextual factors that have facilitated this phenomenon, and discuss the experiences of seven other people, as well as myself, all with connections to higher education, that have experienced this unique form of attack. These conversations provide insight into the patterns evident in the form of the attack, individual and university responses, and informed the creation of lists of recommendations for those experiencing, preparing, and responding to attacks.
Article
Full-text available
This essay explores what the “alt-right” (White ethnonationalist, fascist, misogynistic, and anti-intellectual communities) means for social media researchers in terms of research ethics, risk, and visibility. First, it outlines how #Gamergate and #OperationDiggingDiGRA indicated that academic researchers could be targets of their hostility. This essay then draws on the work of Foucault and Mulvey to theorize how far-right groups have a kind of “gaze.” Then, it discusses how far-right extremism requires rethinking ethical questions around researchers and participants. Finally, some thoughts are offered as to what this means for how individuals, organizations, disciplines, and institutions can support research into these spaces.
Article
The essay explores the mobility of Whiteness in networks of Communication Studies that posture themselves as speaking from the Global South. Depoliticized languages of de-westernizing, internationalizing, and decolonizing are often articulated by elites in North-South networks pushing neoliberal governmentality, erasing claims to radical equality that emerge from within socialist struggles in the Global South. In resistance, a radical framework of knowledge from the Global South emerges from within subaltern struggles for hegemony, achieved through (a) delinking from the metropoles of the North and (b) explicitly crafting a socialist anticolonial politics that names and dismantles Whiteness as a capitalist project.
Article
The practice of ethics in social science research is a reflexive process of self-review to define a profession’s collective responsibility in the face of changing norms and expectations. In recent years, we have seen transformative changes in how society thinks about supporting sexual assault survivors, and how the scientific community thinks about our obligations to society. Decades of research on trauma and its impact has raised awareness about the needs of victimized individuals, giving rise to the trauma-informed practice movement, which emphasizes that service providers must center survivors’ well-being in all interactions, decisions, and program practices. The field of sexual assault research helped give rise to this movement and provides empirical support for its guiding tenets, and in this article, we explore how to bring these ideas full circle to begin articulating trauma-informed principles for research. A trauma-informed perspective on research challenges scientists to go beyond the requirements of the Belmont Report (1979) and institutional review boards' (IRB) regulations to develop research procedures that fully support survivors’ choice, control, and empowerment. Such reflection on participants’ rights is particularly important given the open science movement sweeping academia, which calls on scientists to share their data publicly to promote transparency, replication, and new discoveries. Disseminating data could pose significant safety, privacy, and confidentiality risks for victims of sexual assault, so we need to evaluate what open science means within a trauma-informed framework. In this article, we examine three key stages of the research process—participant recruitment, data collection, and dissemination—and consider how trauma-informed principles could help, but also could complicate, research practices. We explore these tensions and offer potential solutions so that research on sexual trauma embodies trauma-informed practice.
Article
Racial inequalities and the colonial legacies of White supremacy permeate scholarly and public discussions today. As part of an ongoing movement to decenter White masculinity as the normative core of scholarly inquiry, this paper is meant as a preliminary intervention. By coding and analyzing the racial composition of primary authors of both articles and citations in journals between 1990–2016, we find that non-White scholars continue to be underrepresented in publication rates, citation rates, and editorial positions in communication studies. We offer some analysis as to why these findings matter in our current political moment, and propose steps the field might take towards further documenting and rectifying race and representation in the production of disciplinary knowledge.