Brian Keegan’s research while affiliated with University of Colorado Boulder and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (62)


Governance of the Black Experience on Reddit: r/BlackPeopleTwitter as a Case Study in Supporting Sense of Virtual Community for Black Users
  • Article

November 2024

·

12 Reads

·

3 Citations

Proceedings of the ACM on Human-Computer Interaction

·

Shamika Klassen

·

Gale H. Prinster

·

[...]

·

Brian C. Keegan

Despite frequent efforts to combat racism, almost no research has explored how to cultivate positive experiences of thriving Black culture on Reddit. In this case study, we surveyed users of r/BlackPeopleTwitter (BPT)--a large, popular subreddit that showcases screenshots of hilarious or insightful social media posts made by Black people (mainly from Black Twitter). Our research questions seek to understand users' motivations for visiting BPT, how they experience a sense of virtual community (SOVC) and membership in BPT, and how BPT's governance influences these experiences. We find that that users come to BPT primarily for excellent humor and entertainment, sociopolitical context on issues relevant to Black people, and/or partaking in the shared Black experience. Black users are more likely to report higher SOVC and to identify as members, whereas non-Black users are more likely to identify as guests or visitors to the community. To protect Black expression, the BPT moderation team implemented a governance strategy for verifying racial identity and limiting participation to only verified users in certain threads. Our data suggest that this policy is a contentious but influential aspect of SOVC that simultaneously constructs and challenges the sense of the subreddit existing as a safe space for Black people. We synthesize these results by discussing how: differing platform affordances across Twitter and Reddit combine to cultivate a thriving Black community on Reddit; the need for Black authenticity on an otherwise anonymous platform can guide future research in identity verification; and the limitations of this study motivate future work to support all marginalized communities online.


Community Archetypes: An Empirical Framework for Guiding Research Methodologies to Reflect User Experiences of Sense of Virtual Community on Reddit

April 2024

·

19 Reads

·

3 Citations

Proceedings of the ACM on Human-Computer Interaction

Humans need a sense of community (SOC), and social media platforms afford opportunities to address this need by providing users with a sense of virtual community (SOVC). This paper explores SOVC on Reddit and is motivated by two goals: (1) providing researchers with an excellent resource for methodological decisions in studies of Reddit communities; and (2) creating the foundation for a new class of research methods and community support tools that reflect users' experiences of SOVC. To ensure that methods are respectfully and ethically designed in service and accountability to impacted communities, our work takes a qualitative and community-centered approach by engaging with two key stakeholder groups. First, we interviewed 21 researchers to understand how they study community" on Reddit. Second, we surveyed 12 subreddits to gain insight into user experiences of SOVC. Results show that some research methods can broadly reflect user experiences of SOVC regardless of the topic or type of subreddit. However, user responses also evidenced the existence of five distinct Community Archetypes: Topical Q&A, Learning & Perspective Broadening, Social Support, Content Generation, and Affiliation with an Entity. We offer the Community Archetypes framework to support future work in designing methods that align more closely with user experiences of SOVC and to create community support tools that can meaningfully nourish the human need for SOC/SOVC in our modern world.



The Impact of Governance Bots on Sense of Virtual Community: Development and Validation of the GOV-BOTs Scale

November 2022

·

19 Reads

·

10 Citations

Proceedings of the ACM on Human-Computer Interaction

Bots are increasingly being used for governance-related purposes in online communities, yet no instrumentation exists for measuring how users assess their beneficial or detrimental impacts. In order to support future human-centered and community-based research, we developed a new scale called GOVernance Bots in Online communiTies (GOV-BOTs) across two rounds of surveys on Reddit (N=820). We applied rigorous psychometric criteria to demonstrate the validity of GOV-BOTs, which contains two subscales: bot governance (4 items) and bot tensions (3 items). Whereas humans have historically expected communities to be composed entirely of humans, the social participation of bots as non-human agents now raises fundamental questions about psychological, philosophical, and ethical implications. Addressing psychological impacts, our data show that perceptions of effective bot governance positively contribute to users' sense of virtual community (SOVC), whereas perceived bot tensions may only impact SOVC if users are more aware of bots. Finally, we show that users tend to experience the greatest SOVC across groups of subreddits, rather than individual subreddits, suggesting that future research should carefully re-consider uses and operationalizations of the term "community."


Cannabinoid variation among commercial Cannabis-derived product samples in the US
(A) Violin plot of distribution of the set of common cannabinoids measured across all regions. (B) Total THC vs. Total CBD levels, color-coded by THC:CBD chemotype. (C) Histogram showing THC:CBD distribution on a log10 scale. “Inf” stands for “infinite” (any samples with 0 total THC or CBD). (D) Principal Component Analysis of all cannabinoids shown in panel A, color-coded by THC:CBD chemotype.
Correlations among total THC, CBD, and CBG levels in each THC:CBD chemotype
Scatterplots showing the linear correlation between total THC, CBD, and CBG levels in each of the main THC:CBD chemotypes. The sample sizes for each of the groups is as follows: THC-dominant N = 82,563; Balanced N = 1,876, and CBD-dominant N = 1,188. Top Row: Total THC vs. Total CBD; middle row: Total CBD vs. Total THC. Bottom row: Total CBD vs. Total CBG. ***P < 0.0001.
Terpene abundance across commercial Cannabis-derived product samples in the US
(A) Violin plots showing distributions of the set of common terpenes measured across all regions. (B) Scatterplot showing the correlation between α- and β-pinene, two common pinene isomers. Rs = 0.78, ***P < 0.0001 (C) Scatterplot showing the correlation between β-caryophyllene and humulene, two Cannabis terpenes co-produced by common enzymes. Rs = 0.88, ***P < 0.0001.
Patterns of terpene co-occurrence among commercial Cannabis-derived product samples in the US
(A) Hierarchically clustered correlation matrix showing pairwise correlations between all terpenes consistently measured across regions. (B) Network diagram where nodes are terpenes and edges are thresholded to the strongest observed correlations and their widths correspond to the strength of the correlation.
Patterns of terpene profile diversity across THC:CBD chemotypes
(A) Histogram showing the proportion of variation explained by each principal component after performing Principal Component Analysis on the terpene dataset. (B) PCA scores plotted along PC1 and PC2, color-coded by major THC:CBD chemotype. Vectors depict the loadings of the five individual terpenes onto these principal axes. (C) PCA scores plotted along PC1 and PC3. (D) PCA scores plotted along PC2 and PC3. (E) Violin plot showing distribution of ‘product diversity’ values (cosine distances) for each THC:CBD chemotype. Product values are calculated by averaging samples with the same strain name linked to a given producer ID. ***P < 0.0001, Welch’s t-test and Cohen’s d’. (F) Stacked bar chart showing the percent products with a given dominant terpene for each THC:CBD chemotype.

+8

The phytochemical diversity of commercial Cannabis in the United States
  • Article
  • Full-text available

May 2022

·

318 Reads

·

52 Citations

The legal status of Cannabis is changing, fueling an increasing diversity of Cannabis-derived products. Because Cannabis contains dozens of chemical compounds with potential psychoactive or medicinal effects, understanding this phytochemical diversity is crucial. The legal Cannabis industry heavily markets products to consumers based on widely used labeling systems purported to predict the effects of different “strains.” We analyzed the cannabinoid and terpene content of commercial Cannabis samples across six US states, finding distinct chemical phenotypes (chemotypes) which are reliably present. By comparing the observed phytochemical diversity to the commercial labels commonly attached to Cannabis-derived product samples, we show that commercial labels do not consistently align with the observed chemical diversity. However, certain labels do show a biased association with specific chemotypes. These results have implications for the classification of commercial Cannabis, design of animal and human research, and regulation of consumer marketing—areas which today are often divorced from the chemical reality of the Cannabis-derived material they wish to represent.

Download


Examining Narrative Sonification: Using First-Person Retrospection Methods to Translate Radio Production to Interaction Design

December 2021

·

40 Reads

·

10 Citations

ACM Transactions on Computer-Human Interaction

We present a first-person, retrospective exploration of two radio sonification pieces that employ narrative scaffolding to teach audiences how to listen to data. To decelerate and articulate design processes that occurred at the rapid pace of radio production, the sound designer and producer wrote retrospective design accounts. We then revisited the radio pieces through principles drawn from guidance design, data storytelling, visualization literacy, and sound studies. Finally, we speculated how these principles might be applied through interactive, voice-based technologies. First-person methods enabled us to access the implicit knowledge embedded in radio production and translate it to technologies of interest to the human–computer-interaction community, such as voice user interfaces that rely on auditory display. Traditionally, sonification practitioners have focused more on generating sounds than on teaching people how to listen; our process, however, treated sound and narrative as a holistic, sonic-narrative experience. Our first-person retrospection illuminated the role of narrative in designing to support people as they learn to listen to data.


The Phytochemical Diversity of Commercial Cannabis in the United States

July 2021

·

289 Reads

·

4 Citations

The legal status of Cannabis is changing, fueling an increased diversity of Cannabis-derived products. Because Cannabis contains dozens of chemical compounds with potential psychoactive or medicinal effects, understanding its phytochemical diversity is crucial. The legal Cannabis industry heavily markets products to consumers based on widely used labelling systems purported to predict the effects of different Cannabis "strains." We analyzed the cannabinoid and terpene content of tens of thousands of commercial Cannabis samples across six US states, finding distinct chemical phenotypes (chemotypes) which are reliably present. After careful descriptive analysis of the phytochemical diversity and comparison to the commercial labels commonly attached to Cannabis samples, we show that commercial labels do not consistently align with the observed chemical diversity. However, certain labels are statistically overrepresented for specific chemotypes. These results have important implications for the classification of commercial Cannabis, the design of animal and human research, and the regulation of legal Cannabis marketing.


Understanding the Diverging User Trajectories in Highly-related Online Communities during the COVID-19 Pandemic

May 2021

·

4 Reads

·

18 Citations

Proceedings of the International AAAI Conference on Web and Social Media

As the COVID-19 pandemic is disrupting life worldwide, related online communities are popping up. In particular, two “new” communities, /r/China flu and /r/Coronavirus, emerged on Reddit and have been dedicated to COVID- related discussions from the very beginning of this pandemic. With /r/Coronavirus promoted as the official community on Reddit, it remains an open question how users choose between these two highly-related communities. In this paper, we characterize user trajectories in these two communities from the beginning of COVID-19 to the end of September 2020. We show that new users of /r/China flu and /r/Coronavirus were similar from January to March. After that, their differences steadily increase, both in language distance and membership prediction, as the pandemic continues to unfold. Furthermore, users who started at /r/China flu from January to March were more likely to leave, while those who started in later months tend to remain highly “loyal”. To understand this difference, we develop a movement analysis framework to understand membership changes in these two communities and identify a significant proportion of /r/China flu members (around 50%) that moved to /r/Coronavirus in February. This movement turns out to be highly predictable based on other subreddits that users were previously active in. Our work demonstrates how two highly-related communities emerge and develop their own identity in a crisis, and highlights the important role of existing communities in understanding such an emergence.


An Encyclopedia with Breaking News

October 2020

·

33 Reads

·

11 Citations

Wikipedia's first twenty years: how what began as an experiment in collaboration became the world's most popular reference work. We have been looking things up in Wikipedia for twenty years. What began almost by accident—a wiki attached to a nascent online encyclopedia—has become the world's most popular reference work. Regarded at first as the scholarly equivalent of a Big Mac, Wikipedia is now known for its reliable sourcing and as a bastion of (mostly) reasoned interaction. How has Wikipedia, built on a model of radical collaboration, remained true to its original mission of “free access to the sum of all human knowledge” when other tech phenomena have devolved into advertising platforms? In this book, scholars, activists, and volunteers reflect on Wikipedia's first twenty years, revealing connections across disciplines and borders, languages and data, the professional and personal. The contributors consider Wikipedia's history, the richness of the connections that underpin it, and its founding vision. Their essays look at, among other things, the shift from bewilderment to respect in press coverage of Wikipedia; Wikipedia as “the most important laboratory for social scientific and computing research in history”; and the acknowledgment that “free access” includes not just access to the material but freedom to contribute—that the summation of all human knowledge is biased by who documents it. Contributors Phoebe Ayers, Omer Benjakob, Yochai Benkler, William Beutler, Siko Bouterse, Rebecca Thorndike-Breeze, Amy Carleton, Robert Cummings, LiAnna L. Davis, Siân Evans, Heather Ford, Stephen Harrison, Heather Hart, Benjamin Mako Hill, Dariusz Jemielniak, Brian Keegan, Jackie Koerner, Alexandria Lockett, Jacqueline Mabey, Katherine Maher, Michael Mandiberg, Stephane Coillet-Matillon, Cecelia A. Musselman, Eliza Myrie, Jake Orlowitz, Ian A. Ramjohn, Joseph Reagle, Anasuya Sengupta, Aaron Shaw, Melissa Tamani, Jina Valentine, Matthew Vetter, Adele Vrana, Denny Vrandečić


Citations (49)


... A work meeting and a bachelor party may take place in the same city, with the same laws, but each has different standards for acceptable social behavior. In some cases a community's rules may even seem to be in tension with the platform's broader policies; for example, the Reddit community, r/BlackPeopleTwitter, includes racial verification as a moderation practice -a policy that could be considered exclusionary at a platform level (Smith et al. 2024). ...

Reference:

AI and the Future of Digital Public Squares
Governance of the Black Experience on Reddit: r/BlackPeopleTwitter as a Case Study in Supporting Sense of Virtual Community for Black Users
  • Citing Article
  • November 2024

Proceedings of the ACM on Human-Computer Interaction

... The participating communities in this work were selected because they had prior experience with community research. Each represented different context domains, archetypes [79], membership, and contribution structures (Table 1 highlights these differences). Notably, each community had distinct approaches for navigating research which allowed us to examine a range of perspectives on ethical community-research interactions. ...

Community Archetypes: An Empirical Framework for Guiding Research Methodologies to Reflect User Experiences of Sense of Virtual Community on Reddit
  • Citing Article
  • April 2024

Proceedings of the ACM on Human-Computer Interaction

... Similarly, Gab was founded to attract alt-right users [15] and Parler became the home of "disaffected right-wing social media users" [8]. While Mastodon has elements of techno-libertarian leaning [33] and took active measures to distance themselves from right-wing users [34], there exists to our knowledge no study examining the political leanings of users of the platform. While the literature contains ample examples of small social media platforms launched because of content moderation on Twitter, which were perceived to be disproportionally targeting conservative viewpoints [15], there is, to our knowledge, no empirical investigation into a predominantly left-leaning small platform. ...

Mastodon Rules: Characterizing Formal Rules on Popular Mastodon Instances
  • Citing Conference Paper
  • October 2023

... Ford (2015) considera a Wikipedia como una "fábrica de hechos", fuente de autoridad y legitimidad. Su valoración crecientemente positiva se corresponde con una visión crítica hacia las plataformas comerciales dominantes, a partir de sus vulneraciones a la privacidad, difusión de desinformación y contenido de odio, entre otros aspectos desalentadores (Keegan, 2020). ...

An Encyclopedia with Breaking News

... Unlike previous studies that treated committed individuals or bots as independent decision-makers, we consider a scenario where bots act as third-party regulators, influencing the payoffs of normal players without directly engaging in their interactions [23][24][25]. For example, on platforms like Twitter, bots might amplify prosocial content, increasing visibility and engagement (positive payoff), or downrank harmful content, limiting its reach (negative payoff) [26][27][28]. Though these bots do not interact directly with players, they significantly shape social dynamics by externally modifying payoffs. ...

The Impact of Governance Bots on Sense of Virtual Community: Development and Validation of the GOV-BOTs Scale
  • Citing Article
  • November 2022

Proceedings of the ACM on Human-Computer Interaction

... On top of that, we detected a contribution disparity with respect to Wikipedia size, meaning that the smaller Wikipedias we studied did not benefit to the same degree as larger or medium Wikipedias. The observed discrepancy in edit and newcomer increases for large, medium, and small Wikipedias may stem from a difference in community size and structure, or these Wikipedias' specific rules 11,[29][30][31][32] . This discrepancy could be further reinforced by the culture and perception of what constitutes good knowledge representation in the different Wikipedia language editions 33 . ...

The Evolution and Consequences of Peer Producing Wikipedia's Rules
  • Citing Article
  • May 2017

Proceedings of the International AAAI Conference on Web and Social Media

... Unlike Amy Cooper, who was shamed in Twitter's open network, european_douchebag's shaming occurred on Reddit. Reddit is a popular social media platform that hosts over 330 million monthly active users in around 140,000 subreddits, which are organized around a variety of user-driven interests and often support all kinds of collective action (Flores-Saviaga, Keegan, and Savage 2018;Matias 2016;Mills and Fish 2015;Tiffany 2020). ...

Mobilizing the Trump Train: Understanding Collective Action in a Political Trolling Community
  • Citing Article
  • June 2018

Proceedings of the International AAAI Conference on Web and Social Media

... We utilized the Reddit Dataset curated by Baumgartner et al. and hosted on BigQuery [14]. This study was considered exempt under University of Pennsylvania Institutional Review Board guidelines as it involves the analysis of publicly available data. ...

The Pushshift Reddit Dataset
  • Citing Article
  • May 2020

Proceedings of the International AAAI Conference on Web and Social Media

... Most sites already express some specific terms of service and sets of rules that may limit certain forms of research engagement. Such policies generally focus on limiting commercial exploitation on the site (i.e., spam) by prohibiting the use of automated tools for posting messages or automated tools for gathering data [34], but it is also becoming more common for these pages to include information on acceptable research practices (e.g., X's "Rules and Policies" page [15]). A few online communities have established explicit rules and practices for research engagements. ...

No Robots, Spiders, or Scrapers: Legal and Ethical Regulation of Data Collection Methods in Social Media Terms of Service
  • Citing Article
  • May 2020

Proceedings of the International AAAI Conference on Web and Social Media

... In another study, Zhang et al. 36 used the contents of two primary subreddits (i.e., /r/China flu and /r/coronavirus) to investigate the trajectories of users from the beginning of the pandemic until September 2020. In their study, they quantified the differences between users' profiles and their language use as well as their migration between the two subreddits. ...

Understanding the Diverging User Trajectories in Highly-related Online Communities during the COVID-19 Pandemic
  • Citing Article
  • May 2021

Proceedings of the International AAAI Conference on Web and Social Media