Colin Klein’s research while affiliated with Australian National University and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (58)


Trust in a Social and Digital World
  • Article

November 2024

·

3 Reads

·

4 Citations

Social Epistemology

·

Colin Klein

Schematic overview of the survey flow. The pathways for the control participants are shown in blue, and the intervention participants are shown in red.
Average support of each crowdsourced intervention. Support was ranked by a sample of 188 behavioural scientists (coauthors on the current paper) who were asked to rate the interventions on perceived efficiency (practical support) and theoretical value (theoretical support). Error bars are bootstrapped confidence intervals around the mean. The mean is a mean rank, where the rank ordinals are defined such that 10 means most support and 0 means least support.
Data distributions. The number of participants in each of the 63 countries represented in the sample (Ntotal = 59,508).
Graphic illustration of the primary outcome variables. (A) climate change belief, (B) climate policy support, (C) willingness to share on social media, (D) the WEPT.
Correlation matrix showing the Pearson’s correlations between the demographic predictors and the four outcome variables.

+1

The International Climate Psychology Collaboration: Climate change-related data collected from 63 countries
  • Article
  • Full-text available

October 2024

·

1,271 Reads

·

10 Citations

Scientific Data

·

·

·

[...]

·

Jay J. Van Bavel

Climate change is currently one of humanity’s greatest threats. To help scholars understand the psychology of climate change, we conducted an online quasi-experimental survey on 59,508 participants from 63 countries (collected between July 2022 and July 2023). In a between-subjects design, we tested 11 interventions designed to promote climate change mitigation across four outcomes: climate change belief, support for climate policies, willingness to share information on social media, and performance on an effortful pro-environmental behavioural task. Participants also reported their demographic information (e.g., age, gender) and several other independent variables (e.g., political orientation, perceptions about the scientific consensus). In the no-intervention control group, we also measured important additional variables, such as environmentalist identity and trust in climate science. We report the collaboration procedure, study design, raw and cleaned data, all survey materials, relevant analysis scripts, and data visualisations. This dataset can be used to further the understanding of psychological, demographic, and national-level factors related to individual-level climate action and how these differ across countries.

Download

Measuring Moral Dimensions in Social Media with Mformer

May 2024

·

17 Reads

·

5 Citations

Proceedings of the International AAAI Conference on Web and Social Media

The ever-growing textual records of contemporary social issues, often discussed online with moral rhetoric, present both an opportunity and a challenge for studying how moral concerns are debated in real life. Moral foundations theory is a taxonomy of intuitions widely used in data-driven analyses of online content, but current computational tools to detect moral foundations suffer from the incompleteness and fragility of their lexicons and from poor generalization across data domains. In this paper, we fine-tune a large language model to measure moral foundations in text based on datasets covering news media and long- and short-form online discussions. The resulting model, called Mformer, outperforms existing approaches on the same domains by 4–12% in AUC and further generalizes well to four commonly used moral text datasets, improving by up to 17% in AUC. We present case studies using Mformer to analyze everyday moral dilemmas on Reddit and controversies on Twitter, showing that moral foundations can meaningfully describe people’s stance on social issues and such variations are topic-dependent. Pretrained model and datasets are released publicly. We posit that Mformer will help the research community quantify moral dimensions for a range of tasks and data domains, and eventually contribute to the understanding of moral situations faced by humans and machines.


Comparing cognition across major transitions using the hierarchy of formal automata

April 2024

·

24 Reads

Wiley interdisciplinary reviews. Cognitive science

The evolution of cognition can be understood in terms of a few major transitions —changes in the computational architecture of nervous systems that changed what cognitive capacities could be evolved by downstream lineages. We demonstrate how the idea of a major cognitive transition can be modeled in terms of where a system's effective computational architecture falls on the well‐studied hierarchy of formal automata (HFA). We then use recent work connecting artificial neural networks to the HFA, which provides a way to make the structure‐architecture link in natural systems. We conclude with reflections on the power and the challenges of traditional thinking when applied to neural architectures. This article is categorized under: Cognitive Biology > Evolutionary Roots of Cognition Psychology > Comparative Philosophy > Foundations of Cognitive Science


Investigating gender and racial biases in DALL-E Mini Images

March 2024

·

40 Reads

·

34 Citations

ACM Journal on Responsible Computing

Generative artificial intelligence systems based on transformers, including both text-generators like GPT-4 and image generators like DALL-E 3, have recently entered the popular consciousness. These tools, while impressive, are liable to reproduce, exacerbate, and reinforce extant human social biases, such as gender and racial biases. In this paper, we systematically review the extent to which DALL-E Mini suffers from this problem. In line with the Model Card published alongside DALL-E Mini by its creators, we find that the images it produces tend to represent dozens of different occupations as populated either solely by men (e.g., pilot, builder, plumber) or solely by women (e.g., hairdresser, receptionist, dietitian). In addition, the images DALL-E Mini produces tend to represent most occupations as populated primarily or solely by White people (e.g., farmer, painter, prison officer, software engineer) and very few by non-White people (e.g., pastor, rapper). These findings suggest that exciting new AI technologies should be critically scrutinized and perhaps regulated before they are unleashed on society.


Addressing climate change with behavioral science: A global intervention tournament in 63 countries

February 2024

·

1,412 Reads

·

121 Citations

Science Advances

Effectively reducing climate change requires marked, global behavior change. However, it is unclear which strategies are most likely to motivate people to change their climate beliefs and behaviors. Here, we tested 11 expert-crowdsourced interventions on four climate mitigation outcomes: beliefs, policy support, information sharing intention, and an effortful tree-planting behavioral task. Across 59,440 participants from 63 countries, the interventions’ effectiveness was small, largely limited to nonclimate skeptics, and differed across outcomes: Beliefs were strengthened mostly by decreasing psychological distance (by 2.3%), policy support by writing a letter to a future-generation member (2.6%), information sharing by negative emotion induction (12.1%), and no intervention increased the more effortful behavior—several interventions even reduced tree planting. Last, the effects of each intervention differed depending on people’s initial climate beliefs. These findings suggest that the impact of behavioral climate interventions varies across audiences and target behaviors.


The Affiliative Use of Emoji and Hashtags in the Black Lives Matter Movement in Twitter

December 2023

·

55 Reads

·

14 Citations

Protests and counter-protests seek to draw and direct attention and concern with confronting images and slogans. In recent years, as protests and counter-protests have partially migrated to the digital space, such images and slogans have also gone online. Two main ways in which these images and slogans are translated to the online space is through the use of emoji and hashtags. Despite sustained academic interest in online protests, hashtag activism, and the use of emoji across social media platforms, little is known about the specific functional role that emoji and hashtags play in online social movements. In an effort to fill this gap, the current paper studies both hashtags and emoji in the context of the Twitter discourse around the Black Lives Matter movement.


Addressing Climate Change with Behavioral Science: A Global Intervention Tournament in 63 Countries

November 2023

·

1,238 Reads

·

13 Citations

Effectively reducing climate change requires dramatic, global behavior change. Yet it is unclear which strategies are most likely to motivate people to change their climate beliefs and behaviors. Here, we tested 11 expert-crowdsourced interventions on four climate mitigation outcomes: beliefs, policy support, information sharing intention, and an effortful tree-planting behavioral task. Across 59,440 participants from 63 countries, the interventions’ effectiveness was small, largely limited to non-climate-skeptics, and differed across outcomes: Beliefs were strengthened most by decreasing psychological distance (by 2.3%), policy support by writing a letter to a future generation member (2.6%), information sharing by negative emotion induction (12.1%), and no intervention increased the more effortful behavior–several interventions even reduced tree planting. Finally, the effects of each intervention differed depending on people’s initial climate beliefs. These findings suggest that the impact of behavioral climate interventions varies across audiences and target behaviors.


Exploratory Analysis and the Expected Value of Experimentation

September 2023

·

47 Reads

Philosophy of Science

It is increasingly easy to acquire a large amount of data about a problem before formulating a hypothesis. The idea of exploratory data analysis (EDA) predates this situation, but many researchers find themselves appealing to EDA as an explanation of what they are doing with these new resources. Yet there has been relatively little explicit work on what EDA is or why it might be important. I canvass several positions in the literature, find them wanting, and suggest an alternative: exploratory data analysis, when done well, shows the expected value of experimentation for a particular hypothesis.


Consciousness in Artificial Intelligence: Insights from the Science of Consciousness

August 2023

·

4,748 Reads

·

23 Citations

Whether current or near-term AI systems could be conscious is a topic of scientific interest and increasing public concern. This report argues for, and exemplifies, a rigorous and empirically grounded approach to AI consciousness: assessing existing AI systems in detail, in light of our best-supported neuroscientific theories of consciousness. We survey several prominent scientific theories of consciousness, including recurrent processing theory, global workspace theory, higher-order theories, predictive processing, and attention schema theory. From these theories we derive "indicator properties" of consciousness, elucidated in computational terms that allow us to assess AI systems for these properties. We use these indicator properties to assess several recent AI systems, and we discuss how future systems might implement them. Our analysis suggests that no current AI systems are conscious, but also shows that there are no obvious barriers to building conscious AI systems.


Citations (46)


... In some cases, its role will be more significant, while less so in others. Just as it does not invalidate Cassam's political explanation, it is not in competition with psychological analyses or contributions from social philosophy and social epistemology, 4 in particular its empirically oriented research drawing on the wisdom of crowds (DeWitt, Atkinson, and Drew 2018) or social epistemic networks (Alfano and Klein 2019). My approach is thus the following: conspiracy theories are a complex phenomenon that threatens our societies in many ways. ...

Reference:

Exempting Oneself from Knowing Better. Epistemic Laziness and Conspiracy Theories
Trust in a Social and Digital World
  • Citing Article
  • November 2024

Social Epistemology

... To achieve these goals, we analyzed data collected as part of the International Climate Psychology Collaboration 23 Table S1). The outcome measures included climate change belief, climate policy support, willingness to share climate-relevant information on social media, and a pro-environmental behavior task (adapted version of the Work for Environmental Protection Task 24 ; Fig. 1B-1E shows the outcome distributions). ...

The International Climate Psychology Collaboration: Climate change-related data collected from 63 countries

Scientific Data

... MFormer Nguyen et al. (2024) is a collection of five binary classifiers based on the RoBERTa-base architecture Liu et al. (2019), developed for predicting moral values in textual data. Each classifier is fine-tuned to predict one moral foundation (e.g., Care/Harm) and is fine-tuned on a diverse array of data. ...

Measuring Moral Dimensions in Social Media with Mformer
  • Citing Article
  • May 2024

Proceedings of the International AAAI Conference on Web and Social Media

... To help creative professionals fully harness the potential of models' unpredictability for co-creation, prior works explored ways of balancing its inherent tradeoffs to uncontrollability -by surfacing and visualizing the prompt space for users [2], refining representations of user prompts with added words from the embedding space of a frozen text-to-image model (i.e., textual inversion [27,103]), refining textual prompts with multi-modal feedback [102], or using GPT to generate (1) code that "sketches out" graphical inputs to guide the text-to-image generation [109] or (2) more semantically diverse prompts [8]. But while these approaches afford creative professionals the agency to explore and expand their prompt spaces during their use of text-to-image tools, it remains a challenge to address the unseen and unsurfaced uniformities, stereotypes and homogeneities that often occur from the model itself [14,16,28,98]. Responding to calls for more pluralistic alignment [94,97], scholars from the HCI and AI communities explored and documented approaches to quantifying and mitigating social biases and homogeneities in large language models [53,65,90], image retrieval models [35,74], and image generation models [7,14,16,17,66], as well as algorithmic systems more broadly [25,89]. ...

Investigating gender and racial biases in DALL-E Mini Images
  • Citing Article
  • March 2024

ACM Journal on Responsible Computing

... Rather, they exist within broader social, political, and economic structures that shape both perceptions of climate change and their ability to engage in proenvironmental behavior. Relatedly, cross-national differences in climate change beliefs and behaviors are well-documented [8][9][10] . For example, the percentage of people who consider climate change a "very serious threat" varies substantially across countries, from 69% in Italy to 13% in Egypt 11 . ...

Addressing climate change with behavioral science: A global intervention tournament in 63 countries

Science Advances

... Role-playing interventions, as discussion-based formats, engage participants in group-based processes to explore collective climate change solutions through dialogue and collaboration. Role-playing complements the individual-focused interventions commonly used in environmental psychology (see Bergquist et al., 2023;Vlasceanu et al., 2023) by emphasising cooperation among participants to address common goals. This shift from individual to societal-level change frames climate change more strongly as a collective issue. ...

Addressing Climate Change with Behavioral Science: A Global Intervention Tournament in 63 Countries

... Finally, there is the emerging challenge posed by AI. Consider this clear statement of the dominant paradigm: "We adopt computational functionalism, the thesis that performing computations of the right kind is necessary and sufficient for consciousness, as a working hypothesis" 10 . Although there is no consensus about which computations or functions are 'of the right kind', defining consciousness this way implies that if something is equivalent to humans in computational-functional terms, it must also be equivalent with respect to consciousness. ...

Consciousness in Artificial Intelligence: Insights from the Science of Consciousness

... This point converges with an argument fromBaron et al. (2023), where they urge us to look for "major transitions" in the evolution of animal nervous systems rather than focusing on providing evolutionary accounts for specific cognitive capacities.https://doi.org/10.1017/psa.2025.16 Published online by Cambridge University Press ...

Transitions in cognitive evolution

... From the mandevillian point of view, this is not only acceptable but desirable, on the assumption that people's social networks are structured in such a way that enables them to exploit the wisdom of crowds. Unfortunately, recent research suggests that only a small minority of them was so-positioned, at least when it came to discourse about vaccines (Klein et al., 2022;Sullivan et al., 2020). This returns us to the point, made above, that whether a disposition counts as a mandevillian virtue or vice depends on the structure and organization of the group in which its bearer operates. ...

The wisdom_of_crowds: An Efficient, Philosophically-Validated, Social Epistemological Network Profiling Toolkit

Studies in Computational Intelligence

... This imbrication of language, opinion and community provides the signature expression of polarisation (O'Reilly et al., 2024). Polarized communities on social media tend to use different words, phrases and slogans to articulate their point of view (e.g., Kligler-Vilenchik et al., 2020;Ojea Quintana et al., 2022;Roy & Goldwasser, 2020;Villa-Cox et al., 2021). They focus attention on different topics, issues, and events, framing these in group-distinctive ways. ...

Polarization and trust in the evolution of vaccine discourse on Twitter during COVID-19