ArticlePublisher preview available

Fighting “bad science” in the information age: The effects of an intervention to stimulate evaluation and critique of false scientific claims

Wiley
Journal of Research in Science Teaching
Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract and Figures

With developments in technology (e.g., “Web 2.0” sites that allow users to author and create media content) and the removal of publication barriers, the quality of science information online now varies vastly. These changes in the review of published science information, along with increased facility of information distribution, have resulted in the spread of misinformation about science. As such, the role of evaluation when reading scientific claims has become a pressing issue when educating students. While recent studies have examined educational strategies for supporting evaluation of sources and plausibility of claims, there is little extant work on supporting students in critiquing the claims for flawed scientific reasoning. This study tested the efficacy of a structured reading support intervention for evaluation and critique on cultivating a critical awareness of flawed scientific claims in an online setting. We developed and validated a questionnaire to measure epistemic vigilance, implemented a large‐scale (N = 1081) Randomized Controlled Trial (RCT) of an original reading activity that elicits evaluation and critique of scientific claims, and measured whether the intervention increased epistemic vigilance of misinformation. Our RCT results suggested a moderate effect in students who complied with the treatment intervention. Furthermore, analyses of heterogeneous effects suggested that the intervention effects were driven by 11th‐grade students and students who self‐reported a moderate trust in science and medicine. Our findings point to the need for additional opportunities and instruction for students on critiquing scientific claims and the nature of specific errors in scientific reasoning.
This content is subject to copyright. Terms and conditions apply.
RESEARCH ARTICLE
Fighting bad sciencein the information age:
The effects of an intervention to stimulate
evaluation and critique of false scientific claims
Anita S. Tseng
1
| Sade Bonilla
2
| Anna MacPherson
3
1
Graduate School of Education, Stanford
University, Stanford, California, USA
2
College of Education, University of
Massachusetts Amherst, Amherst,
Massachusetts, USA
3
American Museum of Natural History,
New York, New York, USA
Correspondence
Anna MacPherson, American Museum of
Natural History, New York, New York,
USA
Email: amacpherson@amnh.org
Abstract
With developments in technology (e.g., Web 2.0sites
that allow users to author and create media content)
and the removal of publication barriers, the quality of
science information online now varies vastly. These
changes in the review of published science information,
along with increased facility of information distribu-
tion, have resulted in the spread of misinformation
about science. As such, the role of evaluation when
reading scientific claims has become a pressing issue
when educating students. While recent studies have
examined educational strategies for supporting evalua-
tion of sources and plausibility of claims, there is little
extant work on supporting students in critiquing the
claims for flawed scientific reasoning. This study tested
the efficacy of a structured reading support interven-
tion for evaluation and critique on cultivating a critical
awarenessofflawedscientificclaimsinanonlinesetting.
We developed and validated a questionnaire to measure
epistemic vigilance, implemented a large-scale (N=1081)
Randomized Controlled Trial (RCT) of an original reading
activity that elicits evaluation and critique of scientific
claims, and measured whether the intervention increased
epistemic vigilance of misinformation. Our RCT results
suggested a moderate effect in students who complied with
the treatment intervention. Furthermore, analyses of
Received: 5 March 2020 Revised: 13 April 2021 Accepted: 17 April 2021
DOI: 10.1002/tea.21696
|
© 2021 National Association for Research in Science Teaching.
1152 J Res Sci Teach. 2021;58:11521178.wileyonlinelibrary.com/journal/tea
... While it retains the analytical structure and evaluative clarity, it incorporates emerging educational imperatives through six interconnected aspects, each having unique descriptors, organized across cognitive (Aspects 1-3), affective (Aspects 3 and 5), and a newly integrated sustainability dimensions (Aspects 4 and 6). (2020) Highlights a four-stage model integrating socioscientific issues (SSI) into science education to foster critical thinking, ethical reasoning, emotional literacy, and sociopolitical activism, empowering students to address social justice and equity challenges Cavagnetto et al. (2020) Highlights fostering student agency through supportive environments, structured inquiry cycles, and active participation to enhance critical thinking, engagement, and the ability to tackle real-world scientific challenges Bellová et al. (2021) Emphasizes integrating hands-on activities and inquiry-based learning to improve attitudes toward science, fostering curiosity, collaboration, and problem-solving to enhance student engagement and motivation Tseng et al. (2021) Highlights fostering critical evaluation skills through critique-based reading activities to combat misinformation, emphasizing epistemic vigilance for developing informed, scientifically literate citizens in the digital age Pietrocola et al. (2021) Emphasizes integrating risk perception and"wicked problems"like pandemics and climate change into science education to foster critical thinking, informed decision-making, and responsible citizenship through ethical and interdisciplinary approaches Bateman et al. (2021) Emphasizes fostering"agential literacy"to prepare learners for sustainable futures by integrating equity, indigenous knowledge, and skills to navigate socio-environmental challenges in the Anthropocene Valladares (2021) Advocates for a transformative approach to SL (Vision-III), emphasizing social justice, equity, and empowerment. It calls for participatory, interdisciplinary education to address socio-environmental challenges and promote critical thinking and active engagement Holbrook et al. (2022) Advocates a"trans-contextualization"approach in science education, adding action-oriented phases to promote active citizenship, socio-scientific inquiry, and collaboration for sustainable solutions to societal challenges Lüsse et al. (2022) Highlights citizen science as a tool to enhance student motivation, scientific skills, and environmental awareness while bridging science and society. ...
... It advocates for well-designed projects that align with curricula and engage students in authentic scientific inquiry Díez-Palomar et al. (2022) Highlights Dialogic Scientific Gatherings (DSGs) as effective tools to foster scientific literacy by enhancing critical thinking, decision-making, and civic participation, particularly benefiting underprivileged and diverse groups through dialogue-based scientific and social skill development Tasquier et al. (2022) Highlights the need for transformative science education to empower students as active agents in addressing climate challenges by developing future-oriented competencies across personal, political, and practical areas, fostering sustainability and proactive agency Kubisch et al. (2022) Highlights the transformative potential of transdisciplinary science education in addressing climate change, integrating SL with critical thinking, systems thinking, and personal engagement to foster sustainable climate action Belova et al. (2022) Emphasizes integrating media literacy into science education to equip students with critical evaluation skills, counter misinformation, and foster informed decision-making in the context of social media Aspect 1, Knowledge of Science, retains its cognitive foundation but is now expanded to include themes 'epistemic insight, critical evaluation, and media literacy.' This revision reflects the increasing need for learners to navigate information complexity and evaluate scientific claims in a post-truth, digitally saturated environment (Belova et al., 2022;Tseng et al., 2021). Aspect 2, Investigative Nature of Science, remains within the cognitive dimension but is strengthened by including themes 'inquiry-based learning and collaborative scientific practices'. ...
... Osborne and Pimentel (2023) highlight the importance of fostering epistemic insight and critical evaluation skills to navigate misinformation and understand the societal implications of science. Misinformation erodes public trust and hinders informed decision-making (Allchin, 2023;Tseng et al., 2021), highlighting the urgent need for tools that enable critical evaluation of scientific information, a need directly addressed in the Revised Framework through the enhanced Aspect 1: Knowledge of Science. Embedding media literacy into science education prepares learners for digital-age complexities (Hobbs & Jensen, 2013). ...
Article
Full-text available
This study refines and advances the Framework for evaluating Scientific Literacy (SL) within science textbooks/curricula by integrating cognitive, affective, and sustainability dimensions. Through a systematic review and analysis of 22 studies, the research identifies emerging themes to restructure the Cansiz and Cansiz (Journal of Baltic Science Education, 18(5), 681–691, 2019) Framework into six comprehensive aspects: Knowledge of Science, Investigative Nature of Science, Science as a Way of Knowing, Science, Technology, Society, and Environment (STSE) Interaction, Affective Engagement with Science, and Sociopolitico-Environmental Justice and Responsibility. Key findings highlight the significance of fostering critical thinking, ethical reasoning, and interdisciplinary competencies to navigate the complexities of the Anthropocene. The Revised Framework emphasizes systems thinking, transformative action, and including marginalized perspectives, aiming to prepare learners for socio-scientific challenges. Additionally, it incorporates affective and sustainability dimensions to foster lifelong engagement with science and empower learners as change agents. The Revised Framework offers theoretical and practical contributions by bridging traditional content-focused models with transformative, justice-oriented approaches. It provides a robust tool for educators and policymakers to evaluate and enhance science textbooks/curricula, ensuring relevance and fostering globally responsive, socially impactful, critical SL. The study concludes by advocating for the Revised Framework's adaptability to diverse educational contexts and its continuous evolution to address emerging challenges.
... Some only captured prior knowledge/beliefs about the topic, others only prior misinformation-detection competencies (see Appendix Table A1). Only two studies considered both types of prior knowledge (Brodsky et al., 2021;Tseng et al., 2021). Furthermore, only two studies conducted both immediate and delayed posttests (Al Zou'bi, 2022;Osborn, 1939). ...
... In explaining mixed effects, the authors referred to participants' prior beliefs. While all studies on comprehensive curricula accounted for some aspects of prior knowledge, two foregrounded both prior knowledge and beliefs/attitudes in the design of their intervention (Osborn, 1939;Tseng et al., 2021). Mixed effects might reflect both the impact and challenge of explicitly designing interventions that attend to attitude in addition to knowledge. ...
... Mixed effects might reflect both the impact and challenge of explicitly designing interventions that attend to attitude in addition to knowledge. A further explanation for the mixed results relates to attrition and fidelity due to the comprehensive nature of the intervention (Geers et al., 2020;Green et al., 2022;Tseng et al., 2021). This explanation highlights the importance of attending to participants' experiences. ...
Article
Full-text available
Misinformation can have severe negative effects on people’s decisions, behaviors, and on society at large. This creates a need to develop and evaluate educational interventions that prepare people to recognize and respond to misinformation. We systematically review 107 articles describing educational interventions across various lines of research. In characterizing existing educational interventions, this review combines a theory-driven approach with a data-driven approach. The theory-driven approach uncovered that educational interventions differ in terms of how they define misinformation and regarding which misinformation characteristics they target. The data-driven approach uncovered that educational interventions have been addressed by research on the misinformation effect, lie detection, information literacy, and fraud trainings, with each line of research yielding different types of interventions. Furthermore, this article reviews evidence about the interventions’ effectiveness. Besides identifying several promising types of interventions, comparisons across different lines of research yield open questions that future research should address to identify ways to increase people's resilience towards misinformation.
... De hecho, los resultados de investigaciones recientes evidencian que esta población muestra dificultades tanto en la gestión de la desinformación (Herrero-Curiel y La-Rosa, 2022; Herrero-Diz et al., 2021) como en la capacidad para argumentar críticamente ante la misma (Castells et al., 2022), lo que compromete su capacidad para valorar e interpretar críticamente informaciones conflictivas. Considerando que la formación que reciben en torno a estos aspectos es escasa (Pérez et al., 2018), resulta fundamental diseñar intervenciones para enseñar al alumnado a enfrentarse de forma crítica a los textos, fomentando su conciencia crítica o vigilancia epistémica ante las informaciones que leen a diario en la red (Gierth y Bromme, 2020a;Tseng et al., 2021). ...
... Lograrlo precisa recurrir a la lectura y/o revisión de textos diversos para discernir entre información cierta y falsa, entre las evidencias y las opiniones. Justamente, Tseng et al. (2021) plantean que la conciencia crítica o vigilancia epistémica ante la información requiere atender tanto a la evaluación de las características de las fuentes (considerando la autoría y la fiabilidad de la fuente), como a la evaluación del contenido del texto. ...
... Ahora bien, evaluar la plausibilidad de la información resulta complicado cuando tampoco se dispone de conocimiento previo suficiente sobre una temática (Lombardi et al., 2018), como les suele ocurrir a los y las adolescentes ante ciertos temas. En estos casos, la única forma de discernir entre informaciones contrapuestas recae en la posibilidad de identificar y cuestionar los argumentos, lo que requiere de una enseñanza explícita, como recientemente han puesto de manifiesto distintos estudios (Hruschka y Appel, 2023;Kiili et al., 2022;Tseng et al., 2021). ...
Article
Full-text available
Las tecnologías de la información y la comunicación ponen a nuestro alcance múltiples fuentes e informaciones diversas sobre un mismo tema, lo que dificulta la tarea de valorarlas y extraer conclusiones al respecto. En este artículo se presentan los resultados de la aplicación de un programa de intervención dirigido a promover el pensamiento crítico, centrado en enseñar al alumnado a elaborar preguntas críticas, capacitándoles para seleccionar y valorar correctamente las evidencias presentes en los textos. El estudio se realizó con cuatro grupos de 3º de ESO (2 grupos control y 2 grupos de intervención) en el área de ciencias naturales. Los resultados muestran una mayor capacidad para formular preguntas críticas sobre los textos y una mayor habilidad para seleccionar y valorar correctamente las evidencias de los textos por parte del alumnado de los grupos de intervención frente al de los grupos control tras la aplicación del programa. Estos resultados avalan la posibilidad de enseñar a los y las estudiantes a valorar la credibilidad de las informaciones que leen, lo que resulta prioritario en el contexto actual para ayudarles a desarrollar el pensamiento crítico ante las múltiples informaciones contradictorias a su alcance.
... Epistemic vigilance and reasoning are important components of health literacy in the current information landscape. Individuals encounter misinformation in science (Tseng et al., 2021), pseudoscientific information in health and medicine (Garcia-Arch et al., 2022;Li et al., 2018), paranormal and conspiracy beliefs (Jastrzębski & Chuderski, 2022), and health misinformation (Swire- Thompson & Lazer, 2022). Furthermore, medical advice and health recommendations are constantly changing (Levy, 2018). ...
... In addition, most laypeople do not exhibit high expertise in a science-based society (Bromme & Thomm, 2015) and depend on experts when making science-based decisions (Hendriks et al., 2016). Laypeople, therefore, are encouraged to trust health professionals and other experts to achieve desirable health outcomes (Birkhäuer et al., 2017;Levy, 2018;Tseng et al., 2021). Hence, future health professionals are desired to develop an adequate level of health literacy during their training. ...
Article
Full-text available
Creating meaningful connections between chemistry and health is a desired goal when teaching chemistry to health science students. However, current literature offers limited insights on the application of chemistry concepts to health contexts. Aside from achieving content mastery in chemistry, it is desired that health science students develop chemistry-based health literacy, which is the ability to apply relevant chemistry concepts in supporting health decisions related to nutrition, diagnostics, natural products and medicine use. In this study, mereology-based instruction (MbI) and conventional instruction (CI) were compared based on their effects on health science students' chemistry-based health literacy. Mereology-based instruction focused on the evaluation of false, reductionist part-whole relationships in selected biochemistry topics while the conventional instruction placed emphasis on structure–property and structure–function relationships. The interventions were implemented for 12 weeks to 13 randomly assigned intact classes of second-year health science students who were enrolled in a biochemistry course. After performing the stacking procedure in Rasch analysis, it was revealed that the mean posttest chemistry-based health literacy logit of students in the MbI group was significantly higher compared to the CI group. Various types of explanations were also elicited in both groups. Our findings provide evidence that an instruction that involves the evaluation of false, reductionistic part-whole relationships in biochemistry can enhance students’ application of epistemic vigilance and increase their chemistry-based health literacy.
... Reasoning evaluation is the second dimension under the content presentation lens. In the words of Tseng andcolleagues [2021, p. 1156], evaluating scientific claims "involve[s] the assessment of scientific arguments for validity of reasoning and the quality of evidence that is used". Furthermore, reasoning evaluation can become a decisive practice in the case of recent GenAI technologies that often neglect identifying the source or rather do so incorrectly. ...
... Hence, although evaluating the scientific claims themselves might be more complicated for non-experts [Osborne & Pimentel, 2022], evaluating the argumentation may become a valuable avenue to establish information credibility [Barzilai et al., 2020;Forzani, 2020], especially when information about the source is scarce or invalid [Dabran-Zivan & Baram-Tsabari, n.d.]. To allow users to evaluate the scientific claims and reappraise the plausibility of alternative explanations [Tseng et al., 2021; see also Halpern, 2014;McGrew & Breakstone, 2023], the reasoning dimension prompts users to consider the inclusion of evidence, scientific or otherwise, and whether the argument addresses alternative claims [Halpern, 2014]. ...
Article
Full-text available
A guiding theory for a continuous and cohesive discussion regarding generative artificial intelligence (GenAI) in science communication is still unavailable. Here, we propose a framework for characterizing, evaluating, and comparing AI-based information technologies in the context of critical engagement with scientific information in online environments. Hierarchically constructed, the framework observes technological properties, user experience, content presentation, and the context in which the technology is being used. Understandable and applicable for non-experts in AI systems, the framework affords a holistic yet practical assessment of various AI-based information technologies, providing both a reflection aid and a conceptual baseline for scholarly references.
... Research into online misinformation has thus far focused on political, economic, and psychological factors (Grinberg et al., 2019). In addition, most studies have focused on misinformation among adults (Guess et al., 2019) or adolescents (Ku et al., 2019;Tseng et al., 2021). Moore and Hancock (2002) tested a 1-hour self-directed series of interactive modules designed to teach concepts and skills for identifying misinformation online and found that the intervention resulted in a higher probability to employ strategies for identifying fake news online. ...
Article
Widespread belief in scientific misinformation circulating online is a critical challenge for democracies. While research to date has focused on psychological, sociodemographic, and political antecedents to this phenomenon, fewer studies have explored the role of media literacy educational efforts, especially with children. Recent findings indicate that children are unprepared for critically evaluating scientific information online and that literacy instruction should address this gap. The aim of this study is to examine the ability to detect fake science news and the evaluation strategies employed by pupils after a news media literacy intervention. In addition, we explore the impact of the news media literacy intervention on their self-efficacy beliefs for detecting fake science news, and on their views of science news. A one-group experimental design was employed with a sample of 74 primary school pupils. A few weeks following a 2-hour media literacy intervention, pupils ranked ten Twitter posts on various scientific topics and were invited to justify their ranking in an open-ended question to unveil their evaluation strategies. Participants also completed one pre-test and one post-test designed to elicit their confidence in their ability to detect fake science news and their views of science news. We averaged pupils’ judgement accuracy, categorized student’s evaluation strategies, and compared self-efficacy beliefs before and after the intervention. On average, pupils’ accuracy when asked to detect fake science news was 68%. This performance is higher than success rates reported in previous studies where no news media literacy intervention was tested. Pupils relied mostly on knowledge in news media literacy to detect fake science news, but also in great proportion on prior scientific knowledge and intuitive reasoning. Fake news self-efficacy beliefs increased significantly after the intervention, but views of science news were not impacted by the intervention. Findings indicate that primary school pupils are capable of careful examination of the credibility of scientific news. Children are regularly exposed to misinformation, and knowledge on how to critically engage with scientific information should be taught as soon as this exposure begins. Our findings suggest that news media literacy training can be successfully facilitated with primary school pupils and could be effective in fighting scientific misinformation from a young age.
... Finally, our study calls for students to be introduced to common debunking and prebunking techniques in order to critically evaluate information and make evidence-based decisions. By incorporating debunking strategies into the curriculum, teachers can foster critical thinking skills and skepticism [97]. Implementing such techniques in high schools is consistent with the broader educational goal of developing informed citizens capable of contributing positively to the discourse on scientific and societal issues [98], regardless of the specific high school stream attended. ...
Article
Full-text available
The COVID-19 pandemic has increased the interest in the possible causes of the spread of science-based fake news. Indeed, such phenomenon can lead to a generalized distrust of science with serious consequences for our society, ranging from vaccine avoidance to climate change denial. Research in educational psychology has only recently begun to explore the psychological drivers and relationships between misinformation, conspiracy theories and pseudoscientific beliefs. However, existing studies have not focused on specific scientific domains and have involved samples with individuals of different age and sociocultural background. In this empirical study, we focus specifically on the pseudoscientific beliefs of high school students and teachers in a science area where fake news are spreading rapidly on websites and social media, namely, quantum mechanics (QM). To this end, we used a 21-item instrument specifically developed by our group in a previous study to measure pseudoscientific beliefs in QM. The cross-sectional sample included N = 1119 high school students ( female students = 52 % ) and N = 125 high school teachers. The data collected were analyzed using the following methods: confirmatory factor analysis to establish the validity of the instrument; multiple correspondence analysis, to transform categorical variables measuring sociocultural background into continuous variables; repeated measures analysis of variance and linear regression to describe which factors most influence students’ and teachers’ pseudoscientific beliefs. The results show that, for students, endorsement of pseudoscientific beliefs in QM depends on the following factors: trust in public and science institutions, scientific content consumption, type of high school attended, and QM literacy. For teachers, endorsement of pseudoscientific beliefs in QM depends on the type of degree obtained, QM literacy, perceived usefulness of teaching QM, and confidence in teaching QM. Our study suggests that outreach and popularization interventions for high school students focused on QM, as well as teacher training courses on QM, should also incorporate elements of the nature of science, i.e., on how we develop scientific knowledge, to provide more effective tools to help teachers and students distinguish between correct claims and plausible but false claims, using both prebunking and debunking approaches. Published by the American Physical Society 2024
Article
Full-text available
Critical thinking (CT) consists of a deliberate and reflective process that can lead to informed decisions. It involves scrutinizing the trustworthiness and consistency of underlying assumptions, the sources of data, and the validity of other information. CT embodies deliberate, self-regulated judgment incorporating cognitive abilities such as analysis, evaluation, and inference. In this follow-up study to Gadot & Tsybulsky (2023), we confirm the role of Digital Curation (DC) as a catalyst for CT and present a structured taxonomy of DC practices that enhance CT. This taxonomy is designed to act as a systematic framework for categorizing DC tasks while capturing the personal and social facets of curation activities. The curation workflow is broken down into the acquisition and assimilation stages and incorporates the level of complexity. This classification can thus be harnessed by educators and practitioners to define the aims and competencies that are critical to fostering CT skills through DC practices.
Article
Full-text available
The COVID-19 global pandemic was a socio-scientific issue (SSI) that had an impact on various aspects of life including education. Educational institutions adapted to new learning, teaching and assessment approaches to be effective in responding to the pandemic. This study aims to determine the research trends and contributions of science education during the COVID-19 pandemic in order to follow up on possible impacts and other crises in the future. The study involved a narrative systematic literature review of 898 articles published in three selected journals from 2018 to 2021. The analysis was divided into two stages. First, to compare research trends between 2018 and 2019 as the baseline with research trends for 2020–2021 during COVID-19. Second, to systematically analyse the content of articles published between 2020 and 2021 to explore the contribution of science education amidst COVID-19 descriptively. The results show that the empirical type of research during the COVID-19 pandemic has increased compared to the baseline. Research topics on learning contexts dominate the baseline and amidst the pandemic, but ‘teaching’ topics are current and future trends in science education research. The three selected journals contributed many publications related to understanding and resolving the crisis during the COVID-19 pandemic directly and indirectly. In addition, science education amidst COVID-19 contributes to preparing the younger generation to become resilient citizens capable of dealing with crises. Direct evidence of preparing resilient citizens amidst the COVID-19 pandemic is contributed by technological and pedagogical knowledge, content and context knowledge, futurising education, and student mobility programmes in science education. Furthermore, indirect evidence is contributed by science education publications published in the three selected journals between 2020 and 2021. Most publications are carried out at the high school level. More articles in the integrated sciences are published than in separate disciplines such as physics, chemistry, biology and earth/ space science. Furthermore, the details of research trends and contributions of science education amidst the COVID-19 pandemic are discussed.
Book
Full-text available
Um an unserer sich stetig verändernden Welt teilzuhaben, ist die eigene Lesekompetenz eine wichtige Bedingung. Dabei hat sich die Digitalisierung als treibende Kraft erwiesen, indem sie nicht nur in erheblichem Maße verändert, was und wie wir lesen, sondern auch, welche Rollen die Lesenden dabei einnehmen. Wer erfolgreich lesen und sich lesend orientieren will, muss zunehmend ein kritisches Lesen kultivieren und unterschiedlichste Lesestrategien verwenden. Maik Philipp beschreibt praxisnah und wissenschaftlich fundiert, worin sich die Veränderungen in der Lesekompetenz abzeichnen und wie sie sich insbesondere didaktisch aufgreifen lassen. Dabei stehen zwei Bereiche besonders im Fokus: die Analyse von Inhalten und die Nutzung von Zusatzinformationen. // Reading skills are an important prerequisite for participating in our rapidly changing world. Digitization has turned out to be a key driving force here, not only by significantly changing what and how we read, but also the various roles that readers take on. Anyone who wants to read successfully and navigate their way through reading must increasingly adopt a critical approach to reading and use a wide variety of reading strategies. Maik Philipp provides a practical and scientifically sound description of the changes in reading skills and how they can be addressed educationally. The focus is on two areas in particular: the analysis of content and the use of additional information.
Article
Full-text available
In a sample of 455 Taiwanese upper‐secondary school students, latent variable structural equation modeling was used to test hypothesized relationships between beliefs about knowledge in science, beliefs about justification for knowing in science, and justification of knowledge claims concerning science encountered on the Internet. Results indicated that participants displayed adaptive beliefs in the tentative and evolving nature of scientific knowledge while their beliefs about justification for knowing in science seemed somewhat less adaptive. Further, their self‐reports of Internet‐specific justification of knowledge claims suggested that they did not strongly believe that science information posted on the Internet needed to be carefully evaluated. The structural equation modeling indicated that beliefs in the tentative and evolving nature of scientific knowledge had direct positive relationships with beliefs in justification by research‐based authority and justification by multiple sources in science, which, in turn, mediated the relationships between beliefs in tentative and evolving knowledge and adaptive beliefs about Internet‐specific justification of knowledge claims. Beliefs in the unambiguous, certain nature of scientific knowledge had a direct positive relationship with beliefs in justification by school‐based authority (i.e., the science teacher and the science textbook), but beliefs in justification by school‐based authority were not related to Internet‐specific justification beliefs. We highlight the unique contributions of this study to the field of epistemic belief and science education research, and its theoretical and educational implications are discussed.
Article
Full-text available
Certain science‐related topics elicit persistent public controversy, such as routine childhood vaccinations and anthropogenic climate change. Many people are misinformed about the scientific facts underlying these issues. In response, science educators have called for improvements in the public's science literacy, but it is not clear which components of science literacy would help individuals identify misinformation. In this position paper, we examine this issue and make two arguments. First, we unpack the construct of science literacy to the seven components identified by the National Academies, and argue that four of these components are most likely to help individuals identify misinformation in everyday life: (a) Understanding of scientific practices; (b) Identifying and judging appropriate scientific expertise, (c) Epistemic knowledge, and (d) Dispositions and habits of mind, for example, inquisitiveness and open‐mindedness. We also show that three of these four components are not commonly used in definitions of science literacy. Second, we posit that two opposite reasons explain why misinformation is so intractable: on the one hand, that individuals uncritically accept most information, even if it is false, and on the other hand, that they reject information that contradicts their worldview, even if it is true. Consequently, we argue that inculcating intellectual virtues, such as open‐mindedness, should be central to imparting science literacy and propose some implications for educational practice. Lastly, we point out some limitations of our arguments and offer recommendations for further research.
Article
Full-text available
In public disputes, stakeholders sometimes misrepresent statistics or other types of scientific evidence to support their claims. One of the reasons this is problematic is that citizens often do not have the motivation nor the cognitive skills to accurately judge the meaning of statistics and thus run the risk of being misinformed. This study reports an experiment investigating the conditions under which people become vigilant towards a source’s claim and thus reason more carefully about the supporting evidence. For this, participants were presented with a claim by a vested-interest or a neutral source and with statistical evidence which was cited by the source as being in support of the claim. However, this statistical evidence actually contradicted the source’s claim but was presented as a contingency table, which are typically difficult for people to interpret correctly. When the source was a lobbyist arguing for his company’s product people were better at interpreting the evidence compared to when the same source argued against the product. This was not the case for a different vested-interests source nor for the neutral source. Further, while all sources were rated as less trustworthy when participants realized that the source had misrepresented the evidence, only for the lobbyist source was this seen as a deliberate attempt at deception. Implications for research on epistemic trust, source credibility effects and science communication are discussed.
Article
Background/Context The Internet has democratized access to information but in so doing has opened the floodgates to misinformation, fake news, and rank propaganda masquerading as dispassionate analysis. Despite mounting attention to the problem of online misinformation and growing agreement that digital literacy efforts are important, prior research offers few concrete ideas about what skilled evaluations look like. Purpose/Objective/Research Question/Focus of Study Our purpose in this study was to seek out those who are skilled in online evaluations in order to understand how their strategies and approaches to evaluating digital content might inform educational efforts. We sampled 45 experienced users of the Internet: 10 Ph.D. historians, 10 professional fact checkers, and 25 Stanford University undergraduates. Analysis focused on the strategies participants used to evaluate online information and arrive at judgments of credibility. Research Design In this expert/novice study, participants thought aloud as they evaluated live websites and searched for information on social and political issues such as bullying, minimum wage, and teacher tenure. We analyze and present findings from three of the tasks participants completed. Findings/Results Historians and students often fell victim to easily manipulated features of websites, such as official-looking logos and domain names. They read vertically, staying within a website to evaluate its reliability. In contrast, fact checkers read laterally, leaving a site after a quick scan and opening up new browser tabs in order to judge the credibility of the original site. Compared to the other groups, fact checkers arrived at more warranted conclusions in a fraction of the time. Conclusions/Recommendations We draw on insights gleaned from the fact checkers’ practices to examine current curricular approaches to teaching web credibility as well as to suggest alternatives.
Article
Educators have been increasingly concerned with what can be done about “post-truth” problems—that is, threats to people's abilities to know what is true—such as the spread of misinformation and denial of well-established scientific claims. The articles and commentaries in this special issue present diverse perspectives on how “post-truth” problems related to scientific and socio-scientific issues might be educationally addressed. The goal of this introductory article is to review and analyze the educational responses to the “post-truth” condition that are reflected in this special issue and in the literature at large. We argue that these responses have employed four lenses that focus on different underlying factors related to people's ways of knowing: not knowing how to know, fallible ways of knowing, not caring about truth (enough), and disagreeing about how to know. Each of these lenses offers different explanations of how education might aggravate or mitigate “post-truth” troubles.
Article
It would be easier to navigate our information world if we had a navigational system to guide us. Absent such a system, the authors of the five articles in this special issue propose different ways to help learners engage with scientific information, in light of the post-truth condition. I suggest that the contribution of these articles lies in their emphasis on encouraging deliberation-oriented practices, and in presenting a qualified view of science. I further argue that greater knowledge of this qualified science, as well as privileging science, may be necessary components. In order to have an impact on learners’ lives, I encourage adopting a framework of mastery and appropriation, and giving greater attention to issues of appropriation.
Article
When individuals have questions about scientific issues, they often search the Internet. Evaluating sources of information and claims they find has become more difficult in the post-truth era. Students are often taught source evaluation techniques, but the proliferation of “fake news” has resulted in a misinformation arms race. As searchers get more sophisticated identifying misleading information, so do purveyors of information who intend to mislead. We draw on a theoretical model of plausibility judgments and current theory and research in source evaluation to suggest that the post-truth era elevates the need for critical evaluation of online information about scientific issues. We argue that explicitly reappraising plausibility judgments may be a crucial addition to evaluating the connections between sources of information and knowledge claims. Individuals who search for and read a scientific article online should ask themselves: Is this explanation plausible, and how do I know?