ArticlePublisher preview availableLiterature Review

Artificial intelligence in education: Addressing ethical challenges in K-12 settings

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract and Figures

Artificial intelligence (AI) is a field of study that combines the applications of machine learning, algorithm productions, and natural language processing. Applications of AI transform the tools of education. AI has a variety of educational applications, such as personalized learning platforms to promote students’ learning, automated assessment systems to aid teachers, and facial recognition systems to generate insights about learners’ behaviors. Despite the potential benefits of AI to support students’ learning experiences and teachers’ practices, the ethical and societal drawbacks of these systems are rarely fully considered in K-12 educational contexts. The ethical challenges of AI in education must be identified and introduced to teachers and students. To address these issues, this paper (1) briefly defines AI through the concepts of machine learning and algorithms; (2) introduces applications of AI in educational settings and benefits of AI systems to support students’ learning processes; (3) describes ethical challenges and dilemmas of using AI in education; and (4) addresses the teaching and understanding of AI by providing recommended instructional resources from two providers—i.e., the Massachusetts Institute of Technology’s (MIT) Media Lab and Code.org. The article aims to help practitioners reap the benefits and navigate ethical challenges of integrating AI in K-12 classrooms, while also introducing instructional resources that teachers can use to advance K-12 students’ understanding of AI and ethics.
This content is subject to copyright. Terms and conditions apply.
Vol.:(0123456789)
1 3
AI and Ethics (2022) 2:431–440
https://doi.org/10.1007/s43681-021-00096-7
REVIEW
Artificial intelligence ineducation: Addressing ethical challenges
inK‑12 settings
SelinAkgun1 · ChristineGreenhow1
Received: 9 July 2021 / Accepted: 1 September 2021 / Published online: 22 September 2021
© The Author(s), under exclusive licence to Springer Nature Switzerland AG 2021
Abstract
Artificial intelligence (AI) is a field of study that combines the applications of machine learning, algorithm productions, and
natural language processing. Applications of AI transform the tools of education. AI has a variety of educational applica-
tions, such as personalized learning platforms to promote students’ learning, automated assessment systems to aid teachers,
and facial recognition systems to generate insights about learners’ behaviors. Despite the potential benefits of AI to support
students’ learning experiences and teachers’ practices, the ethical and societal drawbacks of these systems are rarely fully
considered in K-12 educational contexts. The ethical challenges of AI in education must be identified and introduced to
teachers and students. To address these issues, this paper (1) briefly defines AI through the concepts of machine learning
and algorithms; (2) introduces applications of AI in educational settings and benefits of AI systems to support students’
learning processes; (3) describes ethical challenges and dilemmas of using AI in education; and (4) addresses the teaching
and understanding of AI by providing recommended instructional resources from two providers—i.e., the Massachusetts
Institute of Technology’s (MIT) Media Lab and Code.org. The article aims to help practitioners reap the benefits and navigate
ethical challenges of integrating AI in K-12 classrooms, while also introducing instructional resources thatteachers can use
to advance K-12 students’ understanding of AI and ethics.
Keywords Artificial intelligence· K-12 education· Ethics· Teacher education
1 Introduction
“Success in creating AI would be the biggest event in human
history. Unfortunately, it might also be the last, unless we
learn how to avoid the risks.”Stephen Hawking.
We may not think about artificial intelligence (AI) on a
daily basis, but it is all around us, and we have been using it
for years. When we are doing a Google search, reading our
emails, getting a doctor’s appointment, asking for driving
directions, or getting movie and music recommendations, we
are constantly using the applications of AI and its assistance
in our lives. This need for assistance and our dependence
on AI systems has become even more apparent during the
COVID-19 pandemic. The growing impact and dominance
of AI systems reveals itself in healthcare, education, commu-
nications, transportation, agriculture, and more. It is almost
impossible to live in a modern society without encountering
applications powered by AI [10, 32].
Artificial intelligence (AI) can be defined briefly as the
branch of computer science that deals with the simulation
of intelligent behavior in computers and their capacity to
mimic, and ideally improve, human behavior [43]. AI dom-
inates the fields of science, engineering, and technology,
but also is present in education through machine-learning
systems and algorithm productions [43]. For instance, AI
has a variety of algorithmic applications in education, such
as personalized learning systems to promote students’
learning, automated assessment systems to support teach-
ers in evaluating what students know, and facial recogni-
tion systems to provide insights about learners’ behaviors
[49]. Besides these platforms, algorithm systems are prom-
inent in education through different social media outlets,
such as social network sites, microblogging systems, and
mobile applications. Social media are increasingly inte-
grated into K-12 education [7] and subordinate learners’
* Selin Akgun
akgunsel@msu.edu
Christine Greenhow
greenhow@msu.edu
1 Michigan State University, EastLansing, MI, USA
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
... Therefore, transparency and accountability are important factors to consider to ensure the trustworthiness of AI systems (Nguyen et al., 2023). Apart from these, dependence on limited data, bias, misinterpretation, generation of data and results that are not real, lack of emotional intelligence, cultural and linguistic deficiencies are some of the other limitations of AIBTs (Akgun & Greenhow, 2022;Gökçearslan et al., 2024;Küchemann et al., 2023;Tapan-Broutin, 2023;Uğraş & Uğraş, 2025). Uğraş et al. (2024) argue that limitations such as reliability, accuracy, and ethics may raise concerns, and therefore the literacy of individuals regarding AI and AIBT should be developed. ...
Article
Full-text available
Artificial intelligence (AI) and AI-based tools are becoming increasingly important in mathematics education due to their potential to enrich learning experiences, provide customized solutions, and increase the effectiveness of learning processes. This case study was conducted to examine the impact of AI-based tool experiences on pre-service mathematics teachers' (PMTs) mathematical concept images. As a result of the content analysis, the data were categorized under the themes of component, understanding, and association, and the changes in PMTs' concept images after their ChatGPT experiences were examined according to these themes. Although not always, the ChatGPT experience had an effect on PMTs' mathematical concept images in general. In particular, PMTs mentioned more components that are directly related to mathematical concepts, while associating related concepts with different terms decreased. However, there were partial transformations in the understandings of the concepts. While subjective knowledge of concepts decreased, objective and directly related knowledge increased and unnecessary repetitions decreased. In conclusion, ChatGPT experiences contributed to the development of concept images of PMTs, but this contribution was not at the same level for all concepts.
... concerns, privacy violations, and biases (Akgun & Greenhow, 2022). Given the opportunities and risks of AI technologies, the ability to understand, use, and critically evaluate these technologies-referred to as AI literacy-gains importance (Laupichler et al., 2022). ...
Article
Full-text available
The study aims to identify the profiles of university students regarding Artificial Intelligence Literacy, Lifelong Learning, and Fear of Innovation using cluster analysis and to examine the relationships among these variables. Cluster analysis and structural equation modeling were conducted with valid responses from 402 university students. The cluster analysis identified three distinct student profiles: the highly adaptive group (Profile 1), the needs improvement group (Profile 2), and the high support required group (Profile 3). Structural equation modeling revealed that artificial intelligence literacy positively affects the tendency for lifelong learning and negatively impacts the fear of innovation. Lifelong Learning Trends also negatively influences the fear of innovation. Furthermore, artificial intelligence literacy was found to indirectly reduce fear of innovation through lifelong learning tendencies. The findings from cluster analysis and structural equation modeling provide significant insights into understanding university students’ artificial intelligence literacy, lifelong learning tendencies, and fear of innovation. Developing customized education and support programs tailored to each profile’s characteristics and the relationships among the study variables can help students enhance their competencies in these areas.
Article
Full-text available
The development of technology and the ease of using artificial intelligence in educational activities are things that must be adjusted to the conditions of practitioners in the field. This study aims to determine the perceptions of elementary school teachers about the use of artificial intelligence in learning. The study was conducted using a qualitative descriptive method on 75 elementary school teachers in Purworejo Regency. Data collection was carried out using a closed questionnaire and Focus Group Discussion (FGD). Data analysis used a descriptive quantitative approach. The results of the findings showed that the highest factor was control beliefs, namely the aspect of teacher self-efficacy towards the use of AI, but teachers were also aware of the lack of digital competence they had. The six aspects that are indicators of the three TPB factors are at high values so that it is known that there is a positive intention of teachers regarding the use of AI in learning. However, it is also known that there is a contradiction, namely the high belief of teachers in the use of AI but the existence of digital competence, especially in the use of AI that has not been maximized. The aspect of basic knowledge that represents behavioural beliefs needs more intensive attention from related parties and further researchers.
Chapter
At its core, AI in education aims to personalize learning, streamline administrative tasks, and foster more efficient, engaging educational interactions. Technology's ability to process vast amounts of data, recognize patterns, and generate insights can significantly improve both student outcomes and teacher effectiveness. By analyzing students' interactions, progress, and assessments, AI can identify strengths and weaknesses, adapting lessons and resources to better suit each learner. For instance, intelligent tutoring systems use algorithms to provide customized feedback and support, enhancing students' grasp of subjects and addressing gaps in their understanding more effectively than generic instruction.AI also contributes significantly to automating administrative tasks, which can alleviate some of the burdens on educators. Furthermore, AI fosters greater engagement and interactivity in the classroom. Educational tools powered by AI, such as virtual assistants and chatbots immediate help and resources to students, facilitating a more interactive learning experience.
Chapter
This chapter explores the impact of Artificial Intelligence (AI) on modern education, focusing on its potential to enable personalized learning. It offers educators practical strategies to use AI for tailoring instruction to diverse needs. The chapter examines AI's role in second language acquisition, where real-time feedback and adaptive exercises enhance engagement. It also discusses AI's role in advancing Universal Design for Learning (UDL) and supporting Individualized Education Programs (IEPs), making education more accessible for students with disabilities. Additionally, the chapter highlights how generative AI fosters creativity and critical thinking in writing, offering new ways for students to express ideas. AI encourages collaboration through peer feedback, while also sparking ethical discussions about authorship and the role of technology in creative processes. The chapter concludes by emphasizing the significant shifts AI is driving in educational practices, underscoring its potential to reshape the future of learning.
Chapter
Innovative solutions to improve learning experiences, simplify administrative operations, and fulfill skill development needs are being offered by artificial intelligence (AI), which is changing the training and education scene. This chapter delves into the various ways artificial intelligence (AI) is revolutionizing education. It discusses how AI-powered adaptive learning systems, virtual tutors, and gamification are making education more personalized, accessible, and engaging. Additionally, it emphasizes how AI is being used for workforce development, immersive simulations, and corporate training. Data privacy, prejudice, and the digital divide are some of the obstacles that need to be overcome in order for AI-driven education to be implemented in an ethical and inclusive manner, despite the fact that it offers great potential. This chapter offers a thorough framework for comprehending the revolutionary power of AI to alter training and education for varied learners and sectors by investigating present uses, ethical concerns, and forthcoming trends.
Article
Full-text available
The rapid advancement of technology, particularly artificial intelligence (AI), has profoundly transformed the landscape of education, prompting vital questions regarding the role of human educators in the teaching and learning process. As educational institutions increasingly integrate AI-driven tools, the challenge of incorporating moral and ethical values within the framework of Islamic education becomes increasingly pressing in this digital age. This study aims to explore the intricate relationship between humans as rational beings and the influence of AI in educational practices, with a particular emphasis on Islamic perspectives. Utilizing a qualitative research method, the research employs a literature review approach to analyze a variety of relevant scholarly sources. The findings reveal that while AI has the potential to significantly enhance learning efficiency through personalized learning experiences and data-driven insights, the indispensable role of human educators persists in guiding students' character formation and moral development. Furthermore, effective education extends beyond mere knowledge transfer; it encompasses the nurturing of values and ethics that prepare students for responsible citizenship. Ultimately, these findings offer new insights into how the collaboration between human educators and AI technology can foster a more enriching educational environment aligned with the principles of Islamic education, ensuring that moral and ethical considerations remain central to the learning experience.
Article
Full-text available
The rapid development of facial recognition technologies (FRT) has led to complex ethical choices in terms of balancing individual privacy rights versus delivering societal safety. Within this space, increasingly commonplace use of these technologies by law enforcement agencies has presented a particular lens for probing this complex landscape, its application, and the acceptable extent of citizen surveillance. This analysis focuses on the regulatory contexts and recent case law in the United States (USA), United Kingdom (UK), and European Union (EU) in terms of the use and misuse of FRT by law enforcement agencies. In the case of the USA, it is one of the main global regions in which the technology is being rapidly evolved, and yet, it has a patchwork of legislation with less emphasis on data protection and privacy. Within the context of the EU and the UK, there has been a critical focus on the development of accountability requirements particularly when considered in the context of the EU’s General Data Protection Regulation (GDPR) and the legal focus on Privacy by Design (PbD). However, globally, there is no standardised human rights framework and regulatory requirements that can be easily applied to FRT rollout. This article contains a discursive discussion considering the complexity of the ethical and regulatory dimensions at play in these spaces including considering data protection and human rights frameworks. It concludes that data protection impact assessments (DPIA) and human rights impact assessments together with greater transparency, regulation, audit and explanation of FRT use, and application in individual contexts would improve FRT deployments. In addition, it sets out ten critical questions which it suggests need to be answered for the successful development and deployment of FRT and AI more broadly. It is suggested that these should be answered by lawmakers, policy makers, AI developers, and adopters.
Article
Full-text available
In the past few decades, technology has completely transformed the world around us. Indeed, experts believe that the next big digital transformation in how we live, communicate, work, trade and learn will be driven by Artificial Intelligence (AI) [83]. This paper presents a high-level industrial and academic overview of AI in Education (AIEd). It presents the focus of latest research in AIEd on reducing teachers’ workload, contextualized learning for students, revolutionizing assessments and developments in intelligent tutoring systems. It also discusses the ethical dimension of AIEd and the potential impact of the Covid-19 pandemic on the future of AIEd’s research and practice. The intended readership of this article is policy makers and institutional leaders who are looking for an introductory state of play in AIEd.
Article
Full-text available
Abstract—Contributions: The Chinese University of Hong Kong (CUHK)-Jockey Club AI for the Future Project (AI4Future) co-created the first pre-tertiary AI curriculum at the secondary school level for Hong Kong and evaluated its efficacy. This study added to the AI education community by introducing a new AI curriculum framework. The pre-posttest multi-factors evaluation about students’ perceptions of AI learning confirmed that the curriculum is effective in promoting AI learning. The teachers also confirmed the co-creation process enhanced their capacity to implement AI education. Background: AI4Future is a cross-sector project that engages five major partners – CUHK’s Faculty of Engineering and Faculty of Education, secondary schools, Hong Kong government and AI industry. A team of 14 professors collaborated with 17 principals and teachers from 6 secondary schools to co-create the curriculum. Research Questions: Would the curriculum significantly improve the student perceived competence, attitude and motivation toward AI learning? How does the co-creation process benefit the implementation of curriculum? Methodology: The participants were 335 students and 8 teachers from the secondary schools. This study adopted a mix-method with quantitative data measures at pre- and post- questionnaires and qualitative data emphasizes teachers’ perspectives on the co-creation process. Paired t-tests and ANCOVAs, and thematic analysis were used to analyze the data. Findings: 1) students perceived greater competence, and developed more positive attitude to learn AI, and 2) the co-creation process enhanced teachers’ knowledge in AI, as well as fostered teachers’ autonomy in bringing the subject matter into their classrooms.
Article
Full-text available
Social media use has spiked around the world during the COVID‐19 global pandemic as people reach out for news, information, social connections, and support in their daily lives. Past work on professional learning networks (PLNs) has shown that teachers also use social media to find supports for their teaching and ongoing professional development. This paper offers quantitative analysis of over a half million Twitter #Edchat tweets as well as qualitative content analysis of teachers’ question tweets (n = 1054) and teacher interviews (n = 4). These data and analyses provide evidence of the kinds of supports that teachers in the United States and Canada sought on social media during the rapid transition to emergency remote teaching in Spring 2020 and how these supports informed teaching practices. These results provide insights into PLN theory and teachers’ social media use during times of disruption and crisis. Practitioner notes What is already known about this topic Prior to the spring 2020 pandemic, teachers turned to social media to find supports for teaching and just‐in‐time professional development (PD). #Edchat, one of the oldest and most used educational hashtags on Twitter, supports education‐related conversations, frequently self‐promotional rather than collaborative. The COVID‐19 pandemic disrupted educational systems globally and created new demands on teacher PD during transitions to emergency remote teaching and learning. What this paper adds Teachers’ professional learning networks (PLN) on social media can be flexible around contextual circumstances and users’ needs. #Edchat discourse can move beyond self‐promotion to inquiry with benefits for professional learning. Education‐related response networks on social media are useful to teachers in emergency situations (and beyond them) where just‐in‐time professional learning needs and questions surpass local PD capacity. Implications for practice and/or policy Teachers should increase capacities inquiring discourses on Twitter. Education stakeholders should increase support for teachers’ agency and advocate for broader conceptions and approaches to PD that incorporate PLNs spanning social media.
Article
Background and Context The increasingly widespread use of social media to expand one's social connections is a relatively new but important phenomenon that has implications for teaching, learning, and teachers’ professional knowledge and development in the 21st century. Educational research in this area is expanding, but further investigation is necessary to better determine how to best support teachers in their professional development, collaboration, and classroom teaching. Prior literature reviews have focused extensively on higher education settings or particular platforms or platform types (e.g., Facebook, microblogging). This article provides needed insights into K–12 settings and encompasses work from a variety of social media types. We describe a systematic review of more than a decade of educational research from various countries to present the state of the field in K–12 teachers’ use of social media for teaching and professional learning across various platforms. Research Questions To define social media's potentially beneficial roles in teaching and learning, we must first take an in-depth look at teachers’ current social media practices. Toward this end, we approached our review with the following research question: How are social media perceived and used by K–12 teachers for their teaching or professional learning, and with what impacts on teachers’ practices? Research Design Guided by Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) established standards for rigor and quality in systematic literature reviews, this article reviews empirical research to examine how social media are perceived and used by K–12 teachers with what impacts on teachers’ practices. Findings We find that social media features offer several benefits for helping teachers fulfill their goals for classroom teaching, including enhancing student engagement, community connections, and teacher–student interactions, but these affordances come with challenges that must be navigated. The literature also suggests that social media features provide benefits for teachers’ professional learning within both formal professional development programs and informal learning networks. Conclusions Implications of this literature review for future research and the design of educational practices are discussed in the final section. Among our conclusions are calls for more data triangulation between teachers’ and students’ learning and experiences on social media, more attention to teachers’ observational behaviors on social media, and further exploration of how social media facilitates interplay between teachers’ formal and informal learning.
Article
By which 'critical' means an intellectual stance of skepticism, centering the consequences, limitations, and unjust impacts of computing in society.
Article
Artificial Intelligence (AI) is reshaping the world in profound ways; some of its impacts are certainly beneficial but widespread and lasting harms can result from the technology as well. The integration of AI into various aspects of human life is underway, and the complex ethical concerns emerging from the design, deployment, and use of the technology serves as a reminder that it is time to revisit what future developers and designers, along with professionals, are learning when it comes to AI. It is of paramount importance to train future members of the AI community, and other stakeholders as well, to reflect on the ways in which AI might impact people’s lives and to embrace their responsibilities to enhance its benefits while mitigating its potential harms. This could occur in part through the fuller and more systematic inclusion of AI ethics into the curriculum. In this paper, we briefly describe different approaches to AI ethics and offer a set of recommendations related to AI ethics pedagogy.