ArticlePDF Available

Can Generative Artificial Intelligence Write an Academic Journal Article? Opportunities, Challenges, and Implications

Authors:

Abstract

This article offers an in-depth reflection on the author’s experiences with Generative Artificial Intelligence (Gen AI), ChatGPT 4.0. The author started the journey from their initial need for software for English proofreading and editing services to their interest in exploring pre-service teachers’ application of Gen AI in lesson planning. Based on prompt engineering techniques, an iterative three-stage manuscript generation process—brainstorming, refinement, and writing—with ChatGPT is detailed. A short paper generated by ChatGPT is presented. Although Gen AI is a valuable tool in providing insights and assistance in research idea generation and design, academic writing, and English writing learning, the author cautions that critical thinking plays a vital role in ensuring accuracy, ethical considerations, and the preservation of rigorous scholarly standards. As Gen AI emerges as a game-changer in academia and education, this article highlights the importance of balancing its emerging capabilities with maintaining traditional academic and educational values.
Irish Journal of Technology Enhanced Learning
Vol 7, Issue 2
Special Issue: The Games People Play: Exploring Technology Enhanced
Learning Scholarship & Generative Artificial Intelligence
The Irish Journal of Technology Enhanced Learning Ireland is the journal of the Irish Learning Technology
Association, an Irish-based professional and scholarly society and membership organization. (CRO# 520231)
http://www.ilta.ie/ . This is an Open Access article distributed under the terms of the Creative Commons
Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0).
Can Generative Artificial Intelligence Write an
Academic Journal Article? Opportunities,
Challenges, and Implications
Hsiao-Ping Hsu *
Dublin City University
Abstract
This article offers an in-depth reflection on the author’s experiences with Generative
Artificial Intelligence (Gen AI), ChatGPT 4.0. The author started the journey from their
initial need for software for English proofreading and editing services to their interest in
exploring pre-service teachers’ application of Gen AI in lesson planning. Based on prompt
engineering techniques, an iterative three-stage manuscript generation process
brainstorming, refinement, and writingwith ChatGPT is detailed. A short paper generated
by ChatGPT is presented. Although Gen AI is a valuable tool in providing insights and
assistance in research idea generation and design, academic writing, and English writing
learning, the author cautions that critical thinking plays a vital role in ensuring accuracy,
ethical considerations, and the preservation of rigorous scholarly standards. As Gen AI
emerges as a game-changer in academia and education, this article highlights the importance
of balancing its emerging capabilities with maintaining traditional academic and educational
values.
1. Introduction
I connected with Gen AI because of my constant need for English proofreading and editing.
After exploring ChatGPT 3.5, I was impressed with its proficiency in proofreading and
editing English text. As an academic for whom English is a second language, I often rely on
English proofreading and editing software, such as Grammarly, particularly for frequent
email communication. Before discovering ChatGPT, I had to spend significant time drafting,
refining, and revising emails to maintain professionalism, even with the help of Grammarly.
With the help of ChatGPT, it requires less effort to efficiently craft emails that do not contain
personal or sensitive information, although minor grammatical and readability issues may
persist.
Additionally, thanks to its conversational user interface, ChatGPT feels like a private tutor
with whom I can converse and ask further questions to learn vocabulary and phrasing to
enhance my English writing. This is in line with the suggested learning strategy by Shemesh
(2023). Building upon this foundation, my exploration of ChatGPT’s potential has expanded
* Corresponding author: hsiao-ping.hsu@dcu.ie
Irish Journal of Technology Enhanced Learning
159
into teacher education. To outline the structure of this article, I will first describe the topic I
utilised ChatGPT to develop a manuscript and the strategies I employed in prompting it.
Subsequently, I will present the short report generated by ChatGPT, followed by a critical
reflection on the process and its educational implications.
1.1 The Short Report Topic
The research topic I asked ChatGPT to generate concerns the investigation of pre-service
primary teachers’ perceptions of Gen AI in lesson planning, taking the impacts of gender,
academic level and daily use of Gen AI into account. The rationale for choosing this topic
stems directly from my professional placement supervision in the Bachelor of Education
programme. One of the recurring challenges they expressed during post-observation
discussions is the creation of lesson plans, especially within tight timeframes and in fast-
paced school environments. A lesson plan is essential for teachers to prepare, organise, and
conduct lessons, and also serves as a means of evaluating a teacher’s instructional skills (Liu
& Zou, 2014). Drafting lesson plans is a standard requirement in teacher education
programmes. However, constructing lesson plans is often seen as challenging and time-
intensive (Alanazi, 2019; Colaco & Antao, 2023). Although some studies have emphasised
the efficacy of technology-integrated approaches in assisting student teachers with lesson
planning, like Google Docs (Colaco & Antao, 2023) and mobile learning applications
(Susantini et al., 2022), there is also a proposal to use Gen AI for lesson planning (Bonner et
al., 2023). However, pre-service teachers’ practical use of Gen AI still awaits more empirical
research. Thus, I applied ChatGPT to bridge the gap because of my familiarity with it.
1.2 Prompting Strategy
ChatGPT 4.0 Plus (Open AI, 2023), the September 25 version, was utilised for generating the
short paper and proofreading this manuscript’s abstract, introduction, and critical reflection
sections. This paid version requires a monthly subscription of $20. The short paper
generation encompassed three stages: brainstorming, refinement, and writing. All prompts are
shown in the table 1. The techniques of prompt engineering were employed to ensure
accurate and logically consistent responses (Ali et al., 2023; Bozkurt & Sharma, 2023; L. S.
Lo, 2023). The prompt engineering technique refers to the three fundamental components:
content knowledge, critical thinking, and iterative design (Cain, 2023). The content
knowledge involved my expertise and experience in teacher education, quantitative research
methods and academic writing. Critical thinking skills were applied to evaluate the responses
generated by ChatGPT critically. Additionally, the short paper generation process features an
iterative design, meaning that its three stages are not linear but rather iterative. For example, I
realised the literature review section lacked an introduction paragraph while writing. To
address this, I turned to ChatGPT for suggestions during the brainstorming stage and asked it
to refine a few sentences during the refinement stage.
160
Table 1: Prompt and explanation
Stage
Prompt
Brainstorming
establish outline
You are a professor with great expertise in qualitative,
quantitative and mixed-method research design and the
application AI in education.
I want to conduct a mixed-method study to investigate pre-
service primary teachers’ perceptions of using Gen AI for lesson
planning, referring to their gender, levels in the teacher
education. programme and daily use of Gen AI for personal and
professional purposes.
Could you suggest a theoretical framework for my research?
Thank you. I like to use the technology acceptance model
(TAM) as the primary theoretical framework of this study.
Sorry, I think you have forgotten my original focus on the
impacts of primary teachers’ gender, levels in the teacher
education programme and daily use of Gen AI on their
perceptions of using Gen AI for lesson planning.
Refinement
specify details
Could you be more specific about the Quantitative Analysis?
I like to you to regenerate a response after taking the variable of
actual system from the theoretical framework.
Could you suggest a questionnaire that measures pre-service
primary teachers perceptions of using Gen AI for lesson
planning?
Could you generate five semi-structured questions for focus
group interview?
I like you to rework section 3 by producing more choices and
then dividing the generated choices into personal and
professional/pedagogical categories.
Id love you to rework the Professional/Pedagogical Use area by
taking the possibility that pre-service teachers might have used
Gen AI to do college works (e.g., writing a reading reflection).
I need a question that asks student teachers pre-existing use of
Gen AI for lesson planning.
Writing
generate the
exact short
report
Based on what we have discussed so far, could you write a 400-
word introduction for my research question.
Could you provide references and reference list to back up the
introduction?
Could you write an 800-word literature review with references
and a reference list?
I do not need the section on Methodological Considerations in
AI Education Research. Instead, I hope you replace this section
with a review of the teachers’ application of Gen AI for lesson
planning.
Thank you for your work. I like you to rework the literature
review by including the following four sections: Gen AI in
Education, Pre-service Teachers and Technological Adoption,
the impacts of gender, academic level, and daily technology use
Irish Journal of Technology Enhanced Learning
161
on teachers’ perceptions of using emerging technologies for
lesson planning.
Could you write a 500-word methodology section for this study?
Table 1: Prompt and explanation (continued)
Stage
Prompt
Writing
generate the
exact short
report
Please be more specific within the word limit, by considering the
following settings: (1) A four-year primary teacher education
programme with a total of 1,600 students. Each year has 400
students. 40 students are male while the rest of the 360 students
are female; (2) the theoretical framework is TAM; (3) The
questionnaire should be done in 10 minutes; (4) The focus group
interview should be done in 20 minutes.
Could you provide reference and reference list to back the
methodology section?
Could write an 800-word section for expected findings and
related discussions?
I think the response has forgotten my interest in relation to the
impacts of the level in the teacher education programme and pre-
service teachers’ personal and professional/pedagogical uses on
their perceptions of using AI for session planning.
I am not very happy with the generated response for the section
on expected findings and related discussion. Let’s restart again.
2. AI Generated Short Report
This section reports on early-stage research pending approval of research ethics and
subsequent data collection. The paper’s title is ‘Gender and Academic Level as Moderators:
Pre-service Primary Teachers’ Perceptions of Generative Artificial Intelligence in Lesson
Planning and its Mediation by Personal and Professional Use.’ Please refer to the other file to
access the short report generated by ChatGPT.
2.1 Introduction
The incorporation of Generative Artificial Intelligence (Gen AI) into educational contexts,
notably within pre-service primary teacher education and lesson planning, presents a complex
and multifaceted exploration. This study tentatively seeks to explore and unpack these
complexities, encapsulated in the research question: To what extent, if any, do gender and
academic level moderate the relationship between pre-service primary teachers’ perceptions
of Gen AI and its potential application in lesson planning, and is this relationship mediated
by their personal and professional use of Gen AI?
Lesson planning is commonly recognised as a critical component of effective teaching,
intertwining content knowledge, pedagogical skill, and innovative strategies, often posing
162
challenges to pre-service teachers (Koehler & Mishra, 2009). Gen AI, with its potential to
autonomously create content, may offer support to navigate these challenges, although it is
essential to acknowledge that the adoption and application of such technology is potentially
influenced by various psychological, socio-demographic, and pedagogical variables.
Gender and academic level have been suggested to influence technological engagement and
application among pre-service teachers. For instance, possible differences in approaches and
attitudes towards technology between male and female pre-service teachers have been noted
in some contexts (Vekiri, 2010). Similarly, academic levels might influence technological
self-efficacy and consequently, interactions and acceptance of emerging technologies within
educational settings (Tondeur et al., 2016).
As pre-service primary teachers traverse their formative educational journey, interactions and
engagement with technology potentially shape their future pedagogical beliefs and practices
(Tondeur et al., 2012). Therefore, examining their perceptions and applications of Gen AI
may offer insights into their current academic and technological experiences and potentially,
into future technology-enriched educational environments (Teo, 2009). Gaining insights into
the factors that influence these perceptions and applications may be crucial for supporting
their development within technological and pedagogical domains.
Informed by the Technology Acceptance Model (TAM), this study cautiously approaches the
understanding that perceived usefulness and ease of use are significant factors in technology
adoption (Davis, 1989). It aims to gently probe the relationship between the acceptance of
Gen AI and its application in lesson planning amidst the challenges often faced by pre-
service teachers, with a mindful consideration of the mediating and moderating effects of
personal/professional use, gender, and academic level.
Given this, the research seeks to explore: To what extent, if any, do gender and academic
level moderate the relationship between pre-service primary teachers’ perceptions of Gen AI
and its application in lesson planning, mediated by their personal and professional use of Gen
AI? The intention here is not only to explore these dynamics but to contribute to the ongoing
conversations about pre-service teacher preparedness and practices in applying Gen AI in
lesson planning, offering insights into their practices, beliefs, and future professional
contexts.
2.2 Literature Review
In the evolving educational landscape, understanding the technological behaviours of pre-
service teachers is becoming increasingly vital. This literature review delves into several
interconnected areas. We begin by examining gender and academic progression, investigating
how they might influence technology adoption patterns among student teachers. Following
this, the Technology Acceptance Model (TAM) is introduced, a renowned framework that
provides insights into the factors driving technology acceptance. From there, we navigate to
the realm of Gen AI, probing its application in both the personal and professional spheres of
pre-service teachers’ lives. Concluding the review, we contemplate the potential of Gen AI as
a tool to assist these educators in lesson planning. Through this exploration, the intention is to
elucidate the nuanced relationships pre-service teachers have with technology, with a
particular emphasis on Gen AI.
Irish Journal of Technology Enhanced Learning
163
2.2.1 Pre-service Teachers: Unraveling Gender and Academic Level in Technological
Adoption
Engaging with literature around pre-service teachers’ adoption of technology, a subtle
narrative regarding gender and academic level begins to surface. Previous explorations, such
as that by Vekiri (2010), slightly pull back the veil on gender disparities, revealing the
possible divergent trajectories in both attitudes and self-efficacy towards Information and
Communication Technology (ICT) among male and female pre-service teachers. Similarly,
as pre-service teachers traverse through academic levels, their technological interactions
might witness variations, suggesting that their year of study might potentially influence their
perceptions and uses of technology in educational contexts (Tondeur et al., 2016).
Nevertheless, these investigations only partially illuminate the broader tableau, indicating a
necessity for a deeper, nuanced exploration that accounts for these variables in the context of
Gen AI.
2.2.2 Anchoring Explorations in the Technology Acceptance Model (TAM)
Navigating the ocean of technological adoption research, the Technology Acceptance Model
(TAM) often serves as a vessel for researchers, exploring user experiences and engagements
with technology. Fundamental to TAM is the assertion that perceived usefulness and
perceived ease of use stand as central pillars influencing technology acceptance and usage
(Davis, 1989). However, applying TAM to pre-service teachers extends beyond mere
application, invoking questions about how these foundational principles might intertwine
with pre-service teachers’ experiences, motivations, and challenges in their technological and
pedagogical journeys (Teo, 2009). The potential symbiosis between perceived utility, ease of
use, and individual variables like gender and academic level opens avenues for meticulous
exploration.
2.2.3 Gen AI in Dualistic Contexts: Personal and Professional Spheres
The landscape of Gen AI use, especially within pre-service teachers’ experiences, extends
across two realms: personal and professional. It’s implied that their engagements with Gen
AI could be shaped by an amalgamation of intrinsic and extrinsic motivations (Wang et al.,
2020), which could be distinctly different in personal versus professional contexts. Their
personal use might be guided more by intrinsic motivations and interests, while professional
usage could be tethered more to perceived utility and extrinsic motivations, like curriculum
demands and pedagogical efficacy. Yet, this dichotomy is speculative at best and demands a
more deliberate investigation into its reality and repercussions in the context of lesson
planning.
2.2.4 Gen AI: A Tentative Bridge in Lesson Planning for Pre-service Teachers
Pre-service teachers, often navigating the tempestuous seas of lesson planning, might find an
ally in Gen AI. The potential of Gen AI in mitigating challenges inherent in lesson planning
is not fully unveiled, yet it is tempting to envisage its capacity to bridge gaps between
theoretical knowledge and practical application (Zawacki-Richter et al., 2019). While the
hypothetical benefits, such as automated content generation, personalised resource
suggestion, and augmented content creation, are attractive, the actual perceptual and practical
164
dynamics among pre-service teachers remain in shadows. The complexity of their
psychological, pedagogical, and technological interactions with Gen AI, especially in the
context of their gender and academic progression, requires a more profound exploration,
deeply embedded in their lived experiences and perceptions.
In wrapping up this literature review, it’s evident that the intersection of technology and
pedagogy, particularly with the advent of Gen AI, is reshaping educational paradigms. Our
exploration underscores the nuances that gender and academic stages introduce to the
technology adoption patterns among pre-service teachers. The insights offered by the
Technology Acceptance Model (TAM) further contextualise these patterns, offering a
framework for understanding their technological inclinations. Gen AI stands out with its
potential in both personal and professional contexts, notably in the realm of lesson planning.
However, there’s a clear gap in fully comprehending its implications and applications. Future
research must delve deeper, ensuring that our understanding evolves in tandem with the
technological advancements, aligning them with the broader educational goals.
2.3 Methodology
2.3.1 Research Design
This study utilises a mixed-methods approach, employing a sequential explanatory design, to
meticulously investigate pre-service primary teachers’ perceptions and applications of Gen
AI in lesson planning. With the Technology Acceptance Model (TAM) as the theoretical
framework, perceived usefulness and perceived ease of use are pivotal variables.
2.3.2 Participants
Participants are pre-service teachers from a four-year primary teacher education programme
with 1,600 students (40 males and 360 females per year). Quantitative phase participants will
be stratified randomly selected, ensuring representative sampling across all academic years
and genders (n=200). For the qualitative phase, 20 participants will be purposively selected
based on their questionnaire responses to ensure diverse insights.
2.3.3 Instruments
2.3.3.1 Questionnaire. A 10-minute online questionnaire will collect data on
demographics, perceptions, and use of Gen AI, informed by TAM’s constructs. It
includes sections on perceived ease of use, perceived usefulness, and behavioural
intention to use Gen AI, measured through Likert-scale items, and sections querying
the frequency and type of Gen AI use. Reliability and validity will be established via
a pilot test and expert review.
2.3.3.2 Focus Group. Subsequent 20-minute focus group discussions will explore
deeper insights into participants’ perceptions and experiences, employing semi-
structured questions derived from quantitative results and the TAM framework,
focusing on practical and perceptual aspects of Gen AI use in lesson planning.
Irish Journal of Technology Enhanced Learning
165
2.3.4 Data Collection
2.3.4.1 Quantitative Phase. A stratified random sample of students will be invited via
email to participate in the online questionnaire, ensuring ethical adherence through
informed consent and maintaining anonymity.
2.3.4.2 Qualitative Phase. Participants for focus groups will be selected based on
interesting or divergent questionnaire responses to ensure varied perspectives. The
discussions will be conducted virtually, recorded, and transcribed, respecting ethical
protocols, and participants’ consent and confidentiality.
2.3.5 Data Analysis
2.3.5.1 Quantitative Analysis. For this research, we will conduct both mediation and
moderation analyses to discern the intricacies of the relationships among the
variables. Mediation analysis will delve into the mechanism of how pre-service
primary teachers’ perceptions of Gen AI (Independent Variable) influence its
application in lesson planning (Dependent Variable). We hypothesise that this
relationship is mediated by their personal and professional use of Gen AI (Mediator
Variable). Moderation analysis will scrutinise how gender and academic level
(Moderator Variable) influence the strength or direction of the relationship between
pre-service teachers’ perceptions (Independent Variable) and the application of Gen
AI (Dependent Variable). In a nuanced moderated mediation analysis, we’ll
investigate if the mediating effect of personal and professional use of Gen AI differs
across gender or academic levels. The hypotheses will test if, for instance, the
mediation effect is more pronounced for final-year students compared to first-year
students or differs between male and female pre-service teachers. Prior to in-depth
analyses, assumptions for mediation and moderation, such as linearity and absence of
multicollinearity, will be tested to ensure the robustness of the findings.
2.3.5.2 Qualitative Analysis. Data from focus group discussions will undergo
inductive thematic analysis, focusing on identifying themes that elucidate the
quantitative findings, specifically around the practical and perceptual aspects of Gen
AI use and its alignment with TAM’s constructs.
2.3.5.3 Ethical Considerations. Ethical diligence will be paramount, involving
obtaining informed consent, ensuring participant anonymity, and the secure storage
and handling of data. Ethical approval will be sought from the relevant institutional
ethics review board.
2.4 Possible results and implications
This study anticipates noticeable variances in the acceptance and use of Gen AI in lesson
planning among pre-service teachers, influenced by their academic progression and gender.
Male and female pre-service teachers might display distinct patterns of Gen AI adoption. The
depth of personal use of Gen AI is predicted to correlate with its integration in professional
settings, suggesting that familiarity might bolster confidence in its pedagogical applications.
A strong intrinsic connection is expected between the perceived usefulness and ease of Gen
166
AI use and its intended implementation in lesson planning. Exploring these perceptions,
aligned with the Technology Acceptance Model (TAM), will provide insights into potential
facilitators or hindrances for its adoption. Ethical concerns and practical challenges might
arise, emphasising a tension between pragmatic AI adoption and traditional planning values.
Ultimately, this research aims to deepen understanding of Gen AI adoption among pre-
service teachers, offering valuable insights for educational stakeholders.
2.5 References
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of
information technology. MIS Quarterly, 13(3), 319-340.
Koehler, M., & Mishra, P. (2009). What is technological pedagogical content knowledge
(TPACK)? Contemporary Issues in Technology and Teacher Education, 9(1), 60-70.
Teo, T. (2009). Modelling technology acceptance in education: A study of pre-service
teachers. Computers & Education, 52(2), 302-312.
Tondeur, J., Aesaert, K., Pynoo, B., Braak, J., Fraeyman, N., & Erstad, O. (2016).
Developing a validated instrument to measure preservice teachers’ ICT competencies:
Meeting the demands of the 21st century. British Journal of Educational Technology,
48(2), 462-472.
Vekiri, I. (2010). Socioeconomic differences in elementary students’ ICT beliefs and out-of-
school experiences. Computers & Education, 54(1), 941-950.
3. Critical Reflection
3.1 Reflection on Process
The whole process took approximately twelve hours. Four challenges were identified. The
initial challenge involved consistently reminding ChatGPT of the primary research objectives
in the context of the hypothetical study. I examined the impacts of three variables on pre-
service teachers’ perceptions of using Gen AI for lesson planning: gender, academic level,
and personal and professional use of Gen AI. Essentially, the longer the conversation, the
more likely ChatGPT was to omit these three variables from earlier in the thread. The second
challenge pertained to inconsistency in ChatGPT’s responses. For instance, when ChatGPT
was requested to suggest a quantitative data analysis technique suitable for the hypothetical
study, it initially outlined relevant statistical variables based on the technology acceptance
model (Davis, 1989) and proposed five analytical steps: pre-processing, descriptive analysis,
inferential analysis, model testing, and interpretation. After I requested the removal of a
particular variable from the TAM framework, ChatGPT generated a new response. However,
the suggested analytical steps decreased from five to threeparticularly omitting the critical
Interpretation step. It is reasonable to assume that the interpretation step should have
remained after removing a single variable from the TAM statistical model. The third
challenge has been widely documented: ChatGPT may produce correct-sounding but
logically incorrect results (Dwivedi et al., 2023; National Academic Integrity Network,
2023). Finally, concerning citations and references, ChatGPT may generate a response with
Irish Journal of Technology Enhanced Learning
167
in-text citations but does not necessarily include the citations in the references. This finding is
consistent with the finding made by Walters and Wilder (2023).
In terms of ChatGPT’s strengths, it was found that ChatGPT can recommend appropriate
research questions and suggest potential research design ideas after being prompted with a
few keywords (Sallam, 2023). It also excels at recommending data analysis techniques
(Rahimi & Talebi Bezmin Abadi, 2023). In other words, using Gen AI could benefit
researchers aiming to identify a viable research question and subsequently outline a fitting
research design (Rahman et al., 2023). ChatGPT’s feature for generating lengthy content has
been articulated in enhancing academic writing efficiency and quality (Huang & Tan, 2023).
In addition to its value in supporting academic writing productivity, ChatGPT allows for two-
way communication, simulating human interaction, for English learners as noted by Imran
and Almusharraf (2023). If ChatGPT generates confusing responses, users can ask for further
clarification or a simplified version. Compared to other online proofreading and editing tools,
such as Grammarly, despite their recent integration of Gen AI, it mainly serves as a tool to
identify errors and suggest corrections through one-way communication. Therefore, it is less
likely to allow users to ask further questions.
Recognising the aforementioned strengths and challenges, the approach to writing, especially
for complex tasks like journal articles, requires a more dynamic strategy. The next time I
have the opportunity to write a journal article with the assistance of Gen AI, I will create a
guiding map listing the major and minor headings required for each chapter, enabling a
visualisation of current progress. This strategy helps clarify my progress in the dialogue with
ChatGPT by referencing these headings as I transition between the brainstorming,
refinement, and writing stages. Thus, I will be able to identify areas that require further
attention. For instance, I should have consulted ChatGPT to refine the focus group interview
questions to align with the updated questionnaire items. I failed to recognise this issue until I
was deep into writing this manuscript. This experience underscores the challenges of relying
solely on Gen AI to craft a journal article. Writing a journal article is not just about writing; it
encompasses idea generation, research design (including data collection/analysis), and
literature search. While Gen AI can assist in idea production and offer recommendations for
research design and literature review (Sallam, 2023), it ultimately falls on us, the scholars, to
critically evaluate the results generated by Gen AI, as Rahman et al. (2023) suggested.
3.2 Reflection on Implications
The adoption of Gen AI, particularly ChatGPT, in academic and educational contexts,
demonstrates a significant shift across various facets, including knowledge, scholarship,
teaching, learning, and assessment. Integrating Gen AI into academia has a great potential to
democratise knowledge and scholarship by enabling non-native English-speaking academics
to participate in scholarly discourse predominantly conducted in English. This accessibility
fosters a more inclusive academic environment but concurrently introduces challenges
concerning authorship and the authenticity of ideas (Lund et al., 2023; Morocco-Clarke et al.,
2023). Academic communities must emphasise cultivating original thought and critical
analysis, fundamental tenets of scholarly work. Discussions regarding the potential for Gen
AI to aid the education sector, including teaching, learning, and assessment, were widespread
(Barros et al., 2023; Chan & Hu, 2023; C. K. Lo, 2023). However, over-reliance on it may
hinder students’ critical thinking (Michel-Villarreal et al., 2023) and raise ethical concerns
(Elkhatat, 2023). Thankfully, in Ireland, clear guidance has been issued by the (National
168
Academic Integrity Network, 2023), though periodic reviews may be necessary to
accommodate the evolving AI landscape. This proactive approach in Ireland reflects the
global academic community’s need to balance the transformative potential of Gen AI with its
inherent challenges.
Gen AI’s emergence offers benefits and challenges for scholars, especially non-native
English-speaking scholars. It significantly enhances efficiency in producing and refining
content and creating opportunities for English writing learning. While Gen AI assists in
research idea generation and design (Sallam, 2023), scholars must critically evaluate these
AI-generated outcomes, maintaining their essential role in scholarly work (Rahman et al.,
2023). Thus, the value of Gen AI in academia hinges on its utility and scholars’ critical
engagement with its responses. In conclusion, integrating Gen AI into academia and the
education sector is a double-edged sword. While it offers significant benefits regarding
efficiency and accessibility, it also challenges us to rethink and redefine the essence of
knowledge, scholarship, teaching, learning, and assessment in the Gen AI age. As we
navigate this new terrain, we must ensure that Gen AI is used responsibly, complementing
rather than supplanting the human elements of scholarship and education.
Irish Journal of Technology Enhanced Learning
169
References
Alanazi, M. H. (2019). A study of the pre-service trainee teachers problems in designing
lesson plans. Arab World English Journal, 10(1), 166-182.
https://doi.org/https://dx.doi.org/10.24093/awej/vol10no1.15
Ali, F., Choy, D., Divaharan, S., Tay, H. Y., & Chen, W. (2023). Supporting self-directed
learning and self-assessment using TeacherGAIA, a generative AI chatbot
application: Learning approaches and prompt engineering. Learning: Research and
Practice, 1-13. https://doi.org/10.1080/23735082.2023.2258886
Barros, A., Prasad, A., & Śliwa, M. (2023). Generative artificial intelligence and academia:
Implication for research, teaching and service. Management Learning, 54(5), 597-
604. https://doi.org/10.1177/13505076231201445
Bonner, E., Lege, R., & Frazier, E. (2023). Large language model-based artificial intelligence
in the language classroom: practical ideas for teaching. Teaching English with
Technology, 23(1). https://doi.org/https://doi.org/10.56297/BKAM1691/WIEO1749
Bozkurt, A., & Sharma, R. C. (2023). Generative AI and prompt engineering: The art of
whispering to let the genie out of the algorithmic world. Asian Journal of Distance
Education. https://asianjde.com/ojs/index.php/AsianJDE/article/view/749
Cain, W. (2023). Prompting change: Exploring prompt engineering in large language model
AI and its potential to transform education. TechTrends.
https://doi.org/10.1007/s11528-023-00896-0
Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: perceptions, benefits,
and challenges in higher education. International Journal of Educational Technology
in Higher Education, 20(1), 43. https://doi.org/10.1186/s41239-023-00411-8
Colaco, D. M., & Antao, D. (2023). Perception of pre-service teachers in using Google Docs
for lesson plan writing. Education and Information Technologies, 28(9), 10903-
10916. https://doi.org/10.1007/s10639-023-11626-7
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of
information technology. MIS quarterly, 319-340.
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A.
M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-
Busaidi, A. S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L.,
Buhalis,D., … Wright, R. (2023). Opinion Paper: “So what if ChatGPT wrote it?”
Multidisciplinary perspectives on opportunities, challenges and implications of
generative conversational AI for research, practice and policy. International Journal of
Information Management, 71, 102642.
https://doi.org/https://doi.org/10.1016/j.ijinfomgt.2023.102642
170
Elkhatat, A. M. (2023). Evaluating the authenticity of ChatGPT responses: A study on text-
matching capabilities. International Journal for Educational Integrity, 19(1), 15.
https://doi.org/10.1007/s40979-023-00137-0
Huang, J., & Tan, M. (2023). The role of ChatGPT in scientific communication: Writing
better scientific review articles. American Journal of Cancer Research, 13(4), 1148.
Imran, M., & Almusharraf, N. (2023). Analysing the role of ChatGPT as a writing assistant at
higher education level: A systematic review of the literature. Contemporary
Educational Technology, 15(4), ep464.
https://doi.org/https://doi.org/10.30935/cedtech/13605
Liu, S. Q., & Zou, D. D. (2014). Preliminary study on collaborative lesson planning based on
cloud platform. Applied Mechanics Materials, 548, 1433-1437.
https://doi.org/https://doi.org/10.4028/www.scientific.net/AMM.548-549.1433
Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the
literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
Lo, L. S. (2023). The CLEAR path: A framework for enhancing information literacy through
prompt engineering. The Journal of Academic Librarianship, 49(4), 102720.
https://doi.org/https://doi.org/10.1016/j.acalib.2023.102720
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023). ChatGPT
and a new academic reality: Artificial Intelligence-written research papers and the
ethics of the large language models in scholarly publishing. Journal of the Association
for Information Science and Technology, 74(5), 570-581.
https://doi.org/https://doi.org/10.1002/asi.24750
Michel-Villarreal, R., Vilalta-Perdomo, E., Salinas-Navarro, D. E., Thierry-Aguilera, R., &
Gerardou, F. S. (2023). Challenges and opportunities of Generative AI for higher
education as explained by ChatGPT. Education Sciences, 13(9), 856.
https://doi.org/https://doi.org/10.3390/educsci13090856
Morocco-Clarke, A., Sodangi, F. A., & Momodu, F. (2023). The implications and effects of
ChatGPT on academic scholarship and authorship: A death knell for original
academic publications? Information & Communications Technology Law, 1-21.
https://doi.org/10.1080/13600834.2023.2239623
National Academic Integrity Network. (2023). NAIN Generative AI Guidelines for
Educators. https://www.qqi.ie/news/nain-publishes-new-genai-guidelines-for-
educators
OpenAI. (2023). ChatGPT (September 25 version) [Large language model].
Rahimi, F., & Talebi Bezmin Abadi, A. (2023). ChatGPT and publication ethics. Archives of
Medical Research, 54(3), 272-274.
https://doi.org/https://doi.org/10.1016/j.arcmed.2023.03.004
Irish Journal of Technology Enhanced Learning
171
Rahman, M. M., Terano, H. J., Rahman, M. N., Salamzadeh, A., & Rahaman, M. S. (2023).
ChatGPT and academic research: A review and recommendations based on practical
examples. Journal of Education, Management Development Studies, 3(1), 1-12.
Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice:
Systematic review on the promising perspectives and valid concerns. Healthcare,
11(6), 887. https://doi.org/https://doi.org/10.3390/healthcare11060887
Shemesh, H. (2023, January 24). The ultimate guide for using ChatGPT for English learning.
Hadar Shemesh. https://hadarshemesh.com/magazine/chatgpt-for-learning-english
Susantini, E., Isnawati, & Raharjo. (2022). HOTS-Link mobile learning application: Enabling
biology pre-service teachers to devise HOTS-based lesson plans. Journal of Science
Education and Technology, 31(6), 783-794. https://doi.org/10.1007/s10956-022-
09993-w
Walters, W. H., & Wilder, E. I. (2023). Fabrication and errors in the bibliographic citations
generated by ChatGPT. Scientific Reports, 13(1), 14045.
https://doi.org/10.1038/s41598-023-41032-5
... It can be used for a variety of natural language processing tasks, including answering questions, generating creative content, assisting with language-based tasks, and engaging in interactive conversations with users" (output of query "What is ChatGPT?", on 11-11-2023). A few studies indicated that ChatGPT has been used as a research assistant tool to support creation and generation of ideas and content [29][30][31], rephrase paragraphs and find references [32], and assist in qualitative research [33] or technological research [34]. In parallel to the benefits/strengths reported, all studies mentioned the need for its ethical, cautious, and responsible use. ...
... In parallel to the benefits/strengths reported, all studies mentioned the need for its ethical, cautious, and responsible use. Indicatively, Hsu [29] used ChatGPT as assistance in research idea generation and design. He reported on its usefulness in the research process, by also highlighting the role of critical thinking for the evaluation of the output produced by ChatGPT. ...
Article
Full-text available
There is a growing interest in using generative artificial intelligence (AI) for educational purposes within the higher education environments, while AI applications (such as ChatGPT) can transform traditional teaching and learning methods. ChatGPT is an advanced AI tool that generates new content and human-like responses. The purpose of this paper is to use ChatGPT as a research assistant in order to explore ways AI can be harnessed to enhance pedagogical practices in higher education. This is a qualitative study, in which the output-responses generated by ChatGPT provided a starting point for the investigation. AI can be harnessed to enhance pedagogical practices in higher education in various ways including personalized learning, automated assessment and feedback generation, virtual assistants and chatbots, content creation, resource recommendation, time management, language translation and support, research assistance, simulations and virtual labs. Other educational affordances that can strengthen the teaching and learning experience regard collaboration and communication, accessibility and inclusivity, as well as AI literacy. When implementing AI tools such as ChatGPT in higher education, ethical considerations (e.g., data privacy, transparency, accessibility, cultural sensitivity), potential misuses and concerns need to also be addressed. Although ChatGPT can aid the generation of content-ideas for further exploration, it is a complementary-supportive tool, and its output necessitates human evaluation and review. The integration of ChatGPT and other AI tools in the higher educational process/practices has implications for educators, students, design of curricula, and university policy makers.
... Generative Artificial Intelligence (AI) has dramatically transformed academic writing [1][2][3][4]. While discussions about academic integrity, ethics, and other crucial aspects are ongoing, many of our colleagues are already incorporating AI into their daily work. ...
Conference Paper
This paper demonstrates the practical use of AI in academic writing, utilizing OpenAI's GPT-4 to generate and refine content through a collaborative dialogue between the researcher and the AI. Our approach adapts the Fiction for Specific Purposes (FSP) approach, typically used to conduct thought-experiments and speculate within STEM, as a vehicle for introducing a couple of controversial theories. The resulting study (a story inside a story) explores AI as an evolutionary life form, using the context of the controversial Gaia Hypothesis, John C. Lilly's Solid State Entity concept, and 20th-century artistic visions to propose a holistic and ethical AI development framework. Our example, the short paper inside our main paper, highlights AI's potential to improve environmental monitoring, resource management, and ecological balance, as well as its role in interstellar colonization, emphasizing the need for robust ethical frameworks to ensure AI systems are sustainable and respectful of life's interconnectedness. This collaboratively developed short paper exemplifies AI's ability to enrich scholarly work and provide personalized assistance. However, we suggest that despite integration of AI into academic writing could enhance human capabilities and aid individuals with disabilities, a critical evaluation of developed ideas by researchers is needed, as AI itself is not limited by the ethics of academic research.
... The incorporation of artificial intelligence (AI) into systems such as Google Scholar and Semantic Scholar has fundamentally transformed the manner in which academics get and engage with scholarly literature (Hsu, 2023). These platforms, through the use of AI and machine learning, have the capability to offer scholars scientific literature that is both more pertinent and easily accessible. ...
Article
The purpose of this paper is to determine the importance of artificial intelligence (AI) on academic platforms by utilizing a multi-criteria determination method. The aim is to enhance our understanding of how incorporating AI can enhance the efficacy and effectiveness of the study process. The study employs the Simplified PIPRECIA (Pivot Pairwise Relative Criteria Importance Assessment) method to assess the significance of various factors and characteristics when choosing an academic platform. Five decision-makers conducted a comprehensive literature review to evaluate a list of elements and characteristics of three platforms. The paper begins with an overview of the theoretical foundation and methodology, then presents the research findings and discusses their implications. The results corroborate the relevance of multi-criteria decision-making methods (MCDM) in this context, providing authoritative insights and demonstrating their advantages. The conclusion emphasizes the potential application of these results to make informed choices about academic platform selection, ultimately contributing to improved learning outcomes and research efficiency.
... From the selected studies on the impact of GenAI on the critical thinking skills of undergraduates, approximately five studies (Berg & Plessis, 2023;Javaid et al., 2023;Farrokhnia et al., 2023;Lu et al., 2024;and Hsiao-Ping Hsu, 2023) focused on the field of education. Additionally, four studies (Jia & Tu, 2024;Shanto et al., 2024;Zaphir et al., 2024;and Fiialka et al., 2023) included undergraduates from various disciplines. ...
Conference Paper
Full-text available
Despite widespread acknowledgement of the significance of critical thinking skills for success in today's job market, higher education institutions face challenges in effectively nurturing these skills in students. Educational policies, reports, and employer demands emphasise the importance of critical thinking, yet a gap remains between its recognised value and the actual proficiency levels among university students. This study employs a systematic literature review approach to address a research question, "What is the impact of Generative AI on the critical thinking skills of undergraduates?" About half of the thirty selected papers suggest that Generative AI benefits undergraduate critical thinking, but limitations in study design prevent generalisation. Other inconclusive studies highlight the need for further research to address research gaps.
... On the other hand, GenAI has spurred countless discussions concerning its ethical use amongst students, particularly in completing assignments and assisting students to understand course materials (Hopfenbeck et al., 2023;Polemi et al., 2024). From the academic staff perspective, discussions have revolved around the use of GenAI in research and report writing, specifically to generate new knowledge in research (Hsu, 2023). In terms of administration, the question of trustworthiness in using GenAI for administrative tasks remains a concern (Polemi et al., 2024). ...
... bibliographic reviews in the context of medical healthcare [53]. The use of GenAI to support scientific writing is also expected to significantly support researchers whose primary language is not English [54,55,56], although authors are expected to disclose its use for transparency reasons [57]. In this reagard, its use can also prove useful to train young students and early-career reserchers in the mechanics of scientific writing (e.g., grant proposals, manuscript preparation, case study presentations, etc). ...
Preprint
Full-text available
Artificial intelligence (AI) has become a commodity for people because of the advent of generative AI (GenAI) models that bridge the usability gap of AI by providing a natural language interface to interact with complex models. These GenAI models range from text generation - such as two-way chat systems - to the generation of image or video from textual descriptions input by a user. These advancements in AI have impacted Dentistry in multiple aspects. In dental education, the student now has the opportunity to solve a plethora of questions by only prompting a GenAI model and have the answer in a matter of seconds. GenAI models can help us deliver better patient healthcare by helping practitioners gather knowledge quickly and efficiently. Finally, GenAI can also be used in dental research, where the applications range from new drug discovery to assistance in academic writing. In this review, we first define GenAI models and describe their multiple generation modalities; then, we explain and discuss their current and potential applications in Dentistry; and finally, we describe the challenges these new technologies impose in our area.
... The approach used was of qualitative type, with queries submitted to ChatGPT. ChatGPT is an advanced Artificial Intelligence chatbot (launched in November 2022), and some studies indicated that it has been used as an aid to support creation-generation of content (Iskender, 2023;Zhu et al., 2023;Hsu, 2023;Nikolopoulou, 2024). For example, Iskender (2023) asked questions in the field of tourism industry and education, and reported that his study originality lies in using ChatGPT as an interviewee. ...
Article
Full-text available
The integration of digital technology into daily life has significantly altered the landscape of childhood experiences, presenting both opportunities and challenges. With regard to children in the digital space, this paper aims to explore the issues that have been researched and the suggestions for future research. This exploration is done with the aid of ChatGPT, while the output generated is reviewed and evaluated by the author. Areas of research concerning children in the digital space include digital literacy, skills and cognitive development, socialization and communication, online safety and privacy, screen time, health and well-being, parental mediation, digital divide and inequalities. Issues for future research include screen time and health, online safety and privacy, digital literacy, effect of (emerging) educational technologies, parental mediation-guidance, digital inclusion-equity, and ethical considerations. Addressing these issues can contribute to a better understanding of the interplay between children and digital space, informing policies, practices, and educational interventions to support healthy, positive experiences for children in the digital space-age.
Article
Full-text available
As the initial stage of an international collaborative design-based research initiative, this study explores the applications and perceptions of generative artificial intelligence (GenAI) among Irish pre-service primary teachers. This study focuses on how personal and academic uses of GenAI influence their perceptions of using GenAI for lesson planning. With a sample of 100 student teachers completing the questionnaire, and data analysed using descriptive analysis and Pearson correlation, the findings highlight that while pre-service teachers use GenAI primarily for personal and academic purposes preliminarily, its integration into lesson planning remains limited. Crucially, the study reveals no significant correlation between personal use of GenAI and perceptions of its application in lesson planning. In contrast, academic use of GenAI is positively correlated with recognising its potential for lesson planning and the desire for professional development, while negatively correlated with perceptions of challenges and ethical concerns. The practical implications suggest that pre-service teachers who primarily use GenAI for personal purposes may require foundational training similar to those without prior GenAI experience. Student teachers with academic GenAI experience would benefit from advanced training aligned with their academic GenAI use patterns. Professional development should also address challenges and ethical concerns in integrating GenAI into education.
Article
Full-text available
The Committee on Publication Ethics (COPE) maintains that AIs (artificial intelligences) cannot be authors of academic papers, because they are unable to take responsibility for them. COPE appears to have the answerability sense of responsibility in mind. It is true that AIs cannot be answerable for papers, but responsibility in this sense is not required for authorship in the sciences. I suggest that ethics will be forced to follow suit in dropping responsibility as a criterion for authorship or rethinking its role. I put forward three options for authorship: dropping responsibility as a criterion for authorship, retaining it and excluding AIs, but at the cost of substantial revision of our practices, or requiring only local responsibility for an intellectual contribution.
Chapter
This research delves into the complex and multifaceted relationship between artificial intelligence (AI) and ethical considerations in academic research. Using literature review and interview method, it highlights the immense potential of AI to streamline research processes and warns against potential pitfalls like data privacy breaches, algorithmic biases, and loss of research autonomy. The study emphasizes the crucial role of researchers in ensuring data integrity, maintaining research reproducibility, mitigating bias, and using AI responsibly. It advocates for robust data governance, open-source practices, and interdisciplinary collaboration to navigate the ethical landscape of AI-powered research. Recognizing the limitations of its scope and the dynamic nature of AI and ethical considerations, the research calls for continuous learning, adaptation, and development of ethical frameworks to ensure the responsible and ethical integration of AI in academic endeavors.
Article
Full-text available
In this editorial, we identify some of the opportunities and the consequences of generative artificial intelligence for academia. We discuss how generative artificial intelligence will affect the three main areas of an academic’s job responsibilities: research, teaching and service. To animate our ideas, we offer illustrative examples of how generative artificial intelligence will impact each of these areas. Further recognizing that generative artificial intelligence poses both opportunities and consequences for academia from a management learning perspective, we use examples that represent a positive and a negative outcome resultant of generative artificial intelligence to each of the three areas of academic responsibility.
Article
Full-text available
Self-directed learning and self-assessment require student responsibility over learning needs, goals, processes, and outcomes. However, this student-led learning can be challenging to achieve in a classroom limited by a one-to-many teacher-led instruction. We, thus, have designed and prototyped a generative artificial intelligence chatbot application (GAIA), named TeacherGAIA, that can be used to asynchronously support students in their self-directed learning and self-assessment outside the classroom. We first identified diverse constructivist learning approaches that align with, and promote, student-led learning. These included knowledge construction, inquiry-based learning, self-assessment, and peer teaching. The in-context learning abilities of large language model (LLM) from OpenAI were then leveraged via prompt engineering to steer interactions supporting these different learning approaches. These interactions contrasted with ChatGPT, OpenAI’s chatbot which by default engaged in the traditional transmissionist mode of learning reminiscent of teacher-led instruction. Preliminary design, prompt engineering and prototyping suggested fidelity to the learning approaches, cognitive guidance, and social-emotional support, all of which were implemented in a generative AI manner without pre-specified rules or “hard-coding”. Other affordances of TeacherGAIA are discussed and future development outlined. We anticipate TeacherGAIA to be a useful application for teachers in facilitating self-directed learning and self-assessment among K-12 students.
Article
Full-text available
Although chatbots such as ChatGPT can facilitate cost-efective text generation and editing, factually incorrect responses (hallucinations) limit their utility. This study evaluates one particular type of hallucination: fabricated bibliographic citations that do not represent actual scholarly works. We used ChatGPT-3.5 and ChatGPT-4 to produce short literature reviews on 42 multidisciplinary topics, compiling data on the 636 bibliographic citations (references) found in the 84 papers. We then searched multiple databases and websites to determine the prevalence of fabricated citations, to identify errors in the citations to non-fabricated papers, and to evaluate adherence to APA citation format. Within this set of documents, 55% of the GPT-3.5 citations but just 18% of the GPT-4 citations are fabricated. Likewise, 43% of the real (non-fabricated) GPT-3.5 citations but just 24% of the real GPT-4 citations include substantive citation errors. Although GPT-4 is a major improvement over GPT3.5, problems remain.
Article
Full-text available
Academic plagiarism is a pressing concern in educational institutions. With the emergence of artificial intelligence (AI) chatbots, like ChatGPT, potential risks related to cheating and plagiarism have increased. This study aims to investigate the authenticity capabilities of ChatGPT models 3.5 and 4 in generating novel, coherent, and accurate responses that evade detection by text-matching software. The repeatability and reproducibility of both models were analyzed, showing that the generation of responses remains consistent. However, a two-sample t-test revealed insufficient evidence to support a statistically significant difference between the text-matching percentages of both models. Several strategies are proposed to address the challenges posed by AI integration in academic contexts; one probable solution is to promote self-transcendent ideals by implementing honor codes. It is also necessary to consider the restricted knowledge base of AI language models like GPT and address any inaccuracies in generated references. Additionally, designing assignments that extract data from imaged sources and integrating oral discussions into the evaluation process can mitigate the challenges posed by AI integration. However, educators should carefully consider the practical constraints and explore alternative assessment methods to prevent academic misconduct while reaping the benefits of these strategies.
Article
Full-text available
The capabilities of generative AI in education, serving as a co-creator, highlight the crucial role of prompt engineering for optimal interactions between humanity and Large Language Models (LLMs) that utilize Natural Language Processing (NLP). Generative AI's potential lies in responding to well-crafted prompts, making them essential for unleashing its capabilities in generating authentic content. To optimize this process, prompt engineers, encompassing various stakeholders in education, must grasp how language nuances impact generative AI's responses. By approaching a conversational generative AI strategically, with clear purpose, tone, role, and context, a prompt-based conversational pedagogy can be established, enabling communication and interaction that facilitate teaching and learning effectively. Such approaches are crucial for harnessing generative AI's power while ensuring meaningful and contextually relevant interactions. Keywords: prompt engineering, prompt design for AI, co-creation with AI, generative artificial intelligence, AI in education (AIEd). Highlights What is already known about this topic: • Generative AI's emergence in large language models has vast implications, as it closely mimics human language and comprehension. • Prompt engineering is optimizing AI language model's responses by formulating effective and specific inputs. • AI language model's efficacy depends on algorithms, training data, and prompt quality. What this paper contributes: • This paper posits that co-creation involving generative AI presents a potent approach in the field of education, underscoring the significance of human-machine interaction facilitated by carefully crafted prompts. • This paper emphasizes the importance of educators developing prompt engineering skills to harness the full potential of generative AI in educational contexts effectively. Implications for theory, practice and/or policy: • Prompt engineers should understand how language nuances impact generative AI's capabilities, enabling authentic and well-tailored content generation for effective teaching and learning interactions. • Approaching generative AI strategically, with clear purpose, tone, role, and context, fosters a prompt-based conversational pedagogy.
Article
Full-text available
This study explores university students’ perceptions of generative AI (GenAI) technologies, such as ChatGPT, in higher education, focusing on familiarity, their willingness to engage, potential benefits and challenges, and effective integration. A survey of 399 undergraduate and postgraduate students from various disciplines in Hong Kong revealed a generally positive attitude towards GenAI in teaching and learning. Students recognized the potential for personalized learning support, writing and brainstorming assistance, and research and analysis capabilities. However, concerns about accuracy, privacy, ethical issues, and the impact on personal development, career prospects, and societal values were also expressed. According to John Biggs’ 3P model, student perceptions significantly influence learning approaches and outcomes. By understanding students’ perceptions, educators and policymakers can tailor GenAI technologies to address needs and concerns while promoting effective learning outcomes. Insights from this study can inform policy development around the integration of GenAI technologies into higher education. By understanding students’ perceptions and addressing their concerns, policymakers can create well-informed guidelines and strategies for the responsible and effective implementation of GenAI tools, ultimately enhancing teaching and learning experiences in higher education.
Article
Full-text available
An artificial intelligence-based chatbot, ChatGPT, was launched in November 2022 and is capable of generating cohesive and informative human-like responses to user input. This rapid review of the literature aims to enrich our understanding of ChatGPT's capabilities across subject domains, how it can be used in education, and potential issues raised by researchers during the first three months of its release (i.e., December 2022 to February 2023). A search of the relevant databases and Google Scholar yielded 50 articles for content analysis (i.e., open coding, axial coding, and selective coding). The findings of this review suggest that ChatGPT's performance varied across subject domains, ranging from outstanding (e.g., economics) and satisfactory (e.g., programming) to unsatisfactory (e.g., mathematics). Although ChatGPT has the potential to serve as an assistant for instructors (e.g., to generate course materials and provide suggestions) and a virtual tutor for students (e.g., to answer questions and facilitate collaboration), there were challenges associated with its use (e.g., generating incorrect or fake information and bypassing plagiarism detectors). Immediate action should be taken to update the assessment methods and institutional policies in schools and universities. Instructor training and student education are also essential to respond to the impact of ChatGPT on the educational environment.
Article
This paper explores the transformative potential of Large Language Models Artificial Intelligence (LLM AI) in educational contexts, particularly focusing on the innovative practice of prompt engineering. Prompt engineering, characterized by three essential components of content knowledge, critical thinking, and iterative design, emerges as a key mechanism to access the transformative capabilities of LLM AI in the learning process. This paper charts the evolving trajectory of LLM AI as a tool poised to reshape educational practices and assumptions. In particular, this paper breaks down the potential of prompt engineering practices to enhance learning by fostering personalized, engaging, and equitable educational experiences. The paper underscores how the natural language capabilities of LLM AI tools can help students and educators transition from passive recipients to active co-creators of their learning experiences. Critical thinking skills, particularly information literacy, media literacy, and digital citizenship, are identified as crucial for using LLM AI tools effectively and responsibly. Looking forward, the paper advocates for continued research to validate the benefits of prompt engineering practices across diverse learning contexts while simultaneously promoting potential defects, biases, and ethical concerns related to LLM AI use in education. It calls upon practitioners to explore and train educational stakeholders in best practices around prompt engineering for LLM AI, fostering progress towards a more engaging and equitable educational future.
Article
ChatGPT, an artificial intelligence large language model, took the world by storm in November 2022. Its launch was met with excitement, and it garnered over 1 million users within the first five days of its release, surpassing social media giants like Facebook, Instagram, Twitter and even the top search engine, Google. Having been trained on volumes of data, ChatGPT has displayed the ability to produce human-like responses to questions. Concerns have been raised among members of the academic and research community regarding the ethical usage of ChatGPT and language models in education and academic/scientific research. This paper examines the development and rise of ChatGPT and similar AI tools, their pros and cons, their impact on academic research and possible intellectual property conflicts. It concludes that ChatGPT and language models are here to stay and makes recommendations for its ethical usage to prevent and detect plagiarism and protect intellectual property rights.
Article
Artificial intelligence tools represent an exciting opportunity for scientists to streamline their research and write impactful articles. Using artificial intelligence tools like ChatGPT can greatly improve writing review articles for scientists, by enhancing efficiency and quality. ChatGPT speeds up writing, develops outlines, adds details, and helps improve writing style. However, ChatGPT's limitations must be kept in mind, and generated text must be reviewed and edited to avoid plagiarism and fabrication. Despite these limitations, ChatGPT is a powerful tool that allows scientists to focus on analyzing and interpreting literature reviews. Embracing these tools can help scientists produce meaningful research in a more efficient and effective manner, however caution must be taken and unchecked use of ChatGPT in writing should be avoided.