ArticlePDF Available

Benefits and Challenges of Using ChatGPT: An Exploratory Study on English Language Program

Authors:
  • University of Bisha

Abstract and Figures

This study was conducted during the early stages of ChatGPT's emergence to explore faculty members' perceptions of its benefits and challenges in the field of English as a Foreign Language (EFL). This study, employing an exploratory descriptive research design, gathered both quantitative and qualitative data from a sample of 58 faculty members at the University of Bisha, Saudi Arabia. A questionnaire consisting of closed-ended and open-ended items was utilized to gather information about the opportunities presented by ChatGPT and the challenges it poses in the field of EFL. The results indicated that while most EFL teachers held a high positive view of ChatGPT's contribution to English language teaching and learning in higher education, some expressed concerns regarding issues such as plagiarism and overreliance on chatbots, with minimal effort from the learners themselves. No difference was reported in the teachers' perception on the benefits and challenges of using ChatGPT attributed to gender. Moreover, teachers with the teaching experience between 6-10 have the high significant perceptions over the other two groups. Based on these findings, the study suggests conducting further research with a larger sample size to uncover the actual utilization of ChatGPT and its impact on EFL learning and teaching. To harness the potential of this technology effectively, teachers can incorporate ChatGPT-based teaching methods to enhance students' language learning. The findings underscore the importance of providing training to teachers on how to engage students positively with ChatGPT while mitigating its negative consequences .
Content may be subject to copyright.
JBH-220111

1445
2023
Journal link


Benefits and Challenges of Using ChatGPT: An
Exploratory Study on English Language Program
Jamal Kaid Mohammed Ali
Department of English, College of Arts, University of Bisha, Bisha, Saudi Arabia
jgmali@ub.edu.sa

Benefits and Challenges of Using ChatGPT Jamal Kaid Mohammed Ali

Abstract
This study was conducted during the early stages of ChatGPT's emergence to explore
faculty members' perceptions of its benefits and challenges in the field of English as a
Foreign Language (EFL). Employing an exploratory descriptive research design, the study
gathered both quantitative and qualitative data from a sample of 58 faculty members at
the University of Bisha, Saudi Arabia. A questionnaire consisting of closed-ended and open-
ended items was utilized to collect information about the opportunities presented by
ChatGPT and the challenges it poses in the field of EFL. The results indicated that while
most EFL teachers held a highly positive view of ChatGPT's contribution to English
language teaching and learning in higher education, some expressed concerns regarding
issues such as plagiarism and overreliance on chatbots, with minimal effort from the
learners themselves. No differences were reported in the teachers' perceptions of the
benefits and challenges of using ChatGPT attributed to gender. Moreover, teachers with
teaching experience between 6-10 years had significantly more positive perceptions
compared to the other two groups. Based on these findings, the study suggests
conducting further research with a larger sample size to uncover the actual utilization of
ChatGPT and its impact on EFL learning and teaching. To harness the potential of this
technology effectively, teachers can incorporate ChatGPT-based teaching methods to
enhance students' language learning. The findings highlighted the importance of
providing training to teachers on how to engage students positively with ChatGPT while
mitigating its negative consequences.
Keywords
: artificial intelligence, challenges, ChatGPT, English language teaching. opportunities
To cite this article (APA):
Ali, J. K. M. (2023) Benefits and challenges of using ChatGPT: An exploratory study on
English language program.
University of Bisha Journal for Humanities, 2
(2). 629-641
 

Introduction
The constant evolution of digital technology continually introduces us to new tools
and applications, which, in turn, facilitate the emergence of innovative learning models and
platforms such as electronic, blended, and online learning (Al-Kadi, 2020; Alzumor et al.,
2013; Bin-Hady & Al-Tamimi, 2021; Jeon, 2022; Mahyoob, 2020). Recent digital advancements,
particularly those in the past few years, have taken the world by surprise, ushering in an
era characterized by "AI bots, ambient intelligence, and the metaverse" (Godwin-Jones,
2023, p. 6). A notable example is the significant transformation brought about by ChatGPT
in 2023, which appears to herald a new era, one that raises profound questions. While
ChatGPT may not consistently demonstrate accuracy, it has the potential to outperform
humans in various domains, leading many to view it as a game-changer for science and
academia (Firat, 2023; Hong, 2023; Kohnke et al., 2023). Since its debut, educators,
policymakers, and students alike have been both impressed by its unprecedented
advantages and plagued by doubts (Ali et al., 2023; Bin-Hady et al., 2023; Farrokhnia et al.,
2023; Hong, 2023; Mohammed et al., 2023; Moulieswaran & Kumar, 2023; Shoufan, 2023).
Consequently, researchers have initiated studies to explore how to harness its capabilities
across various disciplines.
Much like the situation with previous technological advancements preceding
ChatGPT, educators and policymakers in academia have consistently sought ways to
incorporate many of these technologies into the formal curriculum. Furthermore, the rise
of informal and online learning approaches, which encourage learning in diverse settings,
has become increasingly prominent (Alzumor et al., 2013; Godwin-Jones, 2023). The
emergence of ChatGPT has positioned it as a frontrunner among various digital
technologies in the realm of language education. It has introduced new dimensions that
demand attention from teachers, curriculum designers, and policymakers. An urgent and
comprehensive response from educators at all levels is imperative to effectively manage
the significant impact of these technologies on language education.
However, the recent introduction of ChatGPT is still in its early stages, marked by
numerous uncertainties (Bin-Hady et al., 2023; Baskara & Mukarto, 2023; Kohnke et al., 2023;
Shoufan, 2023; Yan, 2023). While researchers have already initiated investigations into its
merits and drawbacks across various fields of study, there is a pressing need for an
exploratory study to assess the perceived advantages and challenges specific to the Saudi
EFL context. Such a study would serve to familiarize faculty members in the Saudi EFL
context with the potential opportunities and pitfalls of this emerging technology, as well
as other similar AI tools, ultimately enabling more effective utilization in English language
learning and teaching.
Research questions
This study explores the benefits and challenges that ChatGPT presents in English
language programs in Saudi Arabia, with a specific focus on the University of Bisha, where
English is taught as a Foreign Language (EFL). The study seeks to address the following
research questions:
Benefits and Challenges of Using ChatGPT Jamal Kaid Mohammed Ali

1. What opportunities does ChatGPT offer for language learning from the
perspectives of EFL teachers?
2. What challenges does ChatGPT pose from the perspectives of EFL teachers?
3. Are there significant differences in teachers' views based on gender and years of
teaching experience?
Literature Review
Human existence is becoming increasingly intertwined with digital technology. The
gradual acceptance of technology led to the development of the Technology Acceptance
Model (TAM), initially proposed by Davis et al. as far back as 1989. Proponents of TAM argue
that people embrace technology when it proves to be valuable and user-friendly.
Technology has now permeated the realms of language learning, teaching, and
assessment, with numerous handheld devices serving as digital companions for both
educators and learners (Moqbel & Al-Kadi, 2023). The application of these technologies is
guided by theories and frameworks such as Computer-Assisted Language Learning (CALL),
Mobile-Assisted Language Learning (MALL), and more recently, ChatGPT-based learning
(Bin-Hady et al., 2023). The last decade of the twentieth century and the early years of the
twenty-first century witnessed increasingly sophisticated uses of technology in everyday
life, including language education. Over time, individual users have grown accustomed to
these advancements, with new innovations and devices emerging periodically.
However, the emergence of ChatGPT, a successor to successful AI applications, surprised
the world, opening up new avenues of research for authors worldwide. As noted by Godwin-Jones
(2023, p. 6), it holds 'considerable potential for language learning' and contributes to 'creating
more complexity in the relationship between humans and the material world.' In the field of
English education, Kohnke et al. (2023) conducted a comprehensive examination of ChatGPT's
capabilities, educational advantages, and shortcomings in language learning and teaching. They
offered a framework for its ethical and efficient utilization as a groundbreaking language
chatbot. Stepanechko and Kozub (2023) delved into the perspectives of English educators
regarding the ethical application of ChatGPT and found that these educators are concerned
about distinguishing content generated by students from that produced by ChatGPT.
A series of studies form the foundational basis for the present investigation. For example,
Ali et al. (2023) conducted research on how ChatGPT affects the motivation of English language
learners in their English studies. Their study included 80 students and teachers from Yemen and
India. They examined disparities in the perspectives of students and teachers regarding
ChatGPT's influence on motivating students to enhance their language skills and engage in
English learning with intrinsic, autonomous, and extrinsic motivation. Their findings indicated a
strong consensus among both teachers and students that ChatGPT is a motivating factor for
improving reading and writing skills. However, there was limited agreement on its ability to
enhance motivation for listening and speaking skills. Similarly, in other motivation-related studies
(e.g., Muñoz et al., 2023; Zhou & Li, 2023), ChatGPT was found to have a positive impact on
university students' motivation, fostering increased interest and enjoyment in their learning
journey.
 

Similarly, Bin-Hady et al. (2023) explored the benefits of ChatGPT in English language
acquisition. They collected data from ResearchGate discussion comments after posting a
question about the impact of ChatGPT on students' language learning. The study also aimed to
create a model for English language researchers who believe it could guide users of the English
language toward the proper use of the ChatGPT application. Moreover, Firat (2023) and Shoufan
(2023) conducted other essential studies on ChatGPT in four countries. Shoufan explored the
potentials and challenges of ChatGPT in a computer engineering program, recruiting 56 senior
students. Although the study showed excitement about its human-like interface, the participants
were suspicious about the model answers provided by ChatGPT, which suggests a need for
human intervention to verify its outcomes within their domain. In line with Shoufan's study, Firat
(2023), using a thematic content analysis approach, explored teachers' and students'
perceptions of ChatGPT across four countries: Australia, Sweden, Canada, and Turkey. Like some
other studies on ChatGPT, this study outlined the benefits and barriers of ChatGPT, indicating
the necessity for further exploration of the topic in different contexts.
In addition, Chiu et al. (2023) investigated the application of self-determination theory in
Artificial Intelligence (AI) within a different yet relevant context. They examined teachers'
support for students using chatbots and its impact on student motivation. The researchers
believe that teachers should support and mediate students' learning through AI. The
experimental study employed the self-determination theory as its framework and explored the
role of teacher support in motivating students to learn through chatbots. The study found that
teacher support motivates novice learners to study effectively via chatbots more than proficient
learners. Additionally, it found that chatbots can benefit and motivate successful students. Prior
to 2023, several studies had examined AI in language learning and teaching. Using the SWOT
analysis framework, Farrokhnia et al. (2023) discussed not only the strengths but also the
potential threats of ChatGPT to education. These concerns included a lack of deep
comprehension, challenges in assessing response quality, potential bias and discrimination, and
a deficit in advanced cognitive abilities. The authors also identified issues involving a lack of
situational awareness, risks to academic ethics, the persistence of bias in educational settings,
and the widespread occurrence of plagiarism.
Even before ChatGPT, several studies had explored the use of AI-based tools for language
learning. For example, Chen et al. (2020) investigated the impact of chatbots as a tool for
learning Chinese vocabulary. The researchers applied the Technology Acceptance Model (TAM)
developed by Davis et al. (1989) to assess the effectiveness of chatbots in Chinese vocabulary
acquisition. Their study revealed that students experienced improvements in Chinese vocabulary
learning when using chatbots. Additionally, the research found that students perceived chatbots
as user-friendly, enhancing their enjoyment of learning Chinese vocabulary. Similarly, in the
academic year 2020/2021, Qasem et al. (2023) conducted an experimental study to examine the
influence of chatbots on English vocabulary learning. Their findings indicated that the use of
chatbots was beneficial for English as a Foreign Language (EFL) students in their pursuit of
English vocabulary acquisition.
With these studies in mind, it's important to note that many technological tools and
applications were not originally designed for language learning. However, language specialists,
Benefits and Challenges of Using ChatGPT Jamal Kaid Mohammed Ali

researchers, and educators have consistently sought ways to incorporate them into language
learning and teaching, starting with Computer-Assisted Language Learning (CALL) and later
Mobile-Assisted Language Learning (MALL) initiatives (Al-Kadi, 2013). In the twenty-first century,
a wide range of technological innovations has opened up new avenues for research to distinguish
between what is beneficial and what is not. Technological advancements show no signs of
slowing down; the future promises more surprises. Informed by the Technology Acceptance
Model (TAM), this current investigation explores the acceptance of ChatGPT within the Saudi
English as a Foreign Language (EFL) context. It uses an exploratory research design to provide
insights for teachers and curriculum designers regarding the advantages and challenges they
should anticipate in the years ahead.
Methodology
Research design
The study followed an exploratory design and gathered both quantitative and qualitative
data from a sample of teaching staff. This topic is framed within a perception framework (Rose et
al., 2020). Motivated by the need for a comprehensive understanding of the ChatGPT
phenomenon, an exploratory research design was adopted in the Saudi context during the peak
of ChatGPT's popularity in early 2023. The rationale for combining these two data types lies in the
recognition that "drawing an absolute line between qualitative and quantitative research projects
is never entirely satisfactory" (Wilkinson et al., 2019, p. 53). Qualitative data provide an impression,
revealing "what kinds of 'something' exist" and shedding light on what it's like to experience, do, or
think something "from the perspective of those in the researched situation." In contrast,
quantitative data address questions about situations in terms of "how many?" or "what
proportion?" (pp. 52-53). Given that the study was conducted during ChatGPT's emergence phase,
characterized by widespread doubts and limited ChatGPT adoption among teachers, only
participants who actively used ChatGPT were included to capture their perspectives on its benefits
and challenges. This typically involves individuals familiar with the phenomenon (Mitchell & Jolley,
2010). The study was conducted during the 2022/2023 academic year at the University of Bisha.
Participants
A sample of 58 faculty members (67% male, 33% female) from the University of Bisha
participated in this study conveniently. Most respondents were early-career faculty members
with a sufficient background in ChatGPT. The selection was based on their experience with
ChatGPT, excluding those with limited experience. The researcher requested their permission to
participate in this study, informed them of its purpose, and assured them that their information
would remain anonymous. The study involved 58 English as a Foreign Language (EFL) teachers,
comprising 39 males and 19 females. Their levels of experience varied, with 8 having less than 6
years of experience, 16 with 6-10 years of experience, and 34 with more than 10 years of
experience.
 

Instrument
A questionnaire was used to collect the necessary data. The first section of the
questionnaire included questions related to demographic information such as gender and
teaching experience. In addition to this background data, the questionnaire consisted of 12 items
rated on a Likert scale, ranging from 'strongly agree' to 'strongly disagree,' to gather quantitative
data. Six of these items focused on the potential benefits of ChatGPT, while the other six
addressed potential challenges. Furthermore, two open-ended questions, one about
opportunities and another about challenges in using ChatGPT in English programs, provided
qualitative data to enhance the depth of the investigation. The formulation of these questions
was informed by previous studies, specifically Farrokhnia et al. (2023), Firat (2023), Kohnke et al.
(2023), and Shoufan (2023). Before implementation, the questionnaire underwent validation and
reliability checks, and a pilot study was conducted to ensure its suitability for this research. The
benefits scale demonstrated a Cronbach's alpha value of .94, while the challenges scale had an
alpha of .85. Both values exceeded the standard threshold of .70, indicating the reliability and
validity of the scales.
Part II
Part III
12 Likert Scale items
2 Open-ended
questions
Figure 1.
Classification of the faculty members’ questionnaire
Procedures
The questionnaire was distributed online using Google Forms, and a link was sent to
participants via a WhatsApp group exclusively for faculty members, of which the researcher is a
member. The questionnaire began with a simple Yes/No question, asking for consent to
participate. If respondents selected 'yes,' they were directed to a 'thank you message' and
provided with guidance for completing the entire questionnaire. If 'no' was chosen, a 'thank you
message' appeared, and the window closed. It was explicitly stated at the outset that
participation was voluntary. The introduction to the questionnaire reassured participants that
their responses would be used solely for research purposes and would not be disclosed to third
parties. Additionally, participant names, emails, and credentials were not mandatory fields.
Data analysis
The responses were recorded and coded, with Likert scale responses assigned codes
(from 1 = strongly disagree to 5 = strongly agree). Data were entered into an Excel file and then
exported to SPSS Version 25 for analysis. Mean and standard deviations were calculated to assess
the level of agreement, differences, and inferential tests such as t-tests and One-Way ANOVA
were used to identify differences in participants' perceptions based on their genders and years
of experience.
Benefits and Challenges of Using ChatGPT Jamal Kaid Mohammed Ali

Results
The opportunities and challenges of using ChatGPT as a language learning tool were
assessed through a questionnaire distributed to faculty members familiar with ChatGPT. The
collected data were analyzed both quantitatively and qualitatively. The results are presented in
the following section, organized according to the research questions, and supported by
references to relevant studies in the literature. The analysis yielded both quantitative and
qualitative data, which are juxtaposed in this section to provide a comprehensive view. In
addition to the statistical findings, pertinent quotations from responses to open-ended
questions are also included.
RQ 1: What opportunities does ChatGPT provide from the perspectives of EFL teachers?
Starting with the opportunities, Table 1 presents the means and standard deviations for
the six benefit items with an average of M=3.5 and Std=1.13. All of the means fall within the 3.3
to 3.6 range, indicating that, on average, the teachers had a high level of agreement with the
suggested benefits. In general, the faculty members agreed that ChatGPT supports the
enhancement of English language learning (Mean=3.6) and also boosts students' motivation to
study English. However, they appeared more neutral towards the statement, "Students should
be encouraged to use ChatGPT in the classroom" (mean=3.3).
Table 1.
Opportunities that ChatGPT creates for English language program
Questionnaire Items (1-6)
Mean
St.D
1. I think ChatGPT helps students enhance their English language learning.
3.6
1.17
2. I think ChatGPT enhances students' motivation to study English
language.
3.6
1.17
3. English teachers should use ChatGPT in the classroom.
3.4
1.15
4. Students should be encouraged to use ChatGPT in the classroom.
3.3
1.28
5.ChatGPT is useful to be used in the classroom.
3.4
0.94
6. Using ChatGPT in the classroom helps me improve my teaching.
3.4
1.08
Overall Average
3.5
1.13
To shed more light on the opportunities, Participant 24 argued that a significant
advantage of ChatGPT includes
"availability of ample material for teachers as well as students,
less time-consuming, quick response"
. This comment is supported by another comment derived
from Participant 29, who seemed positive that ChatGPT can be helpful in saving time for both
teachers and students as well as improving language skills. Participant 33 appeared more
interested in its significance for writing skills, saying,
"there will be a significant impact in
enhancing students' writing skills through it. Students will be more autonomous and learn the
process easily
. Similarly, Participant 34 put it in the context of conversations, and argued, "
it
can be a conversation partner of the learner, provide them more practice in grammar and
vocabulary, check their errors and clarify their doubts
. The participant goes further saying
"
since ChatGPT does not understand contexts, it may struggle to grasp the nuances in
communication, thereby limiting the scope of interaction. Also, AI cannot replace the experience
of a teacher because it cannot personalise learning support for individual learners
".
 

Similar collectively hold a favorable view that the extensive use of ChatGPT contributes
to a positive learning atmosphere, aiding in vocabulary acquisition, fluency, and other aspects of
learning, including motivation, curiosity for further learning, and receiving timely feedback.
Considering these results collectively, it is suggested that ChatGPT has the potential to enhance
English language learning and improve teaching in the classroom. However, there may be
variability in how individual students and teachers perceive the usefulness of ChatGPT.
Addressing any concerns or questions they may have could be essential to fully realize its
potential benefits.
RQ 2: What challenges does ChatGPT create from the perspectives of EFL teachers?
Table 2 displays the means and standard deviations (M=2.2, Std=1.0) for the six
challenge items. All means fall within the 2.0 to 2.5 range, indicating a weak level of
challenge. The teachers showed a low disagreement with the suggested challenges. Any
score below 2.5 implies disagreement with the negative statements about ChatGPT. The
overall average of 2.2 suggests that the rejection of the suggested challenges is stronger
than the acceptance of the benefits (mean = 3.5). The only item where they are close to
neutral is item 12: 'I think that ChatGPT erodes trust between teachers and their students'
(mean=2.5).
Table 2.
Challenges that ChatGPT creates for English Programs
Questionnaire Items (7-12)
Mean
St.D
7. I think ChatGPT decreases students' originality of writing.
2.0
1
8. I think ChatGPT encourages shallow reading.
2.2
0.9
9. I think ChatGPT raises potential ethical challenges.
2.2
1
10. I think ChatGPT encourages plagiarism.
2.1
1
11. I think ChatGPT decreases honesty among students.
2.3
1
12. I think ChatGPT erodes trust between teachers and their students.
2.5
1
Overall Average
2.2
1.0
To enrich understanding of the challenges, Participant 13 commented, "
It never reveals the
student's actual level of applying his English written and research skills. Misusing ChatGPT can
play for the student's benefit of presenting hypothetically well-written essays and passages that
reflect nothing of his/her ideas or level of thinking
".
This is not far from Participant 16’s comment regarding ethics, arguing that it "
poses a
threat on ethical issues, decreases originality, decreases creativity, higher order skills, critical
thinking
." The data suggest that respondents have concerns about the potential negative impact
of ChatGPT on students' originality in writing, shallow reading, ethical challenges, plagiarism,
honesty, and trust between teachers and students.
Combining the quantitative and qualitative findings can provide an overview of the
study's overall outcome. A noteworthy feature of the quantitative results is that, while the
academic staff generally support the opportunities that "
ChatGPT creates for English language
teachers and students
," they also tend to acknowledge that ChatGPT presents challenges for
both groups. In other words, most EFL teachers perceive ChatGPT as a tool that can enhance
Benefits and Challenges of Using ChatGPT Jamal Kaid Mohammed Ali

English teaching and learning. Based on the qualitative findings, the study revealed a
discrepancy regarding the use of ChatGPT in the classroom. Some teachers encourage its use,
while others perceive it as a threat to students' abilities, creativity, and knowledge. Participant
5 commented
In my opinion, ChatGPT can create opportunities for those who use it positively.
It opens up new opportunities for students who have strong motivation to learn English and
teachers can use it as a guide when they prepare lessons. On the other hand, students who don't
have motivation to learn English might use it negatively and depend on it to get ready-made
answers to their assignments
.
RQ 3: Is there a significant difference between the teachers' views based on gender
and years of teaching experience?
Regarding the gender variable, as shown in Table 3, the mean and standard
deviations (M=3.50, Std=1.01) for males tended to perceive greater benefits from ChatGPT
than females (M=3.34, Std=0.95). The difference was not statistically significant, the Sig.
value scored .56.
Table 3.
T-test of the perceived benefits by gender
Gender
N
Mean
Variance
T
Sig.
Male
39
3.50
1.01
0.58
.56
Female
19
3.34
0.95
Regarding the variable of teaching experience, as shown in Table 4, teachers with
one to five years of experience perceived the least benefit in ChatGPT (M=2.9, Std=1.59),
while those with six to ten years of experience perceived the highest benefit (M=3.92,
Std=0.48). Those with more than ten years of experience fell in between these two groups
(M=3.35, Std=0.94). These differences were statistically significant (p=0.04).
Table 4.
One Way Anova of the perceived benefits by years of experience
Years Teaching
N
Mean
Variance
F
P
1-5
8
2.9
1.59
3.55
.Sig
6-10
16
3.92
0.48
More than 10
34
3.35
0.94
Discussion
Results show that teachers have highly positive perceptions about the benefits that
ChatGPT may provide to the English Department. They show their perceptions by stating that
ChatGPT offers ample material for both teachers and students and is less time-consuming with
quick responses. These findings confirm and align with previous research on ChatGPT conducted
shortly after the emergence of this tool in 2023 (Bin-Hady et al., 2023; Chiu et al., 2023; Farrokhnia
et al., 2023; Firat, 2023; Kohnke et al., 2023; Shoufan, 2023). The acceptance of employing
ChatGPT in English education, as indicated by these findings, is consistent with Davis et al.'s
(1989) technology acceptance model. Moreover, the study reported a low perception of the
challenges that ChatGPT may pose for the English learning. Some participants provided
 

justifications, such as concerns about ethical considerations and the inability of ChatGPT
to reveal the students' actual level of understanding. These findings align with Cassidy
(2023), who highlighted that the use of ChatGPT in education may potentially lead to
academic dishonesty, with concerns raised about its impact on evaluations.
The study finds no significant difference in the views of teachers regarding the use
of ChatGPT across genders. Finally, teachers with 6-10 years of teaching experience exhibit
the highest positive perceptions among all groups. In line with a series of earlier findings,
this study highlights the potential of ChatGPT to shape new trends in learning and teaching
English in the coming years (Bin-Hady et al., 2023; Chiu et al., 2023; Farrokhnia et al., 2023;
Firat, 2023; Kohnke et al., 2023; Shoufan, 2023). ChatGPT appears to motivate learners,
potentially leading to significant advancements in learning, which may require strong
motivation for both classroom and independent learning (Ali et al., 2023). However, it is
important to acknowledge some limitations of the current study. One significant concern
relates to the gender variable, and another major challenge is the sample size. The sample
size is relatively small, consisting of 58 participants. Therefore, drawing definitive
conclusions about gender-based differences in the population of English language teachers
based on this data alone may be challenging. The imbalance in the number of male and
female participants also complicates the consideration of gender as a determining factor
in the study's findings. However, it's important to note that this preliminary investigation
is not intended to create a universal ChatGPT model for EFL programs. Instead, its purpose
is to investigate potential advantages and associated difficulties. These findings can serve
as a foundation for future research as ChatGPT establishes its position within academia.
Conclusion
The study aimed to investigate faculty members' perceptions of the benefits and
challenges of ChatGPT in English language education, along with their strategies for addressing
these challenges. It is important to note that this research was conducted during the early
stages of ChatGPT's adoption in academia. The study sought to explore perceived opportunities
and challenges in English language teaching and learning, with a focus on two key variables: the
participants' gender and their years of teaching experience with technology. These variables are
crucial, as they can potentially influence technology acceptance in language education. Digital
technology has become routine for individuals who have grown up with it, while older users may
find it more challenging.
Overall, this study revealed that ChatGPT holds promise for the future of EFL
pedagogy while also presenting challenges to educators and evaluators, particularly in
areas related to plagiarism, originality, and reliability. To effectively address these
challenges, workshops on ChatGPT should be organized to help learners understand both
its benefits and risks, enabling them to make informed decisions.
The researcher recommends that university and department authorities organize a
workshop to establish a unified approach for dealing with ChatGPT. This will ensure
consistency among teachers and provide clear rules for students. In conclusion, while
ChatGPT has the potential to enhance English language teaching and learning, addressing
the associated challenges and concerns is crucial. By offering training to both teachers
Benefits and Challenges of Using ChatGPT Jamal Kaid Mohammed Ali

and students and adopting a unified approach, ChatGPT can be effectively integrated into
English language teaching and learning.
Pedagogical Implications
Based on the study findings, some pedagogical implications can be presented. First,
educators should explore ways to incorporate ChatGPT into the curriculum to harness its
motivational and learning-enhancing benefits. Second, language instructors should receive
training on how to effectively integrate ChatGPT into language assessment. This includes using
ChatGPT to improve language skills, prevent cheating, address misuse, and adopt alternative
assessment methods that align with the technology's integration. Third, educators should
encourage independent learning and self-motivation, both inside and outside the classroom.
Directions for Future Research
Longitudinal studies can be conducted to track the long-term impact of ChatGPT on
language learning outcomes. This will help ascertain its sustained benefits and challenges over
time. In addition, future research may involve a larger and more diverse sample to offer a more
comprehensive understanding of ChatGPT's impact and to improve the generalizability of
findings. Moreover, comparative studies to assess the efficacy of ChatGPT against other
language learning tools and methodologies are needed. This can help identify the specific
strengths and weaknesses of ChatGPT in comparison to alternative approaches.


















.


 

References
Ali, J. K. M., Shamsan, M. A. A., Hezam, T. A., & Mohammed, A. A. Q. (2023). Impact of ChatGPT on
learning motivation: Teachers and students' voices
. Journal of English Studies in Arabia Felix,
2
(1), 4149. https://doi.org/10.56540/jesaf.v2i1.51
Al-kadi, A. M. T. (2013). English acquisition through unstructured internet use in Yemen.
The
Internet Journal Language, Culture and Society, 38
, 1-14.
Al-Kadi, A. (2020). Informal language practices via digital technology: The neglected proficiency.
In R. Ahmed, A. Al-Kadi & H. Trenton (Eds.),
Enhancements and Limitations to ICT-Based
Informal Language Learning: Emerging Research and Opportunities
. Hershey: IGI Global.
Alzumor, A. W. Q., Al Refaai, I. K., Bader Eddin, E. A., & Aziz Al-Rahman, F. H. (2013). EFL students'
perceptions of a blended learning environment: Advantages, limitations and suggestions
for improvement.
English Language Teaching, 6
(10), 95110.
https://doi.org/10.5539/elt.v6n10p95
Baskara, R., Mukarto, M. (2023). Exploring the implications of ChatGPT for language learning in
Higher Education.
Indonesian Journal of English Language Teaching and Applied Linguistics,
7
(2), 343-358. https://dx.doi.org/10.21093/ijeltal.v7i2.1387
Bin-Hady, W. R. A., & Al-Tamimi, N. O. M. (2021). The use of technology in informal English language
learning: evidence from Yemeni undergraduate students.
Learning and Teaching in Higher
Education: Gulf Perspectives, 17
(2), 107-120. https://doi.org/10.1108/LTHE-09-2020-0037
Bin-Hady, W.R.A., Al-Kadi, A., Hazaea, A. and Ali, J.K.M. (2023). Exploring the dimensions of
ChatGPT in English language learning: A global perspective.
Library Hi Tech
.
https://doi.org/10.1108/LHT-05-2023-0200
Cassidy C (2023) Australian universities to return to ‘pen and paper’ exams after students caught
using AI to write essays.
The Guardian Online
. https://www.theguardian.com/ australia-
news/2023/jan/10/universities-to-return-to-pen-and-paper-exams-after-students-
caughtusing-ai-to-write-essays
Chen, H. L., Vicki Widarso, G., & Sutrisno, H. (2020). A chatbot for learning Chinese: Learning
achievement and technology acceptance.
Journal of Educational Computing Research, 58
(6),
11611189. https://doi.org/10.1177/0735633120929622
Chiu, T. K., Moorhouse, B. L., Chai, C. S., & Ismailov, M. (2023). Teacher support and student
motivation to learn with Artificial Intelligence (AI) based chatbot.
Interactive Learning
Environments,
117. https://doi.org/10.1080/10494820.2023.2172044
Farrokhnia, M., Banihashem, S. K., Noroozi, M. & Wals, A. (2023). A SWOT analysis of ChatGPT:
Implications for educational practice and research.
Innovations in Education and Teaching
International
. 115. https://doi.org/10.1080/14703297.2023.2195846
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User acceptance of computer technology: A
comparison of two theoretical models.
Management Science, 35
(8), 9821003.
https://doi.org/10.1287/mnsc.35.8.982
Firat, M. (2023). What ChatGPT means for universities: Perceptions of scholars and students.
Journal of Applied Learning & Teaching, 6
(1), 5763.
https://doi.org/10.37074/jalt.2023.6.1.22
Benefits and Challenges of Using ChatGPT Jamal Kaid Mohammed Ali

Godwin-Jones, R. (2023). Emerging spaces for language learning: AI bots, ambient intelligence,
and the metaverse.
Language Learning & Technology, 27
(2), 627.
https://hdl.handle.net/10125/73501
Hong, W. C. H. (2023). The impact of ChatGPT on foreign language teaching and learning:
opportunities in education and research.
Journal of Educational Technology and
Innovation, 5
(1), 37-45
Jeon, J. (2022). Exploring AI chatbot affordances in the EFL classroom: Young learners
experiences and perspectives.
Computer Assisted Language Learning
. 126.
DOI: 10.1080/09588221.2021.2021241
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning.
RELC
Journal, 45
(2), https://doi.org/10.1177/00336882231162868
Mahyoob, M. (2020). Challenges of e-Learning during the COVID-19 pandemic experienced by
EFL learners.
Arab World English Journal, 11
(4), 351362.
https://doi.org/10.24093/awej/vol11no4.23
Mitchell, M. & Jolley, J.(2010).
Research design explained
(7th ed). London: Wadsworth, Cengage Learning.
Mohammed, A. A., Al-ghazali, A., & Alqohfa, K. A. (2023). Exploring ChatGPT uses in higher
studies: A Case study of Arab postgraduates in India.
Journal of English Studies in Arabia
Felix
, 2(2), 9-17. https://doi.org/10.56540/jesaf.v2i2.55
Moqbel, M. S. & Al-Kadi, A. (2023). Foreign language learning assessment in the age of ChatGPT:
A theoretical account.
Journal of English Studies in Arabia Felix, 2
(1), 7184.
doi.org/10.56540/jesaf.v2i1.62
Moulieswaran, N., & Kumar, S. (2023). Investigating ESL learners' perception and problem
towards artificial intelligence (AI)-assisted English language learning and teaching.
World
Journal of English Language, 13
(5), 290290.https://doi.org/10.5430/wje.v13n5p290
Muñoz, S. A. S., Gayoso, G. G., Huambo, A. C., Tapia, R. D. C., Incaluque, J. L., Aguila, O. E. P., ... &
Arias-Gonzáles, J. L. (2023). Examining the impacts of ChatGPT on student motivation and
engagement.
Social Space, 23
(1), 1-27.
Qasem, F., Ghaleb, M., Mahdi, H. S., Al Khateeb, A., & Al Fadda, H. (2023). Dialog chatbot as an
interactive online tool in enhancing ESP vocabulary learning.
Saudi Journal of Language
Studies, 3
(2), 7686.https://doi.org/10.1108/SJLS-10-2022-0072
Rose, H., McKinley, J. & Briggs Baffoe-Djan, J. (2020
). Data collection research methods in applied
linguistics
. London: Bloomsbury Academics.
Shoufan, A. (2023). Students' perceptions of ChatGPT: Thematic analysis and follow-up survey.
IEEE Access, 11
, 388053881. https://doi.org/10.1109/ACCESS.2023.3268224
Stepanechko, O., & Kozub, L. (2023). English teachers’ concerns about the ethical use of
ChatGPT by university students.
Grail of Science
, (25), 297302.
https://doi.org/10.36074/grail-of-science.17.03.2023.051
Wilkinson, L.; Bouma, G.D. & Carland, S. (2019). The research process. Oxford University Press.
Yan, D. (2023). Impact of ChatGPT on learners in a L2 writing practicum: An exploratory
investigation.
Education and Information Technologies, 28
(4), 125.
https://doi.org/10.1007/s10639-023-11742-4
Zhou, L. & Li, J. J. (2023). The impact of ChatGPT on learning motivation: A study based on self-
determination theory.
Educ Sci. Manag, 1
(1), 1929. https://doi.org/10.56578/esm010103
... Prior research has shown their salience for language assessment (Moqbel & Al-Kadi, 2023;Seo, 2024;Yang et al., 2024), and learning motivation Yıldız, 2023;Zhou & Li, 2023). Other researchers including Ali (2023), Alzubi (2024), Bin-Hady et al. (2023), and Sahari et al. (2023) tapped into AI-based challenges that stand on the way of AI uses in English education. Besides, AI-based language models have been increasingly and significantly championed as self-driven learning versatile tools (Agustini, 2023;Dizon, 2024;Liu et al., 2023;Van Horn, 2024). ...
... An overall picture of the state-of-the-art of their integration is useful to zoom in on the current situation of AI in English language programs and the trajectory of relevant research. It would enrich the ongoing discussion about the critical roles of the three LLMs in question and pinpoint their merits and demerits in English learning and teaching (Ali, 2023;Crompton & Burke, 2024;Kostka, & Toncelli, 2023). Against this background, this paper, based on relevant theoretical underpinning and prior research findings, is a zoom-in lens to succinctly provide well-reasoned propositions on these AI models' potential and limitations (Nugroho et al., 2023;Sok & Heng, 2024). ...
... Earlier studies of AI-based language learning provide foundations for understanding how NLP built on AI models benefit language learners in acquiring the target language (Kirana & Gupta, 2022). Over the last three years, several studies charted areas of the potential of LLMs, consistently indicating positive impacts on English language learning and teaching (Ali, 2023;Agustini, 2023;Lee, 2024;Barrot, 2023;Moqbel & Al-Kadi, 2023;Pack & Maloney, 2023). ...
Article
Full-text available
Artificial Intelligence (AI) has penetrated English language learning and teaching, and this penetration parallels a surge of research on its potential and challenges for learners and teachers altogether. This paper provides a glimpse of the status quo of generative (Gen) AI in contexts where English is not used natively. Adopting a holistic approach to researching these GenAI tools, the study takes three large language models (LLMs) as its focus: ChatGPT, Gemini (formerly Bard) and Copilot (formerly Bing Chat). The discussion focuses on how such chatty LLMs bolster learners' command of English and support teaching it innovatively. It is organized around aspects of effectiveness and challenges in four parts. The first is about LLMs and how they shape new pathways for more interactive English learning. The second sketches how these language models are invested for enriching formal learning, self-directed learning, interactive content, feedback, and learning materials. The third part beds on teachers, including planning teaching, assessment, and professional development. The fourth part culminates in concerns associated with GenAI in English programs. The study charts territories for further research to paint both sides of a complete picture of GenAI in language education.
... Interestingly, students do not admit to utilizing chatbots for academic assignments; instead, they view employing virtual agents without authorization as fraud and cite the ability to do research and enhance writing abilities as benefits of using Chat GPT for English language learning; they also listed the loss of critical thinking abilities as a drawback (Ferreiro-Santamaria, 2024). Along the same line, ChatGPT can be an advanced type of plagiarism since the chatbot gathers information from different sources but fails to provide the citation of the sources it gets the information from (Ali, 2023). ChatGPT also poses the threat of being an unreliable tool of information since the AI lacks filtered sources (Chan & Hu, 2023). ...
... Furthermore, one open-ended question regarding individuals' experiences or challenges in using ChatGPT for writing essays. The formulation of these questions was informed by previous studies, including Ali (2023), Chan and Hu (2023), Baskara and Mukarto (2023), and Pham (2024). Before implementation, the questionnaire underwent validation and reliability checks, and a pilot study was conducted with 30 participants to ensure its suitability for this research. ...
... On the other hand, teachers remained skeptical about the reliability of ChatGPT's answers, as shown in Table 1. This finding matched the statements made by Ali (2023), Chan and Hu (2023), and Baskara and Mukarto (2023) regarding the lack of accuracy in ChatGPT's answers. From their viewpoints, the tool might reduce students' creativity, language appropriateness, and inaccurate information if the teachers and learners are not vigilant about real-like information provided by ChatGPT. ...
Article
Full-text available
This research investigates the stakeholders' perceptions, including teachers and students, in terms of integrating ChatGPT into teaching and learning English paragraph writing at Van Lang University (VLU). Employing both qualitative and quantitative methods, data were collected from 241 survey respondents and ten interviewees. Apart from positive views on ChatGPT's effectiveness in providing instant feedback and giving diverse writing examples, the stakeholders had neutral opinions regarding ChatGPT's ability to support teaching, learning, and user creativity. Additionally, they were skeptical about the reliability and accuracy of its responses. To maximize the benefits of ChatGPT, it is advised to utilize it cautiously, confirm the correctness of its outputs through verification, and enhance quick ways for the best answers. The findings highlight the importance of a balanced approach incorporating AI tools in language education, emphasizing the need to leverage its strengths and mitigate its limitations. Future research needs to explore the benefits and drawbacks of ChatGPT in different aspects and conduct empirical studies for the chatbot to gather more valuable information.
... ChatGPT, an AI-based tool powered by deep learning, simulates human-like text generation and analysis [1,2] . It has been extensively integrated into educational and language learning research, where it is celebrated for its contextual understanding and capacity to deliver precise, actionable responses [3][4][5][6] . ChatGPT supports a range of educational functions, from enhancing teaching methodologies to aiding students in comprehension, research, and problem-solving [7] . ...
... English language teaching reveal its dual potential to both enhance and challenge the learning process. It is well-regarded for boosting language skills, providing immediate feedback, and supporting academic writing [3,6,7] . However, its impact varies with its implementation within educational frameworks. ...
Article
Full-text available
ChatGPT has significantly impacted various educational sectors, including English-medium instruction (EMI). This study explores perceptions of Saudi medical students at the University of Bisha on integrating ChatGPT into their EMI coursework, focusing particularly on its influence on their comprehension and application of medical terminology in English. Employing a descriptive research design, this research collected data from 54 students using both quantitative and qualitative methods. Data collection was facilitated through a questionnaire administered via Google Forms, with responses analyzed statistically using SPSS and qualitatively through thematic analysis. Results indicate a positive student reception towards ChatGPT, particularly its role in enhancing their understanding of medical English. These findings suggest substantial pedagogical benefits, proposing that meticulous integration of ChatGPT could significantly improve EMI in medical education. The study highlights ChatGPT's capability to aid students in grasping complex medical terms and concepts, stressing the importance of strategic deployment to maximize educational outcomes. Furthermore, this research underscores the necessity for ethical guidance to enable students to critically evaluate the accuracy of information, thus mitigating dependence on potentially erroneous AI outputs. This study establishes a foundational framework for the future integration of ChatGPT in EMI, contributing innovatively to the field.
... There was also a sign of taking a personal stance to "face controversy" or disagreements when completing group projects. Additionally, like the teacher, the student authors began demonstrate a critical awareness of inaccuracies in ChatGPT output (Mahama et al., 2023), the risk of overreliance on ChatGPT (Ali, 2023), and the danger of non-learning behaviors such as copying ChatGPT-generated responses directly as one's own (Teng, 2024c). Through classroom-supported explorations, these student authors were showing signs of becoming "thoughtful, independent thinkers in an AI-driven world" (Hao et al., 2024). ...
Article
Full-text available
Since its launch in late 2022, ChatGPT has generated both excitement and concern among language professionals in applied linguistics. Although various organizations, publishers, and institutions have introduced guidelines to address this phenomenon, these top-down approaches often neglect the nuanced experiences and perspectives of L2 academic writing teachers and their students. This study aims to bridge this gap by centering on the experiences of one EFL writing teacher and two international students in an undergraduate academic writing course in an English medium program in a Thai private university. In this class, students engaged in writing, reading, and discussions about what it means to be an academic writer in the age of generative AI. By employing collaborative poetic autoethnography, we argue that ChatGPT is more than just a tool or assistant; it has become a ubiquitous "ghostwriter" that requires careful navigation. Drawing on the poems, reflections, freewriting samples, and drafts collected from January to May 2024, the present study provides critical insights into ethical and effective integration of ChatGPT in EFL academic writing classes. The study also contributes to the domain of digital applied linguistics through depicting the opportunities and challenges presented by AI technologies in language and literacy education.
... One of the major concerns is that ChatGPT-generated content may not help to develop students' understanding and critical thinking skills (Stepanechko & Kozub, 2023). While the possible challenges have been explored in specific contexts (e.g., Ali, 2023;Rasul et al., 2023), the strategies of using ChatGPT in students' writing tasks have only been hinted at in few previous studies (e.g., Baskara, 2023;Mondal & Mondal, 2023). For example, several previous studies have reported consistent findings. ...
Article
Full-text available
The development of generative Artificial Intelligence (AI) models, particularly ChatGPT, has gained considerable attention among academics and researchers in recent years. Research shows that ChatGPT can be a vital means of increasing students’ writing performance. However, students may face difficulties in developing effective strategies to incorporate ChatGPT-generated content into written tasks. Therefore, this study sought to examine the challenges and strategies employed by students to use ChatGPT-generated responses for written communication assignments. The study utilized a quantitative method, using a descriptive survey technique. A self-developed questionnaire was used to gather data from a sample of 59 communication students at a Malaysian public university. The data were examined through descriptive statistics and Pearson correlation analysis. According to the findings, students face various challenges in using ChatGPT-generated responses, such as the inability to express unique writing skills, dealing with inaccurate citation formats, as well as difficulty revising ChatGPT-generated responses. The students also employ certain relevant strategies for using ChatGPT-generated responses, such as adding ideas to already generated ChatGPT content, using ChatGPT as a means of idea generation, paraphrasing ChatGPT-generated responses, and replacing ChatGPT-generated words with synonyms. Accordingly, the analysis showed a significant association between students’ challenges and the strategies they employ to utilize ChatGPT-generated responses. This study provides valuable information that can help educators and relevant authorities review and reinforce institutional policies for quality higher education, particularly in the Malaysian context.
Article
Full-text available
Global firms are competing hard for leadership in the field of artificial intelligence in the third millennium, believing that one day a machine will take the position of a human being to rule the future of humankind. Since various firms have attempted to produce artificial intelligence-operated robots to replace human labour in the medical, engineering, technological, and financial fields, such dreams have become a seemingly realistic prospect. The new boom in the artificial intelligence industry, which the "OpenAI" company brought about by releasing the "ChatGPT" chatbot, has sparked widespread controversy about its enormous capabilities in generating accurate and correct information. It makes it worthwhile to mention that the influence of these companies extended to written texts and scientific research. Accordingly, the current research aims to investigate the impact of artificial intellgance on the translation quality of Saudi learners’ performance in Saudi Universities. It also seeks to explore the Saudi translators’ attitudes towards using artificial intelligence in the translation process. Therefore, the study will use a mixed approach: quantitative and qualitative. A closed ended questionnaire was used to explore the Saudi students’ attitudes towards using artificial intelligence tools in translation texts. On the other hand, a translation test was utilized to evaluate the impact of AI on students’ translation performance. Both the quantitative and qualitative data of the questionnaire and the test have been investigated by descriptive statistics. The results indicated that AI-based translation tools had increased the experimental group’s proficiency and their translation performance surpassed that of the control group.
Article
Teaching foreign language learners literature appreciation can be a tricky task as it follows from a deep and clear understanding of literature as the first step. This study examines whether and how an AI tool (ChatGPT) can contribute to the literature appreciation skills of EFL learners. The study was conducted with a sample of 28 female EFL learners at Prince Sattam Bin Abdelaziz University (PSBAU), Saudi Arabia in the first semester of 2023 spanning a ChatGPT- based intervention period of three weeks. Results indicated that learners’ literature appreciation scores improved from 17.96 before the intervention to 22.21 afterwards with a probability value which was a statistically significant change. The parameters on which the improvement was observed were the ability to identify and interpret literary themes, symbols, and character development using the chatbot. The study employed a unique method of gathering real-time experiential data from the participants by encouraging them to share their ChatGPT interaction experiences after each interventional session. The participants reported gains over conventional learning including cоntext and nuances, general language proficiency by helping with error correction, cohesion, and coherence, identifying themes, motifs, symbolism, and character development, exposure to world literatures, adjustment to learners’ proficiency levels, cultural and historical information, and freedom to ask questions. Based on these results, the study highly recommends the integration of ChatGPT into the EFL classroom but with appropriate investment in educating the learners on the ethics of AI use as was done by the researcher here.
Article
Full-text available
This preliminary cross-sectional study, focusing on Artificial Intelligence (AI), aimed to assess the impact of ChatGPT on translation within an Arab context. It primarily explored the attitudes of a sample of translation teachers and students through semi-structured interviews and projective techniques. Data collection included gathering information about the advantages and challenges that ChatGPT, in comparison to Google Translate, had introduced to the field of translation and translation teaching. The results indicated that nearly all the participants were satisfied with ChatGPT. The results also revealed that most students preferred ChatGPT over Google Translate, while most teachers favored Google Translate. The study also found that the participants recognized both positive and negative aspects of using ChatGPT in translation. Findings also indicated that ChatGPT, as a recent AI-based translation-related technology, is more valuable for mechanical processes of writing and editing translated texts than for tasks requiring judgment, such as fine-tuning and double-checking. While it offers various advantages, AI also presents new challenges that educators and stakeholders need to address accordingly.
Article
Full-text available
The proliferation of ChatGPT, as in many other digital technologies and social media, has increasingly impacted many aspects of modern life, including second and foreign language education. This study, building on a common theoretical position of all these advances in Artificial intelligence (AI), seeks to establish a model for ChatGPT research on English language learning. It specifically explores the dimensions in which ChatGPT aids students in their English language learning. Design/methodology/approach The study adopts grounded theory in collecting and analyzing data from 20 ResearchGater (RG) through a two-week RG discussion about ChatGPT uses in their language learning contexts. Data collected via the discussion was analyzed thematically. Findings Preliminary findings show that ChatGPT can be used in developing learners' language skills; scaffolding the learning process by providing feedback to students on their language use and acting as partners in practicing language with recommended activities for more language practice. Originality/value The study contributes a five-dimension model for artificial intelligence assisted language learning (AIALL). The model involves flexible teacher's role to consolidate learner autonomy and provide enjoyable learning, urges future innovation, and celebrates various applications. Examining the AIALL model of ChatGPT for language learning, teachers should provide some directions for properly using this new application.
Article
Full-text available
In the Artificial Intelligence (AI) age now, foreign language learners can get unlimited support on their learning tasks from advanced AI chatbots, primarily the ChatGPT. At the same time, such a language chatbot intensifies the importance of rethinking learning outcome assessment. Traditional assessments that draw on a teach-and-test-approach are of little use and no longer valid for a comprehensive understanding of students' knowledge and skills that they, by and large, obtain in informal learning settings and contribute to their overall performance. Hence, alternative assessments can reflect more on learners' actual performance that likely involves AI chatbots and yet goes unnoticed by traditional assessment. This paper discusses alternative assessments regarding their nature, forms, characteristics, advantages, and integration into L2 programs. It establishes a foundational theoretical account for future research that would take place when ChatGPT becomes commonplace in the worldwide L2 contexts. It charts new research territories and passes the torch to second and foreign-language learning assessors to reflect on their teaching situations and reimagine L2 programs in light of the affordances of the ChatGPT, which has made a significant breakthrough in learning and teaching languages.
Article
Full-text available
ChatGPT has sparked both excitement and skepticism in education. To analyze its impact on teaching and learning it is crucial to understand how students perceive ChatGPT and assess its potential and challenges. Toward this, we conducted a two-stage study with senior students in a computer engineering program (n=56). In the first stage, we asked the students to evaluate ChatGPT using their own words after they used it to complete one learning activity. The returned responses (3136 words) were analyzed by coding and theme building (36 codes and 15 themes). In the second stage, we used the derived codes and themes to create a 27-item questionnaire. The students responded to this questionnaire three weeks later after completing other activities with the help of ChatGPT. The results show that the students admire the capabilities of ChatGPT and find it interesting, motivating, and helpful for study and work. They find it easy to use and appreciate its human-like interface that provides well-structured responses and good explanations. However, many students feel that ChatGPT's answers are not always accurate and most of them believe that it requires good background knowledge to work with since it does not replace human intelligence. So, most students think that ChatGPT needs to be improved but are optimistic that this will happen soon. When it comes to the negative impact of ChatGPT on learning, academic integrity, jobs, and life, the students are divided. We conclude that ChatGPT can and should be used for learning. However, students should be aware of its limitations. Educators should try using ChatGPT and guide students on effective prompting techniques and how to assess generated responses. The developers should improve their models to enhance the accuracy of given answers. The study provides insights into the capabilities and limitations of ChatGPT in education and informs future research and development.
Article
Full-text available
This study investigates the implications of ChatGPT, an AI-powered language model, for students and universities by examining the perceptions of scholars and students. The responses of seven scholars and 14 PhD students from four countries – Turkey, Sweden, Canada and Australia – are analysed using a thematic content analysis approach. Nine key themes emerge from the findings. According to their frequency of recurrence, these themes are: “Evolution of learning and education systems”, “changing role of educators”, “impact on assessment and evaluation”, “ethical and social considerations”, “future of work and employability”, “personalized learning”, “digital literacy and AI integration”, “AI as an extension of the human brain”, and “importance of human characteristics”. The potential benefits of AI in education as well as the challenges and barriers that may arise from its integration are discussed in the context of existing literature. Based on these findings, suggestions for future research include further exploration of the ethical implications of AI for education, the development of strategies to manage privacy concerns, and the investigation of how educational institutions can best prepare for the integration of AI technologies. The paper concludes by emphasizing the importance of understanding the potential opportunities and challenges associated with AI in higher education and the need for continued research in this area.
Article
Full-text available
A surprising new challenge appeared with the advent of ChatGPT in November 2022 dealing with many academic tasks of different levels. The tool that revolutionized the way people interact with machines caused a lot of heated debates over its benefits and limitations. There is an increasing number of works devoted to different aspects of ChatGTP usage. They pose discussions and arguments among educators, scientists, governmental representatives, and even technology experts concerning ethical issues surrounding the use of ChatGTP. Some governmental institutions reacted instantly to the latest text tool and even forbade its use at schools and universities because of the fear that students might use it to cheat in university writing assignments and academic papers. The main worry is that tasks generated by this tool are relatively qualitative and may have a negative impact on learning. It does not contribute to developing critical thinking and problem-solving skills that are essential for wholesome personalities and successful professionals. Another big challenge for teachers connected with the use of ChatGTP by university students is the inability to distinguish the text written by a new OpenAI chatbot from the works written by real students, even with the help of antiplagiarism tools currently in use. The results of the study prove that for many English teachers ChatGTP is the tool that may impede and interfere with successful educational process preventing the development of students’ creativity, critical thinking, and analytical skills. However, we admit the necessity to take advantage of the new chatbot, the need to rethink and reconsider the existing methods and praxis for learning foreign languages in line with the requirements of the time. It is of primary importance to start looking for new ways how to incorporate the emerging technology into the educational process, using effectively its possibilities and tools.
Article
Full-text available
In this technology review, we explore the affordances of the generative AI chatbot ChatGPT for language teaching and learning. In addition to this, we also present debates and drawbacks of ChatGPT. Finally, we present the digital competencies teachers and learners require to use this chatbot ethically and effectively to support language learning.
Article
Full-text available
Technology-enhanced language learning has exerted positive effects on the performance and engagement of L2 learners. Since the advent of tools based on recent advancement in artificial intelligence (AI), educators have made major strides in applying state-of-the-art technologies to writing classrooms. In November 2022, an AI-powered chatbot named ChatGPT capable of automatic text generation was introduced to the public. The study tried to apply ChatGPT’s text generation feature in a one-week L2 writing practicum. The study adopted a qualitative approach to investigate students’ behaviors and reflections in their exposure to ChatGPT in writing classrooms. The developmental features in learning activities and reflective perceptions were triangulated for the piloting evaluation of the impact of ChatGPT on L2 writing learners. The findings revealed the affordance and potential applicability of the tool in L2 writing pedagogy. Additionally, the tool also showcased an automatic workflow that could maximize the efficiency in composing writing. However, participants generally expressed their concern with its threats to academic honesty and educational equity. The study impelled the reconceptualization of plagiarism in the new era, development of regulatory policies and pedagogical guidance to regulate proper utilization of the tool. Being a pioneering effort, the study accentuated future research directions for more insights into the application of ChatGPT in L2 learning, and the establishment of corresponding pedagogical adjustments.
Article
Full-text available
ChatGPT is an AI tool that has sparked debates about its potential implications for education. We used the SWOT analysis framework to outline ChatGPT's strengths and weaknesses and to discuss its opportunities for and threats to education. The strengths include using a sophisticated natural language model to generate plausible answers, self-improving capability, and providing personalised and real-time responses. As such, ChatGPT can increase access to information, facilitate personalised and complex learning, and decrease teaching work-load, thereby making key processes and tasks more efficient. The weaknesses are a lack of deep understanding, difficulty in evaluating the quality of responses, a risk of bias and discrimination, and a lack of higher-order thinking skills. Threats to education include a lack of understanding of the context, threatening academic integrity, perpetuating discrimination in education, democratising plagiarism, and declining high-order cognitive skills. We provide agenda for educational practice and research in times of ChatGPT.
Article
This study aimed to investigate the effects of ChatGPT on student motivation and engagement. The study had two primary objectives: to determine teachers' and students' perceptions of how ChatGPT motivates students' learning process and whether there is a significant correlation between teachers' and students' perceptions of using ChatGPT in the learning process. The information was gathered via a survey of 350 students and instructors. The data were analyzed statistically using ANOVA and post hoc multiple comparison tests. Students listening skills (p = 0.006) and interest in learning (p = 0.00078103) were significantly correlated with the teacher's experience level. In addition, the results demonstrated that ChatGPT substantially impacted student motivation and engagement. Highly experienced instructors significantly impacted student motivation in listening skills (p = 0.006) and learning interest (p = 0.001). The research indicates that ChatGPT helps increase student motivation and engagement in the learning process. Therefore, policymakers should promote the incorporation of ChatGPT into the educational system to improve student learning outcomes.