ArticlePDF Available

The Effectiveness and Potential of E-Learning in War Zones: An Empirical Comparison of Face-to-Face and Online Education in Saudi Arabia

Authors:

Abstract

This study compares the effectiveness of e-learning and face-to-face education in the previously neglected context of Saudi Arabia. This is done by examining Najran University’s e-learning experience after the institution suspended traditional course delivery due to the ongoing war between Saudi Arabia, the Arab Coalition, and Yemeni rebel groups. The analysis also considers the potential benefits offered by e-learning in crisis zones such as the southern border region of Najran, Saudi Arabia. The results indicate that there is no statistical or practical difference between online and face-to-face learning with respect to student performance. The study also demonstrated that e-learning is capable of delivering the educational goals of higher learning institutions to areas wrecked by wars. E-Learning offers students a safe learning environment, engaging platforms, and most importantly, a quality education. The findings of this study contribute to a growing body of scholarship on the effectiveness and implementation of e-learning in the Middle East.
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 1
2169-3536 © 2017 IEEE. Translations and content mining are permitted for academic research only.
Personal use is also permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Date of publication xxxx 00, 0000, date of current version xxxx 00, 0000.
Digital Object Identifier 10.1109/ACCESS.2017.Doi Number
The Effectiveness and Potential of E-learning in
War Zones: An Empirical Comparison of Face-
to-Face and Online Education in Saudi Arabia
Khairan D. Rajab1, Member, IEEE
1Najran University, Najran, Saudi Arabia
Corresponding author: Khairan D. Rajab (e-mail: khairanr@ gmail.com).
The author would like to thank the E-Learning Committee at the College of Computer Science and Information System at Najran University for the weekly,
mid-semester, and final reports that ensured the proper activation of e-learning teaching during the academic year 2016. This work is supported by Najran
University [grant number NU/ESCI/064].”
ABSTRACT This study compares the effectiveness of e-learning and face-to-face education in the
previously neglected context of Saudi Arabia.  This is done by examining Najran University‟s e -learning
experience after the institution suspended traditional course delivery due to the ongoing war between Saudi
Arabia, the Arab Coalition, and Yemeni rebel groups. The analysis also considers the potential benefits
offered by e-learning in crisis zones such as the southern border region of Najran, Saudi Arabia. The results
indicate that there is no statistical or practical difference between online and face-to-face learning with
respect to student performance. The study also demonstrated that e-learning is capable of delivering the
educational goals of higher learning institutions to areas wrecked by wars. E-Learning offers students a safe
learning environment, engaging platforms, and most importantly, a quality education. The findings of this
study contribute to a growing body of scholarship on the effectiveness and implementation of e-learning in
the Middle East.
INDEX TERMS Education in War Zones, E-learning, Evaluation of Face-to-Face Education, Information
Communications Technologies (ICTs), Online Education, Saudi Arabia
I. INTRODUCTION
The government of Saudi Arabia has increasingly coalesced
its efforts at implementing e-learning initiatives and
programsintothekingdoms‟highereducationsystemsince
April 2016, when the Council of Ministers endorsed the
2030 vision to “expand the scope of online education” in
the country. Authors [1] noted that the Saudi higher
education system was gradually shifting from a traditional
face-to-face classroom setting into a more web-based
system. While the number of e-learning courses and
programs has increased exponentially within Saudi
universities, it is still unclear whether online learning is an
effective educational model.
Research on the effectiveness of online education is both
extensive and inconclusive [2-8]. On the one hand, many
studies concluded that there is no statistical or practical
difference between the academic outcomes of online and
face-to-face courses [9-12]. On the other hand, many
studies have found that student performance and
satisfaction with online courses was better when compared
to traditional face-to-face classes [13-16]. Additionally, few
studies reported poor student performance in online classes
compared to traditional courses [16-17].
Despite a large number of studies comparing student
academic outcomes across various learning modes (such as
face-to-face, hybrid, blended, and online or distance
education), there has been no systematic evaluation of the
effectiveness of e-learning in Saudi universities [18-22].
Previous studies on e-learning in Saudi Arabia focused on
the types, breadth, future potential, and challenges of the
mode [23-27]. Despite an interest in e-learning throughout
the Kingdom, the effectiveness of it has not yet been
adequately evaluated. Do online students perform the same,
better, or worse than students who attend traditional classes
in Saudi universities? This study attempts to address this
question by comparing student performance in courses
taught both online and face-to-face at the same public
university in southern Saudi Arabia.
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
While scholarship on e-learning has extensively outlined
the benefits of online education, it has failed to indicate that
e-learning can be used as an effective educational delivery
system in crisis areas [2, 5-6, 12, 26]. E-learning expands
the access of education to hard-to-reach groups, rural
populations, and female students in countries such as Saudi
Arabia as well as among non-traditional groups including
single parents, the less economically endowed, and the
chronically ill [18, 25-26]. The format also allows students
to learn, develop, and enhance their technical skills by
forcing them to utilize new educational tools [17, 27]. In
addition to such advantages, this paper highlights the
potential of e-learning in delivering intended educational
outcomes within crisis zones.
This research contributes to ongoing debates concerning
the effectiveness of e-learning in emerging educational
systems such as in Saudi Arabia. Many policymakers have
been hesitant in lending support for the expansion of e-
learning, citing its ineffectiveness in delivering desired
educational goals, unsuitability for students, lack of self-
direction among students, regulation and motivation,
institutional inexperience and inadequate technologies.
Findings of this research clearly indicate that e-learning is
an effective tool for achieving desired educational
outcomes in countries where online education is still
emerging, such as Saudi Arabia. It adds evidence to the
nascent scholarship establishing a positive correlation
between online education and better student outcomes in
the Middle East. This study provides policymakers with a
real success story demonstrating the effectiveness of e-
learning in unconventional areas, with a predominantly
conservative Arab constituency in Southern Saudi Arabia.
This research presents an efficient, accessible and timely
solution to suspended higher education due to natural
disasters, emergencies or civil wars. E-learning does not
require students to travel to a brick and mortar structure
where the lives of students are jeopardized due to air
bombardments, rocket shelling, earthquakes or flooding.
Students can access course materials remotely from a safe
haven. Faculty can offer collaborative and assisted learning
services to students using online platforms without
worrying about their safety. E -earning provides a
compelling educational solution that guarantees better
equity and access to high quality education in emergency
ridden areas around the world.
Distance education literature often neglects the connection
between e-learning, its benefits and its application in
unconventional contexts, sa hus war-zones. This research
extends the study of e-learning by testing its effectiveness in
war zones specifically. Evidence indicates that well-designed
e- learning initiatives allow universities to provide equitable,
high quality and efficient higher education to inaccessible
populations such as those prevented from attending face-to-
face courses due to wars or natural disasters. The concept of
implementing e-learning in war-zones is inadequately
investigated and needs to be developed further. This research
expands the horizon for further rigorous analyses on the
implementation of e-learning in natural disaster areas to
address inadequate access to high quality education in those
areas.
II. FACE-TO-FACE VERSUS ONLINE
Analyzing data from the same courses over a four-year
period, the authors [28] compared student performance with
respect to the medium of instruction, specifically face-to-
face versus fully online courses. Using a post-test design,
theauthorsconcluded that the “data suggested that student
learning outcomes were essentially the same for face-to-
face and fully online delivery.” This finding seems to be
pervasive in the literature comparing academic student
outcomes across different means of instruction.
Nevertheless, other studies found noticeable statistical and
practical differences in student achievement based on the
way that the courses were delivered [2, 7, 11, 14, 16, 29].
Therefore, the question remains whether online instruction
delivers the same academic results as traditional face-to-
face instruction. Despite the existence of hundreds of
studies which attempt to answer this question, none have
investigated it within the context of the Saudi educational
system.
The seminal work „There is No Significant Difference
Phenomenon‟,[30] concluded that there is no statistical or
practical difference in the student outcomes between
alternative modes of educational delivery. Russell‟s
analysis included over three-hundred and fifty-five articles,
reports, summaries, and related investigations which
indicated no significant difference in thestudents‟academic
and non-academic outcomes between face-to-face and
distance education forms of delivery. Despite the criticisms
Russell‟s work has received regarding its lack of
methodological rigor and inclusion criteria, a few meta-
analyses on the effect educational delivery modes have on
student academic and extracurricular outcomes found that
no tangible difference exists between face-to-face and
distance education delivery models such as hybrid, blended,
or fully online. In a meta-analysis investigation examining
the effects of traditional and distance education course
delivery on student achievement, attitudes, and retention
rates, utilizing one-hundred and fifty-seven studies, Hijazi,
et al. [31] found a slightly positive difference, suggesting
that distance education is actually more effective than face-
to-face delivery in respect to student achievement.
Nevertheless, there were no significant differences between
the various educational delivery systems in respect to the
student‟s attitude toward the courses. Similarly, a meta-
analysis conducted by Zhao, et al. [32] found no significant
difference in student outcomes when comparing courses
taught in traditional classroom settings and those taught in
any form of distance education. In a more recent study,
Dell, Low and Wilker compared student achievements in a
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
human development graduate course and three educational
psychology undergraduate courses taught both online and
face-to-face at a large Midwestern United States university
and concluded that the “results suggest there were no
significant differences between the work submitted by
students from the online sections and from the face-to-face
students, and the methods of instruction are more important
thanthedeliveryplatform”[33].
In a study comparing cyber and traditional learners‟
academic performance and perceptions on an introductory
economics course, Navaro and Shoemaker [34] found that
the online learners performed as well as or better than the
traditional students with respect to their academic
performance after holding the effects of gender, ethnicity,
academic background, academic aptitude, and computer
skills constant. Furthermore, the study reported higher
satisfaction rates amongst the cyber-learners compared to
traditional students. Similarly, Harmon and Lambronis [35]
found that the likelihood of answering a question correctly
on an economics exam is significantly higher if the material
was instructed and covered online versus in-class
instruction. The authors continued to suggest that online
instruction results in better academic performance
compared to traditional face-to-face instruction in a
classroom. Comparing student performance in computer
science courses taught both on campus and online, Dutton,
et al. [29] found that the online learners performed better
than the on-campus students. One possible explanation
offered by Dutton is that the online learners tend to be
older, employed, have children, and are more serious,
experienced, and skilled in a variety of aspects compared to
the younger on-campus college students. In a study
comparing student achievement in management courses
taught online and on-campus, Wilson and Allen [36]
concluded that “the assertion that online students perfor m
poorly relative to face-to-face students wasnotsupported.”
Controlling for gender, prior math knowledge, and high
school grades, Brown and Liedholdm compared student
performance in macroeconomics by measuring test scores,
finding that the on-campus students performed better than
the online students [37]. Similarly, Coates, et al., compared
student achievement in the macroeconomics section, and
also concluded that after controlling for age, working hours,
and prior college experience, the face-to-face learners
outperformed their online counterparts [38]. In a recent
reporttitled“OnlineCourse-Taking and Students Outcomes
in California Community Colleges,” the results indicated
that the on-campus learners who received face-to-face
instruction outperformed those who opted to take online
classes across the state community college system. The
authors concluded that “whichever way we look at it, we
are finding consistently that students are performing better
in the face-to-face sections versus the online sections" [39].
The wide variation in the findings regarding the effectiveness
of online instruction when compared to face-to-face course
delivery is resultant of a number of methodological
problems. First, selection bias characterizes a large number
of the samples used in the above cited studies; namely, the
researchers have not randomly assigned students into online
or face-to-face courses [29, 33-34]. On the contrary, the
students self-selected the medium of instruction that best
satisfied their need or desire. This jeopardizes the
representativeness of the samples, especially when the
researchers are only comparing one or two courses, totalling
a small number of students. Second, few studies compared
more than two courses, making it difficult to generalize based
on the small samples [35-37]. Making bold inferences, such
as online learning being as good, better, or worse than face-
to-face instruction, requires a larger sample. Most studies
including online and face-to-face courses do not exceed one
hundred students combined [29, 32, 36, 38]. While
researchers tried to control for instructor differences, material
variation, and course variation by making these as uniform as
possible, small student samples when taking the same course,
at the same college, with similar academic and demographic
backgrounds jeopardizes the key element of any sample: its
representativeness. Third, most comparisons of online and
face-to-face instruction were conducted by researchers who
taught the courses themselves [34, 36-38]. This results in
inducing a certain degree of bias generated by the
participation of the researcher. Researcher bias in social and
behavioural research is unavoidable [40-41].Theinstructors‟
choices, interactivity levels, motivation, charisma,
instructional rigor, and other contextual factors are likely to
influence the comparison results and make the online
instructions appear more or less effective compared to the
face-to-face instructions [35, 38]. Most comparisons of the
course delivery methods do not provide sufficient
information on possible researcher biases that could
influence the inferences based on their findings.
III. BENEFITS OF E-LEARNING
In a report reviewing one thousand empirical studies, the
U.S. Department of Education noted that a greater number
of well-documented benefits resulted from e-learning.
First, e-learning allowed students to access the content of
the courses at any time and from any place [42-43]. E-
learning also focuses on offering options to students unable
to attend face-to-face settings or those who wish not to
partake in the same learning experiences as traditional
students [14]. In addition, e-learning allows for the
distribution of learning materials in a more cost-effective
manner [45-46]. Lastly, e-learning permits the instructors to
reach out to more students while maintaining equivalent
standards of learning quality [42, 44, 46].
In studying the benefits brought about by the adoption of
e-learning in developing countries, Olson, et al. [47],
concluded that students, teachers, and both the economies
and societies in such areas would be greatly improved with
the implementation of e-learning [47-49]. The report
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
concluded that the use of laptops in student learning
experiences fosters team work qualities, independent
learning habits, the development of greater critical thinking,
and problem-solving skills in addition more time spent on
homework, thus enhancing the overall learning experience
[12, 17, 43]. E-learning also positively impacts the
performance of teachers who can utilize a variety of means
to motivate students, identify weaknesses to better target
student challenges, and become overall better teachers
through learning new technologies that are likely to
improve the quality of their teaching [50-51]. E-learning by
its very nature introduces both students and teachers to new
technologies, equipping both groups with the necessary
skills and knowledge essential for economic success in
today‟s world. E-learning generally enhances the overall
skillset of students as well as teachers, improving their
chances of obtaining and maintaining employment.
Studies of e-learning in Saudi Arabia have highlighted
the importance of such approaches in expanding
educational opportunities available for women and hard to
reach populations [18, 20]. First, the Saudi educational
system is based on Islamic tradition, where men and
women are not allowed to interact within the same
classroom [19, 21]. This requires universities to offer
equivalent versions of courses for each gender. E-learning
makes this process less expensive, and quality control is
better guaranteed by allowing the same instructors to teach
online or through an internally utilized system accessible to
both sexes [25]. Second, many areas of the Kingdom suffer
from limited access to universities. This population can be
more readily reached through the use of online education
conveyed wirelessly [26].
Additionally, e-learning could potentially be used as an
alternative model to traditional education in crisis and
disaster areas. Olson, et al. [47], concluded that e-learning
was a potential solution to the educational problems in
Libya following the February 14th revolution that resulted
in the death of Libyan leader Muaammar Al Gaddaffi. In
theauthors‟words
E-learning appears to be a promising alternative.
It can provide learning opportunities anytime
anywhere. It enables students and instructors to use
a wide range of Internet based tools to communicate,
collaborate and share resources, and open up
accessible educational opportunities. ICT and e-
learning could be used (as reconstructive and
attractive measures) to support the affected learners
and instructors in Libya.”
The ongoing conflict between Saudi Arabia, its allies,
and the Houthi rebel group and supporters in Yemen has
resulted in the closure of schools in many areas of southern
Saudi Arabia along the border. E-learning has emerged as a
viable alternative for many institutions such as Najran
University, which closed its classrooms in 2015 for safety
concerns. With the institutionalization of e-learning as an
alternative to traditional face-to-face learning, Najran
University has overcome the political crisis by delivering
its educational mission and standards online.
This study aims to investigate whether there is a tangible
difference in the academic performance between students
attending face-to-face courses and those enrolled online.
Furthermore, the study explores whether e-learning can serve
as an effective system overcoming some of the challenges
brought on by man-made or human crises such as interstate
conflict. The case study analysed here is that of a large public
university located in southern Saudi Arabia where all of its
computer science courses were moved online due to safety
concerns.
IV. HYPOTHESES, DATA AND METHODS
This study hypothesizes that students‟ academic
performance does not differ based on the medium of course
delivery in higher education institutions in the Kingdom of
Saudi Arabia. Further, the research hypothesizes that e-
learning can fulfil educational outcomes in a comparable
fashion to face-to-face educational settings. Available data
from the Computer Science department at Najran
University in southern Saudi Arabia is utilized. Najran
University suspended on-campus learning due to ongoing
conflicts between the Arab Coalition led by Saudi Arabia
and Yemeni rebel groups spearheaded by the Houthi Group.
The Department of Computer Science at Najran University
has collected detailed information on students‟ enrolment,
withdrawal, passing, and course completion rates, allowing
the comparison between face-to-face and online learning.
Najran University was established only recently with a
royal decree from King Abdullah Bin Abdulaziz in 2005,
quickly becoming the largest public university in the
Kingdom with an 18-million square meters campus. The
university has two campuses, one for males and the other
for females, with fifteens and ten colleges respectively. The
university intended to accommodate 45,000 students and
currently has a total enrolment of 14,000 students in its
undergraduate and graduate programs.
This research tests the effectiveness of an e-learning
program developed by the Department of Computer
Science at Najran University based on Andrade‟s [52]
online teaching theoretical framework. The model depicted
in Figure 1 integrates three of the most widely theoretical
frameworks in the distance education literature: Self-
Regulated Learning Model, Transactional Model and
Collaborative Learning Practices Model. This model starts
with designing courses that compel learners to exercise
goal-setting, development and application of strategies,
review of the implementation of those strategies and
fulfilment of set educational objectives. In addition, the
course content, materials, syllabi and supporting services
are designed with organized channels of communication,
interaction and dialogue with students. Instructors are
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
trained in fostering collaboration and harnessing help-
seeking practices among learners polishing off the
educational experience with a socially conducive
environment for collaboration and sustained learning. The
resulting e-learning program aimed at aggrandizing
learners‟ autonomy, self-direction and self-regulation to
support individual learning attitudes, behaviors and
improvement.
This framework suggests how distance education and e-
learning initiatives can blend transactional education
models, self-regulation learning models and collaborative
practices into a unified online delivery system. While the
model dimensions overlap and share few similar
characteristics such as structured, organized and facilitating
mediums of learning and instruction, each component is
distinctly fostering an independent pillar of distance
education. In the end, this increases learners‟ self-
regulation, structure, autonomy and educational
performance.
The data used in this study comes from two different
years, one taught traditionally in face-to-face instructional
settings and the other taught online using Learning
Management Systems (specifically Blackboard). All
students were tested on-site for final examinations
regardless of the medium of instruction. This analysis
excluded directed study, independent projects, and
graduation capstones because such courses are tailored to
one individual with a specific scope. Table 1 presents the
course names taught in all four semesters (two in the face-
to-face year and two in the online education year). Note that
courses taught in one semester but not in the other were
excluded in order to reduce non-comparable cases
Measures.
Thirty-six courses with a total enrolment of over 1,000
students over the four semesters are included in this
analysis. Each semester includes the same courses with
varying enrolment numbers. Face-to-face semesters
exhibited higher enrolments compared to online semesters.
Please not that this was the first time in the history of the
Saudi higher educational system, where a department
transferred all its courses from traditional settings to an e-
learning environment. Subsequently, there has been a
steady decrease in computer science courses at the
university and online enrolment is lower than that of face-
to-face courses. Note that students and courses included in
this analysis come from both the male and female campuses
at Najran University. Most students come from the city of
Najran, an urban area, and are enrolled in the undergraduate
curriculum of the department or other colleges around the
university. Most students are within the age range of 18 to
22 years old. Courses were taught by the same instructors in
TABLE I
COURSE NAME AND ENROLMENTS IN THE TWO SEMESTERS
Course Name
Visual Programming
Database Foundations
Information Systems Design and Analysis
Modern Approaches for Application Programming
Database Systems Architecture
Database Systems Administration
Database Systems Engineering
Database Systems Project Management
Computer Networks and Data Communication
Database Systems Strategies
Information Networks Administration
Electronic Business
Multi-medium Technologies
Internet Application Development
Decision Support Systems
Information Systems Security Administration
Computer Programming 1
Object Oriented Programming
Design and Analysis of Algorithms
Computer Organization and Collection Language
Unix Environment
Operating Systems
Theories of Computing
Computer Graphics
Human-Computer Interaction
Computer Architecture for CS Majors
User Interface Programming
Programming Engineering
Design and Construction of Translators
Artificial Intelligence
Foundations of Database Management Systems
Modern Topics in Computer Science
Computer Security
Social, Ethical and Professional Issues
Parallel and Distributed Systems
Internet Technologies
Total: 36
Fig.1. Adapted Online Teaching Theoretical Framework
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
both semesters, decreasing the influence of instructional
rotationandinstructors‟interactivitylevels.
Themaindependent variable intheanalysisis students‟
academic performance. This outcome is measured using
various indicators to cross-validate results obtained from
the analysis. First, the number of passing students in each
course serves as a simple indicator of students‟
performance. The higher the number of passing students,
the higher students‟ performance in the course is
considered. Second, the percentage of passing students
(passing rates) is another indicator of student performance.
The higher the percentage among those who took the entire
course and final examinations (and were not terminated,
suspended,or withdrawn), the higher is a course‟slevelof
student performance. Finally, withdrawal rates are taken as
another indicator of student performance. The higher
withdrawal rates are in a course, the lower the rates of
students‟ performance are recorded. Note that the
correlations between the three variables are sufficiently
high as evident in Table 2 which prompts the conclusion
that all such indicators measure a latent construct, student
academic performance. Taking all these measures together,
analysts can better evaluate student performance in face-to-
face as well as online learning environments.
The primary independent variable in this analysis is the
course delivery medium, a categorical indicator coded 0 if
the course was taught online and 1 if the course was taught
face-to-face. This leads to the conclusion that the unit of
analysis in this research is the individual course.
Information about courses, however, informs stakeholders
on student academic performance. Since this research is
aimed at establishing the direction and strength of
relationships among course delivery method and student
academic performance, the appropriate research strategy
proves to be quantities correlational design.
To evaluate the proposed hypotheses, a simple
comparative analysis between the means of course passing
rates, passing students and withdrawn students in the face-
to-face learning environment and online learning semester
is carried out. Since the courses taught are the same in four
consecutive semesters, a paired sample exists. Therefore,
the analysis utilizes the paired samples t-test to evaluate the
statistical and practical significance of the mean differences
in student performance between face-to-face and online
learning settings, if existent. The paired t-test is a repeated
measure design that is more powerful compared to other
designs such as between group designs.
V. RESULTS
Table 3 displays all 36 courses with passing rates in each
year. Note the value for passing rate is an average for the
course across two semesters, considered for each
corresponding year. The right-hand column presents the
difference between face-to-face values and online learning
values. Note that passing rates refers to the percentage of
those students who passed the course from the total number
of students who were admitted into the final examination
phase. For instance, if ten students in a computer science
programming course were admitted into the final
examination period and all passed the passing rate would
equal 100. The table indicates that 26 online courses have a
passing rate of 100% compared to about 17 courses in the
face-to-face learning environment.
Face-to-face courses had a higher rate of passing
students, with 24 courses featuring a higher number of
passing students in a face-to-face environment compared to
about 8 courses having online courses surpass face-to-face
participation in terms of the number of passing students.
Twenty-seven courses had the same number of withdrawn
students regardless of the medium of instruction, and all
such cases had zero students withdrawn from classes. In
about 14 courses, the difference between passing rates in
face-to-face and online courses exceeded 10 points. In fact,
in 4 courses the passing rate exceeded 30 points of
difference. Thirteen courses had higher passing rates for
online courses compared to 9 face-to-face courses. Fourteen
courses had the same passing rate in both semesters. The
results show marked differences in passing rates and the
number of passing students dependent on the medium of
instruction. Simultaneously, the findings show no real
differences in terms of the number of withdrawn students
among the courses based on whether they were delivered
online or face-to-face. Those differences, however, are seen
on the individual course level and the inspection at the
aggregate level follows below.
Figure 2 displays a bar chart with the course delivery
mode, face-to-face versus online, on the x-axis while the
mean of passing rates for courses in the 4 semesters is on
the y-axis. Notice that in both years, the mean of passing
rates was about 90%. The bars show a little difference,
indicating that online courses had a higher rate compared to
face-to-face courses. Nevertheless, such a difference seems
to be negligible, 0.5 or half a point. Figure 3 displays a bar
chart depicting the mean of passing students on the y-axis
and course delivery mode on the x-axis. The figure shows a
difference of 2.3 students; 7.1 for face-to-face courses and
4.8 for e-learning courses. This difference is non-negligible
and may be partly due to the larger number of students who
attended face-to-face courses compared to online courses.
Figure 4 displays the mean of withdrawn students in face-
to-face courses and online courses. The findings indicate
that the difference is miniscule, 0.3. Such figures
demonstrate that face-to-face and online courses have
TABLE 2
MEANS OF PASSING RATES BY COURSE DELIVERY METHOD
Variable
Passing
Rates
Passing
Students
Passing Rates
1.0
0.83
Passing Students
0.83
1.0
Withdrawn Students
-0.78
-0.82
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
similar passing rates and numbers of withdrawn students. Conversely, they differ with respect to the number of
passing students due to the larger student body size that
enrolled in face-to-face courses compared to online classes.
TABLE 3
COURSE NAME AND THEIR PASSING RATES
Course Name
Face-to-
Face
Enrolment
Online
Enrolment
Difference
Visual Programming
(88)
(100)
(-12)
Database Foundations
(88)
(100)
(-12)
Information Systems
Design and Analysis
(50)
(67)
(-17)
Modern Approaches for
Application Programming
(100)
(100)
(0)
Database Systems
Architecture
(89)
(100)
(-11)
Database Systems
Administration
(100)
(100)
(0)
Database Systems
Engineering
(71)
(50)
(21)
Database Systems Project
Management
(100)
(100)
(0)
Computer Networks and
Data Communication
(80)
(100)
(-20)
Database Systems
Strategies
(100)
(86)
(14)
Information Networks
Administration
(100)
(75)
(25)
Electronic Business
(95)
(91)
(4)
Multi-medium
Technologies
(89)
(71)
(18)
Internet Application
Development
(100)
(100)
(0)
Decision Support Systems
(92)
(100)
(-8)
Information Systems
Security Administration
(82)
(100)
(-18)
Computer Programming 1
(79)
(50)
(29)
Object Oriented
Programming
(31)
(100)
(-69)
Design and Analysis of
Algorithms
(89)
(100)
(-11)
Computer Organization
and Collection Language
(100)
(100)
(0)
Unix Environment
(67)
(100)
(-33)
Operating Systems
(89)
(100)
(-11)
Theories of Computing
(100)
(100)
(0)
Computer Graphics
(100)
(90)
(10)
Human-Computer
Interaction
(100)
(100)
(0)
Computer Architecture for
CS Majors
(100)
(100)
(0)
User Interface
Programming
(83)
(100)
(-17)
Programming Engineering
(71)
(0)
(71)
Design and Construction
of Translators
(100)
(100)
(0)
Artificial Intelligence
(86)
(50)
(36)
Foundations of Database
Management Systems
(91)
(100)
(-9)
Modern Topics in
Computer Science
(100)
(100)
(0)
Computer Security
(100)
(100)
(0)
Social, Ethical and
Professional Issues
(100)
(100)
(0)
Parallel and Distributed
Systems
(100)
(100)
(0)
Internet Technologies
(100)
(100)
(0)
Fig. 2 Passing Rates
Fig. 3 Quantity Passing
Fig. 4 Withdrawn students
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
Table 4 displays the means, standard deviations, and
sample sizes for the number of withdrawn students, number
of passing students, and passing rates for face-to-face and
online courses. As previously indicated, results show little
difference between course means with respect to passing
rates and the number of withdrawn students. Further, the
means seem to differ significantly, which will be assessed
more below, with respect to the number of passing students.
Despite the mean differences regarding the number of
passing students, the distribution of the variable is similar
with respect to the standard deviation (3.7 for face-to-face
learning versus 3.5 for online learning), suggesting similar
distributional characteristics. This indicates that the likely
explanation for the mean difference is simply the larger size
of student enrolment in the face-to-face semester.
Table 5 presents the results of three paired sample t-tests
on passing rates, the number of passing students, and the
number of withdrawn students. Please note that each course
included in the analysis received two measurements, one is
the average for the two face-to-face semesters and one for
the two online learning semesters. This allows detecting the
statistical and practical differences in means among the
three variables. Results indicate that mean differences with
respect to passing rates and the number of students
withdrawn from courses are not statistically significant,
with p-values of 0.880 and 0.850 respectively. The
confidence intervals for both variables at the 95% level
contains zero in them, indicating that the mean differences
are not statistically significant. The slight difference in
means yields no practical significance in the two variables.
On the other hand, the p-value corresponding to the number
of passing students is 0.006 with a t-value of 2.93
indicating statistical significance. This result is consistent
with the large practical means‟ difference betweenface-to-
face and online courses with respect to the number of
passing students. This result may be due to the larger
number of students who registered in the face-to-face year
compared to the online learning year.
This research tested an integrated e-learning framework
based on self-regulation learning models, transactional
distance learning and collaborative practices. The model
presented in Figure 1 wassupportedbyNajranUniversity‟s
experience. Student academic performance in Computer
Science was found to be satisfactory and equal to that
obtained through face-to-face instruction. The department‟s
data indicated that the Computer Science faculty designed
well-structured courses that helped students in fostering
goal setting, applying helpful learning strategies and
monitoring their progress. Further, evidence indicates that
the level of interactivity between faculty and students, as
well as students with each other was high, fostering a
collaborativelearningenvironment.Finally,Najran‟sonline
experience provided evidence that well designed online
education fosters adequate learner autonomy capable of
improving student academic performance.
Figures 5-9 present findings based on an internal
departmental assessment of faculty performance throughout
the e-learning year. First, the department reported that there
was a high participation rate from the faculty teaching
online. Figure 5 shows that on average, 82% of the teaching
faculty have provided the department with information
about their courses throughout the 11-week long semester.
By the same token, Figure 6 displays the percentage of
content uploaded by faculty members throughout the
semester. The graph indicated that on average, 87% of
faculty members uploaded their materials online for
students to use throughout the semester. Figure 7 indicates
that faculty members heavily used the virtual classes,
resulting in a semester average of 83%. Figure 5 suggests
that on average, 18% of classes were missed due to
technical problems per week, and Figure 8 shows that the
faculty members experienced a moderate number of
TABLE 4
MEANS COMPARISON BETWEEN FACE-TO-FACE AND ONLINE COURSES
Delivery Mode
Withdrawal
Passing
Passing Rate
Face-to-Face
Learning
Mean
.3784
7.1081
89.4595
N
37
37
37
Std. Dev.
.82836
3.73262
15.37782
E-learning
Mean
.4054
4.8649
90.0000
N
37
37
37
Std. Dev.
1.01268
3.53681
21.55871
Total
Mean
0.3919
5.9865
89.7297
N
74
74
74
Std. Dev.
.91887
3.78350
18.59835
TABLE 5
PAIRED T TESTS RESULTS
Paired Samples Test
Paired Differences
t
df
Sig.
Mean
Std. Deviation
Std. Error Mean
95% Confidence Interval of the
Difference
Lower
Upper
Pair 1
Passing1 - Passing2
2.24324
4.6452
0.76367
0.6944
3.79204
2.937
36
0.006
Pair 2
Passing Rate1 - Passingrate2
-0.54054
21.613
3.55324
-7.7468
6.66577
-0.152
36
0.880
Pair 3
Withdrawl1 - Withdrawl2
-0.02703
0.8655
0.14230
-.31563
0.26158
-0.190
36
0.850
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
technical issues while teaching online with an average of
almost 30% a week. Figure 9 shows that almost half of the
lectures were recorded through the Learning Management
System used by the department.
Those graphs indicate that faculty members were actively
engaged in utilizing the available resources for teaching
their assigned courses online. The high percentages of
faculty participation, low percentage of missed classes, and
the moderate number of technical issues coupled with high
rates of course accomplishment as outlined above, shows
that the e-learning experience within the department has
proved to be quite successful.
Results indicated that face-to-face and online learning do
not significantly differ. The paired t-test findings alluded
that the mean differences in passing rates and the number of
passing students were not statistically or practically
significant. With respect to the number of withdrawn
students, the difference in means was statistically
significant; however, the larger size of enrolment in the
face-to-face instruction semester may have generated such a
result. The internal departmental investigation has
established that faculty actively participated, delivered, and
evaluated learning outcomes during the e-learning semester.
This indicates that online education is as effective as face-
to-face instruction, yielding similar results.
VI. DISCUSSION AND CONCLUSION
This study supports the no significance hypothesis,
suggestingthatastudent‟sperformancedoes not differ with
respect to the educational delivery mode (face-to-face
versus online) [2, 4, 6, 8, 11]. While this research is novel
given its exploration of a new context (Saudi Arabia) and
breadth (inclusion of all courses offered by a large
computer science department), the findings of the study
confirm the earlier results by concluding that the course
delivery technique has little impact when it comes to
justifying the course passing rates. It is difficult to
generalize these findings across all Saudi universities,
departments, or Middle Eastern higher learning institutions,
though such findings should persuade opponents of e-
Fig.5. Overall faculty participation.
Fig.6. Overall faculty participation in uploading lectures
Fig. 9. Overall percentage of recorded lectures through BB collaborates
Fig. 8. Overall number of technical problems faced
Fig.7. Overall faculty usage of virtual class in the blackboard systems
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
learning implementation by demonstrating that it carries the
same, if not better, results than traditional face-to-face
learning.
One of the main findings is that enrolment rates in the
online semester were significantly lower than the face-to-
face semester. This difference may be due to students‟
increased fears of taking online courses. Notice that Najran
University‟s experiment withonline teaching ist helargest
and first of its kind in the Kingdom. Students perceive
online courses as lacking in support, interactivity,
connectivity, and as more difficult academically. For such
reasons, Saudi students are likely to avoid registering in
online courses. University administrators should increase
student confidence levels in online education through an
awareness campaign showing the mechanics, logistics,
usefulness, accessibility, and interactivity of online courses.
University faculty should receive formal training in
delivering course contents through Learning Management
Systems and following best practices for teaching via
online platforms. While universities in Saudi Arabia are
expanding their online education programs, they still need
to do more work to harness students trust in e-learning.
This study‟s findings challenge popular perceptions
among educators as well as policy-makers in Saudi Arabia
and the Middle East about the effectiveness of e-learning.
These  perceptions include: lower quality of education
offered by e-learning compared to face-to-face settings, the
lack of need given comprehensive on-campus programs,
insufficient knowledge about the nature, implementation, or
potential of e-learning, and the substantial bureaucratic
burdens associated with creating new e-learning programs.
Further, this study demonstrated that e-learning in Saudi
Arabia is capable of delivering the same, if not better,
educational quality as that provided by traditional delivery
settings. It has also shown that the implementation and
maintenance of e-learning courses and programs does not
involve the contracting of immense resources. Given the
outcomes, this research contributes to the efforts of
adopting and expanding e-learning initiatives across the
region.
In addition, this study has shown the power of
Information Communications Technologies (ICTs) in
overcoming challenges such as war or natural disasters by
delivering the educational mission and vision of higher
learning institutions remotely. E-learning has proven to be a
successful course delivery method at Najran University.
The Computer Science Department was able to engage its
faculty, staff, and resources to teach all of its courses online
while the university closed its doors for traditional learning
due to the worsening humanitarian conditions resulting
from the political crisis between Saudi Arabia and Yemen.
While the student evaluations of their online experience are
not well documented, the data obtained from the
department indicated high levels of success characterizing
the e-learning program at Najran University.
This research opens paths for future research on the
impact of e-learning on student performance in the Middle
East, an unexplored area of inquiry. It also encourages
future study on the applicability and potential of e-learning
in areas unraveled by political instability and conflict. E-
Learning is developing exponentially across the Kingdom
of Saudi Arabia and the Middle East generally. Therefore,
more concern should be devoted to its effectiveness,
implementation, and impact on students' academic and non-
academic outcomes.
Natural disasters in the form of hurricanes, wildfire,
floods, famines, or civil and interstate conflicts regularly
prevent millions of children, college students, and adult
learners from accessing brick and mortar schools, colleges,
or universities. E-learning can mitigate the magnitude and
severity of these impacts on education delivery. Refugees in
host countries may fully access wired computer labs
connected to university and school servers abroad. Thus,
access to education for vulnerable groups such as refugees
or those affected by natural disasters improves significantly
with the prospects of e-learning. The use of e-learning as an
alternative medium of education for all levels should be
seriously considered in areas suffering from emergencies
such as a number of Middle Eastern nations including
Syria, Iraq, Libya, Yemen, and Lebanon.
At best, E-learning costs less than constructing and
maintaining educational facilities. It also requires a lower
number of academic and administrative staff. E-learning
eliminates heavy dues and the hefty requirements of
running large educational facilities, proving to be a solution
for delivering basic educational curriculum to suffering
populations. It can also be administered from a long
distance, connecting the best brains available and desiring
to assist in lessening the hardships faced by affected student
groups. The best example can be offered by large Massive
Open Online Courses platforms such as Coursera. Despite
the shortcomings of any online educational medium, it can
at least be accessed by hard to reach populations who can
have access to the study material online and practice what
they learn using virtual machines from their homes, cafes,
designated learning labs, or anywhere connected to the
internet. For all such reasons, e-learning is an effective tool
in delivering educational goals in crises ridden areas such
as the southern borders of Saudi Arabia.
This research contributes to the efforts of making higher
education more accessible, efficient and sustainable in
Saudi Arabia as well as in other areas are affected by
disasters, natural or otherwise. Najran‟s university
experience provides compelling evidence that the university
curriculum, instruction and evaluation can reach more
students faster through its e-learning program than its brick
and mortar apparatus. Equity in education is defined by two
components: access and quality. Delivering educational
content by Saudi universities online can reach the same
desired population targeted through face-to-face
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
approaches. Student performance rates in the computer
science department, one of the toughest areas of education
across the university, did not fall in the e-learning program.
On the contrary, in many courses, students‟ academic
achievement improved significantly. Faculty members
reported high levels of self-reported satisfaction with the
quality of courses delivered online at Najran university.
Informal assessments by the College, department and allied
staff exhibited high levels of approval with the statement,
“online courses provide equal if not superior quality
educationtotraditionalmethodsofinstruction.” Oneofthe
more increasingly used indicators to measure quality of
coursesisstudents‟satisfaction.
Detailed discussions with students who enrolled in both
sessions, the face-to-face and online phases, reported higher
satisfaction with the online delivery method. This is due to
the ease of access, processing and retrieval of course
materials posted on Blackboard. All in all, online education
seems to score higher on equity, access and quality than
face-to-face instruction. E-learning serves as a sustainable
form of education. It is cheaper to provide online courses
than on-campus courses. E-learning utilizes less material
resources, less human capital and is more agile compared to
face-to-face education. E-learning not only saves
universities undue costs to broaden the educational, service
or research endeavors of students and faculty, but also
delivers education and resources in a timely, easily tractable
and monitored fashion. Therefore, this paper supplies
higher education stakeholders in Saudi Arabia with telling
results that Najran university‟s experience with e-learning
presents Saudi students with more equitable, accessible,
quality and sustainable education compared to face-to-face
approaches.
This research does not only present an on-going extensive
debate on whether e-learning provides satisfactory
educational gains, but also tests the effectiveness of an e-
learning program in a previously neglected context: the Saudi
higher education system. It also outlines the potential
benefits offered by e-learning in war-ridden zones. This
research offers a real success story where e-learning
delivered efficient, equitable, accessible and high-quality
education to students who could not attend classes due to an
ongoing war. This is a novel research agenda attempting to
address an internationally forgotten crisis, inadequate access
to high quality higher education in hard to reach geographic
areas, war-zones, areas suffering from epidemics, natural
disasters, civil wars or other types of emergencies.
REFERENCES
[1] Albalawi, M.: Critical Factors Related to the Implementation of
Web-Based Instruction by Higher-Education Faculty at Three
Universities in the Kingdom of Saudi Arabia (Doctoral Dissertation).
Department of Instructional and Performance Technology,
University of West Florida (2007)
[2] Jaggars, S., and Bailey, T.: Effectiveness of Fully Online Courses
for College Students: Response to a Department of Education Meta-
Analysis. CCRC Publications: New York, NY (2010)
[3] Eom, S., Wen, S., and Ashill,A.:  The Determinants of Students‟
Perceived Learning Outcomes and Satisfaction in University Online
Education: An Empirical Investigation. Decision Sciences: Journal of
Innovative Education 4(2), 215-235 (2006)
[4] Swan, K.: Learning effectiveness: what the research tells us. In J.
Bourne & J. C. Moore (Eds) Elements of Quality Online Education,
Practice and Direction, 13-45. Sloan Center for Online Education:
Needham, MA (2003)
[5] Harasim, L.: Shift happens: online education as a new paradigm in
learning. The Internet and Higher Education 3(1-2), 41-61 (2000)
[6] Jung, I. and Ilju, R.: Effectiveness and Cost-Effectiveness of Online
Education: A Review of the Literature. In Educational Technology
40(4), 57-60 (2000)
[7] Volery, T. and Lord, D: Critical success factors in online education.
International Journal of Educational Management 14(5), 216-223
(2000)
[8] Kearsley, G., et al.: The Effectiveness and Impact of Online
Learning in Graduate Education. CCRC Publications: New York,
NY (1995)
[9] Allen, I. and Seaman, J.: Sizing the Opportunity: The Quality and
Extent of Online Education in the United States, 2002 and 2003.
Sloan Consortium: Newburyport, MA (2003)
[10] Allen, I. and Seaman, J.: Learning on Demand: Online Education in
the United States, 2009. Sloan Consortium: Newburyport, MA
(2010)
[11] Lim, D., Morris, M., and Kupritz, V.: Online vs. blended learning:
Differences in Instructional Outcomes and Learner Satisfaction.
ERIC-education resources (2014)
[12] Bell, B., and Federman, J. E-learning in Postsecondary Education.
The Future of Children 23(1), 165-185 (2013)
[13] Lizzio, A., Wilson, K., and Simons, R.: University Students‟
Perceptions of the Learning Environment and Academic Outcomes:
Implications for theory and practice. Studies in Higher Education
27(1), 27-52 (2010)
[14] Lee, S., et al.: Examining the relationship among student perception
of support, course satisfaction, and learning outcomes in online
learning. The Internet and Higher Education 14(3), 158-163 (2011)
[15] Herrington, J. Oliver, R. and Reeves, T.: Patterns of engagement in
authentic online learning environments. ASCILITE 2002
Conference, 8-11 December 2002, Auckland, New Zealand, 279-286
(2002)
[16] Muilenburg, L. and Berge, Z. Student barriers to online learning: A
factor analytic study. Distance Education 26(1), 29-48 (2007)
[17] Anderson, T.: The Theory and Practice of Online Learning.
Athabasca University Press: Edmonton, AB, Canada (2008)
[18] Alaugab, A.: Benefits, barriers, and attitudes of Saudi female faculty
and students toward online learning in higher education (Doctoral
Dissertation). University of Kansas (2007)
[19] Hamdan, A.: The reciprocal and correlative relationship between
learning culture and online education: A case from Saudi Arabia.
IRRODL: The International Review of Research in Open and
Distributed Learning 15(1) (2014)
[20] Al-Fahad, F.:  Students‟ Attitues and Perceptions towards the
Effectiveness of Mobile Learning in King Saud University, Saudi
Arabia. TOJET: The Turkish Online Journal of Education
Technology 8(2) (2009)
[21] Alamri, M.: Higher Education in Saudi Arabia. Journal of Higher
Education Theory and Practice 11(4), 88-91 (2011)
[22] Lloyd, S., Byrne, M., and McCoy, T.: Faculty-Perceived Barriers of
Online Education. Journal of Online Learning and Teaching 8(1), 1
(2012)
[23] Alebaikan, R. and Troudi, S.: Blended learning in Saudi universities:
challenges and perspectives. ALT-J, Research in Learning
Technology 18(1), 49-59 (2010)
[24] Nassuora, A.: Students Acceptance of Mobile Learning for Higher
Education in Saudi Arabia. American Academic & Scholarly
Research Journal 4(2), 1-6 (2012)
[25] Al-Shehri, A.: E-learningin SaudiArabia: „toEor not to E, that is
the question‟. Journal of Family and Community Medicine 17(3),
147-150 (2010)
2169-3536 (c) 2018 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See
http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/ACCESS.2018.2800164, IEEE Access
VOLUME XX, 2017 9
[26] Yamani, H.: E-learning in Saudi Arabia: Challenges and
opportunities. Journal of Information Technology and Application in
Education 3(4) (2014)
[27] Garrison, D. and Kanuka, H.: Blended learning: Uncovering its
transformative potential in higher education. The Internet and Higher
Education 7(2), 95-105 (2004)
[28] Sussman, S. and Dutter, L.: Comparing Student Learning Outcomes
in Face-toFacce and Online Course Delivery. Online Journal of
Distance Learning Administration 13(4) (2010)
[29] Dutton, J., Dutton, M., and Perry, J.: How Do Online Students
Differ From Lecture Students? JALN 6(1) (2002)
[30] Russell, T.: The no significant difference phenomenon. IDECC:
Chicago, Illinois (2001)
[31] Hijazi, S., et al.: Interactive Technology Impact on Quality Distance
Education. Electronic Journal of e-Learning 1(1), 35-44 (2003)
[32] Zhao, Y., et al.: What makes the difference? A practical analysis of
research on the effectiveness of distance education. Teachers College
Record (2005)
[33] Dell, C., Low, C., and Wilker, J.: Comparing Student Achievement
in Online and Face-to-Face Classes. Journal of Online Learning and
Teaching 6(1), 30 (2010)
[34] Navarro, P. and Shoemaker, J.: Performance and perceptions of
distance learners in cyberspace. American Journal of Distance
Education 14(2), 15-35 (2000)
[35] Harmon, O., and Lambrinos, J.: Student performance in traditional
vs. online format: evidence from an MBA level introductory
economics class (2007)
[36] Wilson, D. and Allen, D: Success rates of online versus traditional
college students. Research in Higher Education Journal 14, 1-9
(2011)
[37] Brown, B. and Liedholm, C.: Can Web Courses Replace the
Classroom in Principles of Microeconomics? The American
Economic Review 92(2), 444-448 (2002)
[38] Coates,D.,etal.:“Nosignificantdistance”betweenface-to-face and
online instruction: evidence from principles of economics.
Economics of Education Review 23(5), 533-546 (2004)
[39] Hart, C., Friedmann, E., and Hill, M.: Online Course-Taking and
Students Outcomes in California Community Colleges (digital
paper). Education Department, UC Davis (2016)
[40] Chenail, R. Interviewing the Investigator: Strategies for Addressing
Instrumentation and Researcher Bias Concerns in Qualitative
Research. The qualitative Report 16(1), 255-262 (2011)
[41] Dieckman, E.: A procedural check for researcher bias in an
ethnographic report. Research in Education 50, 1 (1993)
[42] Harasim, L.: Online Education: The Future. In Harrison, T. and
Stephen, T. (Eds.), Computer Networking and Scholarly
Communication in the Twenty-First-Century University (pp.203-
214). SUNY Press: Albany, NY (1996)
[43] Means, B., et al.: Evaluation of Evidence-Based Practices in Online
Learning: A Meta-Analysis and Review of Online Learning Studies.
US Department of Education, Office of Planning, Evaluation, and
Policy Development: Washington, D.C. (2010)
[44] Means, B., et al: The Effectiveness of Online and Blended Learning:
A Meta-Analysis of the Empirical Literature. Teachers College
Record 115 (2013)
[45] Bartley, S. and Golek, J.: Evaluating the Cost Effectiveness of
Online and Face-to-Face Instruction. Journal of Educational
Technology & Society 7(4), 167-175 (2004)
[46] Simonson, M., et al.: Teaching and Learning at a Distance:
Foundations of Distance Education. Pearson: London (2011)
[47] Olson, J. et al: An Analysis of e-Learning Impacts & Best Practicies
in Developing Countries: With Reference to Secondary School
Education in Tanzania. The ICT4D Program, Michigan State
University: Lansing, MI (2011)
[48] Capper, J.: E-Learning Growth and Promise for the Developing
World. In TechKnowLogia 3(3), 7-10 (2001)
[49] Sife, A., Lwoga, E., and Sanga, C.: New technologies for teaching
and learning: Challenges for higher learning institutions in
developing countries. International Journal of Education and
Development using ICT 3(2) (2007)
[50] Sandholtz, J., et al: Teaching with Technology: Creating Student-
Centered Classrooms. Teachers College Press, Columbia University:
New York, NY (1997)
[51] Ertmer, P.A.: Teacher pedagogical beliefs: The final frontier in our
quest for technology integration? Educational Technology Research
and Development 53(4), 25-39 (2005)
[52] Andrade, M. S. (2015). Effective eLearning and eTeachingA
Theoretical Model. In E-Learning-Instructional Design,
Organizational Strategy and Management. InTech.
Khairan D. Rajab (M‟06) is working as an Assistant Professor, Vice
Dean of E-learning and Distance Education and also the Head of Network
and Communication Engineering Department at College of Computer
Science and Information Systems (CSIS), Najran University, Najran,
Saudi Arabia. He received Ph.D. in Computer Science and Engineering
from the University of Southern Florida, United States under supervision
of Prof. Les A. Piegl. He also received his Masters from the University of
South Florida and his bachelor from the University of South Carolina,
United States. Dr. Rajab has published more than 16 research papers in
high impact factor journals and reputable conferences. He is also a
reviewer and editorial board of several research conferences and journals.
His research interests are geometric modeling, NURBS, data mining, and
network security, as well as cyber learning; in addition, he is a member of
IEEE and College Council at CSIS.
... However, implementing AI-powered elearning in conflict zones comes with its challenges. For example, [9] provided a comparative study focusing on Saudi Arabia based on e-learning and inperson education. The study data indicate that elearning, when implemented correctly, shows an effectiveness equivalent to other methods without being superior or inferior to them. ...
... [4] Argued that such systems can adapt educational content to make individual students more engaged with learning results. Similarly, [9] expressed that elearning as an instructive framework can be a positive factor contributing to and contending effectively with the conventional system through equal exactness in learning quality, however better than expected execution result-wise. ...
Article
Full-text available
Transforming education in conflict zones has not been extensively studied. This paper aims to investigate higher educational levels in conflict zones for Artificial Intelligence (AI)-enabled adaptive e-learning systems concerning schooling in Palestine. This paper constructs a comprehensive technology adoption model that explains these factors in distance education without needing the Internet. The descriptive-analytical method and the questionnaire were used for data collection. The survey included 30 questions adapted from previous studies. The focus was on the conflict areas before the war on Gaza. An electronically designed questionnaire was distributed. Data from 205 schools in Gaza were analyzed using Smart PLS 4. The results show that Perceived Usefulness (PU), Perceived Ease of Use (PEU), and System Quality (SQ) positively influence BI Behavioral Intention toward system use, while IQ Information Quality indicates areas for improvement. This paper shows AI-powered e-learning systems' transformational impact in bringing customizable, convenient, and scalable learning in resource-constrained regions. The findings suggest the importance of Information and Communication Technology (ICT) infrastructure, digital literacy training, and inclusive strategies to provide equitable access to these technologies in conflict zones and inspire others.
... Shahid and Ali (2017) found that Saudi male undergraduate English major students performed better in their listening comprehension tests than those who did not. As a fragment of the Saudi Vision 2030, the government of Saudi Arabia has emphasized the active assimilation of technology to improve the learning and teaching process (Rajab, 2018). Besides, this study observed that the ELP students positively perceived the infrastructure and learning resources and digital technology use with a mean score of more than 3.8, denoting ELP in Saudi Arabia offering adequate infrastructure and learning resources and the student's preference for using digital technology for learning. ...
Article
Full-text available
According to the Saudi Vision 2030, the country will continue focusing on the education system by enhancing the learning environment, curriculum, teaching methods, and digital education and preparing their residents for labor market needs. Therefore, this study focuses on revealing the status of the English language program considering Saudi Vision 2030 from students’ perspectives. An exploratory study was conducted with the population of final-year students (N = 160) of the undergraduate English language program (ELP) in two female campuses (80 from each campus) of a public university in Saudi Arabia. A self-structured online questionnaire was distributed among them to assess the students’ perceptions of the status of ELP considering Saudi Vision 2030. Among 160 students, 132 responded to the questionnaire. 76.2% perceived that the courses supported them in improving their English language proficiency. More than 75% of students felt that the program aided them in developing their professional skills and ability to work in diverse cultures. Their faculty members also motivated them to build their knowledge and skills. 81.8% agreed that the ELP provided them with adequate knowledge and skills required by the labor market after graduation. Overall, 83.8% of ELP students were satisfied with the status of the ELP considering Saudi Vision 2030. Saudi universities should continue their strategies to improve ELP students’ knowledge and skills, thereby boosting their ability to compete with the national and international labor market and achieve Vision 2030 objectives.
... In general, the author also emphasized the effectiveness of this form of education. Rajab (2018) also compared the results of online learning of students based on the teaching of certain disciplines with the results of face-to-face learning. The author came to the conclusion that learning based on non-remote or blended learning is effective for providing educational services in war-affected areas. ...
Article
Full-text available
Digitalization is an important innovative approach to the development of the entire education system. The Covid-19 pandemic has significantly intensified it, and now, despite all the global challenges, it continues to develop actively. Therefore, this problem is relevant and requires a thorough study of the peculiarities of introducing digital technologies into the education system. Therefore, the purpose of the paper is to study the digital transformation of education through the prism of analyzing innovative technologies that contribute to its development. A quantitative research approach was used for this purpose. The participants of this study are 211 teachers and students from different educational institutions. The selection procedure was purposeful and based on several inclusion criteria, including experience in using technology. The main tools for the study were questionnaires and focus group interviews. Data processing was carried out in stages with the appropriate use of scientific methods of knowledge: content analysis, cluster analysis, factor analysis, and comparison method. The results of the study demonstrated the wide awareness of modern teachers and students of innovative tools. Based on the interviews, it was determined that the use of digital technologies in the learning environment has a number of advantages, including the speed of providing initial information, flexibility and accessibility. It is established that the use of digital technologies in education improves students' perception, increases the level of motivation and interest in learning. The conclusions summarize the main opportunities for the development of the digital education system and characterize potential ways to improve it. In particular, it is established that important issues that need to be addressed are ensuring a safe learning cyber environment, improving the material and technical base, and further developing the digital literacy of teachers.
... As a result, higher education students were most concerned about the uncertainty of the procedure for conducting online exams, as well as the criteria for assessing and making up missed classes, working with information resources, etc. On the other hand, the use of the digital environment for many students has generally lost some seriousness [5]. They avoided answering questions and did not complete assignments on time. ...
Article
Full-text available
The purpose of the study is to investigate the impact of special educational programmes on the psychological and emotional development of higher education students. To achieve this goal, survey methods were used (200 participants). The method of content analysis was used to study the scientific literature on this issue. The results show that the use of modern programmes has led to a number of organisational challenges related to ensuring a stable Internet connection and limited opportunities to acquire practical skills that are important for many specialities. This situation caused particular anxiety among students. The study showed that students generally have a positive perception of the use of modern technologies and methods. However, there are also negative aspects of constant interaction with the digital environment, such as atomisation, problems with soft skills development, the risk of emotional burnout, etc. Overcoming these challenges is possible through the evolution of the organisation of the educational process. The creation of smaller academic groups of students provides opportunities for deeper interaction and the development of relevant communication skills. The conclusions emphasise that the development and implementation of new methods that can quickly adapt to modern educational environments is a promising area for further research.
... This is in line with the findings of other researchers. (39,40) Moreover, a fairly small proportion of teachers who have worked with Google tools evaluate them less positively (satisfactorily or ineffectively), which can be explained by individual technical problems in their work or gaps in the acquisition of relevant digital competencies. Such reasons are most often mentioned in the scientific literature. ...
Article
Full-text available
Introduction: In the modern world the digitalization of educational trends offers many mechanisms for implementation. At the same time their use depends on many conditions. The purpose of this article is to study the peculiarities of using Google web applications to create an accessible and interactive learning environment in wartime. The main objective are using Google tools to implement education in wartime, describe the results of their use, finding its efficiency. Method: The realization of this goal involves the use of certain scientific methods. In particular, we are talking about the use of a survey and the method of content analysis of scientific literature, which made it possible to compare the Ukrainian experience with the existing paradigms of perception of Google tools in education. Results: The study results show that Google web applications are an important part of the modern educational process. All applications have a simple and user-friendly interface. The measurements showed that Google Classroom (33.33%) and Google Meet (26.67%) are the most used applications. This proves their important role in organizing online classes both at the organizational and direct learning levels. Teachers also use Google Drive, Google Docs, and Google Forms, which fulfill their function in organizing the modern educational process. Conclusion: The conclusions note that the importance of further research is dictated by the need to take into account new changes and capabilities of the tools.
... For example, Rajab (2018) noted that during the military crisis, there was no recorded decrease in the quality of education received due to the transition to the use of digital technologies in education, and the frequency of their use only improves the desired effect in education. It is obvious that this trend will continue, as the integration of online technologies into educational processes will only grow. ...
Article
Full-text available
Due to the rapid development of technologies, the study of the problem of the implementation of online education acquires special importance. In Ukraine, this process is accompanied by separate challenges and opportunities that require detailed analysis. The main goal of the study is to study the prospects and problems of the development of online education in Ukraine through the analysis of qualitative and quantitative data collected from literary sources and surveys of participants. Therefore, the study uses a mixed approach to studying the problem. The date range of literature selection: from 2018 to 2024, including some works from 2015. The survey was conducted from January 2024 to May 2024 among 77 participants: 45 students and 32 teachers from various educational institutions of Ukraine. Therefore, the analysis showed that the implementation of the online system faces challenges, in particular, infrastructure problems, technical difficulties and energy interruptions are noticeable. Also, based on the survey, students noted a low level of motivation. The conclusions emphasize the importance of implementing innovative solutions in the online education support environment and offer various recommendations for further steps in the system of improving this approach. Thus, the study contains an important practical component for the development of the following mechanisms for improving the quality of online education in Ukraine.
... Asynchronous online learning is advantageous in places with limited internet connectivity because it provides flexibility and offline resource access [13]. Najran University in Saudi Arabia is one successful example of how e-learning works well in emergency situations [25]. However, according to our survey, medical students may find that having reliable internet and electronic devices alone isn't sufficient in a time of war. ...
Article
Full-text available
The ongoing war crisis in Khartoum, Sudan, has created significant challenges for medical students, impacting their education. A cross-sectional study involving 224 medical students was conducted in Khartoum state to explore the challenges faced by medical students during this crisis, using a structured Google Form questionnaire. The majority of participants were female (65.6%), fourth-year students (36.6%), and aged between 22 and 25 years (66.8%). Notably, 92% of the participants had been displaced from Khartoum. The study found that a majority of participants reported experiencing physiological distress, with study distractions (65.2%), anxiety (51.8%), and depression (49.1%). Significant gender differences were observed, with females reporting higher psychological distress compared to males (p-value = 0.04). Additionally, 45% of participants noted that the war led to a shortage of experienced teaching staff, and 56.6% raised concerns about the potential decline in the quality standards of their university's curriculum. Nearly 48% of participants expressed a desire to collaborate with international or local universities in stable regions to continue their education. However, 20.2% believed that online learning can effectively maintain the continuity of their education. A significant correlation was found between university type and the ability to resume activities online or outside of Khartoum State (p-value = 0.01). The study concludes that the war crisis in Khartoum State has had significant, negative consequences for medical students, impacting their mental well-being, access to necessary resources, and overall learning experiences. Immediate interventions, psychological support, and increased coordination and collaboration among international and regional academic institutions are needed. Supplementary Information The online version contains supplementary material available at 10.1186/s12909-024-06358-2.
... Due to infrastructure weaknesses and a lack of appropriate capabilities to resume face-to-face teaching of medical radiation technology in Sudan's safe states, the majority of the universities to which these colleges belong have decided to resume the educational process via e-learning [4]. However, research on the effectiveness of online education is both extensive and equivocal [5]. Two studies discovered no significant difference in academic achievement between online and in-person courses [6,7]. ...
... Al-Husain and Hammo [52] suggested that college students lack fundamental computer science and programming skills, negatively impacting their graduation likelihood and timely degree completion. By the same token, Rajab [53] noted a high dropout rate among computer science majors at Najran University in Saudi Arabia caused by a lack of technical ability, literacy, and adaptability. ...
Article
Full-text available
Career and College Readiness (CCR) generates higher levels of persistence, grit, motivation, and competencies in performing work-or school-related tasks among learners during post-secondary life. One primary limitation defining the present scholarship on CCR is the authentic analysis of the on the ground or field practices high schools perform to increase learners' CCR competencies. The inadequate research on actual CCR practices in high schools motivated this study. To learn more about how high schools prepare students for post-secondary life, 16 principals from high schools provided detailed narratives on CCR practices in their institutions. Principals completed interviews of one to two hours using Microsoft Teams, supplying the researcher with specific information and examples of how their institutions equip students for future careers and higher education. Manual qualitative thematic analysis of the entire transcript guided the organization and interpretation of the findings, allowing the presentation of meaningful themes supported by a plethora of illustrations. Six themes representing 18 distinct CCR practices emerged, and the themes were rigorous curriculum, content knowledge, key academic behaviors, key cognitive strategies, multiculturalism, and citizenship development. Results partially supported the pervasive CCR model based on Conley's readiness index. Increasingly, diversity and citizenship learning have defined high schools' CCR work in preparing learners to become effective local and global citizens. The current investigation paves the way for future observational and field research uncovering whether schools truly prepare students or not, and such preparation varies across community, country, and institutional characteristics.
Article
Full-text available
Introduction Distance learning has seen a significant increase as educational institutions have shifted toward offering online courses. Although some institutions quickly adapted, many struggled to modify traditional materials for online learners. Time was crucial for institutions lacking experience in remote teaching. Designing engaging online cybersecurity modules for diverse students is a major challenge. With the growing popularity of online courses, it is necessary to examine the teaching methods used. This paper presents a systematic literature review on the current state of online cybersecurity education at universities. Using the PRISMA approach, the study identifies prevalent themes and addresses key research questions. This study aims to analyze academic articles to highlight key findings on how universities teach cybersecurity courses online. Methods The authors conducted a systematic review of scholarly articles, adhering to the PRISMA approach for the period from January 2010 to August 2024. PRISMA offers a structured approach to planning, executing, and reporting systematic reviews in various fields, including healthcare and social sciences. Results The review revealed several key findings on the design of online cybersecurity courses. Learner-centered approaches were commonly used, featuring active learning and practical applications. Effective instructional methods included collaborative learning, case studies, and simulations, which promoted student engagement and critical thinking. Universities emphasize practical skills evaluation and knowledge acquisition through project-based assessments. The role of IT tools was highlighted, with virtual laboratories, gamification, and simulations providing hands-on experiences, enhancing motivation, and facilitating active learning. Discussion This systematic review provides a comprehensive overview of the current online cybersecurity education practices in online universities. As a pioneering effort, it offers educators and curriculum developers valuable insight into designing effective online cybersecurity programmes to enhance teaching and learning practices. The review of online cybersecurity education highlighted several key findings. Learner-centered approaches, which incorporate active learning practices and practical applications, were prevalent. Effective instructional methods included collaborative learning, case studies, and simulations, which fostered student engagement and critical thinking. Assessments focused on the acquisition of practical skills and knowledge, using project-based tasks, practical exercises, and online quizzes. IT tools played a significant role, with virtual laboratories, gamification, and simulation environments that enhanced hands-on experiences, motivation, and active learning.
Article
Full-text available
Although the conditions for successful technology integration finally appear to be in place, including ready access to technology, increased training for teachers, and a favorable policy environment, high-level technology use is still surprisingly low. This suggests that additional barriers, specifically related to teachers' pedagogical beliefs, may be at work. Previous researchers have noted the influence of teachers' beliefs on classroom instruction specifically in math, reading, and science, yet little research has been done to establish a similar link to teachers' classroom uses of technology. In this article, I argue for the importance of such research and present a conceptual overview of teacher pedagogial beliefs as a vital first step. After defining and describing the nature of teacher beliefs, including how they are likely to impact teachers' classroom practice I describe important implications for teacher professional development and offer suggestions for future research.
Article
Full-text available
The effects of teaching mathematics by e‐learning on students' performance in Saudi primary schools are inspiring signs for Saudi educational reforms. Due to the gender segregration in Saudi education, this paper was conducted in schools for girls. A totacl of 48 female students voluntarily participated from two primary schools‐ one public and one private. Students were assigned to experimental groups. They were taught mathematics by elearning over a 13 week period. Interviews were conducted with students. The qualitative results indicated that students supported the new method of teaching mathematics. Several obstacles, advantages and disadvantages were reported as well. This finding supports the value of e‐learning pedagogy as a significant tool for improving mathematics education in Saudi Arabia.
Article
Full-text available
The purpose of this paper is to build on the insights of educators regarding the relationship between culture and online learning. More specifically, this paper aims to explore the ways in which students' culture of learning is changing as a result of the introduction of various modes of online learning. It also aims to explore the ways in which culture and cultural values affect the application and success of online-learning strategies. Particular attention is directed to learners' perceptions of the advantages and disadvantages of online communication. The paper is based on primary data drawn from undergraduate female students' responses regarding how online education is changing their learning culture and how their culture is influencing online education. Sixty-seven undergraduate Saudi female students participated in the survey. The literature in the field of online and distance education is explored to help answer these questions. The participants indicated that online education helped them to challenge some cultural norms, enhance their learning culture, and improve their communication skills.
Article
Full-text available
Instrumentation rigor and bias management are major challenges for qualitative researchers employing interviewing as a data generation method in their studies. A usual procedure for testing the quality of an interview protocol and for identifying potential researcher biases is the pilot study in which investigators try out their proposed methods to see if the planned procedures perform as envisioned by the researcher. Sometimes piloting is not practical or possible so an "interviewing the investigator" technique can serve as a useful first step to create interview protocols that help to generate the information proposed and to assess potential researcher biases especially if the investigator has a strong affinity for the participants being studied or is a member of the population itself.
Article
This paper uses fixed effects analyses to estimate differences in student performance under online versus face-to-face course delivery formats in the California Community College system. On average, students have poorer outcomes in online courses, in terms of the likelihood of course completion; course completion with a passing grade; and receiving an A or B. These estimates are robust across estimation techniques, different groups of students, and different types of classes. Accounting for differences in instructor characteristics, including through the use of instructor fixed effects, dampens, but does not fully explain, the estimated relationships. Online course-taking also has implications for downstream outcomes, although these effects are smaller. Students are more likely to repeat courses taken online, but are less likely to take new courses in the same subject following courses taken online.
Article
Background/Context Earlier research on various forms of distance learning concluded that these technologies do not differ significantly from regular classroom instruction in terms of learning outcomes. Now that web-based learning has emerged as a major trend in both K–12 and higher education, the relative efficacy of online and face-to-face instruction needs to be revisited. The increased capabilities of web-based applications and collaboration technologies and the rise of blended learning models combining web-based and face-to-face classroom instruction have raised expectations for the effectiveness of online learning. Purpose/Objective/Research Question/Focus of Study This meta-analysis was designed to produce a statistical synthesis of studies contrasting learning outcomes for either fully online or blended learning conditions with those of face-to-face classroom instruction. Population/Participants/Subjects The types of learners in the meta-analysis studies were about evenly split between students in college or earlier years of education and learners in graduate programs or professional training. The average learner age in a study ranged from 13 to 44. Intervention/Program/Practice The meta-analysis was conducted on 50 effects found in 45 studies contrasting a fully or partially online condition with a fully face-to-face instructional condition. Length of instruction varied across studies and exceeded one month in the majority of them. Research Design The meta-analysis corpus consisted of (1) experimental studies using random assignment and (2) quasi-experiments with statistical control for preexisting group differences. An effect size was calculated or estimated for each contrast, and average effect sizes were computed for fully online learning and for blended learning. A coding scheme was applied to classify each study in terms of a set of conditions, practices, and methodological variables. Findings/Results The meta-analysis found that, on average, students in online learning conditions performed modestly better than those receiving face-to-face instruction. The advantage over face-to-face classes was significant in those studies contrasting blended learning with traditional face-to-face instruction but not in those studies contrasting purely online with face-to-face conditions. Conclusions/Recommendations Studies using blended learning also tended to involve additional learning time, instructional resources, and course elements that encourage interactions among learners. This confounding leaves open the possibility that one or all of these other practice variables contributed to the particularly positive outcomes for blended learning. Further research and development on different blended learning models is warranted. Experimental research testing design principles for blending online and face-to-face instruction for different kinds of learners is needed.