ArticlePDF Available

Tracking Student Behavior, Persistence, and Achievement in Online Courses

Authors:

Abstract

The purpose of this research was to examine student engagement in totally asynchronous online courses through an empirical analysis of student behavior online and its relationship to persistence and achievement. A total of 13 sections of three undergraduate, general education courses provided the setting for the study. Three hundred fifty-four students were used in the data analysis. Using student access computer logs, student behaviors defined as frequency of participation and duration of participation were documented for eight variables. The descriptive data revealed significant differences in online participation between withdrawers and completers and between successful completers and non-successful completers. A multiple regression analysis was used to evaluate how well student participation measures predicted achievement. Approximately 31% of the variability in achievement was accounted for by student participation measures, and three of the eight variables were statistically significant.
b Q
!
!
!
R
b Q
Mu
l
t
i
p
le
R
e
g
ressi
on
Mod
el
fo
r I
m
p
ac
t
of
A
c
t
ivi
t
ies
on
A
c
h
ieveme
nt
# of
O
ri
g
i
na
l
Po
s
t
s
Cr
eated
# of
F
o
ll
o
w-
up
Po
s
t
s
Cr
eated
Se
c
ond
s
on
O
ri
g
i
na
l
Po
s
t
s
Se
c
ond
s
on
F
o
ll
o
w-
up Po
s
t
s
R
ead
# of
C
ontent
Page
s
vi
e
w
ed
# of
Disc
u
ssi
on
Po
s
t
s
R
ead
Se
c
ond
s
on
C
ontent Page
s
Se
c
ond
s
on
Disc
u
ssi
on
Po
s
t
s
R
ead
A
c
h
i
e
v
e
m
ent
(
S
tudent
G
r
ade
s)
S
u
cc
e
ss
fu
l
and
N
on
-s
u
cc
e
ss
fu
l
C
o
m
p
l
ete
rs
N
=284
b
b Q
b Q
... Numerous studies have examined online student engagement, both in the context of online/blended delivery (Argyriou et al., 2022;Cocea & Weibelzahl, 2011;Dixson, 2015;Giesbers et al., 2014;Lang, 2022;Morris et al., 2005;Rajabalee et al., 2020;Stewart et al., 2011) and fully in-person delivery (Boulton et al., 2018). These studies incorporate measures of engagement ranging from data available through a VLE such as completion of online quizzes (Argyriou et al., 2022;Dixson, 2015) daily activity time in a module (Boulton et al., 2018), frequency and hours of access (Lang, 2022), number of contributions to video conferences or online discussion forums (Dixson, 2015;Giesbers et al., 2014), as well as number of assignments completed, importance level of such assignments and activities requiring VLE presence (Rajabalee et al., 2020) to selfreporting instruments (Dixson, 2015). ...
... Studies exploring the relationship between quantitative observational measures of student engagement captured through VLE and academic performance report a positive association for some measures (Argyriou et al., 2022;Lang, 2022;Morris et al., 2005;Rajabalee et al., 2020). Morris et al. (2005) examined the relationship between several engagement measures from VLE and final grades using data from three asynchronous online undergraduate courses. ...
... Studies exploring the relationship between quantitative observational measures of student engagement captured through VLE and academic performance report a positive association for some measures (Argyriou et al., 2022;Lang, 2022;Morris et al., 2005;Rajabalee et al., 2020). Morris et al. (2005) examined the relationship between several engagement measures from VLE and final grades using data from three asynchronous online undergraduate courses. Out of the measures of engagement analyzed, it was found that the number of discussion posts viewed, the number of content pages viewed, and seconds viewing discussion posts were positively associated with the final grade achieved. ...
Article
Full-text available
This study examines the relationship between student engagement with digital resources and final module grade in a particular mathematics module delivered online in an Irish technological university. Measures of student engagement with the module are defined and calculated using data from virtual learning environment. These measures are analyzed to provide a description of students’ online study habits. We make an initial distinction between resources provided by the lecturer that are lecture-based or exam-focused. We further categorize student engagement with these resources as active or passive and consider these measures of student engagement in an online context. With these categories and measures in mind, we then examine the correlation between student engagement and final module grade using a multivariable linear regression model.
... Topics for these discussions ranged from good mentoring practices and mentoring pitfalls to mentees' position in the research world (see Figs. 3 and 4). In their study on student engagement in asynchronous online courses, Morris et al., 2005 found a correlation between online participation in group discussions and successful online learning [25]. Ozkara & Cakir, 2018 confirmed that a lack of online interaction led to drop-out in their study on the students' perspective of online courses [26]. ...
... Topics for these discussions ranged from good mentoring practices and mentoring pitfalls to mentees' position in the research world (see Figs. 3 and 4). In their study on student engagement in asynchronous online courses, Morris et al., 2005 found a correlation between online participation in group discussions and successful online learning [25]. Ozkara & Cakir, 2018 confirmed that a lack of online interaction led to drop-out in their study on the students' perspective of online courses [26]. ...
Article
Full-text available
Background Translational researchers (TRs) fulfill various roles across clinical, educational, and research domains with the ultimate goal of positively impacting patients. Mentorship has been recognized as an important means of career support for TRs, particularly when navigating the complex translational research pipeline and adapting to evolving roles. In response, the Erasmus + PATHWAY project developed and piloted an extra-curricular online preparatory course and mentorship program in 2019 and 2020 to help TRs build mentorship skills, develop their careers, and create online peer-to-peer learning opportunities. Methods To assess the pilot online mentorship program, a longitudinal exploratory mixed method study was conducted. Results Mentees and mentors from both years reported that they joined the program to learn mentorship skills, gain career support, and expand their (international) network. Analysis of evaluation forms indicated that the online preparatory course was evaluated largely positively, with participants suggesting improvements for future iterations. Results of a follow-up survey in 2022 revealed that mentorship was considered helpful in supporting TRs’ work in translational research, and an online mentorship program was useful, provided it included interactive online training, multiple mentee-mentor matching rounds, compatible time zones and professional experience for matched pairs, active program moderation with offline activities, and effective online tools. Conclusions This study revealed the mentorship needs of TRs and their recommendations for international online mentorship. The innovative PATHWAY program’s online format, mentee-driven matching, and preparatory training for both mentees and mentors contribute to the development of mentorship for the general translational community that could potentially have broader applications, especially in a post-COVID-19 environment.
... On the other hand, Moreno-Marcos et al. (2020) identified exercise-related activities as strong predictors of success in MOOCs while discussion forum participations, which require more active learning, did not have a similar effect. However, other research revealed discussion forum activity as a predictor of learner performance (Macfadyen & Dawson, 2010;Morris et al., 2005). In their research across multiple blended undergraduate courses, Gašević et al. (2016) found that course logins and access to resources were significant predictors of academic performance for the total sample population. ...
... Similarly, Tempelaar et al (2015) report even lower predictive power for LMS data on learner performance. However, other previous LA research revealed higher predictive power for LA data (Macfadyen & Dawson, 2010;Morris et al., 2005). The differences in the predictive power of LA data reported in literature could be due to contextual differences, differences in study design, and the number of predictor variables addressed in the studies. ...
Article
Full-text available
Learning analytics offer unprecedented opportunities for tracking and storing learning behaviors, thereby providing chances for optimizing learner engagement and success. The limited adoption of learning analytics by educational institutions hinders efforts to optimize learning processes through organizational and educational interventions, especially in open and distance learning settings. Therefore, this study attempts to investigate whether learning analytics data and learner demographic characteristics predict academic success in two distinct online large-scale undergraduate courses delivered at a mega distance teaching university. The prediction research design was employed, and correlation and multiple regression analyses were conducted to investigate the relationships between the predictor and outcome variables in this study. The results revealed that both learning analytics and learner demographics significantly predict academic success. However, there were disciplinary differences in terms of access to learning resources, their relative impact on academic success, and the impact of learner demographics on academic success.
... Nevertheless, a few educational forecast models are reported in the case of e-learning courses (Finnegan et al., 2005;Macfayden & Dawson, 2010;Ya-Han Hu et al., 2014). In detail, one study proved that student behavioral engagement is a strong predictor of students' attrition in elearning courses (Morris et al., 2005). ...
... Nevertheless, a few educational forecast models are reported in the case of e-learning courses (Finnegan et al., 2005;Macfayden & Dawson, 2010;Ya-Han Hu et al., 2014). In detail, one study proved that student behavioral engagement is a strong predictor of students' attrition in elearning courses (Morris et al., 2005). In parallel, another study indicates that non-achievers could be monitored and predicted by analyzing LMS engagement data whereas another study proposes the analysis of e-Portfolio data to yield the same result (Ya-Han Hu et al., 2014). ...
Article
Full-text available
Learning Management Systems store valuable data in their repositories. Analyzing such data could contribute to identifying non-achievers in eLearning courses. This study presents an integrated framework (encompassing stages from a risk management process) to predict non-achievers in eLearning Business Informatics Lab Courses through a discriminant function analysis of student engagement data. In detail, data regarding with student interaction with the learning activities were elicited from the Moodle LMS log files. The paper also presents a specific eLearning Business Informatics Lab Course, designed upon Business Informatics competencies, tailored to a Business Informatics Curriculum for undergraduate Accounting Students. A discriminant function analysis was used to develop a competent prediction model. Linear discriminant functions were generated for achievers and non-achievers respectively. Students were classified into non-achievers or achievers according to the maximum score of the discriminant functions. The high classification percentage of our model indicates that our framework could be used to identify non-achievers in any eLearning Business Informatics Lab course sharing the same structure. A linear discriminant analysis (LDA) was also employed to indicate the training potential of our model. The evaluation metrics of our trained model indicate that our model could potentially be used to develop an alert system.
... It has been reported that that the time spent on task and frequency of participation are key factors for successful e-learning (Morris, Finnegan & Wu, 2005). However, over the past 4 years, no changes were observed in students' online participation. ...
Article
Full-text available
Since 2010, both universities in which the authors teach have integrated pc-based e-learning or mobile learning programs into several English courses. Students’ online performances are evaluated and used in determining the grades for each course. The data accumulated over the years indicates both changing and unchanged e-learning habits among Japanese university students. By analyzing the accumulated data, coupled with information obtained from questionnaires, we conclude that while some e-learning habits remain unchanged, several new learning habits have emerged. The unchanged e-learning habits include: predominant use of the iPhone, which remains the most popular mobile learning tool; a deadline rush for completing e-learning tasks; a preference for engaging in e-learning in the evening and at night; e-learning diligence, i.e., frequency of participation and duration of participation, show no change. In recent years some new trends have appeared in students’ e-learning: more students entering university have previous experience with e-learning, and they are less concerned about the cost of mobile phone Internet connection.
Article
Full-text available
The curriculum in the "Engineering Design (Interior and Furniture Design)" Bachelor program has frequently changed over the years regarding how and what kind of study modules are taught. In the 2020-2021 academic year, the teaching staff was presented with another novelty-the transition to full-time virtual training in practical design and purely artistic disciplines. In the context of introducing a new virtual education modality, the new teachers in the department decided to leverage the moment and test innovative ways of working that are widely applicable in their practices and were formerly introduced in their design training in foreign universities. Their approach was based on integrating design thinking with the traditional approach used in the program to bridge two separate study modules from the curriculum-"Graphic Design" and "Furniture Design for Public Spaces". In the process, the assistant professors introduced a few new tools, principles, and perspectives, all with the idea of raising the level of engagement and practical fieldwork experience among students, taking advantage of the positive aspects of working in a virtual environment.
Article
Web-based learning environments are popular on campus nowadays. These software packages improve communication between instructor and students, enable students to take charge over their learning processes, and provide feedback data to the instructor. Universities and colleges are called to foot the bill for these computerized tools by training teachers and students on how to use them, adding new computer classrooms, and upgrading the network backbone. Few, if any, of these academic institutions systematically collect and analyze data in order to assess if their investments in this new approach are paying off. How can academic institutions collect and analyze data in order to determine the effectiveness of the new computer mediated distance learning approach? This is the key question addressed in this article.
Article
The purpose of the study was to investigate how graduate students (n = 14) participated in on-line discussions over a two-week period to determine the utility of synchronous and asynchronous modes of discussion. The types and amounts of communication statements that participants made in chats and threaded discussions were analyzed using a coding scheme developed by the researchers. Students were randomly assigned to either a small group chat or threaded discussion during one week. In the second week, the groups switched discussion modes and another topic question was provided. The researchers coded the transcribed discussions to determine whether the students' participation was substantive (directly related to the topic) or non-substantive (not directly related to the content) in nature. Results indicated that overall students' discussions included nine types of substantive and non-substantive comments. However, the participants when in the chat showed greater numbers of responding and reacting statements...
Article
Survival analysis was used to model theretention of 8,867 undergraduate students at OregonState University between 1991 and 1996. Attrition wasfound to increase with age, and decrease with increasing high school GPA and first-quarter GPA.Non-residents had higher attrition rates than didresident and international students, and students takingthe Freshman Orientation Course appeared to be atreduced risk of dropping out. Statistically significantassociations of retention with ethnicity/race andcollege at first enrollment were also noted. Aproportional hazards regression model was developed topredict a student's probability of leaving school basedon these demographic and academic variables. Theseanalyses are helping to guide the university's effortsto improve retention through marketing, recruitment, and the development of orientation and otherprograms.