ArticlePDF Available

Performance indicators in online distance learning courses: A study of management education

DOI:10.1108/09684880410517397
Authors:
Jeffrey W. Alstete at Iona University
Jeffrey W. Alstete
  • Iona University
Nicholas J. Beutell at Iona University-LaPenta School of Business
Nicholas J. Beutell
  • Iona University-LaPenta School of Business
Download full-text PDF
Read full-text
Download citation

Abstract

Examines student performance indicators in online distance learning courses offered on the Internet at a mid-sized private college in the USA. A sample of 74 undergraduate and 147 graduate business students in ten courses were selected for statistical analysis of their grade performance and the relationship with various indicators. The research results include findings that gender and age are related differently for undergraduate and graduate students to performance in distance learning courses, and that undergraduate grades, age, work experience, and discussion board grades are significantly related to overall course performance. However, standardized test scores (SATs, GMATs) and organization position level are not related to the performance in distance learning courses. Makes recommendations for further qualitative and empirical research on distance learning student performance in online computer-mediated courses and programs.
Content uploaded by Nicholas J. Beutell
Author content
All content in this area was uploaded by Nicholas J. Beutell on Dec 31, 2013
Content may be subject to copyright.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Performance indicators in online distance learning courses: a study of management education
Alstete, Jeffrey W;Beutell, Nicholas J
Quality Assurance in Education; 2004; 12, 1; ProQuest Education Journals
pg. 6
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
... Distance education, in its simplest terms, can be defined as an educational technology used when the student and teacher are not in the same environment [5]. Distance education programs have become a popular form of education for universities to increase their number of students, reduce their costs of formal education and grow in new markets [6]. The opportunity of education independent of the time and place provided by distance education has caused those who want to benefit from this education to be composed of adults who live geographically in remote areas and working all day at home or work [7]. ...
... The negative ideal solution set is created by choosing the smallest of the weighted column values in Y i j matrix. The negative ideal solution set is obtained from Eq. (6). ...
Performance Evaluation in Distance Education by Using Data Envelopment Analysis (DEA) and TOPSIS Methods
Article
Full-text available
Depending on the global world conditions and technological developments, the education and job status of people are constantly changing. In the competitive environment of today, as in many other sectors, it has become necessary to compete with the competitors in the education sector and to open up to new markets. Universities are the most important education centers where qualified human resources are trained. Universities offer different types of education along with people's lifestyles and technology. Distance education has become increasingly widespread in recent years as it can meet human needs. It has become necessary for universities to evaluate their performance to compete with their competitors in distance education. In recent years, data envelopment analysis (DEA) and technique for order preference by similarity to ideal solutions (TOPSIS) are widely used in performance evaluation. In this study, it has been aimed at performance evaluation of distance education departments of public universities in Turkey for the 2018-2019 academic year by using the DEA method and the TOPSIS method. In the study, it has been also aimed to compare and rank the efficient decision-making units as a result of efficiency measurement among themselves. The study has been carried out using 6 input and 4 output variables. As a result of the efficiency analysis using the CCR-DEA model, 7 universities were efficient and 49 universities not. Later, the efficient universities have been ranked using the super efficiency CCR-DEA model and TOPSIS method.
... No significant differences were found between undergraduate or graduate-level students; however, when a discussion was moderated by the instructor all students were more or less active in the discussion. The strongest indicator of student performance in online classes was the students' participation in discussion boards, measured by usage (Alstete & Beutell, 2004). This finding was supported by the fact that usage was positively and significantly related to overall course performance. ...
... Students' success (Duncan et al., 2012) improved by promoting high-quality and regular participation in synchronous and asynchronous forums. The strongest indicator of student performance in online classes was the students' participation in discussion boards, measured by usage (Alstete & Beutell, 2004). This finding was supported by the fact that usage was positively and significantly related to overall course performance. ...
The Role of Forum Discussion in the Online Learning Modality of Senior High School Students
Article
Full-text available
  • Mar 2022
The new normal has brought changes in the teaching-learning platform. Different modalities were implemented to ensure the continuation of education, but some nations had decided to close their educational system amidst the pandemic. The Philippines have decided to enter the synchronous and asynchronous modality of learning. This study aimed to know the role of online recitation through forum discussion in the synchronous learning modality. Thirty grade 11 STEM students were chosen purposely for this study. Google Classroom was the online platform used by the researchers, the classwork section of the google classroom was utilized where questions were posted, and responses were placed by the students. Rubric scoring was used to grade the works of students. The result of the study showed that there is no significant difference in the performance of students in terms of participation, quality of posts, plagiarism, and students' attitudes.
... They look through the websites developed by universities and colleges [2]. An appropriate Web-User communication system must be present to catch students' attention, thus, beginning with highlighting the specific users that extensively rely on web pages, the concerns on which the Web page focuses, or the message it wishes to convey to the users [3]. Therefore, it is crucial to investigate the whole process, for instance, how students approach a Web page and how they conclude it. ...
Eye-tracking Analysis: College Website Visual Impact on Emotional Responses Reflected on Subconscious Preferences
Article
Full-text available
  • Feb 2023
This study examined students’ behaviour on the college website and the content of information they were able to obtain. With the eye-tracking sensor, this study aims to investigate the university websites’ effectiveness, satisfaction, and efficiency and collect data regarding users' visual impacts. The research was carried out using mobile phone neuromarketing tools of eye-tracking, facial coding, and supplementary short memory post-survey. The study was focused on two web pages, the homepage, and the CARE page. The analysis results from both web pages were then compared and further discussed. The results suggest that participants mostly elicited sadness (29.55%), neutrality (33.19%), and puzzlement (13.60%) while browsing the homepage, regardless of the areas of interest (AOI). They also elicited slight disgust (4.33%), fear (3.51%), joy (5.21%), and surprise (29.55%). The heat map for the CARE page reveals that the top of the CARE page was a point of attraction for participants. The study found that participants' negative feelings were more intense than good ones concerning homepage scrolling. Also, their pleasant mood intensity increased moderately when they looked at regions with only photos in a subdued color scheme or where brighter colors were used to emphasize essential textual information such as upcoming events and student blogs. This reveals that the website's complexity further affects the cognitive load. Therefore, making it more accessible will be beneficial to students. According to the student's responses, change such as the page's design, color, and text could be implemented.
... Performance indicators, meanwhile, are used to assess output and outcome performance, often based on numerical data. Common performance indicators for ODE are course/program registrations, course/program completion and graduation rates, collaborative course development and delivery with other ODE institutions, graduate students' satisfaction, employer satisfaction, and the economic impact of an ODE institution on its local community (Shale & Gomes, 1998) and grades earned on individual assignments, course final grades, discussion board participation and thread initiation, and standardized test scores (Alstete, 2004). ...
Quality Assurance in Online, Open, and Distance Education
Chapter
Full-text available
  • Jan 2023
Over the past few decades, online, open, and distance education (ODE) has enjoyed phenomenal growth across different regions, and with the spread of the COVID-19 virus, its use has adopted more quickly and widely at all levels of education in both developed and developing countries. There has also been a surge in trans-institutional online courses and programs. Despite this surge in widespread practice of ODE, an image problem that perceives ODE as a second-rate education, indicated by Daniel (Quality assurance and accreditation in distance education and e-learning: Models, policies, and research. Routledge, New York, 2011) a decade ago, still exists, meaning that there is a need for even stronger measures to ensure that ODE is as good as in-person education and that quality assurance (QA) systems are in place as it enters the mainstream of education. Applying QA to ODE processes and outcomes is a relatively new phenomenon. Drawing upon previous literature on quality and QA in ODE, including institutional case studies, this chapter examines various definitions of quality and QA in ODE practice, difficulties, and challenges presented by QA in ODE and the role of stakeholders in QA in ODE. It then discusses how different ODE institutions judge and assure the quality of their courses, programs, and services and what values and assumptions underpin such QA approaches. It finally draws conclusions about what still needs to be considered and actioned.
... According to Akhtar and Kroener-Herwig (2019), gender was concluded to be forecaster of psychological wellbeing, implying that females had lower levels of psychological well-being than their male counterparts. Age has also been found to be considerably related to academic performance, suggesting that older students tend to outperform their younger colleagues (Alstete and Beutell 2004;Lobb et al. 2006). This could be as a result of mature students being more invested in completing their degrees leading to better performances academically. ...
Will working students flourish or give up? Exploring the influence of academic psychological capital, grit, and time management
Article
  • Jan 2022
Working students are faced with challenges and responsibilities both at university and in their employment. In attempting to study the books and chapters assigned, meet assignment deadlines, participate in extracurricular activities, and functions at work, working students may be overwhelmed. The primary aim of this study was to examine and understand the influence of non-cognitive factors (including Psychological Capital, time management, and grit) on flourishing and the working student’s intention to quit their studies. A non-probability sampling technique indicating convenience sampling and purposive sampling were employed to recruit respondents. The sample (n = 194) was from a residential university in the Western Cape of South Africa. Non-cognitive variables had a positive relationship with flourishing and a negative relationship with intention-to-quit studies. Academic mindset measured as Psychological Capital explained the largest proportion of the variance in flourishing and intention-to-quit studies. Lecturers, counsellors, and university officials should collaborate to incorporate programmes that will aid in developing these non-cognitive variables into the university’s curriculum. These interventions may help improve academic success and throughput of working students. Keywords: psychological capital, grit, time management, flourishing, intention to quit, working students
... In a dominantly online class, all the materials (feedback, assessments, etc.) are delivered via a Learning Management System (LMS) with an environment specially designed for educational purposes (Franks, 2002;Hiltz and Turoff, 2005;Parsad and Lewis, 2008). Thus, there is a growing dependence on using different platforms with different environments for social interaction and social networking to facilitate student learning (Franks, 2002;Alstede and Beutell, 2004). It is noteworthy that this trend is driven by ever-increasing demands for flexibility (on the part of teachers and learners both) and the need for an adaptive and supportive classroom climate. ...
Reviewing the role of positive classroom climate in improving English as a foreign language students' social interactions in the online classroom
Article
Full-text available
  • Oct 2022
The teacher and learners are cooperatively involved in the creation of a positive climate in an L2 class. In the online language learning environment today, teachers can make the best use of technology, multimedia learning, and accessibility of learners to create a supportive and effective climate. In this productive climate, the teacher and learners can have multiple forms of social interaction which can improve language learners' communicative skills. Not only can the teacher expect better learning outcomes, but s/he can also ensure students' wholehearted attendance in, attention to, and participation in class activities. A positive class climate and the consequent better social interactions can also enhance learners' affective well-being. For example, higher self-esteem leads to lower levels of anxiety and better emotional health. This study aims to review the contribution of a positive classroom climate to the improvement of students' social interaction in the online L2 classroom. To do this, the findings of the relevant studies have been presented and their implications for the construction of a positive online L2 classroom climate have been provided. Suggestions are made on how to help teachers create a positive climate in online L2 classes and how to pave the way for more effective social interactions between teachers and students and among students. Also, implications are provided for L2 teachers, researchers, and trainers, especially in the post-pandemic era.
... Online distance learning may impact the academic performance (Allam et al., 2020;Alstete & Beutell, 2004) of radiologic technology students. Students' performance in face-to-face, blended, and online classes has been studied extensively for decades (Adam et al., 2009;Auster, 2016;Bartolic-Zlomislic & Bates, 1999;Fischer et al., 2020;Kemp & Grieve, 2014). ...
Perceived Barriers in the Sudden Transition to Asynchronous and Synchronous Online Distance Learning of Radiologic Technology Student
Article
Full-text available
  • Mar 2022
This study identified the effect of the perceived barriers in the sudden transition to online distance learning on the academic performance of radiologic technology students. Four barriers were identified and used: digital literacy, support barriers, institutional barriers, and educational impact. A causal-comparative study was utilized to determine the effect of the perceived barriers on students' academic performance. Resuts revealed that support and institutional barriers significantly impact students' academic performance. On the other hand, digital literacy and educational impact have no significant effect. This finding of the study indicates that students must have easy access to the available support. This is critical not only for technical assistance but also for institutional support.
Teaching and Learning English Online: The Perspectives of English Teachers and Students at Karabuk University in Turkey
Chapter
Full-text available
  • Dec 2022
This study aims to examine the perspectives of teachers and students towards teaching and learning English online and to determine the performance of students during online and traditional learning. This study mainly adopted a mixed methods research design. The data were collected using closed-ended and 5-point Likert scale questions on Google documents. The students' performance is similar according to the type of education they received, but their academic performance is slightly better in the blended learning period, and also the female students do slightly better than their male peers. The findings show that students are not completely in favor of learning English online and they also need psychological support during online education. The findings also revealed that teachers' computer literacy levels, preparedness to implement e-learning, awareness about students' psychological conditions, and their needs for methodological support for online teaching are indispensable necessities in eradicating the negative sides of online education to maximize the learning outcomes.
The Impact of Demographic Variables on Students' Scholastic Achievement in Technology-Based Learning
Article
Full-text available
  • Feb 2018
This study investigates the potential impact of students' demographic variables, namely gender, age, computer experience, and computer use on achievement in English among convenience-sampled 81 students within the School of Arts and Humanities, the Department of English Studies in Moulay Ismail University of Meknes. To this end, achievement tests are analyzed and interpreted quantitatively; whereas the follow-up interviews are treated qualitatively. The statistical tools used in order to help analyze and interpret data include descriptive and inferential statistics which make use of frequencies, percentage, Independent Samples t-Tests, and ANOVA tests. Following what has been hypothesized, the test results do not support the four research hypotheses claiming there is no statistically significant relationship between gender, age, and computer experience and computer frequency of use on students' level of achievement.
Increasing Engagement in e-Learning Systems
Chapter
  • Jan 2022
Recent research has shown the importance of social activities in e-learning processes and revealed their effect on academic achievement. Even within innovative e-learning models, the social dimensions of engagement have a long time been neglected. This chapter aims to analyze the activities performed by students in different social applications (blog, tweet, and Wiki) and understand their possible relation with their engagement and academic results. Experimental results show a correlation between social activities, indicating engagement, and academic performance. Furthermore, the lack of participation during the interactive activities may indicate insufficient preparation in performing the learning tasks. Still, we provided a data analysis pipeline that finds students with significant engagement but with low academic performance and students with low engagement but with high academic performance. Proper analysis of various categories of students opens the way towards an accurate classification of students in terms of their engagement and academic proficiency.KeywordsMachine learningEducational data miningUser modelling
Evaluation of Factors Related to Student Performance in a Distance-Learning Business Communication Course
Article
Full-text available
Because most previous studies on college student performance have focused on conventional learning environments in Western cultures, in this study the authors evaluated factors related to student performance in the open and distance-learning environment in Hong Kong. Using two-way cross-tabulations with chi-square testing and equality of academic performance by proposed factors, the authors examined 168 students in a distance-learning business communication course. Results show that tutorial attendance, gender, relevant academic background, previous academic achievement, and relevant learning experience were related to student performance. The results are mostly similar to those of prior studies despite differences in culture, teaching mode, and subject.
E-learning: Engagement, enhancement and execution
Article
Explores the practical and theoretical issues involved in the evaluation, quality assurance and engagement of operating an e-learning programme as a distance learning service on an international basis for people in employment. Focuses on the experiences of delivery of e-learning of a case at the University of Wales, Lampeter that has been adapted from a project into mainstream provision. Suggests that the current emphasis of the prefix “e” in learning application needs to shift from electronic to the more supportive descriptions of engagement, enhancement and execution of the student learning programme. Reviews the current quality assurance recommendations in the context of e-learning. Concludes with the evidence emerging from the particular case of e-learning provision at Lampeter and the key findings of the programme.
Developing the “virtual” classroom: A business school example
Article
Distance education and the concept of the virtual classroom is an area of considerable interest to educators and trainers alike. Charts the develop-ment of a distance learning provision in an undergraduate School of Business Administration and discusses how the new teaching and learning strategies are now firmly part of the school. Discusses the mix of traditional teaching and distance learning and provides suggestions on how to use the technology in a broader context of training and professional development. Concludes with a discussion of the ways to overcome the barrier that students are taught rather than helped to learn. By relying almost exclusively on the case method of instruction, students or participants are forced to move from dependency to engage in problem solving, critical thinking, and experiential group exercises that will help them make decisions not only in the classroom session but also in business settings.
Identifying Factors That Effect Learning Community Development and Performance in Asynchronous Distance Education
Article
  • Jan 2000
Describes the development of learning communities within the context of asynchronous distance education, based on a study of 12 graduate students in a course that used Internet-based conferencing software. Preliminary results of empirical data, interviews, and student journals indicate a relationship between learning achievement and strength of the community. (Author/LRW)
Designing and Teaching an On-Line Course: Spinning Your Web Classroom
Article
  • Jan 1999
This guide to developing and teaching an on-line course is intended to lead the instructor through the steps of course development, on-line teaching, and on-line assessment. It emphasizes principles of course design which are outcome-based, performance-assessed, and collaborative. The guide's nine chapters cover the following aspects of course development: (1) demystifying the on-line environment; (2) principles of performance-based curriculum design; (3) creating performance-based assessments; (4) planning on-line activities and resources; (5) creating on-line discussion groups; (6) being a "visible" on-line instructor; (7) technology (handling hardware and software problems); (8) designing a course evaluation instrument; principles of visual design; and (9) answers to questions by three experts in distance learning. Eight appendices provide a variety of resources, including a sample welcome letter, a list of verbs according to Bloom's taxonomy, a list of roles and responsibilities for cooperative group members, sample on-line group activity, a sample data record, and a sample course evaluation. (DB)
Expectations Evaporate for Online MBA Programs
Article
Describes how, for online Master's of Business Administration programs, enrollments are low and business deals are falling through. Despite initial hype, expectations are now lower in the face of economic uncertainty; programs partnering with businesses and school-run programs both face challenges. (EV)