Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis.
ABSTRACT A recent systematic review (2008) described the effectiveness of Internet-based learning (IBL) in health professions education. A comprehensive synthesis of research investigating how to improve IBL is needed. This systematic review sought to provide such a synthesis.
The authors searched MEDLINE, CINAHL, EMBASE, Web of Science, Scopus, ERIC, TimeLit, and the University of Toronto Research and Development Resource Base for articles published from 1990 through November 2008. They included all studies quantifying the effect of IBL compared with another Internet-based or computer-assisted instructional intervention on practicing and student physicians, nurses, pharmacists, dentists, and other health professionals. Reviewers working independently and in duplicate abstracted information, coded study quality, and grouped studies according to inductively identified themes.
From 2,705 articles, the authors identified 51 eligible studies, including 30 randomized trials. The pooled effect size (ES) for learning outcomes in 15 studies investigating high versus low interactivity was 0.27 (95% confidence interval, 0.08-0.46; P = .006). Also associated with higher learning were practice exercises (ES 0.40 [0.08-0.71; P = .01]; 10 studies), feedback (ES 0.68 [0.01-1.35; P = .047]; 2 studies), and repetition of study material (ES 0.19 [0.09-0.30; P < .001]; 2 studies). The ES was 0.26 (-0.62 to 1.13; P = .57) for three studies examining online discussion. Inconsistency was large (I(2) >or=89%) in most analyses. Meta-analyses for other themes generally yielded imprecise results.
Interactivity, practice exercises, repetition, and feedback seem to be associated with improved learning outcomes, although inconsistency across studies tempers conclusions. Evidence for other instructional variations remains inconclusive.
SourceAvailable from: PubMed Central[Show abstract] [Hide abstract]
ABSTRACT: Comparing computer and internet based instruction with traditional giving lecture would provide enough evidence to identify best teaching practice. In this study, we compared lecture, interactive internet based and computer based learning regarding medical students' knowledge acquisition and satisfaction in teaching pathophysiology of hematology and oncology. Eighty four medical students were randomized into three groups and an identical faculty member conducted the instructions through the above mentioned methods. Students' knowledge was assessed one week before and immediately after the interventions by pre and posttest. Students' satisfaction was assessed using a validated 5-point Likert scale. The results showed that students' satisfaction was significantly higher in interactive internet based group than other ones (p=0.05). There were a significant increase between pre and posttest scores in all groups (p=0.000). We used ANCOVA to compare score changes in the study groups, with posttest scores as the dependent factor and pretest scores as covariate and knowledge acquisition was significantly higher in interactive internet based group than other two groups (p=0.026). The study showed that although interactive internet based instruction is a difficult and time consuming method, it is recommended to integrate this method to medical curricula.Medical journal of the Islamic Republic of Iran 01/2014; 28:136.
[Show abstract] [Hide abstract]
ABSTRACT: Background Spaced-repetition and test-enhanced learning are two methodologies that boost knowledge retention. ALERT STUDENT is a platform that allows creation and distribution of Learning Objects named flashcards, and provides insight into student judgments-of-learning through a metric called `recall accuracy`. This study aims to understand how the spaced-repetition and test-enhanced learning features provided by the platform affect recall accuracy, and to characterize the effect that students, flashcards and repetitions exert on this measurement.Methods Three spaced laboratory sessions (s0, s1 and s2), were conducted with n=96 medical students. The intervention employed a study task, and a quiz task that consisted in mentally answering open-ended questions about each flashcard and grading recall accuracy. Students were randomized into study-quiz and quiz groups. On s0 both groups performed the quiz task. On s1 and s2, the study-quiz group performed the study task followed by the quiz task, whereas the quiz group only performed the quiz task. We measured differences in recall accuracy between groups/sessions, its variance components, and the G-coefficients for the flashcard component.ResultsAt s0 there were no differences in recall accuracy between groups. The experiment group achieved a significant increase in recall accuracy that was superior to the quiz group in s1 and s2. In the study-quiz group, increases in recall accuracy were mainly due to the session, followed by flashcard factors and student factors. In the quiz group, increases in recall accuracy were mainly accounted by flashcard factors, followed by student and session factors. The flashcard G-coefficient indicated an agreement on recall accuracy of 91% in the quiz group, and of 47% in the study-quiz group.Conclusions Recall accuracy is an easily collectible measurement that increases the educational value of Learning Objects and open-ended questions. This metric seems to vary in a way consistent with knowledge retention, but further investigation is necessary to ascertain the nature of such relationship. Recall accuracy has educational implications to students and educators, and may contribute to deliver tailored learning experiences, assess the effectiveness of instruction, and facilitate research comparing blended-learning interventions.BMC Medical Education 01/2015; 15(1):4. DOI:10.1186/s12909-014-0275-0 · 1.41 Impact Factor
[Show abstract] [Hide abstract]
ABSTRACT: Background: The use of information and communication technology (ICT) in health professional education is increasing rapidly. Health professional educators need to be responsive to health professionals’ information and communication technological needs; however, there is a paucity of information about educators’ attitudes to, and capabilities with, ICT. Methods: Fifty-two health professional educators, enrolled in health professional education postgraduate studies, participated in an online subject with specific eLearning components requiring the use of ICT. They completed a pre- and postquestionnaire pertaining to ICT attitudes, confidence, and usage. Results: Participants reported significant increases in overall ICT confidence during the subject despite it being high at baseline (mean: 7.0 out of 10; P=0.02). Even with increased ICT confidence, there were decreases in the participants’ sense of ICT control when related to health professional education (P=0.002); whereas, the amount of time participants engaged with ICT devices was negatively correlated with the sense of ICT control (P=0.002). The effect of age and health discipline on ICT attitudes and confidence was not significant (P.0.05). Conclusion: This study reports that health professional educators have perceptual deficits toward ICT. The impact of eLearning increased confidence in ICT but caused a reduction in participants’ sense of control of ICT. Health professional educators require more ICT training and support to facilitate better ICT integration in health professional education settings. Keywords: confidence, sense of controlJournal of Multidisciplinary Healthcare 01/2015; 2015(8):75-81. DOI:10.2147/JMDH.S74974