Technology-Enhanced Simulation for Health Professions Education A Systematic Review and Meta-analysis

Office of Education Research, Mayo Medical School, Rochester, Minnesota, USA.
JAMA The Journal of the American Medical Association (Impact Factor: 30.39). 09/2011; 306(9):978-88. DOI: 10.1001/jama.2011.1234
Source: PubMed

ABSTRACT Although technology-enhanced simulation has widespread appeal, its effectiveness remains uncertain. A comprehensive synthesis of evidence may inform the use of simulation in health professions education.
To summarize the outcomes of technology-enhanced simulation training for health professions learners in comparison with no intervention.
Systematic search of MEDLINE, EMBASE, CINAHL, ERIC, PsychINFO, Scopus, key journals, and previous review bibliographies through May 2011.
Original research in any language evaluating simulation compared with no intervention for training practicing and student physicians, nurses, dentists, and other health care professionals.
Reviewers working in duplicate evaluated quality and abstracted information on learners, instructional design (curricular integration, distributing training over multiple days, feedback, mastery learning, and repetitive practice), and outcomes. We coded skills (performance in a test setting) separately for time, process, and product measures, and similarly classified patient care behaviors.
From a pool of 10,903 articles, we identified 609 eligible studies enrolling 35,226 trainees. Of these, 137 were randomized studies, 67 were nonrandomized studies with 2 or more groups, and 405 used a single-group pretest-posttest design. We pooled effect sizes using random effects. Heterogeneity was large (I(2)>50%) in all main analyses. In comparison with no intervention, pooled effect sizes were 1.20 (95% CI, 1.04-1.35) for knowledge outcomes (n = 118 studies), 1.14 (95% CI, 1.03-1.25) for time skills (n = 210), 1.09 (95% CI, 1.03-1.16) for process skills (n = 426), 1.18 (95% CI, 0.98-1.37) for product skills (n = 54), 0.79 (95% CI, 0.47-1.10) for time behaviors (n = 20), 0.81 (95% CI, 0.66-0.96) for other behaviors (n = 50), and 0.50 (95% CI, 0.34-0.66) for direct effects on patients (n = 32). Subgroup analyses revealed no consistent statistically significant interactions between simulation training and instructional design features or study quality.
In comparison with no intervention, technology-enhanced simulation training in health professions education is consistently associated with large effects for outcomes of knowledge, skills, and behaviors and moderate effects for patient-related outcomes.

Download full-text


Available from: Stanley J. Hamstra, Jan 13, 2015
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Simulation-based education is one strategy that may be used to teach nursing students to recognize and manage patient deterioration.
    Clinical Simulation in Nursing 02/2015; 11(2):97-105. DOI:10.1016/j.ecns.2014.10.010
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Virtual patients are computerised representations of realistic clinical cases. They were developed to teach clinical reasoning skills through delivery of multiple standardized patient cases. The anesthesia course at The Chinese University of Hong Kong developed two novel types of virtual patients, formative assessment cases studies and storyline, to teach its final year medical students on a 2 week rotational course. Acute pain management cases were used to test if these two types of virtual patient could enhance student learning. A 2 × 2 cross over study was performed in academic year 2010-2011 on 130 students divided into four groups of 32-34. Performance was evaluated by acute pain management items set within three examinations; an end of module 60-item multiple choice paper, a short answer modified essay paper and the end of year final surgery modified essay paper. The pain management case studies were found to enhanced student performance in all three examinations, whilst the storyline virtual patient had no demonstrable effect. Student-teaching evaluation questionnaires showed that the case studies were favored more than the storyline virtual patient. Login times showed that students on average logged onto the case studies for 6 h, whereas only half the students logged on and used the storyline virtual patient. Formative assessment case studies were well liked by the students and reinforced learning of clinical algorithms through repetition and feedback, whereas the educational role of the more narrative and less interactive storyline virtual patient was less clear .
    Advances in Health Sciences Education 11/2014; DOI:10.1007/s10459-014-9570-0 · 2.71 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The influence of simulation on self-efficacy for novice nurses has been reported inconsistently in the literature. Effect sizes across studies were synthesized using random-effects meta-analyses. Simulation improved self-efficacy in one-group, pretest-posttest studies (Hedge's g = 1.21, 95% CI [0.63, 1.78]; p < 0.001). Simulation also was favored over control teaching interventions in improving self-efficacy in studies with experimental designs (Hedge's g = 0.27, 95% CI [0.1, 0.44]; p = 0.002). In nonexperimental designs, consistent conclusions about the influence of simulation were tempered by significant between-study differences in effects. Simulation is effective at increasing self-efficacy among novice nurses, compared with traditional control groups. [J Nurs Educ. 2014;53(11):607-614.].
    Journal of Nursing Education 11/2014; 53(11):607-14. DOI:10.3928/01484834-20141023-03 · 0.76 Impact Factor