Impact of online education on intern behaviour around joint commission national patient safety goals: A randomised trial

Workforce Education and Development Group, K01, The University of Sydney, NSW 2006, Australia
BMJ quality & safety (Impact Factor: 3.99). 06/2012; 21(10):819-25. DOI: 10.1136/bmjqs-2011-000702
Source: PubMed


To compare the effectiveness of two types of online learning methodologies for improving the patient-safety behaviours mandated in the Joint Commission National Patient Safety Goals (NPSG).
This randomised controlled trial was conducted in 2010 at Massachusetts General Hospital and Brigham and Women's Hospital (BWH) in Boston USA. Incoming interns were randomised to either receive an online Spaced Education (SE) programme consisting of cases and questions that reinforce over time, or a programme consisting of an online slide show followed by a quiz (SQ). The outcome measures included NPSG-knowledge improvement, NPSG-compliant behaviours in a simulation scenario, self-reported confidence in safety and quality, programme acceptability and programme relevance.
Both online learning programmes improved knowledge retention. On four out of seven survey items measuring satisfaction and self-reported confidence, the proportion of SE interns responding positively was significantly higher (p<0.05) than the fraction of SQ interns. SE interns demonstrated a mean 4.79 (36.6%) NPSG-compliant behaviours (out of 13 total), while SQ interns completed a mean 4.17 (32.0%) (p=0.09). Among those in surgical fields, SE interns demonstrated a mean 5.67 (43.6%) NPSG-compliant behaviours, while SQ interns completed a mean 2.33 (17.9%) (p=0.015). Focus group data indicates that SE was more contextually relevant than SQ, and significantly more engaging.
While both online methodologies improved knowledge surrounding the NPSG, SE was more contextually relevant to trainees and was engaging. SE impacted more significantly on both self-reported confidence and the behaviour of surgical residents in a simulated scenario.

21 Reads
  • [Show abstract] [Hide abstract]
    ABSTRACT: Background:Pain is a complex multidimensional phenomenon moderated by consumer, provider and health system factors. Effective pain management cuts across professional boundaries, with failure to screen and assess contributing to the burden of unrelieved pain.Aim:To test the impact of an online pain assessment learning module on specialist palliative care nurses' pain assessment competencies, and to determine whether this education impacted positively on palliative care patients' reported pain ratings.Design:A quasi-experimental pain assessment education pilot study utilising 'Qstream(©)', an online methodology to deliver 11 case-based pain assessment learning scenarios, developed by an interdisciplinary expert panel and delivered to participants' work emails over a 28-day period in mid-2012. The 'Self-Perceived Pain Assessment Competencies' survey and chart audit data, including patient-reported pain intensity ratings, were collected pre-intervention (T1) and post-intervention (T2) and analysed using inferential statistics to determine key outcomes.Setting/participants:Nurses working at two Australian inpatient specialist palliative care services in 2012.Results:The results reported conform to the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Guidelines. Participants who completed the education intervention (n = 34) increased their pain assessment knowledge, assessment tool knowledge and confidence to undertake a pain assessment (p < 0.001). Participants were more likely to document pain intensity scores in patients' medical records than non-participants (95% confidence interval = 7.3%-22.7%, p = 0.021). There was also a significant reduction in the mean patient-reported pain ratings between the admission and audit date at post-test of 1.5 (95% confidence interval = 0.7-2.3) units in pain score.Conclusion:This pilot confers confidence of the education interventions capacity to improve specialist palliative care nurses' pain assessment practices and to reduce patient-rated pain intensity scores.
    No preview · Article · Mar 2014 · Palliative Medicine
  • [Show abstract] [Hide abstract]
    ABSTRACT: Purpose ‐ Cancer care is complex and an integrated cancer pathway involves many health professionals in a variety of care settings using many skills. The widely distributed and heterogeneous nature of the cancer workforce raises significant challenges with respect to professional development. Cancer Learning is a government-funded initiative designed to provide access to a wide range of quality online learning resources for all health care professionals involved in the care of cancer patients and their families. The purpose of this paper is to discuss these issues. Design/methodology/approach ‐ A multi-phase project, led by a consortium of national stakeholders in cancer care, informed the design, build, and deployment of Cancer Learning; an online, evidence based, information and learning portal to support professional development of health professionals across the continuum of cancer care in Australia. An action research approach allowed for an iterative process of ongoing dynamic evaluation and improvement of this workforce improvement resource. Findings ‐ The National Government Agency, Cancer Australia's Cancer Learning online hub has been supporting the professional development requirements of cancer care professionals since the site deployment in 2007. Since launch, site usage continues to grow and evaluations have been positive. Time constraints of health professionals continue to be a major barrier to sustained online learning participation. Originality/value ‐ This research recount of the development and implementation of an Australia first national online learning initiative highlights the rigorous approach undertaken for the delivery of a quality evidence-based resource for the professional development of all health professionals involved in the delivery of cancer care.
    No preview · Article · Apr 2014 · Education and Training
  • [Show abstract] [Hide abstract]
    ABSTRACT: Abstract Background: Online learning is a primary delivery method for continuing health education programs. It is critical that programs have curricula objectives linked to educational models that support learning. Using a proven educational modelling process ensures that curricula objectives are met and a solid basis for learning and assessment is achieved. Aim: To develop an educational design model that produces an educationally sound program development plan for use by anyone involved in online course development. Methods: We have described the development of a generic educational model designed for continuing health education programs. The Knowledge, Process, Practice (KPP) model is founded on recognised educational theory and online education practice. This paper presents a step-by-step guide on using this model for program development that encases reliable learning and evaluation. Results: The model supports a three-step approach, KPP, based on learning outcomes and supporting appropriate assessment activities. It provides a program structure for online or blended learning that is explicit, educationally defensible, and supports multiple assessment points for health professionals. Conclusion: The KPP model is based on best practice educational design using a structure that can be adapted for a variety of online or flexibly delivered postgraduate medical education programs.
    No preview · Article · Jun 2014 · Medical Teacher
Show more