Assessment of BLS skills: Optimizing use of instructor and manikin measures

University of Dundee School of Medicine, Dundee, Tayside Centre for General Practice, Mackenzie Building, Kirsty Semple Way, Dundee DD2 4BF, United Kingdom.
Resuscitation (Impact Factor: 3.96). 03/2008; 76(2):233-43. DOI: 10.1016/j.resuscitation.2007.07.018
Source: PubMed

ABSTRACT The primary objective of layperson CPR training is to ensure that learners achieve minimal competence to provide aid that improves the odds of survival of victims of out-of-hospital sudden cardiac arrest. During CPR courses, pronouncement of a learner's competence typically depends entirely on judgments made by an instructor; yet previous research strongly suggests that these judgments - particularly of chest compressions - are not sufficiently precise or accurate to ensure valid assessments. Comparisons of instructors' subjective assessments with objective data from recording manikins provide one means of understanding the magnitude and type of instructor errors in assessment.
Eight hundred and twenty-six laypersons between 40 and 70 years old participated in CPR training. Performance of five discrete skills was tested in a scenario format immediately afterward: assessing responsiveness, calling the emergency telephone number 911, delivering ventilations of adequate volume, demonstrating correct hand placement for compressions, and delivering compressions with adequate depth. Thirteen AHA-certified instructors assessed these five skills and rendered a global performance rating; sensored Resusci Anne manikins with SkillReporting software recorded ventilation and compression data.
Instructors' ratings of the ventilation skills were highly accurate; ratings of compressions were correct about 83% of the time; yet inadequate compression depth was rated adequate 55% of the time, and incorrect hand placement was rated adequate 49% of the time.
Instructors' judgments alone are not sufficient to determine learners' competence in performing compressions. Assessment, technology, and guidelines must be better aligned so that learners can receive accurate feedback.

Download full-text


Available from: Bonnie Lynch, May 08, 2015
1 Follower
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Current methods to assess Basic Life Support skills (BLS; chest compressions and ventilations) require the presence of an instructor. This is time-consuming and comports instructor bias. Since BLS skills testing is a routine activity, it is potentially suitable for automation. We developed a fully automated BLS testing station without instructor by using innovative software linked to a training manikin. The goal of our study was to investigate the feasibility of adequate testing (effectiveness) within the shortest period of time (efficiency). As part of a randomised controlled trial investigating different compression depth training strategies, 184 medicine students received an individual appointment for a retention test six months after training. An interactive FlashTM (Adobe Systems Inc., USA) user interface was developed, to guide the students through the testing procedure after login, while Skills StationTM software (Laerdal Medical, Norway) automatically recorded compressions and ventilations and their duration ("time on task"). In a subgroup of 29 students the room entrance and exit time was registered to assess efficiency. To obtain a qualitative insight of the effectiveness, student's perceptions about the instructional organisation and about the usability of the fully automated testing station were surveyed. During testing there was incomplete data registration in two students and one student performed compressions only. The average time on task for the remaining 181 students was three minutes (SD 0.5). In the subgroup, the average overall time spent in the testing station was 7.5 minutes (SD 1.4). Mean scores were 5.3/6 (SD 0.5, range 4.0-6.0) for instructional organisation and 5.0/6 (SD 0.61, range 3.1-6.0) for usability. Students highly appreciated the automated testing procedure. Our automated testing station was an effective and efficient method to assess BLS skills in medicine students. Instructional organisation and usability were judged to be very good. This method enables future formative assessment and certification procedures to be carried out without instructor involvement. B67020097543.
    BMC Medical Education 07/2012; 12:58. DOI:10.1186/1472-6920-12-58 · 1.41 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: BACKGROUND: Cardiopulmonary resuscitation (CPR) improves outcomes after cardiac arrest. Much of the lay public is untrained in CPR skills. We evaluated the effectiveness of a compression-only CPR video self-instruction (VSI) with a personal manikin in the lay public. METHODS: Adults without prior CPR training in the past year or responsibility to provide medical care were randomized into one of three groups: 1) Untrained before testing, 2) 10-minute VSI in compressions-only CPR (CPR Anytime, American Heart Association, Dallas, TX), or 3) 22-minute VSI in compressions and ventilations (CPR Anytime). CPR proficiency was assessed using a sensored manikin. The primary outcome was composite skill competence of 90% during five minutes of skill demonstration. Evaluated were alternative cut-points for skill competence and individual components of CPR. 488 subjects (143 in untrained group, 202 in compressions-only group and 143 in compressions and ventilation group) were required to detect 21% competency with compressions-only versus 7% with untrained and 34% with compressions and ventilations. RESULTS: Analyzable data were available for the untrained group (n = 135), compressions-only group (n = 185) and the compressions and ventilation group (n = 119). Four (3%) achieved competency in the untrained group (p-value = 0.57 versus compressions-only), nine (4.9%) in the compressions-only group, and 12 (10.1%) in the compressions and ventilations group (p-value 0.13 vs. compressions-only). The compressions-only group had a greater proportion of correct compressions (p-value = 0.028) and compressions with correct hand placement (p-value = 0.0004) compared to the untrained group. CONCLUSIONS: VSI in compressions-only CPR did not achieve greater overall competency but did achieve some CPR skills better than without training.
    Scandinavian Journal of Trauma Resuscitation and Emergency Medicine 05/2013; 21(1):36. DOI:10.1186/1757-7241-21-36 · 1.93 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: High quality chest compression is one of the key factors in successful resuscitation. A high standard of training is therefore decisive. We aimed to investigate the strengths and weaknesses of teaching chest compression in a study designed to highlight where targeted improvements in the quality of our chest compression training can and must be made. Retrospective analysis of prospectively documented data with 234 participants, and recording and analysis of chest compression variables before and after a BLS training course. The results after the course were good for compression depth (94% correct), moderate for compression frequency (83% correct) and decompression (82% correct), unsatisfactory for hand positioning (74% correct) and poor for the compression/decompression ratio (32% correct). Practical instruction brought about improvements of between 9% and 48%. The greatest improvement was seen for hand positioning (48%), followed by compression depth (32%), compression rate (32%), and the compression/decompression ratio (20%). Training had only a slight effect on the degree of decompression (9%). Significant deteriorations were also noted after the course, for compression rate (11%) and the compression/decompression ratio (12%). Chest compression training showed weakness for four out of five variables. Only the end results for compression depth were satisfactory. The deficits observed in the training on chest compression were relevant and must be remedied. One possibility would be initial step-by-step training and assessment of each component of chest compression, concentrating in particular on hand positioning and compression/decompression ratio.
    Schweizerische medizinische Wochenschrift 07/2011; 141:w13221. DOI:10.4414/smw.2011.13221 · 1.88 Impact Factor