ArticlePDF Available

Use of simulation as a needs assessment to develop a focused team leader training curriculum for resuscitation teams


Abstract and Figures

Background: Many inpatients experience cardiac arrest and mortality in this population is extremely high. Simulation is frequently used to train code teams with the goal of improving these outcomes. A key step in designing such a training curriculum is to perform a needs assessment. We report on the effectiveness of a simulation-based training program for residents designed using unannounced in-situ simulation cardiac arrest data as a needs assessment. Methods: In order to develop the curriculum for training, a needs assessment was done using in-situ simulation. Prior to instruction, residents were assessed in their ability to lead a simulated resuscitation using a standardized checklist. During the intervention phase, residents participated in didactic and team training. The didactic training consisted of pharmacology review, ACLS update and TeamSTEPPS training. Residents took turns as code team leader in three simulation sessions. Rapid cycle deliberate practice (RCDP) was employed as part of simulation sessions. All residents returned, for post-intervention assessment. Mean pre-post test scores were analyzed to determine if there was a significant difference. Results: Twenty-seven residents participated. Mean pre-training assessment score was 47.6 (95% CI 37.5-57.9). The mean post-training assessment score was 84.4 (95% CI 79.0-89.5). The mean time to defibrillation after pads were placed in scenario with shockable rhythm decreased from 102.2 seconds (95% CI 74.0-130.5) to 56.3 (95% CI 32.7-79.8). Conclusion: Using unannounced in-situ cardiac arrest simulations as a needs assessment, a simulation-based training program was developed that significantly improved resident performance as team leader. Future work is needed to determine if this improvement translates into patient benefits and is sustainable. However, in-situ simulation is a promising tool for curriculum development.
Content may be subject to copyright.
R E S E A R C H Open Access
Use of simulation as a needs assessment to
develop a focused team leader training
curriculum for resuscitation teams
Susan Coffey Zern
, William J. Marshall
, Patricia A. Shewokis
and Michael T. Vest
Background: Many inpatients experience cardiac arrest and mortality in this population is extremely high.
Simulation is frequently used to train code teams with the goal of improving these outcomes. A key step in
designing such a training curriculum is to perform a needs assessment. We report on the effectiveness of a
simulation-based training program for residents designed using unannounced in-situ simulation cardiac arrest data
as a needs assessment.
Methods: In order to develop the curriculum for training, a needs assessment was done using in-situ simulation.
Prior to instruction, residents were assessed in their ability to lead a simulated resuscitation using a standardized
checklist. During the intervention phase, residents participated in didactic and team training. The didactic training
consisted of pharmacology review, ACLS update and TeamSTEPPS training. Residents took turns as code team
leader in three simulation sessions. Rapid cycle deliberate practice (RCDP) was employed as part of simulation
sessions. All residents returned, for post-intervention assessment. Mean pre-post test scores were analyzed to
determine if there was a significant difference.
Results: Twenty-seven residents participated. Mean pre-training assessment score was 47.6 (95% CI 37.5-57.9).
The mean post-training assessment score was 84.4 (95% CI 79.0-89.5). The mean time to defibrillation after
pads were placed in scenario with shockable rhythm decreased from 102.2 seconds (95% CI 74.0-130.5) to
56.3 (95% CI 32.7-79.8).
Conclusion: Using unannounced in-situ cardiac arrest simulations as a needs assessment, a simulation-based
training program was developed that significantly improved resident performance as team leader. Future work
is needed to determine if this improvement translates into patient benefits and is sustainable. However, in-
situ simulation is a promising tool for curriculum development.
Keywords: Cardiac Arrest, Medical Education, Advanced Cardiac Life Support, Team Training, curriculum
development, needs assessment, gap analysis
© The Author(s). 2020 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License,
which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give
appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if
changes were made. The images or other third party material in this article are included in the article's Creative Commons
licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons
licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain
permission directly from the copyright holder. To view a copy of this licence, visit
The Creative Commons Public Domain Dedication waiver ( applies to the
data made available in this article, unless otherwise stated in a credit line to the data.
* Correspondence:
Department of Internal Medicine, Section of Pulmonary and Critical Care
Medicine, Christiana Care Health System, 4755 Ogletown-Stanton Road,
Medical Intensive Care Unit, 3E, Newark, Delaware 19713, USA
Sidney Kimmel Medical College, Philadelphia, PA, USA
Full list of author information is available at the end of the article
Zern et al. Advances in Simulation (2020) 5:6
Cardiac arrest affects approximately 209,000 adult pa-
tients in hospitals in the United States every year [1].
Additionally, national statistics show outcomes are poor
for those patients. Only 1 in 4 in hospital cardiac arrest
patients will survive to hospital discharge. Moreover,
those patients that survive often have neurological se-
quela from the event [2]. Survival for patients who have
cardiac arrest at night and on weekends has been shown
to be worse than for patients who undergo cardiac arrest
during the work day using national data from both the
United States and the United Kingdom [3,4].
While it is typically a rare event for an individual
healthcare provider, a cardiac arrest can be called mul-
tiple times a week in our 1,100-bed private teaching hos-
pital system. Our inpatient code teams are led by a
resident physician who has completed at least one post
graduate year of training and American Heart Associ-
ation (AHA) Advanced Cardiac Life Support (ACLS)
training. These residents typically do not receive formal
training in teamwork and communication or team leader
training, yet they are expected to employ these nontech-
nical skills during a cardiac arrest event [5,6]. Although
the AHA has imbedded team leader training into the
ACLS courses, the major focus of the course continues
to be on medical management. Additionally, teamwork
and communication skills necessary to be a team leader
are not a formal component of the medical education
curriculum for medical students or residents [7]. As a
result of limited training, this skill set is difficult to em-
ploy when the resident is involved in an emergency situ-
ation with a high mental workload, new skills, and an ad
hoc team [7,8]. The AHA 2015 ACLS guideline updates
recognize that ACLS training every two years is not suf-
ficient [9]. However, while supporting the use of simula-
tion training in general, they acknowledge that the
optimal approach to ACLS education for resuscitation
team members is unknown and call for additional re-
search in this area.
Although resuscitation training is a common need, it
is a complex undertaking for many institutions [10].
Curriculum development as described by Kern, needs to
address multiple steps. One of the steps in developing
the curriculum is determining the needs assessment.
This step allows for an understanding of the differences
between the learners expected performance versus their
actual performance [11]. While traditionally simulation
is used for training or for an intervention, it can also be
used to determine gaps in knowledge, skill and abilities.
Using in-situ simulation to perform a needs assessment
can inform curriculum development targeted to a spe-
cific learner group. We hypothesized that simulation can
be used as an effective tool for the purpose of developing
a curriculum.
The goal of this study was to determine if a needs as-
sessment performed using in-situ simulation would be
an effective method for simulation-based resuscitation
curriculum development, as measured by improved resi-
dent performance. We choose time to defibrillation as
the primary performance outcome because it is easily
measured, objective, and associated with clinically im-
portant outcomes.
Needs assessment
In order to accurately define the needs assessment for
resuscitation curriculum development, we used in-situ
simulation sessions. We conducted five unannounced
in-situ cardiac arrest simulations throughout our hos-
pital system. We specifically focused on the behavior of
the team leader, as the curriculum would be designed to
train only the team leader. Since our hospital resuscita-
tion team is a contingency team the residents are a
stable member and as such could have a substantial im-
pact on overall team effectiveness.
In each of the in-situ simulations, a resident physician
was the team leader. Team Leader behavior was ob-
served by S.C.Z., W.M. and M.V. We evaluated each
simulated in-situ cardiac arrest using ACLS guidelines
and the TeamSTEPPS Team Performance Observation
Tool [12]. Table 1shows the areas of opportunity noted
in at least four of five in-situ simulations. The areas of
opportunity informed curriculum development for our
intervention. Our intervention as described below was
Table 1 Results of in situ Evaluation Parameters for Needs
TeamSTEPPS Performance Observation - Areas of Opportunity
Team Leader did not Identify themselves as leading the resuscitation
Team Leader did not assign roles and responsibilities
Team leader failed to maintain situational awareness throughout the
Team Leader did not foster communication to ensure team members
have a shared mental model
Team Leader failed to collaborate with team members
Team Leader did not provide timely and constructive feedback to team
members, i.e. rate and quality of chest compressions
Closed Loop Communication was lacking or non-existent during the
AHA ACLS Guidelines Areas of Opportunity Noted
Quality of chest compressions varied with team leader failing to monitor
and address
Airway management was not assessed
Time to initial shock was variable
Cardiac rhythm was not announced to the team
AHA: American Heart Association, ACLS: Advanced Cardiac Life Support
Zern et al. Advances in Simulation (2020) 5:6 Page 2 of 7
designed to ensure that the areas of opportunity noted
during our needs assessment, would be taught and
Study design
We conducted a pretest-posttest study to evaluate the
impact of a new, annual resident resuscitation team
leader training curriculum designed based on needs as-
sessment using in-situ simulation. The course was con-
ducted in the Virtual Education and Simulation Training
(VEST) Center at the Christiana Care Health System.
This study was submitted to the Christiana Care Institu-
tional Review Board and was determined to be exempt.
Participants were resident physicians completing their
first post graduate year (PGY-1) of residency. They were
required to be previously certified in Basic Life Support
(BLS) and ACLS. All PGY-1 residents in internal and
family medicine programs in the spring of 2016 at Chris-
tiana Care were required to participate in the training.
Curriculum description and intervention
The curriculum started with a pre-assessment of the res-
idents skills in the simulation center. This was done
after curriculum was set and was separate from the in-
situ simulations used for the needs assessment. Each
resident was assessed on their ability to lead a cardiac
arrest with a standardized interprofessional team. A
team of confederates was trained to play the roles of a
respiratory care provider, a medical intensive care nurse,
a bedside nurse and three medical students using a stan-
dardized scenario. The scenarios objectives and check-
list evaluation were based on the gaps noted in the in-
situ needs assessment. In each scenario, two errors were
purposely made by the standardized team; one was in-
accurate closed loop communication by the MICU nurse
and the other was a medical student slowing down the
rate of chest compressions. METIman® pre-hospital
model or nursing model, patient simulator (CAE Health-
care) was used. The resident was blinded to the areas of
assessment as the team leader. The session was termi-
nated at the end of the third cycle of chest compres-
sions. Each pre-assessment was video recorded and
evaluated using a checklist, by one of two trained evalua-
tors. After running the cardiac arrest, each resident was
given a rhythm recognition test using HEARTSIM 200,
rhythm generator (Laerdal) where they had 20 seconds
to report each rhythm to an evaluator.
For the intervention, all the residents received the
same training including both didactic and TeamSTEPPS®
simulation training. The residents were split into two
groups (Group A and Group B) specifically to ensure
that the groups were small in size, not to assess order of
the training. Figure 1outlines the agenda. One group
attended didactic lectures for 1½ hours which included
pharmacology review, ACLS update and review, and spe-
cial situations (i.e., caring for coding pregnant patients).
They were given an electronic multiple-choice test to as-
sess their knowledge of the content (content exam).
The other group attended TeamSTEPPS® didactic
training session by a TeamSTEPPS® master trainer, fo-
cusing on the role of the team leader. They then partici-
pated in three simulation scenarios with rapid cycle
deliberate practice for 1 ½ hours. TeamSTEPPS® is an
evidence-based systematic training, developed by the De-
partment of Defense (DOD) and the Agency for Health-
care Research and Quality (AHRQ), used to improve
and integrate teamwork and communication into health-
care delivery. There are five tenets of TeamSTEPPS®;
Fig. 1 Class divided to keep groups small for teaching purposes. Both groups received same intervention
Zern et al. Advances in Simulation (2020) 5:6 Page 3 of 7
team structure, communication, leading teams, situ-
ational monitoring and mutual support [13]. These key
principles are important for a resident to understand, ex-
hibit and support as the resuscitation team leader.
After the TeamSTEPPS® didactic session, the residents
then took turns being the team leader in three simula-
tion scenarios (Table 2) with a standardized resuscitation
team of trained confederates assuming the roles of the
typical members who would normally respond, RCP,
MICU Nurse, Bedside nurse, and three people to provide
chest compression. The focus of the simulation scenar-
ios was teamwork and communication. Rapid cycle de-
liberate practice (RCDP) was employed as part of the
session with the faculty facilitators stopping the session
for skills that required immediate correction, further
practice or opportunities to highlight something done
exceptionally well, as was described in Hunt, et al 2014
[14]. Only one resident at a time was the team leader,
the other residents were in the room watching them lead
the code but were not permitted to speak or assist in
anyway. Each simulation session was performed in a dif-
ferent room with a different patient case. Each resident
participated as the leader in one of the three scenarios.
The resident led a cardiac arrest scenario and received
immediate correction or praise for their performance.
We chose RCDP as a means of debriefing to ensure that
the residents were able to practice the new skills many
times and learn vicariously while watching their peers.
All residents individually returned to the simulation
center between three to five weeks later for a post-
intervention assessment. The same scenario used for the
pre-assessment was used again. The team leader was ex-
pected to run the cardiac arrest with a standardized in-
terprofessional team, and the standardized scenario.
Each assessment was video recorded, evaluated by
checklist by one of two trained evaluators using the
same checklist as the pre-assessment. The resident was
debriefed after the cardiac arrest. Overall scores were
compared pre and post training.
Statistical analysis
Descriptive statistics and assumptions for parametric
tests were calculated for the following variables car-
diac arrest pre-test and post-test scores; rhythm
visible-time to shock delivered (RVTSD) pre-test and
post-test scores; content exam and rhythm recogni-
tion test. If the normality assumptions were violated,
then appropriate non-parametric tests were calculated.
To determine the effectiveness of the intervention,
parametric paired t-tests were used to compare pre
and post test scores on the code blue and RVTSD
tests. The content exam (electronic multiple choice
test) and rhythm tests were administered only once
and a criterion of 80% competency or better was used
for passing. A one sample t-test was calculated for
the content exam and rhythm test. Effect sizes were
calculated and used to aid in interpretation of the
data. The effect size index for the paired t-test and
one-sample t-test is Cohensd
[15]. Cohensd
interpreted as d
= 0.20, 0.50 and > 0.80 as small,
medium and large effects, respectively. To assess any
order effects of the grouping of participants, we cal-
culated independent samples t-tests (two-tailed) with
a significance criterion of α= 0.05. Since there were
multiple tests employed, we used a Bonferroni adjust-
ment to control for Type I error inflation (alpha/6 =
0.0083). The significance criterion for all tests was set
at α= 0.05. Number Cruncher Statistical Software
(NCSS ver. 9; was used for the
Table 2 Team Work and Communication Scenarios using Rapid Cycle Deliberate Practice (RCDP) Debriefing
Case Rhythm Scenario
1 PEA Arrest Adult patient was admitted overnight for deep tissue infection on left leg. He recently had a subclavian central line inserted.
Breath sounds are decreased on right side of the chest one minute into the code.
Cardiac Arrest starts with bedside nurse in the room doing compressions
Code Team comes in with the resident team leader
After two minutes the confederate Respiratory Care Provider comments that ventilating has gotten more difficult
2 Slow V
Adult patient is admitted for lumbar discectomy. He has peripheral IV access.
Cardiac arrest starts with multiple nurses in the room
Pads are on the chest
CPR is in progress
Defibrillator is in AED mode and is still on
Code team comes in with the team leader
3 PEA Arrest Adult patient was admitted overnight with concern for sepsis. He has peripheral IV access. Patient was noted to have elevated
lactate levels as per bedside nurse report.
Cardiac arrest starts with bedside nurse in the room
No pads are on the patient
Code team comes in with the team leader
After the first rhythm check the MICU nurse states that the IV is lost and not working
PEA Pulseless Electrical Activity, V Tach ventricular tachycardia, CPR cardiopulmonary resuscitation, AED automatic electrical defibrillator, IV
intravenous line
Zern et al. Advances in Simulation (2020) 5:6 Page 4 of 7
A total of 27 residents completed the training; 14 were
female and 13 male, there were internal medicine (n=
12), combined internal medicine/pediatrics (n= 4) family
medicine (n=6) and there were combined internal medi-
cine/emergency medicine residents or family medicine/
emergency medicine (n=5). Sixty-one percent reported
having attended five or more cardiac arrests, in clinical
care within the past year.
The competency level was set at 80% for the all assess-
ments. An 80% or better performance is typically noted as
the criterion for competent performance [16]. Descriptive
statistics and 95% confidence intervals are reported in
Table 3for all measures. The effect of simulation training
with rapid cycle deliberate practice significantly improved
cardiac arrest performance overall [t(26) = -6.248, p<
0.001, d
= -1.20] and time to shock delivery (RVTSD)
[t(26) = 3.127, p =0.004, dz = 0.60) specifically. Cardiac ar-
rest scores showed a large effect while RVTSD scores re-
sulted in a moderate-to-large effect. A significant effect
was detected for the mean content exam [t(26) = 2.93, p =
0.003, d
= 0.56] indicating that the content exam (elec-
tronic multiple choice test) was able to reliably discrimin-
ate between high performing residents and low
performing residents. No significant difference was de-
tected for the rhythm test [t(26) = 0.132, p 0.448, d
0.03] showing that there was no reliable discrimination
between the high performing and low performing resi-
dents based on the rhythm test. There was no difference
in performance related to whether residents were assigned
to group A or group B (p>0.05).
In the debriefing, the residents commented that in the
pre assessment the confederate team was difficult to lead
and seemed to lack content knowledge and skill in re-
suscitation. Their comments at the post assessment were
entirely different; they felt that the team was much bet-
ter trained and more knowledgeable regarding resuscita-
tion. They initially did not attribute this to their
improved leadership skills. However, we used the same
simulation case and standardized team of confederates
for pre and post assessments so that we controlled the
teams performance and ensured that it was not signifi-
cantly different between the two assessments.
The use of in-situ simulation to determine a needs as-
sessment enabled the simulation curriculum to incorpor-
ate the exact problems and barriers the resident would
experience in clinical care. It ensured that we were
teaching to the actual gaps in knowledge and skills. We
addressed issues that the residents demonstrated during
the gap analysis such as closed loop communication,
maintaining situational awareness and assigning roles
and responsibilities. Importantly, after training in these
leadership skills we observed an improvement in the
clinically important outcome of time to defibrillation.
Needs assessments in medical education are often
done using data gathered from surveys, structured inter-
views, observations of clinical practice, or peer review
data [17]. Focus groups have been described as a method
to assess needs for simulation based emergency training
[18]. The incorporation of input from multiple stake-
holders (insurers, educational institutions, funders, em-
ployers, regulators) has also been described in the
development of simulation curriculum [19]. In addition
to the above methods for gathering data to inform cur-
riculum development, in-situ simulation can be consid-
ered an additional option. To our knowledge, this is the
first time that using simulation to perform both a needs
assessment and an intervention has been reported.
By using in-situ simulation as a needs assessment tool,
we developed a focused curriculum to meet the needs of
our residents, rather than just repeating training in
ACLS. While AHA acknowledges that every 2 years
training in ACLS is not sufficient, the best approach to
training during that interim 2-year period is unknown.
We believe that in-situ simulation alone is unlikely to
correct deficits. However, using in-situ simulation to
identify gaps and addressing them with a focused cur-
riculum informed by this assessment, has potential to be
an effective approach. We are currently using in-situ
simulation for needs assessment for other areas of emer-
gency response including pediatric, surgical, neurologic
and obstetric emergencies. Future work will be needed
to determine the optimal time frame to repeat in-situ
simulation for the purpose of re-assessing the need for
curriculum developed in this fashion.
Table 3 Descriptive Statistics and 95% Confidence Intervals of the Dependent Measures
Variable Time Mean + SD 95% Confidence Interval (LL, UL)
Cardiac arrest team leader performance Pre-test 47.6 + 25.9 (37.3, 57.9)
Cardiac arrest team leader performance Post-test 84.3 + 13.3 (79.0, 89.5)
RVTSD Pre-test 102.2 + 21.4 (74.0, 130.5)
RVTSD Post-test 56.3 + 59.5 (32.7, 79.8)
Rhythm Test Once 80.4 + 14.5 (74.6, 86.1)
Content Exam Once 86.0 + 10.7 (81.8, 90.3)
RVTSD rhythm visible time to shock delivered, SD standard deviation, LL lower limit, UL upper limit. Con tent Exam was an electronic multiple choice exam
Zern et al. Advances in Simulation (2020) 5:6 Page 5 of 7
We found that training of the team leader in ACLS
and teamwork and communication skills using Team-
STEPPS® with RCDP can improve team performance in
simulated cardiac arrest. Prior work has shown improve-
ments in clinical outcomes of pediatric patients after
simulation based code team training [10]. Our study dif-
fered in that we focused our intervention only on the
resident code team leaders. This is important because
many institutions, including ours, are faced with training
thousands of healthcare providers to respond to cardiac
arrest emergencies. While we believe that training the
actual responding team is optimal, when this is not lo-
gistically possible, our data suggest that training focused
on the team leader may still have a positive impact.
We noted that many cycles of deliberate practice were
needed for residents to effectively employ TeamSTEPPS®
skills. Using simulation scenarios with RCDP allowed
the residents to practice the expected technical and non-
technical skills over and over until they became a habit.
Our goal was to make sure the newly learned Team-
STEPPS® concepts and tools would be solidly incorpo-
rated into each residents repertoire, i.e. assessing chest
compressions, assigning roles and responsibilities, etc.
RCDP may be particularly effective debriefing method to
use in a focused simulation developed using in-situ
simulation as a needs assessment tool.
Our study has several limitations. First, we cannot de-
termine the impact our training had on actual patients.
Second, while all post-graduate year one medicine resi-
dents at our institution participated, this was a small
study at one institution, and it would be important to
know if the same findings could be replicated in larger
studies at other institutions. Also, all participants re-
ceived training, so the lack of a control group is a limita-
tion of this study. Future work will need to determine
the durability of this training and impact on actual pa-
tients. Lastly, the training sequence may have had an im-
pact on resident learning and retention.
In conclusion, a novel code team leader training course
using in-situ simulation data to develop the curriculum
and combining TeamSTEPPS® principals and ACLS sci-
ence update can provide sustained improvement in resi-
dent performance as code team leaders.
ACLS: Advanced Cardiac Life SupportRCDPRapid Cycle Deliberate
PracticeAHAAmerican Heart AssociationTeamSTEPPSTeam Strategies and
Tools to Enhance Performance and Patient SafetyBLSBasic Life
SupportMICUMedical intensive care unitRCPRespiratory care
providerDODDepartment of DefenseAHRQAgency for Healthcare Research
and QualityRVTSDRhythm Visible-time to shock delivered
Not applicable
SCZ, WJM and MTV contributed to design of the study and data collection.
PAS performed statistical analysis. All authors contributed to the analysis of
data and drafting of manuscript. All authors contributed to manuscript
revisions and approved the final version of manuscript.
Author information
SCZ is Director of Simulation, Virtual Education and Simulation Training
(VEST) Center, Christiana Care Health System. WJM is Simulation Specialist
Coordinator, Virtual Education and Simulation Training (VEST) Center,
Christiana Care Health System. He is also a nurse with extensive experience
in emergency medicine and an ACLS instructor. PAS is Professor, College of
Nursing and Health Professions, School of Biomedical Engineering, Science
and Health Systems, and School of Education at Drexel University. MTV is a
critical care physician at Christiana Care Healthcare System and an Assistant
Professor of Medicine at Sidney Kimmel Medical College.
No external source of funding
Availability of data and materials
The datasets generated and/or analyzed during the current study are not
publicly available due to need to protect the privacy of the trainees who
participated but are available from the corresponding author on reasonable
Ethics approval and consent to participate
This study was submitted to the Christiana Care Institutional Review Board
and was determined to be exempt.
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Author details
Virtual Education and Simulation Training (VEST) Center, Christiana Care
Health System, 4755 Ogletown-Stanton Road, Ammon MEC LE86B, Newark,
Delaware 19718, USA.
Nutrition Sciences Department, College of Nursing
and Health Professions; School of Biomedical Engineering, Science and
Health Systems, and Department of Teaching, Learning & Curriculum, School
of Education, Drexel University, 3rd Floor, Room 382, Parkway Building, 1601
Cherry Street, Mail Stop 31030, Philadelphia, PA 19102, USA.
Department of
Internal Medicine, Section of Pulmonary and Critical Care Medicine,
Christiana Care Health System, 4755 Ogletown-Stanton Road, Medical
Intensive Care Unit, 3E, Newark, Delaware 19713, USA.
Sidney Kimmel
Medical College, Philadelphia, PA, USA.
Received: 15 September 2019 Accepted: 14 May 2020
1. Kronick SL, Kurz MC, Lin S, et al. Part 4: Systems of Care and Continuous
Quality Improvement: 2015 American Heart Association Guidelines Update
for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care.
Circulation. 2015;132(18 Suppl 2):S397413.
2. Barbeito A, Bonifacio A, Holtschneider M, et al. In situ simulated cardiac
arrest exercises to detect system vulnerabilities. Simul Healthc. 2015;10(3):
3. Peberdy MA, Ornato JP, Larkin GL, et al. Survival from in-hospital cardiac
arrest during nights and weekends. JAMA. 2008;299(7):78592.
4. Robinson EJ, Smith GB, Power GS, et al. Risk-adjusted survival for adults
following in-hospital cardiac arrest by day of week and time of day:
observational cohort study. BMJ Qual Saf. 2015.
5. Blackwood J, Duff JP, Nettel-Aguirre A, Djogovic D, Joynt C. Does teaching
crisis resource management skills improve resuscitation performance in
pediatric residents?*. Pediatr Crit Care Med. 2014;15(4):e16874.
6. Fernandez Castelao E, Boos M, Ringer C, Eich C, Russo SG. Effect of CRM
team leader training on team performance and leadership behavior in
Zern et al. Advances in Simulation (2020) 5:6 Page 6 of 7
simulated cardiac arrest scenarios: a prospective, randomized, controlled
study. BMC Med Educ. 2015;15:116.
7. Burden AR, Pukenas EW, Deal ER, et al. Using Simulation Education With
Deliberate Practice to Teach Leadership and Resource Management Skills to
Senior Resident Code Leaders. J Grad Med Educ. 2014;6(3):4639.
8. Wright MC, Taekman JM, Endsley MR. Objective measures of situation
awareness in a simulated medical environment. Qual Saf Health Care. 2004;
13(Suppl 1):i6571.
9. Bhanji F, Donoghue AJ, Wolff MS, et al. Part 14: Education: 2015 American
Heart Association Guidelines Update for Cardiopulmonary Resuscitation and
Emergency Cardiovascular Care. Circulation. 2015;132(18 Suppl 2):S56173.
10. Knight LJ, Gabhart JM, Earnest KS, Leong KM, Anglemyer A, Franzon D.
Improving code team performance and survival outcomes: implementation
of pediatric resuscitation team training. Crit Care Med. 2014;42(2):24351.
11. Kern DE. Curriculum development for medical education : a six step
approach. Baltimore: Johns Hopkins University Press; 1998.
12. Team Performance Observation Tool.
longtermcare/sitetools/tmpot.html, 2014.
13. TeamSTEPPS 2.0.
Accessed November, 2018.
14. Hunt EA, Duval-Arnould JM, Nelson-McMillan KL, et al. Pediatric resident
resuscitation skills improve after rapid cycle deliberate practicetraining.
Resuscitation. 2014;85(7):94551.
15. Lakens D. Calculating and reporting effect sizes to facilitate cumulative
science: a practical primer for t-tests and ANOVAs. Front Psychol. 2013;4:863.
16. Wass V, Wakeford R, Neighbour R, Van der Vleuten C. Royal College of
General P. Achieving acceptable reliability in oral examinations: an analysis
of the Royal College of General Practitioners membership examination's oral
component. Med Educ. 2003;37(2):12631.
17. Grant J. Learning needs assessment: assessing the need. BMJ. 2002;
18. Wehbi NK, Wani R, Yang Y, et al. A needs assessment for simulation-based
training of emergency medical providers in Nebraska, USA. Adv Simul
(Lond). 2018;3:22.
19. Edwards S, Tuttle N. Using stakeholder input to inform scenario content: an
example from physiotherapy. Adv Simul (Lond). 2019;4(Suppl 1):20.
Springer Nature remains neutral with regard to jurisdictional claims in
published maps and institutional affiliations.
Zern et al. Advances in Simulation (2020) 5:6 Page 7 of 7
... LST evaluation 24 (25) Chan et al. 31 Hamman et al. 59 Hamman et al. 60 Hunt et al. 44 Kerner et al. 62 Kobayashi et al. 52 Kobayashi et al. 63 O'Leary et al. 64 Patterson et al. 10 Shrestha et al. 34 Theilen et al. 41 Ullman et al. 67 Walsh et al. 68 Whitfill et al. 69 Zimmermann et al. 70 Bradley et al. 71 Couto et al. 36 Geis et al. 72 Lakissian et al. 73 Shah et al. 37 Wong et al. 74 Petrosoniak et al. 75 Aljahany et al. 76 Zern et al. 77 Shrestha et al. 78 Gray et al. 42 Others (survey, qualitative analysis) ...
... Abu-Sultaneh et al. 96 Amiel et al. 28 Armstrong et al. 97 Auerbach et al. 38 Barker et al. 98 Bayouth et al. 99 Bredmose et al. 35 Campbell et al. 100 Coggins et al. 101 Farah et al. 102 Generoso et al. 103 Jörgens et al. 104 Jung et al. 105 Katznelson et al. 106 Lakissian et al. 73 Miller et al. 107 O'Leary et al. 87 Patterson et al. 65 Petrosoniak et al. 30 Pirie et al. 108 Qian 109 et al Saqe-Rockoff et al. 110 Truta et al. 111 Wong et al. 74 Zern et al. 77 Zimmermann et al. 70 Walsh et al. 68 Continued on August 3, 2022 by guest. Protected by copyright. ...
Full-text available
Objectives To provide an overview of the available evidence regarding the safety of in situ simulation (ISS) in the emergency department (ED). Design Scoping review. Methods Original articles published before March 2021 were included if they investigated the use of ISS in the field of emergency medicine. Information sources MEDLINE, EMBASE, Cochrane and Web of Science. Results A total of 4077 records were identified by our search strategy and 2476 abstracts were screened. One hundred and thirty full articles were reviewed and 81 full articles were included. Only 33 studies (40%) assessed safety-related issues, among which 11 chose a safety-related primary outcome. Latent safety threats (LSTs) assessment was conducted in 24 studies (30%) and the cancellation rate was described in 9 studies (11%). The possible negative impact of ISS on real ED patients was assessed in two studies (2.5%), through a questionnaire and not through patient outcomes. Conclusion Most studies use ISS for systems-based or education-based applications. Patient safety during ISS is often evaluated in the context of identifying or mitigating LSTs and rarely on the potential impact and risks to patients simultaneously receiving care in the ED. Our scoping review identified knowledge gaps related to the safe conduct of ISS in the ED, which may warrant further investigation.
... A learning needs analysis (LNA) should be carried out beforehand to determine which areas of the curriculum would benefit from simulation training. The LNA is not limited to individual skills but can encompass communication, teamworking and other non-technical skills [29][30][31][32][33][34]. Many different tools can be used for the LNA with the exact tool chosen to suit the scope of the analysis and the context of the teaching (Table 2). ...
Full-text available
Simulation-based procedure training is now integrated within health professions education with literature demonstrating increased performance and translational patient-level outcomes. The focus of published work has been centered around description of such procedural training and the creation of realistic part-task models. There has been little attention with regards to design consideration, specifically around how simulation and educational theory should directly inform programme creation. Using a case-based approach in cardiology as an example, we present a blueprint for theory-informed simulation-based procedure training linking learning needs analysis and defining suitable objectives to matched fidelity. We press the importance of understanding how to implement and utilise task competence benchmarking in practice, and the role of feedback and debriefing in cycles of repeated practice. We conclude with evaluation and argue why this should be considered part of the initial design process rather than an after-thought following education delivery.
... Foi descoberto que a simulação no treinamento do líder do time em ACLS melhora suas habilidades e trabalho em equipe, corroborando com um melhor desempenho na parada cardíaca simulada e, potencialmente, melhor desfecho para a prática realizada em paciente. Trabalhos anteriores mostraram melhorias nos resultados clínicos de pacientes pediátricos, também, após treinamento da equipe com código baseado em simulação (KNIGHT et al., 2014;ZERN et al., 2020). ...
Full-text available
Rapid cycle deliberate practice (RCDP) is a type of simulation-based medical education (SBME) where learners cycle between deliberate practice and directed feedback until skill mastery is achieved before progressing to subsequent learning objectives. This scoping review examines and summarizes the literature on RCDP, compares RCDP to other modes of instruction, and identifies knowledge gaps for future research. Of the 1224 articles identified, 23 studies met inclusion criteria. The studies varied in design, RCDP technique implementation strategies, and outcome measures. RCDP is associated with positive outcomes in immediate learner performance. It is unclear if RCDP is superior to traditional simulation.
Full-text available
Background: Simulated learning environments (SLEs) are being embraced as effective, though potentially costly tools, by health educators in a variety of contexts. The selection of scenarios, however, can be arbitrary and idiosyncratic. Methods: We conducted a stakeholder audit to determine priorities for student learning which would inform scenario design. The process consisted of (1) the identification of stakeholders, (2) consultation with stakeholders to identify their priorities, (3) determination of priorities that could be addressed in the SLE being developed, and (4) incorporating these priorities into scenarios. Results: The identified stakeholders were the funding body, educational institution and discipline, regulatory agency, accreditation agency, external clinical placement providers, employers of new graduates, patients, and learners. Stakeholder input included a combination of surveys, consultation of online resources, and semi-structured interviews. Identified areas where student learning could be improved included (1) all students not having experience of all populations or 'essential' conditions, (2) situations where adverse events had occurred, (3) working with people from diverse backgrounds or those with psychosocial issues including those in chronic pain, (4) communication, (5) situation awareness, and (6) ethical issues. Conclusions: Ten scenarios were developed considering the stakeholder input. Facilitator notes were written to ensure all facilitators addressed the areas that had been identified. Where possible, simulated patients, with diverse backgrounds, were hired to portray roles even though such areas of diversity were not explicitly written into the scenarios. Whilst the example concerns physiotherapy students within Australia, the principles may be applicable across a range of health disciplines.
Full-text available
Background Training emergency medical services (EMS) workforce is challenging in rural and remote settings. Moreover, critical access hospitals (CAHs) struggle to ensure continuing medical education for their emergency department (ED) staff. This project collected information from EMS and ED providers across Nebraska to identify gaps in their skills, knowledge, and abilities and thus inform curriculum development for the mobile simulation-based training program. Methods The needs assessment used a three-step process: (1) four facilitated focus group sessions were conducted in distinct geographical locations across Nebraska to identify participants’ perceived training gaps; (2) based on the findings from the focus group, a needs assessment survey was constructed and sent to all EMS and ED staff in Nebraska; and (3) 1395 surveys were completed and analyzed. Results Thematic areas of training gaps included cardiopulmonary conditions, diabetes management, mass casualty incidents (MCI), maternal health and child delivery, patient assessment, pediatric care (PC), and respiratory emergency care. Gaps in non-clinical skills were related to crisis management such as maintaining effective teamwork. Participants frequently identified cardiopulmonary care, PC, and MCI as highly needed trainings. Other needs included life support-related retaining courses, sessions informing protocol updates, the availability of retraining tailored for rural areas, substance use-related emergencies, and farming-related injuries. Conclusion EMS and ED staff identified several skill gaps and training needs in the provision of emergency services in rural communities. These results allow for the development of customized training curricula and, with the help of an on-site simulation-based program, can identify gaps in health professionals’ skills, knowledge, and abilities and thus help them respond to acute healthcare needs of rural communities.
Full-text available
Background Internationally, hospital survival is lower for patients admitted at weekends and at night. Data from the UK National Cardiac Arrest Audit (NCAA) indicate that crude hospital survival was worse after in-hospital cardiac arrest (IHCA) at night versus day, and at weekends versus weekdays, despite similar frequency of events. Objective To describe IHCA demographics during three day/time periods—weekday daytime (Monday to Friday, 08:00 to 19:59), weekend daytime (Saturday and Sunday, 08:00 to 19:59) and night-time (Monday to Sunday, 20:00 to 07:59)—and to compare the associated rates of return of spontaneous circulation (ROSC) for >20 min (ROSC>20 min) and survival to hospital discharge, adjusted for risk using previously developed NCAA risk models. To consider whether any observed difference could be attributed to differences in the case mix of patients resident in hospital and/or the administered care. Methods We performed a prospectively defined analysis of NCAA data from 27 700 patients aged ≥16 years receiving chest compressions and/or defibrillation and attended by a hospital-based resuscitation team in response to a resuscitation (2222) call in 146 UK acute hospitals. Results Risk-adjusted outcomes (OR (95% CI)) were worse (p<0.001) for both weekend daytime (ROSC>20 min 0.88 (0.81 to 0.95); hospital survival 0.72 (0.64 to 0.80)), and night-time (ROSC>20 min 0.72 (0.68 to 0.76); hospital survival 0.58 (0.54 to 0.63)) compared with weekday daytime. The effects were stronger for non-shockable than shockable rhythms, but there was no significant interaction between day/time of arrest and age, or day/time of arrest and arrest location. While many daytime IHCAs involved procedures, restricting the analyses to IHCAs in medical admissions with an arrest location of ward produced results that are broadly in line with the primary analyses. Conclusions IHCAs attended by the hospital-based resuscitation team during nights and weekends have substantially worse outcomes than during weekday daytimes. Organisational or care differences at night and weekends, rather than patient case mix, appear to be responsible.
Full-text available
Effective team leadership in cardiopulmonary resuscitation (CPR) is well recognized as a crucial factor influencing performance. Generally, leadership training focuses on task requirements for leading as well as non-leading team members. We provided crisis resource management (CRM) training only for designated team leaders of advanced life support (ALS) trained teams. This study assessed the impact of the CRM team leader training on CPR performance and team leader verbalization. Forty-five teams of four members each were randomly assigned to one of two study groups: CRM team leader training (CRM-TL) and additional ALS-training (ALS add-on). After an initial lecture and three ALS skill training tutorials (basic life support, airway management and rhythm recognition/defibrillation) of 90-min each, one member of each team was randomly assigned to act as the team leader in the upcoming CPR simulation. Team leaders of the CRM-TL groups attended a 90-min CRM-TL training. All other participants received an additional 90-min ALS skill training. A simulated CPR scenario was videotaped and analyzed regarding no-flow time (NFT) percentage, adherence to the European Resuscitation Council 2010 ALS algorithm (ADH), and type and rate of team leader verbalizations (TLV). CRM-TL teams showed shorter, albeit statistically insignificant, NFT rates compared to ALS-Add teams (mean difference 1.34 (95 % CI -2.5, 5.2), p = 0.48). ADH scores in the CRM-TL group were significantly higher (difference -6.4 (95 % CI -10.3, -2.4), p = 0.002). Significantly higher TLV proportions were found for the CRM-TL group: direct orders (difference -1.82 (95 % CI -2.4, -1.2), p < 0.001); undirected orders (difference -1.82 (95 % CI -2.8, -0.9), p < 0.001); planning (difference -0.27 (95 % CI -0.5, -0.05) p = 0.018) and task assignments (difference -0.09 (95 % CI -0.2, -0.01), p = 0.023). Training only the designated team leaders in CRM improves performance of the entire team, in particular guideline adherence and team leader behavior. Emphasis on training of team leader behavior appears to be beneficial in resuscitation and emergency medical course performance.
Full-text available
One major limitation in the use of human patient simulators is a lack of objective, validated measures of human performance. Objective measures are necessary if simulators are to be used to evaluate the skills and training of medical practitioners and teams or to evaluate the impact of new processes or equipment design on overall system performance. Situation awareness (SA) refers to a person’s perception and understanding of their dynamic environment. This awareness and comprehension is critical in making correct decisions that ultimately lead to correct actions in medical care settings. An objective measure of SA may be more sensitive and diagnostic than traditional performance measures. This paper reviews a theory of SA and discusses the methods required for developing an objective measure of SA within the context of a simulated medical environment. Analysis and interpretation of SA data for both individual and team performance in health care are also presented.
Based on a proven six-step model and including examples and questions to guide application of those timeless principles, Curriculum Development for Medical Education is a practical guidebook for all faculty members and administrators responsible for the educational experiences of medical students, residents, fellows, and clinical practitioners. Incorporating revisions driven by calls for reform and innovations in medical education that challenge established teaching models, the third edition includes an awareness of new accreditation standards and regulatory guidelines. The authors have expanded their discussion of survey methodology for needs assessment and stress the importance of writing competency-based goals and objectives that incorporate milestones, entrustable professional activities, and observable practice activities. With updated examples focusing on interprofessional education, collaborative practice, and educational technology, they describe educational strategies that incorporate the new science of learning. A completely new chapter presents the unique challenges of curriculum development for large, long, and integrated curricula. © 1998, 2009, 2016 Johns Hopkins University Press. All rights reserved.
The science and recommendations discussed in the other Parts of the 2015 American Heart Association (AHA) Guidelines Update for Cardiopulmonary Resuscitation (CPR) and Emergency Cardiovascular Care (ECC) form the backbone of resuscitation. They answer the “why”, “what,” and “when” of performing resuscitation steps. In a perfectly controlled and predictable environment, such as a laboratory setting, those answers often suffice, but the “how” of actual implementation depends on knowing the “who” and “where” as well. The ideal work flow to accomplish resuscitation successfully is highly dependent on the system of care as a whole. Healthcare delivery requires structure (eg, people, equipment, education, prospective registry data collection) and process (eg, policies, protocols, procedures), which, when integrated, produce a system (eg, programs, organizations, cultures) leading to outcomes (eg, patient safety, quality, satisfaction). An effective system of care (Figure 1) comprises all of these elements—structure, process, system, and patient outcomes—in a framework of continuous quality improvement (CQI). Figure 1. Taxonomy of systems of care. In this Part, we will focus on 2 distinct systems of care: the system for patients who arrest inside the hospital and the one for those who arrest outside it. We will set into context the building blocks for a system of care for cardiac arrest, with consideration of the setting, team, and available resources, as well as CQI from the moment the patient becomes unstable until after the patient is discharged. The chain of survival metaphor, first used almost 25 years ago,1 is still very relevant. However, it may be helpful to create 2 separate chains (Figure 2) to reflect the differences in the steps needed for response to cardiac arrest in the hospital (in-hospital cardiac arrest [IHCA]) and out of the hospital (out of hospital cardiac arrest [OHCA]). Regardless of where an arrest occurs, the care following resuscitation converges …
Sudden cardiac arrest is the leading cause of death in the United States. Despite new therapies, progress in this area has been slow, and outcomes remain poor even in the hospital setting, where providers, drugs, and devices are readily available. This is partly attributed to the quality of resuscitation, which is an important determinant of survival for patients who experience cardiac arrest. Systems problems, such as deficiencies in the physical space or equipment design, hospital-level policies, work culture, and poor leadership and teamwork, are now known to contribute significantly to the quality of resuscitation provided. We describe an in situ simulation-based quality improvement program that was designed to continuously monitor the cardiac arrest response process for hazards and defects and to detect opportunities for system optimization. A total of 72 simulated unannounced cardiac arrest exercises were conducted between October 2010 and September 2013 at various locations throughout our medical center and at different times of the day. We detected several environmental, human-machine interface, culture, and policy hazards and defects. We used the Systems Engineering Initiative for Patient Safety (SEIPS) model to understand the structure, processes, and outcomes related to the hospital's emergency response system. Multidisciplinary solutions were crafted for each of the hazards detected, and the simulation program was used to iteratively test the redesigned processes before implementation in real clinical settings. We describe an ongoing program that uses in situ simulation to identify and mitigate latent hazards and defects in the hospital emergency response system. The SEIPS model provides a framework for describing and analyzing the structure, processes, and outcomes related to these events.