Validation of a self-efficacy instrument and its relationship to performance of crisis resource management skills

Department of Pediatrics, University of California Davis, Sacramento, 95817, USA.
Advances in Health Sciences Education (Impact Factor: 2.71). 12/2011; 16(5):579-90. DOI: 10.1007/s10459-011-9274-7
Source: PubMed

ABSTRACT Self-efficacy is thought to be important for resuscitation proficiency in that it influences the development of and access to the associated medical knowledge, procedural skills and crisis resource management (CRM) skills. Since performance assessment of CRM skills is challenging, self-efficacy is often used as a measure of competence in this area. While self-efficacy may influence performance, the true relationship between self-efficacy and performance in this setting has not been delineated. We developed an instrument to measure pediatric residents' self-efficacy in CRM skills and assessed its content validity, internal structure, and relationship to other variables. After administering the instrument to 125 pediatric residents, critical care fellows and faculty, we performed an exploratory factor analysis within a confirmatory factor analysis as well as a known group comparison. The analyses specified four factors that we defined as: situation awareness, team management, environment management, and decision making. Pediatric residents reported lower self-efficacy than fellows and faculty in each factor. We also examined the correlation between self-efficacy and performance scores for a subset of 30 residents who led video recorded simulated resuscitations and had their performances rated by three observers. We found a significant, positive correlation between residents' self-efficacy in situation awareness and environment management and their overall performance of CRM skills. Our findings suggest that in a specific context, self-efficacy as a form of self-assessment may be informative with regards to performance.

1 Bookmark
  • The Interpreter and translator trainer 07/2014; 8(2):183-203. · 0.18 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Pediatrics residents are expected to demonstrate preparedness for neonatal resuscitation, yet research has shown gaps in residents' readiness to perform this skill. To evaluate procedural skills and team performance of pediatrics residents during neonatal resuscitation (NR) using a high-fidelity mannequin, and to assess residents' confidence in their NR skills before and after training. Two teams of residents (all had completed NR program training) participated in 2 separate, 90-minute sessions (2 to 3 weeks apart) in an off-site delivery room during their neonatal intensive care rotation. Residents' confidence in assisting and leading NR was surveyed before each session. Teams participated in a scenario (adapted from the NR program), which required 5 skills (positive pressure ventilation, chest compressions, endotracheal intubation, umbilical vein catheterization, and epinephrine administration). Video recording was used for debriefing and scoring. Skills were scored for technique and timeliness, and team behaviors were scored for communication, management, and leadership. Twenty-six residents (11 teams) completed 2 paired sessions. Self-confidence scores increased between the 2 sessions but were not correlated with performance. Gaps in procedural skill performance were observed, and timeliness for most skills did not meet expectations. Significant improvement in team communication was noted. Important gaps in procedural skill performance, particularly timeliness, were detected by NR simulation training; residents' improvements in self-confidence did not reflect gains in actual performance. Their relative unpreparedness for NR (despite prior certification) highlights the need for deliberate practice and specific team training before and during neonatal intensive care delivery room rotations.
    Journal of graduate medical education. 09/2013; 5(3):399-404.
  • [Show abstract] [Hide abstract]
    ABSTRACT: Valid teamwork assessment is imperative to determine physician competency and optimize patient outcomes. We systematically reviewed published instruments assessing teamwork in undergraduate, graduate, and continuing medical education in general internal medicine and all medical subspecialties. We searched MEDLINE, MEDLINE In-process, CINAHL and PsycINFO from January 1979 through October 2012, references of included articles, and abstracts from four professional meetings. Two content experts were queried for additional studies. Included studies described quantitative tools measuring teamwork among medical students, residents, fellows, and practicing physicians on single or multi-professional (interprofessional) teams. Instrument validity and study quality were extracted using established frameworks with existing validity evidence. Two authors independently abstracted 30 % of articles and agreement was calculated. Of 12,922 citations, 178 articles describing 73 unique teamwork assessment tools met inclusion criteria. Interrater agreement was intraclass correlation coefficient 0.73 (95 % CI 0.63-0.81). Studies involved practicing physicians (142, 80 %), residents/fellows (70, 39 %), and medical students (11, 6 %). The majority (152, 85 %) assessed interprofessional teams. Studies were conducted in inpatient (77, 43 %), outpatient (42, 24 %), simulation (37, 21 %), and classroom (13, 7 %) settings. Validity evidence for the 73 tools included content (54, 74 %), internal structure (51, 70 %), relationships to other variables (25, 34 %), and response process (12, 16 %). Attitudes and opinions were the most frequently assessed outcomes. Relationships between teamwork scores and patient outcomes were directly examined for 13 (18 %) of tools. Scores from the Safety Attitudes Questionnaire and Team Climate Inventory have substantial validity evidence and have been associated with improved patient outcomes. Review is limited to quantitative assessments of teamwork in internal medicine. There is strong validity evidence for several published tools assessing teamwork in internal medicine. However, few teamwork assessments have been directly linked to patient outcomes.
    Journal of General Internal Medicine 12/2013; · 3.42 Impact Factor

Full-text (2 Sources)

Available from
May 27, 2014