Validation of a self-efficacy instrument and its relationship to performance of crisis resource management skills

Department of Pediatrics, University of California Davis, Sacramento, 95817, USA.
Advances in Health Sciences Education (Impact Factor: 2.12). 12/2011; 16(5):579-90. DOI: 10.1007/s10459-011-9274-7
Source: PubMed


Self-efficacy is thought to be important for resuscitation proficiency in that it influences the development of and access to the associated medical knowledge, procedural skills and crisis resource management (CRM) skills. Since performance assessment of CRM skills is challenging, self-efficacy is often used as a measure of competence in this area. While self-efficacy may influence performance, the true relationship between self-efficacy and performance in this setting has not been delineated. We developed an instrument to measure pediatric residents' self-efficacy in CRM skills and assessed its content validity, internal structure, and relationship to other variables. After administering the instrument to 125 pediatric residents, critical care fellows and faculty, we performed an exploratory factor analysis within a confirmatory factor analysis as well as a known group comparison. The analyses specified four factors that we defined as: situation awareness, team management, environment management, and decision making. Pediatric residents reported lower self-efficacy than fellows and faculty in each factor. We also examined the correlation between self-efficacy and performance scores for a subset of 30 residents who led video recorded simulated resuscitations and had their performances rated by three observers. We found a significant, positive correlation between residents' self-efficacy in situation awareness and environment management and their overall performance of CRM skills. Our findings suggest that in a specific context, self-efficacy as a form of self-assessment may be informative with regards to performance.

1 Follower
28 Reads
    • "Of all instruments, 11 are designed for assessment in the OR; five of these are for OR teams (Healey et al. 2004; Hull et al. 2011; Mishra et al. 2009; Schraagen et al. 2010; Sevdalis et al. 2008; Undre et al. 2007), three for anaesthesiologists (Crossingham et al. 2012; Fletcher et al. 2003, 2004; Jepsen et al. 2012) and three for surgeons (Parker et al. 2013; Spanager et al. 2012; Yule et al. 2006, 2008). Four instruments are developed for assessment of NTS during resuscitations (Cooper et al. 2010; Plant et al. 2011; Thomas et al. 2004; Walker et al. 2011), two for obstetric teams (Guise et al. 2008; Morgan et al. 2012), two for trauma teams NTS' (Steinemann et al. 2012; Westli et al. 2010), two for teams in acute settings (Kim et al. 2006; Malec et al. 2007) and two for critical care teams (Lambden et al. 2013; Weller et al. 2011). Six out of seven instruments for assessment of individuals are designed for the OR. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Focus on patient safety has increased over the last decades; however, patient safety still relies on technology and the performance of healthcare professionals. Technology improves rapidly but despite numerous reports on how to improve the performance of healthcare professionals, this improvement has been more slow than expected. The performance of healthcare professionals is a product of each individual’s medical knowledge, technical and non-technical skills as well as the settings in which these skills are used. Training and the assessment of non-technical skills for individuals or teams in healthcare have shown to improve a safe and efficient performance. However, the implementation has been slow. One reason for this might be the shortage of assessment instrument to assess individuals’ and teams’ non-technical skills. In this paper, we review the development process of 23 instruments for assessment of non-technical skills for individuals or teams within healthcare. The instruments are mainly for use in the operating room or for teams handling emergency situations. Several of the instruments are developed based on a thorough needs analysis by a team having the same professional background as the target group. Most of the instruments consist of almost the same categories of non-technical skills and many use behavioural markers. Overall, the instruments have been validated to some extent, but there is room for improvement. However, there seems to be a lack of training of the raters. The importance of providing feedback after the assessment is emphasised. The criteria on which the behavioural markers are developed should undergo continuous changes, representing the development of the patient safety culture in healthcare organisations.
    Cognition Technology and Work 02/2015; 17(1). DOI:10.1007/s10111-014-0306-y · 1.31 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Simulation-based interprofessional team training is important to ensure high-quality, safe patient care, but several barriers exist, including diverging learning needs and schedules as well as limited available resources. The authors developed an in situ, simulation-based interprofessional team training program around pediatric emergencies for physicians, nurses, respiratory therapists, and pharmacists at their institution and performed an analysis of the program's impact on self-efficacy in resuscitation skills among pediatric residents and nurses. The results showed that with a design based in best principles of team training and simulation education, interprofessional team training is feasible and sustainable. The program had a beneficial effect on self-efficacy in resuscitation skills among both residents and nurses at the authors' institution and received widespread acceptance. A collaborative approach to design and implementation of interprofessional team training can lead to a sustainable program that serves both patient safety and training requirements set forth by professional organizations.
    Clinical Pediatrics 04/2011; 50(9):807-15. DOI:10.1177/0009922811405518 · 1.15 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Self-efficacy is a personal belief in one's capability to successfully execute the behaviors necessary to attain designated types of performances. Sometimes described as task-specific self-confidence, self-efficacy is a key component in many contemporary theories of motivation and learning. The purpose of this study was to develop a survey for measuring students' medical skills self-efficacy and to collect reliability and validity evidence for the instrument. A secondary purpose was to explore differences in students' self-efficacy from year 1 of medical school to year 4. We created 19 survey items based on the 6 core competencies of the Accreditation Council for Graduate Medical Education, and we collected data from 304 medical students. Results from an exploratory factor analysis suggested three interpretable factors: patient care self-efficacy (eight items, Cronbach's alpha = 0.92), interpersonal skills self-efficacy (three items, Cronbach's alpha = 0.76), and evidence-based medicine self-efficacy (three items, Cronbach's alpha = 0.79). We then compared students' self-efficacy at different stages of training using a one-way multivariate analysis of variance. Consistent with our expectations, we found several statistically significant differences, suggesting students' self-efficacy increased considerably from year 1 of medical school to year 4, F(9, 725) = 30.58, p < 0.001, Wilks' lambda = 0.46. Using this survey, medical educators and researchers have a psychometrically sound tool for measuring students' medical skills self-efficacy during undergraduate medical education. Practical implications and future directions are discussed.
    Military medicine 09/2012; 177(9 Suppl):31-7. DOI:10.7205/MILMED-D-12-00240 · 0.77 Impact Factor
Show more