Validation of a self-efficacy instrument and its relationship to performance of crisis resource management skills

Department of Pediatrics, University of California Davis, Sacramento, 95817, USA.
Advances in Health Sciences Education (Impact Factor: 2.71). 12/2011; 16(5):579-90. DOI: 10.1007/s10459-011-9274-7
Source: PubMed

ABSTRACT Self-efficacy is thought to be important for resuscitation proficiency in that it influences the development of and access to the associated medical knowledge, procedural skills and crisis resource management (CRM) skills. Since performance assessment of CRM skills is challenging, self-efficacy is often used as a measure of competence in this area. While self-efficacy may influence performance, the true relationship between self-efficacy and performance in this setting has not been delineated. We developed an instrument to measure pediatric residents' self-efficacy in CRM skills and assessed its content validity, internal structure, and relationship to other variables. After administering the instrument to 125 pediatric residents, critical care fellows and faculty, we performed an exploratory factor analysis within a confirmatory factor analysis as well as a known group comparison. The analyses specified four factors that we defined as: situation awareness, team management, environment management, and decision making. Pediatric residents reported lower self-efficacy than fellows and faculty in each factor. We also examined the correlation between self-efficacy and performance scores for a subset of 30 residents who led video recorded simulated resuscitations and had their performances rated by three observers. We found a significant, positive correlation between residents' self-efficacy in situation awareness and environment management and their overall performance of CRM skills. Our findings suggest that in a specific context, self-efficacy as a form of self-assessment may be informative with regards to performance.

1 Follower
  • [Show abstract] [Hide abstract]
    ABSTRACT: Pediatrics residents are expected to demonstrate preparedness for neonatal resuscitation, yet research has shown gaps in residents' readiness to perform this skill. To evaluate procedural skills and team performance of pediatrics residents during neonatal resuscitation (NR) using a high-fidelity mannequin, and to assess residents' confidence in their NR skills before and after training. Two teams of residents (all had completed NR program training) participated in 2 separate, 90-minute sessions (2 to 3 weeks apart) in an off-site delivery room during their neonatal intensive care rotation. Residents' confidence in assisting and leading NR was surveyed before each session. Teams participated in a scenario (adapted from the NR program), which required 5 skills (positive pressure ventilation, chest compressions, endotracheal intubation, umbilical vein catheterization, and epinephrine administration). Video recording was used for debriefing and scoring. Skills were scored for technique and timeliness, and team behaviors were scored for communication, management, and leadership. Twenty-six residents (11 teams) completed 2 paired sessions. Self-confidence scores increased between the 2 sessions but were not correlated with performance. Gaps in procedural skill performance were observed, and timeliness for most skills did not meet expectations. Significant improvement in team communication was noted. Important gaps in procedural skill performance, particularly timeliness, were detected by NR simulation training; residents' improvements in self-confidence did not reflect gains in actual performance. Their relative unpreparedness for NR (despite prior certification) highlights the need for deliberate practice and specific team training before and during neonatal intensive care delivery room rotations.
    09/2013; 5(3):399-404. DOI:10.4300/JGME-D-12-00192.1
  • [Show abstract] [Hide abstract]
    ABSTRACT: Research findings from various professional areas of activity have demonstrated that self-efficacy, or personal belief in one's capabilities is a good predictor of how one feels and behaves and what one can accomplish. Absent from this body of research are studies on Interpreting Self-Efficacy (ISE), a person's belief about their interpreting competence. Informed by the tenets of Albert Bandura's social cognitive theory, this study aims to develop an ISE scale for undergraduate trainee interpreters in Korea. The ISE scale was developed following a statistically sound format. An initial pool of 63 items was generated based on a review of the literature on self-efficacy instruments and interpreting competence, and the draft scale was checked for face and content validity. Undergraduate students majoring in consecutive interpreting at three universities in Seoul participated (N = 413) in validating the scale. The preliminary scale was refined into 21 items through analysis of internal consistency reliability and exploratory factor analysis.
    The Interpreter and translator trainer 07/2014; 8(2):183-203. DOI:10.1080/1750399X.2014.929372 · 0.18 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Focus on patient safety has increased over the last decades; however, patient safety still relies on technology and the performance of healthcare professionals. Technology improves rapidly but despite numerous reports on how to improve the performance of healthcare professionals, this improvement has been more slow than expected. The performance of healthcare professionals is a product of each individual’s medical knowledge, technical and non-technical skills as well as the settings in which these skills are used. Training and the assessment of non-technical skills for individuals or teams in healthcare have shown to improve a safe and efficient performance. However, the implementation has been slow. One reason for this might be the shortage of assessment instrument to assess individuals’ and teams’ non-technical skills. In this paper, we review the development process of 23 instruments for assessment of non-technical skills for individuals or teams within healthcare. The instruments are mainly for use in the operating room or for teams handling emergency situations. Several of the instruments are developed based on a thorough needs analysis by a team having the same professional background as the target group. Most of the instruments consist of almost the same categories of non-technical skills and many use behavioural markers. Overall, the instruments have been validated to some extent, but there is room for improvement. However, there seems to be a lack of training of the raters. The importance of providing feedback after the assessment is emphasised. The criteria on which the behavioural markers are developed should undergo continuous changes, representing the development of the patient safety culture in healthcare organisations.
    Cognition Technology and Work 02/2015; 17(1). DOI:10.1007/s10111-014-0306-y · 1.00 Impact Factor

Full-text (2 Sources)

Available from
May 27, 2014