Measuring team performance in simulation-based training: adopting best practices for healthcare.

Department of Psychology, University of Central Florida, Florida, USA.
Simulation in healthcare: journal of the Society for Simulation in Healthcare (Impact Factor: 1.64). 02/2008; 3(1):33-41. DOI: 10.1097/SIH.0b013e3181626276
Source: PubMed

ABSTRACT Team performance measurement is a critical and frequently overlooked component of an effective simulation-based training system designed to build teamwork competencies. Quality team performance measurement is essential for systematically diagnosing team performance and subsequently making decisions concerning feedback and remediation. However, the complexities of team performance pose a challenge to effectively measuring team performance. This article synthesizes the scientific literature on this topic and provides a set of best practices for designing and implementing team performance measurement systems in simulation-based training.

1 Bookmark
  • [Show abstract] [Hide abstract]
    ABSTRACT: Abstract Evidence suggests that breakdowns in communication and a lack of situation awareness contribute to poor performance of medical teams. In this pilot study, three interprofessional obstetrical teams determined the feasibility of using the situation awareness global assessment technique (SAGAT) during simulated critical event management of three obstetrical scenarios. After each scenario, teams were asked to complete questionnaires assessing their opinion of how their performance was affected by the introduction of questions during a SAGAT stop. Fifteen obstetrical professionals took part in the study and completed the three scenarios in teams consisting of five members. At nine questions per stop, more participants agreed or strongly agreed that there were too many questions per stop (57.1%) than when we asked six questions per stop (13%) and three questions per stop (0%). A number of interprofessional differences in response to this interprofessional experience were noted. A team SAGAT score was determined by calculating the proportion of correct responses for each individual. Higher scores were associated with better adherence to outcome times, although not statistically significant. A robust study design building on our pilot data is needed to probe the differing interprofessional perceptions of SAGAT and the potential association between its scores and clinical outcome times.
    Journal of Interprofessional Care 07/2014; · 1.48 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: The aim of this study was to examine videotaped simulation-based team training (SBTT) and debriefing experiences from the perspectives of nursing staff and physicians on one surgical inpatient unit.
    The Journal of Continuing Education in Nursing 06/2014; · 0.71 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Human patient simulation has been widely adopted in healthcare education despite little research supporting its efficacy. The debriefing process is central to simulation education, yet alternative evaluation methods to support providing optimal feedback to students have not been well explored. Eye tracking technology is an innovative method for providing objective evaluative feedback to students after a simulation experience. The purpose of this study was to compare 3 forms of simulation-based student feedback (verbal debrief only, eye tracking only, and combined verbal debrief and eye tracking) to determine the most effective method for improving student knowledge and performance. An experimental study using a pretest-posttest design was used to compare the effectiveness of 3 types of feedback. The subjects were senior baccalaureate nursing students in their final semester enrolled at a large university in the northeast United States. Students were randomly assigned to 1 of the 3 intervention groups. All groups performed better in the posttest evaluation than in the pretest. Certain safety practices improved significantly in the eye tracking-only group. These criteria were those that required an auditory and visual comparison of 2 artifacts such as "Compares patient stated name with name on ID band." Eye tracking offers a unique opportunity to provide students with objective data about their behaviors during simulation experiences, particularly related to safety practices that involve the comparison of patient stated data to an artifact such as an ID band. Despite the limitations of current eye tracking technology, there is significant potential for the use of this technology as a method for the study and evaluation of patient safety practices.
    Dimensions of critical care nursing: DCCN 33(3):129-35.

Full-text (2 Sources)

Available from
Jun 2, 2014