A Comparison of Orthopaedic Resident Performance on Surgical Fixation of an Ulnar Fracture Using Virtual Reality and Synthetic Models

Department of Surgery, The University of Calgary, Calgary, Alberta, Canada
The Journal of Bone and Joint Surgery (Impact Factor: 4.31). 05/2013; 95(9):e601-6. DOI: 10.2106/JBJS.K.01284
Source: PubMed

ABSTRACT Surgical trainees develop surgical skills using various techniques, with simulators providing a safe learning environment. Fracture fixation is the most common procedure in orthopaedic surgery, and residents may benefit from simulated fracture fixation. The performance of residents on a virtual simulator that allows them to practice the surgical fixation of fractures by providing a sense of touch (haptics) has not yet been compared with their performance using other methods of practicing fracture fixation, such as a Sawbones simulator model. The purpose of this study was to assess whether residents performed similarly on a newly developed virtual simulator compared with a Sawbones simulator fracture fixation model.
A stratified, randomized controlled study involving twenty-two orthopaedic surgery residents was performed. The residents were randomized to first perform surgical fixation of the ulna on either the virtual or the Sawbones simulator, after which they performed the same procedure on the other simulator. Their performance was evaluated by examiners experienced in fracture fixation who completed a task-specific checklist, global rating scale (GRS) form, and time-to-completion record for each participant on each simulator.
Both simulators distinguished between differing experience levels, demonstrating construct validity; for the Sawbones simulator, the Cohen d value (effect size) was >0.90, and for the virtual simulator, d was >1.10 (p < 0.05 for both). The participants achieved significantly better scores on the virtual simulator compared with the Sawbones simulator (p < 0.05) for all measures except time to completion. The GRS scores showed a high level of internal consistency (Cronbach α, >0.80). However, Pearson product-moment correlation analysis showed no significant correlations between the results on the two simulators; therefore, concurrent validity was not achieved.
The newly developed virtual ulnar surgical fixation simulator, which incorporates haptics, shows promise for helping surgical trainees learn and practice basic skills, but it did not attain the same standards as the current standard Sawbones simulator. The procedural measures used to assess resident performance demonstrated good reliability and validity, and both the Sawbones and the virtual simulator showed evidence of construct validity.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Background and purpose Internal fixation of hip fractures is a common and important procedure that orthopedic surgeons must master early in their career. Virtual-reality training could improve initial skills, and a simulation-based test would make it possible to ensure basic competency of junior surgeons before they proceed to supervised practice on patients. The aim of this study was to develop a reliable and valid test with credible pass/fail standards. Methods 20 physicians (10 untrained novices and 10 experienced orthopedic surgeons) each performed 3 internal fixation procedures of an undisplaced femoral neck fracture: 2 hook-pins, 2 screws, and a sliding hip screw. All procedures were preformed on a trauma simulator. Performance scores for each procedure were obtained from the predefined metrics of the simulator. The inter-case reliability of the simulator metrics was explored by calculation of intra-class correlation coefficient. Validity was explored by comparison between novices' and experts' scores using independent-samples t-test. A pass/fail standard was set by the contrasting-groups method and the consequences were explored. Results The percentage of maximum combined score (PM score) showed an inter-case reliability of 0.83 (95% CI: 0.65-0.93) between the 3 procedures. The mean PM score was 30% (CI: 7-53) for the novices and 76% (CI: 68-83) for the experienced surgeons. The pass/fail standard was set at 58%, resulting in none of the novices passing the test and a single experienced surgeon failing the test. Interpretation The simulation-based test was reliable and valid in our setting, and the pass/fail standard could discriminate between novices and experienced surgeons. Potentially, training and testing of future junior surgeons on a virtual-reality simulator could ensure basic competency before proceeding to supervised practice on patients.
    Acta Orthopaedica 04/2014; 85(4). DOI:10.3109/17453674.2014.917502 · 2.45 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: To develop and conduct a pilot study of a curriculum of 4 surrogate bone training modules to assess and track progress in basic orthopedic manual skills outside the operating room.
    Journal of Surgical Education 08/2014; DOI:10.1016/j.jsurg.2014.06.005 · 1.39 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Changing patterns of health care delivery and the rapid evolution of orthopaedic surgical techniques have made it increasingly difficult for trainees to develop expertise in their craft. Working hour restrictions and a drive towards senior led care demands that proficiency be gained in a shorter period of time whilst requiring a greater skill set than that in the past. The resulting conflict between service provision and training has necessitated the development of alternative methods in order to compensate for the reduction in ‘hands-on’ experience. Simulation training provides the opportunity to develop surgical skills in a controlled environment whilst minimising risks to patient safety, operating theatre usage and financial expenditure. Many options for simulation exist within orthopaedics from cadaveric or prosthetic models, to arthroscopic simulators, to advanced virtual reality and threedimensional software tools. There are limitations to this form of training, but it has significant potential for trainees to achieve competence in procedures prior to real-life practice. The evidence for its direct transferability to operating theatre performance is limited but there are clear benefits such as increasing trainee confidence and familiarity with equipment. With progressively improving methods of simulation available, it is likely to become more important in the ongoing and future training and assessment of orthopaedic surgeons.
    Journal of Orthopaedic Surgery and Research 12/2014; 9(126). DOI:10.1186/s13018-014-0126-z · 1.58 Impact Factor


Available from
Jun 4, 2014