Construct validity testing of a laparoscopic surgery simulator (Lap Mentor): evaluation of surgical skill with a virtual laparoscopic training simulator.

Department of Surgery and Surgical Oncology, Charite Universitätsmedizin Berlin, Berlin, Germany.
Surgical Endoscopy (Impact Factor: 3.43). 07/2008; 22(6):1440-4. DOI: 10.1007/s00464-007-9625-x
Source: PubMed

ABSTRACT Before surgical simulators can be implemented for assessment of surgical training, their construct validity should be assessed.
Nine novices (NOV), nine medical students (MS), and nine residents (RES) underwent a laparoscopic skills training on the virtual reality (VR) simulator Lap Mentor. Assessment of laparoscopic skill was based on parameters measured by the computer system before and after training.
Significant difference existed between RES and NOV at seven of nine tasks before training on the VR simulator. After the training in some tasks significant differences were observed between the experienced group (RES) and the nonexperienced groups (MS and NOV) or between medical groups (RES and MS) and nonmedical group (NOV).
Performance parameters of the Lap-Mentor can be used to distinguish between subjects with varying laparoscopic experience.

  • [Show abstract] [Hide abstract]
    ABSTRACT: The FLS trainer lacks objective and automated assessments of laparoscopic performance and requires a large supply of relatively expensive consumables. Virtual reality simulation has a great potential as a training and assessment tool of laparoscopic skills and can overcome some limitations of the FLS trainer. This study was carried out to assess the value of our Virtual Basic Laparoscopic Surgical Trainer (VBLaST(©)) in the peg transfer task compared to the FLS trainer and its ability to differentiate performance between novice, intermediate, and expert groups. Thirty subjects were divided into three groups: novices (PGY1-2, n = 10), intermediates (PGY3-4, n = 10), and experts (PGY5, surgical fellows and attendings, n = 10). All subjects performed ten trials of the peg transfer task on each simulator. Assessment of laparoscopic performance was based on FLS scoring while a questionnaire was used for subjective evaluation. The performance scores in the two simulators were correlated, though subjects performed significantly better in the FLS trainer. Experts performed better than novices only on the FLS trainer while no significant differences were observed between the other groups. Moreover, a significant learning effect was found on both trainers, with a greater improvement of performance on the VBLaST(©). Finally, 82.6 % of the subjects preferred the FLS over the VBLaST(©) for surgical training which could be attributed to the novelty of the VR technology and existing deficiencies of the user interface for the VBLaST(©). This study demonstrated that the VBLaST(©) reproduced faithfully some aspects of the FLS peg transfer task (such as color, size, and shape of the peg board, etc.) while other aspects require additional development. Future improvement of the user interface and haptic feedback will enhance the value of the system as an alternative to the FLS as the standard training tool for laparoscopic surgery skills.
    Surgical Endoscopy 04/2014; · 3.43 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The LAP Mentor is a procedural simulator that provides a stepwise training for laparoscopic cholecystectomy. This study addresses its "construct" validity that is present when a simulator is able to discriminate between persons with known differences in performance level on the laparoscopic cholecystectomy in real life. Three groups with different skill levels performed 2 trials of 4 distinct parts of the cholecystectomy procedure (cholecystectomy exercises) and 1 full procedure on the LAP Mentor. Assessment parameters concerning the quantity and the quality of performance were compared between groups using the Kruskal-Wallis and Mann-Whitney U tests. The entire research was performed in the Center for Surgical Technologies, Leuven, Belgium. For study purposes, 5 expert abdominal laparoscopists (>100 laparoscopic cholecystectomies performed), 11 surgical residents (10-30 cholecystectomies performed), and 10 novices (minimal laparoscopic experience) were recruited. With regard to the quantity of performance (time needed and number of movements), the experts showed significantly better results compared with the novices in the cholecystectomy exercises. Only in the full procedure, the results of all the parameters (except speed) were significantly different between the 3 groups, with the best results observed for the experts and worst for the novices. With respect to quality of performance, only the parameter "accuracy rate of dissection" in exercise 3 showed significantly better performance by the experts. Only the full procedure of the LAP Mentor procedural simulator has enough discriminative power to claim construct validity. However, the lack of quality control, which is indispensible in the evaluation of procedural skills, makes it currently unsuited for the assessment of procedural laparoscopic skills. The role of the simulator in a training context remains to be elucidated.
    Journal of Surgical Education 04/2014; · 1.07 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Abstract Background: Efficient acquisition of endoscopic technique is essential for high-level care in surgical practice. In contrast to similar substantial risk industries, there is no standard instrument capable of detecting the potential of surgical residency candidates to develop such skills. Material and methods: We used the Simbionix "Lapmentor" Virtual reality simulator basic skills tasks 1, 5 and 6 to establish baseline performance of 17 subjects lacking surgical experience, then divided them into two groups. One group trained on the Lapmentor, a validated trainer. The second group trained on a video box trainer using 3 FLS tasks, which correlate with real OR performance. After completing the training program, each group was tested on its training modality and correlations were sought between performance in the screening tasks and final scores in both groups. Results: Time in Lapmentor task 1 showed significant correlations with total FLS scores (R 0.807 P 0.015), in addition to other benchmark parameters. With the Lapmentor group, time on task 5 demonstrated correlation with itself on the final scores (R 0.794 P 0.011). Conclusions: Time in the Lapmentor task 1 demonstrates correlations with FLS scores, which translate to better OR performance. The Lapmentor thus shows potential to be used as a screening test for surgical talent.
    Minimally invasive therapy & allied technologies: MITAT: official journal of the Society for Minimally Invasive Therapy 05/2014; · 1.33 Impact Factor


Available from