Review of surgical robotics user interface: what is the best way to control robotic surgery?

University of Nebraska Medical Center, Center for Advanced Surgical Technology, 985126 Nebraska Medical Center, Omaha, NE 68198-5126, USA.
Surgical Endoscopy (Impact Factor: 3.31). 02/2012; 26(8):2117-25. DOI: 10.1007/s00464-012-2182-y
Source: PubMed

ABSTRACT As surgical robots begin to occupy a larger place in operating rooms around the world, continued innovation is necessary to improve our outcomes.
A comprehensive review of current surgical robotic user interfaces was performed to describe the modern surgical platforms, identify the benefits, and address the issues of feedback and limitations of visualization.
Most robots currently used in surgery employ a master/slave relationship, with the surgeon seated at a work-console, manipulating the master system and visualizing the operation on a video screen. Although enormous strides have been made to advance current technology to the point of clinical use, limitations still exist. A lack of haptic feedback to the surgeon and the inability of the surgeon to be stationed at the operating table are the most notable examples. The future of robotic surgery sees a marked increase in the visualization technologies used in the operating room, as well as in the robots' abilities to convey haptic feedback to the surgeon. This will allow unparalleled sensation for the surgeon and almost eliminate inadvertent tissue contact and injury.
A novel design for a user interface will allow the surgeon to have access to the patient bedside, remaining sterile throughout the procedure, employ a head-mounted three-dimensional visualization system, and allow the most intuitive master manipulation of the slave robot to date.

  • [Show abstract] [Hide abstract]
    ABSTRACT: Clinical robotic surgery systems do not currently provide haptic feedback because surgical instrument interactions are difficult to measure and display. Our laboratory recently developed a technology that allows surgeons to feel and/or hear the high-frequency vibrations of robotic instruments as they interact with patient tissue and other tools. Until now, this type of feedback had not been carefully evaluated by users. We conducted two human-subject studies to discover whether surgeons and non-surgeons value the addition of vibration feedback from surgical instruments during robotic surgery. In the first experiment, 10 surgeons and 10 non-surgeons (n = 20) used an augmented Intuitive da Vinci Standard robot to repeatedly perform up to four dry-lab tasks both with and without haptic and audio feedback. In the second experiment, 68 surgeons and 26 non-surgeons (n = 94) tested the same robot at a surgical conference: each participant spent approximately 5 min performing one or two tasks. Almost all subjects in both experiments (95 and 98 %, respectively) preferred receiving feedback of tool vibrations, and all subjects in the second experiment thought it would be useful for surgeons to have the option of such feedback. About half of the subjects (50, 60 %) preferred haptic and audio feedback together, and almost all the rest (45, 35 %) preferred haptic feedback alone. Subjects stated that the feedback made them more aware of tool contacts and did not interfere with use of the robot. There were no significant differences between the responses of different subject populations for any questions in either experiment. This study illustrates that both surgeons and non-surgeons prefer instrument vibration feedback during robotic surgery. Some participants found audio feedback useful but most preferred haptic feedback overall. This strong preference for tool vibration feedback indicates that this technology provides valuable tactile information to the surgeon.
    Surgical Endoscopy 12/2014; DOI:10.1007/s00464-014-4030-8 · 3.31 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Although technology and computation power have become more and more present in our daily lives, we have yet to see the same tendency in robotics applied to health care. In this work we focused on the study of four distinct applications of robotic technology to health care, named Robotic Assisted Surgery, Robotics in Rehabilitation, Prosthetics and Companion Robotic Systems. We identified the main roadblocks that are limiting the progress of such applications by an extensive examination of recent reports. Based on the limitations of the practical use of current robotic technology for health care we proposed a general modularization approach for the conception and implementation of specific robotic devices. The main conclusions of this review are: (i) there is a clear need of the adaptation of robotic technology (closed loop) to the user, so that robotics can be widely accepted and used in the context of heath care; (ii) for all studied robotic technologies cost is still prohibitive and limits their wide use. The reduction of costs influences technology acceptability; thus innovation by using cheaper computer systems and sensors is relevant and should be taken into account in the implementation of robotic systems.
    Biomedical Signal Processing and Control 03/2014; 10:65–78. DOI:10.1016/j.bspc.2013.12.009 · 1.53 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Common goals in the development of human-machine interface (HMI) technology are to reduce cognitive workload and increase function. However, objective and quantitative outcome measures assessing cognitive workload have not been standardized for HMI research. The present study examines the efficacy of a simple event-related potential (ERP) measure of cortical effort during myoelectric control of a virtual limb for use as an outcome tool. Participants trained and tested on two methods of control, direct control (DC) and pattern recognition control (PRC), while electroencephalographic (EEG) activity was recorded. Eighteen healthy participants with intact limbs were tested using DC and PRC under three conditions: passive viewing, easy, and hard. Novel auditory probes were presented at random intervals during testing, and significant task-difficulty effects were observed in the P200, P300, and a late positive potential (LPP), supporting the efficacy of ERPs as a cognitive workload measure in HMI tasks. LPP amplitude distinguished DC from PRC in the hard condition with higher amplitude in PRC, consistent with lower cognitive workload in PRC relative to DC for complex movements. Participants completed trials faster in the easy condition using DC relative to PRC, but completed trials more slowly using DC relative to PRC in the hard condition. The results provide promising support for ERPs as an outcome measure for cognitive workload in HMI research such as prosthetics, exoskeletons, and other assistive devices, and can be used to evaluate and guide new technologies for more intuitive HMI control.
    PLoS ONE 11/2014; 9(11):e112091. DOI:10.1371/journal.pone.0112091 · 3.53 Impact Factor

Dmitry Oleynikov