About
49
Publications
8,933
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
352
Citations
Introduction
Skills and Expertise
Current institution
Publications
Publications (49)
The lack of haptic feedback in touchless human-robot interaction is critical in applications such as robotic ultrasound, where force perception is crucial to ensure image quality. Augmented reality (AR) is a promising tool to address this limitation by providing sensory substitution through visual or vibrotactile feedback. The implementation of vis...
Purpose
As technology advances, more research dedicated to medical interactive systems emphasizes the integration of touchless and multimodal interaction (MMI). Particularly in surgical and interventional settings, this approach is advantageous because it maintains sterility and promotes a natural interaction. Past reviews have focused on investiga...
In the embryonic human heart, complex dynamic shape changes take place in a short period of time on a microscopic scale, making this development difficult to visualize. However, spatial understanding of these processes is essential for students and future cardiologists to properly diagnose and treat congenital heart defects. Following a user center...
Background:
We developed an interactive augmented reality tool (HoloPointer) that enables real-time annotation on a laparoscopy monitor for intraoperative guidance. This application operates exclusively via verbal commands and head movements to ensure a sterile workflow.
Study design:
Purpose of this randomized controlled clinical trial was to e...
Learning human anatomy is key for health-related education and often requires expensive and time-consuming cadaver dissection courses. Augmented reality (AR) for the representation of spatially registered 3D models can be used as a low-cost and flexible alternative. However, suitable visualisation and interaction approaches are needed to display mu...
Group navigation is essential for arranging group members in a certain configuration, as it supports team communication and interaction in collaborative virtual reality (VR). We propose a group World-in-Miniature (group WiM) navigation technique that allows a guide to control and navigate a team within a miniature replica of the entire virtual envi...
Group navigation is essential for arranging group members in a certain configuration, as it supports team communication and interaction in collaborative virtual reality (VR). We propose a group World-in-Miniature (group WiM) navigation technique that allows a guide to control and navigate a team within a miniature replica of the entire virtual envi...
Robotic assistance is applied in orthopedic interventions for pedicle screw placement (PSP). While current robots do not act autonomously, they are expected to have higher autonomy under surgeon supervision in the mid-term. Augmented reality (AR) is promising to support this supervision and to enable human–robot interaction (HRI). To outline a futu...
Touchless interaction is popular in the medical domain because it maintains sterility and ensures physicians’ autonomy. Evaluating these technologies, however, proves difficult due to technical and human hurdles. Virtual reality leaves these limitations behind and allows for the exploration of promising concepts by simulating an environment and the...
The rapid development of available hard- and software for computer-assisted or augmented reality (AR) guided interventions creates a need for fast and inexpensive prototyping environments. However, intraoperative tracking systems in particular represent a high cost threshold. Therefore, this work presents a low-cost tracking method based on a conve...
Purpose:
Insertion point identification is a major challenge for percutaneous interventions. Planning in 2D slice image data is time-consuming and inefficient. Automated path planning can help to overcome these challenges. However, the setup of the intervention room is difficult to consider. In addition, transferring the insertion point to the ski...
In this work, we present a group World-in-Miniature (WiM) navigation technique that allows a guide to navigate a team in collaborative virtual reality (VR) environments. We evaluated the usability, discomfort, and user performance of the proposed technique compared to state-of-the-art group teleportation in a user study (n=21). The results show tha...
Minimally invasive interventions, e.g., percutaneous needle interventions, have many advantages compared to traditional surgery. However, they may require complex and time-consuming planning with experience-dependent success. Automated access path planning is faster and more consistent but individual preferences and situational circumstances are no...
Vascular structures are assessed, e.g., in tumor surgery to understand the influence of a planned resection on the vascular supply and venous drainage. The understanding of complex branching vascular structures may benefit from immersive virtual reality (VR) visualization. Therefore, the estimation of distance, depth and shape information is a cruc...
Purpose
In laparoscopic surgery training, experts guide novice physicians to desired instrument positions or indicate relevant areas of interest. These instructions are usually given via verbal communication or using physical pointing devices. To facilitate a sterile work flow and to improve training, new guiding methods are needed. This work propo...
Augmented reality (AR) may be a useful technique to overcome issues of conventionally used navigation systems supporting medical needle insertions, like increased mental workload and complicated hand-eye coordination. Previous research primarily focused on the development of AR navigation systems designed for specific displaying devices, but differ...
Augmented reality (AR) is a widely researched route for navigation support in laparoscopic surgery. Accurate registration is a crucial component for such AR systems. We introduce two methods for interactive registration that aim to be minimally invasive to the workflow and to mimic natural manipulation of 3D objects. The methods utilise spatially t...
Medical volume data is usually explored on monoscopic monitors. Displaying this data in three-dimensional space facilitates the development of mental maps and the identification of anatomical structures and their spatial relations. Using augmented reality (AR) may further enhance these effects by spatially aligning the volume data with the patient....
Medical volume data is usually explored on monoscopic monitors. Displaying this data in three-dimensional space facilitates the development of mental maps and the identification of anatomical structures and their spatial relations. Using augmented reality (AR) may further enhance these effects by spatially aligning the volume data with the patient....
Fig. 1. Needle navigation aid visualized using different display techniques. a) Video see-through visualization on a stationary tablet computer. b) Visualization displayed by an optical see-through head-mounted display. c) Spatial augmented reality visualization directly projected onto a phantom. d) Visualization shown on a monitor. Abstract-Augmen...
The correct placement of needles is decisive for the success of many minimally-invasive interventions and therapies. These needle insertions are usually only guided by radiological imaging and can benefit from additional navigation support. Augmented reality (AR) is a promising tool to conveniently provide needed information and may thus overcome t...
Augmented reality (AR) is a promising tool to convey useful information at the place where it is needed. However, perceptual issues with augmented reality visualizations affect the estimation of distances and depth and thus can lead to critically wrong assumptions. These issues have been successfully investigated for video see-through modalities. M...
The estimation of distances and spatial relations between surgical instruments and surrounding anatomical structures is a challenging task for clinicians in image-guided surgery. Using augmented reality (AR), navigation aids can be displayed directly at the intervention site to support the assessment of distances and reduce the risk of damage to he...
Instrument placement in intraoperative environments demands accurate estimation of distance between surgical tools and obstacles. In this work, AR visualization concepts were combined with real-time auditory display. A pilot study showed that enhancing AR visualization with auditory display provided qualitative and quantitative advantages but showe...
Augmented reality can provide valuable guidance information for the navigation of surgical instruments. Such applications usually require spatial tracking data. The mixed reality glasses Microsoft HoloLens seem to be well-suited devices to convey this data. Existing approaches that provide HoloLens applications with surgical instrument tracking inf...
Hintergrund:
Cholezystektomien zählen zu den häufigen laparoskopischen Weiterbildungseingriffen bei denen der Operateur (Assistenzarzt) durch den Kameraassistenten (Facharzt) angeleitet wird. Mithilfe einer neu entwickelten Applikation für ein Augmented Reality (AR) Display (Microsoft HoloLens) soll die verbale Kommunikation unterstützt werden ohn...
Instrument navigation in needle-based interventions can benefit from augmented reality (AR) visualisation. Design aspects of these visualisations have been investigated to a limited degree. This work examined colour-specific parameters for AR instrument navigation, that have not been successfully researched before. Three different mapping methods t...
Augmented reality (AR) is a promising tool to improve instrument navigation in needle-based interventions. Limited research has been conducted regarding suitable navigation visualizations. In this work, three navigation concepts based on existing approaches were compared in a user study using a projective AR setup. Each concept was implemented with...
Image-guided surgery near anatomical or functional risk structures poses a challenging task for surgeons. To this end, surgical navigation systems that visualize the spatial relation between patient anatomy (represented by 3D images) and surgical instruments have been described. The provided 3D visualizations of these navigation systems are often c...
Image-guided surgery near anatomical or functional risk structures poses a challenging task for surgeons. To this end, surgical navigation systems that visualize the spatial relation between patient anatomy (represented by 3D images) and surgical instruments have been described. The provided 3D visualizations of these navigation systems are often c...
Augmented reality (AR) is a promising tool to improve instrument navigation in needle-based interventions. Limited research has been conducted regarding suitable navigation visualizations. In this work, three navigation concepts based on existing approaches were compared in a user study using a projective AR setup. Each concept was implemented with...
Background
Navigation support in interventional MRI is separated from the operating field, which makes it difficult to interpret positions and orientations and to coordinate the necessary hand movements.
Methods
We developed a projector‐based augmented reality system to enable visual navigation of tracked instruments on pre‐planned paths and visua...
During MRI-guided interventions, navigation support is often separated from the operating field on displays, which impedes the interpretation of positions and orientations of instruments inside the patient's body as well as hand-eye coordination. To overcome these issues projector-based augmented reality can be used to support needle guidance insid...
Die Planung chirurgischer Eingriffe stellt einen entscheidenden Schritt bei der Behandlung von Erkrankungen wie Lebermetastasen dar. Zur Unterstützung von Chirurgen wurden daher zahlreiche Anwendungen zur Planung und abstrakten Simulation solcher Eingriffe entwickelt. Diese stoßen jedoch schnell an verschiede-ne Grenzen, wie unzureichende Interakti...
