(A) Total operative time and (B) time from trocar insertion to cystic duct clipping for LCH and CLC. Boxes and horizontal bars denote interquartile range and median operative time, respectively. Lower and upper whiskers denote minimum and maximum values, respectively. Cross marks denote mean operative time. LCH, laparoscopic cholecystectomy with HoloLens2; CLC, conventional laparoscopic cholecystectomy.

(A) Total operative time and (B) time from trocar insertion to cystic duct clipping for LCH and CLC. Boxes and horizontal bars denote interquartile range and median operative time, respectively. Lower and upper whiskers denote minimum and maximum values, respectively. Cross marks denote mean operative time. LCH, laparoscopic cholecystectomy with HoloLens2; CLC, conventional laparoscopic cholecystectomy.

Source publication
Article
Full-text available
Background Mixed-reality technology, a new digital holographic image technology, is used to present 3-dimensional (3D) images in the surgical space using a wearable mixed-reality device. This study aimed to assess the safety and efficacy of laparoscopic cholecystectomy using a holography-guided navigation system as an intraoperative support image.I...

Similar publications

Article
Full-text available
Advancements in the field of flexible electronics have enabled many novel applications such as wearables, flexible large-area displays, and textile-based sensor systems. A widely used semiconductor material for flexible electronics is amorphous indium gallium zinc oxide (a-IGZO). When compared to other semiconductors suitable for flexible technolog...

Citations

... The authors pointed out that although the safety and accuracy were assessed, the reduction of surgical time and radiation exposure were not, and the workload was not mentioned. Since this technology can also be expected to significantly reduce the workload, the workload itself should be evaluated using a questionnaire methods that have been widely validated (i.e., System Usability score, Surgical Task Load Index, and NASA-Task load index) 3,4 . However, such workload questionnaires have not been widely shared for cases of spine surgery. ...
... In laparoscopic cholecystectomy, MR guidance is feasible, but it was not preferred over traditional 2D methods in one study. Especially more experienced surgeons responded neutrally or negatively toward the implementation MR for laparoscopic cholecystectomy due to increased operating time and no significant improvements in outcome [44]. Lastly, in an extensive survey-based study [45], the reported overall experience with MR using HMD was good, with an important advantage being the ability to superimpose (visual) information on the patient's body. ...
Article
Background Mixed reality (MR) and its potential applications have gained increasing interest within the medical community over the recent years. The ability to integrate virtual objects into a real-world environment within a single video-see-through display is a topic that sparks imagination. Given these characteristics, MR could facilitate preoperative and preinterventional planning, provide intraoperative and intrainterventional guidance, and aid in education and training, thereby improving the skills and merits of surgeons and residents alike. Objective In this narrative review, we provide a broad overview of the different applications of MR within the entire spectrum of surgical and interventional practice and elucidate on potential future directions. Methods A targeted literature search within the PubMed, Embase, and Cochrane databases was performed regarding the application of MR within surgical and interventional practice. Studies were included if they met the criteria for technological readiness level 5, and as such, had to be validated in a relevant environment. Results A total of 57 studies were included and divided into studies regarding preoperative and interventional planning, intraoperative and interventional guidance, as well as training and education. Conclusions The overall experience with MR is positive. The main benefits of MR seem to be related to improved efficiency. Limitations primarily seem to be related to constraints associated with head-mounted display. Future directions should be aimed at improving head-mounted display technology as well as incorporation of MR within surgical microscopes, robots, and design of trials to prove superiority.
... Reconstructive surgery included orbital floor reconstruction [69] and radiotherapy applications involved AR-based patient positioning [70,71]. Laparoscopic surgery applications included cholecystectomy [72] and general laparoscopic surgery [73]. Heart surgery related applications included guiding the targeted delivery of media to the surface of the infarcted heart in regenerative medicine [33]. ...
... The majority of papers made use of preoperative CT data as the input to the surgical guidance strategy, corresponding with the frequent application space of orthopedic surgery and the enhanced ability of CT to generate geometrically accurate representations of rigid anatomical structures, such as bone [45,76,77]. The second most frequently used data type was MRI, either as a standalone data type [62,72,78] or in combination with CT [49,52,53]. Magnetic resonance imaging has better sensitivity than CT when imaging soft tissue structures; however, it is less geometrically precise [79] and has less signal intensity when imaging bony structures. ...
... For OST-HMD-based overlay, the HoloLens 1 was the most frequently mentioned device, followed by the HoloLens 2 and Magic Leap 1. Several groups reported successful guidance based on the OST-HMD camera and surface registration with markers [46,47,74,86] and point registration based on feature matching [48,50,87,99]. The final overlay strategy discussed is manual placement of virtual content; in this case it was up to either the surgeon [72,81] or a secondary user [55,74] to ensure comfortable placement of virtual content. After placement, virtual content remained anchored in place based on the SLAM predictions included with the HMD. ...
Article
Full-text available
We conducted a systematic review of recent literature to understand the current challenges in the use of optical see-through head-mounted displays (OST-HMDs) for augmented reality (AR) assisted surgery. Using Google Scholar, 57 relevant articles from 1 January 2021 through 18 March 2022 were identified. Selected articles were then categorized based on a taxonomy that described the required components of an effective AR-based navigation system: data, processing, overlay, view, and validation. Our findings indicated a focus on orthopedic (n=20) and maxillofacial surgeries (n=8). For preoperative input data, computed tomography (CT) (n=34), and surface rendered models (n=39) were most commonly used to represent image information. Virtual content was commonly directly superimposed with the target site (n=47); this was achieved by surface tracking of fiducials (n=30), external tracking (n=16), or manual placement (n=11). Microsoft HoloLens devices (n=24 in 2021, n=7 in 2022) were the most frequently used OST-HMDs; gestures and/or voice (n=32) served as the preferred interaction paradigm. Though promising system accuracy in the order of 2–5 mm has been demonstrated in phantom models, several human factors and technical challenges—perception, ease of use, context, interaction, and occlusion—remain to be addressed prior to widespread adoption of OST-HMD led surgical navigation.
... Three-dimensional holograms of bones are particularly useful in spinal surgery, as they can be easily created using precise models. Furthermore, there are an increasing number of reports of case-specific 3D hologram-based surgical simulations/guidance [3, [31][32][33][34][35][36][37][38][39][40][41][42]. ...
... Holoeyes MD enables holographic-based navigation by superimposing holographic elements onto the actual patient's superficial anatomy in real time on the operating table with MR HMD. Intraoperative holograms may represent the next generation of surgical support tools in terms of spatial awareness, shareability, and simplicity [3, [31][32][33][34][35][36][37][38][39][40][41][42]. ...
Article
Full-text available
The concept of minimally invasive spine therapy (MIST) has been proposed as a treatment strategy to reduce the need for overall patient care, including not only minimally invasive spine surgery (MISS) but also conservative treatment and rehabilitation. To maximize the effectiveness of patient care in spine surgery, the educational needs of medical students, residents, and patient rehabilitation can be enhanced by digital transformation (DX), including virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR), three-dimensional (3D) medical images and holograms; wearable sensors, high-performance video cameras, fifth-generation wireless system (5G) and wireless fidelity (Wi-Fi), artificial intelligence, and head-mounted displays (HMDs). Furthermore, to comply with the guidelines for social distancing due to the unexpected COVID-19 pandemic, the use of DX to maintain healthcare and education is becoming more innovative than ever before. In medical education, with the evolution of science and technology, it has become mandatory to provide a highly interactive educational environment and experience using DX technology for residents and medical students, known as digital natives. This study describes an approach to pre- and intraoperative medical education and postoperative rehabilitation using DX in the field of spine surgery that was implemented during the COVID-19 pandemic and will be utilized thereafter.
... Whereas in VR the user enters a completely simulated virtual environment, MR overlays the physical environment with digital content, offering the advantage for users to interact with these objects while still being able to see real objects. The use of MR in a medical context has previously been described in patient education, teaching and intraoperative navigation in a wide variety of surgical specialties such as orthopedics, neurosurgery, and plastic surgery [8][9][10][11][12][13][14][15][16][17][18][19][20]. Although the futuristic vision of MR as a navigational tool in surgery appears to be especially promising, there are currently many challenges remaining with regards to the technical feasibility and the accuracy of virtual model registration, in addition to the stabilization of the virtual model in a spatial environment. ...
Article
Full-text available
Percutaneous femoral arterial access is daily practice in a variety of medical specialties and enables physicians worldwide to perform endovascular interventions. The reported incidence of percutaneous femoral arterial access complications is 3–18% and often results from suboptimal puncture location due to insufficient visualization of the target vessel. The purpose of this proof-of-concept study was to evaluate the feasibility and the positional error of a mixed-reality (MR)-assisted puncture of the common femoral artery in a phantom model using a commercially available navigation system. In total, 15 MR-assisted punctures were performed. Cone-beam computed tomography angiography (CTA) was used following each puncture to allow quantification of positional error of needle placements in the axial and sagittal planes. Technical success was achieved in 14/15 cases (93.3%) with a median axial positional error of 1.0 mm (IQR 1.3) and a median sagittal positional error of 1.1 mm (IQR 1.6). The median duration of the registration process and needle insertion was 2 min (IQR 1.0). MR-assisted puncture of the common femoral artery is feasible with acceptable positional errors in a phantom model. Future studies should aim to measure and reduce the positional error resulting from MR registration.
Article
Full-text available
In the world reference context, although virtual reality, augmented reality and mixed reality have been emerging methodologies for several years, only today technological and scientific advances have made them suitable to revolutionize clinical care and medical contexts through the provision of enhanced functionalities and improved health services. This systematic review provides the state-of-the-art applications of the Microsoft® HoloLens 2 in a medical and healthcare context. Focusing on the potential that this technology has in providing digitally supported clinical care, also but not only in relation to the COVID-19 pandemic, studies that proved the applicability and feasibility of HoloLens 2 in a medical and healthcare scenario were considered. The review presents a thorough examination of the different studies conducted since 2019, focusing on HoloLens 2 medical sub-field applications, device functionalities provided to users, software/platform/framework used, as well as the study validation. The results provided in this paper could highlight the potential and limitations of the HoloLens 2-based innovative solutions and bring focus to emerging research topics, such as telemedicine, remote control and motor rehabilitation.
Article
Background: This systematic review aims to critically appraise the intraoperative use of augmented and mixed reality technology to improve surgical outcomes. Method: A literature search of PubMed, Scopus, Cochrane Central Register of Controlled Trials, ClinicalTrials.gov and WHO ICTRP was performed in accordance with Cochrane Handbook for Systematic Reviews of Interventions. Results: This review included 94 studies on 2473 patients, comprising 78 studies on augmented reality and 16 on mixed reality. This technology has seen broad intraoperative application. Augmented and mixed reality can reduce operative duration, blood loss, and the duration of inpatient care. Current evidence shows that they achieve this most in percutaneous surgery. Conclusions: Augmented and mixed reality technology improve surgical outcomes by increasing navigational speed and reducing navigational error intraoperatively. However, they have technical limitations which are the subject of ongoing research. Further studies are necessary to define how this technology is best applied intraoperatively. This article is protected by copyright. All rights reserved.
Article
Holographic navigation guidance technology mainly refers to the intraoperative holography navigation using a mixed-reality wearable computer, which can provide more probabilities to accurately remove the tumors and preserve more normal tissues. We reported a case of using this new technology to achieve precise resection of malignant bone tumors. The operation was successful, with short operative time, low blood loss, and good postoperative limb function recovery. The successful application of this technology is expected to effectively reduce the recurrence rate of malignant bone tumors, to reduce intraoperative blood loss and to avoid many perioperative complications. We believe that the novel application of holographic navigation guidance technology will bring good news to the precise and individualized treatment of bone tumor patients.