Figure - uploaded by Hongen Liao
Content may be subject to copyright.
Augmented reality system configuration, which consists of an IV display device, 3D data source collection equipment (computed tomography), 3D optical tracking system, and a computer. A half-silvered mirror is attached to the IV display. Through the half mirror, surgeons can see the IV image without the need for special glasses. (a) Tracker attached to the teeth; (b) tracker attached to the surgical instrument. 3D, three-dimensional; IV, integral videographic.
Source publication
To evaluate the feasibility and accuracy of a three-dimensional augmented reality system incorporating integral videography for imaging oral and maxillofacial regions, based on preoperative computed tomography data. Three-dimensional surface models of the jawbones, based on the computed tomography data, were used to create the integral videography...
Contexts in source publication
Context 1
... configuration of the AR system is shown in Figure 1. The IV image display, which has been developed at The University of Tokyo and previously described, [6][7][8] consists of a high-density rear liquid crystal display and microarray glass. ...Context 2
... system measured the position and direction of the subject's movements in real time. The tracking marker was noninva- sively attached to the subject's tooth by using a dental splint ( Figure 1a). The coordinate system of the IV images was obtained by measuring the position of the characteristics of these images in space. ...Context 3
... integrate the coordinate systems between the object and IV images, the Polaris Spectra optical tracking system was used. However, in this case, the tracking marker was attached to the surgical instrument (Figure 1b). The coordinate system of the IV images was obtained by measuring the position of the cha- racteristics of these images in space. ...Context 4
... this system, the surgeon could view the internal structures in the 3D for- mat, the data for which were initially obtained from the preoperative CT data and superimposed onto the actual subject's anatomy through a half-silvered mirror. Supplementary Movies 1-3 show the surgical sites, as viewed by the surgeon. The movies demonstrate that by using the AR technique, stereoscopy is possible from every position and that the stereoscopic images are accurately displayed across different view- ing angles. ...Similar publications
There is no apical morphological data being available for mandibular first or second premolars in the Turk-ish population. The aims of the study were (I) to assess apical morphological data of mandibular first and second premolars in a Turkish population at a young-adult age range (II) to analyze potential correlations between the size and position...
Citations
... However, it requires the installation of mounting equipment between the operator and the FoV (Fig. 5C). [17][18][19] Both the AR and MR workflows allow team member participation from a remote location if desired (demonstrated in the second workflow). This was performed with the immersive platform (Holodentist; fifthengenium) that allowed avatar creation and HMD view sharing. ...
... 22 Other reports used immersive technologies for implant navigation with registration procedures that included point to point registration with manual, stereo camera, or point cloud. 1,[15][16][17][18][19] These studies had an in vitro design and used either static surgical guides or reference tracking system. In this clinical report, navigation was obtained with static surgical guides. ...
... Virtual and Augmented and Reality (VR/AR) are used in surgery on pre-operation planning and surgeon's training (Halabi et al.,2020), (Joda et al., 2019), (Farronato et al., 2019), and (Towers et al., 2019). AR is used in complex and sensitive surgical fields such as heart, kidney, brain, pelvis, thoracic, artery, and jaw surgeries through a video display, seethrough or transparent display, and projection-based display (Suenaga et al., 2015) (Suenaga et al., 2013), (Murugesan et al., 2018), and (Tanji et al., 2022). Images are virtually generated to a real-time video stream in Video-based display overlays. ...
In medicine and healthcare, augmented reality (AR) has been used by physicians during surgical procedures. It has provedhelpful in preoperative planning and procedure navigation by allowing them to display in-depth information and visualizedetails in real time during surgery, prioritizing patient safety and healthcare. Due to the critical nature of surgical procedures,extreme accuracy is required when using ar technology to maintain patients' health. A few years ago, ar faced severalchallenges and limitations in surgeries, such as noise in real-time images, cutting errors, navigation errors, wrong implantplacement, overlay errors, navigating narrow areas, geometric accuracy limitations, image alignment, image registration,and occlusion handling. This paper reviews several recently published articles exploring ar technology usage in jaw andknee replacement surgery, focusing on identifying the newest technologies, methods, and solutions for the abovementionedlimitations. Based on data collected from the published papers, the results were compared for each problem solved in eacharticle regarding accuracy and processing time.
... Guided surgery with head-up without tracking; II. Guided surgery with a semi-transparent screen [16,17]; III. Guided surgery with digital image projection on the patient [18]; and IV. ...
... Augmented reality (AR) in education has become an innovative and promising field of research and practice due to its emphasis on superimposing virtual information on real environments, creating different contexts from traditional learning, and providing completely new imaginations about learning (Chang et al., 2022). They also state that AR is a rapidly growing research field that aims to integrate the virtual with the real environment fully Pai et al., 2016, Suenaga et al., 2013. In addition, AR programming can increase student motivation and balance between deep learning. ...
This study aims to conduct a field study on the need to develop Augmented Reality (AR) assisted practicum guidelines. Data collection instruments were in the form of questionnaires and interview guidelines. The subjects in this field study were students who became practicum assistants, physics laboratory staff, and lecturers of basic physics courses. Questionnaire data and interview results were analyzed qualitatively to see the real conditions of the practicum. Based on the results of data analysis, it is known that practicum manuals are still dominant in text, and practicum activities can be directed to practice problem-solving skills. The phenomenon of coastal areas can also be associated with physics practicum material. Based on the results of the practicum assistant's questionnaire, it is known that AR can facilitate physics practicum, so it is necessary to develop an AR-assisted practicum guide that presents audio-visual presentations. Based on the results of the interviews, it is also known that the constraints on practicum activities during this pandemic were that not all practicum courses were available at PheT to carry out virtual practicums, counter-dependence with assistant explanations in carrying out practicum procedures, so strict procedures could not be carried out, so it could be interpreted that a solution was needed an alternative practicum guide that is equipped with a video tutorial about practicum procedures. AR technology can be used to visualize tutorial videos that can be accessed offline.
... The third element is, a display system to showcase the virtual and 3D objects in the real world. Finally, a tracking device is used to register and actively track the user during the entire process in order to achieve real-time visualization [8]. The two primary categories of registration procedures are marker-free registration, which uses lasers to scan the surface of the skin, and marker-based registration, which uses anatomical landmarks, bone screws, and skin adhesive markers [9,10]. ...
... The two primary categories of registration procedures are marker-free registration, which uses lasers to scan the surface of the skin, and marker-based registration, which uses anatomical landmarks, bone screws, and skin adhesive markers [9,10]. The tracking systems are utilized to follow the patient, the instruments, and the operator's movements, and the virtual objects may be observed from different perspectives [8][9][10][11]. Two methods are employed for tracking: a) The Fiducially Markers: based on anatomical landmarks identified by X-rays, and b) Surface Matching: which relies on position sensors that are attached to both the patient and the device being used. [11]. ...
Background: The oral and cranio-maxillofacial region houses various delicate, complex and vital structures imperative for sustaining an individual's survival. Therefore, in order to provide the best possible outcome-both functionally and aesthetically, surgery in this area demands a high level of precision. In order to achieve this finesse last few decades have witnessed the birth of various innovative tools and concepts. Interactive visual guided surgical interventions is one such field of active research and upgrade, the latest addition to this being the introduction of virtual and augmented reality in the surgical domain. Conclusion: This literature review provides an insight in the current employment and future scope of this rapidly evolving technology in the field of oral and maxillofacial surgery.
... The Mandible plastic surgery helping robot with AR having error in edge and position mistakes of 5.59 ± 3.15° and 1.06 ± 0.27 mm separately. The researcher proposed an essential videography framework, which depends on AR for stereoscopic perception of 3D oral and maxillofacial area by means of superimposition of augmented 3D picture, with error (< 1mm) [39]. ...
... Some paper described the utilization of distinctive kinds of the raw data. Wang et al. [44] utilized 2D/3D camera picture just as these exploration papers of Shi et al. [38]and Suenaga et al. [39]. Some papers described utilization of CT/MRI picture. ...
... Most of the papers has used the camera-based techniques for the tracking, some are optical and stereo camera tracking methods [1,5,39,50]. Zhu et al. [51] used a different device called warm device and Qu et al. [36] used the video tracking method. ...
Augmented reality (AR) navigation system is increasingly being integrated into Image Guided Surgery systems. The use of AR registration and tracking system in operating rooms (OR) for oral and maxillofacial surgery (OMS) can result in reducing medical errors and decreasing total operation times. As such, AR systems are assisting to reduce some of the surgical complexities associated with OMS, making it easier for the surgeons to view the operation. Although AR systems has been implemented in OR for many years, there are still several factors that are less than optimal and can cause complications, such as inadequate system accuracy, poor image and video quality, high operating time and cost, and significant complexity of the system required to achieve accurate views of the surgical target of OMS. The aim of this research is to improve the use of AR in OMS using the proposed review taxonomy which incorporated Data, Visualization, and Tracking (DVT). DVT taxonomy defines the major components that are required to implement in an AR navigation system. Those components are validated and evaluated considering the clear and accurate output or view during craniofacial surgery for the end user. The proposed DVT taxonomy have been considered comparison of system, completeness of system and acceptance of the system as the major criteria. DVT is evaluated and validated our DTV taxonomy by analysing and classifying the 33 state of art publications which work in the AR navigation. This work presents a review over navigational approach towards surgery through AR which highlights the features and usefulness of AR compared to the existing surgical process in terms of processing time, accuracy, efficiency, and feasibility in surgery.
... The breadth of medical specialties demonstrates the versatility and potential uses for AR HMDs and highlights underlying procedural commonalities that motivate their use for open and interventional procedures. (9): [8,[94][95][96][97][98][99][100][101] Other (14): [58,68,[102][103][104][105][106][107][108][109][110][111][112][113] Cardiac Surgery/Interventional Cardiology (16) AR HMD (4): [7,[114][115][116] Other (12): [105,[117][118][119][120][121][122][123][124][125][126][127] Oral and Maxillofacial Surgery (13) AR HMD (4): [128][129][130][131] Other (9): [58,77,[132][133][134][135][136][137][138] General Surgery (12) AR HMD (4): [139][140][141][142] Other (8): [143][144][145][146][147][148][149][150] Endovascular Surgery (7) AR HMD (3): [151][152][153] Other (4): [154][155][156][157] Otolaryngology (7) AR HMD (3): [158][159][160] Other (4): [161][162][163][164] Dermatology/Plastic Surgery (3) AR HMD: -Other (3): [165][166][167] Emergency Medicine/Trauma (3) AR HMD (2): [168,169] Other (1): [170] Anesthesiology (2) AR HMD: -Other (2): [171,172] Obstetrics (1) AR HMD: -Other (1): [173] XR+ technologies were used in both pre-and intraoperative settings. Fifty-eight percent of all analyzed articles (85) and 79% of AR HMD articles (42) were used to perform a real or simulated surgical procedure. ...
Augmented reality (AR) head-mounted displays (HMDs) are an increasingly popular technology. For surgical applications, the use of AR HMDs to display medical images or models may reduce invasiveness and improve task performance by enhancing understanding of the underlying anatomy. This technology may be particularly beneficial in open surgeries and interventional procedures for which the use of endoscopes, microscopes, or other visualization tools is insufficient or infeasible. While the capabilities of AR HMDs are promising, their usability for surgery is not well-defined. This review identifies current trends in the literature, including device types, surgical specialties, and reporting of user demographics, and provides a description of usability assessments of AR HMDs for open surgeries and interventional procedures. Assessments applied to other extended reality technologies are included to identify additional usability assessments for consideration when assessing AR HMDs. The PubMed, Web of Science, and EMBASE databases were searched through September 2022 for relevant articles that described user studies. User assessments most often addressed task performance. However, objective measurements of cognitive, visual, and physical loads, known to affect task performance and the occurrence of adverse events, were limited. There was also incomplete reporting of user demographics. This review reveals knowledge and methodology gaps for usability of AR HMDs and demonstrates the potential impact of future usability research.
... However, it requires the installation of mounting equipment between the operator and the FoV (Fig. 5C). [17][18][19] Both the AR and MR workflows allow team member participation from a remote location if desired (demonstrated in the second workflow). This was performed with the immersive platform (Holodentist; fifthengenium) that allowed avatar creation and HMD view sharing. ...
... 22 Other reports used immersive technologies for implant navigation with registration procedures that included point to point registration with manual, stereo camera, or point cloud. 1,[15][16][17][18][19] These studies had an in vitro design and used either static surgical guides or reference tracking system. In this clinical report, navigation was obtained with static surgical guides. ...
Purpose
To present the results obtained with a novel sleeveless and keyless guided implant surgery system.
Methods
Inclusion criteria for this multicenter clinical retrospective study were fully or partially edentulous patients who had been treated with a sleeveless and keyless guided implant surgery system (R2Gate®, Megagen), and who had been rehabilitated with fixed restorations, with a minimum follow-up of 1 year. All surgeries and prosthetic procedures were conducted following the same protocol, and data were obtained from the patients’ medical records. The outcomes were the fit and stability of the surgical guide, any intra-operative and immediate post-operative complications, any biologic and prosthetic complications that occurred during the 1-year follow-up period, implant survival, and prosthetic success.
Results
Sixty patients were selected for the installation of 124 implants, through a guided procedure: 66 sleeveless, keyless surgical guides were manufactured. The incidence of immediate intra-operative (lack of space: 12.1%; lack of implant stability 2.6%) and immediate post-operative (pain and discomfort: 6.6%; mild swelling 3.3%) complications was low. In total, 112/124 implants (90.3%) were successfully placed with a guided procedure, in 52 patients; among them, 82 (73.2%) were placed with a flapless procedure. Thirty fixtures supported single crowns (SCs), 42 fixed partial dentures (FPDs) and 52 full-arch (FA) restorations. Sixty-two fixed prosthetic restorations (30 SCs, 22 FPDs and 10 FAs) were delivered; among these restorations, 15 (24.1%) were subjected to immediate functional loading. All implants (100%) survived. Two implants had peri-implant mucositis (1.6%), two SCs had abutment screw loosenings (1.6%), two FAs and one FPD had ceramic chipping/fracture (2.4%), for an overall prosthetic success amounting to 88.7%.
Conclusions
Within the limits of this study, this novel guided surgery system appeared to be clinically reliable; further studies are needed to confirm these results.
Statement of Clinical Relevance
The use of sleveless and keyless surgical guides can be clinically reliable and may be represent a valid option for the surgeon.
... It is the most malignant and harmful tumor of the head and neck, accounting for about 50% of the incidence of the head and neck squamous cell carcinoma [2]. Due to the rich blood flow and complex anatomical structure of oral and maxillofacial region, OSCC surgery often cannot completely remove the tumor [3]. At the same time, OSCC is prone to lymph node metastasis and postoperative recurrence, so its prognosis is poor [4]. ...
Objective:
N7-methylguanosine modification-related lncRNAs (m7G-related lncRNAs) are involved in progression of many diseases. This study was aimed at revealing the risk correlation between N7-methylguanosine modification-related lncRNAs and survival prognosis of oral squamous cell carcinoma.
Methods:
In the present study, coexpression network analysis and univariate Cox analysis were used to obtained 31 m7G-related mRNAs and 399 m7G-related lncRNAs. And the prognostic risk score model of OSCC patients was evaluated and optimized through cross-validation.
Results:
Through the coexpression analysis and risk assessment analysis of m7G-related prognostic mRNAs and lncRNAs, it was found that six m7G-related prognostic lncRNAs (AC005332.6, AC010894.1, AC068831.5, AL035446.1, AL513550.1, and HHLA3) were high-risk lncRNAs. Three m7G-related prognostic lncRNAs (AC007114.1, HEIH, and LINC02541) were protective lncRNAs. Then, survival curves were drawn by comparing the survival differences between patients with high and low expression of each m7G-related prognostic lncRNA in the prognostic risk score model. Further, risk curves, scatter plots, and heat maps were drawn by comparing the survival differences between high-risk and low-risk OSCC patients in the prognostic model. Finally, forest maps and the ROC curve were generated to verify the predictive power of the prognostic risk score model. Our results will help to find early and accurate prognostic risk markers for OSCC, which could be used for early prediction and early clinical intervention of survival, prognosis, and disease risk of OSCC patients in the future.
... Nevertheless, the registration and implant accuracy are improved this method as a marker-based. Suenaga et al. [22] has improved on the visualisation of the system by proposing a stereo vision for tracking and marker-less registration on the state of the art solution in [23]. They established a new AR marker-less registration system which does not need any additional display device for surgeons to see the superimposed 3D image. ...
... Accuracy and processing time results for mandible (adult[20][21][22][23][24][25][26][27][28][29][30] ...
Over time, Augmented Reality (AR) based technology becomes not being properly to implement with oral and maxillofacial surgery to visualise the narrow area spot in jaw surgery as blood vassals and root canals in these types of surgeries. Image registration is considered the major limitation of using the AR in these types of surgeries and reduces the accuracy of visualising the narrow areas. In this research, we propose a Correntropy based scale ICP algorithm as a solution to improve the image registration during jaw surgery. Correntropy is considered here to minimise the error metric of the ICP algorithm instead of the Euclidean distance measurement compared to the state-of-the-art solution. This led to decrease the registration error, increase the video accuracy and reduce the processing time simultaneously. The proposed system consists of Enhanced Tracking Learning Detection (TLD), which is used as an occlusion removal featured algorithm in the intra-operative stage of the AR-based jaw surgery system. In this research, a Modified Correntropy-based enhanced ICP (MCbeICP) algorithm is proposed for the system’s pose-refinement phase. Moreover, this proposed algorithm (MCbeICP) has a new function to process the point set registration with great noises and outliers. It eliminates the poor performance of the ICP algorithm of the noisy point set. Furthermore, the ICP algorithm considers the scale factor to register the point with different scales of the real-time video and the sample models. Additionally, this method improves the result of the pose refinement stage in terms of registration accuracy and processing time. By this method, the pose refinement stage gives an improved result in terms of registration accuracy and processing time. The samples, which were taken from the upper (maxillary) and the lower (mandible) jaw bone show that the proposed algorithm provides a significant accuracy improvement in alignment to 0.21- 0.29 mm from 0.23 to 0.35 mm and an increment in processing time from 8 to 12 frames per second (fs/s) to 10-14 fs/s compared to the result provided by state of the art. The proposed augmented reality (AR) system is focused on the overlay accuracy and processing time. Finally, this study addressed the limitation of Image registration with AR using modified Correntropy-based enhanced ICP algorithm to implement oral and maxillofacial surgery successfully.
