FIGURE 6 - available via license: Creative Commons Attribution 4.0 International
Content may be subject to copyright.
Source publication
Artificial intelligence (AI) and extended reality (XR) differ in their origin and primary objectives. However, their combination is emerging as a powerful tool for addressing prominent AI and XR challenges and opportunities for cross-development. To investigate the AI-XR combination, we mapped and analyzed published articles through a multi-stage s...
Context in source publication
Similar publications
SPM HD Technology is revolutionizing SHOCK & VIBRATION monitoring. It uses patented digital signal processing algorithms to extract and enhance only the signals of interest, resulting in extreme sensitivity and unseen clarity. The presentation of disturbance-free condition data in high definition quality sets HD technology apart from conventional v...
Hazy images often have color distortion, blur and other visible visual quality degradation, affecting the performance of some advanced visual tasks. Therefore, single image dehazing has always been a challenging and significant problem. Convolutional neural network has been widely used in image dehazing task, but the limitations of convolutional op...
Citations
... 163 Incorporating AI-driven technologies like virtual reality, augmented reality, mixed reality, and metaverse into dental simulations and practical exercises in laboratory and preclinical education amplifies the efficacy of simulations for dental students. 164,165 For instance, SIMROID serves as a simulation system designed for training in a wide range of treatment methods and interpersonal communication abilities through the utilization of an exceptionally lifelike robotic patient. Apart from recording and reviewing the training operation, it has the capacity to provide human-like expressions. ...
Introduction
Healthcare amelioration is exponential to technological advancement. In the recent era of automation, the consolidation of artificial intelligence (AI) in dentistry has rendered transformation in oral healthcare from a hardware-centric approach to a software-centric approach, leading to enhanced efficiency and improved educational and clinical outcomes.
Objectives
The aim of this narrative overview is to extend the succinct of the major events and innovations that led to the creation of modern-day AI and dentistry and the applicability of the former in dentistry. This article also prompts oral healthcare workers to endeavor a liable and optimal approach for effective incorporation of AI technology into their practice to promote oral health by exploring the potentials, constraints, and ethical considerations of AI in dentistry.
Methods
A comprehensive approach for searching the white and grey literature was carried out to collect and assess the data on AI, its use in dentistry, and the associated challenges and ethical concerns.
Results
AI in dentistry is still in its evolving phase with paramount applicabilities relevant to risk prediction, diagnosis, decision-making, prognosis, tailored treatment plans, patient management, and academia as well as the associated challenges and ethical concerns in its implementation.
Conclusion
The upsurging advancements in AI have resulted in transformations and promising outcomes across all domains of dentistry. In futurity, AI may be capable of executing a multitude of tasks in the domain of oral healthcare, at the level of or surpassing the ability of mankind. However, AI could be of significant benefit to oral health only if it is utilized under responsibility, ethicality and universality.
... For example, XR researchers employed AI methods to solve problems like object tracking and virtual agent communications; AI, and situated predictions. Conversely, AI researchers adopted XR technologies to address issues such as understandability and explainability [69,56,59,14,58,1,27,24]. In such a context, an increasing body of research is orchestrating, composing, and pipelining XR and AI paradigms for the benefit of several fields of study, from consumer, academic, and industrial perspective [56,69,64,24]. ...
... Conversely, AI researchers adopted XR technologies to address issues such as understandability and explainability [69,56,59,14,58,1,27,24]. In such a context, an increasing body of research is orchestrating, composing, and pipelining XR and AI paradigms for the benefit of several fields of study, from consumer, academic, and industrial perspective [56,69,64,24]. With such premises, and considering that the ergonomics of consumer XR devices are increasing while the performance of integrated AI models is improving, it is predictable that a higher market quota for these devices will occur (e.g., Apple Vision Pro 1 ) impacting different sectors of our everyday lives [46,2]. ...
Extended Reality (XR) integrates real and virtual environments through spatial computing technologies, playing a crucial role in the development of the Metaverse. The synergy of XR with Artificial Intelligence (AI), referred to as Extended Artificial Intelligence (XRAI), enhances immersive experiences and operational efficiencies across various domains and human activities.
However, ethical considerations for XRAI remain underexplored, particularly concerning fairness, privacy, bias, and responsibility. This paper introduces the XRAI-Ethics framework, which proposes a novel approach for analyzing and extracting ethical risks and principles associated with XRAI.
The XRAI-Ethics framework aims to promote the responsible development and implementation of XRAI technologies, providing guidelines for both the public and private sectors to ensure ethical practices in emerging XR applications.
... For example, XR researchers employed AI methods to solve problems like object tracking and virtual agent communications; AI, and situated predictions. Conversely, AI researchers adopted XR technologies to address issues such as understandability and explainability [69,56,59,14,58,1,27,24]. In such a context, an increasing body of research is orchestrating, composing, and pipelining XR and AI paradigms for the benefit of several fields of study, from consumer, academic, and industrial perspective [56,69,64,24]. ...
... Conversely, AI researchers adopted XR technologies to address issues such as understandability and explainability [69,56,59,14,58,1,27,24]. In such a context, an increasing body of research is orchestrating, composing, and pipelining XR and AI paradigms for the benefit of several fields of study, from consumer, academic, and industrial perspective [56,69,64,24]. With such premises, and considering that the ergonomics of consumer XR devices are increasing while the performance of integrated AI models is improving, it is predictable that a higher market quota for these devices will occur (e.g., Apple Vision Pro 1 ) impacting different sectors of our everyday lives [46,2]. ...
Extended Reality (XR) integrates real and virtual environments through spatial computing technologies, playing a crucial role in the development of the Metaverse. The synergy of XR with Artificial Intelligence (AI), referred to as Extended Artificial Intelligence (XRAI), enhances immersive experiences and operational efficien-cies across various domains and human activities. However, ethical considerations for XRAI remain underexplored, particularly considering fairness, privacy, bias, and responsibility. This paper introduces the XRAI-Ethics framework, which aims at defining a novel approach for analyzing and extract ethical risks and principles for XRAI. The XRAI-Ethics framework seeks to promote responsible development and implementation of XRAI technologies, offering guidelines for both public and private sectors to ensure ethical practices in emerging XR applications.
... Extended reality, which includes virtual reality, augmented reality, and mixed reality, revolutionizes people's lives by enabling collaboration between real and virtual elements. It bridges the gap between the physical and virtual worlds (1)(2)(3)(4). In the field of clinical care and medical education, all three extended reality technologies have the potential to bring about significant changes. ...
Background and objectives
The Extended Reality (XR) technology was established by combining elements of Virtual Reality and Augmented Reality, offering users the advantage of working in a virtual environment. The study aimed to evaluate medical professionals’ and students’ knowledge, attitudes, and practices regarding using XR technology in Pakistan’s healthcare system and identify its benefits, drawbacks, and implications for the system’s future.
Methodology
A cross-sectional study was executed by circulating a self-structured online questionnaire among the Medical Community across Major Cities of Pakistan using various social media platforms as available sampling. The sample size was calculated to be 385 using RAOSOFT. Cronbach’s alpha was calculated as 0.74. The Exploratory Factor Analysis (EFA) conducted on the dataset was validated using the Kaiser-Meyer-Olkin (KMO) measure and Bartlett’s Test of Sphericity. The KMO value of 0.752 indicates adequate sampling, and Bartlett’s Test was significant (χ² (435) = 2809.772, p < 0.001), confirming the suitability of the data for factor analysis. Statistical analysis was done using SPSS-25, and data description was done as frequency and percentage. Pearson correlation and regression analysis kept p-value < 0.05% significant.
Results
Approximately 54.8% of 406 participants conveyed their familiarity with XR technologies. The majority of participants (83.8%) believed that using XR technology effectively enhanced medical education and patient care in Pakistan. Regarding clinical outcomes, 70.8% believed XR improved the efficiency of procedures and 52.8% agreed XR would lead to more device-dependent systems and eradicating human error (32.4%). Major barriers to XR integration included ethical and privacy issues (63.9%), lack of technological advancements in Pakistan (70%), and lack of ample knowledge and training of XR among health care professionals (45.8%). Hypothesis testing revealed a low positive but significant correlation between the use of AI-based healthcare systems and the increasing speed and accuracy of procedures (r = 0.342, p < 0.001), supporting Hypothesis 1. Similarly, a very low positive yet significant correlation was observed between the augmentation of diagnostic and surgical procedures and addressing data security and ethical issues for implementing XR (r = 0.298, p < 0.001), supporting Hypothesis 2. Lastly, a correlation between the mean Attitude (MA) score and the mean Perception (MP) score was found to be moderately positive and significant (r = 0.356, p < 0.001). Hence, the hypothesis 3 was supported.
Conclusion
XR technology has the potential to enhance medical education and patient care in Pakistan, but its adoption faces significant challenges, including ethical concerns, technological gaps, and inadequate training. The study’s findings highlight the need to address these issues to maximize the benefits of XR in healthcare.
... Future advancements in VR, potentially augmented by artificial intelligence (AI), could lead to more interactive and personalized training environments that closely replicate real-life medical scenarios through predictive analytics and real-time feedback. Integrating AI with VR may facilitate adaptive learning tailored to individual skills, support synchronous multinational collaboration through features like automatic language translation, and help overcome current VR-based simulation challenges [28]. These advancements are poised to transform neonatal resuscitation training, significantly enhancing the quality and accessibility of medical education worldwide. ...
Objective
This pilot implementation study introduces a novel, neonatal-specific virtual reality (VR) simulation platform for resuscitation training and assesses its initial feasibility and reception in a neonatal intensive care unit setting.
Study design
We developed a custom VR model simulating a resuscitation scenario for a 30-week neonate. Neonatal providers completed individualized training sessions and post-training surveys.
Results
Thirty-eight neonatal providers participated in the study. The VR platform was well-received, with 97% willing to use it again and 95% recommending it. Most participants (70.3%) found VR more realistic than traditional methods, with an average usefulness rating of 4.5/5. However, 40.5% reported adverse effects like eye strain and motion sickness. Feedback led to three significant VR platform upgrades.
Conclusion
This study demonstrates strong enthusiasm for VR among neonatal providers. While promising, further research with larger samples and comparisons to traditional methods is needed to fully evaluate VR’s effectiveness in neonatal resuscitation training.
... It seeks to replicate how humans receive information and employ computer skills to handle enormous amounts of data (Reiners, D., et al., 2021). The use of Extended Reality (XR) technology helps to improve students' performance and the educational experience. ...
In “AI-Driven Architecture: Pioneering the Digital Frontier”, explore how artificial intelligence is reshaping architecture and urban design, pushing the limits of what’s possible. From AI-supported design processes and evolving transparency in algorithms to policy impacts on smart transportation and new paradigms in architectural education, this book delves into the intersection of technology and creativity. Discover how AI is integrated into design processes, drives innovations in conceptual design, and even re-imagines the concept of infinity in architecture. Featuring case studies, thought-provoking insights, and practical examples, this book offers a comprehensive guide to the transformative power of AI in shaping the built environment.
... Several previous reviews have focused on specific, fragmented aspects of the field. For example, Reiners et al. [4] reviewed literature in the intersection of AI and extended reality. The study indicated the applications and integrations of AI and extended reality, but not in multimodality. ...
... When being discussed with extended reality, multimodality leverages multiple sensory inputs to create a more immersive and interactive experience. By engaging various senses simultaneously, 4 extended reality environments may provide realistic simulations and interactions. This approach is particularly valuable in educational settings, training programs, and performance enhancement strategies [30,31]. ...
Advanced technologies have had a transformative impact on education. In this paper, we explored the current status and future outlook of the use of AI-supported multimodal extended reality for human performance. Using a systematic scoping review design and a machine learning-based semi-automatic approach supplemented by pattern review, we derived several insights into AI-supported multimodal extended reality for human performance. Text mining and topic modeling revealed an optimal twenty-six topics from the included studies. These classifications are salient in the extended reality technologies used (i.e., virtual and augmented reality), the multimodal techniques involved (i.e., haptic, eye, and brain tracking), and the AI leveraged (i.e., machine learning accuracy). Through pattern review, we distilled topical patterns on 1) Goals and Outcomes of AI-supported Multimodal Extended Reality for Human Performance; 2) Disentangling the Dynamics of User Interactions in Virtual Environments with Multimodal Strategies; 3) Synergistic Multimodality with Emerging AI Technologies Using Machine Learning, LLMs, and VLMs; 4) Fostering Engaging, Interactive and Immersive Human Experiences through Ambient Intelligence. These nuanced details in AI-supported multimodal extended reality are emerging, yet not established enough to be classified through text mining and topic modeling. We discussed the implications of these findings for AI-supported multimodal extended reality for human performance in future research and practice.
... The combination of XR with AI has also been examined and results found that the primary motivation is focused on training AI, conferring intelligence on XR, and interpreting XR-generated data [21]. In terms of AI in education, institutions provided conflicting feedback regarding the use of large language models such as ChatGPT [22]. ...
Advancements in technology that can reshape educational paradigms, with Extended Reality (XR) have a pivotal role. This paper introduces an interactive XR intelligent assistant featuring a virtual teacher that interacts dynamically with PowerPoint presentations using OpenAI’s ChatGPT API. The system incorporates Azure Cognitive Services for multilingual speech-to-text and text-to-speech capabilities, custom lip-syncing solutions, eye gaze, head rotation and gestures. Additionally, panoramic images can be used as a sky box giving the illusion that the AI assistant is located at another location. Findings from three pilots indicate that the proposed technology has a lot of potential to be used as an additional tool for enhancing the learning process. However, special care must be taken into privacy and ethical issues.
... Reiners D. et al. conducted a systematic review on the combination of AI and extended reality, exploring various approaches to integrating AI in VR to enhance the user experience [5]. Ribeiro de Oliveira T. et al. conducted a systematic literature review on VR solutions employing AI methods, underscoring the importance of innovation and research for the further development of this technology [6]. ...
... Artificial intelligence has experienced rapid growth in recent years in various research areas such as robotics, education, and autonomous driving, leading to social transformations (Ahmad et al., 2021;Chen et al., 2020;Kasneci et al., 2023;Kusters et al., 2020;Montenegro-Rueda et al., 2023;Owoc et al., 2021;Reiners et al., 2021). Among these developments, the field of education also occupies an important place. ...
... More research is needed on how humans can coexist with AI and how to minimize the negative effects of technology (Duan et al., 2019). In this context, it is of great importance to strike a balance between technology and educators, focusing on the holistic development of students and their preparedness for an ever-changing world (Chan & Zary, 2019;Kusters et al., 2020;Rahimi & Mosalli, 2024;Reiners et al., 2021;Timotheou et al., 2023). In this context, the main aim of the study is to determine the effectiveness of using ChatGPT to overcome the difficulties experienced in the implementation of early childhood STEM education based on teacher opinions. ...
The aim of this study is to determine the effectiveness of using ChatGPT, an artificial intelligence-supported tool, to overcome the challenges in the implementation of early childhood STEM education based on teachers’ views. In the study, a case study, which is a qualitative research method, was used. The participants of the study consisted of 43 early childhood teachers specialized in the field of STEM education who were determined by purposeful sampling method. Within the scope of the study, a training program was developed for teachers to integrate ChatGPT into early childhood STEM education and teachers voluntarily participated in this program. During the training process, the researchers collected data through observation reports and semi-structured interviews conducted after the training. The collected data were subjected to content analysis using MAXQDA software, and themes, categories and codes were identified. The findings revealed the teachers’ views that the use of ChatGPT in early childhood STEM education would be beneficial. It was determined that ChatGPT would provide advantages such as guidance, effective use of existing materials, the opportunity to design student-specific activities, and the potential to complete teachers’ missing knowledge. However, teachers also think that ChatGPT may cause negative situations such as technological addiction, regression in social skills, damage to the teacher-student relationship and misinformation. In conclusion, ChatGPT can benefit students’ education.
