Figure 4 - uploaded by Po-Han Chen
Content may be subject to copyright.
Representation of user using the HoloLens for looking at the design proposal integrated with the real environment.
Source publication
![Figure 1 Differences between AR, MR and VR. Reference: [6]](profile/Po-Han-Chen/publication/350526801/figure/fig1/AS:1086069042872367@1635950446331/Differences-between-AR-MR-and-VR-Reference-6_Q320.jpg)
Extended Reality (XR) technologies such as AR, VR and MR have influenced many industries, including architecture. Even though they are all capable of creating immersive digital worlds, the only one capable of merging the real world with a holographic 3D modelby letting the user interact intuitively and naturally with the project is MR. In this pape...
Context in source publication
Citations
... In addition to immersive visualization, XR enhances collaborative design processes, allowing multiple professionals to work together on the same project from different physical locations. Through hand-tracking and full-body tracking, architects and engineers can manipulate 3D models in real-time, using intuitive gestures to adjust designs, place virtual tools, or test structural components [89]. This ability to interact with digital models in a shared virtual space fosters more efficient collaboration and innovation, especially in large-scale urban planning projects that require input from various disciplines. ...
... This technology allows remote collaborators to work on the same virtual project, make adjustments, and provide feedback as though they were physically present together. Full-body tracking enhances collaborative experiences, allowing users to move freely in the virtual space, which is particularly useful for large-scale projects like building designs or landscape architecture [89]. Additionally, EEG and GSR sensors monitor participants' cognitive and emotional states, ensuring that workloads and tasks are adjusted to optimize performance [43]. ...
This scoping review examines the broad applications, risks, and ethical challenges associated with Extended Reality (XR) technologies, including Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), within the context of Metaverse. XR is revolutionizing fields such as immersive learning in education, medical and professional training, neuropsychological assessment, therapeutic interventions, arts, entertainment, retail, e-commerce, remote work, sports, architecture, urban planning, and cultural heritage preservation. The integration of multimodal technologies such as haptics, eye-tracking, face- and body-tracking, and brain-computer interfaces, enhances user engagement and interactivity, playing a key role in shaping the immersive experiences in the Metaverse. However, XR's expansion raises serious concerns, including data privacy risks, cybersecurity vulnerabilities, cybersickness, addiction, dissociation, harassment, bullying, and misinformation. These psychological, social, and security challenges are further complicated by intense advertising, manipulation of public opinion, and social inequality, which could disproportionately affect vulnerable individuals and social groups. This review emphasizes the urgent need for robust ethical frameworks and regulatory guidelines to address these risks while promoting equitable access, privacy, autonomy, and mental well-being. As XR technologies increasingly integrate with artificial intelligence, responsible governance is essential to ensure the safe and beneficial development of the Metaverse and the broader application of XR in enhancing human development.
... MR applications are particularly valuable in fields such as architecture, engineering, and healthcare. For example, architects can use MR to visualize a building design within its intended physical space, offering clients a walkthrough of a structure before it is built [32,33]. Similarly, in healthcare, MR can be used to simulate surgeries where real and virtual tools interact in real time, providing a safe environment for training medical students and professionals [30,34]. ...
... In addition to immersive visualization, XR enhances collaborative design processes, allowing multiple professionals to work together on the same project from different physical locations. Through hand-tracking and full-body tracking, architects and engineers can manipulate 3D models in real-time, using intuitive gestures to adjust designs, place virtual tools, or test structural components [33]. This ability to interact with digital models in a shared virtual space fosters more efficient collaboration and innovation, especially in large-scale urban planning projects that require input from various disciplines. ...
... Full-body tracking enhances collaborative experiences, allowing users to move freely in the virtual space, which is particularly useful for large-scale projects like building designs or landscape architecture [33]. Additionally, EEG and GSR sensors monitor participants' cognitive and emotional states, ensuring that workloads and tasks are adjusted to optimize performance [28]. ...
This scoping review explores the intersection of Extended Mind Theory and Extended Reality (XR) technologies, focusing on how Virtual Reality, Augmented Reality, and Mixed Reality reshape human cognition and interaction. XR enables users to offload cognitive tasks and engage in embodied experiences, extending cognition beyond the brain into digital environments. The review highlights a wide range of XR applications, from immersive learning in STEM education and medical training, neuropsychological assessment to therapeutic interventions, arts and entertainment, professional skills development, retail and e-commerce, remote work, sports training, architecture and urban planning, and cultural heritage preservation. XR's integration with modalities like haptics, eye-tracking, face- and body-tracking, and brain-computer interfaces further enhances cognitive extension and user engagement. However, alongside these advancements come significant ethical, psychological, and societal challenges, such as data privacy concerns, the psychological effects of prolonged immersion, and social inequality arising from disparate access to XR technologies. This review emphasizes the need for robust ethical frameworks that address these challenges, ensuring that XR technologies enhance human development while maintaining autonomy, privacy, and mental well-being. As XR continues to evolve and integrate with artificial intelligence and other emerging technologies, its role in expanding human cognition will depend on responsible implementation and governance.
... MR applications are particularly valuable in fields such as architecture, engineering, and healthcare. For example, architects can use MR to visualize a building design within its intended physical space, offering clients a walkthrough of a structure before it is built [32,33]. Similarly, in healthcare, MR can be used to simulate surgeries where real and virtual tools interact in real time, providing a safe environment for training medical students and professionals [30,34]. ...
... In addition to immersive visualization, XR enhances collaborative design processes, allowing multiple professionals to work together on the same project from different physical locations. Through hand-tracking and full-body tracking, architects and engineers can manipulate 3D models in real-time, using intuitive gestures to adjust designs, place virtual tools, or test structural components [33]. This ability to interact with digital models in a shared virtual space fosters more efficient collaboration and innovation, especially in large-scale urban planning projects that require input from various disciplines. ...
... Full-body tracking enhances collaborative experiences, allowing users to move freely in the virtual space, which is particularly useful for large-scale projects like building designs or landscape architecture [33]. Additionally, EEG and GSR sensors monitor participants' cognitive and emotional states, ensuring that workloads and tasks are adjusted to optimize performance [28]. ...
This scoping review explores the intersection of Extended Mind Theory and Extended Reality (XR) technologies, focusing on how Virtual Reality, Augmented Reality, and Mixed Reality reshape human cognition and interaction. XR enables users to offload cognitive tasks and engage in embodied experiences, extending cognition beyond the brain into digital environments. The review highlights a wide range of XR applications, from immersive learning in STEM education and medical training, neuropsychological assessment to therapeutic interventions, arts and entertainment, professional skills development, retail and e-commerce, remote work, sports training, architecture and urban planning, and cultural heritage preservation. XR's integration with modalities like haptics, eye-tracking, face- and body-tracking, and brain-computer interfaces further enhances cognitive extension and user engagement. However, alongside these advancements come significant ethical, psychological, and societal challenges, such as data privacy concerns, the psychological effects of prolonged immersion, and social inequality arising from disparate access to XR technologies. This review emphasizes the need for robust ethical frameworks that address these challenges, ensuring that XR technologies enhance human development while maintaining autonomy, privacy, and mental well-being. As XR continues to evolve and integrate with artificial intelligence and other emerging technologies, its role in expanding human cognition will depend on responsible implementation and governance.
... The utilisation of real-time data visualisation enables the maintenance of up-to-date BIM models, resulting in enhanced usability and a heightened immersive encounter. The implementation of this approach holds promise in reducing gaps in spatial intelligence, enhancing understanding of projects, and facilitating improved communication in design (Alizadehsalehi et al., 2020;Carrasco & Chen, 2021;Heaton et al., 2019;Kim et al., 2021;Sidani et al., 2021;Spaeth & Khali, 2018;Xu et al., 2021). ...
Delays in project completion, cost overruns, safety risks, and poor communication among project stakeholders are just some of the leading causes of the many problems plaguing Malaysian construction projects. The construction sector in this country is suffering from these significant problems, which could be remedied with the help of emerging technologies, including Building Information Modelling (BIM) and Virtual Reality (VR). Integrating Virtual Reality (IVR) and Building Information Modelling (BIM) may help avoid and resolve such problems during construction. The features allow for remote collaboration, enhanced communication and connection, enhanced immersion and interactivity, and reduced costs. This literature review exemplifies the challenge that arose on a construction site, as well as the potential of VR technology in general and its integration in assisting the construction industry in Malaysia with BIM. Based on the comprehensive analysis conducted, it is evident that the integration of BIM and VR presents a vast potential to alleviate and resolve the pressing construction-related challenges afflicting Malaysia’s construction industry. The effective integration of these innovative technologies can revolutionise the sector by mitigating cost overruns, reducing project delays, enhancing communication, and improving safety outcomes. Therefore, realising the potential and exploring the possibilities of BIM and VR integration is crucial to overcoming the issues and promoting sustainable growth in Malaysia’s construction sector.
... Generally, MR has multiple applications in engineering, such as design visualisation, training and simulation, maintenance and repair, collaboration and communication, and marketing and sales [86]. Design visualisation involves using MR to view and interact with 3D models and CAD designs in real-time, leading to more intuitive and immersive design decisions [87,88]. MR can create realistic simulations of real-world scenarios for training and simulation, providing a safe and controlled environment for engineers to practice and improve their skills [89,90]. ...
In recent years, mine site closure and rehabilitation have emerged as significant global challenges. The escalating number of abandoned mines, exemplified by over 60,000 in Australia in 2017, underscores the urgency. Growing public concerns and governmental focus on environmental issues are now jeopardising sustainable mining practices. This paper assesses the role of unmanned aerial vehicles (UAVs) in mine closure, exploring sensor technology, artificial intelligence (AI), and
mixed reality (MR) applications. Prior research validates UAV efficacy in mining, introducing various deployable sensors. Some studies delve into AI’s use for UAV data analysis, but a comprehensive review integrating AI algorithms with MR methods for mine rehabilitation is lacking. The paper discusses data acquisition methods, repeatability, and barriers toward fully autonomous monitoring
systems for mine closure projects. While UAVs prove adaptable with various sensors, constraints such as battery life and payload capacity impact effectiveness. Although UAVs hold potential for AI testing in mine closure studies, these applications have been overlooked. AI algorithms are pivotal for creating autonomous systems, reducing operator intervention. Moreover, MR’s significance in mine closure is evident, emphasising its application in the mining industry. Ultimately, a hybrid
UAV–AI–MR technology is not only viable but essential for achieving successful mine closure and sustainable mining practices in the future.
... Mixed reality (MR) provides users with an immersive and interactive experience by combining digital objects with a realistic environment in the user's field of view. This technology is already widely used in fields such as healthcare, education, and design (Carrasco & Chen, 2021;Morimoto et al., 2022;Tang et al., 2020), and is expected to become even more prevalent with the advancement of Industry 4.0 and the third wave of the Internet (Ziker et al., 2021). However, the average user still faces significant challenges in creating and entering MR content. ...
Mixed reality (MR) technology combines digital elements with the real world, offering immersive experiences in various fields. However, content creation in MR remains challenging for average users due to complex 3D modelling techniques. This paper introduces Light-Tracing, a novel system integrating light painting with MR environments using a robotic arm. Light-Tracing allows users to intuitively create 3D models through path light painting, which AI tools convert into digital assets. The system simplifies spatial content input, making MR content creation more accessible and enhancing user experience. Evaluations demonstrate its positive impact on usability and immersion. Importantly, Light-Tracing lowers the barrier for MR content creation and opens new possibilities for participatory design in urban planning and vehicle customization, highlighting its potential to revolutionize MR content creation.
... Juan Manuel Davila Delgado et al. [12] demonstrate how VR and AR can be applied throughout the lifecycle of a building. Po-Han Chen et al. [13] show through their research that MR has a significant positive impact on the expressiveness of architectural design. This paper will review three aspects of architectural design: architectural theory, architectural practice, and architectural design. ...
With the emergence of Architecture 4.0 and the occurrence of the COVID-19 pandemic, extended reality (XR) technology has been increasingly applied in architectural education. This study aims to systematically organize and analyze the applications and outcomes of XR technology in construction education over the past five years, provide a theoretical framework for its future widespread use, and highlight its drawbacks as well as future research directions. The paper employs content analysis to summarize and analyze the findings. The report reveals that more institutions are integrating XR technology into their architectural education programs and that it has a significant impact on teacher effectiveness, student motivation, reflection and improvement, and teacher–student communication. The study suggests that XR technology will increasingly replace conventional teaching techniques in classrooms.
... Extended reality devices (XR) are increasingly common in professional and recreational settings, where reading text is a relevant part of the user experience (Burova et al., 2020;Kim et al., 2020;Osorto Carrasco and Chen, 2021). However, a major limitation of XR headsets is that reading with them is slower (Baceviciute et al., 2021;Rau et al., 2021), requires more mental effort (Baceviciute et al., 2021), and causes more eye strain (Pölönen et al., 2012) than reading from direct view displays or paper. ...
Reading is a crucial aspect of the extended reality (XR) experience across various professional and recreational contexts. Legibility, which is defined as the ease with which a character can be recognized, is an essential determinant of readability. As legibility on a specific device cannot be deduced from technical specifications alone, an efficient perceptual method for measuring legibility is needed to measure the legibility of text presented in XR. In this study, we present a method for comparing the legibility limits of XR devices, where single letter legibility is measured with fast and precise psychophysical methods. We applied the method to compare the legibility in three commercial XR headsets (Varjo VR-2, HTC Vive Pro Eye, Oculus Quest 2) in experiments with human observers. Our results show that the single letter legibility methods presented here provide an effect size approximately ten times higher compared to the widely used method of reading speed. This allows for the use of fewer observers and the detection of smaller differences, making it a more efficient and effective approach for comparing the legibility limits of XR devices.
... Various tools and techniques, such as sketches and scale models, have been utilized throughout history to address this challenge [23,24]. However, until the advent of current technologies, such as CAD and BIM, they were limited to two-dimensional representations, which reduced the intuitiveness of the process [25]. The integration of extended reality (XR) technologies with BIM has emerged as a promising tool for optimizing the communication of design ideas among professionals and stakeholders throughout the architecture, engineering, and construction (AEC) industry process [26]. ...
When producing an engaging augmented reality (AR) user experience, it is crucial to create AR content that mimics real-life objects' behavior to the greatest extent possible. A critical aspect to achieve this is ensuring that the digital objects conform to line-of-sight rules and are either partially or completely occluded, just like real-world objects would be. The study explores the concept of utilizing a pre-existing 3D representation of the physical environment as an occlusion mask that governs the rendering of each pixel. Specifically, the research aligns a Level of Detail (LOD) 1 building model and a 3D mesh model with their real-world counterparts and evaluates the effectiveness of occlusion between the two models in an outdoor setting. Despite the mesh model containing more detailed information, the overall results do not show improvement. In an indoor scenario, the researchers leverage the scanning capability of HoloLens 2.0 to create a pre-scanned representation, which helps overcome the limited range and delay of the mesh reconstruction.
... 41 Carrasco and Chen projected a virtual architectural renovation plan on the real site and let people analyze it by wearing MR glasses. 42 Kiljae Ahn developed a collaboration service platform for architectural design. 43 Huang evaluated nine different MR apps for representing architectural design and construction layout. ...
Extended reality (XR), including augmented reality (AR), mixed reality (MR), and virtual reality (VR), can make complex information more intuitively understandable. However, it still needs to be determined which XR technology is the most suitable for reviewing performance‐based building design, during which architects check whether design strategies increase energy efficiency, indoor environment quality and so forth. It requires comprehensive design and simulation information to be vividly represented. The authors develop three XR apps (AR, MR, and VR) to interactively visualize façade fenestration geometries and indoor illuminance simulations. Then XR technologies are assessed by 120 students and young architects, from task performance and engagement level two aspects. The task performance is measured by correct rate and time consumption two indicators, while the engagement level is measured by usability and interest two indicators. Evaluation results show that compared to AR and VR, MR is the best XR technology for this aim. VR outperforms AR on three indicators except for usability. By exposing three different XR technologies' performances in aiding fenestration design, this study increases the practical value of applying XR to the building design field. Comparing three XR technologies for reviewing performance‐based building design.
