No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
FlowMorph - Exploring the human-material interaction in digitally augmented craftsmanship
... In the same way, Hahm et al. and Song illustrate in their research respectively that AR immersive design method shows great potential for gesture recognition during the design process, and influences digital simulation through hand gestures (Fig. 12, Fig. 13) [33,58]. The authors prove that using the AR immersive design can generate more reasonable outcomes related to the location of physical components placed by the designer, hand gestures, and material behavior in real-time on-site locations [33,58]. ...
... In the same way, Hahm et al. and Song illustrate in their research respectively that AR immersive design method shows great potential for gesture recognition during the design process, and influences digital simulation through hand gestures (Fig. 12, Fig. 13) [33,58]. The authors prove that using the AR immersive design can generate more reasonable outcomes related to the location of physical components placed by the designer, hand gestures, and material behavior in real-time on-site locations [33,58]. By way of contrast, Goepel et al. focus on the physical model scanning and the assembly of nonstandard prefabricated elements based on the optimized parametric structure through the AR environment. ...
... The permission to re-use the figure has been granted by the author and the publisher. [33], and it summarized the real-time calculation and an immersive design process which shows that a quite simple hologram that guides a maker is sufficient rather than deploying all of the details of the 3D model. The permission to re-use the figure has been granted by the author and the publisher. ...
The use of Augmented Reality (AR) technologies has increased recently, due to the equipment update and the mature technology. For architectural design, especially in digital fabrication projects, more designers begin to integrate AR methods to achieve the visualization in the process. To help unskilled labors for holographic on-site previewing and instruction training, experimental and practice-based studies in AR for the architectural digital fabrication have emerged in recent years. Now, it is a great opportunity to discuss the topic of AR in architectural digital fabrication. By presenting a statistical review of AR technology in architecture projects, this literature review aims to review ongoing research and provide pathways for further research in architectural digital fabrication. This review article is based on information found in journal publications and conference papers in the fields of architecture, engineering, robotics, and digital fabrication, published to date (from 2010 to 2020). The review narrows the literature within these papers by filtering 84 articles through the keyword “Augmented Reality”, “Digital Fabrication” and “Assembly”. The selected articles can be categorized based on the most use of AR function in architectural digital fabrication into an order of the following three classifications with the most significant growth in the last years: (A) AR 3D holographic instruction, (B) AR data sharing, (C) AR for Human-Computer interaction. The information collected from these articles within their classifications is meant to give insight into the current state-of-the-art of AR in the architectural digital fabrication area, as well as to summarize how the topic has matured and developed over time in the research and industry literature. This article has not only analyzed the existing literature but also highlighted new emerging fields in AR research and the future trends of AR function in architectural digital fabrication.
... By harnessing the visual instruction MR can provide throughout fabrication, this tool has been harnessed in not only the instruction of students in typical construction methods, but also in challenging students to experiment with materials, fabrication techniques, and begin to develop problem solving within construction contexts. In several courses instructed at UCL Bartlett B-Pro AD, students are encouraged to use innovative material experimentation in order to generate precise physical manifestations of their complex digitally generated geometries (Fig.10) (Hahm, Maciel, Sumitiomo, & Lopez Rodriguez, 2019). Such fabrication methods gave students the ability to not only realize physically the very complex geometries they are able to model digitally, but also allowed them to become participants in the actual generation of the final product. ...
... Such fabrication methods gave students the ability to not only realize physically the very complex geometries they are able to model digitally, but also allowed them to become participants in the actual generation of the final product. While robotic and digital fabrication is frequently used when seeking precise formal accuracy, the combination of MR and human intuition eliminates the need for heavy computing and allows for a much more free and adaptive process (Hahm, Maciel, Sumitiomo, & Lopez Rodriguez, 2019). In addition, expensive technologies like robotic arms and large-scale 3D printers are frequently prohibitively expensive to purchase and maintain within architecture institutions, making MR fabrications a much more cost-effective and flexible alternative. ...
... Fabrication and material experimentation using MR technologies(Hahm, Maciel, Sumitiomo, & Lopez Rodriguez, 2019). ...
... Although Augmented Reality is not a new concept, it has been only in the last three years that the technology has broken into the mainstream with the development of consumer Augmented Reality devices (Coppens 2017). This is rapidly opening up possibilities in every aspect of our daily lives and is expected to greatly impact every field in the near future, including design and fabrication (Hahm et al. 2019). Therefore, the timing is ideal to think about the impact of Mixed Reality (MR) / Augmented Reality (AR) technologies on the building industry. ...
... Mixed-reality devices were used in digital fabrication applications such as knitting with bamboo material [6], brick wall assembly [7,8], knitting with metal bars [9], timber structures assembly [4], making a vault structure with Styrofoam pieces [10], and rubble bridge-making [11], as well as in additive manufacturing [12]. Mixed-reality devices were also used in the design and digital fabrication study with composite parts that are stretched and shaped [13]. ...
In this study, a method, in which parametric design and robotic fabrication are combined into one unified framework, and integrated within a mixed reality environment, where designers can interact with design and fabrication alternatives, and manage this process in collaboration with other designers, is proposed. To achieve this goal, the digital twin of both design and robotic fabrication steps was created within a mixed-reality environment. The proposed method was tested on a design product, which was defined with the shape-grammar method using parametric-modeling tools. In this framework, designers can interact with both design and robotic-fabrication parameters, and subsequent steps are generated instantly. Robotic fabrication can continue uninterrupted with human–robot collaboration. This study contributes to improving design and fabrication possibilities such as mass-customization, and shortens the process from design to production. The user experience and augmented spatial feedback provided by mixed reality are richer than the interaction with the computer screen. Since the whole process from parametric design to robotic fabrication can be controlled by parameters with hand gestures, the perception of reality is richer. The digital twin of parametric design and robotic fabrication is superimposed as holographic content by adding it on top of real-world images. Designers can interact with both design and fabrication processes both physically and virtually and can collaborate with other designers.
... AEC industry has employed AR for assisting construction processes, especially with complex geometry or material assemblies by providing visuals and instructions (Chen, Liao and Chu, 2018;Jahn et al., 2018;Hahm et al., 2019;Kwiatek et al., 2019;Qian, 2019;Yan, 2022) that can reduce errors and training periods of the staff. Instead of a fully automated construction process with robotic arms, drones, CNC machines, and automatic-operation construction machines, a hybrid system between machine and AR-powered human is the most practical one and giving the most accurate results (Abe et al., 2017). ...
... alter design shapes in real-time by the control of points through an AR interface (Betti, Aziz and Ron 2019), to influence digital simulation through gesture recognition and hand gestures (Hahm et al. 2019), and to adjust to dynamic structural performance simulations by tracking the movement of a structure's control points (Forren et al 2019). Mitterberger et al. applied an "eye-in-hand" system (Schmalstieg and Höllerer 2016) with an object trackingand registration system that estimates the deviations between the as-planned and the as-built model in realtime for the assembly of a fair-faced brickwork facade (Mitterberger et al. 2020). ...
Augmented Reality (AR) has the potential to create a paradigm shift in the production of architecture. This paper discusses the assembly and evaluation of a bamboo prototype installation aided by holographic instructions. The case study is situated within the framework of AR-driven computational design implementation methods that incorporate feedback loops between the as-built and the digital model.
The prototype construction aims to contribute to the ongoing international debate on architectural applications of digital technology and computational design tools and on the impact these have on craftsmanship and architecture fabrication. The case study uses AR-aided construction techniques to augment existing bamboo craftsmanship in order to expand its practically feasible design solution space. Participating laypersons were challenged to work at the interface of technology and material culture and engage with both latest AR systems and century-old bamboo craft.
This paper reflects on how AR tracking can be used to create a constant feedback loop between as-built installations and digitally designed source models and how this allows for the real-time assessment of design fidelity and deviations. The case study illustrates that this is especially advantageous when working with naturally varying materials, like bamboo, whose properties and behaviour cannot straightforwardly be accurately simulated digitally.
... AR deliberates a method by using the aid of high precision and detailed holographic assem-bly instructions (Chengyu Sun, 2019). Previous research and commercial applications have progressed this model (Soomeen et al., 2019), and it looks into developing technology to ease the working pipeline for AR-based fabrication. The assembly of complex structures required detailed 2D drawings and skilled labour to interpret and operate. ...
Augmented Reality (AR) as a new technical tool has developed rapidly in the last few years and has now the potential of bridging the gap between holographic drawings and the real world. This paper addresses whether AR can guide unskilled labour on complex structure assembly and fabrication process. It contains three experiments developed with AR. The research aims to prove that with intuitive holographic instructions, AR helps to reduce the time spent in comparing 2D drawings to the real site during the assembly process, and therefore offers possibilities to improve the construction efficiency significantly. The research also paves the way for shell structures, considering the latest technology such as AR and AI, and gives emphasis on the communication between computer and human during the fabrication process through the physical model. It is an exploration of how people might change their mind or decisions can be changed in a real-time manner harmoniously using AI through AR.
... The digital design model and the digitized physical model differ by at most 46 mm, with an average of 20 mm across all parts, attributed to human errors in construction, physical model self-weight and contortion, holographic drift from inside-out device tracking, and other causes [22]. In another collaborative construction project, some construction workers wear the Hololens to instruct others without the device to build the structure but the localization has an accuracy problem [23]. One of the Yindings in a review of AR in manufacturing industry in the last decade is that the marker-based solutions are usually the preferred tracking technology due to ease of implementation and higher accuracy compared to marker-less solutions [24]. ...
BRICKxAR is an Augmented Reality-based construction method applied to LEGO as a case study. With BRICKxAR, real LEGO brick construction is guided by virtual bricks in the right place at the right time, step by step. Virtual and real object occlusions are implemented to enable a natural appearance of virtual bricks inside real bricks. LEGO players' hand detection and occlusion are realized to allow a realistic immersive AR experience, in which virtual bricks can be "grasped" by the real hand, facilitating hand-eye coordination in AR. High accuracy and high precision of registration, i.e. the virtual - physical model alignment are achieved. In the best case, the average error of registration is less than 1mm throughout the model. BRICKxAR is expected to enhance Learning Through Play, as well as assembly and construction by human workers. In the experiment, LEGO Arc de Triomphe is built completely with BRICKxAR, without the instruction booklet.
BRICKxAR is a novel augmented reality (AR) instruction method for construction toys such as LEGO®. With BRICKxAR, physical LEGO construction is guided by virtual bricks. Compared with the state of the art, accuracy of the virtual-physical model alignment is significantly improved through a new design of marker-based registration, which can achieve an average error less than 1 mm throughout the model. Realistic object occlusion is accomplished to reveal the true spatial relationship between physical and virtual bricks. LEGO players' hand detection and occlusion are realized to visualize the correct spatial relationship between real hands and virtual bricks, and allow virtual bricks to be "grasped" by real hands. The major finding of the research is that the integration of these features makes AR instructions possible for small parts assembly, validated through a working AR prototype for constructing LEGO Arc de Triomphe and quantitative measures of the accuracies of registration and occlusions. In addition, a heuristic evaluation of BRICKxAR's features has led to findings that the present method could advance AR instructions in terms of enhancing part visibility, match between mental models and visualization, alignment of physical and virtual parts in perspective views and spatial transformations, tangible user interface, consolidated structural diagrams, virtual cutaway views, among other benefits for guiding construction.
Supplementary information:
The online version contains supplementary material available at 10.1007/s10055-021-00582-7.
ResearchGate has not been able to resolve any references for this publication.