Conference PaperPDF Available

Augmented Feedback - A case study in Mixed-Reality as a tool for assembly and real-time feedback in bamboo construction

Authors:

Abstract

Augmented Reality (AR) has the potential to create a paradigm shift in the production of architecture. This paper discusses the assembly and evaluation of a bamboo prototype installation aided by holographic instructions. The case study is situated within the framework of AR-driven computational design implementation methods that incorporate feedback loops between the as-built and the digital model. The prototype construction aims to contribute to the ongoing international debate on architectural applications of digital technology and computational design tools and on the impact these have on craftsmanship and architecture fabrication. The case study uses AR-aided construction techniques to augment existing bamboo craftsmanship in order to expand its practically feasible design solution space. Participating laypersons were challenged to work at the interface of technology and material culture and engage with both latest AR systems and century-old bamboo craft. This paper reflects on how AR tracking can be used to create a constant feedback loop between as-built installations and digitally designed source models and how this allows for the real-time assessment of design fidelity and deviations. The case study illustrates that this is especially advantageous when working with naturally varying materials, like bamboo, whose properties and behaviour cannot straightforwardly be accurately simulated digitally.
ACADIA 2021 TOPIC
23
Augmented Feedback
1 




Garvin Goepel

Kristof Cr olla



1
2
INTRODUCTION
AR i n the f a br icati on an d con str u ct i on a r ea




































ABSTRACT




















REALIGNMENTS
























Bending-active bamboo gridshells









2 



ACADIA 2021 TOPIC
45








METHODS
















































 
 

 

 
RESULTS
Successful holographic fabrication
























Ch all en g in g c rea tio n of ho log rap hic f e edb ack




Paper Title REALIGNMENTS























ACADIA 2021 TOPIC
67Paper Title REALIGNMENTS


























CONCLUSION








ACKNOWLEDGEMENTS










REFERENCES




















7
7 
































Fologram
















Grasshopper3D












IMAGE CREDITS

Garvin Goepel 









Dr. Kristof Crolla 









ResearchGate has not been able to resolve any citations for this publication.
Article
Full-text available
Augmented bricklaying explores the manual construction of intricate brickwork through visual augmentation, and applies and validates the concept in a real-scale building project—a fair-faced brickwork facade for a winery in Greece. As shown in previous research, robotic systems have proven to be very suitable to achieve various differentiated brickwork designs with high efficiency but show certain limitations, for example, in regard to spatial freedom or the usage of mortar on site. Hence, this research aims to show that through the use of a craft-specific augmented reality system, the same geometric complexity and precision seen in robotic fabrication can be achieved with an augmented manual process. Towards this aim, a custom-built augmented reality system for in situ construction was established. This process allows bricklayers to not depend on physical templates, and it enables enhanced spatial freedom, preserving and capitalizing on the bricklayer’s craft of mortar handling. In extension to conventional holographic representations seen in current augmented reality fabrication processes that have limited context-awareness and insufficient geometric feedback capabilities, this system is based on an object-based visual-inertial tracking method to achieve dynamic optical guidance for bricklayers with real-time tracking and highly precise 3D registration features in on-site conditions. By integrating findings from the field of human-computer interfaces and human-machine communication, this research establishes, explores, and validates a human-computer interactive fabrication system, in which explicit machine operations and implicit craftsmanship knowledge are combined. In addition to the overall concept, the method of implementation, and the description of the project application, this paper also quantifies process parameters of the applied augmented reality assembly method concerning building accuracy and assembly speed. In the outlook, this paper aims to outline future directions and potential application areas of object-aware augmented reality systems and their implications for architecture and digital fabrication.
Conference Paper
Full-text available
We present a method for generating holographic construction information from parametric models. Holographic models replace 2D drawings and templates with unambiguous, contextual, shared and interactive design information. We show that our method enabled a team of expert bricklayers to complete a section of wall in a fraction of expected construction time and within typical tolerances, measured through comparative analysis of digital models to 3D point cloud scans of as built conditions.
Conference Paper
Full-text available
This paper discusses the integration of Mixed Reality in the design and implementation of non-standard architecture. It deliberates a method that does not require conventional 2D drawings, and the need for skilled labor, by using the aid of holographic instructions. Augmented Construction allow builders to execute complex tasks and to understand structural relations intuitively by overlaying digital design information onto their field of view on the building site. This gives the implementation system authors different levels of control. As a proof of concept, a group of non-professionals reconstructed the south wall of Corbusier’s Ronchamp chapel, the Notre-Dame du Haut, at scale 1:5 using no architectural 2D drawings but only custom-built Augmented Reality apps for HoloLens and mobile devices. This project focused on the assembly of non-standard prefabricated elements, based on an optimized parametric structure that enables designers to integrate imprecision within the construction phases into the design through a constant feedback-loop between the real and the digital. The setup was designed in a non-linear process that allows the integration of new information during the Augmented Construction phases. The paper evaluates applied Augmented Construction for further improvements and research and concludes by discussing the impact potential of Augmented Construction on architectural design, socio-cultural, and economical levels.
Conference Paper
Full-text available
This paper examines a novel, integrated and collaborative approach to design and fabrication, enabled through Mixed Reality. In a bespoke fabrication process, the design is controlled and altered by users in holographic space, through a custom, multi-modal interface. Users input is live-streamed and channeled to 3D modelling environment,on-demand robotic fabrication and AR-guided assembly. The Holographic Interface is aimed at promoting man-machine collaboration. A bespoke pipeline translates hand gestures and audio into CAD and numeric fabrication. This enables non-professional participants engage with a plethora of novel technology. The feasibility of Mixed Reality for architectural workflow was tested through an interactive installation for the makeCity Berlin 2018 festival. Participants experienced with on-demand design, fabrication an AR-guided assembly. This article will discuss the technical measures taken as well as the potential in using Holographic Interfaces for collaborative design and on-site fabrication.Please write your abstract here by clicking this paragraph. INTRODUCTION In this paper we argue that AR can improve man-machine collaboration in architecture making. Holo-graphic, multimodal interfaces simplify access to cutting-edge technology for the all-user. Human operators can edit digital information with using intuitive interfaces, for CAD/CAM. Leveraging human capabilities to communicate vie speech and hand-gestures allows non-professionals easy access to 3D modelling and robotic fabrication. We examined AR representation and multimodal interface potential in the inclusion of non-professional in architectural design and making, human-machine collaboration and multi-participant design. This approach was tested through a fully integrated cycle of holographic 3D modelling, on-demand robotic machining and AR-guided assembly that resulted in a collaborative installation for the MakeCity Festival 2018 in Berlin.
Conference Paper
Full-text available
In this paper, we present a set of enabling technologies developed for the KUKA Innovation Award to facilitate Human Robot collaboration targeted for the architecture, engineering and construction (AEC) sector. Critically, little progress has been made in the usability of user interfaces for industrial robots [1]. We targeted our investigation explicitly towards human-robot collaboration (HRC) in wood based prefabrication production. Although wood is a sustainable material with abundant processing possibilities, it is also a material system where process knowledge remains critically important, making highly automated workflows unfeasible and inefficient. We propose an interactive fabrication process where a user such as a construction worker could wear an augmented reality head mounted display (ARHMD) as an interface to plan robotic trajectories, influence production sequencing, and view superimposed diagnostic feedback. We describe necessary system components including a robotic workcell consisting of a KUKA LBR iiwa, flexFELLOW mobile platform, a Robotiq 2-finger gripper and a custom platform and material feeding station. In addition, we describe a communication framework and set of protocols connecting a CAD digital design environment, a user interface (UI) for Microsoft HoloLens, a ROS server for backend path planning and coordination, and a 3D graphical web interface for downstream visualization of construction status. We conclude with an outlook on enabling technologies for human-robot collaboration in construction, and the importance of increasing digital integration and accessibility in characteristic production workflows through accessible and intuitive digital interfaces.
Article
Although modern software has paved the way for architects to design complex forms, such as free-forms, construction remains challenging, costly, and time-consuming which requires skilled workers. Advanced digital fabrication technologies can offer new ways to fill the gap between design and construction. Augmented Reality (AR) technology is one such technology that has many potentials in various fields, however, its capabilities are not sufficiently explored yet, especially in the field of digital fabrication. This study presents a new affordable interactive multi-marker augmented reality tool for constructing free-form modular surfaces implemented by integrating common accessible devices. The proposed tool consists of two digital cameras, a head-mounted display, a processor, and two markers that enable the user to virtually see the accurate location of any proposed object in the real world. A controlling subsystem was also designed to enhance the accuracy of construction. Method efficiency was studied in five full-scale prototypes. The results showed that the majority of errors (91%) were less than 6 mm, and 2° for lateral placements and orientation errors.
Building simplexity: the 'more or less' of post-digital architecture practice
  • Kristof Crolla
Crolla, Kristof. 2018. "Building simplexity: the 'more or less' of post-digital architecture practice." PhD diss. RMIT University.1-2
Action over form: combining off-loom weaving and augmented reality in a non-specification model of design, James Forren's Lab
  • J Forren
  • M Ramadan
  • S Sarrazin
Forren, J., M. Ramadan and S. Sarrazin. 2019. "Action over form: combining off-loom weaving and augmented reality in a non-specification model of design, James Forren's Lab." In Artificial Realities: Virtual as an Aesthetic Medium in Architecture Ideation 2019.
Steampunk Pavilion, Fologram
  • Gwyllim Jahn
  • C Newnham
  • S Hahn
  • I Pantic
Jahn, Gwyllim, C. Newnham, S. Hahn, I. Pantic.2019. Steampunk Pavilion, Fologram, (last modified October 2019). https://vimeo. com/365917769, 2019.