Mark Billinghurst

Mark Billinghurst
University of South Australia | UniSA · School of Information Technology and Mathematical Sciences

PhD (2002)

About

655
Publications
284,213
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
22,745
Citations
Additional affiliations
April 2002 - May 2015
University of Canterbury
Position
  • Director, Professor

Publications

Publications (655)
Article
In recent years, the multi-dimensional, multi-faceted, and multi-level applications of augmented reality/mixed reality have attracted more and more attention from researchers in the field of smart manufacturing. However, the disadvantage is that AR interaction cues supporting user cognition have not been fully analyzed and summarized in manual asse...
Article
Full-text available
Most augmented reality (AR) assembly guidance systems only utilize visual information. Regarding the sound, the human binaural effect helps users quickly identify the general direction of sound sources. At the same time, pleasant sounds can give people a sense of pleasure and relaxation. However, the effect on workers is still unknown when stereo s...
Article
Full-text available
Our memories and past experiences contribute to guiding our perception and action of future affective experiences. Virtual Reality (VR) experiences are more vividly memorized and recalled than non-VR ones, but there is little research on how to detect this recall in VR. We investigate the feasibility of recognizing autobiographical memory (AM) reca...
Article
Full-text available
We present NapWell, a Sleep Assistant using virtual reality (VR) to decrease sleep onset latency by providing a realistic imagery distraction prior to sleep onset. Our proposed prototype was built using commercial hardware and with relatively low cost, making it replicable for future works as well as paving the way for more low cost EOG-VR devices...
Article
Full-text available
Emotions are multimodal processes that play a crucial role in our everyday lives. Recognizing emotions is becoming more critical in a wide range of application domains such as healthcare, education, human-computer interaction, Virtual Reality, intelligent agents, entertainment, and more. Facial macro-expressions or intense facial expressions are th...
Article
Remote guidance on physical tasks is a type of collaboration in which a local worker is guided by a remote helper to operate on a set of physical objects. It has many applications in industrial sections such as remote maintenance and how to support this type of remote collaboration has been researched for almost three decades. Although a range of d...
Article
Full-text available
The assembly stage is a vital phase in the production process and currently, there are still many manual tasks in the assembly operation. One of the challenges of manual assembly is the issue of blind area assembly since the visual obstruction of the hands or a part can lead to more errors and lower assembly efficiency. In this study, we developed...
Preprint
Full-text available
This paper describes a case study and the insights gained from prototyping an Intelligent Virtual Agent (IVA) for English vocabulary building for Spanish-speaking preschool children. After an initial exploration to evaluate the feasibility of developing an IVA, we followed a Human-Centered Design (HCD) approach to create a prototype. We report on t...
Article
Full-text available
Sketch design is generally a feasible concept within virtual reality (VR). However, VR controllers suffer from a fundamental problem that limits operability and immersion, which is the difficulty of imitating the texture of natural materials. To solve these challenges, we developed a tablet-based design system named Pressure-Sketch (PSK) around the...
Conference Paper
Full-text available
Augmented Reality (AR) and Virtual Reality (VR) techniques are widely used for people to experience and interact with 3D digital content. However, the user has to choose either AR or VR separately with different devices for different interaction modalities. This work presents ARinVR, a novel concept that seamlessly and synchronously integrates hand...
Article
This paper provides a review of research into using Augmented Reality (AR) and Mixed Reality(MR) for remote collaboration on physical tasks. AR/MR-based remote collaboration on physical tasks has recently become more prominent in academic research and engineering applications. It has great potential in many fields, such as real-time remote medical...
Article
Virtual Reality (VR) interfaces provide an immersive medium to interact with the digital world. Most VR interfaces require physical interactions using handheld controllers, but there are other alternative interaction methods that can support different use cases and users. Interaction methods in VR are primarily evaluated based on their usability, h...
Chapter
Remote collaboration is becoming increasingly crucial, especially currently when travel is restricted because of the Covid-19 pandemic. People are looking for real-time and no-travel solutions to enable remote collaboration with colleagues and experts. A lot of research has been conducted on how to support remote guidance on physical tasks. However...
Article
This paper presents an Augmented Reality (AR)-based network cabling tutoring system that trains users how to interconnect cables within a Virtual Local Area Network (VLAN) on a physical switching rack. AR arrows combined with text-based instruction and a checklist provided assistance during practical learning. When learners made a mistake, an Intel...
Article
Full-text available
Conventional training and remote collaboration systems allow users to see each other’s faces, heightening the sense of presence while sharing content like videos or slideshows. However, these methods lack depth information and a free 3D perspective of the training content. This paper investigates the impact of volumetric playback in a Mixed Reality...
Article
Full-text available
As Virtual Reality(VR), Augmented Reality(AR), Mixed Reality(MR) technology becomes more accessible, it is important to explore VR/AR/MR technologies that can be used for remote collaboration on physical tasks. Previous research has shown that gesture-based interaction is intuitive and expressive for remote collaboration, and using 3D CAD models ca...
Article
Full-text available
This paper describes the user experience (UX) design for a smart-mirror-based personalized training system which aims to help people live a healthy life. A number of researchers and companies have developed fitness systems that use a virtual coach which shows the user with actions they should perform. However such systems can be difficult to accura...
Article
Full-text available
Gaze is one of the predominant communication cues and can provide valuable implicit information such as intention or focus when performing collaborative tasks. However, little research has been done on how virtual gaze cues combining spatial and temporal characteristics impact real-life physical tasks during face to face collaboration. In this stud...
Article
The art installation common/room explores human–digital–human encounter across cultural differences. It comprises a suite of extended reality (XR) experiences that use technology as a bridge to help support human connections with a view to overcoming intercultural discomfort (racism). The installations are exhibited as an informal dining room, wher...
Conference Paper
This paper investigates the use of immersive virtual reconstructions as an aid for jurors during a courtroom trial. The fndings of a between-participant user study on memory and decision-making are presented in the context of viewing a simulated hit-run-death scenario. Participants listened to the opening statement of a prosecutor and a defence att...
Article
Virtual Reality (VR) Head-Mounted Display (HMD) technology immerses a user in a computer generated virtual environment. However, a VR HMD also blocks the users’ view of their physical surroundings, and so prevents them from using their mobile phones in a natural manner. In this paper, we present a novel Augmented Virtuality (AV) interface that enab...
Conference Paper
Full-text available
Many studies have focused on Virtual Reality (VR) frameworks for remotely controlling robotic systems. Although VR systems have been used to teleoperate robots in simple scenarios, their effectiveness in terms of accuracy, speed, and usability has not been rigorously evaluated for complex tasks that require accurate trajectories. In this work, an E...
Preprint
Full-text available
Modern training typically incorporates real-world training applications. Augmented Reality (AR) technologies support this by overlaying virtual objects in real-world 3-Dimensional (3D) space. However, integrating instruction into AR is challenging because of technological and educational considerations. One reason is a lack of architecture for supp...
Preprint
Modern training typically incorporates real-world training applications. Augmented Reality (AR) technologies support this by overlaying virtual objects in real-world 3-Dimensional (3D) space. However, integrating instruction into AR is challenging because of technological and educational considerations. One reason is a lack of architecture for supp...
Article
Researchers have employed hyperscanning, a technique used to simultaneously record neural activity from multiple participants, in real-world collaborations. However, to the best of our knowledge, there is no study that has used hyperscanning in Virtual Reality (VR). The aims of this study were; firstly, to replicate results of inter-brain synchrony...
Article
Full-text available
Communication disruptions are frequent in aerial firefighting. Information is more easily lost over multiple radio channels, busy with simultaneous conversations. Such a high bandwidth of information throughput creates mental overload. Further problems with hardware or radio signals being disrupted over long distances or by mountainous terrain make...
Article
AR instruction is a kind of virtual information presented on a human–computer interface. It allows users to view the geometric state, spatial relationship, operation method, and other information involved in the physical task, to form the spatial cognition of the current interaction process. At present, AR instructions cannot support high-precision...
Article
Full-text available
Daily vital signs monitoring is very important for detecting diseases in early stages and for preventive treatments. Such a task can be achieved by taking advantage of the omnipresence of cameras in people’s personal space. As heart-related diseases are part of the leading causes of deaths worldwide, monitoring heart-related vital signs appear to b...