About
364
Publications
98,071
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
5,010
Citations
Introduction
Additional affiliations
May 2008 - August 2008
May 1996 - August 1996
DEC Systems Research Center
Position
- Visiting Researcher
June 1997 - September 1997
DEC Cambridge Research Laboratory
Position
- Visiting Researcher
Education
August 1995 - December 1999
August 1991 - June 1995
Publications
Publications (364)
The main treatment modality for oropharyngeal cancer (OPC) is radiotherapy, where accurate segmentation of the primary gross tumor volume (GTVp) is essential. However, accurate GTVp segmentation is challenging due to significant interobserver variability and the time-consuming nature of manual annotation, while fully automated methods can occasiona...
In the development of communication devices for individuals who are Deafblind, a significant challenge is achieving a seamless transition from human-generated to technology-mediated communication. This study compares the intelligibility of the Australian Deafblind tactile fingerspelling alphabet rendered on the HaptiComm tactile communication devic...
Augmentative and alternative communication (AAC) methods aim to enable a variety of interactions and participation for those with complex communication needs. AAC’s benefits are well known. However, many with these unique needs do not have access to these technologies, do not use them to their full potential, or abandon the system for a variety of...
This paper investigates the versatility of force feedback (FF) technology in enhancing user interfaces across a spectrum of applications. We delve into the human finger pad's sensitivity to FF stimuli, which is critical to the development of intuitive and responsive controls in sectors such as medicine, where precision is paramount, and entertainme...
Recent progress in artificial intelligence, particularly deep learning, has ushered in a new era of autonomously generated content spanning text, audio, and visuals. This means Large Language Models (LLMs) such as ChatGPT, Llama2, Claude, and PaLM 2 are now developed enough to not only fill in the gaps within user-generated content, but also create...
This paper presents the conclusions drawn from an ongoing experiment investigating the performance, usability, and impact of multisensory stimuli in the virtual environment, with a focus on proposing guidelines for conducting biofeedback-enhanced Quality of Experience (QoE) studies in multimedia-enhanced Virtual Reality (VR). The study evaluated va...
In this paper, we report a method of implementing a universal volumetric haptic actuation platform which can be adapted to fit a wide variety of visual displays with flat surfaces. This platform aims to enable the simulation of the 3D features of input interfaces. This goal is achieved using four readily available stepper motors in a diagonal cross...
Driving demands a significant amount of visual attention, which
may impair drivers’ ability to detect and react to visual information
such as blind spot warnings. This online pilot study (N =242) evaluated the perception of binaural auditory cues and concurrent visual animations about overtaking vehicles designed to improve drivers’ situational awa...
The process of transforming data into sounds for auditory display provides unique user experiences and new perspectives for analyzing and interpreting data. A research study for data transformation to sounds based on musical elements, called data-to-music sonification, reveals how musical characteristics can serve analytical purposes with enhanced...
We studied two interaction techniques to perform secondary tasks in a driving simulator environment with the focus on driving safety. In both techniques, the participants (N = 20) used gaze pointing to select virtual task buttons. Toggling the controls was achieved by either mid-air gestures with haptic feedback or physical buttons located on the s...
The aim was to utilize ultrasound skin stimulation (UH) on a palm to inform the system state when interacting with mid-air hand gestures in the automotive context. Participants navigated a horizontal menu using touch, buttons, and hand gestures during simulated driving. Mid-air interaction and UH feedback design was tested in two studies. The first...
Purpose:
E-textiles have been the focus of interest in health technology, but little research has been done so far on how they could support persons with complex communication needs. A global estimate is that 97 million people may benefit from Augmentative and Alternative Communication (AAC). Unfortunately, despite the growing body of research, ma...
To improve the perception of haptic feedback, materials and sense-modifier effects should be examined. Teflon, Nylon mesh, and Silicone overlays were tested in combination with lateral vibrations to study their impact on the tactile sense. A feelable point moving along a line was implemented through the use of a dynamically moving interference maxi...
In medical surgery planning, virtual reality (VR) provides a working environment, where 3D images of the operation area can be utilized. VR allows 3D imaging data to be viewed in a more realistic 3D environment, reducing perceptual problems and increasing spatial understanding. In the present experiment, we compared a mouse, hand tracking, and a co...
Haptic imagery, the imagining of haptic sensations in the mind, makes use of and extends human vision. Thus, enabling a better understanding of multi-dimensional sensorimotor information by strengthening space exploration with “seeing by touch." Testing this concept was performed on a spherical surface to optimize the way of generating localized ha...
Kinesthetic interaction is an important interaction method for virtual reality. Current kinesthetic interaction using a grounded force-feedback device, however, is still considered difficult and time-consuming because of the interaction difficulty in a three-dimensional space. Velocity-oriented dynamic control–display (CD) gain has been used to imp...
The automotive evolution in virtual controls for touchscreen interaction provides the opportunity to manage and manipulate In-vehicle Infotainment (IVI) system without the need for large physical control. However, as most of these virtual controls are designed for visual feedback in PCs and mobile devices, their implementation can have usability an...
As virtual and mixed reality hardware systems become more mainstream, users are spending substantial amounts of time in simulated environments. Unlike the transition from desktop to mobile devices, VR/XR utilizes 360 wrap-around space which can be challenging to master even for experienced users. Tasks and tools commonly utilized in 2D environments...
In the contemporary food landscape, where easily accessible and appetizing food options prevail, the issue of overconsumption and its contribution to global obesity concerns remains a critical societal and research challenge. While it is well-established that sensory appeal plays a key role in motivating eating behaviour, recent studies have unders...
In the last few year advances in deep learning and artificial intelligence have made it possible to generate high-quality text, audio, and visual content automatically for a wide range of application areas including research and education. However, designing and customizing an effective R&D tool capable of providing necessary tool-specific output,...
Unconventional displays, such as 3D displays, projection screens formed of flowing light-scattering particles (fogscreens), and virtual reality (VR) headsets, can create illusions of images floating in mid-air. Paired with hand tracking, gestural interaction with floating user interfaces (UI) is possible on this permeable imagery, thus creating rea...
In the light of Industry 4.0, the field of Industrial Maintenance faces a large digital transformation, adopting Extended Reality (XR) technologies to aid industrial operations. For the manufacturing corporations that provide maintenance services, the efficiency of industrial maintenance plays a crucial role in the competitiveness and is tightly re...
Training in virtual reality (VR) is a valuable supplementing tool for advancing knowledge transfer that results in increased efficiency and accuracy of technicians in fieldwork. However, COVID-19 pandemic restrictions made it impossible for VR training centers to operate on a full scale, forcing traditional face-to-face learning sessions to become...
Purpose
Many surgical complications can be prevented by careful operation planning and preoperative evaluation of the anatomical features. Virtual dental implant planning in three-dimensional stereoscopic virtual reality environment has advantages over three-dimensional projections on two-dimensional screens. In the virtual environment, the anatomi...
Purpose
In dental implantology, the optimal placement of dental implants is important to meet functional and aesthetic requirements. Planning dental implants in virtual three-dimensional (3D) environment is possible using virtual reality (VR) technologies. The three-dimensional stereoscopic virtual reality environment offers advantages over three-d...
Touch between people is an integral part of human life. Touch is used to convey information, emotions, and other social cues. Still, everyday remote communication remains mainly auditive or audio-visual. The theme of this article, interpersonal haptic communication, refers to any communication system that supports mediation of touch between two or...
Three-dimensional (3D) models have widely been used in medical diagnosis and planning tasks. Haptic virtual reality (VR) interfaces implemented by using VR equipment and haptic devices have previously been proposed for these medical 3D manipulation tasks. They have been found to be faster and more accurate in a medical marking task with novel users...
Virtual Reality (VR) is a critical emerging technology in industrial contexts, as it facilitates collaboration and supports the product development lifecycle. However, its broad adoption is constrained by complex and high-cost integration. The use of VR among devices with various immersion and control levels may solve this obstacle, and increase th...
Head mounted displays provide a good platform for viewing of immersive 360° or hemispheric images. A person can observe an image all around, just by turning his/her head and looking at different directions. The device also provides a highly useful tool for studying the observer’s gaze directions and head turns. We aimed to explore the interplay bet...
Virtual reality devices are used for several application domains, such as medicine, entertainment, marketing and training. A handheld controller is the common interaction method for direct object manipulation in virtual reality environments. Using hands would be a straightforward way to directly manipulate objects in the virtual environment if hand...
As the automotive industry transitions to electric and autonomous vehicles (SAE 2-3) more and more information needs to be reviewed by the driver in real-time. Conventional information presentation techniques are not ideal for reviewing this type of information as it lacks multimodal and cross modal presentation. Haptics, one of the key interaction...
Mid-air ultrasound skin stimulation is a known technology used to provide haptic feedback for touchless communication. Even though some in-car interaction already takes place with mid-air gestures, the utilization of this type of feedback is still uncommon. In this study we evaluated how environmental vibration affects the recognition of ultrasound...
When designing extended reality (XR) applications, it is important to consider multimodal interaction techniques, which employ several human senses simultaneously. Multimodal interaction can transform how people communicate remotely, practice for tasks, entertain themselves, process information visualizations, and make decisions based on the provid...
Decades of research in environmental psychology have shown that contact with natural environments has restorative, stress-ameliorating effects. At present, researchers in the emerging field of virtual natural environments are studying whether these restorative health effects can be reproduced with simulated environments, raising new possibilities f...
Many virtual reality (VR) applications use teleport for locomotion. The non-continuous locomotion of teleport is suited for VR controllers and can minimize simulator sickness, but it can also reduce spatial awareness compared to continuous locomotion. Our aim was to create continuous, controller-based locomotion techniques that would support spatia...
High-fidelity localized feedback has the potential of providing new and unique levels of interaction with a given device. Achieving this in a cost-effective reproducible manner has been a challenge in modern technology. Past experiments have shown that by using the principles of constructive wave interference introduced by time offsets it is possib...
More than 50 years since its mass market introduction the core user interfaces of Video Conferencing (VC) systems have essentially been unchanged. Relaying real time audio and video over distance is inherently productive. However, it lacks the sense of in-person interaction. With the current global pandemic, additional privacy concerns over the ext...
Three-dimensional (3D) visualization has been widely used in computer-aided medical diagnosis and planning. To interact with 3D models, current user interfaces in medical systems mainly rely on the traditional 2D interaction techniques by employing a mouse and a 2D display. There are promising haptic virtual reality (VR) interfaces which can enable...
Vibrotactile feedback is affected by the properties of the material and structure that transmit vibration from an actuator to the entire device surface. The stimuli felt by the skin may be distorted or attenuated at different locations of the device surface. Therefore, it is important to understand how the source vibration can be properly mediated...
In this study, we assessed the emotional dimensions (valence, arousal, and dominance) of the multimodal visual-cutaneous rabbit effect. Simultaneously to the tactile bursts on the forearm, visual silhouettes of saltatorial animals (rabbit, kangaroo, spider, grasshopper, frog, and flea) were projected on the left arm. Additionally, there were two lo...
Kinesthetic interaction typically employs force-feedback devices for providing the kinesthetic input and feedback. However, the length of the mechanical arm limits the space that users can interact with. To overcome this challenge, a large control-display (CD) gain (>1) is often used to transfer a small movement of the arm to a large movement of th...
Ultrasonic tactile stimulation can give the user contactless tactile feedback in a variety of human-computer interfaces. Parameters, such as duration, rhythm, and intensity, can be used to encode information into tactile sensation. The present aim was to investigate the differentiation of six ultrasonic tactile stimulations that were varied by form...
Ultrasound haptics is a contactless haptic technology that enables novel mid-air interactions with rich multisensory feedback. This paper surveys recent advances in ultrasound haptic technology. We discuss the fundamentals of this haptic technology, how a variety of perceptible sensations are rendered, and how it is currently being used to enable n...
We present a study comparing physiological and psychological restoration in matched real and virtual natural environments. Participants (n=24) experienced a real forest, or one of two audiovisual virtual forests wearing a head-mounted display: A 3D forest or a 360-degree video. The results showed that some of the benefits of the real forest could a...
Kinaesthetic interaction using force-feedback devices is promising in virtual reality. However, the devices are currently not suitable for interactions within large virtual spaces because of their limited workspace. We developed a novel gaze-based kinaesthetic interface that employs the user’s gaze to relocate the device workspace. The workspace sw...
Methods of interaction and information presentation in the automotive context have continuously been evolving in the last decade Essentially, there is an inherent need to design and research in-vehicle systems that complement and natively support a multimodal approach towards driver-vehicle interaction. Basically, most IVI tasks are classified as s...
Immersive technologies such as virtual reality and augmented reality have been recently explored in the field of food consumption studies from different perspectives. The present study utilized virtual reality technology in a within-subject experiment with three conditions to examine whether a varying virtual eating environment can alter consumers’...
As our interaction in virtual space expands from 2D to 3D, the absence of meaningful touch output restricts our ability to explore new virtual frontiers. The core limitation of not being able to reach out and feel or interpolate an object or sense its texture and form, within a virtual environment, hinders the intuitiveness of the interaction exper...
As VR, and AR become more popular forms of interaction with standalone and wearable computing systems, there is an inherent need to redefine the role of haptics in virtual environments. Complex virtual environments require more comprehensive tactile information. For this reason, primitive tactile signals currently being used in most commercial syst...
In an effort to find a way to more efficiently and accurately display localized high definition tactile information to the skin we studied the vibrotactile constructive wave interference properties of silicone gel. By placing two actuators at a given distance from each other and controlling the delay when each actuator is activated in relation to t...
Semiautonomous driving still requires the driver's control and attention in certain situations. Especially control transitions, i.e. take-over and hand-over situations, are important for safety. Our aim was to study control transitions supported by unimodal (i.e. visual, auditory, or haptic) or multimodal (i.e. visual, auditory and haptic) signals...
Methods of information presentation in the automotive space have been evolving continuously in recent years. As technology pushes forward the boundaries of what is possible, automobile manufacturers are trying to keep up with the current trends. Traditionally, the often-long development and quality control cycles of the automotive sector ensured sl...
Human augmentation is a field of research that aims to enhance human abilities through medicine or technology. This has historically been achieved by consuming chemical substances that improve a selected ability or by installing implants which require medical operations. Both of these methods of augmentation can be invasive. Augmented abilities hav...
As research into autonomous vehicles gets mainstream, automobile manufacturers are trying to reinvent the ways we operate and interact with our vehicles. This is now more evident in the central instrument clusters than ever before. While some manufacturers are focusing on adding touchscreens to replace most in-vehicular infotainment (IVI) controls,...
One embodiment relates to a method for creating a fast vanishing light scattering surface/volume to which an image is projected. The method includes: creating two portions of atomized particles of a given particle size that does not allow an incident light having a visible spectrum from being scattered, reflected and/or dissipated; and ejecting the...
Additional illumination improves the capture of omnidirectional 360° video and images, especially for dark or high-contrast environments. There is no "behind" for 360° cameras, so the placement of lights is a problem. We explore ways to position lights on some 360° cameras, and propose two good locations.