Jens Grubert

Jens Grubert
University of Applied Sciences Coburg · Departement of Electrical Engineering and Computer Science

Prof. Dr. techn.

About

103
Publications
34,507
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,339
Citations
Introduction
I am passionate about exploring novel mobile user interfaces for interacting with information situated in the physical world. Currently, I work as a Research Assistant at Graz University of Technology with a focus on mobile Augmented Reality.
Additional affiliations
September 2010 - present
Graz University of Technology
Position
  • Research Assistant
Description
  • Research in mobile HCI, mobile and Web-based AR. Acquisition and management of EU FP7 and national research projects. Lecturing courses in the fields of Distributed Systems, Computer Graphics,Virtual Reality, HCI and Information Visualization.
April 2007 - September 2007
The University of Calgary
Position
  • Intern
Description
  • Reasearch intern with Sheelagh Carpendalen and Tobias Isenberg working on interactive non-photorealistic rendering on large interactive surfaces.

Publications

Publications (103)
Preprint
Full-text available
Learning vocabulary in a primary or secondary language is enhanced when we encounter words in context. This context can be afforded by the place or activity we are engaged with. Existing learning environments include formal learning, mnemonics, flashcards, use of a dictionary or thesaurus, all leading to practice with new words in context. In this...
Preprint
Full-text available
Virtual Reality (VR) provides new possibilities for modern knowledge work. However, the potential advantages of virtual work environments can only be used if it is feasible to work in them for an extended period of time. Until now, there are limited studies of long-term effects when working in VR. This paper addresses the need for understanding suc...
Article
Full-text available
Virtual Reality (VR) has the potential to support mobile knowledge workers by complementing traditional input devices with a large three-dimensional output space and spatial input. Previous research on supporting VR knowledge work explored domains such as text entry using physical keyboards and spreadsheet interaction using combined pen and touch i...
Article
Structure-from-motion and multi-view stereo can be used to create 3D models from image sequences, but are not widely adopted by consumers. We study how to address two challenges of such systems for non-professional users: 1) their technical complexity, and, 2) the computational demand needed for processing. To this end, we embed an open-source pipe...
Preprint
Full-text available
Virtual Reality (VR) has the potential to support mobile knowledge workers by complementing traditional input devices with a large three-dimensional output space and spatial input. Previous research on supporting VR knowledge work explored domains such as text entry using physical keyboards and spreadsheet interaction using combined pen and touch i...
Preprint
Virtual and Augmented Reality have the potential to change information work. The ability to modify the workers senses can transform everyday environments into a productive office, using portable head-mounted displays combined with conventional interaction devices, such as keyboards and tablets. While a stream of better, cheaper and lighter HMDs hav...
Preprint
Full-text available
An increasing number of consumer-oriented head-mounted displays (HMD) for augmented and virtual reality (AR/VR) are capable of finger and hand tracking. We report on the accuracy of off-the-shelf VR and AR HMDs when used for touch-based tasks such as pointing or drawing. Specifically, we report on the finger tracking accuracy of the VR head-mounted...
Preprint
This chapter gives an overview of interaction techniques for mixed reality including augmented and virtual reality (AR/VR). Various modalities for input and output are discussed. Specifically, techniques for tangible and surface-based interaction, gesture-based, pen-based, gaze-based, keyboard and mouse-based, as well as haptic interaction are disc...
Article
Virtual Reality (VR) has the potential to transform knowledge work. One advantage of VR knowledge work is that it allows extending 2D displays into the third dimension, enabling new operations, such as selecting overlapping objects or displaying additional layers of information. On the other hand, mobile knowledge workers often work on established...
Preprint
As more people work from home or during travel, new opportunities and challenges arise around mobile office work. On one hand, people may work at flexible hours, independent of traffic limitations, but on the other hand, they may need to work at makeshift spaces, with less than optimal working conditions and decoupled from co-workers. Virtual Reali...
Preprint
With the rise of natural user interfaces, immersive analytics applications often focus on novel forms of interaction modalities such as mid-air gestures, gaze or tangible interaction utilizing input devices such as depth-sensors, touch screens and eye-trackers. At the same time, traditional input devices such as the physical keyboard and mouse are...
Preprint
Virtual Reality (VR) has the potential to transform knowledge work. One advantage of VR knowledge work is that it allows extending 2D displays into the third dimension, enabling new operations, such as selecting overlapping objects or displaying additional layers of information. On the other hand, mobile knowledge workers often work on established...
Preprint
Virtual Reality (VR) can enhance the display and interaction of mobile knowledge work and in particular, spreadsheet applications. While spreadsheets are widely used yet are challenging to interact with, especially on mobile devices, using them in VR has not been explored in depth. A special uniqueness of the domain is the contrast between the imme...
Preprint
Full-text available
Research in user interaction with mixed reality environments using multiple displays has become increasingly relevant with the prevalence of mobile devices in everyday life and increased commoditization of large display area technologies using projectors or large displays. Previous work often combines touch-based input with other approaches, such a...
Preprint
Virtual Reality enables the exploration of large information spaces. In physically constrained spaces such as airplanes or buses, controller-based or mid-air interaction in mobile Virtual Reality can be challenging. Instead, the input space on and above touch-screen enabled devices such as smartphones or tablets could be employed for Virtual Realit...
Article
In this special issue of IEEE Transactions on Visualization and Computer Graphics (TVCG) , we are pleased to present the TVCG papers from the 18th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2019), held October 14–18 in Beijing, China. ISMAR continues the over 20-year long tradition of IWAR, ISMR, and ISAR, and is undoubt...
Conference Paper
Full-text available
Optical see-through head-mounted displays (OST HMDs) typically display virtual content at a fixed focal distance while users need to integrate this information with real-world information at different depth layers. This problem is pronounced in body-proximate multi-display systems, such as when an OST HMD is combined with a smartphone or smartwatch...
Preprint
Full-text available
Optical see-through head-mounted displays (OST HMDs) typically display virtual content at a fixed focal distance while users need to integrate this information with real-world information at different depth layers. This problem is pronounced in body-proximate multi-display systems, such as when an OST HMD is combined with a smartphone or smartwatch...
Article
Physical keyboards are common peripherals for personal computers and are efficient standard text entry devices. Recent research has investigated how physical keyboards can be used in immersive head-mounted display-based Virtual Reality (VR). So far, the physical layout of keyboards has typically been transplanted into VR for replicating typing expe...
Preprint
Physical keyboards are common peripherals for personal computers and are efficient standard text entry devices. Recent research has investigated how physical keyboards can be used in immersive head-mounted display-based Virtual Reality (VR). So far, the physical layout of keyboards has typically been transplanted into VR for replicating typing expe...
Conference Paper
Full-text available
Digital-augmentation of print-media can provide contextually relevant audio, visual, or haptic content to supplement the static text and images. The design of such augmentation--its medium, quantity, frequency, content, and access technique--can have a significant impact on the reading experience. In the worst case, such as where children are learn...
Preprint
Virtual Reality has the potential to change the way we work. We envision the future office worker to be able to work productively everywhere solely using portable standard input devices and immersive head-mounted displays. Virtual Reality has the potential to enable this, by allowing users to create working environments of their choice and by relie...
Article
In this special issue of IEEE Transactions on Visualization and Computer Graphics (TVCG) , we are pleased to present the TVCG papers from the 17th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2018), held October 16–20 in Munich, Germany. ISMAR continues the 20-year long tradition of IWAR, ISMR, and ISAR, and is undoubtedly t...
Book
Full-text available
Große Umwälzungen in der Entwicklung unserer Geschichte kündigen sich mitnichten an wie eine Gewitterwolke. In der Retrospektive ragen zwar jene Singularitäten heraus, in denen sich derartige Entwicklungen oftmals in unvorhergesehener oder auch in radikaler Art und Weise entladen, aber das Große und Ganze bleibt dahinter verborgen. Dabei handelt es...
Conference Paper
Full-text available
Computer Vision-based natural feature tracking is at the core of modern Augmented Reality applications. Still, Web-based Augmented Reality typically relies on location-based sensing (using GPS and orientation sensors) or marker-based approaches to solve the pose estimation problem. We present an implementation and evaluation of an efficient natural...
Article
Computer Vision-based natural feature tracking is at the core of modern Augmented Reality applications. Still, Web-based Augmented Reality typically relies on location-based sensing (using GPS and orientation sensors) or marker-based approaches to solve the pose estimation problem. We present an implementation and evaluation of an efficient natural...
Article
Full-text available
We propose a set of techniques leveraging mobile devices as lenses to explore, interact and annotate n-dimensional data visualizations. The democratization of mobile devices, with their arrays of integrated sensors, opens up opportunities to create experiences for anyone to explore and interact with large information spaces anywhere. In this paper,...
Article
Full-text available
Alphanumeric text entry is a challenge for Virtual Reality (VR) applications. VR enables new capabilities, impossible in the real world, such as an unobstructed view of the keyboard, without occlusion by the user's physical hands. Several hand representations have been proposed for typing in VR on standard physical keyboards. However, to date, thes...
Article
Full-text available
We study the performance and user experience of two popular mainstream text entry devices, desktop keyboards and touchscreen keyboards, for use in Virtual Reality (VR) applications. We discuss the limitations arising from limited visual feedback, and examine the efficiency of different strategies of use. We analyze a total of 24 hours of typing dat...
Article
Full-text available
With the rising popularity of Augmented and Virtual Reality, there is a need for representing humans as virtual avatars in various application domains ranging from remote telepresence, games to medical applications. Besides explicitly modelling 3D avatars, sensing approaches that create person-specific avatars are becoming popular. However, afforda...
Article
Full-text available
Optical see-through head-mounted displays (OST HMDs) are a major output medium for Augmented Reality, which have seen significant growth in popularity and usage among the general public due to the growing release of consumer-oriented models, such as the Microsoft Hololens. Unlike Virtual Reality headsets, OST HMDs inherently support the addition of...
Article
Full-text available
Authoring location-based experiences involving multiple participants, collaborating or competing in both indoor and outdoor mixed realities, is extremely complex and bound to serious technical challenges. In this work, we present the first results of the MAGELLAN European project and how these greatly simplify this creative process using novel auth...
Article
Full-text available
Smartphones are a popular device class for mobile Augmented Reality but suffer from a limited input space. Around-device interaction techniques aim at extending this input space using various sensing modalities. In this paper we present our work towards extending the input area of mobile devices using front-facing device-centered cameras that captu...
Article
Full-text available
Digitalization offers chances as well as risks for industrial companies. This article describes how the area of Mixed Reality, with its manifestations Augmented and Virtual Reality, can support industrial applications in the age of digitalization. Starting from a historical perspective on Augmented and Virtual Reality, this article surveys recent d...
Article
Around-device interaction techniques aim at extending the input space using various sensing modalities on mobile and wearable devices. In this paper, we present our work towards extending the input area of mobile devices using front-facing device-centered cameras that capture reflections in the human eye. As current generation mobile devices lack h...
Conference Paper
Full-text available
We present HeadPhones (Headtracking + smartPhones), a novel approach for the spatial registration of multiple mobile devices into an ad hoc multi-display environment. We propose to employ the user's head as external reference frame for the registration of multiple mobile devices into a common coordinate system. Our approach allows for dynamic repos...
Article
Full-text available
Handheld Augmented Reality commonly implements some variant of magic lens rendering, which turns only a fraction of the user's real environment into AR while the rest of the environment remains unaffected. Since handheld AR devices are commonly equipped with video see-through capabilities, AR magic lens applications often suffer from spatial distor...
Article
Full-text available
Around-device interaction promises to extend the input space of mobile and wearable devices beyond the common but restricted touchscreen. So far, most around-device interaction approaches rely on instrumenting the device or the environment with additional sensors. We believe, that the full potential of ordinary cameras, specifically user-facing cam...
Conference Paper
Handheld Augmented Reality commonly implements some variant of magic lens rendering, which turns only a fraction of the users real environment into AR while the rest of the environment remains unaffected. Since handheld AR devices are commonly equipped with video see-through capabilities, AR magic lens applications often suffer from spatial distort...
Conference Paper
Full-text available
We present a novel approach for extending the input space around unmodified mobile devices. Using built-in front-facing cameras of unmodified handheld devices, GlassHands estimates hand poses and gestures through reflections in sunglasses, ski goggles or visors. Thereby, GlassHands creates an enlarged input space, rivaling input reach on large touc...
Conference Paper
In gaming, customizing individual characters, can create personal bonds between players and their characters. Hence, character cus-tomization is a standard component in many games. While mobile Augmented Reality (AR) games become popular, to date, no 3D character editor for AR games exists. We investigate the feasibility of 3D character customizati...
Article
Full-text available
Background Coordinated multi-display environments from the desktop, second-screen to gigapixel display walls are increasingly common. Personal and intimate mobile and wearable devices such as head-mounted displays, smartwatches, smartphones and tablets are rarely part of such multi-device ecosystems. Methods We conducted a literature research and a...
Article
Full-text available
In gaming, customizing individual characters, can create personal bonds between players and their characters. Hence, character customization is a standard component in many games. While mobile Augmented Reality (AR) games become popular, to date, no 3D character editor for AR games exists. We investigate the feasibility of 3D character customizatio...
Article
Full-text available
Augmented Reality is a technique that enables users to interact with their physical environment through the overlay of digital information. While being researched for decades, more recently, Augmented Reality moved out of the research labs and into the field. While most of the applications are used sporadically and for one particular task only, cur...
Article
Full-text available
Paper documents such as passports, visas and banknotes are frequently checked by inspection of security elements. In particular, optically variable devices such as holograms are important, but difficult to inspect. Augmented Reality can provide all relevant information on standard mobile devices. However, hologram verification on mobiles still take...
Conference Paper
Full-text available
One challenge of supporting in-situ sketching tasks with Magic Lenses on handheld Augmented Reality systems is to provide accurate and robust pose tracking without disrupting the sketching experience. Typical tracking approaches rely on the back-facing camera both for tracking and providing the view of the physical scene. This typically requires a...
Conference Paper
Full-text available
Coordinated multi-display environments from the desktop, second-screen to gigapixel display walls are increasingly common. Personal and intimate display devices such as head-mounted displays, smartwatches, smartphones and tablets are rarely part of such a multi-display ecosystem. This presents an opportunity to realise "body proximate" display envi...
Conference Paper
Full-text available
Body proximate display environments can be formed by combining multiple hand-held, head-mounted, wrist-worn or other displays. Wearable displays such as smartwatches and smartglasses have the potential to extend the interaction capabilities of mobile users beyond a single display. However, the display ecosystem formed by multiple personal displays...
Thesis
Full-text available
The increasing amount of publicly accessible situated information and the increasing computational power of personal devices such as smartphones and tablets have created an ideal basis for the uptake of Augmented Reality among mobile users. Specifically, information surfaces provide a large potential for augmentations, as they already provide an ut...