Tobias Schwandt

Tobias Schwandt
Technische Universität Ilmenau | TUI · Institut für Medien und Kommunikationswissenschaft

Doctor of Engineering
Looking for new opportunities, research facilities for a stay abroad, and awesome new research.

About

21
Publications
2,232
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
34
Citations
Introduction
My personal interest is to enhance the visual quality of virtual objects inside an AR application. Mainly virtual mirror-like objects are difficult to visualize because of their shinny material. Therefore, I try to estimate a light probe as plausible as possible to show virtual reflections. Beside that estimation, I try to reconstruct the real world to allow a more sophisticated interaction between real and virtual world. All approaches and findings are usable in real-time on a smartphone.
Additional affiliations
September 2014 - January 2020
Technische Universität Ilmenau
Position
  • Research Assistant

Publications

Publications (21)
Article
Full-text available
In recent years, various depth sensors that are small enough to be used with mobile hardware have been introduced. They provide important information for use cases like 3D reconstruction or in the context of augmented reality where tracking and camera data alone would be insufficient. However, depth sensors may not always be available due to hardwa...
Chapter
This chapter deals with the authoring of VR and AR applications. The focus here is on the use of authoring tools in the form of software development kits (SDKs) or game engines. First, the actual authoring process will be briefly discussed before selected authoring tools for VR and AR are reviewed. Subsequently, the authoring process and the use of...
Conference Paper
Depth estimation is one of the basic building blocks for scene understanding. In the case of monocular depth estimation using neural networks, many such approaches are highly hardware dependent because they result in a task- and environment-specific optimizing problem. Most DNN methods use commonly available datasets which leads to overfitting on p...
Chapter
All approaches in Chapter 3 have been explored to enable high-quality visualization in Mixed Reality (MR) applications. Hereby, the visual output as well as the performance for mobile devices and desktop PCs is of particular importance. Therefore, a graphics engine has been implemented using OpenGL 4.5 on desktop PCs and OpenGL ES 3.2 on mobile dev...
Chapter
Illumination is important for a high-quality visualization of virtual objects. Especially in the case of AR applications, lighting is important to visualize virtual objects inside the real world correctly. A major contribution to AR lighting is the reflection of the real environment on virtual objects. Therefore, the environment needs to be taken i...
Chapter
The visualization of virtual objects inside the real environment is quite a complex issue and basic knowledge is required to understand the approaches in detail. Therefore, in the following the fundamentals and state of the art are described. Some parts are discussed in more detail depending on the contribution to the overall topic.
Chapter
This thesis introduced various approaches to estimate the environment, manipulate the spatial behavior, and create different lighting effects between the real and virtual world. The main contributions of this thesis are (1) a real-time rendering for MR applications combining real-world and virtual content in the G-Buffer, (2) a manipulation of the...
Chapter
The previous chapters outline the approaches, the pipeline, and realization. Based on this, different effects can be achieved like glossy reflections on mirror-like surfaces or the manipulation of real-world geometry.
Chapter
The results shown in the previous chapter highlight the advantages of the approaches for plausible and high-quality reflections in Mixed Reality (MR). All of them can visualize virtual reflections between the real and virtual world in realtime. Even virtual glossy surfaces can be visualized with plausible looking reflections. In addition, a manipul...
Preprint
Full-text available
The reconstruction of real-world surfaces is on high demand in various applications. Most existing reconstruction approaches apply 3D scanners for creating point clouds which are generally sparse and of low density. These points clouds will be triangulated and used for visualization in combination with surface normals estimated by geometrical appro...
Conference Paper
Full-text available
The reconstruction of real-world surfaces is on high demand in various applications. Most existing reconstruction approaches apply 3D scanners for creating point clouds which are generally sparse and of low density. These points clouds will be triangulated and used for visualization in combination with surface normals estimated by geometrical appro...
Book
Visualizations of virtual objects in the real environment is often done by a simplified representation with simple surfaces and without reference to the surrounding environment. The seamless fusion of the virtual and real environment is, however, an essential factor in many areas, which is of particular importance when calculating lighting in mixed...
Chapter
Environment textures are used for the illumination of virtual objects within a virtual scene. Using these textures is crucial for high-quality lighting and reflection. In the case of an augmented reality context, the lighting is very important to seamlessly embed a virtual object within the real world scene. To ensure this, the lighting of the envi...
Chapter
Dieses Kapitel befasst sich mit der Erstellung von VR- und AR-Anwendungen. Im Zentrum der Betrachtung steht hierbei die Nutzung von Autorenwerkzeugen in Form von Softwarepaketen oder (Game) Engines. Zunächst soll kurz auf den eigentlichen Autorenprozess eingegangen werden, bevor ausgewählte Autorenwerkzeuge für VR und AR betrachtet werden. Anschlie...
Conference Paper
Full-text available
Glossy reflections of the surroundings play a major role when trying to achieve a seamless fusion of real and virtual objects in Mixed Reality (MR) environments. Traditionally, the necessary information about the ambiance is captured using mirrored balls, HDR cameras, fish-eye lenses, RGB-D cameras or 360-degree cameras. While these approaches allo...
Conference Paper
Full-text available
Physically-based approaches are increasingly used in a wide field of computer graphics. By that, modern graphic engines can provide a realistic output using physical correct values instead of an analytical approximation. Such applications apply the final lighting on a geometry buffer to reduce the complexity. Using this approach for Mediated Realit...
Article
This paper examines benefits of the exer-learning concept HOPSCOTCH for rehabilitation in spa clinics and at home. It describes a specific application to motivate obese patients in spa clinics for exercise. Furthermore results of an empirical study are reported where HOPSCOTCH was implemented in two spa clinics for a period of four weeks. The resul...

Network

Cited By

Projects

Project (1)
Project
The goal of this project is to develop and evaluate possible tracking solutions in an outdoor environment. These new approaches are supported by neural networks algorithms. Moreover, modern user interfaces will be evaluated in the case of a usage in road maintenance services.