Reinhard Klein

University of Bonn | Uni Bonn · Institute for Computer Sciences

We present incomplete gamma kernels, a generalization of Locally Optimal Projection (LOP) operators. In particular, we reveal the relation of the classical localized $ L_1 $ estimator, used in the LOP operator for surface reconstruction from noisy point clouds, to the common Mean Shift framework via a novel kernel. Furthermore, we generalize this r...

VR/AR technology is a key enabler for new ways of immersively experiencing cultural heritage artifacts based on their virtual counterparts obtained from a digitization process. In this article, we focus on enriching VR-based object inspection by additional haptic feedback, thereby creating tangible cultural heritage experiences. For this purpose, w...

Context:Optical interferometry is at a key development stage. ESO's VLTI has established a stable, robust infrastructure for long-baseline interferometry for general astronomical observers. The present second-generation instruments offer a wide wavelength coverage and improved performance. Their sensitivity and measurement accuracy lead to data and...

Previous work on interactive 3D labeling focused on improving user experience based on virtual/augmented reality and, thereby, speeding-up the labeling of scenes. In this paper, we present a novel interactive, collaborative VR-based 3D labeling system for live-captured scenes by multiple remotely-connected users based on sparse multi-user input wit...

VR/AR technology is a key enabler for new ways of immersively experiencing cultural heritage artifacts based on their virtual counterparts obtained from a digitization process. In this paper, we focus on enriching VR-based object inspection by additional haptic feedback, thereby creating tangible cultural heritage experiences. For this purpose, we...

Context. The inner few au region of planet-forming disks is a complex environment. High angular resolution observations have a key role in understanding the disk structure and the dynamical processes at work. Aims. In this study we aim to characterize the mid-infrared brightness distribution of the inner disk of the young intermediate-mass star HD...

The paper is concerned with simulation of the periodontal ligament response to force in the initial phase of orthodontic tooth movement. This is based on two previous investigations, a in vitro experiment with specimens of porcine mandibular premolars and a in vivo experiment on human upper first incisors. For the curve fit of the in vitro experime...

Plant growth visualization from a series of 3D scanner measurements is a challenging task. Time intervals between successive measurements are typically too large to allow a smooth animation of the growth process. Therefore, obtaining a smooth animation of the plant growth process requires a temporal upsampling of the point cloud sequence in order t...

accepted for publication in A&A

The key prerequisite for accessing the huge potential of current machine learning techniques is the availability of large databases that capture the complex relations of interest. Previous datasets are focused on either 3D scene representations with semantic information, tracking of multiple persons and recognition of their actions, or activity rec...

Applications like disaster management and industrial inspection often require experts to enter contaminated places. To circumvent the need for physical presence, it is desirable to generate a fully immersive individual live teleoperation experience. However, standard video-based approaches suffer from a limited degree of immersion and situation awa...

Sharing live telepresence experiences for teleconferencing or remote collaboration receives increasing interest with the recent progress in capturing and AR/VR technology. Whereas impressive telepresence systems have been proposed on top of on-the-fly scene capture, data transmission and visualization, these systems are restricted to the immersion...

Real-time reflectance reconstruction under uncontrolled illumination conditions is well-known to be a challenging task due to the complex interplay of scene geometry, surface reflectance and illumination. Nonetheless, recent works succeed in recovering both unknown reflectance and illumination in an uncontrolled setting. However, they are either li...

Applications like disaster management and industrial inspection often require experts to enter contaminated places. To circumvent the need for physical presence, it is desirable to generate a fully immersive individual live teleoperation experience. However, standard video-based approaches suffer from a limited degree of immersion and situation awa...

Sharing live telepresence experiences for teleconferencing or remote collaboration receives increasing interest with the recent progress in capturing and AR/VR technology. Whereas impressive telepresence systems have been proposed on top of on-the-fly scene capture, data transmission and visualization, these systems are restricted to the immersion...

Iridescence is a natural phenomenon that is perceived as gradual color changes, depending on the view and illumination direction. Prominent examples are the colors seen in oil films and soap bubbles. Unfortunately, iridescent effects are particularly difficult to recreate in real‐time computer graphics. We present a high‐quality real‐time method fo...

We present a framework for sharing immersive live telepresence experiences to groups of remote users for arbitrary-sized environments. Our framework builds upon RGB-D data capture of the local environment (by a person or robot) and involves real-time 3D reconstruction, scalable data streaming and visualization to a multitude of remote users at mode...

Context. Teegarden's Star is the brightest and one of the nearest ultra-cool dwarfs in the solar neighbourhood. For its late spectral type (M7.0V), the star shows relatively little activity and is a prime target for near-infrared radial velocity surveys such as CARMENES. Aims. As part of the CARMENES search for exoplanets around M dwarfs, we obtain...

The perceptual similarity of textures has gained considerable attention in the computer vision and graphics communities. Here, we focus on the challenging task of estimating the mutual perceptual similarity between two textures from materials on a consistent scale. Unlike previous studies that more or less directly queried pairwise similarity from...

Real-time 3D scene reconstruction from RGB-D sensor data, as well as the exploration of such data in VR/AR settings, has seen tremendous progress in recent years. The combination of both these components into telepresence systems, however, comes with significant technical challenges. All approaches proposed so far are extremely demanding on input a...

Re­con­struct­ing scenes in real-time us­ing low-cost sen­sors has gained in­creas­ing at­ten­tion in re­cent re­search and en­abled nu­mer­ous ap­pli­ca­tions in graph­ics, vi­sion, and ro­bot­ics. While cur­rent tech­niques of­fer a subs­tantial im­prove­ment re­gard­ing the qual­ity of the recon­structed geom­e­try, the de­gree of re­al­ism of t...

Context. η Car is one of the most intriguing luminous blue variables in the Galaxy. Observations and models of the X-ray, ultraviolet, optical, and infrared emission suggest a central binary in a highly eccentric orbit with a 5.54 yr period residing in its core. 2D and 3D radiative transfer and hydrodynamic simulations predict a primary with a dens...

Metallic car paints are visually complex materials that, among others effects, exhibit a view-dependent metallic sparkling, which is particularly difficult to recreate in computer graphics. While capturing real-world metallic paints is possible with specialized devices, creating these materials computationally poses a difficult problem. We present...

This work presents an interferometric study of the massive-binary fraction in the Orion Trapezium Cluster with the recently comissioned GRAVITY instrument. We observe a total of 16 stars of mainly OB spectral type. We find three previously unknown companions for $\theta ^1$ Ori B, $\theta ^2$ Ori B, and $\theta ^2$ Ori C. We determine a separation...

Compositing transparent surfaces rendered in an arbitrary order requires techniques for order-independent transparency. Each surface color needs to be multiplied by the appropriate transmittance to the eye to incorporate occlusion. Building upon moment shadow mapping, we present a moment-based method for compact storage and fast reconstruction of t...

Car paints are visually complex materials that are of great importance for numerous real-time applications, including not only the game and movie industries but also virtual prototyping and design as well as advertisement. In addition to the creation of plausible materials by designers, more and more industrial effort is spent on capturing large da...

Real-time 3D scene reconstruction from RGB-D sensor data, as well as the exploration of such data in VR/AR settings, has seen tremendous progress in recent years. The combination of both these components into telepresence systems, however, comes with significant technical challenges. All approaches proposed so far are extremely demanding on input a...

Among the many models for material appearance, data-driven representations like bidirectional texture functions (BTFs) play an important role as they provide accurate real-time reproduction of complex light transport effects such as interreflections. However, their acquisition involves time-consuming capturing of many thousands of bidirectional sam...

Manipulating digital optical material representations is still a difficult problem because arbitrary manipulations lead almost certainly to an unrealistic impression of the material. In this paper we present an approach to material editing based on a digital model of the V1-area of the visual cortex. The V1-model is used to define the appearance sp...

We report on the first star discovered to host a planet detected by radial velocity (RV) observations obtained within the CARMENES survey for exoplanets around M dwarfs. HD 147379 (V = 8.9 mag, M = 0.58 ± 0.08 M), a bright M0.0 V star at a distance of 10.7 pc, is found to undergo periodic RV variations with a semi-amplitude of K = 5.1±0.4 m s −1 an...

Realistic virtual reality applications require highly-detailed geometry as well es convincing surface representations. In many applications, especially in the automotive industry, the realistic rendering of metallic effect paints is necessary. Due to their complex appearance, this is a demanding problem. Previous methods either use a computationall...

The CARMENES radial velocity (RV) survey is observing 324 M dwarfs to search for any orbiting planets. In this paper, we present the survey sample by publishing one CARMENES spectrum for each M dwarf. These spectra cover the wavelength range 520--1710nm at a resolution of at least $R > 80,000$, and we measure its RV, H$\alpha$ emission, and project...

We present a novel approach for the calculation of dense correspondences between non-isometric shapes. Our work builds on the well known functional map framework and investigates a novel embedding for the alignment of shapes. We therefore identify points with their Green’s functions of the Laplace-Beltrami operator, and hence, embed shapes into the...

Conventional reflectance acquisition techniques rely on the reconstruction of a closed surface geometry and a subsequent surface parametrization that is required to store the reflectance data parametrized over the surface. Among the main drawbacks of this approach is the need for a suitable surface parametriza- tion which is particularly challengin...

We present preliminary results on our effort to combine sparse and illumination-multiplexed acquisition of bidirectional texture functions (BTFs) for material appearance. Both existing acquisition paradigms deal with a single specific problem: the desire to reduce either the number of images to be obtained while maintaining artifact-free renderings...

When relighting digitized objects, strong color deviations can arise depending on the illumination conditions if the object’s reflectance is only captured in RGB. To guarantee color-correct simulations, it is therefore of great importance to perform appearance capture with a finer spectral sampling than the three broad band RGB channels. Capturing...

We propose a novel example-based approach for road network synthesis relying on Generative Adversarial Networks (GANs), a recently introduced deep learning technique. In a pre-processing step, we first convert a given representation of a road network patch into a binary image where pixel intensities encode the presence or absence of streets. We the...

GRAVITY is a new instrument to coherently combine the light of the European Southern Observatory Very Large Telescope Interferometer to form a telescope with an equivalent 130 m diameter angular resolution and a collecting area of 200 m$^2$. The instrument comprises fiber fed integrated optics beam combination, high resolution spectroscopy, built-i...

Context. The main goal of the CARMENES survey is to find Earth-mass planets around nearby M-dwarf stars. Seven M-dwarfs included in the CARMENES sample had been observed before with HIRES and HARPS and either were reported to have one short period planetary companion (GJ 15 A, GJ 176, GJ 436, GJ 536 and GJ 1148) or are multiple planetary systems (G...

We introduce a method for automated temporal segmentation of human motion data into distinct actions and compositing motion primitives based on self-similar structures in the motion sequence. We use neighborhood graphs for the partitioning and the similarity information in the graph is further exploited to cluster the motion primitives into larger...

The work at hand outlines a recording setup for capturing hand and finger movements of musicians. The focus is on a series of baseline experiments on the detectability of coloured markers under different lighting conditions. With the goal of capturing and recording hand and finger movements of musicians in mind, requirements for such a system and e...

GRAVITY is a near-infrared interferometric instrument that allows astronomers to combine the light of the four unit or four auxiliary telescopes of the ESO Very Large Telescope in Paranal, Chile. GRAVITY will deliver extremely precise relative astrometry and spatially resolved spectra. In order to study objects in regions of high extinction (e.g. t...

This paper introduces a novel and efficient segmentation method designed for articulated hand motion. The method is based on a graph representation of temporal structures in human hand-object interaction. Along with the method for temporal segmentation we provide an extensive new database of hand motions. The experiments performed on this dataset s...

Inferring the underlying depth map from a single image is an ill-posed and inherently ambiguous problem. State-of-the-art deep learning methods can now estimate accurate depth maps, but when projected into 3D, still lack local detail and are often highly distorted. We propose a multi-scale convolution neural network to learn from single RGB images...

This paper introduces a novel and efficient segmentation method designed for articulated hand motion. The method is based on a graph representation of temporal structures in human hand-object interaction. Along with the method for temporal segmentation we provide an extensive new database of hand motions. The experiments performed on this data set...

This tutorial is focused on acquisition methods for geometry and reflectance as well as strategies towards an efficient acquisition pipeline to fulfill the demands of industry with respect to mass digitization of 3D contents. We provide a thorough overview of the standard methods for the acquisition of both geometry and reflectance of surfaces with...