Conference Paper

Sttreaming Video Textures for Mixed Reality Applications in Interactive Ray Tracing Environments.

Conference: Proceedings of the Vision, Modeling, and Visualization Conference 2003 (VMV 2003), München, Germany, November 19-21, 2003
Source: DBLP

ABSTRACT The realm of mixed reality applications lies in blending rendered images with images of the real world. This requires highly realistic rendered im- ages in order to seamlessly blend between those two worlds. However, current rasterization technology severely limits the achievable realism and imposes strict limits on the scene complexity and the optical effects that can be simulated efficiently. Real-time ray tracing can overcome many of these constraints and enables completely new approaches for mixed reality applications. This paper explores this design space based on a framework for live streaming of video textures in a real-time ray tracing engine. We also sug- gest a novel approach to video-based AR by inte- grating image compositing with shading computa- tions. We demonstrate the approach with a num- ber of VR/AR applications including video inserts, video billboards, and dynamic lighting from video and HDR video streams. Being seamlessly inte- grated into the ray tracing framework, all our ap- plications feature ray traced effects, like shadows, reflections and refraction.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: In the last years, the well known ray tracing algorithm gained new popularity with the introduction of interactive ray tracing methods. The high modularity and the ability to produce highly realistic images make ray tracing an attractive alternative to raster graphics hardware.Interactive ray tracing also proved its potential in the field of Mixed Reality rendering and provides novel methods for seamless integration of real and virtual content. Actor insertion methods, a subdomain of Mixed Reality and closely related to virtual television studio techniques, can use ray tracing for achieving high output quality in conjunction with appropriate visual cues like shadows and reflections at interactive frame rates.In this paper, we show how interactive ray tracing techniques can provide new ways of implementing future virtual studio applications.
    Journal of Virtual Reality and Broadcasting. 01/2005;
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Virtual Mirrors are augmented reality applications that capture a viewer's image and add 2D or 3D overlaid virtual elements, such as cloth patterns, or replace existing pieces of garments, such as shoes, by virtual ones. The purpose of our study is to focus on the addition of jewels that present complex rendering issues due to reflection and translucency, especially for real-time applications. We propose two complementary approaches which are both suited for particular objects. The image-based rendering technique relies on an image data-set of photos taken on a semi-circle of camera positions and a 3D reconstruction of the jewel. This approach is exploited to demonstrate real jewels with sophisticated refractions and highlights. The analytical 3D rendering technique can also visualize configurable virtual jewels and is based on the decomposition of the jewel into parts without non-local reflection or transparency. A graph-based rendering chain takes in consideration some of the self-reflection and lighting effects.
    Image Processing (ICIP), 2010 17th IEEE International Conference on; 10/2010
  • [Show abstract] [Hide abstract]
    ABSTRACT: This paper introduces new approaches to enable collaborative outdoor mixed reality design review in the architectural domain as well as outdoor mixed reality experiences in the cultural heritage domain. For this purpose we present the results of three closely related European projects, IMPROVE and CINeSPACE, which are currently succeeded by MAXIMUS, continuing the development of technologies relevant to the two domains. The paper focuses on the base technologies needed to develop usable outdoor mixed reality applications, such as marker-less optical tracking combined with sensor fusion for accurate pose estimation outdoors. Furthermore the paper presents a new visualization system developed within the project, one of the few daylight blocking head.-mounted displays available. In addition to pose estimation and visualization devices, the paper presents a VR framework adapted for the architecture and the cultural heritage domain featuring high dynamic range image acquisition combined with pre-computed radiance transfer rendering to be able to photo-realistically render urban content. For the cultural heritage domain this framework has been extended to allow accurate display and generation of multimedia content super-imposed on a real environment as well as city navigation.
    Proceedings of the 2010 Spring Simulation Multiconference, SpringSim 2010, Orlando, Florida, USA, April 11-15, 2010; 01/2010

Full-text (2 Sources)

Available from
May 20, 2014