No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
An Efficient Disparity Map Format for Real Time Interpolation in Multi Viewpoint Stereoscopic Video Systems
Abstract
In this paper we present an efficient disparity map format that has been developed in the European ACTS project PANORAMA for stereoscopic multi viewpoint video systems. This new map, the chain map, has several advantages compared to the usual disparity vector fields. It is a very efficient, single bidirectional map, with explicit indication of occlusions and normal/contracted objects, there are no upper or lower bounds on disparity values and a disparity offset is not needed. For real time video applications, the chain map allows for low complexity hardware implementations of system parts. We present disparity estimation, image interpolation and filtering algorithms with low hardware complexity. With teleconferencing images high quality results are obtained. 1. INTRODUCTION Stereoscopic multi viewpoint systems have been considered widely for 3D video communication systems [1-6]. These systems provide the sensation of depth and motion parallax. Figure 1 shows a multi viewpoint system ...
... In the latter case P A is an occlusion point. The presence of occlusion points can be represented by the occlusion field O A : and O B can be represented by one field, the so-called chain map [46], provided pixel accuracy is used and an additional ordering constraint, discussed near the end of this paper, holds [11,16,44,58]. ...
The estimation of correspondences in natural image pairs plays an important role in a large number of applications such as video coding, frame rate conversion, multi-viewpoint image generation, camera calibration, 3D from stereo, and structure from motion. An overview of the techniques for dense geometric correspondence estimation is presented. Different types of image pairs are discussed. Some improvements for correspondence estimation in image pairs are projected, which include, the estimation of all pseudo-correspondences, the incorporation of image restoration models, modeling of specular reflectivity of scene surfaces, the use of image sequences, and the application of epipolar geometry.
In the last years two European projects – DISTIMA and PANORAMA – were working on stereoscopic and three-dimensional (3-D) video. While DISTIMA made it possible to transmit stereoscopic video compatible to MPEG 2 in real time, PANORAMA develops a 3-D video system: viewpoint adaptive visualisation of scenes providing look-around-capability. This paper describes selected parts of the work performed in the two projects: the DISTIMA real-time hardware for the MPEG2 compatible transmission of stereoscopic video, the DISTIMA activities in the area of region and object-based stereoscopic coding, the PANORAMA real-time hardware development for 3-D video based on disparity estimation and disparity compensated interpolation of intermediate views and the PANORAMA software development for 3-D video based on 3-D reconstruction and 3-D computer graphics.
We propose a generic algorithm for the geometrically correct
reconstruction of 3-D scenes on stereo displays with viewpoint
adaptation. This forms the basis of multiviewpoint systems, which are
currently the most promising candidates for real-time implementations of
3-D visual communication systems. The reconstruction algorithm needs 3-D
tracking of the viewers' eyes with respect to the display. We analyze
the effect of eye-tracking errors. A simple bound is derived, below
which reconstruction errors cannot be observed. We design a
multiviewpoint system using a recently introduced image-based scene
representation. The design formed the basis of the real-time
multiviewpoint system that was recently built in the European PANORAMA
project. Experiments with both natural and synthetic scenes show that
the proposed reconstruction algorithm performs well. The experiments are
performed by computer simulations and the real-time PANORAMA
system
ResearchGate has not been able to resolve any references for this publication.