A 3D-TV system based on video plus depth information
ABSTRACT This paper presents details of a system that allows for an evolutionary introduction of depth perception into the existing 2D digital TV framework. The work is part of the European information society technologies (IST) project "advanced three-dimensional television system technologies" (ATTEST), an activity, where industries, research centers and universities have joined forces to design a backwards-compatible, flexible and modular broadcast 3D- TV system. At the very heart of this new idea is a novel data representation format, which consists of monoscopic color video and associated per-pixel depth information. From these data, one or more "virtual" views of the 3D scene can be synthesized in real-time at the receiver side by means of so-called depth-image-based rendering (DIBR) techniques. After describing the basics of this new approach on 3D- TV, this paper will focus on (a) the efficient generation of high-quality "virtual" stereoscopic views and (b) the backwards-compatible compression and transmission of 3D imagery using state-of-the-art MPEG tools.
- SourceAvailable from: Andrew J. Woods[show abstract] [hide abstract]
ABSTRACT: This paper discusses the origins, characteristics and effects of image distortions in stereoscopic video systems. The geometry of stereoscopic camera and display systems is presented first. This is followed by the analysis and diagrammatic presentation of various image distortions such as depth plane curvature, depth non-linearity, depth and size magnification, shearing distortion and keystone distortion. The variation of system parameters is also analysed with the help of plots of image geometry to show their effects on image distortions.11/2002;
- [show abstract] [hide abstract]
ABSTRACT: . In this paper an approach is presented that obtains virtual models from sequences of images. The system can deal with uncalibrated image sequences acquired with a hand held camera. Based on tracked or matched features the relations between multiple views are computed. From this both the structure of the scene and the motion of the camera are retrieved. The ambiguity on the reconstruction is restricted from projective to metric through auto-calibration. A flexible multi-view stereo matching scheme is used to obtain a dense estimation of the surface geometry. From the computed data virtual models can be constructed or, inversely, virtual models can be included in the original images. Keywords: Structure from motion, image sequences, 3D models. 111/2001;
- [show abstract] [hide abstract]
ABSTRACT: The ability to make on-line adjustments to stereoscopic camera position parameters dynamically, during execution of telemanipulation tasks, allows one to maintain a theoretically `optimal' camera configuration, in response to changing viewing conditions. Associated with this, however, is the problem of the observer's being forced to adapt to a (continuously) changing relationship between perceived inter-object distances in the depth plane and the corresponding real distances. One problem in particular is the potential conflict between varying stereoscopic depth cues and unchanging size cues. Two experiments were performed. In the first we investigated how depth judgement ability varied with unsignalled changes in camera convergence distance. This resulted in significant changes in distance judgement, with overestimation for increases in camera separation and underestimation for decreases. Short- term feedback on judgement error was sufficient to correct the changes. In the second experiment, on-screen calibrated depth cues were added, by means of overlaid stereoscopic computer graphics, causing the significant estimation errors found in the first experiment to disappear. The implication of this is that distance/depth judgement can in principle be rescaled to compensate for perceptual conflicts caused by changing camera configuration, by providing either real or virtual depth scaling cues at the task site.01/1992; 1669:122-134.