Multiview panoramic cameras using mirror pyramids.

Computer Vision and Robotics Laboratory, Beckham Institute for Advanced Science and Technology, University of Illinois, at Urbana-Champaign, Urbana, IL 61801, USA.
IEEE Transactions on Pattern Analysis and Machine Intelligence (Impact Factor: 4.8). 08/2004; 26(7):941-6. DOI: 10.1109/TPAMI.2004.33
Source: PubMed

ABSTRACT A mirror pyramid consists of a set of planar mirror faces arranged around an axis of symmetry and inclined to form a pyramid. By strategically positioning a number of conventional cameras around a mirror pyramid, the viewpoints of the cameras' mirror images can be located at a single point within the pyramid and their optical axes pointed in different directions to effectively form a virtual camera with a panoramic field of view. Mirror pyramid-based panoramic cameras have a number of attractive properties, including single-viewpoint imaging, high resolution, and video rate capture. It is also possible to place multiple viewpoints within a single mirror pyramid, yielding compact designs for simultaneous multiview panoramic video rate imaging. Nalwa [4] first described some of the basic ideas behind mirror pyramid cameras. In this paper, we analyze the general class of multiview panoramic cameras, provide a method for designing these cameras, and present experimental results using a prototype we have developed to validate single-pyramid multiview designs. We first give a description of mirror pyramid cameras, including the imaging geometry, and investigate the relationship between the placement of viewpoints within the pyramid and the cameras' field of view (FOV), using simulations to illustrate the concepts. A method for maximizing sensor utilization in a mirror pyramid-based multiview panoramic camera is also presented. Images acquired using the experimental prototype for two viewpoints are shown.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The paper presents a registration algorithm based on the Analytical Fourier-Mellin Transform (AFMT). In the Fourier Mellin registration algorithm, the estimation of the geometrical transformation is only done in the Fourier Transform phase domain which is known by containing the shape information. The proposed algorithm will be used to estimate homography since in the vicinity of key points, we can assume that geometrical transformation is simply a similarity. So, we compute AFMT at each key point location and we use the phase correlation to match features. Then, we estimate homography parameters with RANSAC algorithm. An archeological application will illustrate the efficiency of AFMT registration in image mosaicing context by the construction of Punic Panorama.
    IPCV 2012, Las Vegas, USA; 07/2012
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: A computational camera uses a combination of optics and processing to produce images that cannot be captured with traditional cameras. In the last decade, computational imaging has emerged as a vibrant field of research. A wide variety of computational cameras has been demonstrated to encode more useful visual information in the captured images, as compared with conventional cameras. In this paper, we survey computational cameras from two perspectives. First, we present a taxonomy of computational camera designs according to the coding approaches, including object side coding, pupil plane coding, sensor side coding, illumination coding, camera arrays and clusters, and unconventional imaging systems. Second, we use the abstract notion of light field representation as a general tool to describe computational camera designs, where each camera can be formulated as a projection of a high-dimensional light field to a 2-D image sensor. We show how individual optical devices transform light fields and use these transforms to illustrate how different computational camera designs (collections of optical devices) capture and encode useful visual information.
    IEEE Transactions on Image Processing 01/2012; · 3.20 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: It is widely accepted that the emerging concept of immersive media is one of the key technologies for future entertainment. One feature of immersive media is to use large panoramic screens with ultrahigh resolution. This technology requires a completely new production grammar that is not necessarily compatible with conventional production formats. Against this background the paper describes a new approach called format-agnostic production that bridges the gap between different target formats and applications. It does not use fixed numbers of frames, lines and pixels, or even geometry. The philosophy is to merge video signals from different camera sensors with different spatio-temporal resolutions and dynamic ranges to a wide-angle panoramic view of the scene. Hence, to support a wide range of applications from mobile devices to immersive media, any desired shot framing and resolution can be obtained by scanning, panning, or zooming. Apart from a general description of the concept and the system architecture, the paper will mainly focus on technical details of ultrahigh-resolution panoramic imaging which plays a central role in the concept of format-agnostic production.
    Proceedings of the IEEE 01/2013; 101(1):99-114. · 6.91 Impact Factor

Full-text (2 Sources)

Available from
May 17, 2014