Conference Paper

Quasi-dense 3D reconstruction using tensor-based multiview stereo.

DOI: 10.1109/CVPR.2010.5539796 Conference: The Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2010, San Francisco, CA, USA, 13-18 June 2010
Source: DBLP

ABSTRACT We propose tensor-based multiview stereo (TMVS) for quasi-dense D reconstruction from uncalibrated images. Our work is inspired by the patch-based multiview stereo (PMVS), a state-of-the-art technique in multiview stereo reconstruction. The effectiveness of PMVS is attributed to the use of 3D patches in the match-propagate-filter MVS pipeline. Our key observation is: PMVS has not fully utilized the valuable 3D geometric cue available in 3D patches which are oriented points. This paper combines the complementary advantages of photoconsistency, visibility and geometric consistency enforcement in MVS via the use of 3D tensors, where our closed-form solution to tensor voting provides a unified approach to implement the match-propagate-filter pipeline. Using PMVS as the implementation backbone where TMVS is built, we provide qualitative and quantitative evaluation to demonstrate how TMVS significantly improve the MVS pipeline.

  • [Show abstract] [Hide abstract]
    ABSTRACT: In this paper we propose a depth-map merging based Multiple View Stereo method for large-scale scenes which takes both accuracy and efficiency into account. In the proposed method, an efficient patch based stereo matching process is used to generate depth-map at each image with acceptable errors, followed by a depth-map refinement process to enforce consistency over neighboring views. Compared to state-of-the-art methods, the proposed method can reconstruct quite accurate and dense point clouds with high computational efficiency. Besides, the proposed method could be easily parallelized at image level, i.e., each depth-map is computed individually, which makes it suitable for large-scale scene reconstruction with high resolution images. The accuracy and efficiency of the proposed method are evaluated quantitatively on benchmark data and qualitatively on large data sets.
    IEEE Transactions on Image Processing 01/2013; · 3.11 Impact Factor
  • Source
    New Developments in the Visualization and Processing of Tensor Fields :, 01/2012: pages 29-50;
  • [Show abstract] [Hide abstract]
    ABSTRACT: Depth-map merging based 3D modeling is an effective approach for reconstructing large-scale scenes from multiple images. In addition to generate high quality depth maps at each image, how to select suitable neighboring images for each image is also an important step in the reconstruction pipeline, unfortunately to which little attention has been paid in the literature till now. This work is intended to tackle this issue for large scale scene reconstruction where many unordered images are captured and used with substantial varying scale and viewangle changes. We formulate the neighboring image selection as a combinatorial optimization problem and use the quantuminspired evolutionary algorithm to seek its optimal solution. Experimental results on the ground truth data set show that our approach can significantly improve the quality of the depthmaps as well as the final 3D reconstruction results with high computational efficiency.
    IEEE Transactions on Image Processing 11/2013; · 3.11 Impact Factor