Silhouette and stereo fusion for 3D object modeling

Signal and Image Processing Department, CNRS UMR 5141, Ecole Nationale Supérieure des Télécommunications, France
Computer Vision and Image Understanding (Impact Factor: 1.36). 01/2003; DOI: 10.1016/j.cviu.2004.03.016
Source: DBLP

ABSTRACT In this paper, we present a new approach to high quality 3D object reconstruction. Starting from a calibrated sequence of color images, the algorithm is able to reconstruct both the 3D geometry and the texture. The core of the method is based on a deformable model, which defines the framework where texture and silhouette information can be fused. This is achieved by defining two external forces based on the images: a texture driven force and a silhouette driven force. The texture force is computed in two steps: a multi-stereo correlation voting approach and a gradient vector flow diffusion. Due to the high resolution of the voting approach, a multi-grid version of the gradient vector flow has been developed. Concerning the silhouette force, a new formulation of the silhouette constraint is derived. It provides a robust way to integrate the silhouettes in the evolution algorithm. As a consequence, we are able to recover the contour generators of the model at the end of the iteration process. Finally, a texture map is computed from the original images for the reconstructed 3D model.

1 Follower
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: This paper presents a volumetric formulation for the multi-view stereo problem which is amenable to a computationally tractable global optimisation using Graph-cuts. Our approach is to seek the optimal partitioning of 3D space into two regions labelled as "object" and "empty" under a cost functional consisting of the following two terms: (1) A term that forces the boundary between the two regions to pass through photo-consistent locations and (2) a ballooning term that inflates the "object" region. To take account of the effect of occlusion on the first term we use an occlusion robust photo-consistency metric based on Normalised Cross Correlation, which does not assume any geometric knowledge about the reconstructed object. The globally optimal 3D partitioning can be obtained as the minimum cut solution of a weighted graph.
    IEEE Transactions on Pattern Analysis and Machine Intelligence 01/2008; 29(12):2241-6. DOI:10.1109/TPAMI.2007.70712 · 5.69 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Generating free-viewpoint video in outdoor sports environments is currently an unsolved problem due to difficulties in obtaining accurate background segmentation and camera calibration. This paper introduces a technique for the reconstruction of a scene in the presence of these errors. We tackle the issues of reconstruction completeness, and accuracy of surface shape and appearance. We introduce the concept of the conservative visual hull as a technique to improve reconstruction completeness. We then present a view-dependent surface optimisation technique using deformable models to improve surface shape and appearance. We contribute a novel dual-mode snake algorithm that is robust to noise and demonstrates reduced dependence on parameterisation by separating the search of the solution space from the data fitting. We conclude by presenting results of this technique along with a quantitative evaluation against other reconstruction techniques using a leave-one- out data set.
    3-D Digital Imaging and Modeling, 2007. 3DIM '07. Sixth International Conference on; 09/2007
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: This work presents a procedure for the 3D quantification of facial edemas. This issue is instrumental for assessing the effectiveness of specific drugs and/or surgical provisions in facial surgery. The considered problems are the automatic acquisition of face masks of adequate precision, the registration of the 3D masks of the same patient taken at different times during the edema evolution and the estimate of the volume characterizing the edema.
    Image and Signal Processing and Analysis, 2005. ISPA 2005. Proceedings of the 4th International Symposium on; 10/2005

Preview (2 Sources)