Specular Surface Recovery from Reflections of a Planar Pattern Undergoing an Unknown Pure Translation.
ABSTRACT This paper addresses the problem of specular surface recovery, and proposes a novel solution based on observing the reflections
of a translating planar pattern. Previous works have demonstrated that a specular surface can be recovered from the reflections
of two calibrated planar patterns. In this paper, however, only one reference planar pattern is assumed to have been calibrated
against a fixed camera observing the specular surface. Instead of introducing and calibrating a second pattern, the reference
pattern is allowed to undergo an unknown pure translation, and a closed form solution is derived for recovering such a motion.
Unlike previous methods which estimate the shape by directly triangulating the visual rays and reflection rays, a novel method
based on computing the projections of the visual rays on the translating pattern is introduced. This produces a depth range
for each pixel which also provides a measure of the accuracy of the estimation. The proposed approach enables a simple auto-calibration
of the translating pattern, and data redundancy resulting from the translating pattern can improve both the robustness and
accuracy of the shape estimation. Experimental results on both synthetic and real data are presented to demonstrate the effectiveness
of the proposed approach.
Conference Paper: Pose estimation from reflections for specular surface recovery.[Show abstract] [Hide abstract]
ABSTRACT: This paper addresses the problem of estimating the poses of a reference plane in specular shape recovery. Unlike existing methods which require an extra mirror or an extra reference plane and camera, our proposed method recovers the poses of the reference plane directly from its reflections on the specular surface. By establishing reflection correspondences on the reference plane in three distinct poses, our method estimates the poses of the reference plane in two steps. First, by applying a colinearity constraint to the reflection correspondences, a simple closed-form solution is derived for recovering the poses of the reference plane relative to its initial pose. Second, by applying a ray incidence constraint to the incident rays formed by the reflection correspondences and the visual rays cast from the image, a closed-form solution is derived for recovering the poses of the reference plane relative to the camera. The shape of the specular surface then follows. Experimental results on both synthetic and real data are presented, which demonstrate the feasibility and accuracy of our proposed method.IEEE International Conference on Computer Vision, ICCV 2011, Barcelona, Spain, November 6-13, 2011; 01/2011
[Show abstract] [Hide abstract]
ABSTRACT: In this paper, we present a novel, robust multi-view normal field integration technique for reconstructing the full 3D shape of mirroring objects. We employ a turntable-based setup with several cameras and displays. These are used to display illumination patterns which are reflected by the object surface. The pattern information observed in the cameras enables the calculation of individual volumetric normal fields for each combination of camera, display and turntable angle. As the pattern information might be blurred depending on the surface curvature or due to non-perfect mirroring surface characteristics, we locally adapt the decoding to the finest still resolvable pattern resolution. In complex real-world scenarios, the normal fields contain regions without observations due to occlusions and outliers due to interreflections and noise. Therefore, a robust reconstruction using only normal information is challenging. Via a non-parametric clustering of normal hypotheses derived for each point in the scene, we obtain both the most likely local surface normal and a local surface consistency estimate. This information is utilized in an iterative min-cut based variational approach to reconstruct the surface geometry.Proceedings of the 2013 IEEE International Conference on Computer Vision; 12/2013
[Show abstract] [Hide abstract]
ABSTRACT: This paper addresses the problem of recovering the unknown poses of a moving reference plane for specular shape recovery. Given the initial pose of the reference plane with respect to the camera, a closed form solution is derived to recover its subsequent poses directly from its reflections on the specular surface observed in the image sequence. With the estimated poses of the reference plane, the specular surface can then be easily recovered using any existing ray triangulation method. The proposed method greatly simplifies the calibration problem in specular shape recovery. Experimental results on both synthetic and real data are presented, which demonstrate the effectiveness of the proposed method.IEEE International Conference on Computer Vision Workshops, ICCV 2011 Workshops, Barcelona, Spain, November 6-13, 2011; 01/2011