Conference Paper

Robust Photometric Stereo via Low-Rank Matrix Completion and Recovery.

DOI: 10.1007/978-3-642-19318-7_55 Conference: Computer Vision - ACCV 2010 - 10th Asian Conference on Computer Vision, Queenstown, New Zealand, November 8-12, 2010, Revised Selected Papers, Part III
Source: DBLP

ABSTRACT We present a new approach to robustly solve photometric stereo problems. We cast the problem of recovering surface normals from multiple lighting conditions as a problem of recovering a low-rank matrix with both missing entries and corrupted entries, which model all types of non-Lambertian eects such as shadows and specularities. Unlike previ- ous approaches that use Least-Squares or heuristic robust techniques, our method uses advanced convex optimization techniques that are guaranteed to nd the correct low-rank matrix by simultaneously xing its missing and erroneous entries. Extensive experimental results demonstrate that our method achieves unprecedentedly accurate estimates of surface nor- mals in the presence of signicant amount of shadows and specularities. The new technique can be used to improve virtually any photometric stereo method including uncalibrated photometric stereo.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Subspace recovery from noisy or even corrupted data is crit-ical for various applications in machine learning and data analysis. To detect outliers, Robust PCA (R-PCA) via Out-lier Pursuit was proposed and had found many successful ap-plications. However, the current theoretical analysis on Out-lier Pursuit only shows that it succeeds when the sparsity of the corruption matrix is of O(n/r), where n is the number of the samples and r is the rank of the intrinsic matrix which may be comparable to n. Moreover, the regularization param-eter is suggested as 3/(7 √ γn), where γ is a parameter that is not known a priori. In this paper, with incoherence condi-tion and proposed ambiguity condition we prove that Outlier Pursuit succeeds when the rank of the intrinsic matrix is of O(n/ log n) and the sparsity of the corruption matrix is of O(n). We further show that the orders of both bounds are tight. Thus R-PCA via Outlier Pursuit is able to recover in-trinsic matrix of higher rank and identify much denser cor-ruptions than what the existing results could predict. More-over, we suggest that the regularization parameter be chosen as 1/ √ log n, which is definite. Our analysis waives the ne-cessity of tuning the regularization parameter and also sig-nificantly extends the working range of the Outlier Pursuit. Experiments on synthetic and real data verify our theories.
    AAAI Conference on Artificial Intelligence 2015; 01/2015
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: In this paper we propose a new method to solve the problem of uncalibrated photometric stereo, making very weak assumptions on the properties of the scene to be reconstructed. Our goal is to solve the generalized bas-relief ambiguity (GBR) by performing a total variation regularization of both the estimated normal field and albedo. Unlike most of the previous attempts to solve this ambiguity, our approach does not rely on any prior information about the shape or the albedo, apart from its piecewise smoothness. We test our method on real images and obtain results comparable to the state-of-the-art algorithms.
    Scale Space and Variational Methods in Computer Vision, Schloss Seggau; 06/2013
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: While recent imaging techniques provide insights into biological processes from the molecular to the cellular scale, phenotypes at larger scales remain poorly amenable to quantitative analyses. For example, investigations of the biophysical mechanisms generating skin morphological complexity and diversity would greatly benefit from 3D geometry and colour-texture reconstructions. Here, we report on R2OBBIE-3D, an integrated system that combines a robotic arm, a high-resolution digital colour camera, an illumination basket of high-intensity light-emitting diodes and state-of-the-art 3D-reconstruction approaches. We demonstrate that R2OBBIE generates accurate 3D models of biological objects between 1 and 100 cm, makes multiview photometric stereo scanning possible in practical processing times, and enables the capture of colour-texture and geometric resolutions better than 15 μm without the use of magnifying lenses. R2OBBIE has the potential to greatly improve quantitative analyses of phenotypes in addition to providing multiple new applications in, e.g., biomedical science.
    PLoS ONE 01/2015; 10(6):e0126740. DOI:10.1371/journal.pone.0126740 · 3.53 Impact Factor