Parametric Image Alignment Using Enhanced Correlation Coefficient Maximization

Signal Processing and Communications Lab, Department of Computer Engineering and Informatics, University of Patras, Rio-Patras, Greece.
IEEE Transactions on Pattern Analysis and Machine Intelligence (Impact Factor: 5.78). 11/2008; 30(10):1858-65. DOI: 10.1109/TPAMI.2008.113
Source: PubMed


In this work we propose the use of a modified version of the correlation coefficient as a performance criterion for the image alignment problem. The proposed modification has the desirable characteristic of being invariant with respect to photometric distortions. Since the resulting similarity measure is a nonlinear function of the warp parameters, we develop two iterative schemes for its maximization, one based on the forward additive approach and the second on the inverse compositional method. As it is customary in iterative optimization, in each iteration, the nonlinear objective function is approximated by an alternative expression for which the corresponding optimization is simple. In our case we propose an efficient approximation that leads to a closed-form solution (per iteration) which is of low computational complexity, the latter property being particularly strong in our inverse version. The proposed schemes are tested against the Forward Additive Lucas-Kanade and the Simultaneous Inverse Compositional (SIC) algorithm through simulations. Under noisy conditions and photometric distortions, our forward version achieves more accurate alignments and exhibits faster convergence whereas our inverse version has similar performance as the SIC algorithm but at a lower computational complexity.

Download full-text


Available from: Emmanouil Psarakis
  • Source
    • "Therefore, this measure is suitable for comparing images that are captured under different lighting conditions. The correlation coefficient [16] is written as: "
    [Show abstract] [Hide abstract]
    ABSTRACT: This paper proposes a new unsupervised satellite change detection method, which is robust to illumination changes. To achieve this, firstly, a preprocessing strategy is used to remove illumination artifacts and results in less false detection than traditional threshold-based algorithms. Then, we use the corrected input data to define a new fitness function based on the difference image. The purpose of using Self-Adaptive Hybrid Particle Swarm Optimization-Genetic Algorithm (SAPSOGA) is to combine two meta-heuristic optimization algorithms to search and find the feasible solution in the NP-hard change detection problem rapidly and efficiently. The hybrid algorithm is employed by letting the GA and PSO run simultaneously and similarities of GA and PSO have been considered to implement the algorithm, i.e. the population. In the SAPSOGA employed, in each iteration/generation the two population based algorithms share different amount of information or individual(s) between themselves. Thus, each algorithm informs each other about their best optimum results (fitness values and solution representations) which are obtained in their own population. The fitness function is minimized by using binary based SAPSOGA approach to produce binary change detection masks in each iteration to obtain the optimal change detection mask between two multi temporal multi spectral landsat images. The proposed approach effectively optimizes the change detection problem and finds the final change detection mask.
    Full-text · Conference Paper · Jul 2016
  • Source
    • "Applications have already covered many fields of interesting: image mosaicking [1] [2], super-resolution reconstruction [3] [4], motion estimation of a moving planar object [5], shape matching [6] [7] [8] [9] and camera calibration [10] [11] [12]. Basically there are two classical approaches: one of them is called pixel-based approach [13] [14] [15], which consist in establishing error metrics of appearance similarity, e. g. sum of squared differences and cross correlation. And then the transformation parameters are obtained by minimizing the objective function which makes optimal use of every pixel's contribution. "
    [Show abstract] [Hide abstract]
    ABSTRACT: This paper proposes a homograhpy estimation algorithm that uses contour model to track and locate the texture-less object in high clutter environments. The proposed method consists of a homography recognition with the correspondences between model and image lines unknown, followed by a nonlinear homography optimization based on the maximum likelihood criterion. In our approach, the initial estimation of the homography is obtained in the framework of RANSAC-like, which contains two stages: hypothesizing and verifying. The first stage generates a number of homograhpy hypotheses from the correspondences of the quadrangle-like structures. Next, the homography hypotheses are quickly ranked according to a redefined distance function. In the refinement procedure, the model sample points are projected into the image plane. After that, 1D search is utilized along the normal direction to obtain the corresponding image point for each model sample point. Finally, the optimized homography is obtained by minimizing the errors between the sample points and their corresponding image points. Experiments show that the proposed method performs robust homography recognition of texture-less planar objects and maintains accurate and stable homography estimation in the cluttered environments as well as the cases of extreme slant angles.
    Full-text · Article · Jan 2016 · Pattern Recognition
  • Source
    • "The camera system employs an iterative image alignment algorithm that compares the intensity profiles in both images to calculate the amount of transformation required to align them (Evangelidis & Psarakis 2008). As the alignment between cameras does not change, the amount of transformation (termed the transformation matrix) is calculated a priori and only the affine transform is only applied during operation, to save computation time. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Short-term cloud forecast systems detect clouds and track their movement by acquiring and processing digital colour images of the sky. The high intensity of solar irradiance can induce glare in images containing the solar disk. This paper proposes an approach using two inexpensive surveillance IP cameras fitted with neutral density filters to reduce solar glare. The cameras operate concurrently and capture 1600x1200 pixel images synchronously at 5 second intervals. Camera images are combined with a tone mapping algorithm into an image that exhibits a 40% reduction of the glare radius in the vicinity of the solar disk, and preserves the contrast of cloud and clear sky in the image. All image processing steps are implemented on a desktop computer with OpenCV 3.0, a comprehensive open source C++/Python image processing suite. This paper provides the design and implementation details of the sky imager system and the proposed glare reduction technique.
    Full-text · Conference Paper · Dec 2015
Show more