Maximum a Posteriori Video Super-Resolution Using a New Multichannel Image Prior

Faculty of Physics, Department of Electronics, Computers, Telecommunications and Control, National and Kapodistrian University of Athens, Panepistimiopolis, Zografos, 15784 Athens, Greece.
IEEE Transactions on Image Processing (Impact Factor: 3.63). 06/2010; 19(6):1451-64. DOI: 10.1109/TIP.2010.2042115
Source: PubMed


Super-resolution (SR) is the term used to define the process of estimating a high-resolution (HR) image or a set of HR images from a set of low-resolution (LR) observations. In this paper we propose a class of SR algorithms based on the maximum a posteriori (MAP) framework. These algorithms utilize a new multichannel image prior model, along with the state-of-the-art single channel image prior and observation models. A hierarchical (two-level) Gaussian nonstationary version of the multichannel prior is also defined and utilized within the same framework. Numerical experiments comparing the proposed algorithms among themselves and with other algorithms in the literature, demonstrate the advantages of the adopted multichannel approach.

Download full-text


Available from: Stefanos P. Belekos
  • Source
    • "However, they are ineffective under blurry and noisy cases. The second type (e.g., maximum a posteriori (MAP) [7], projection onto convex set (POCS) [8], etc.) relies on the accuracy of the required subpixel registration process, which is even more difficult in the superresolution setting. The type later known as single image superresolution is based on machine learning techniques, with the attempt to exceed some of the limitations mentioned above. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Currently superresolution from a motion blurred image still remains a challenging task. The conventional approach, which preprocesses the blurry low resolution (LR) image with a deblurring algorithm and employs a superresolution algorithm, has the following limitation. The high frequency texture of the image is unavoidably lost in the deblurring process and this loss restricts the performance of the subsequent superresolution process. This paper presents a novel technique that performs motion deblurring and superresolution jointly from one single blurry image. The basic idea is to regularize the ill-posed reconstruction problem using an edge-preserving gradient prior and a sparse kernel prior. This method derives from an inverse problem approach under an efficient optimization scheme that alternates between blur kernel estimation and superresolving until convergence. Furthermore, this paper proposes a simple and efficient refinement formulation to remove artifacts and render better deblurred high resolution (HR) images. The improvements brought by the proposed combined framework are demonstrated by the processing results of both simulated and real-life images. Quantitative and qualitative results on challenging examples show that the proposed method outperforms the existing state-of-the-art methods and effectively eliminates motion blur and artifacts in the superresolved image.
    Full-text · Article · Oct 2015 · Mathematical Problems in Engineering
  • Source
    • "Protter et al. had come up with a simple super resolution technique by applying denoising method called Nonlocal-Means algorithm (NLM) [11]. Other approaches to the SR problems include Maximum a posteriori (MAP) [12], iterative back-projection [13], POCS [2], [14], [15] and wavelet-based algorithm [16]. Meanwhile, learning-based SR algorithms work by extracting redundant high-frequency image information from training samples which contained known HR components. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Generating high-resolution images or videos have become an essential need for digital image processing and analysis especially in the forensic field. Compressed and at low resolution video frames of common security surveillance videos are found to be very low in clarity and degraded with many noises, distortions, blurs, bad illumination and video compression artifact. This could interfere during image interpretation and analysis process. Using super resolution methods, high resolution image is obtained from a set of low resolution images, after it had undergone two main processes; image registration process based on Keren algorithm and image reconstruction process based on Projection onto Convex Set (POCS) on frequency domain. The validation process of output is done by calculating the Mean Square Error (MSE) and Peak Signal to Noise Ratio (PSNR) value to show the comparison of image quality. The proposed combination methods were evaluated against other typical resampling methods and sparse representation method. The experimental results had shown that the sparse representation method has the highest PSNR mean value but our proposed combinatorial method is comparable to it as the difference of the mean is too small.
    Full-text · Article · Jun 2013
  • Source
    • "Iteration back projection (IBP) [3], [4] algorithms estimate the HR image by iteratively back projecting the error between simulated LR images and the observed ones. Maximum a posteriori (MAP) [5]–[7] approaches adopt the prior probability of target HR images to stabilize the solution space under a Bayesian framework. Projection on convex sets (POCS) [8], [9] tends to consider the solution as an element on a convex set defined by the input LR images. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Super-resolution technology provides an effective way to increase image resolution by incorporating additional information from successive input images or training samples. Various super-resolution algorithms have been proposed based on different assumptions, and their relative performances can differ in regions of different characteristics within a single image. Based on this observation, an adaptive algorithm is proposed in this paper to integrate a higher level image classification task and a lower level super-resolution process, in which we incorporate reconstruction-based super-resolution algorithms, single-image enhancement, and image/video classification into a single comprehensive framework. The target high-resolution image plane is divided into adaptive-sized blocks, and different suitable super-resolution algorithms are automatically selected for the blocks. Then, a deblocking process is applied to reduce block edge artifacts. A new benchmark is also utilized to measure the performance of super-resolution algorithms. Experimental results with real-life videos indicate encouraging improvements with our method.
    Full-text · Article · Apr 2012 · IEEE Transactions on Image Processing
Show more