Conference Paper

Learning-based video super-resolution reconstruction using particle swarm optimization.

DOI: 10.1109/MMSP.2011.6093780 Conference: IEEE 13th International Workshop on Multimedia Signal Processing (MMSP 2011), Hangzhou, China, October 17-19, 2011
Source: DBLP

ABSTRACT In this study, a learning-based video super-resolution (SR) reconstruction approach using particle swarm optimization (PSO) is proposed. First, a 5×5×5 motion-compensated volume containing five 5×5 motion-compensated patches is extracted and the orientation of the volume is determined for each pixel in the “central” reference low-resolution (LR) video frame. Then, the pixel values of the “central” reference high-resolution (HR) video frame are reconstructed by using the corresponding SR reconstruction filtering masks, based on the orientation of the volume and the coordinates of the pixels to be reconstructed. To simplify the PSO learning processes for determining the weights in SR reconstruction filtering masks, simple mask flippings are employed. Based on the experimental results obtained in this study, the SR reconstruction results of the proposed approach are better than those of three comparison approaches, whereas the computational complexity of the proposed approach is higher than those of two “simple” comparison approaches, NN and Bicubic, and lower than that of the recent comparison approach, modified NLM.

0 Bookmarks
 · 
55 Views
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: A new approach toward increasing spatial resolution is required to overcome the limitations of the sensors and optics manufacturing technology. One promising approach is to use signal processing techniques to obtain an high-resolution (HR) image (or sequence) from observed multiple low-resolution (LR) images. Such a resolution enhancement approach has been one of the most active research areas, and it is called super resolution (SR) (or HR) image reconstruction or simply resolution enhancement. In this article, we use the term "SR image reconstruction" to refer to a signal processing approach toward resolution enhancement because the term "super" in "super resolution" represents very well the characteristics of the technique overcoming the inherent resolution limitation of LR imaging systems. The major advantage of the signal processing approach is that it may cost less and the existing LR imaging systems can be still utilized. The SR image reconstruction is proved to be useful in many practical cases where multiple frames of the same scene can be obtained, including medical imaging, satellite imaging, and video applications. The goal of this article is to introduce the concept of SR algorithms to readers who are unfamiliar with this area and to provide a review for experts. To this purpose, we present the technical review of various existing SR methodologies which are often employed. Before presenting the review of existing SR algorithms, we first model the LR image acquisition process.
    IEEE Signal Processing Magazine 06/2003; · 3.37 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Super-resolution reconstruction proposes a fusion of several low-quality images into one higher quality result with better optical resolution. Classic super-resolution techniques strongly rely on the availability of accurate motion estimation for this fusion task. When the motion is estimated inaccurately, as often happens for nonglobal motion fields, annoying artifacts appear in the super-resolved outcome. Encouraged by recent developments on the video denoising problem, where state-of-the-art algorithms are formed with no explicit motion estimation, we seek a super-resolution algorithm of similar nature that will allow processing sequences with general motion patterns. In this paper, we base our solution on the Nonlocal-Means (NLM) algorithm. We show how this denoising method is generalized to become a relatively simple super-resolution algorithm with no explicit motion estimation. Results on several test movies show that the proposed method is very successful in providing super-resolution on general sequences.
    IEEE Transactions on Image Processing 02/2009; 18(1):36-51. · 3.20 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The optimization of nonlinear functions using particle swarm methodology is described. Implementations of two paradigms are discussed and compared, including a recently developed locally oriented paradigm. Benchmark testing of both paradigms is described, and applications, including neural network training and robot task learning, are proposed. Relationships between particle swarm optimization and both artificial life and evolutionary computation are reviewed
    Micro Machine and Human Science, 1995. MHS '95., Proceedings of the Sixth International Symposium on; 11/1995