Multiframe-based bilateral motion estimation with emphasis on stationary caption processing for frame rate up-conversion

Div. of Electr. & Comput. Eng., Pohang Univ. of Sci. & Technol., Pohang
IEEE Transactions on Consumer Electronics (Impact Factor: 1.09). 12/2008; DOI: 10.1109/TCE.2008.4711242
Source: IEEE Xplore

ABSTRACT In this paper, we present a new motion compensated frame rate up-conversion algorithm that uses multiframes to enhance the accuracy of motion estimation. We also develop adaptive motion vector smoothing to correct outliers in a motion vector field. In addition, stationary caption processing is carried out for removing block artifacts from stationary captions. Finally, we propose adaptive-weighted bidirectional motion compensated interpolation to reduce object blurring. In experiments using benchmark test sequences, the proposed algorithm improves the average PSNR of interpolated frames by up to 5.34 dB compared to the conventional algorithm.

1 Bookmark
  • [Show abstract] [Hide abstract]
    ABSTRACT: This paper proposes a new motion-compensated frame interpolation (MCFI) method. The performance of MCFI is highly dependent on the accuracy of the estimated motion vectors (MVs). The proposed iterative motion estimation (ME) method estimates reliable MVs using linearity checking and restricted search areas. An adaptive interpolation method is also proposed to obtain MVs for blocks that do not have reliable MVs in the iterative ME process. The experimental results show that the proposed method outperforms the conventional MCFI methods in terms of the quality of the interpolated frames. Furthermore, the MVs from the proposed method are more accurate than those from the conventional methods.
    IEEE Transactions on Circuits and Systems for Video Technology 01/2013; 23(3):445-454. · 1.82 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: In this paper, we present a new subpixel rendering algorithm considering adaptively weighting factors of the current and neighboring subpixels for matrix displays. The proposed method divides gray levels into several bins computing the absolute color difference between the current subpixel and neighboring subpixels. Then, it adaptively assigns weighting factors to the current and neighboring subpixels. In the experiments using test images, the proposed subpixel rendering algorithm improved the average luminance sharpness by up to 0.124, when compared to benchmarks methods. For the chrominance blending, the average peak signal-to-noise ratio (PSNR) of the proposed method was up to 1.415 dB higher than those of the benchmarks methods.
    Journal of Display Technology 01/2013; 9(8):632-637. · 1.66 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: In this paper, we propose a new motion estimation algorithm to be used for motion-compensated frame rate up-conversion. The proposed algorithm independently carries out motion estimations in both forward and backward directions, and selects a more reliable one between forward and backward motion vectors by evaluating the motion vector reliability from the viewpoint of the interpolated frame. The proposed algorithm smooths and refines both the forward and backward motion vectors before selecting the reliable one. This procedure helps to select the reasonable motion estimation direction. In identifying the motion vector outliers, the proposed algorithm uses a circular range of which center is located at the mean of the eight neighboring motion vectors of the motion vector being processed. Experimental results using 1720 test images show that the proposed motion estimation algorithm improves the average peak signal-to-noise ratio and the average structural similarity of the interpolated frames by up to 5.31 dB and 0.053, respectively, compared to conventional motion estimation algorithms.
    Journal of Display Technology 01/2013; 9(10):840-850. · 1.66 Impact Factor