Error Resilient Coding and Error Concealment in Scalable Video Coding

Dept. of Electron. Eng. & Inf. Sci., Univ. of Sci. & Technol. of China, Hefei
IEEE Transactions on Circuits and Systems for Video Technology (Impact Factor: 2.62). 07/2009; 19(6):781 - 795. DOI: 10.1109/TCSVT.2009.2017311
Source: DBLP


Scalable video coding (SVC), which is the scalable extension of the H.264/AVC standard, was developed by the Joint Video Team (JVT) of ISO/IEC MPEG (Moving Picture Experts Group) and ITU-T VCEG (Video Coding Experts Group). SVC is designed to provide adaptation capability for heterogeneous network structures and different receiving devices with the help of temporal, spatial, and quality scalabilities. It is challenging to achieve graceful quality degradation in an error-prone environment, since channel errors can drastically deteriorate the quality of the video. Error resilient coding and error concealment techniques have been introduced into SVC to reduce the quality degradation impact of transmission errors. Some of the techniques are inherited from or applicable also to H.264/AVC, while some of them take advantage of the SVC coding structure and coding tools. In this paper, the error resilient coding and error concealment tools in SVC are first reviewed. Then, several important tools such as loss-aware rate-distortion optimized macroblock mode decision algorithm and error concealment methods in SVC are discussed and experimental results are provided to show the benefits from them. The results demonstrate that PSNR gains can be achieved for the conventional inter prediction (IPPP) coding structure or the hierarchical bi-predictive (B) picture coding structure with large group of pictures size, for all the tested sequences and under various combinations of packet loss rates, compared with the basic joint scalable video model (JSVM) design applying no error resilient tools at the encoder and only picture copy error concealment method at the decoder.

Download full-text


Available from: Moncef Gabbouj
  • Source
    • "Popular class of solutions relies on the so-called error-concealment/ error-resilient techniques. Numerous error resilient techniques have been investigated [46]–[49], such as intra-MB refreshing, motion vector recovery, frame-copy, distributed source coding etc. Generally, these techniques aim for reducing the channeleffects imposed on the received video is, thereby improving the reconstructed video quality. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Layered video coding creates multiple layers of unequal importance, which enables us to progressively refine the reconstructed video quality. When the base layer (BL) is corrupted or lost during transmission, the enhancement layers (ELs) must be dropped, regardless whether they are perfectly decoded or not, which implies that the transmission power assigned to the ELs is wasted. For the sake of combating this problem, the class of inter-layer forward error correction (IL-FEC) solutions, also referred to as layer-aware FEC (LA-FEC),1has been proposed for layered video transmissions, which jointly encode the BL and the ELs, thereby protecting the BL using the ELs. This tutorial aims for inspiring further research on IL-FEC/LA-FEC techniques, with special emphasis on the family of soft-decoded bit-level IL- FEC schemes.
    Full-text · Article · Apr 2015 · IEEE Communications Surveys & Tutorials
  • Source
    • "Estimating EED at the encoder is central to optimize its decisions. The recursive optimal per-pixel estimate (ROPE) [6] is an optimal EED estimation method that recursively calculates the first and second moments of reconstructed pixels via update equations that explicitly account for the prediction modes, concealment methods, channel uncertainties, etc. ROPE and its variants have been successfully incorporated in standard SVC coders, e.g., [7]-[10], and significantly improved the coding performance. "
    [Show abstract] [Hide abstract]
    ABSTRACT: A novel scalable video coding (SVC) scheme is proposed for video transmission over loss networks, which builds on an estimation-theoretic (ET) framework for optimal prediction and error concealment, given all available information from both the current base layer and prior enhancement layer frames. It incorporates a recursive end-to-end distortion estimation technique, namely, the spectral coefficient-wise optimal recursive estimate (SCORE), which accounts for all ET operations and tracks the first and second moments of decoder reconstructed transform coefficients. The overall framework enables optimization of ET-SVC systems for transmission over lossy networks, while accounting for all relevant conditions including the effects of quantization, channel loss, concealment, and error propagation. It thus resolves longstanding difficulties in combining truly optimal prediction and concealment with optimal end-to-end distortion and error-resilient SVC coding decisions. Experiments demonstrate that the proposed scheme offers substantial performance gains over existing error-resilient SVC systems, under a wide range of packet loss and bit rates.
    Preview · Conference Paper · Jan 2012
  • Source
    • "Currently, most of the study in H.264/SVC video quality and error concealment such as in [13] is based on error patterns. This scheme can define a specified loss rate in the bitstream and it is very useful and efficient for the error resilient study. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Multi-Path OLSR is an extension of the single path routing protocol OLSR. The QoS has been demonstrated in simulation and testbed. In this paper, we attempt to confirm those results at the application layer specially for critical applications as video services over wireless networks. The standard H264/SVC is chosen for its enormous potential in video delivery in lossy networks. Still vulnerable to packet losses, we combine the scalable source coding to an Unequal Error Protection (UEP) scheme in order to improve a simple Quality of Experience (QoE) measurements i.e PSNR. In a new simulation framework called SVCEval, the combination of path diversity and scalable protection insures a significant 2 dB gain in QoE for sensitive contents and mobile scenarios in comparison with just MP-OLSR. Within the same context, single path strategy delivers non acceptable video services as soon as nodes are mobile.
    Full-text · Conference Paper · Oct 2011
Show more