No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
NAL-SIM: An Interactive Simulator for H.264/AVC Video Coding and Transmission
Abstract
In this paper we present a high-level graphical simulator for video coding and transmission using the H.264/AVC standard. The main objective of the developed simulator is to build an overall video communication system model including source encoding, channel modeling and decoding in order to interactively investigate the performance of various H.264/AVC coding schemes in the face of bandwidth constraints and channel errors. The developed simulator can be employed as a useful research or educational tool for video communication systems based on the H.264/AVC video coding standard.
Supplementary resource (1)
... For error hiding in P-frames, the spatio-temporal boundary-matching method [36] is used. Temporal information may be utilized to hide lost slices or missing MBs since a P-frame can be anticipated from either an I-or P-frame. ...
... To construct exact MB losses in both views, we used the same parameters, the CRF, fixed length slice, motion vector search method, etc., to encode both the left and right views of a stereoscopic video and then applied the same loss rate to both video streams. Since the videos were encoded in the NAL packet format, the exact numbers of NAL unit sequences and equal quantity of NAL units were discarded from both video streams using the H.264/AVC video stream analyzer [36,46], an approach that enabled the same MB error to be maintained in both views. After the simulated network loss, the videos were decoded and the same error concealment approach was applied to both distorted views. ...
Three-dimensional video services delivered through wireless communication channels have to deal with numerous challenges due to the limitations of both the transmission channel’s bandwidth and receiving devices. Adverse channel conditions, delays, or jitters can result in bit errors and packet losses, which can alter the appearance of stereoscopic 3D (S3D) video. Due to the perception of dissimilar patterns by the two human eyes, they can not be fused into a stable composite pattern in the brain and hence try to dominate by suppressing each other. Thus, a psychovisual sensation that is called binocular rivalry occurs. As a result, undetectable changes causing irritating flickering effects are seen, leading to visual discomforts such as eye strain, headache, nausea, and weariness. This study addresses the observer’s quality of experience (QoE) by analyzing the binocular rivalry impact on the macroblock (MB) losses in a frame and its error propagation due to predictive frame encoding in stereoscopic video transmission systems. To simulate the processing of experimental videos, the Joint Test Model (JM) reference software has been used as it is recommended by the International Telecommunication Union (ITU). Existing error concealing techniques were then applied to the contiguous lost MBs for a variety of transmission impairments. In order to validate the authenticity of the simulated packet loss environment, several objective evaluations were carried out. Standard numbers of subjects were then engaged in the subjective testing of common 3D video sequences. The results were then statistically examined using a standard Student’s t-test, allowing the impact of binocular rivalry to be compared to that of a non-rivalry error condition. The major goal is to assure error-free video communication by minimizing the negative impacts of binocular rivalry and boosting the ability to efficiently integrate 3D video material to improve viewers’ overall QoE.
... The similarity can be measured using the conventional PSNR. The evaluations are conducted on two kinds of MV fields: one generated by exhaustive search motion estimation (8×8 blocks), and the other by Rate-Distortion Optimized (RDO) H.264 motion estimation using the NAL-SIM simulator [32] (IPPP … GOP structure, at 512 kbps, with the smallest MV block size of 8×8). The MV field from H.264 RDO motion estimation is then normalized by block splitting to obtain a uniformly sampled MV field on 8×8 blocks. ...
In many content-based video processing systems, the presence of moving objects limits the accuracy of global motion estimation (GME). On the other hand, the inaccuracy of global motion parameter estimates affects the performance of motion segmentation. In this paper, we introduce a procedure for simultaneous object segmentation and GME from a coarsely sampled (i.e., block-based) motion vector (MV) field. The procedure starts with removing MV outliers from the MV field, and then performs GME to obtain an estimate of global motion parameters. Using these estimates, global motion is removed from the MV field, and moving region segmentation is performed on this compensated MV field. MVs in the moving regions are treated as outliers in the context of GME in the next round of processing. Iterating between GME and motion segmentation helps improve both GME and segmentation accuracy. Experimental results demonstrate the advantage of the proposed approach over state-of-the-art methods on both synthetic motion fields and MVs from real video sequences.
In video transmission over packet-based networks, packet losses often occur in bursts. In this paper, we present a novel packetization method for increasing the robustness of compressed video against bursty packet losses. The proposed method is based on creating a coding order of macroblocks (MBs) so that the blocks that are close to each other in the coding order end up being far from each other in the frame. We formulate this idea as a discrete optimization problem, prove its NP-hardness, and discuss several possible solution methods. Experimental results indicate that the proposed method improves the quality of reconstructed frames under burst loss by several decibels compared to conventional flexible MB ordering techniques, and about 0.7 dB compared to the state-of-the-art method called explicit chessboard wipe.
A model of a burst-noise binary channel uses a Markov chain with two states G and B. In state G, transmission is error-free. In state B, the channel has only probability h of transmitting a digit correctly. For suitably small values of the probabilities, p, P of the B rA B transitions, the model simulates burst-noise channels. Probability formulas relate the parameters p, P, h to easily measured statistics and provide run distributions for comparison with experimental measurements. The capacity C of the model channel exceeds the capacity C(sym. bin.) of a memoryless symmetric binary channel with the same error probability. However, the difference is slight for some values of h, p, P; then, time-division encoding schemes may be fairly efficient.
Error concealment is an effective approach to reduce the influence of errors that occur at the decoders. When error occurs, it may degrade the reconstructed pictures and lead to undesirable visual distortion. In this paper, we propose a novel temporal error concealment method for H.264 video streaming. A block-matching algorithm based on multi-side boundary matching (MSBM) principle, is presented to refine the concealed video. The proposed algorithm divides a corrupted macroblock (MB) into four 8times8 sub-blocks, and uses the information of the nearest rows and columns to reconstruct the MB. Experimental results show that the proposed algorithm yields more satisfying image quality than the relative algorithms presented in previous studies
H.264/AVC is newest video coding standard of the ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group. The main goals of the H.264/AVC standardization effort have been enhanced compression performance and provision of a "network-friendly" video representation addressing "conversational" (video telephony) and "nonconversational" (storage, broadcast, or streaming) applications. H.264/AVC has achieved a significant improvement in rate-distortion efficiency relative to existing standards. This article provides an overview of the technical features of H.264/AVC, describes profiles and applications for the standard, and outlines the history of the standardization process.
A unified approach to the coder control of video coding standards such as MPEG-2, H.263, MPEG-4, and the draft video coding standard H.264/AVC (advanced video coding) is presented. The performance of the various standards is compared by means of PSNR and subjective testing results. The results indicate that H.264/AVC compliant encoders typically achieve essentially the same reproduction quality as encoders that are compliant with the previous standards while typically requiring 60% or less of the bit rate.
A theoretical analysis of the overall mean squared error (MSE) in
hybrid video coding is presented for the case of error prone
transmission. Our model covers the complete transmission system
including the rate-distortion performance of the video encoder, forward
error correction, interleaving, and the effect of error concealment and
interframe error propagation at the video decoder. The channel model
used is a 2-state Markov model describing burst errors on the symbol
level. Reed-Solomon codes are used for forward error correction.
Extensive simulation results using an H.263 video codec are provided for
verification. Using the model, the optimal tradeoff between INTRA and
INTER coding as well as the optimal channel code rate can be determined
for given channel parameters by minimizing the expected MSE at the
decoder. The main focus of this paper is to show the accuracy of the
derived analytical model and its applicability to the analysis and
optimization of an entire video transmission system
A theoretical analysis of the overall mean squared error (MSE) in hybrid video coding is presented for the case of error prone transmission. Our model covers the complete transmission system including the rate{distortion performance of the video encoder, forward error correction, interleaving, and the eect of error concealment and interframe error propagation at the video decoder. The channel model used is a 2{state Markov model describing burst errors on the symbol level. Reed-Solomon codes are used for forward error correction. Extensive simulation results using an H.263 video codec are provided for verication. Using the model, the optimal trade{o between INTRA and INTER coding as well as the optimal channel code rate can be determined for given channel parameters by minimizing the expected MSE at the decoder. The main focus of this paper is to show the accuracy of the derived analytical model and its applicability to the analysis and optimization of an entire video tra...
Temporal error concealment algorithm using multi-side boundary matching principle This full text paper was peer reviewed at the direction of IEEE Communications Society subject matter experts for publication in the IEEE CCNC 2010 proceedings Authorized licensed use limited to
- C.-Y Su
- S.-H Huang
C.-Y. Su and S.-H. Huang, “Temporal error concealment algorithm using multi-side boundary matching principle,” Proc. IEEE Int. Symp. on Signal Processing and Information Technology (ISSPIT), pp.676-681, Vancouver, BC, Aug. 2006. This full text paper was peer reviewed at the direction of IEEE Communications Society subject matter experts for publication in the IEEE CCNC 2010 proceedings Authorized licensed use limited to: SIMON FRASER UNIVERSITY. Downloaded on March 25,2010 at 17:52:10 EDT from IEEE Xplore. Restrictions apply.