Smooth Control of Adaptive Media Playout for Video Streaming

Grad. Inst. of Commun. Eng., Nat. Taiwan Univ., Taipei, Taiwan
IEEE Transactions on Multimedia (Impact Factor: 1.75). 12/2009; DOI: 10.1109/TMM.2009.2030543
Source: IEEE Xplore

ABSTRACT Client-side data buffering is a common technique to deal with media playout interruptions of streaming video caused by network jitters and packet losses of best-effort networks. However, stronger playout interruption protection inevitably amounts to larger data buffering and results in more memory requirements and longer playout delay. Adaptive media playout (AMP), also a client-side technique, can reduce the buffer requirement and avoid buffer outage but at the expense of visual quality degradation because of the fluctuation of playout speed. In this paper, we propose a novel AMP scheme to keep the video playout as smooth as possible while adapting to the channel condition. The triggering of the playout control is based on buffer variation rather than buffer fullness. Experimental results show that our AMP scheme surpasses conventional schemes in unfriendly network conditions. Unlike previous schemes that are tuned for a specific range of packet loss and network instability, the proposed AMP scheme maintains consistent performance across a wide range of network conditions.

  • [Show abstract] [Hide abstract]
    ABSTRACT: This paper aims to reduce the amount of prebuffering required to ensure a maximum video continuity in streaming. Current approaches do this by slowing the playout frame rate of the decoder, this is known as adaptive media playout (AMP). However, doing this introduces playout distortion to the viewers as the video is played slower than its natural playout rate. We approach this by proposing a frame rate control scheme that jointly adjusts the encoder frame generation rate of the encoder and the playout frame rate of the decoder. In addition to using AMP to improve video continuity, we also allow the encoder to increase the encoder frame generation rate. This means the encoder will be sending more frames to the decoder to quickly increase the number of frames available at the playback buffer, thus lowering the chance of buffer underflow which causes discontinuity in video playback. At the same time, the increase in the number of frames at the playback buffer may mean that the decoder does not need to use AMP to delay the playback, thus lowering the playback distortion. However, the increase in encoder frame generation rate comes at a price because frame quality will need to decrease in order to meet the constraint on available network bandwidth. This implies that the scheme needs to find the optimal trade-off between frame quality, playout distortion and video continuity. To do that, we characterize the frame rate control problem using Lyapunov optimization. We then systematically derive the optimization policies. We also show that these policies can be decoupled into separate encoder and decoder optimization policies, thus allowing for a distributed implementation. Simulation results show significant reductions in the prebuffering requirements over a scheme that perform no frame rate control and lower playout distortions compared to the AMP schemes, while exhibiting a modest drop in frame quality.
    Computer Networks. 02/2013; 57(3):609–621.
  • [Show abstract] [Hide abstract]
    ABSTRACT: Synchronizing multimedia playback among geographically distributed clients is a challenging task and is referred to as Inter-Destination Media Synchronization (IDMS). In this paper we discuss the uses cases of IDMS as identified within the SocialSensor Project and based on these use cases we derive a novel Adaptive Media Playout (AMP) scheme which aims on carrying out the process of synchronizing the media playback at the clients to a given synchronization point. We propose how visual and acoustic features can be used to achieve a QoE-aware and context-aware AMP scheme.
    Quality of Multimedia Experience (QoMEX), 2013 Fifth International Workshop on; 01/2013
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: To improve the playout quality of video streaming services, several adaptive media playout (AMP) mechanisms were proposed in literature. However, all performance evaluations and comparisons for AMPs were made in terms of quality of service (QoS) metrics. As one knows, there may exist a trade-off between QoS metrics, such as buffer underflow and overflow performance. Thus, it is not sufficient to only evaluate the performance of AMPs in terms of QoS metrics. In this paper, we will evaluate and compare the performance of several AMPs from the aspect of quality of experience (QoE). Numerical results will show that some existing AMP systems do not perform better than the nonadaptive playout system from the point of view of overall QoE.
    Advances in Multimedia 02/2013; 2013.

Full-text (2 Sources)

Available from