No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Frame-accuracy synchronisation for mobile TV interactivity
Abstract
Interactive applications for mobile TV are usually related to the audiovisual content, but not very precisely. In some applications, like object-based interactivity, where the user can retrieve rich media information associated to moving objects with just the direct interactivity by the touch screen of the mobile device, frame-based precision is required. As DVB-H transmits audiovisual content in MPEG-4 formats, the natural choice for adding rich content seems to be LASeR (MPEG-4 part 20) scene description. In this paper we present a mechanism to achieve frame-accuracy synchronisation between audio, video and LASeR streams. We also introduce its inclusion to an end-to-end system that implements the whole chain of creation, transmission and reception of interactive applications for mobile devices.
... Here aspects of synchronization, devices, sources, and contents are presented as they were extracted from papers. The contributions of the surveyed papers are applications: the paper focus on the description of a specific multimedia application18192021222324252627282930 ; architecture: the paper proposes an architecture to solve synchronization problems but does not present programming interfaces or formalization313233343536373839; framework: the paper presents a framework [40] that developers may use to provide synchronization to their multimedia applications414243444546474849; language: the paper presents the description of a programming language that may be used to develop applications [17]; model: the paper presents the modeling of an approach that in theory may be used to bring synchronization to the applications50515253545556; platform/middleware: a platform which provides synchronization functionalities is presented. Also modifications to existing platforms are considered in this category [10, 57– 69]; protocol: the paper defines rules and conventions for communication among devices so they may keep synchro- nization7071727374; tool: the paper presents a tool with specific functionalities that once executed will provide synchronized contents75767778798081828384. ...
... The channel used depends on the demand of the extra content: if the demand is huge it uses the broadcasting, if not it uses the interactive channel. Margalef et al. [47] proposes an interactive platform for DVB-H that sends interactive content through interactive channel and receives main content through broadcasting. 3.2.2.3. ...
... The synchronization is performed using the client devices and information available at his side. A third alternative is to presynchronize the contents on server and then resynchronize then on the client [39, 45, 47, 51, 63, 64,676869. In this case there is a synchronization of contents both on server and client side. ...
Context. Interactive TV has not reached yet its full potential. How to make the use of interactivity in television content viable and attractive is something in evolution that can be seen with the popularization of new approaches as the use of second screen as interactive platform. Objective. This study aims at surveying existing research on Multiple Contents TV Synchronization in order to synthesize their results, classify works with common points, and identify needs for future research. Method. This paper reports the results of a systematic literature review and mapping study on TV Multiple Contents Synchronization published until middle 2013. As result, a set of 68 papers was generated and analyzed considering general information such as sources and time of publication; covered research topics; and synchronization aspects such as methods, channels, and precision. Results. Based on the obtained data, the paper provides a high level overview of the analyzed works; a detailed exploration of each used and proposed technique and its applications; and a discussion and proposal of a scenario overview and classification scheme based on the extracted data.
The porTiVity project is developing a converged rich media iTV system, which integrates broadcast and mobile broadband delivery
to portables and mobiles and which will enable the end-user to act on moving objects within TV programmes. The developments
of the project include the playout of portable rich media iTV and the middleware, data and presentation engine in the handheld
receiver. In this demonstration, we will present, on the production side, the Live Annotation Tool which allows the video
editor to define and include active objects in Live TV Programs, and on the user side, the interaction with active objects
on a mobile terminal.
GPAC is a multimedia framework for research and academic purposes in different aspects of multimedia, with a focus on presentation technologies (graphics, animation and interactivity). The project started in 2003 with the initial goal to develop from scratch, in ANSI C, clean software compliant to the MPEG-4 Systems standard, a small and flexible alternative to the MPEG-4 reference software. Since then, the project has evolved into an advanced multimedia player, a multimedia packager and several servers. The project is intended to a wide audience ranging from end-users or content creators with development skills who want to experiment the new standards for interactive technologies or want to convert files for mobile devices, to developers who need players and/or server for multimedia streaming applications.
In this demonstration, we present the Annotation Tool that is being developed in the porTiVity project to annotate video objects for Interactive Television programs. This tool includes various video processing components to structure and speed-up the annotation process, such as shot segmentation, key-frame extraction, object tracking and object redetection. A specific feature is that the tool includes a preprocessing phase where a quantity of information is precomputed, so that the annotation itself can be done quite rapidly.
The porTiVity project will realise direct interactivity with moving objects on handheld receivers, which are connected to DVB-H or DMB as the mobile broadcast channel and to UMTS as the mobile communication channel. porTiVity will develop tools which enable producers to link Rich Media information with objects in the TV-program. The project will further develop the playout for portable Rich Media iTV and the middleware, data and presentation engine in the handheld receiver. For the application layer, the project will make use of international standards such as MPEG-4 A/V, MPEG-7 Metadata, MPEG-21 DIA and MHP. On the distribution side, the open standard MXF is used as material exchange format.
Electronic Service Guide (ESG), ETSI Std
- Ip
- Dvb-H Datacast
IP Datacast over DVB-H: Electronic Service Guide (ESG), ETSI Std. TS 102 471, 2006.
Set of Specifications for Phase 1, ETSI Std
- Ip
- Dvb-H Datacast
IP Datacast over DVB-H: Set of Specifications for Phase 1, ETSI Std. TS 102 468, 2007.
portivity: Object based interactive mobile tv system
- J Deigmöller
- G Fernàndez
- A López
- B Mérialdo
- H Neuschmied
- F Pinyol
- R Trichet
- P Wolf
- R Salgado
- F Milagaia
- S Glaser
- A Duffy