On the implementation of semantic content adaptation in the drama manufacturing process
ABSTRACT A multitude of platforms with widely varying capabilities is available today for the consumption of broadcasted audiovisual content. Each class of media consumption devices should receive a product not only adapted to its capabilities, but also in a manner that fully conveys the cinematic narrative and hence provides true universal media experiences. This paper presents semantic adaptation processes that integrate with other drama media manufacturing processes and allow directors and other creative staff to naturally carry over cinematic decision making into the content adaptation domain, thereby using narrative story elements already available from other production processes. We discuss how the adaptation process interacts with other processes and what parameters influence the adaptations applied to audiovisual material, followed by an evaluation of our current implementation.
- SourceAvailable from: uow.edu.au[show abstract] [hide abstract]
ABSTRACT: The previous decade has seen a variety of trends and developments in the area of communications and thus multimedia access. While individual, isolated developments produced small advances on the status quo, their combination and cross-fertilization resulted in today's complex but exciting landscape. In particular, we are beginning to see delivery of all types of data for all types of users in all types of conditions. This article discusses the current status of universal multimedia access (UMA) technologies and investigates future directions in this area. Key developments and trends from the last few years have set the scene for ubiquitous multimedia consumption. In summary, these are: wireless communications and mobility; standardized multimedia content; interactive versus passive consumption; and the Internet and the World Wide Web (WWW).IEEE Signal Processing Magazine 04/2003; · 3.37 Impact Factor
Article: Metadata-driven multimedia access[show abstract] [hide abstract]
ABSTRACT: With the growing ubiquity and mobility of multimedia-enabled devices, universal multimedia access (UMA) is emerging as one of the important components for the next generation of multimedia applications. The basic concept underlying UMA is universal or seamless access to multimedia content, by automatic selection and adaptation of content based on the user's environment. UMA promises an integration of these different perspectives into a new class of content adaptive applications that could allow users to access multimedia content without concern for specific coding formats, terminal capabilities, or network conditions. We discuss methods that support UMA and the tools provided by MPEG-7 to achieve this. We also discuss the inclusion of metadata in JPEG 2000 encoded images. We present these methods in the typical order that they may be used in an actual application. Therefore, we first discuss the (personalized) selection of desired content from all available content, followed by the organization of related variations of a single piece of content. Then, we discuss segmentation and summarization of audio video (AV) content, and finally, transcoding of AV content.IEEE Signal Processing Magazine 04/2003; · 3.37 Impact Factor
- [show abstract] [hide abstract]
ABSTRACT: We present an encoding framework which exploits semantics for video content delivery. The video content is organized based on the idea of main content message. In the work reported in this paper, the main content message is extracted from the video data through semantic video analysis, an application-dependent process that separates relevant information from non relevant information. We use here semantic analysis and the corresponding content annotation under a new perspective: the results of the analysis are exploited for object-based encoders, such as MPEG-4, as well as for frame-based encoders, such as MPEG-1. Moreover, the use of MPEG-7 content descriptors in conjunction with the video is used for improving content visualization for narrow channels and devices with limited capabilities. Finally, we analyze and evaluate the impact of semantic video analysis in video encoding and show that the use of semantic video analysis prior to encoding sensibly reduces the bandwidth requirements compared to traditional encoders not only for an object-based encoder but also for a frame-based encoder.IEEE Transactions on Circuits and Systems for Video Technology 11/2005; · 1.82 Impact Factor