Lyndon Nixon

MODUL University Vienna · New Media Technology

Destination marketers are aware that online communication about their destination is increasingly dependent on visual media rather than text, due to the growing popularity of social networks such as Instagram. An accurate understanding of how the destination is being presented to users in this medium is critical for digital marketing activities, e....

This survey considers the vision of TV broadcasting where content is personalised and personalisation is data-driven, looks at the AI and data technologies making this possible and surveys the current uptake and usage of those technologies. We examine the current state-of-the-art in standards and best practices for data-driven technologies and iden...

As global travel emerges from the pandemic, pent up interest in travel will lead to consumers making their choice between global destinations. Instagram is a key source of destination inspiration. DMO marketing success on this channel relies on projecting a destination image that resonates with this target group. However, usual text-based marketing...

Sentic computing relies on well-defined affective models of different complexity—polarity to distinguish positive and negative sentiment, for example, or more nuanced models to capture expressions of human emotions. When used to measure communication success, even the most granular affective model combined with sophisticated machine learning approa...

Sentic computing relies on well-defined affective models of different complexity - polarity to distinguish positive and negative sentiment, for example, or more nuanced models to capture expressions of human emotions. When used to measure communication success, even the most granular affective model combined with sophisticated machine learning appr...

Digital publication platforms and social media have opened possibilities for cultural heritage institutions to share their content online, in particular favouring audiovisual content. To better valorise large-scale digital collections and increase their visibility and societal impact in this digital landscape, archives and libraries need to find op...

In contemporary TV audience prediction, outliers are considered mere anomalies in the otherwise cyclical trend and seasonality components that can be used to make predictions. In the ReTV project, we want to provide more accurate audience predictions in order to enable innovative services for TV content recommendation. This paper presents a concept...

By automatically adapting TV content for publication on secondary channels, we aim to increase user engagement and at the same time reduce the manual effort for broadcasters. We present a system architecture for automatic content adaptation and two distinct use cases built on top of it.

Technological developments in comprehensive video understanding - detecting and identifying visual elements of a scene, combined with audio understanding (music, speech), as well as aligned with textual information such as captions, subtitles, etc. and background knowledge - have been undergoing a significant revolution during recent years. The wor...

The InVID Multimodal Analytics Dashboard is a visual content exploration and retrieval system to analyze user-generated video content from social media platforms including YouTube, Twitter, Facebook, Reddit, Vimeo, and Dailymotion. It uses automated knowledge extraction methods to analyze each of the collected postings and stores the extracted meta...

This chapter introduces two key tools for journalists. Before being able to initiate the process of verification of an online video, they need to be able to determine the news story that is the subject of online video, and they need to be able to find candidate online videos around that story. To do this, we have assessed prior research in the area...

This paper describes the combination of advanced technologies for social-media-based story detection, story-based video retrieval and concept-based video (fragment) labeling under a novel approach for multimodal video annotation. This approach involves textual metadata, structural information and visual concepts - and a multimodal analytics dashboa...

This book presents the latest technological advances and practical tools for discovering, verifying and visualizing social media video content, and managing related rights. The digital media revolution is bringing breaking news to online video platforms, and news organizations often rely on user-generated recordings of new and developing events sha...

The news media landscape tends to focus on long-running narratives. Correctly processing new information, therefore, requires considering multiple lenses when analyzing media content. Traditionally it would have been considered sufficient to extract the topics or entities contained in a text in order to classify it, but today it is important to als...

This paper presents an approach to automatically detecting breaking news events from social media streams, using event detection to collect in near real time relevant video documents from social networks regarding that breaking news. A visual analytics dashboard provides access to the results of the content processing pipeline, providing a rich int...

This paper gives an overview of the First International Workshop on Multimedia Verification, organized as part of the 2017 ACM Multimedia Conference. The paper outlines the current verification scene and needs, discusses the goals of the workshop, and presents the workshop's program, consisting of two invited keynote talks and three presentations o...

In this paper we show how the performance of tweet clustering can be improved by leveraging character-based neural networks. The proposed approach overcomes the limitations related to the vocabulary explosion in the word-based models and allows for the seamless processing of the multilingual content. Our evaluation results and code are available on...

Destination promotion videos (DPVs) are increasingly being used for online marketing and seen by travellers during the information search process. Yet, scholarly attention to DPVs is scarce and the research question of “how do DPVs influence viewers’ destination image change?” is unresolved. To fill these voids, this study (1) examines the projecte...

This paper presents a German corpus for Named Entity Linking (NEL) and Knowledge Base Population (KBP) tasks. We describe the annotation guideline, the annotation process, NIL clustering techniques and conversion to popular NEL formats such as NIF and TAC that have been used to construct this corpus based on news transcripts from the German regiona...

This paper presents a German corpus for Named Entity Linking (NEL) and Knowledge Base Population (KBP) tasks. We describe the annotation guideline, the annotation process, NIL clustering techniques and conversion to popular NEL formats such as NIF and TAC that have been used to construct this corpus based on news transcripts from the German regiona...

While parallel Internet usage to explore additional information while watching TV is on the rise, TV content owners face excessive costs and technological challenges to provide eased access to that information alongside their own content. Since viewers do not have access to the same background metadata as the content owner, they are often frustrate...

This short/demo paper describes LinkedCulture, a Web based application which complements the viewing of a well known Dutch cultural heritage TV program with the ability of viewers to explore art objects from Europeana related to those in the program.

The rise of new paradigms in the field of television and digital media distribution (e.g. Smart TV, IPTV, Social TV) has opened a new digital world of data communication opportunities but at the same time exacerbated the information overload problem for media consumers and providers. Therefore, the need for personalized content delivery has extende...

In this demo, we present the VideoLecturesMashup, which delivers re-mixes of learning materials from the VideoLectures.NET portal based on shared topics across different lectures. Learners need more efficient access to teaching on specific topics which could be part of a larger lecture (focused on a different topic) and occur across lectures from d...

Semantic annotation of media resources has been a focus in research since many years, the closing of the “semantic gap” being seen as key to significant improvements in media retrieval and browsing and enabling new media applications and services. However, current tools and services exhibit varied approaches which do not easily integrate and act as...

Increasingly, European citizens consume television content together with devices connected to the Internet where they can look up related information. In parallel, growing amounts of Linked Open Data are being published on the Web, including rich metadata about its cultural heritage. Linked Data and semantic technologies could enable broadcasters t...

We investigate a method of crowdsourced task routing based on matrix factorization. From a preliminary analysis of a real crowdsourced data, we begin an exploration of how to route crowdsourcing task via Matrix factorization (MF) which efficiently estimate ...

This paper reports on the vision of LinkedTV driven by the EU project of the same name, and the work done in its first year. LinkedTV is a new type of television (or audio-visual) experience where Web and TV content can be seamlessly interlinked based on the concepts present within that content. The project addresses how the Web and TV is convergin...

This paper describes a full day workshop taking place at the 11th European Interactive TV conference (EuroITV 2013), Como, Italy, on June 24th, 2013, in conjunction with the workshop on Multi-User Services for Social TV, MUSST.

Make It So (Rosenfeld Media, 2012) explores the speculative interfaces seen in science fiction movies and television shows. The authors have developed a model that traces lines of influence between these sci-fi examples and design in the real ...

This demo submission presents a set of tools and an extended framework with API for enabling the semantically empowered enrichment of online video with Web content. As audiovisual media is increasingly transmitted online, new services deriving added value from such material can be imagined. For example, combining it with other material elsewhere on...

In this submission, we describe the Linked Services Infrastructure (LSI). It uses Semantic Web Service technology to map individual concepts (identified by Linked Data URIs) to sets of online media content aggegrated from heterogeneous Web APIs. It exposes this mapping service in a RESTful API and returns RDF based responses for further processing...

If the future Web will be able to fully leverage the scale and quality of online media, a Web scale layer of structured, interlinked media annotations is needed, which we will call Linked Media, inspired by the Linked Data movement for making structured, interlinked descriptions of resources better available online. Mobile and tablet devices, as we...

This deliverable updates the scenarios and requirements described in D2.1.2 to include on-demand features identified during connectivity phase development, the usage by driving experiments and experiments funded through the open calls. The document provides a description of the functionality that needs to be developed within the expansion phase, to...

Creating and maintaining augmented scenes for mobile Augmented Reality browsers can be a challenging and time consuming task. The timeliness of digital information artifacts connected to changing urban environments require authors to constantly update the structural representations of augmented scenes or to accept that the information will soon be...

This paper describes how semantic and Linked Data technology are incorporated into an Augmented Reality (AR) platform in the SmartReality project and form the basis for enhanced AR mobile applications in which information and content in the user’s surroundings can be presented in a more meaningful and useful manner. We describe how things of intere...

This paper will look at how the growth of open data and APIs on the Web can be leveraged by intelligent systems to empower new types of flexible, dynamic interactive television applications. Examples will be given from the ConnectME and LinkedTV projects.

TV and Web convergence is becoming more and more a reality. This paper provides an overview of the opportunities and challenges that arise in fu-ture TV environments regarding unobtrusive, context-aware personalisation of digital media content. Subsequently, it describes the vision and first conceptual personalisation approach within the LinkedTV E...

This paper describes the main goals and outcomes of the EU-funded Framework 7 project entitled Semantic Evaluation at Large Scale (SEALS). The growth and success of the Semantic Web is built upon a wide range of Semantic technologies from ontology engineering tools through to semantic web service discovery and semantic search. The evaluation of suc...

Authoring Augmented Reality scenes typically involves arranging concrete multimedia assets (e.g., 3D models, images, videos) in a scene's coordinate system. When creating or collecting assets might be too time consuming, or assets are simply non-existent at the moment of annotation the authoring process fails. To overcome this problem, we employ a...

This paper describes the first five SEALS Evaluation Campaigns over the semantic technologies covered by the SEALS project (ontology engineering tools, ontology reasoning tools, ontology matching tools, semantic search tools, and semantic web service tools). It presents the evaluations and test data used in these campaigns and the tools that partic...

The NoTube European project puts the TV user back in the driver's seat by generating user profiles from data the user creates on the Social Web, and in this way facilitating a personalised TV experience without an intrusive user profiling process.

This chapter turns to the application of semantic technologies to areas where text is not dominant, but rather audiovisual content in the form of images, 3D objects, audio, and video/television. Non-textual digital content raises new challenges for semantic technology in terms of capturing the meaning of that content and expressing it in the form o...

This volume has introduced the foundations and technologies which make up the Semantic Web. Mostly the discussion has been on the state of the art, but what developments can be expected next in semantic technologies? What social and technological trends will spur and enable the next generation of semantic technology? Which application areas can one...

The Future Television workshop at EuroITV 2010 will explore how emerging Semantic Web and Social Web technologies can be integrated into the (increasingly Web-based) television experience to create new services and content offers around TV programming. It will bring together visionary minds from the TV, Social Web and Semantic Web communities to di...

Semantic Web technology is being increasingly applied in a large spectrum of applications in which domain knowledge is conceptualized and formalized (e.g., by means of an ontology) in order to support diversified and automated knowledge processing (e.g., reasoning) performed by a machine. Moreover, through an optimal combination of (cognitive) huma...

One of the main items on the eHealth agenda of the European Community is the design and promotion of electronic patient summaries as an instrument to guarantee the continuity of healthcare across national boundaries and to facilitate the pervasive delivery of healthcare, thus ensuring the right to patient mobility and increasing the productivity an...

After the first generation Web which started with manually created HTML pages, the second generation made the step to machine generated and often active HTML pages. Since these first two generations were meant for direct human processing, the third generation Web, the Semantic Web and Web 2.0 provide machine processable information and social colla...

Semantic Web technology is being increasingly applied in a large spectrum of applications in which domain knowledge is conceptualized and formalized (e.g., by means of an ontology) in order to support diversified and automated knowledge processing (e.g., reasoning) performed by a machine. Moreover, through an optimal combination of (cognitive) huma...

Semantic Web technology is being increasingly applied in a large spectrum of applications in which domain knowledge is conceptualized and formalized (e.g., by means of an ontology) in order to support diversified and automated knowledge processing (e.g., reasoning) performed by a machine. Moreover, through an optimal combination of (cognitive) huma...

For those outside the research community, to develop Semantic Web applications entails real difficulty. This difficulty is due in part to the lack of usable approaches for planning Semantic Web solutions, even though Semantic Web tools have already reached industrial maturity. We propose here the Semantic Web Framework, a component-based framework...

Triple Space Computing is a new middleware paradigm [11,13] based on semantics and tuplespaces which can be used for the coordination of Semantic Web clients and services. To achieve scalability of Triple Space infrastructure distribution of triplespaces is necessary. A major problem within massively distributed triplespaces is to find the best sui...

Knowledge in the form of semantic data is becoming more and more ubiquitous, and the need for scalable, dynamic systems to support collaborative work with such distributed, heterogeneous knowledge arises. We extend the “data in the cloud” approach that is emerging today to “knowledge in the cloud”, with support for handling semantic information, or...

A Multimedia Content Marketplace can support innovative business models in the telecommunication sector. This marketplace has a strong need for semantics, co-ordination and a service-oriented architecture. Triple Space Computing is an emerging semantic co-ordination paradigm for Web services, for which the marketplace is an ideal implementation sce...

The semantic Web and Web services have emerged as a new paradigm for knowledge-based applications, both human and machine controlled. The coordination of semantic clients or services is necessary to achieve goals only possible from the combination of knowledge based activities. Triple space computing is a new coordination paradigm based on semantic...

The "amount" of knowledge is constantly growing. Technological advances more and more facilitate an access to knowledge in an anytime, anywhere, and anyhow manner. The provision of accurate knowledge with respect to a requester's context gets more challenging. Explicit coordination of knowledge can be one means to address such developments. This re...

A new application of tuple-space-based coordination systems is in knowledge communication and representation. This knowledge is being published on the Web (the so-called “Semantic Web”) and could be concurrently accessed and used by large numbers of agents distributed across the world. Present coordination models assume that the tuples contain plai...

Semantic technologies promise to solve many challenging problems of the present Web applications. As they achieve a feasible level of maturity, they become increasingly accepted in various business settings at enterprise level. By contrast, their usability in open environments such as the Web—with respect to issues such as scalability, dynamism and...

Triple Space Middleware is a highly scalable, semantically enhanced platform for automatic machine-based communication on the basis of Web services, Semantic Web technologies and the coordination medium of Tuple Spaces. For this, we specify and prototypically implement a Triple Space system that innovatively combines these three research areas. As...

The Semantic Web is about a Web which contains data which is machine-processable rather than human-interpretable. This makes new demands upon the Web architecture such as a standardized interface for access to this knowledge (how to interact), model and vocabulary-based mediation (how to understand) and semantic-based distribution (how to find). We...

Semantic wikis combine the advantages introduced by the wiki princi- ple with the potential of Semantic Web technologies. However, there is still a very limited support for coordination, collaboration and integration in current seman- tic wikis. In this paper, we present a solution for this through the integration of our Makna semantic wiki with a...

One of the main items on the eHealth agenda of the European Community is the design and promotion of electronic patient summaries as an instrument to facilitate the pervasive delivery of healthcare, thus ensuring the right to patient mobility and increasing the productivity and quality of health service delivery. From a technical point of view this...

The task of resource retrieval and composition is particularly challenging in the case of multimedia resources. Usual approaches focus on the use of textual multimedia annotations to enable computer-based management of multimedia repositories. In this paper, we introduce two approaches which make use of a logical formalism called an ontology to imp...

Recent advances in middleware technologies propose semantics- aware tuplespaces as an instrument for coping with the requirements of scalability, heterogeneity and dynamism arising in highly distributed environments such as the Web or the emerging Semantic Web. In particular, Semantic Web services have inherited the Web service communication model,...