Nicola Orio

University of Padova | UNIPD · Department of Cultural Heritage: Archaeology and History of Art, Cinema and Music DBC

This paper presents the design, development and a first evaluation of a smartphone application aimed at promoting a cultural heritage site, Padua’s fourteenth-century fresco cycle, which has been registered in the UNESCO World Heritage List under the lettering Padua Urbs Picta. The evaluation have been realized through a questionnaire submitted to...

This article presents FakeMuse, a serious game about forgery and authentication in archaeological museums that aims at letting users playfully approach this issue. The player takes on the role of a museum curator who is presented with several artifacts that s/he must decide whether they are authentic or not. As the player progresses in the game, s/...

This paper reviews the existing literature on input device evaluation and design in human-computer interaction (HCI) and discusses possible applications of this knowledge to the design and evaluation of new interfaces for musical expression. Specifically, a set of musical tasks is suggested to allow the evaluation of different existing controllers.

In this paper an Android application called TindArt is presented. It has been developed to investigate a way to profile the user in cultural contexts, through the application of Recommender Systems for museum visits in the future. The purpose of the research also includes the study of the User Experience with TindArt to understand how it could be u...

In the context of cooperating in a project whose central aim has been the production of a corpus agnostic research environment supporting access to and exploitation of digital cultural heritage collections, we have worked towards promoting user engagement with the collections. The aim of this paper is to present the methods and the solutions that h...

Cambridge Core - General - Managing Digital Cultural Objects - edited by Allen Foster

This paper presents an initial proposal for the development of a crowdsourcing platform aimed at gathering information about audiovisual productions. Our goal is to foster the task of identifying movie excerpts that are filmed in a given location and of manually geolocating these excerpts. In this way it is possible to link audiovisual content to a...

Film induced tourism is a recent phenomenon, rising increasing interest in tourism management and promotion. A research project on this topic has been recently investigated at the Department of Cultural Heritage of the University of Padua, resulting in the development of a software architecture for the promotion of film-induced tourism, capable of...

Online music libraries available on the Web contain a large amount of audio content that is usually the result of digitization of analogue recordings or the direct acquisition of digital sources. The acquisition process is carried out by several persons and may last a number of years, thus it is likely that the same or similar audio content is pres...

This book constitutes the thoroughly refereed proceedings of the 12th Italian Research Conference on Digital Libraries, IRCDL 2016, held in Firence, Italy, in February 2016. The 15 papers presented were carefully selected from 23 submissions and cover topics such as formal methods, long-term preservation, metadata creation, management and curation,...

Film induced tourism is a recent phenomenon, which is rising increasing interest in tourism management and promotion. A research project on this topic is currently investigated at the Department of Cultural Heritage of the University of Padova, with the aim of developing a software architecture for promoting film-induced tourism. One of the challen...

We propose the use of short lectures, called narratives, embedded in a digital archive as a personalization method to support and guide users within a collection of historical material. The effectiveness of the approach has been evaluated with two groups of users. An analysis of the results has been conducted enabling the presentation of preliminar...

This paper reports on the outcomes of the CULTURA project that aims to improve user engagement with digital cultural heritage collections. The IPSA digital collection has been used as a case study for the development of novel personalised access tools for a variety of different user categories. The evaluation results collected on user engagement wi...

Digital humanities initiatives play an important role in making cultural heritage collections accessible to the global community of researchers and general public for the first time. Further work is needed to provide useful and usable tools to support users in working with those digital contents in virtual environments. The CULTURA project has deve...

This paper reports on the original approach envisaged for the evaluation of a digital archive accessible through a Web application, in its transition from an isolated archive to an archive fully immersed in a new adaptive environment.

The paper reports on the effort of reconsidering the characteristics of the IPSA online collection of illuminated images created for specialised users, involving the redesigning of the interaction functions to make the online collection of interest for new and diverse user categories. The effort is part of the design and development of a new adapti...

This paper reports on the results of a study that aims to support end users of a multimedia system that manages a digital cultural heritage collection. The system is provided with automatic tools that simulate the behavior of the research method adopted by professional users when they interact with the multimedia application. The experimental resul...

This paper presents the MusiClef data set, a multimodal data set of professionally annotated music. It includes editorial metadata about songs, albums, and artists, as well as MusicBrainz identifiers to facilitate linking to other data sets. In addition, several state-of-the-art audio features are provided. Different sets of annotations and music c...

ClipBoard is a novel system aimed at improving the accessibility of movies. Although subtitles and audio description are already provided for some TV programs and by a limited number of movie theaters, the availability of accessible content still depends on the choice of the film distributor. Through ClipBoard it is possible to synchronize in real-...

Digital resources are becoming an important tool for research in all the domains related to cultural heritage. Scholars have special requirements that need to be matched when developing digital library and digital archive systems that are to be used as tools to carry out scientific research. After having designed and developed a digital library app...

MusiClef was one of the "brave new tasks" at MediaEval 2013 with a multimodal approach that combined music, video and textual information in order to evaluate systems that recommend a music soundtrack given the video of a commercial and the information on the product to be advertised.

In recent years there has been a marked uptake in the digitisation of cultural heritage collections. Though this has enabled more sources to be made available to experts and the wider public, curators still struggle to instigate and enhance engagement with cultural archives. This is largely due to the monolithic nature of many digital archives; the...

In this paper, we give an overview of the MusiClef Brave New Task at MediaEval 2012. After introducing the back-ground of the task and related initiatives in the music infor-mation retrieval domain, we give an overview of the actual task and baseline results obtained for a reference implemen-tation by the task organizers.

This paper presents research carried out in order to elicit user needs for the design and development of a digital library and research platform intended to enhance user engagement with cultural heritage collections. It outlines a range of user constituencies for this digital library. The paper outlines a taxonomy of intended users for this system...

MusiClef is a multimodal music benchmarking initiative that will be running a MediaEval 2012 Brave New Task on Multimodal Music Tagging. This paper describes the setup of this task, showing how it complements existing benchmarking initiatives and fosters less explored methodological directions in Music Information Retrieval. MusiClef deals with a c...

In this paper, we present a digital library system for managing heterogeneous music collections. The heterogeneity refers to various document types and formats as well as to different modalities, e. g., CD-audio recordings, scanned sheet music, and lyrics. ...

Diverse digital resources are commonly used by different types of users. It is common practice to develop those application having in mind a set of requirements for a specific target category of users. We envisaged and designed the IPSA archive and system using a similar approach: the identification of a set of requirements for researchers in illum...

The rise of the Internet has led the music industry to a transition from physical media to online products and services. As a consequence, current online music collections store millions of songs and are constantly being enriched with new content. This has created a need for music technologies that allow users to interact with these extensive colle...

The availability of digital multimedia resources for cultural heritage poses challenging questions about the kind of interaction that is necessary to foresee to make them available to distinct categories of users. We report on a study on user requirements carried out on two groups of users: domain professional researchers, who need to carry out the...

A comprehensive methodology for automatic mu-sic identification is presented. The main application of the proposed approach is to provide tools to enrich and validate the descriptors of recordings digitized by a sound archive institution. Experimentation has been carried out on three different datasets, including a collection of digitized vinyl dis...

This paper reports on the effort we made in adapting and opening a specialist tool, focused on illumination and designed purposely for scholars and researchers, in order to be suitable also for the general public. We describe the ongoing process we are conducting: the adaptation and the improvement of the IPSA digital archive using the results we c...

Personalized and user-aware systems for retrieving multimedia items are becoming increasingly important as the amount of available multimedia data has been spiraling. A personalized system is one that incorporates information about the user into its data processing part (e.g., a particular user taste for a movie genre). A context-aware system, in c...

The aim of this paper is to report the results of an ongoing project that deals with the exploitation of a digital archive of drawings and illustrations of historic documents for research and educational purposes. A prototype system, called IPSA (Imaginum Patavinae Scientiae Archivum), has been developed and is currently used as a case study to pro...

A comprehensive methodology for automatic music identification is presented. The main application of the proposed approach is to provide tools to enrich and validate the descriptors of recordings digitized by a sound archive institution. Experimentation has been carried out on a collection of digitized vinyl discs, although the methodology is not l...

This paper reports the results of an ongoing project that deals with the development of a digital archive of drawings and illustrations of historic documents for research purposes, but also as a tool that can be used to disclose cultural heritage contents to the general public. The digital archive is currently used as a case study to provide innova...

CULTURA will deliver personalisation and community-aware adaptivity for Digital Humanities communities through an innovative environment which is tailored to the investigation, comprehension and enrichment of digital humanities collections. CULTURA seeks to stimulate and support the communities of interest which form around such collections.

An interesting problem in accessing music digital libraries is how to combine the information of different sources in order to improve the retrieval effectiveness. This paper introduces an approach to represent a collection of tagged songs through an hidden Markov model with the purpose to develop a system that merges in the same framework both aco...

This work presents the rationale, tasks and procedures of MusiCLEF, a novel benchmarking activity that has been developed along with the Cross-Language Evaluation Forum (CLEF). The main goal of MusiCLEF is to promote the development of new methodologies for music access and retrieval on real public music collections, which can combine content-based...

This paper reports on the participation of the Information Management System Research Group of the University of Padua to the Music Identfication task of the MusiCLEF Laboratory in CLEF 2011. The system under evaluation is FALCON, an open-source engine for content-based cover song identification written in Java that applies clas- sic techniques der...

We present FALCON, an open-source engine for content-based cover song identification written in Java. The popular Lucene search engine library is used as the core of the software, proving that textual methods in information retrieval can be successfully adapted to multimedia tasks. An overview of the system methodology and of the implementation are...

This paper describes the implementation of a content-based cover song identification system which has been released under an open source license. The system is centered around the Apache Lucene text search engine library, and proves how classic techniques derived from textual Information Retrieval, in particular the bag-of-words paradigm, can succe...

This paper describes a methodology for the statistical modeling of music works. Starting from either the representation of the symbolic score or the audio recording of a performance, a hidden Markov model is built to represent the corresponding music work. The model can be used to identify unknown recordings and to align them with the corresponding...

This paper describes the submission to the MIREX‘06 (Music Information Retrival Evaluation eXchange) first score following task. 1. Overview Score following is the key to an interaction with a written score/song based on the metaphor of a performer with an accompanist or band. For a historical review of score follower systems we refer the reader to...

This paper describes a methodology for the automatic identification of audio recordings of ethnic music. The identification is based on an application of hidden Markov models (HMMs), which are automatically built from a representation of the music pieces to be identified. States of the HMMs are labeled with music events, and the transition and obse...

In this paper we report the status of our research on the problem of content-based cover song identification in music digital libraries. An approach which exploits both harmonic and rhythmic facets of music is presented and evaluated against a test collection. Directions for future work are proposed, and particular attention is given to the scalabi...

The digital re-recording of analogue material, in particular phonographic discs, can be carried out using different approaches: mechanical, electro-mechanical, opto-mechanical, and opto-digital. In this paper, we investigate the differences among these approaches, using two novel methods that have been developed on purpose: a system for synthesizin...

An interesting problem in music information retrieval is how to combine the information from different sources in order to improve retrieval effectiveness. This paper introduces an approach to represent a collection of tagged songs through an hidden Markov model with the purpose to develop a system that merges in the same framework both acoustic si...

In response to the proposal of digitizing the entire back-run of several European audio archives, many research projects have been carried out in order to discover the technical issues involved in making prestigious audio documents digitally available, which are related to the A/D transfer process and supervised metadata extraction. This article gi...

We investigate differences among the approaches to the digitization of phonographic discs, using two novel methods developed by the authors: a system for synthesizing audio signals from still images of phonographic discs and a tool for the automatic alignment of audio signals. Results point out that this combined approach can be used as an effectiv...

This paper presents a system for tracking the position of a polyphonic music performance in a symbolic score, pos- sibly in real time. The system, based on Hidden Markov Models, is briefly presented, focusing on specific aspects such as observation modeling based on discrete filterbanks, in contrast with traditional FFT-based approaches, and de- sc...

Content-based music retrieval requires to define a similar- ity measure between music documents. In this paper, we propose a novel similarity measure between melodic con- tent, as represented in symbolic notation, that takes into account musicological aspects on the structural function of the melodic elements. The approach is based on the rep- rese...

We present a system for automatic real time alignment of an acoustic music performance with a digital representation of its score, a problem which is usually defined score following. The alignment is based on an application of hidden Markov models. A model is automatically built from a music score, while decoding is used to compute the most probabl...

Content based search in audio-visual collections requires media specific analysis for extracting low level features to be efficiently indexed and searched. We present the SAPIR media framework for analyzing digital content and representing the extracted features in a common schema, used to index and search content in a P2P network. The framework co...

A methodology is described for the automatic identification of classical music works. It can be considered an exten- sion of fingerprinting techniques because the identification is carried out also when the query is a different performance of the work stored in the database, possibly played by differ- ent instruments and with background noise. The...

This chapter describes two algorithms for probabilistic stemming. A probabilistic stemmer aims at detecting word stems by using a probabilistic or statistical model with no or very little knowledge about the language for which the stemmer has been built. While illustrating two probabilistic stemming models, a reflection and an analysis of the poten...

This chapter addresses the problem of the retrieval of music documents from multimedia digital libraries. Some of the peculiarities of the music language are described, showing similarities and differences between indexing and retrieval of textual and music documents. After reviewing the main approaches to music retrieval, a novel methodology is pr...

This paper describes a system able to identify a music work through the analysis of the audio recording of a performance. The approach is based on the statistical modeling of the expected audio features of music performances, given a database of known music works. In particular, the automatic identification is based on an application of hidden Mark...

The aim of this paper is to report the research results of an ongoing project that deals with the exploitation of a digital archive of drawings and illustrations of historic documents for research and educational purposes. According to the results on a study of user requirements, we have designed tools to provide researchers with innovative ways fo...

The availability of large music repositories poses challenging research problems, which are also related to the identification of different performances of music scores. This paper presents a methodology for music identification based on hidden Markov models. In particular, a statistical model of the possible performances of a given score is built...

Image digital archives of illuminated manuscripts can become a useful tool for researchers in different disciplines. To this aim, it is proposed to provide them with tools for annotating images to disclose hidden relationships between illustrations belonging to different works. Relationships can be modeled as typed links, which induce an hypertext...

The authors describe a statistical approach based on hidden Markov models (HMMs), for generating stemmers automatically. The proposed approach requires little effort to insert new languages in the system even if minimal linguistic knowledge is available. This is a key advantage especially for digital libraries, which are often developed for a speci...

The identification of unknown recordings is a challeng- ing problem that has several applications. In this paper, we focus on the identification of alternative releases of a given music work. To this end, a statistical model of the possible performances of a given score is built from the recording of a single performance. The methodology is based o...

ABSTRACT This paper presents a novel approach to the retrieval of multimedia documents,that considers Intellectual Property Rights (IPR) metadata,as a multidimensional feature in a metric space. The approach allows us to perform simi- larity searches on the IPR attributes of digital items and to integrate these searches in a common,query-by-example...

Indexing is the core component of most information retrieval systems, because it allows for a compact representation of the content of a collection of documents, aimed at efficient and scalable access and retrieval. Indexing techniques can be extended also to music, providing that significant descriptors are computed from music documents. These des...

The analysis of electroacoustic music may benefit from the design and development of tools for automatic audio matching, allowing musicologists to compare different versions of the same work and to draw the artistic path from the synthesis of fragments to the creation of a complete work. Music alignment has been explored as a tool in many areas, fr...

This paper describes a methodology for the identification of pop and rock songs based on the statistical modeling of the leading voice. The identification is based on the use of hidden Markov models (HMM), which are automatically built from digital music scores. States of the HMMs are labeled by the notes of the leading voice, and the transition an...

Abstract The increasing availability of music in digital format needs to be matched by the development of tools for music accessing, filtering, classification, and retrieval. The research area of Music Information Retrieval (MIR) covers many of these aspects. The aim of this paper is to present an overview of this vast and new field. A number of is...

The number of 3D models that are available from the Web is increasingly growing, motivating the research on content- based retrieval from shape information. In this paper we propose to extend the approach to colored 3D models, which start to become more and more popular. To this end we propose a content descriptor that combines together shape and c...

In this paper it is proposed a methodology for retrieving music documents using a query by example paradigm. The basic idea is that a collection of music documents can be indexed by the set of melodic contours of its documents, and retrieval is carried out using an approximate matching between query and document contours. The approximate matching i...

Scientific research on illuminated manuscripts includes the disclosure of relationships among images belonging to different manuscripts. Relationships can be modeled as typed links, which induce an hypertext over the archive. In this paper we present a formal model for annotations, which is the basis to build methods for automatically processing ex...

The scientific research on accessing and retrieval of music documents is becoming increasingly active, including the analysis of suitable features for content description or the development of algorithms to match relevant documents with queries. One of the challenges in this area is the possibility to extend textual retrieval techniques to music la...

This paper presents an overview of different approaches to melody segmentation aimed at extracting music lexical units, which can be used as content descriptors of mu- sic documents. Four approaches have been implemented and compared on a test collection of real documents and queries, showing their impact on index term size and on retrieval effecti...

The aim of this paper is to report the research results of an ongoing project that deals with the exploitation of a digital archive of drawings and illustrations of historic documents for research and educational purposes. According to the results on a study of user requirements, we have designed tools to provide researchers with innovative ways fo...

One of the challenges of music information retrieval is the automatic extraction of effective content descriptors of documents, whichcan be used at indexing and retrieval time to match queries with them. In this paper it is proposed to index music documents with frequent musical patterns. A musical pattern is a sequence of features in the score tha...

In most contemporary digital library management systems (DLMS) the contents are conveyed to the user as a "collection of information items", which can be searched or browsed. However, this paradigm is often not sufficient to cope with embedded usages, for which access to the contents is not seen as an isolated activity, but as part of a larger work...

Although modern audio score following systems work very well with low polyphony performances, they are still too im-precise with highly polyphonic instruments such as the piano, or the guitar. On the other hand, these instruments can easily output Midi information which shows that our work on robust Midi score following is still needed. We propose...

The article describes the project on music information retrieval that has been carried out at the University of Padova, Italy. The research work has been characterized by the synergy of the modular integration of sound techniques of melody processing and of statistical information retrieval. After illustrating the background from which the project...

One of the challenges of music information retrieval is the automatic extraction of effective content descriptors of music documents, which can be used at indexing and at retrieval time to match queries with documents. In this pa- per it is proposed to index music documents with frequent musical patterns. A musical pattern is a sequence of fea- tur...

Information Retrieval systems can benefit from advanced linguistic resources when carrying out tasks such as word-stemming or query translation. The main goal of our experiments has been the development of methodologies that minimize the human labor needed for creating linguistic resources for new languages. For this purpose, we have applied statis...

This paper presents an approach for aspect-based retrieval of 3D models or circular views of real objects. The objects in our database are described by a set of images, which are taken varying the pose of a constant angle along a given plane. A set of parameters is computed for each image, taking into account general features like bounding boxes, c...