• Home
  • University of Padova
  • Department of Cultural Heritage: Archaeology and History of Art, Cinema and Music DBC
  • Nicola Orio
Nicola Orio

Nicola Orio
University of Padova | UNIPD · Department of Cultural Heritage: Archaeology and History of Art, Cinema and Music DBC

PhD in Computer Engineering

About

128
Publications
31,358
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,782
Citations
Additional affiliations
February 2011 - present
University of Padova
Position
  • CULTURA

Publications

Publications (128)
Article
This article presents FakeMuse, a serious game about forgery and authentication in archaeological museums that aims at letting users playfully approach this issue. The player takes on the role of a museum curator who is presented with several artifacts that s/he must decide whether they are authentic or not. As the player progresses in the game, s/...
Preprint
Full-text available
This paper reviews the existing literature on input device evaluation and design in human-computer interaction (HCI) and discusses possible applications of this knowledge to the design and evaluation of new interfaces for musical expression. Specifically, a set of musical tasks is suggested to allow the evaluation of different existing controllers.
Chapter
In this paper an Android application called TindArt is presented. It has been developed to investigate a way to profile the user in cultural contexts, through the application of Recommender Systems for museum visits in the future. The purpose of the research also includes the study of the User Experience with TindArt to understand how it could be u...
Article
Full-text available
In the context of cooperating in a project whose central aim has been the production of a corpus agnostic research environment supporting access to and exploitation of digital cultural heritage collections, we have worked towards promoting user engagement with the collections. The aim of this paper is to present the methods and the solutions that h...
Article
Cambridge Core - General - Managing Digital Cultural Objects - edited by Allen Foster
Conference Paper
This paper presents an initial proposal for the development of a crowdsourcing platform aimed at gathering information about audiovisual productions. Our goal is to foster the task of identifying movie excerpts that are filmed in a given location and of manually geolocating these excerpts. In this way it is possible to link audiovisual content to a...
Conference Paper
Film induced tourism is a recent phenomenon, rising increasing interest in tourism management and promotion. A research project on this topic has been recently investigated at the Department of Cultural Heritage of the University of Padua, resulting in the development of a software architecture for the promotion of film-induced tourism, capable of...
Conference Paper
Online music libraries available on the Web contain a large amount of audio content that is usually the result of digitization of analogue recordings or the direct acquisition of digital sources. The acquisition process is carried out by several persons and may last a number of years, thus it is likely that the same or similar audio content is pres...
Book
This book constitutes the thoroughly refereed proceedings of the 12th Italian Research Conference on Digital Libraries, IRCDL 2016, held in Firence, Italy, in February 2016. The 15 papers presented were carefully selected from 23 submissions and cover topics such as formal methods, long-term preservation, metadata creation, management and curation,...
Conference Paper
Film induced tourism is a recent phenomenon, which is rising increasing interest in tourism management and promotion. A research project on this topic is currently investigated at the Department of Cultural Heritage of the University of Padova, with the aim of developing a software architecture for promoting film-induced tourism. One of the challen...
Conference Paper
We propose the use of short lectures, called narratives, embedded in a digital archive as a personalization method to support and guide users within a collection of historical material. The effectiveness of the approach has been evaluated with two groups of users. An analysis of the results has been conducted enabling the presentation of preliminar...
Article
Full-text available
This paper reports on the outcomes of the CULTURA project that aims to improve user engagement with digital cultural heritage collections. The IPSA digital collection has been used as a case study for the development of novel personalised access tools for a variety of different user categories. The evaluation results collected on user engagement wi...
Article
Full-text available
Digital humanities initiatives play an important role in making cultural heritage collections accessible to the global community of researchers and general public for the first time. Further work is needed to provide useful and usable tools to support users in working with those digital contents in virtual environments. The CULTURA project has deve...
Conference Paper
This paper reports on the original approach envisaged for the evaluation of a digital archive accessible through a Web application, in its transition from an isolated archive to an archive fully immersed in a new adaptive environment.
Conference Paper
The paper reports on the effort of reconsidering the characteristics of the IPSA online collection of illuminated images created for specialised users, involving the redesigning of the interaction functions to make the online collection of interest for new and diverse user categories. The effort is part of the design and development of a new adapti...
Conference Paper
This paper reports on the results of a study that aims to support end users of a multimedia system that manages a digital cultural heritage collection. The system is provided with automatic tools that simulate the behavior of the research method adopted by professional users when they interact with the multimedia application. The experimental resul...
Article
This paper presents the MusiClef data set, a multimodal data set of professionally annotated music. It includes editorial metadata about songs, albums, and artists, as well as MusicBrainz identifiers to facilitate linking to other data sets. In addition, several state-of-the-art audio features are provided. Different sets of annotations and music c...
Article
ClipBoard is a novel system aimed at improving the accessibility of movies. Although subtitles and audio description are already provided for some TV programs and by a limited number of movie theaters, the availability of accessible content still depends on the choice of the film distributor. Through ClipBoard it is possible to synchronize in real-...
Conference Paper
Digital resources are becoming an important tool for research in all the domains related to cultural heritage. Scholars have special requirements that need to be matched when developing digital library and digital archive systems that are to be used as tools to carry out scientific research. After having designed and developed a digital library app...
Article
MusiClef was one of the "brave new tasks" at MediaEval 2013 with a multimodal approach that combined music, video and textual information in order to evaluate systems that recommend a music soundtrack given the video of a commercial and the information on the product to be advertised.
Conference Paper
Full-text available
In recent years there has been a marked uptake in the digitisation of cultural heritage collections. Though this has enabled more sources to be made available to experts and the wider public, curators still struggle to instigate and enhance engagement with cultural archives. This is largely due to the monolithic nature of many digital archives; the...
Article
Full-text available
In this paper, we give an overview of the MusiClef Brave New Task at MediaEval 2012. After introducing the back-ground of the task and related initiatives in the music infor-mation retrieval domain, we give an overview of the actual task and baseline results obtained for a reference implemen-tation by the task organizers.
Conference Paper
This paper presents research carried out in order to elicit user needs for the design and development of a digital library and research platform intended to enhance user engagement with cultural heritage collections. It outlines a range of user constituencies for this digital library. The paper outlines a taxonomy of intended users for this system...
Conference Paper
MusiClef is a multimodal music benchmarking initiative that will be running a MediaEval 2012 Brave New Task on Multimodal Music Tagging. This paper describes the setup of this task, showing how it complements existing benchmarking initiatives and fosters less explored methodological directions in Music Information Retrieval. MusiClef deals with a c...
Article
Full-text available
In this paper, we present a digital library system for managing heterogeneous music collections. The heterogeneity refers to various document types and formats as well as to different modalities, e. g., CD-audio recordings, scanned sheet music, and lyrics. ...
Article
Full-text available
Diverse digital resources are commonly used by different types of users. It is common practice to develop those application having in mind a set of requirements for a specific target category of users. We envisaged and designed the IPSA archive and system using a similar approach: the identification of a set of requirements for researchers in illum...
Article
The rise of the Internet has led the music industry to a transition from physical media to online products and services. As a consequence, current online music collections store millions of songs and are constantly being enriched with new content. This has created a need for music technologies that allow users to interact with these extensive colle...
Article
Full-text available
The availability of digital multimedia resources for cultural heritage poses challenging questions about the kind of interaction that is necessary to foresee to make them available to distinct categories of users. We report on a study on user requirements carried out on two groups of users: domain professional researchers, who need to carry out the...
Article
Full-text available
A comprehensive methodology for automatic mu-sic identification is presented. The main application of the proposed approach is to provide tools to enrich and validate the descriptors of recordings digitized by a sound archive institution. Experimentation has been carried out on three different datasets, including a collection of digitized vinyl dis...
Conference Paper
This paper reports on the effort we made in adapting and opening a specialist tool, focused on illumination and designed purposely for scholars and researchers, in order to be suitable also for the general public. We describe the ongoing process we are conducting: the adaptation and the improvement of the IPSA digital archive using the results we c...
Chapter
Full-text available
Personalized and user-aware systems for retrieving multimedia items are becoming increasingly important as the amount of available multimedia data has been spiraling. A personalized system is one that incorporates information about the user into its data processing part (e.g., a particular user taste for a movie genre). A context-aware system, in c...
Chapter
The aim of this paper is to report the results of an ongoing project that deals with the exploitation of a digital archive of drawings and illustrations of historic documents for research and educational purposes. A prototype system, called IPSA (Imaginum Patavinae Scientiae Archivum), has been developed and is currently used as a case study to pro...
Article
A comprehensive methodology for automatic music identification is presented. The main application of the proposed approach is to provide tools to enrich and validate the descriptors of recordings digitized by a sound archive institution. Experimentation has been carried out on a collection of digitized vinyl discs, although the methodology is not l...
Article
This paper reports the results of an ongoing project that deals with the development of a digital archive of drawings and illustrations of historic documents for research purposes, but also as a tool that can be used to disclose cultural heritage contents to the general public. The digital archive is currently used as a case study to provide innova...
Conference Paper
Full-text available
CULTURA will deliver personalisation and community-aware adaptivity for Digital Humanities communities through an innovative environment which is tailored to the investigation, comprehension and enrichment of digital humanities collections. CULTURA seeks to stimulate and support the communities of interest which form around such collections.
Conference Paper
An interesting problem in accessing music digital libraries is how to combine the information of different sources in order to improve the retrieval effectiveness. This paper introduces an approach to represent a collection of tagged songs through an hidden Markov model with the purpose to develop a system that merges in the same framework both aco...
Conference Paper
Full-text available
This work presents the rationale, tasks and procedures of MusiCLEF, a novel benchmarking activity that has been developed along with the Cross-Language Evaluation Forum (CLEF). The main goal of MusiCLEF is to promote the development of new methodologies for music access and retrieval on real public music collections, which can combine content-based...
Conference Paper
This paper reports on the participation of the Information Management System Research Group of the University of Padua to the Music Identfication task of the MusiCLEF Laboratory in CLEF 2011. The system under evaluation is FALCON, an open-source engine for content-based cover song identification written in Java that applies clas- sic techniques der...
Conference Paper
We present FALCON, an open-source engine for content-based cover song identification written in Java. The popular Lucene search engine library is used as the core of the software, proving that textual methods in information retrieval can be successfully adapted to multimedia tasks. An overview of the system methodology and of the implementation are...
Conference Paper
This paper describes the implementation of a content-based cover song identification system which has been released under an open source license. The system is centered around the Apache Lucene text search engine library, and proves how classic techniques derived from textual Information Retrieval, in particular the bag-of-words paradigm, can succe...
Chapter
This paper describes a methodology for the statistical modeling of music works. Starting from either the representation of the symbolic score or the audio recording of a performance, a hidden Markov model is built to represent the corresponding music work. The model can be used to identify unknown recordings and to align them with the corresponding...
Article
Full-text available
This paper describes the submission to the MIREX‘06 (Music Information Retrival Evaluation eXchange) first score following task. 1. Overview Score following is the key to an interaction with a written score/song based on the metaphor of a performer with an accompanist or band. For a historical review of score follower systems we refer the reader to...
Article
This paper describes a methodology for the automatic identification of audio recordings of ethnic music. The identification is based on an application of hidden Markov models (HMMs), which are automatically built from a representation of the music pieces to be identified. States of the HMMs are labeled with music events, and the transition and obse...
Conference Paper
In this paper we report the status of our research on the problem of content-based cover song identification in music digital libraries. An approach which exploits both harmonic and rhythmic facets of music is presented and evaluated against a test collection. Directions for future work are proposed, and particular attention is given to the scalabi...
Conference Paper
The digital re-recording of analogue material, in particular phonographic discs, can be carried out using different approaches: mechanical, electro-mechanical, opto-mechanical, and opto-digital. In this paper, we investigate the differences among these approaches, using two novel methods that have been developed on purpose: a system for synthesizin...
Conference Paper
Full-text available
An interesting problem in music information retrieval is how to combine the information from different sources in order to improve retrieval effectiveness. This paper introduces an approach to represent a collection of tagged songs through an hidden Markov model with the purpose to develop a system that merges in the same framework both acoustic si...
Article
In response to the proposal of digitizing the entire back-run of several European audio archives, many research projects have been carried out in order to discover the technical issues involved in making prestigious audio documents digitally available, which are related to the A/D transfer process and supervised metadata extraction. This article gi...
Conference Paper
We investigate differences among the approaches to the digitization of phonographic discs, using two novel methods developed by the authors: a system for synthesizing audio signals from still images of phonographic discs and a tool for the automatic alignment of audio signals. Results point out that this combined approach can be used as an effectiv...
Conference Paper
Full-text available
This paper presents a system for tracking the position of a polyphonic music performance in a symbolic score, pos- sibly in real time. The system, based on Hidden Markov Models, is briefly presented, focusing on specific aspects such as observation modeling based on discrete filterbanks, in contrast with traditional FFT-based approaches, and de- sc...
Conference Paper
Full-text available
Content-based music retrieval requires to define a similar- ity measure between music documents. In this paper, we propose a novel similarity measure between melodic con- tent, as represented in symbolic notation, that takes into account musicological aspects on the structural function of the melodic elements. The approach is based on the rep- rese...
Conference Paper
We present a system for automatic real time alignment of an acoustic music performance with a digital representation of its score, a problem which is usually defined score following. The alignment is based on an application of hidden Markov models. A model is automatically built from a music score, while decoding is used to compute the most probabl...
Conference Paper
Full-text available
Content based search in audio-visual collections requires media specific analysis for extracting low level features to be efficiently indexed and searched. We present the SAPIR media framework for analyzing digital content and representing the extracted features in a common schema, used to index and search content in a P2P network. The framework co...
Conference Paper
Full-text available
A methodology is described for the automatic identification of classical music works. It can be considered an exten- sion of fingerprinting techniques because the identification is carried out also when the query is a different performance of the work stored in the database, possibly played by differ- ent instruments and with background noise. The...
Article
This chapter describes two algorithms for probabilistic stemming. A probabilistic stemmer aims at detecting word stems by using a probabilistic or statistical model with no or very little knowledge about the language for which the stemmer has been built. While illustrating two probabilistic stemming models, a reflection and an analysis of the poten...
Chapter
Full-text available
This chapter addresses the problem of the retrieval of music documents from multimedia digital libraries. Some of the peculiarities of the music language are described, showing similarities and differences between indexing and retrieval of textual and music documents. After reviewing the main approaches to music retrieval, a novel methodology is pr...
Conference Paper
This paper describes a system able to identify a music work through the analysis of the audio recording of a performance. The approach is based on the statistical modeling of the expected audio features of music performances, given a database of known music works. In particular, the automatic identification is based on an application of hidden Mark...
Conference Paper
Full-text available
The aim of this paper is to report the research results of an ongoing project that deals with the exploitation of a digital archive of drawings and illustrations of historic documents for research and educational purposes. According to the results on a study of user requirements, we have designed tools to provide researchers with innovative ways fo...
Conference Paper
The availability of large music repositories poses challenging research problems, which are also related to the identification of different performances of music scores. This paper presents a methodology for music identification based on hidden Markov models. In particular, a statistical model of the possible performances of a given score is built...
Conference Paper
Image digital archives of illuminated manuscripts can become a useful tool for researchers in different disciplines. To this aim, it is proposed to provide them with tools for annotating images to disclose hidden relationships between illustrations belonging to different works. Relationships can be modeled as typed links, which induce an hypertext...
Article
The authors describe a statistical approach based on hidden Markov models (HMMs), for generating stemmers automatically. The proposed approach requires little effort to insert new languages in the system even if minimal linguistic knowledge is available. This is a key advantage especially for digital libraries, which are often developed for a speci...
Conference Paper
Full-text available
The identification of unknown recordings is a challeng- ing problem that has several applications. In this paper, we focus on the identification of alternative releases of a given music work. To this end, a statistical model of the possible performances of a given score is built from the recording of a single performance. The methodology is based o...
Conference Paper
Full-text available
ABSTRACT This paper presents a novel approach to the retrieval of multimedia documents,that considers Intellectual Property Rights (IPR) metadata,as a multidimensional feature in a metric space. The approach allows us to perform simi- larity searches on the IPR attributes of digital items and to integrate these searches in a common,query-by-example...
Article
Indexing is the core component of most information retrieval systems, because it allows for a compact representation of the content of a collection of documents, aimed at efficient and scalable access and retrieval. Indexing techniques can be extended also to music, providing that significant descriptors are computed from music documents. These des...
Article
Full-text available
The analysis of electroacoustic music may benefit from the design and development of tools for automatic audio matching, allowing musicologists to compare different versions of the same work and to draw the artistic path from the synthesis of fragments to the creation of a complete work. Music alignment has been explored as a tool in many areas, fr...
Article
This paper describes a methodology for the identification of pop and rock songs based on the statistical modeling of the leading voice. The identification is based on the use of hidden Markov models (HMM), which are automatically built from digital music scores. States of the HMMs are labeled by the notes of the leading voice, and the transition an...
Article
Full-text available
Abstract The increasing availability of music in digital format needs to be matched by the development of tools for music accessing, filtering, classification, and retrieval. The research area of Music Information Retrieval (MIR) covers many of these aspects. The aim of this paper is to present an overview of this vast and new field. A number of is...
Conference Paper
The number of 3D models that are available from the Web is increasingly growing, motivating the research on content- based retrieval from shape information. In this paper we propose to extend the approach to colored 3D models, which start to become more and more popular. To this end we propose a content descriptor that combines together shape and c...
Conference Paper
In this paper it is proposed a methodology for retrieving music documents using a query by example paradigm. The basic idea is that a collection of music documents can be indexed by the set of melodic contours of its documents, and retrieval is carried out using an approximate matching between query and document contours. The approximate matching i...
Conference Paper
Full-text available
Scientific research on illuminated manuscripts includes the disclosure of relationships among images belonging to different manuscripts. Relationships can be modeled as typed links, which induce an hypertext over the archive. In this paper we present a formal model for annotations, which is the basis to build methods for automatically processing ex...