Raul Masu

Raul Masu
Universidade NOVA de Lisboa | NOVA · Department of Informatics (DI)

PhD Student in Digital Media

About

50
Publications
6,121
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
210
Citations
Introduction
I am a HCI researcher who explores the potential of sound, and a musician who plays with interactive computers. Lately, I increasingly became interested in digital ethic issues related to my research area. I am currently enrolled in a PhD program in Digital Media at the Department of Informatics, FCT-NOVA University of Lisbon (UT Austin|Portugal Program) and ITI/LARSyS. I graduated in Electronic Music (BA) and Composition (10-Years Diploma – Master equivalent) from the Conservatory of Trento.

Publications

Publications (50)
Conference Paper
Full-text available
Commons and commoning are of increasing interest to the PD community. We argue that off-the-shelf digital commons can be used in the context of PD to support groups in their commoning practices. This approach presents some advantages: it allows focusing resources on participation rather than software development and it fosters sustainability of res...
Conference Paper
In this workshop, we aim at fostering a conversation on performance ecologies. At first, part of the workshop will be a self-reflective activity. The participants will analyse one of their recent performances, or pieces of music technology they developed. This activity will be facilitated by the use of ARCAA—a framework to study performance ecologi...
Article
Full-text available
In this paper, we propose a set of reflections to actively incorporate environmental sustainability instances in the practice of circuit bending. This proposal combines circuit bending-related concepts with literature from the domain of sustainable Human-Computer Interaction (HCI). We commence by presenting an overview of the critical discourse wit...
Article
Full-text available
In this paper, we propose a set of reflections to actively incorporate environmental sustainability instances in the practice of circuit bending. This proposal combines circuit bending-related concepts with literature from the domain of sustainable Human-Computer Interaction (HCI). We commence by presenting an overview of the critical discourse wit...
Conference Paper
Full-text available
The management of the musical structures and the awareness of the performer’s processes during a performance are two important aspects of live coding improvisations. To support these aspects, we developed and evaluated two systems, Time_X and Time_Z, for visualizing the musical form during live coding reharsals. Time_X allows visualizing an entire...
Conference Paper
Full-text available
Ethically-defensible research requires wide-ranging, holistic, and deep consideration. It is often overseen by Research Ethics Committees, Institutional Research Boards or equivalents but not all organisations have these and where they do, their degree of independence from organisational priorities varies (perhaps leading to research that would cre...
Chapter
This paper proposes a dynamic VR environment design approach to enhance the way a user experiences a computer generated character’s movement. We transferred concepts and practices from performance studies to create a dynamic VR environment, in which design elements are interconnected and changing with the character’s movement. Our focus was on spac...
Book
Full-text available
The book titled The Collaborative Economy in Action: European Perspectives is one of the important outcomes of the COST Action CA16121, From Sharing to Caring: Examining the Socio-Technical Aspects of the Collaborative Economy (short name: Sharing and Caring; sharingandcaring.eu) that was active between March 2017 and September 2021. The Action was...
Conference Paper
In this paper we present the design process and the preliminary evaluations of Zugzwang. The system implemented a mixed approach to represent a chess game by combining direct sonification of the moves with instrumental improvisation. The improvisation is guided by a score displayed in real-time that represent the thinking process of the player base...
Conference Paper
Full-text available
This paper investigates how the concept of score has been used in the NIME community. To this end, we performed a systematic literature review of the NIME proceedings, analyzing papers in which scores play a central role. We analyzed the score not as an object per se but in relation to the users and the interactive system(s). In other words, we pri...
Conference Paper
Full-text available
This paper addresses environmental issues around NIME research and practice. We discuss the formulation of an environmental statement for the conference as well as the initiation of a NIME Eco Wiki containing information on environmental concerns related to the creation of new musical instruments. We outline a number of these concerns and, by syste...
Article
Full-text available
In this paper we propose to apply historical compositional approaches to contemporary audiovisual materials. In an interview about music composition, composer Luciano Berio declared: “The most profound comment to symphonies or operas has always been another symphony or another opera.” In this paper, we present “Structures Remediation,” an audiovisu...
Conference Paper
Full-text available
In this paper, we propose to consider the sonic interactions that occurs in a dance performance from an ecological perspective. In particular, we suggest using the conceptual models of artefact ecology and design space. As a case study, we present a work developed during a two weeks artistic residency in collaboration between a sound designer, one...
Conference Paper
Full-text available
In this paper, we introduce the concept of VR Open Scores: aleatoric score-based virtual scenarios where an aleatoric score is embedded in a virtual environment. This idea builds upon the notion of graphic scores and composed instrument , and apply them in a new context. Our proposal also explores possible parallels between open meaning in interact...
Article
Full-text available
INTRODUCTION: In this paper we present Silico, a new Digital Musical Instrument which ideally represents the performer itself. This instrument is composed by two parts: an interface (a sensor glove), which relies on the movements of the performer's hand, and a computational engine (a set of patches developed in Max 7), which generates sound events...
Article
Full-text available
INTRODUCTION: We present an audience study investigating the impact of different technologies to create visuals in dance performances. OBJECTIVES: We investigated four conditions: motion capture, sensors, camera image, and minimal interaction; and four variables: how much did the audience perceive a connection between the body and the visuals; the...
Conference Paper
This paper presents ARCAA (Actors, Role, Context, Activity, Artefacts), a framework that supports designers in understanding the artefact ecology in the music performance scenario, in particular, allowing to frame the role of the different actors. The ARCAA framework is the result of the combination of two different areas of HCI: artefact ecology c...
Conference Paper
There has been an increased interest in HCI research regarding the possibilities of interactive technology applied to the field of dance performance, particularly contemporary dance. This has produced numerous strategies to capture data from the moving bodies of the dancers and to map that data into different types of display formats. In this paper...
Conference Paper
Full-text available
Orientation is an emerging issue in cinematic Virtual Reality (VR), as viewers may fail in locating points of interest. Recent strategies to tackle this research problem have investigated the role of cues, specifically diegetic sound effects. In this paper, we examine the use of sound spatialization for orientation purposes, namely by studying diff...
Article
Full-text available
This paper presents a model to codesign interpretively flexible artefacts. We present the case study of Beatfield, a multimodal system that allows users to control audiovisual material by means of tangible interaction. The design of the system was coauthored by individuals with different background and interests to encourage a range of difference i...
Conference Paper
In this paper, we present Penguin, a system for live scoring, and Studio I, a piece composed for the system and an accordion. The system is shaped in two modules, one that generates a musical stream in real-time and the other that manages a live scoring process. Penguin is designed to be used in interactive performances alongside traditional instru...
Conference Paper
Full-text available
My project aims to study the adoption of scores in mixed performances with DMIs and traditional instruments fostering performers' creativity while keeping the composer authorship over the piece. I intend to develop my research in the context of professional music performances and pedagogic scenarios. In this paper I introduce related works on DMI,...
Conference Paper
Full-text available
This paper proposes the idea that a score for a Digital Musical In- strument (DMI) can be approached from a design perspective. In particular, we focus on the concepts of affordances and constraints. The paper describes the use of scores in a piece called XXV composed for Chimney, a DMI and Cello. Both the piece and the system are detailed with a f...
Conference Paper
Full-text available
The purpose of this paper is to present Robinflock, an al-gorithmic system for automatic polyphonic music generation to be used with interactive systems targeted at children. The system allows real time interaction with the generated music. In particular, a number of parameters can be independently manipulated for each melody line. The design of th...
Conference Paper
Full-text available
The purpose of this paper is to present Robinflock, an al-gorithmic system for automatic polyphonic music generation to be used with interactive systems targeted at children. The system allows real time interaction with the generated music. In particular, a number of parameters can be independently manipulated for each melody line. The design of th...
Conference Paper
Full-text available
This paper investigates the involvement of preschoolers in the late stages of the design of Child Orchestra, a musical interactive playground for the kindergarten. The study presents a retrospective analysis of the design of Child Orchestra. The system was iteratively prototyped and developed following UCD methods and a design in use approach in a...
Conference Paper
Full-text available
Research on musical instrument design suggests that deliberate constraints can offer new creative experiences to the performer. At times, design constraints are physically embedded in the instrument to limit the interaction possibilities ; in other cases the constraints are given by delegating part of the control to the machine. In this paper we pr...
Conference Paper
Full-text available
This paper proposes discussions for the (re)negotiation of responsibilities in performances that involve a collaboration between human and computer agents. Most of current research is human-hierarchical, leaving the machine the role of a mere tool at performer's service. In this paper a more balanced distribution of responsibilities between the two...
Chapter
This paper presents Beatfield, a musical installation that allows players to explore an audiovisual landscape by positioning tangible objects on an augmented game board. The underlying idea of the installation was the proposition of an artefact that could encourage heterogeneous interpretations. Beatfield had to offer a multitude of interpretations...
Conference Paper
Full-text available
OHR is a puzzle and platform game, based on both classical mechanics and tangible interaction, powered by Unity3D and a custom-built hardware interface called Radiant Square (Radiant2). OHR tells the tale of Spark, an electronic life form, which wakes up in an electronic components dump, trying to exit from it. Players will help Spark to solve puzz...
Conference Paper
Full-text available
The last decades have witnessed a significant growth of interest in in- teractive systems that allow the audience to alter the auditory content of an art- work. Generally, the artwork itself is the primary goal of the artist, who arbitrarily maps audience behaviours into musical output following their personal aesthetic. However, given this subject...
Conference Paper
Full-text available
The purpose of this paper is to present Robin, an algorithmic composer specifically designed for interactive situations. Users can interact in real time with the algorithmic composition by means of control strategies based on emotions. This study aims at providing a system for automatic music generation to be applied to interactive systems for musi...
Article
Full-text available
In this paper, we reflect on our experience of designing, developing and evaluating interactive spaces for collaborative creativity. In particular, we are interested in designing spaces which allow everybody to compose and play original music. The Music Room is an interactive installation where couples can compose original music by moving in the sp...
Conference Paper
Full-text available
This paper presents The Music Room, an interactive installation where couples compose original music. The music is generated by Robin, an automatic composition system, according to relative distance between the users and the speed of their own movements. Proximity maps the pleasantness of music, while speed maps its intensity. The Music Room was ex...
Conference Paper
Full-text available
Current systems aiming at facilitating and extending musical expression typically rely on concepts that non-musicians can hardly comprehend. To attract such users, different interaction metaphors laying outside of the musical domain need to be considered. This study is a step towards the definition of a new class of interfaces for musical expressio...

Network

Cited By

Projects

Projects (4)
Archived project
Moving Digits: Augmented Dance for Engaged Audience (https://movingdigits.eu) aims to enhance audience understanding and engagement in contemporary dance performances, and to allow to experience dance in an augmented way (even after the performance). The project also aims to empower dancers, choreographers and technicians with further tools for expression, archival and analysis. The project is a partnership between Madeira Interactive Technologies Institute (M-ITI, Portugal – Lead Partner), Hochschule Düsseldorf (HSD, Germany) and Sõltumatu Tantsu Lava (STL, Estonia). Instituto de Telecomunicações (IT, Portugal), Plux (Portugal), Tanzhaus NRW (Germany) and University of Greenwich (UK) are associated partners. The project has a duration of 2 years, starting 1st October 2018.
Project
Inf@nzia DIGI.tales 3.6 è un progetto finanziato dal programma PON-Smart Cities and Communities and Social Innovation che si pone l'obiettivo di costruire ambienti di insegnamento/apprendimento innovativi per i bambini compresi tra i 3 e i 6 anni (scuola dell’infanzia e primo anno della scuola primaria). Guidato da Engineering SpA, il progetto può contare su una virtuosa sinergia tra il lavoro di quattro fra le più importanti Università italiane (Napoli “Federico II”, Sapienza – Università di Roma, Salerno, Trento) e tre partner tecnologici di altissimo livello (Fastweb, Interactive Media, iCampus). Il progetto mira a definire pratiche psico-pedagogiche che possano potenziare le attività curricolari e facilitare i processi di acquisizione di competenze e conoscenze da parte dei bambini: • facendo leva sulle ICT per rendere più efficace la fruibilità dei percorsi formativi, facilitare i docenti nel controllare in maniera non invasiva i progressi dei discenti, costruire nuovi scenari educativi impensabili senza l’uso delle capacità computazionali distribuite in un ambiente intelligente (DIGI) • potenziando approcci come quello di Munari, e ancor prima della Montessori, per privilegiare le dimensioni del fare, l’esplorazione spontanea, la manipolazione di artefatti e blocchi logici, la creazione di storie (tales).