• Home
  • McGill University
  • Centre for Interdisciplinary Research in Music Media & Technology (CIRMMT)
  • Marcelo Wanderley
Marcelo Wanderley

Marcelo Wanderley
McGill University | McGill · Centre for Interdisciplinary Research in Music Media & Technology (CIRMMT)

PhD

About

300
Publications
81,001
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
6,105
Citations
Citations since 2016
82 Research Items
2745 Citations
20162017201820192020202120220100200300400
20162017201820192020202120220100200300400
20162017201820192020202120220100200300400
20162017201820192020202120220100200300400
Introduction
I have a background in electrical engineering and hold a PhD in the field of computer music from Paris 6 University/Ircam. My main interests include multidisciplinary research on the design and evaluation of digital musical instruments and the analysis of performer movements. I'm a senior member of the ACM and of the IEEE and since September 2016 a member of Computer Music Journal’s Editorial Advisory Board.

Publications

Publications (300)
Article
Full-text available
Different technologies can acquire data for gait analysis, such as optical systems and inertial measurement units (IMUs). Each technology has its drawbacks and advantages, fitting best to particular applications. The presented multi-sensor human gait dataset comprises synchronized inertial and optical motion data from 25 participants free of lower-...
Conference Paper
Full-text available
Urban sound management often amounts to reducing sound levels with the underlying assumption of sound/noise as a nuisance. However, a reduction in sound level does not necessarily lead to a more pleasant auditory experience, especially in urban public spaces where vibrancy can be sought after. A proactive design approach that accounts for the human...
Article
Full-text available
Digital musical instruments are frequently designed in research and experimental performance contexts but few are taken up into sustained use by active and professional musicians. To identify the needs of performers who use novel technologies in their practices, a survey of musicians was conducted that identified desirable qualities for instruments...
Preprint
Full-text available
Different technologies can acquire data for gait analysis, such as optical systems and inertial measurement units (IMUs). Each technology has its drawbacks and advantages, fitting best to particular applications. The presented multi-sensor human gait dataset comprises synchronized inertial and optical motion data from 25 subjects free of lower-limb...
Article
The aims of this study were to i) evaluate proximal-to-distal sequencing (PDS) in pianists’ attack and release movements during pressed-staccato keystrokes, and ii) investigate if trunk motion facilitates PDS of upper-limb movements. Nine expert pianists performed a series of loud pressed-staccato keystrokes. Kinematic data was recorded with a 3 D...
Article
Full-text available
This paper introduces the musical haptic wearables for audiences (MHWAs), a class of wearable devices for musical applications targeting audiences of live music performances. MHWAs are characterized by embedded intelligence, wireless connectivity to local and remote networks, a system to deliver haptic stimuli, and tracking of gestures and/or physi...
Article
Full-text available
Recent works recognize musicality is based on and constrained by our cognitive and biological system. Taking in account a concept from cognitive science - cognitive offloading - as a principle for technology-supported musical activities, in this paper we discuss some principles (guidelines) to be taken into account when designing, developing and ev...
Conference Paper
Full-text available
This paper presents a theoretical framework for describing interactive sound installations, along with an interactive database, on a web application, for visualizing various features of sound installations. A corpus of 195 interactive sound installations was reviewed to derive a taxonomy describing them across three perspectives: Artistic Intention...
Article
Full-text available
High-level improvising musicians master idiosyncratic gesture vocabularies that allow them to express themselves in unique ways. The full use of such vocabularies is nevertheless challenged when improvisers incorporate electronics in their performances. To control electronic sounds and effects, they typically use commercial interfaces whose physica...
Article
Full-text available
We report on a conceptual framework for describing interactive sound installations from three complementary perspectives: artistic intention, interaction and system design. Its elaboration was informed by a systematic review of 181 peer-reviewed publications retrieved from the Scopus database, which describe 195 interactive sound installations. The...
Preprint
Full-text available
This paper reviews the existing literature on input device evaluation and design in human-computer interaction (HCI) and discusses possible applications of this knowledge to the design and evaluation of new interfaces for musical expression. Specifically, a set of musical tasks is suggested to allow the evaluation of different existing controllers.
Chapter
The internet has allowed for the flourishing of several shared projects. Developers from different parts of the world can work asynchronously on the same project, formulating ideas, and implementing complex systems. For remote collaboration in software development projects, sharing information and code becomes more straightforward, given the textua...
Article
Full-text available
Haptics, audio and human–computer interaction are three scientific disciplines that share interests, issues and methodologies. Despite these common points, interaction between these communities are sparse, because each of them have their own publication venues, meeting places, etc. A venue to foster interaction between these three communities was c...
Article
The integration of vibrotactile feedback in digital music instruments (DMIs) is thought to improve the instrument’s response and make it more suitable for expert musical interactions. However, given the extreme requirements of musical performances, there is a need for solutions allowing for independent control of frequency and amplitude over a wide...
Chapter
This paper reports ongoing initiatives to explore how digital and augmented musical instruments gestural vocabulary is developed over time, and how embedding the high-level gesture descriptors in those instruments can fomenting their use and contribute to their maturity toward established music instruments. The instruments included in this research...
Chapter
The definition of mapping strategies between input devices and sound generating algorithms is an essential process in computer music. Traditionally, mapping has been considered in the context of digital musical instruments where the control of low level sound features (note articulation, timbre) is the goal. This paper describes the motivation, imp...
Chapter
The CIRMMT Distinguished Lecture (DL) series consists of over seventy 1-h videos of leading scholars and artists discussing their interdisciplinary work, a unique video encyclopedia of Music, Science and Technology. Though this collection in itself is already an invaluable research and pedagogical tool, searching videos in the collection is not a t...
Conference Paper
Full-text available
So far, NIME research has been mostly inward-looking, dedicated to divulging and studying our own work and having limited engagement with trends outside our community. Though musical instruments as cultural artefacts are inherently political, we have so far not sufficiently engaged with confronting these themes in our own research. In this paper we...
Conference Paper
Music performance involves continuous muscle activity of different body parts. Activity of more distal body segments which directly interact with the instrument usually relates to the actual production of sound. However, muscle activations of more proximal segments, including the trunk, might relate to the expressive content of the musical idea bei...
Conference Paper
Full-text available
In this paper we investigate the role of haptic stimuli in affecting the perception of live music. We designed a study where a smart mandolin performer played live for audience members wearing a gilet-based musical haptic wearable, which provided vibro-tactile sensations in response to the performed music. Six performances were conducted, each of w...
Conference Paper
Full-text available
The increasing availability of accessible sensor technologies, single board computers, and prototyping platforms have resulted in a growing number of frameworks explicitly geared towards the design and construction of Digital and Augmented Musical Instruments. Developing such instruments can be facilitated by choosing the most suitable framework fo...
Conference Paper
Full-text available
This paper documents the key issues of performance and compatibility working with Musical Instrument Digital Interface (MIDI) over Bluetooth Low Energy (BLE) as a wireless interface for sensor or controller data and inter-module communication in the context of building interactive digital systems. An overview of BLE MIDI is presented along with a c...
Chapter
We present the body:suit:score, a vibrotactile musical score that displays instructions and signals directly on musicians’ bodies using an array of vibrating motors. Initially inspired by the third author’s need for a new kind of score in his compositional practice, the body:suit:score facilitates the exploration of novel musical experiences and pe...
Chapter
Full-text available
This chapter discusses possible links between the fields of computer music (CM) and human-computer interaction (HCI), particularly in the context of the MIDWAY project between Inria, France and McGill University, Canada. The goal of MIDWAY is to construct a “musical interaction design workbench” to facilitate the exploration and development of new...
Chapter
Wendy Mackay is a Research Director at INRIA Saclay—Île-de-France where she founded and directs the ExSitu research group in Human-Computer Interaction. She is a former chair of CHI. Her research interests include multi-disciplinary, participatory design methods, tangible computing, interactive paper, and situated interaction. In this interview, Ma...
Chapter
This is the introductory chapter of a book dedicated to new research in, and emerging new understandings of, music and human-computer interaction—known for short as music interaction. Music interaction research plays a key role in innovative approaches to diverse musical activities, including performance, composition, education, analysis, productio...
Article
Full-text available
Established pedagogical theories for classical piano usually do not consider the essential relationship between the musical structure, whole body movements, and expression. Research focusing on musicians' expression has shown that body movements reflect the performer's understanding of the musical structure. However, most studies to date focus on t...
Conference Paper
Full-text available
This paper describes two augmented nylon-string guitar projects developed in different institutions. GuitarAMI uses sensors to modify the classical guitars constraints while GuiaRT uses digital signal processing to create virtual guitarists that interact with the performer in real-time. After a bibliographic review of Augmented Musical Instruments...
Conference Paper
Full-text available
Despite the proliferation of new digital musical instruments (DMIs) coming from a diverse community of designers, researchers and creative practitioners, many of these instruments experience short life cycles and see little actual use in performance. There are a variety of reasons for this, including a lack of established technique and repertoire f...
Conference Paper
Contemporary classical music conductors are often required to perform music that requires a click track for accurate tempo following. Auditory click tracks can be obtrusive as they block an ear and interfere with the conductor’s perception of the music being performed. We propose a device and framework that uses the tactile sense to provide a simil...
Conference Paper
Full-text available
We present a gestural control system to augment harp performance with real-time control of computer-based audio affects and processing. While the lightweight system was designed for use alongside any instrument, our choice of the concert harp represented a unique case study in gestural control of music. The instrument's large size and physically de...
Conference Paper
The swaying action coming from the pianists' hip region constitutes the pivotal point for upper body movements. In this paper, we evaluate the relation between the use of vertical force and structural characteristics of technically different excerpts when pianists play with varied levels of expression. We also analyze the common patterns within the...
Conference Paper
Full-text available
The term 'NIME'-New Interfaces for Musical Expression-has come to signify both technical and cultural characteristics. Not all new musical instruments are NIMEs, and not all NIMEs are defined as such for the sole ephemeral condition of being new. So, what are the typical characteristics of NIMEs and what are their roles in performers' practice? Is...
Conference Paper
Full-text available
The Digital Orchestra Toolbox for Max is an open-source collection of small modular software tools for aiding the development of Digital Musical Instruments. Each tool takes the form of an “abstraction” for the visual programming environment Max, meaning it can be opened and under- stood by users within the Max environment, as well as copied, modif...
Conference Paper
This paper presents the work to maintain several copies of the digital musical instrument (DMI) called the T-Stick in the hopes of extending their useful lifetime. The T-Sticks were originally conceived in 2006 and 20 copies have been built over the last 12 years. While they all preserve the original design concept, their evolution resulted in vari...
Chapter
Full-text available
Haptics, and specifically vibrotactile-augmented interfaces, have been the object of much research in the music technology domain: In the last few decades, many musical haptic interfaces have been designed and used to teach, perform, and compose music. The investigation of the design of meaningful ways to convey musical information via the sense of...
Article
Full-text available
Motor skill acquisition inherently depends on the way one practices the motor task. The amount of motor task variability during practice has been shown to foster transfer of the learned skill to other similar motor tasks. In addition, variability in a learning schedule, in which a task and its variations are interweaved during practice, has been sh...
Article
Full-text available
We articulate a need for the representation of temporal objects represented by dynamic, short-lived mapping connections instantiated from a template, in tools for designing and using interactive media systems. A list of requirements is compiled from examination of existing tools, practical use cases, and abstract considerations of node connectivity...
Conference Paper
Digital Music Instruments (DMI) are usually composed of a gestural controller connected to a general-purpose computer. Recent developments in embedded computing facilitate new self-contained designs, where gestural interface and processing unit are integrated. These new instruments are possibly more focused on the musical activity, while maintainin...
Conference Paper
Full-text available
In this paper we present a series of experiments aiming at modifications of an existing augmented musical instrument entitled GuitarAMI. We use a single-board computer and a prototyping platform to embed hardware capable of performing audio capture, gestural data generation and process, synthesis and sound manipulation, as well as audio input/outpu...
Conference Paper
Full-text available
Expert musicians' performances embed a timing variability pattern that can be used to recognize individual performance. However, it is not clear if such a property of performance variability is a consequence of learning or an intrinsic characteristic of human performance. In addition, little evidence exists about the role of timing and motion in re...
Conference Paper
This paper presents a wearable, wireless tactile display system which consists of individually controllable vibrotactile actuator devices, called Vibropixels. The design of the system is easily scalable and reconfigurable, allowing for implementation in a variety of applications. The system removes any limit on the number of actuator devices by avo...
Article
Full-text available
We examined temporal synchronization in joint music performance to determine how social status, auditory feedback, and animacy influence interpersonal coordination. A partner's coordination can be bidirectional (partners adapt to the actions of one another) or unidirectional (one partner adapts). According to the dynamical systems framework, bidire...
Chapter
In this paper we challenge the assumption that an electronic instrument consists solely of an interface and a sound generator. We emphasise the importance of the mapping between input parameters and system parameters, and claim that this can define the very essence of an instrument.
Chapter
While several researchers have grappled with the problem of comparing musical devices across performance, installation, and related contexts, no methodology yet exists for producing holistic, informative visualizations for these devices. Drawing on existing research in performance interaction, human-computer interaction, and design space analysis,...
Article
Digital musical instruments (DMIs) make up a class of devices in which gestural control and sound production are physically decoupled, but digitally mapped. This work discusses aspects of DMI design by focusing on the complexity of the design space and the importance of prototyping cycles. The authors' research questions cover how to provide an ini...