Mus ink : composing music through augmented drawing

01/2009; DOI: 10.1145/1518701.1518827

ABSTRACT We focus on the creative use of paper in the music composition process, particularly the interaction between paper and end-user programming. When expressing musical ideas, composers draw in a precise way, not just sketch. Working in close collaboration with composers, we designed Musink to provide them with a smooth transition between paper drawings and OpenMusic, a flexible music composition tool. Musink's built-in recognizers handle common needs, such as scoping and annotation. Users can also define new gestures and associate them with their own or predefined software functions. Musink supports semi-structured, delayed interpretation and serves as a customizable gesture browser, giving composers significant freedom to create their own, individualized composition languages and to experiment with music, on-paper and on-line.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: We describe the evaluation of a personal digital library environment designed to help musicians capture, enrich and store their ideas using a spatial hypermedia paradigm. The target user group is musicians who primarily use audio and text for composition and arrangement, rather than with formal music notation. Using the principle of user-centered design, the software implementation was guided by a diary study involving nine musicians which suggested five requirements for the software to support: capturing, overdubbing, developing, storing, and organizing. Moreover, the underlying spatial data-model was exploited to give raw audio compositions a hierarchical structure, and - to aid musicians in retrieving previous ideas - a search facility is available to support both query by humming and text-based queries. A user evaluation of the completed design with eleven subjects indicated that musicians, in general, would find the hypermedia environment useful for capturing and managing their moments of musical creativity and exploration. More specifically they would make use of the query by humming facility and the hierarchical track organization, but not the overdubbing facility as implemented.
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: RESUME Les systèmes actuellement utilisés par les contrôleurs aériens mêlent des visualisations informatiques (images radar), et des systèmes tangibles, notamment le strip, une bande de papier imprimée à chaque entrée d'un vol dans un secteur. Bien que le support papier s'avère robuste, souple et complémentaire de l'image radar, les autorités ont décidé de l'abandonner au profit d'interfaces entièrement informatisées, notamment parce que le papier ne permet pas de renseigner les systèmes informatiques. Dans cet article, nous proposons une étude d'une solution alternative utilisant des stylos hybrides Anoto avec communication continue (streaming). Nous avons observé l'activité de contrôle et réalisé un travail de conception des interactions stylo/papier numérique en coopération avec des contrôleurs. Nous enfin avons réalisé un prototype abouti et fonctionnel incluant de nouvelles fonctionnalités. Cela suggéré qu'il est possible de conserver les avantages des outils existants tout en renseignant les systèmes informatiques et en améliorant l'interaction. Mots clés Informatique papier, papier augmenté, stylo numérique, papier interactif, interfaces tangibles, visualisation, contrôle aérien, conception participative. ABSTRACT Current environment used by air traffic controllers mixes digital visualizations (radar screen), and tangible systems with paper strip. Despite the fact that paper strip are robust, flexible and complementary to the radar screen, authorities decided to abandon it in the profit of digital strip. The main issue of paper strip is that the system does not have access to the information written on it. In this paper, we studied an alternative solution with hybrids Anoto pens with contiuous streaming. We first retrieved important tasks performed by air traffic controller, second, we investigated to find out efficient interaction paradigm for their activity. Finally, we developed and assessed an operational prototype with new functionalities. This suggests that it is possible to retain advantages of existing paper strip while informing informatics systems and improving interaction.
  • [Show abstract] [Hide abstract]
    ABSTRACT: The Living Wall project explores the construction and application of interactive wallpaper. Using conductive, resistive, and magnetic paints we produced wallpaper that enables us to create dynamic, reconfigurable, programmable spaces. The wallpaper consists of circuitry that is painted onto a sheet of paper and a set of electronic modules that are attached to it with magnets. The wallpaper can be used for a multitude of functional and fanciful applications involving lighting, environmental sensing, appliance control, and ambient information display.
    Proceedings of the 18th International Conference on Multimedea 2010, Firenze, Italy, October 25-29, 2010; 01/2010

Full-text (3 Sources)

Available from
May 22, 2014