Musink: Composing Music through Augmented Drawing

Conference on Human Factors in Computing Systems - Proceedings 04/2009; DOI: 10.1145/1518701.1518827


We focus on the creative use of paper in the music composition process, particularly the interaction between paper and end-user programming. When expressing musical ideas, composers draw in a precise way, not just sketch. Working in close collaboration with composers, we designed Musink to provide them with a smooth transition between paper drawings and OpenMusic, a flexible music composition tool. Musink's built-in recognizers handle common needs, such as scoping and annotation. Users can also define new gestures and associate them with their own or predefined software functions. Musink supports semi-structured, delayed interpretation and serves as a customizable gesture browser, giving composers significant freedom to create their own, individualized composition languages and to experiment with music, on-paper and on-line.

Download full-text


Available from: Catherine Letondal,
  • Source
    • "Visual feature analysis and sonification are explored in [4], in which fingerprint features were extracted to sonic parameters as a sonification approach. [5] presented an interactive music composition platform via paper drawing. "
    [Show abstract] [Hide abstract]
    ABSTRACT: In this paper we introduce SoZen, a novel interface for parameterizing aspects of ambient soundscapes including ambient music and peripheral sonifications using a Zen Garden. The SoZen system is both a stylish and aesthetic artifact in daily living environments and a computer-vision-based tangible and malleable representation for sound features. Due to the immediate correspondence between the arrangement of stones and the shape of sand with sonic features it also becomes a persistent visualization of the current sonic ambience. Thus it offers a conceptually different and 'calm' way of reviewing and specifying sounds. The paper focuses on the conceptual ideas and showcases our current system. We demonstrate some initial ambiences and conclude with current ideas on how to embed and evaluate SoZen in the context of a smart apartment environment.
    Coginfocom 2015, 6th IEEE International Conference on Cognitive Inforcommunications; 10/2015
  • Source
    • "Musically oriented interactive paper applications pose special challenges, since composers often sketch on paper to express personal or ill-formed musical ideas that cannot be represented easily with traditional musical representations [11] [12] [16] [21]. For example, Musink [22] helps composers define their own annotations with respect to musical scores and link them to computerbased functions. InkSplorer [7] lets composers draw hand-written curves to control computer programs and PaperTonnetz [3] lets composers explore melodies and chords within hexagonal-shaped sets of tone networks. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Interactive paper technologies offer new opportunities for supporting the highly individual practices of creative artists, such as contemporary music composers, who express and explore their ideas on both paper and the computer. We introduce PaperComposer, a graphical interface builder that allows users to create a personalized interactive paper interface that they can connect to their own computer-based musical data. We also present an API that facilitates the development of interactive paper components for PaperComposer. We describe one public demonstration of a novel musical interface designed for children and our collaborations with composers to create two novel interactive music interfaces that reflected their individual composition styles.
  • Source
    • "Previous works explored how this technology could support the work of contemporary music composers. The Musink project [11] showed that they could intuitively use it to develop personal notations on paper over time. The annotations over printed scores were recognized and mapped to online functions. "

Show more