Musink: Composing Music through Augmented Drawing

04/2009; DOI: 10.1145/1518701.1518827

ABSTRACT We focus on the creative use of paper in the music composition process, particularly the interaction between paper and end-user programming. When expressing musical ideas, composers draw in a precise way, not just sketch. Working in close collaboration with composers, we designed Musink to provide them with a smooth transition between paper drawings and OpenMusic, a flexible music composition tool. Musink's built-in recognizers handle common needs, such as scoping and annotation. Users can also define new gestures and associate them with their own or predefined software functions. Musink supports semi-structured, delayed interpretation and serves as a customizable gesture browser, giving composers significant freedom to create their own, individualized composition languages and to experiment with music, on-paper and on-line.

Download full-text


Available from: Catherine Letondal, Aug 30, 2015
  • Source
    • "Yet even composers with computer skills and access to advanced composition systems prefer to sketch their early creative ideas on paper [9] [10]. Paper helps creative professionals externalize their ideas [11] and composers often create their own personal languages to express musical ideas [12], which are difficult to translate into computer terms. One method for bridging the gap between physical paper and composition software is interactive paper. "
    [Show abstract] [Hide abstract]
    ABSTRACT: A Tonnetz, or "tone-network" in German, is a two-dimensional representation of the relationships among musical pitches. In this paper, we present PaperTonnetz, a tool that lets musicians explore and compose music with Tonnetz representations by making gestures on interactive paper. In addition to triggering musical notes with the pen as a button based-interface, the drawn gestures become interactive paths that can be used as chords or melodies to support composition.
  • Source
    • "He argued that initial expression on paper is a 'delicate' phase and he does not want to be distracted by technology, i.e. live feedback that communicates state transitions and recognition errors. Musink [21], our first system, was designed explicitly to support the early creative phase, avoiding the interruption problem because data interpretation on first generation pens was delayed until it was uploaded to the computer. Although newer wireless pens offer real-time feedback, we recommend limiting this to later exploratory phases, when it is less disruptive. "
    [Show abstract] [Hide abstract]
    ABSTRACT: We conducted three studies with contemporary music compos-ers at IRCAM. We found that even highly computer-literate composers use an iterative process that begins with expressing musical ideas on paper, followed by active parallel exploration on paper and in software, prior to final execution of their ideas as an original score. We conducted a participatory design study that focused on the creative exploration phase, to design tools that help composers better integrate their paper-based and elec-tronic activities. We then developed InkSplorer as a technology probe that connects users' hand-written gestures on paper to Max/MSP and OpenMusic. Composers appropriated InkSplorer according to their preferred composition styles, emphasizing its ability to help them quickly explore musical ideas on paper as they interact with the computer. We conclude with recommen-dations for designing interactive paper tools that support the creative process, letting users explore musical ideas both on paper and electronically.
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: 修士(Master) 工学(Engineering) 奈良先端科学技術大学院大学 修第4612号
Show more