Hiroki Nishino

• Professor (Assistant) at Chang Gung University

We describe our preliminary experiments in hybrid moving images. A hybrid image is generated by synthesizing two different still images into one in such a way that the interpretation can change depending on the viewing distance of either of these two images. However, existing works on hybrid images only apply this technique to still images, and the...

This paper describes Ardestan, a visual programming language (VPL) for Arduino currently under development. The language is designed with art and design students in mind as novice programmers. Although multitasking and event scheduling are essential for interactive prototypes, novices often face difficulty in implementing these features. By borrowi...

Meet in Rain is a serious game on Chinese poetry. While invoking various events, players must complete given tasks, which help them better appreciate the poems, by exploring imaginary sceneries that depict Chinese poems. Its visual design also mimics Chinese paintings in the era when the poems were created. As only a few serious games exist for Chi...

This paper describes "Scented Graphics," our artistic experiments with a scented-printing technique that utilizes an inkjet printer. By mixing water-soluble aromatic oils with inks, an inkjet printer can be utilized to control scent mixing with high precision at almost no extra cost. Such features are hardly provided by the existing scented-printin...

We prototyped interactive digital signage systems with custom-made physical interfaces to investigate how the addition of physical interfaces extends the design space of digital signage. While our investigation is still in the preliminary phase and the prototypes just simply play back video files when triggered by the user's action, this addition o...

This chapter briefly overviews the history of computer music languages and related systems, mainly focusing on those developed in the research community (hence, less focus is put on those commercial computer music software such as digital audio workstation (DAW) software or sound editor software). As is often seen in other surveys of computer music...

Picture books are considered beneficial for children in many ways (e.g., psychological development and language acquisition), yet some children have less opportunity to receive such benefits because of their visual impairment. Considering such a situation, we designed Alice and Her Friend, an interactive book for visually-impaired children. While w...

This chapter briefly overviews the history of computer music languages and related systems, mainly focusing on those developed in the research community (hence, less focus is put on those commercial computer music software such as digital audio workstation (DAW) software or sound editor software). As is often seen in other surveys of computer music...

This paper describes how the short-term Fourier transform (STFT) and inverse short-term Fourier transform (ISTFT) are integrated within the sound synthesis framework of LC, a new computer music programming language, which the authors prototyped, and discusses its benefits for computer music programming. In addition to the traditional unit-generator...

This article describes the design of a framework for sound synthesis in LC, a new computer music language we prototyped, together with concrete code examples. Unlike existing unit-generator languages, LC provides objects as well as library functions and methods that can directly represent microsounds and related manipulations that are involved in m...

This chapter briefly overviews the history of computer music languages and related systems, mainly focusing on those developed in the research community (hence, less focus is put on those commercial computer music software such as digital audio workstation (DAW) software or sound editor software). As is often seen in other surveys of computer music...

This paper describes LC, a new computer music programming language currently under development. LC is a strongly-timed prototype-based programming language for live computer music with lightweight concurrency and lexical closure, the design of which takes the emergence of live-coding performance on laptop computers into consideration as a significa...

In this paper, we describe a novel programming model for microsound synthesis techniques in LCSynth, a strongly-timed sound synthesis language, with concrete examples in granular synthesis and waveset synthesis. Instead of encapsulating microsound synthesis techniques inside unit-generators, LCSynth provides objects and manipulations for microsound...

Strongly-timed programming provides precise timing behaviours in logical time, which is crucial for audio programming. Yet, in the presence of time-consuming tasks, it can easily fail in coordinating the advance of logical time and the passage of real time. This can cause undesirable results, such as unexpected noise in sound output. We propose mos...

The development of computer music languages seems to be considered from outside the computer music community just as contributions in practice rather than in research. Yet, the emerging approach of ''Research through Design (RtD)' in HCI also casts a significant question as to how the academic contribution can be made through the design of such DSL...

Programming languages have been rarely discussed from the perspective of user-centered design when compared to GUIs or Human Interface Devices. We de-scribe our case study in user-centered design of a do-main-specific language (DSL) for computer music. Since the potential usability problems of a DSL is large-ly unforeseeable in the early phase of t...

In this paper, we describe LCSynth, a new sound synthe-sis language currently under development, which inte-grates objects and manipulation for microsounds in its language design. Such an integration of objects and ma-nipulations for microsounds into sound synthesis frame-work can facilitate creative exploration in microsound synthesis techniques,...

In this paper, we discuss user-centered design of end-user programming languages with an example of computer music language. We describe an approach to analyze the misfits between the users' conceptualization and the programming language design in an existing usability problem with a focus on the abstraction layers both in conceptualization and lan...

We developed a novel marker tracking method with shape-free designable markers, which can be visually meaningful to users. The method can work fast enough to provide a real-time camerabased interaction even on low performance CPUs such as one used in mobile Internet devices. Features such as visually communicative design and inexpensive computation...

We encountered 3 patients with symptoms of oral allergy syndrome (OAS) and anaphylactic reactions to soymilk. CAP-RAST analysis showed negative findings for soybean but was positive for Glym4. These patients also had past history of birch pollen allergy and/or OAS in response to certain fruits. These cases all seemed to have class 2 food allergies...

Markers are widely used for camera-based interaction. Yet, most of the marker tracking methods have considerable limitations in shapes and designs; they are not usually visually meaningful to the users. Such an issue on visually communicative designs can be very important to provide visual cues in a mobile/pervasive environment where a user must fi...

In this paper, we describe Topolo Surface, a 2D fiducial tracking system we developed. Topolo Surface is a prototype system that implements a novel fiducial tracking method based on the combination of topological region adjacency and angle information. Existing systems based only on topological region adjacency information, such as D-Touch and Reac...

Oberhausen Requiem (see also Color Plate E) is a site-specific electroacoustic live performance designed and implemented for the huge Gasometer in Oberhausen, Germany, and captured on video. The original live performance took place multiple times on 8 and 22 September 2007. The Gasometer is not functional as industrial space today but is still one...

In this paper, we describe a new method for camera-based fiducial tracking. Our new method is based on the combination of topological region adjacency and angle information, where as related works by Johnston's RAG target [7], Costanza's D-Touch [3], and Kaltenbrunner's reacTIVision [2] are based on the uniqueness of the topological region adjacenc...

Recently, the extension of card games by interactive systems has been rapidly popular in gaming industry. Camera-based Tracking can play an important role to build such interactive card games at a low cost, without any special hardware. Split markers can be useful for such card games since the space between the markers can be used for pictures that...

A case of atopic dermatitis complicated with Asperger's disorder and learning disorder was reported and our effort and measure are described to manage this complex disorder. The patient is a 13-year-old boy who has a severe atopic dermatitis since infant. At the age of 9, he was diagnosed having Asperger's disorder and learning disorder by child ps...

DXRenderFarm is distributed rendering software for Maya® on Mac OS X, build upon Xgrid, Apple's grid computing technology. Since it was originally developed for computer graphics courses at DXARTS, University of Washington, it mainly targets the use in the open environment where a number of the students need to share the computational resources to...

Tre Marie is an interactive audio-visual dance improvised performance. The system in progress is a RF-ID (radio-frequency identification) technology for dance performance, which improvises, live visuals on stage. The performance is a reconstructed architecture of space that encodes the spatial aesthetics of the interaction between human, theatrical...