Enhancement of Stage Performances by Projecting CG Animation and Control of Images with Sensors
ABSTRACT We have been producing live stage performances using computer graphics (CG) and interactive techniques. We developed a system to support and enhance live performances. This system projects CG onstage alongside real actors and allows users to control the projected images in real time. Collaborative scenes between real actors and virtual actors created by CG are possible. The system has multi-functions and is flexible, hence, it can be used for purposes other than performances. The system helps directors and actors in the creation of performances, as well as during rehearsals. Moreover, the system is portable and easy to set up in various types of theaters. The system can use sensor devices to determine physical expressions of actors or spectators. These perceived states can be used to affect projected images, which can provide a richer presentation. This paper describes the structure of the system and its effects in live performances that we attempted.
Conference Paper: Movement-based interactive dance performance.[Show abstract] [Hide abstract]
ABSTRACT: Movement-based interactive dance has recently attracted great interest in the performing arts. While utilizing motion capture technology, the goal of this project was to design the necessary real-time motion analysis engine, staging, and communication systems for the completion of a movement-based interactive multimedia dance performance. The movement analysis engine measured the correlation of dance movement between three people wearing similar sets of retro-reflective markers in a motion capture volume. This analysis provided the framework for the creation of an interactive dance piece, Lucidity, which will be described in detail. Staging such a work also presented additional challenges. These challenges and our proposed solutions will be discussed. We conclude with a description of the final work and a summary of our future research objectives.Proceedings of the 14th ACM International Conference on Multimedia, Santa Barbara, CA, USA, October 23-27, 2006; 01/2006
[Show abstract] [Hide abstract]
ABSTRACT: Recently many live performances use projected visual images and videos. Our goal is to provide a supporting system for the creative use of CG animation for live performances. This paper describes a method of supporting live stage performances by projecting computer-created visual images. We developed a system to project images in a theatre, and then staged performances with both living actors and virtual CG animations. The system can project images in various types of theatres, and can adapt to the trial and error of rehearsals, not constricted to pre-set programs in actual performances. This paper describes our experience with one of our performances featuring collaborative scenes of actual actors with virtual actors created by CG with human motion-data. Moreover we created transitions representing paradise and various levels of hell. After the performances, we received comments from director and spectators that the projection of CG animations was a fascinating and powerful method for combining live performances and CG.
[Show abstract] [Hide abstract]
ABSTRACT: The Tele-immersive Dance Environment (TED) is a geographically distributed, real-time 3-D virtual room where multiple participants interact independent of physical distance. TED, a highly interactive collaborative environment, offers digital options with multiple viewpoints, enhancing the creative movement composition involved with dance choreography. A symbiotic relationship for creativity and design exists between dance artists and computer scientists as the tele-immersive environment is analyzed as a creativity and learning tool. We introduce the advancements of the interactive digital options, new interface developments, user study results, and the possibility of a computational model for human creativity through Laban Movement Analysis.Proceedings of the 16th International Conference on Multimedia 2008, Vancouver, British Columbia, Canada, October 26-31, 2008; 01/2008