A virtual performance system and its application on a Noh stage

Conference Paper · January 2009with9 Reads
DOI: 10.1145/1643928.1643998 · Source: DBLP
Conference: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST 2009, Kyoto, Japan, November 18-20, 2009

We have developed a virtual performance system that projects visual images and controls them in a theater easily. This system manages videos and 3D models, and users can control the projected image in real-time. We used the system on a Noh stage. We displayed virtual actors and had them act with the real actors. As a result of evaluations by the audience, we verified that using virtual actors acting with real actors can provide effective stage presentations.

  • [Show abstract] [Hide abstract] ABSTRACT: The idea of combining virtual reality technology and theatrical tra-dition to create virtual plays has captured artists' imaginations for some time. Using conventional technology, the use of virtual char-acters in a theatrical performance often integrates the predefined animations of virtual actors into the theater scene, resulting in a performance that can feel stilted and unresponsive due to its pre-programmed nature. This paper proposes a new system that allows actors to animate virtual characters in real time, resulting in a more flexible and interactive theatrical performance experience. Actors are sequestered at a remote site, invisible to the audience, and are digitized by a motion capture system. Using camera feeds to pro-vide the remote actors with information about the behavior of the live actors and audience in the theater, the remote actors can adapt their virtual counterparts' behavior to react to live events in real-time, giving the illusion to the audience that the virtual characters are responsive to their actions. The system integrates display peripherals, networked cameras, real-time motion capture system, gesture recognition, and a virtual environment development suite (Virtools) to create a true virtual theatrical performance environment. In the paper, we will present the various concepts developed so far and an example of a virtual theatrical performance called Trickster at the Intersection that was presented during Smart Graphics 2010 at Canada's Banff Centre.
    Full-text · Article · Oct 2010
    0Comments 14Citations
  • [Show abstract] [Hide abstract] ABSTRACT: We have been developing a simulation system for dance using a 3D motion archive. Our goal is to provide a supporting system for the creative use of motion data for live performances. We used motion data and this system on a Noh stage, which is normally used by the classic Japanese masked musical drama. The performance was a new Noh based on Shakespeare's Macbeth. One challenge in this performance was to create collaborative scenes of real and virtual actors. We displayed virtual actors on a projection screen. We deployed two real actors and one virtual actor as three witches in the Macbeth story. Another challenge was real-time composition of dance on stage. We controlled one of the virtual actors to dance according to the real actors on the stage. In this paper, we describe the method of choreography composition and our experience using the system in a Noh theater.
    No preview · Conference Paper · Jan 2009
    0Comments 3Citations