AiRome DH2015 Workshop

Presentation (PDF Available) · October 2015with 35 Reads
Digital Heritage 2015, Granada, CNR ITABC
Abstract
The installation proposal for DH15 Expo is composed by two different gesture-based applications that aim to create a shared experience and a collaborative gameplay among visitors. The first application (“Admotum”) consists in a serious game that allows the visitor to virtually explore 3D reconstructed environments using body gestures and motions, through the use of a microsoft Kinect sensor. The main goal of the exploration is finding a few objects displayed in the Imperial Fora Museum (Rome, Italy) in their original context, following the Treasure Hunt game mechanics. It is very different from traditional approaches since it allows the visitor to navigate in and interact with a virtual environment in three dimensions, including manipulation techniques to interact with multi-scale objects. The user performs actions in the virtual environment by means of gestures and other body movements. The second application (“Holobox”) is an inspection unit, consisting of an holographic display and a Leap Motion controller to allow the user to interact with virtual objects. The proposed solution is a reinterpretation of the immersive Pepper’s Ghost theatrical technique. The application provides a flexible and accessible system for “holographic” display and enables the possibility to integrate real-time manipulation by natural interaction paradigms. Concerning the latter, the ability to explore the 3D model is supported by the Leap motion controller. The optical illusion allow the users to visualize a virtual object fluctuating in the air, providing the illusion of 3D volumes and transparencies. The inspection unit behaves conceptually as a “magnifier”, to further investigate a virtual item or to provide additional information. A local net layer (wireless) allows the two applications to communicate to create an advanced and engaging gesture-based context, where users can pass items from one application to the other, reinforced by visual, dynamic floor animations. This layer allows also external visitors to participate to the collaborative experience by connecting to the local net and using their mobile devices to interact with active users by influencing gameplay visual appearance, hints and other factors, enabling a shared and engaging experience.
AiRome
Bruno Fanini, Enzo D'Annibale
VHLab, CNR ITABC
(Rome, Italy)
AiRome
AiRome is composed by two connected
gesture-based applications
Admotum + Holoint
- Presented @ Keys2Rome exhibit (V-MusT)
- Serious Game + Inspection Unit concept
Evolved installation @ DH2015
floor interface, remote control, ...
Admotum + HoloINT (K2R)
Virtual Environments
Virtual Environments
Create a shared experience and a collaborative
gameplay among visitors
Contextualize virtual objects within
reconstructed environments
- Serious Game
Inspect and manipulate virtual objects
- Inspection Unit
Allow observing/waiting visitors to participate
to gameplay
AiRome (DH15) - Goals
Different professionals involved
Further details on 3D content pipeline
and Evaluation activities:
"Engaging and Shared Gesture-based
Interaction for Museums"
T2 FP9 "Interaction with Virtual Worls"
1st October @ 14:30 PM
Workflow
Setup
Floor
2 PC: ~1.500 eu
2 Projectors + proj screen: ~2.500 eu
Kinect + Leap Motion Controller: ~200 eu
Monitor: ~500 eu
~5.000 eu total
Setup costs (est.)
Video
Extended "Air" interaction
- Gesture-based to gesture-based
- Remote interaction (wi-fi)
- Skeleton streaming (active user) via web
- Expand interaction space, go beyond "the box"
Dynamic floor interface
- Reacts to events from both installations
- Visitors can drop messages/comments
Communication and integration between different
technologies and frameworks
Reusable + modular software components
(e.g.: different V.E., objects, interaction spaces, etc.)
AiRome tech results
This research hasn't been cited in any other publications.
This research doesn't cite any other publications.