Conference Paper

Effects of interactivity and 3D-motion on mental rotation brain activity in an immersive virtual environment

DOI: 10.1145/1753326.1753454 Conference: CHI 2010

ABSTRACT The combination of virtual reality (VR) and brain measurements is a promising development of HCI, but the maturation of this paradigm requires more knowledge about how brain activity is influenced by parameters of VR applications. To this end we investigate the influence of two prominent VR parameters, 3d-motion and interactivity, while brain activity is measured for a mental rotation task, using functional MRI (fMRI). A mental rotation network of brain areas is identified, matching previous results. The addition of interactivity increases the activation in core areas of this network, with more profound effects in frontal and preparatory motor areas. The increases from 3d-motion are restricted to primarily visual areas. We relate these effects to emerging theories of cognition and potential applications for brain-computer interfaces (BCIs). Our results demonstrate one way to provoke increased activity in task-relevant areas, making it easier to detect and use for adaptation and development of HCI.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The idea of realistic HCI, as described with Reality-Based Interaction, continuously adapting to the users experience of the interaction, is a grand vision. Reality-Based Brain-Computer Interaction (RBBCI) is a conception of a system implementing this idea by combining Virtual Reality with functional brain imaging (fMRI) and appropriate methods of analysis and interpretation. The development of such systems can benefit greatly from a solid grounding in emerging theories of cognition and the brain. We present examples of such cognitive grounding and relate them to RBBCI, models of interaction and methods for interpretation of brain measurements. Recent results include the effect of interactivity on brain activity measurements in an immersive VR environment.
    CHI 2010 Workshop on Brain, Body and Bytes: Psychophysiological User Interaction, Atlanta, Georgia, USA; 04/2010


Available from
Jun 1, 2014