Conference Paper

Effects of interactivity and 3D-motion on mental rotation brain activity in an immersive virtual environment

DOI: 10.1145/1753326.1753454 Conference: CHI 2010


The combination of virtual reality (VR) and brain measurements is a promising development of HCI, but the maturation of this paradigm requires more knowledge about how brain activity is influenced by parameters of VR applications. To this end we investigate the influence of two prominent VR parameters, 3d-motion and interactivity, while brain activity is measured for a mental rotation task, using functional MRI (fMRI). A mental rotation network of brain areas is identified, matching previous results. The addition of interactivity increases the activation in core areas of this network, with more profound effects in frontal and preparatory motor areas. The increases from 3d-motion are restricted to primarily visual areas. We relate these effects to emerging theories of cognition and potential applications for brain-computer interfaces (BCIs). Our results demonstrate one way to provoke increased activity in task-relevant areas, making it easier to detect and use for adaptation and development of HCI.

Download full-text


Available from: Johan Eriksson, Apr 07, 2014
1 Follower
25 Reads
  • Source
    • "In another study, Sjölie et al. (2010) analyzed the brain activations due to a mental rotation task. Although they did not measure presence, two other important VR parameters were analyzed: 3D-motion and interactivity. "
    [Show abstract] [Hide abstract]
    ABSTRACT: In the field of virtual reality (VR),many efforts have beenmade to analyze presence, the sense of being in the virtual world. However, it is only recently that functional magnetic resonance imaging (fMRI) has been used to study presence during an automatic navigation through a virtual environment. In the present work, our aim was to use fMRI to study the sense of presence during a VR-free navigation task, in comparison with visualization of photographs and videos (automatic navigations through the same environment). The main goal was to analyze the usefulness of fMRI for this purpose, evaluating whether, in this context, the interaction between the subject and the environment is performed naturally, hiding the role of technology in the experience.We monitored 14 right-handed healthy females aged between 19 and 25 years. Frontal, parietal and occipital regions showed their involvement during free virtual navigation.Moreover, activation in the dorsolateral prefrontal cortex was also shown to be negatively correlated to sense of presence and the postcentral parietal cortex and insula showed a parametric increased activation according to the condition-related sense of presence, which suggests that stimulus attention and self-awareness processes related to the insula may be linked to the sense of presence.
    Interacting with Computers 07/2013; 26(3). DOI:10.1093/iwc/iwt037 · 1.27 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The idea of realistic HCI, as described with Reality-Based Interaction, continuously adapting to the users experience of the interaction, is a grand vision. Reality-Based Brain-Computer Interaction (RBBCI) is a conception of a system implementing this idea by combining Virtual Reality with functional brain imaging (fMRI) and appropriate methods of analysis and interpretation. The development of such systems can benefit greatly from a solid grounding in emerging theories of cognition and the brain. We present examples of such cognitive grounding and relate them to RBBCI, models of interaction and methods for interpretation of brain measurements. Recent results include the effect of interactivity on brain activity measurements in an immersive VR environment.
    CHI 2010 Workshop on Brain, Body and Bytes: Psychophysiological User Interaction, Atlanta, Georgia, USA; 04/2010
  • [Show abstract] [Hide abstract]
    ABSTRACT: To assess linguistic development in patients with mild and moderate Alzheimer's disease (AD) who underwent treatment with a drug and regularly performed language activities. For 12 months, five patients with mild-to-moderate AD participated in a Stimulation-Activation-Training programme (SAT) including pragmatic, semantic, writing, conversation and counting sessions. A computer with exercise programs and a keyboard with a printer were used as complements to ordinary stationery. The linguistic competence was assessed using a standardized assessment tool. The assessment indicated preservation or slight changes of the patients' linguistic competence over the period and greater confidence in the management of the language. The personal computer system was a well accepted novelty. The documented approach, SAT training interlaced with everyday life tasks, may be helpful in maintaining and improving remaining language functions in patients with mild or moderate AD.
    Developmental neurorehabilitation 06/2011; 14(3):156-63. DOI:10.3109/17518423.2011.566594 · 2.05 Impact Factor