Sensory motor remapping of space in human-machine interfaces

Department of Physiology, Northwestern University, Chicago, Illinois, USA.
Progress in brain research (Impact Factor: 5.1). 01/2011; 191:45-64. DOI: 10.1016/B978-0-444-53752-2.00014-X
Source: PubMed

ABSTRACT Studies of adaptation to patterns of deterministic forces have revealed the ability of the motor control system to form and use predictive representations of the environment. These studies have also pointed out that adaptation to novel dynamics is aimed at preserving the trajectories of a controlled endpoint, either the hand of a subject or a transported object. We review some of these experiments and present more recent studies aimed at understanding how the motor system forms representations of the physical space in which actions take place. An extensive line of investigations in visual information processing has dealt with the issue of how the Euclidean properties of space are recovered from visual signals that do not appear to possess these properties. The same question is addressed here in the context of motor behavior and motor learning by observing how people remap hand gestures and body motions that control the state of an external device. We present some theoretical considerations and experimental evidence about the ability of the nervous system to create novel patterns of coordination that are consistent with the representation of extrapersonal space. We also discuss the perspective of endowing human-machine interfaces with learning algorithms that, combined with human learning, may facilitate the control of powered wheelchairs and other assistive devices.

1 Follower
  • Source
    • "Although intuitive decoders give better initial performance, other decoders with worse initial performance are capable of higher learning rates. Further, Mussa-Ivaldi et al. [20] propose that the human motor system attempts to uncover the novel inverse map relating the effect of motor commands on task-relevant variables through learning. This suggests that humans, while learning to perform a task with a novel control space, tend to explore the full space in order to form a complete inverse model. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Myoelectric controlled interfaces have become a research interest for use in advanced prosthetics, exoskeletons, and robot teleoperation. Current research focuses on improving a user's initial performance, either by training a decoding function for a specific user or implementing "intuitive" mapping functions as decoders. However, both approaches are limiting, with the former being subject-specific, and the latter task-specific. This paper proposes a paradigm shift on myoelectric interfaces by embedding the human as controller of the system to be operated. Using abstract mapping functions between myoelectric activity and control actions for a task, this study shows that human subjects are able to control an artificial system with increasing efficiency, by just learning how to control it. The method efficacy is tested by using two different control tasks and four different abstract mappings relating upper limb muscle activity to control actions for those tasks. The results show that all subjects were able to learn the mappings and improve their performance over time. More interestingly, a chronological evaluation across trials reveals that the learning curves transfer across subsequent trials having the same mapping, independent of the tasks to be executed. This implies that new muscle synergies are developed and refined relative to the mapping used by the control task, suggesting that maximal performance may be achieved by learning a constant, arbitrary mapping function rather than dynamic subject- or task-specific functions. Moreover, the results indicate that the method may extend to the neural control of any device or robot, without limitations for anthropomorphism or humanrelated counterparts.
    IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society 01/2014; 22(4). DOI:10.1109/TNSRE.2014.2302212 · 2.82 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Motor skill learning has different components. When we acquire a new motor skill we have both to learn a reliable action-value map to select a highly rewarded action (task model) and to develop an internal representation of the novel dynamics of the task environment, in order to execute properly the action previously selected (internal model). Here we focus on a 'pure' motor skill learning task, in which adaptation to a novel dynamical environment is negligible and the problem is reduced to the acquisition of an action-value map, only based on knowledge of results. Subjects performed point-to-point movement, in which start and target positions were fixed and visible, but the score provided at the end of the movement depended on the distance of the trajectory from a hidden viapoint. Subjects did not have clues on the correct movement other than the score value. The task is highly redundant, as infinite trajectories are compatible with the maximum score. Our aim was to capture the strategies subjects use in the exploration of the task space and in the exploitation of the task redundancy during learning. The main findings were that (i) subjects did not converge to a unique solution; rather, their final trajectories are determined by subject-specific history of exploration. (ii) with learning, subjects reduced the trajectory's overall variability, but the point of minimum variability gradually shifted toward the portion of the trajectory closer to the hidden via-point.
    06/2013; 2013:1-5. DOI:10.1109/ICORR.2013.6650386
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: When performing a skill such as throwing a dart, many different combinations of joint motions suffice to hit the target. The motor system adapts rapidly to reduce bias in the desired outcome (i.e., the first-order moment of the error); however, the essence of skill is to produce movements with less variability (i.e., to reduce the second-order moment). It is easy to see how feedback about success or failure could sculpt performance to achieve this aim. However, it is unclear whether the dimensions responsible for success or failure need to be known explicitly by the subjects, or whether learning can proceed without explicit awareness of the movement parameters that need to change. Here, we designed a redundant, two-dimensional reaching task in which we could selectively manipulate task success and the variability of action outcomes, whilst also manipulating awareness of the dimension along which performance could be improved. Variability was manipulated either by amplifying natural errors, leaving the correlation between the executed movement and the visual feedback intact, or by adding extrinsic noise, decorrelating movement and feedback. We found that explicit, binary, feedback about success or failure was only sufficient for learning when participants were aware of the dimension along which motor behavior had to change. Without such awareness, learning was only present when extrinsic noise was added to the feedback, but not when task success or variability was manipulated in isolation; learning was also much slower. Our results highlight the importance of conscious awareness of the relevant dimension during motor learning, and suggest that higher-order moments of outcome signals are likely to play a significant role in skill learning in complex tasks.
    PLoS ONE 01/2014; 9(1):e86580. DOI:10.1371/journal.pone.0086580 · 3.53 Impact Factor
Show more


Available from