Intention estimation in brain-machine interfaces
ABSTRACT The objective of this work was to quantitatively investigate the mechanisms underlying the performance gains of the recently reported 'recalibrated feedback intention-trained Kalman Filter' (ReFIT-KF).
This was accomplished by designing variants of the ReFIT-KF algorithm and evaluating training and online data to understand the neural basis of this improvement. We focused on assessing the contribution of two training set innovations of the ReFIT-KF algorithm: intention estimation and the two-stage training paradigm.
Within the two-stage training paradigm, we found that intention estimation independently increased target acquisition rates by 37% and 59%, respectively, across two monkeys implanted with multiunit intracortical arrays. Intention estimation improved performance by enhancing the tuning properties and the mutual information between the kinematic and neural training data. Furthermore, intention estimation led to fewer shifts in channel tuning between the training set and online control, suggesting that less adaptation was required during online control. Retraining the decoder with online BMI training data also reduced shifts in tuning, suggesting a benefit of training a decoder in the same behavioral context; however, retraining also led to slower online decode velocities. Finally, we demonstrated that one- and two-stage training paradigms performed comparably when intention estimation is applied.
These findings highlight the utility of intention estimation in reducing the need for adaptive strategies and improving the online performance of BMIs, helping to guide future BMI design decisions.
- SourceAvailable from: K.G. Oweiss
[Show abstract] [Hide abstract]
- "This learning trend results in larger performance gains within daily sessions (Ganguly and Carmena, 2010; Krakauer and Mazzoni, 2011). A more recent study reported that a two-stage decoder calibration process – in which the first stage initializes the decoder while the other recalibrates it based on closed loop brain control data – results in a reduction in the observed changes in neuronal tuning between training and test data (Fan et al., 2014). Since the decoder defines a causal link between the neural activity and the state of the end effector, a few studies have examined the extent to which subjects could learn to adapt to perturbations to a given decoding rule (Jarosiewicz et al., 2008; Chase et al., 2012; Sadtler et al., 2014; Ganguly and Carmena, 2009; Golub et al., 2012). "
ABSTRACT: Neuroplasticity is key to the operation of brain machine interfaces (BMIs)-a direct communication pathway between the brain and a man-made computing device. Whereas exogenous BMIs that associate volitional control of brain activity with neurofeedback have been shown to induce long lasting plasticity, endogenous BMIs that use prolonged activity-dependent stimulation - and thus may curtail the time scale that governs natural sensorimotor integration loops - have been shown to induce short lasting plasticity. Here we summarize recent findings from studies using both categories of BMIs, and discuss the fundamental principles that may underlie their operation and the longevity of the plasticity they induce. We draw comparison to plasticity mechanisms known to mediate natural sensorimotor skill learning and discuss principles of homeostatic regulation that may constrain endogenous BMI effects in the adult mammalian brain. We propose that BMIs could be designed to facilitate structural and functional plasticity for the purpose of re-organization of target brain regions and directed augmentation of sensorimotor maps, and suggest possible avenues for future work to maximize their efficacy and viability in clinical applications. Copyright © 2015. Published by Elsevier Inc.Neurobiology of Disease 05/2015; DOI:10.1016/j.nbd.2015.05.001 · 5.20 Impact Factor
[Show abstract] [Hide abstract]
- "The Kalman filter’s Gaussian noise model clearly does not match the data (spike counts), yet due to its accuracy and execution speed the method has remained popular since its first use by Wu et al. (2003) (Aggarwal et al., 2013; Chen et al., 2013; Dangi et al., 2013a,c; Homer et al., 2013; Ifft et al., 2013; Jarosiewicz et al., 2013; Kao et al., 2013; Merel et al., 2013; Wong et al., 2013; Zhang and Chase, 2013; Fan et al., 2014; Golub et al., 2014; Gowda et al., 2014; Homer et al., 2014). While point process filters (for a review, see Koyama et al., 2010) offer a more realistic noise model, their use in decoding is still relatively rare (Shanechi et al., 2013; Velliste et al., 2014; Xu et al., 2014), due in part to their heavier computational burden. "
ABSTRACT: This article reviews advances in decoding methods for brain-machine interfaces (BMIs). Recent work has focused on practical considerations for future clinical deployment of prosthetics. This review is organized by open questions in the field such as what variables to decode, how to design neural tuning models, which neurons to select, how to design models of desired actions, how to learn decoder parameters during prosthetic operation, and how to adapt to changes in neural signals and neural tuning. The concluding discussion highlights the need to design and test decoders within the context of their expected use and the need to answer the question of how much control accuracy is good enough for a prosthetic.Frontiers in Systems Neuroscience 07/2014; 8:129. DOI:10.3389/fnsys.2014.00129
- [Show abstract] [Hide abstract]
ABSTRACT: The brain–computer interface (BCI) has made remarkable progress in the bridging the divide between the brain and the external environment to assist persons with severe disabilities caused by brain impairments. There is also continuing philosophical interest in BCIs which emerges from thoughtful reflection on computers, machines, and artificial intelligence. This article seeks to apply BCI perspectives to examine, challenge, and work towards a possible resolution to a persistent problem in the mind–body relationship, namely dualism. The original humanitarian goals of BCIs and the technological inventiveness result in BCIs being surprisingly useful. We begin from the neurologically impaired person, the problems encountered, and some pioneering responses from computers and machines. Secondly, the interface of mind and brain is explored via two points of clarification: direct and indirect BCIs, and the nature of thoughts. Thirdly, dualism is beset by mind–body interaction difficulties and is further questioned by the phenomena of intentions, interactions, and technology. Fourthly, animal minds and robots are explored in BCI settings again with relevance for dualism. After a brief look at other BCIs, we conclude by outlining a future BCI philosophy of brain and mind, which might appear ominous and could be possible.AI & Society 01/2014; DOI:10.1007/s00146-014-0545-8