Jose M Carmena

University of California, Berkeley, Berkeley, California, United States

Are you Jose M Carmena?

Claim your profile

Publications (117)345.25 Total impact

  • Preeya Khanna, Jose M Carmena
    [Show abstract] [Hide abstract]
    ABSTRACT: Local field potential (LFP) activity in motor cortical and basal ganglia regions exhibits prominent beta (15-40Hz) oscillations during reaching and grasping, muscular contraction, and attention tasks. While in vitro and computational work has revealed specific mechanisms that may give rise to the frequency and duration of this oscillation, there is still controversy about what behavioral processes ultimately drive it. Here, simultaneous behavioral and large-scale neural recording experiments from non-human primate and human subjects are reviewed in the context of specific hypotheses about how beta band activity is generated. Finally, a new experimental paradigm utilizing operant conditioning combined with motor tasks is proposed as a way to further investigate this oscillation. Copyright © 2014 Elsevier Ltd. All rights reserved.
    Current Opinion in Neurobiology 06/2015; 32. · 6.77 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Brain-machine interface (BMI) technology has tremendous potential to revolutionize healthcare by greatly im-proving the quality of life of millions of people suffering from a wide variety of neurological conditions. Radio-frequency identi-fication (RFID)-inspired backscattering is a promising approach for wireless powering of miniature neural sensors required in BMI interfaces. We analyze the functionality of millimeter-size loop antennas in the wireless powering of miniature cortical implants through measurements ina human head equivalent liquid phantom and in the head of a postmortem pig. For the first time, we present the design and measurement of a miniature 1x1x1 mm3 backscattering device based on a cubic loop connected with an RFID integrated circuit (IC). Our measurement results show that this very small loop receives sufficient electro-magnetic powertoactivatethe IC whenthedeviceisimplanted in a pig's head. This demonstrates the feasibility of extremely small implant antennas in challenging wireless biomedical systems
    IEEE Transactions on Antennas and Propagation 02/2015; 63(2):719. · 2.46 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Emerging applications in brain-machine interface systems require high-resolution, chronic multisite cortical recordings, which cannot be obtained with existing technologies due to high power consumption, high invasiveness, or inability to transmit data wirelessly. In this paper, we describe a microsystem based on electrocorticography (ECoG) that overcomes these difficulties, enabling chronic recording and wireless transmission of neural signals from the surface of the cerebral cortex. The device is comprised of a highly flexible, high-density, polymer-based 64-channel electrode array and a flexible antenna, bonded to 2.4 mm x 2.4 mm CMOS integrated circuit (IC) that performs 64-channel acquisition, wireless power and data transmission. The IC digitizes the signal from each electrode at 1 kS/s with 1.2 μV input referred noise, and transmits the serialized data using a 1 Mb/s backscattering modulator. A dual-mode power-receiving rectifier reduces data-dependent supply ripple, enabling the integration of small decoupling capacitors on chip and eliminating the need for external components. Design techniques in the wireless and baseband circuits result in over 16x reduction in die area with a simultaneous 3x improvement in power efficiency over the state of the art. The IC consumes 225 μW and can be powered by an external reader transmitting 12 mW at 300 MHz, which is over 3x lower than IEEE and FCC regulations.
    IEEE Journal of Solid-State Circuits 01/2015; 50(1):344. · 3.11 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Brain-machine interfaces (BMI) hold great po-tential to improve the quality of life of many patients with disabilities. The neural decoder, which expresses the mapping between the neural signals and the subject's motion, plays an important role in BMI systems. Conventional neural decoders are generally in the form of a kinematic Kalman filter which does not possess an explicit mechanism to deal with the unavoid-able mismatch between the biological system and the model of the system used by the decoder. This paper presents a novel design of a neural decoder that uses a one-step model predictive controller to generate a control signal that compensates for the inherent model mismatch. The effectiveness of the proposed decoding algorithm compares favorably to the state-of-the-art Kalman filter in numerical simulations with different degrees of model mismatch.
    Control and Decisions Conference; 12/2014
  • Krishna V Shenoy, Jose M Carmena
    [Show abstract] [Hide abstract]
    ABSTRACT: Brain-machine interfaces (BMIs) aim to help people with paralysis by decoding movement-related neural signals into control signals for guiding computer cursors, prosthetic arms, and other assistive devices. Despite compelling laboratory experiments and ongoing FDA pilot clinical trials, system performance, robustness, and generalization remain challenges. We provide a perspective on how two complementary lines of investigation, that have focused on decoder design and neural adaptation largely separately, could be brought together to advance BMIs. This BMI paradigm should also yield new scientific insights into the function and dysfunction of the nervous system. VIDEO ABSTRACT: Copyright © 2014 Elsevier Inc. All rights reserved.
    Neuron 11/2014; 84(4):665-680. · 15.77 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: A major hurdle in brain-machine interfaces (BMI) is the lack of an implantable neural interface system that remains viable for a substantial fraction of the user's lifetime. Recently, sub-mm implantable, wireless electromagnetic (EM) neural interfaces have been demonstrated in an effort to extend system longevity. However, EM systems do not scale down in size well due to the severe inefficiency of coupling radio-waves at those scales within tissue. This paper explores fundamental system design trade-offs as well as size, power, and bandwidth scaling limits of neural recording systems built from low-power electronics coupled with ultrasonic power delivery and backscatter communication. Such systems will require two fundamental technology innovations: 1) 10-100μm scale, free-floating, independent sensor nodes, or neural dust, that detect and report local extracellular electrophysiological data via ultrasonic backscattering, and 2) a sub-cranial ultrasonic interrogator that establishes power and communication links with the neural dust. We provide experimental verification that the predicted scaling effects follow theory; (127μm)(3) neural dust motes immersed in water 3cm from the interrogator couple with 0.002064% power transfer efficiency and 0.04246ppm backscatter, resulting in a maximum received power of ∼0.5μW with ∼1 nW of change in backscatter power with neural activity. The high efficiency of ultrasonic transmission can enable the scaling of the sensing nodes down to 10's of μm. We conclude with a brief discussion of the application of neural dust for both central and peripheral nervous system recordings, and perspectives on future research directions.
    Journal of Neuroscience Methods 08/2014; · 1.96 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Brain-machine interface (BMI) performance has been improved using Kalman filters (KF) combined with closed-loop decoder adaptation (CLDA). CLDA fits the decoder parameters during closed-loop BMI operation based on the neural activity and inferred user velocity intention. These advances have resulted in the recent ReFIT-KF and SmoothBatch-KF decoders. Here we demonstrate high-performance and robust BMI control using a novel closed-loop BMI architecture termed adaptive optimal feedback-controlled (OFC) point process filter (PPF). Adaptive OFC-PPF allows subjects to issue neural commands and receive feedback with every spike event and hence at a faster rate than the KF. Moreover, it adapts the decoder parameters with every spike event in contrast to current CLDA techniques that do so on the time-scale of minutes. Finally, unlike current methods that rotate the decoded velocity vector, adaptive OFC-PPF constructs an infinite-horizon OFC model of the brain to infer velocity intention during adaptation. Preliminary data collected in a monkey suggests that adaptive OFC-PPF improves BMI control. OFC-PPF outperformed SmoothBatch-KF in a self-paced center-out movement task with 8 targets. This improvement was due to both the PPF's increased rate of control and feedback compared with the KF, and to the OFC model suggesting that the OFC better approximates the user's strategy. Also, the spike-by-spike adaptation resulted in faster performance convergence compared to current techniques. Thus adaptive OFC-PPF enabled proficient BMI control in this monkey.
    08/2014; 2014:6493-6.
  • [Show abstract] [Hide abstract]
    ABSTRACT: In this paper, we examine the use of beamforming techniques to interrogate a multitude of neural implants in a distributed, ultrasound-based intra-cortical recording platform known as Neural Dust [1]. We propose a general framework to analyze system design tradeoffs in the ultrasonic beamformer that extracts neural signals from modulated ultrasound waves that are backscattered by free-floating neural dust (ND) motes. Simulations indicate that high-resolution linearly-constrained minimum variance beamforming sufficiently suppresses interference from unselected ND motes and can be incorporated into the ND-based cortical recording system.
    08/2014; 2014:2625-8.
  • IEEE International Symposium on Antennas and Propagation; 07/2014
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Brain-Machine Interfaces (BMI) have strong po-tential to benefit a large number of disabled people but current decoding algorithms suffer from the following shortcomings. First, BMI decoding algorithms are often trained offline, but this paradigm ignores the discrepancy between the Manual Control (MC) and the Brain Control (BC) modes of operation. Second, the standard neural decoder, the Kalman filter, does not explicitly take into account the control of movements by neural activity. To address these problems, we propose a biologically motivated neural decoder structure by explicitly adding a control signal and unmeasureable neural activity. Since the parameter estimation problem is underdetermined, we propose a new parameter estimation method that minimizes the discrepancy between the MC and BC. We demonstrate the effectiveness of our methods by synthesizing MC and BC data in a Linear Quadratic (LQ) optimal control setting with a partial loss of neural control in BC, and show that the proposed decoder is more robust to a partial loss of neural control than a standard Kalman filter that does not utilize any reparameterizations.
    European Control Conference, Strasbourg, France; 06/2014
  • [Show abstract] [Hide abstract]
    ABSTRACT: Neuroplasticity may play a critical role in developing robust, naturally controlled neuroprostheses. This learning, however, is sensitive to system changes such as the neural activity used for control. The ultimate utility of neuroplasticity in real-world neuroprostheses is thus unclear. Adaptive decoding methods hold promise for improving neuroprosthetic performance in nonstationary systems. Here, we explore the use of decoder adaptation to shape neuroplasticity in two scenarios relevant for real-world neuroprostheses: nonstationary recordings of neural activity and changes in control context. Nonhuman primates learned to control a cursor to perform a reaching task using semistationary neural activity in two contexts: with and without simultaneous arm movements. Decoder adaptation was used to improve initial performance and compensate for changes in neural recordings. We show that beneficial neuroplasticity can occur alongside decoder adaptation, yielding performance improvements, skill retention, and resistance to interference from native motor networks. These results highlight the utility of neuroplasticity for real-world neuroprostheses.
    Neuron 06/2014; 82(6):1380-93. · 15.77 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Closed-loop decoder adaptation (CLDA) is an emerging paradigm for both improving and maintaining online performance in brain-machine interfaces (BMIs). The time required for initial decoder training and any subsequent decoder recalibrations could be potentially reduced by performing continuous adaptation, in which decoder parameters are updated at every time step during these procedures, rather than waiting to update the decoder at periodic intervals in a more batch-based process. Here, we present recursive maximum likelihood (RML), a CLDA algorithm that performs continuous adaptation of a Kalman filter decoder's parameters. We demonstrate that RML possesses a variety of useful properties and practical algorithmic advantages. First, we show how RML leverages the accuracy of updates based on a batch of data while still adapting parameters on every time step. Second, we illustrate how the RML algorithm is parameterized by a single, intuitive half-life parameter that can be used to adjust the rate of adaptation in real time. Third, we show how even when the number of neural features is very large, RML's memory-efficient recursive update rules can be reformulated to be computationally fast so that continuous adaptation is still feasible. To test the algorithm in closed-loop experiments, we trained three macaque monkeys to perform a center-out reaching task by using either spiking activity or local field potentials to control a 2D computer cursor. RML achieved higher levels of performance more rapidly in comparison to a previous CLDA algorithm that adapts parameters on a more intermediate timescale. Overall, our results indicate that RML is an effective CLDA algorithm for achieving rapid performance acquisition using continuous adaptation.
    Neural Computation 06/2014; · 1.69 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Wireless body-centric sensing systems have an important role in the fields of biomedicine, personal healthcare, safety, and security. Body-centric radio-frequency identification (RFID) technology provides a wireless and maintenance-free communication link between the human body and the surroundings through wearable and implanted antennas. This enables real-time monitoring of human vital signs everywhere. Seamlessly integrated wearable and implanted miniaturized antennas thus have the potential to revolutionize the everyday life of people, and to contribute to independent living. Low-cost and low-power system solutions will make widespread use of such technology become reality. The primary target applications for this research are body-centric sensing systems and the relatively new interdisciplinary field of wireless brain-machine interface (BMI) systems. Providing a direct wireless pathway between the brain and an external device, a wireless brain-machine interface holds an enormous potential for helping people suffering from severely disabling neurological conditions to communicate and manage their everyday life more independently. In this paper, we discuss RFID-inspired wireless brain-machine interface systems. We demonstrate that mm-size loop implanted antennas are capable of efficiently coupling to an external transmitting loop antenna through an inductive link. In addition, we focus on wearable antennas based on electrically conductive textiles and threads, and present design guidelines for their use as wearable-antenna conductive elements. Overall, our results constitute an important milestone in the development of wireless brain-machine interface systems, and a new era of wireless body-centric systems.
    IEEE Antennas and Propagation Magazine 06/2014; 56(1):271. · 1.15 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Brain-machine interfaces are not only promising for neurological applications, but also powerful for investigating neuronal ensemble dynamics during learning. We trained mice to operantly control an auditory cursor using spike-related calcium signals recorded with two-photon imaging in motor and somatosensory cortex. Mice rapidly learned to modulate activity in layer 2/3 neurons, evident both across and within sessions. Learning was accompanied by modifications of firing correlations in spatially localized networks at fine scales.
    Nature Neuroscience 04/2014; · 14.98 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Electrical microstimulation studies provide some of the most direct evidence for the neural representation of muscle synergies. These synergies, i.e., coordinated activations of groups of muscles, have been proposed as building blocks for the construction of motor behaviors by the nervous system. Intraspinal or intracortical microstimulation (ICMS) has been shown to evoke muscle patterns that can be resolved into a small set of synergies similar to those seen in natural behavior. However, questions remain about the validity of microstimulation as a probe of neural function, particularly given the relatively long trains of supratheshold stimuli used in these studies. Here, we examined whether muscle synergies evoked during ICMS in two rhesus macaques were similarly encoded by nearby motor cortical units during a purely voluntary behavior involving object reach, grasp, and carry movements. At each microstimulation site we identified the synergy most strongly evoked among those extracted from muscle patterns evoked over all microstimulation sites. For each cortical unit recorded at the same microstimulation site, we then identified the synergy most strongly encoded among those extracted from muscle patterns recorded during the voluntary behavior. We found that the synergy most strongly evoked at an ICMS site matched the synergy most strongly encoded by proximal units more often than expected by chance. These results suggest a common neural substrate for microstimulation-evoked motor responses and for the generation of muscle patterns during natural behaviors.
    Frontiers in Computational Neuroscience 03/2014; 8:20. · 2.23 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Brain-machine interfaces (BMIs) are dynamical systems whose properties ultimately influence performance. For instance, a 2D BMI in which cursor position is controlled using a Kalman filter (KF) will, by default, create an attractor point that "pulls" the cursor to particular points in the workspace. If created unintentionally, such effects may not be beneficial for BMI performance. However, there have been few empirical studies exploring how various dynamical effects of closed-loop BMIs ultimately influence performance. In this work, we utilize experimental data from two macaque monkeys operating a closed-loop BMI to reach to 2D targets and show that certain dynamical properties correlate with performance loss. We also show that other dynamical properties represent tradeoffs between naturally competing objectives, such as speed versus accuracy. These findings highlight the importance of fine-tuning the dynamical properties of closed-loop BMIs to optimize taskspecific performance.
    IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society 03/2014; · 2.42 Impact Factor
  • IEEE International Solid-State Circuits Conference (ISSCC); 02/2014
  • [Show abstract] [Hide abstract]
    ABSTRACT: Objective. Intracortical brain-machine interfaces (BMIs) have predominantly utilized spike activity as the control signal. However, an increasing number of studies have shown the utility of local field potentials (LFPs) for decoding motor related signals. Currently, it is unclear how well different LFP frequencies can serve as features for continuous, closed-loop BMI control. Approach. We demonstrate 2D continuous LFP-based BMI control using closed-loop decoder adaptation, which adapts decoder parameters to subject-specific LFP feature modulations during BMI control. We trained two macaque monkeys to control a 2D cursor in a center-out task by modulating LFP power in the 0-150 Hz range. Main results. While both monkeys attained control, they used different strategies involving different frequency bands. One monkey primarily utilized the low-frequency spectrum (0-80 Hz), which was highly correlated between channels, and obtained proficient performance even with a single channel. In contrast, the other monkey relied more on higher frequencies (80-150 Hz), which were less correlated between channels, and had greater difficulty with control as the number of channels decreased. We then restricted the monkeys to use only various sub-ranges (0-40, 40-80, and 80-150 Hz) of the 0-150 Hz band. Interestingly, although both monkeys performed better with some sub-ranges than others, they were able to achieve BMI control with all sub-ranges after decoder adaptation, demonstrating broad flexibility in the frequencies that could potentially be used for LFP-based BMI control. Significance. Overall, our results demonstrate proficient, continuous BMI control using LFPs and provide insight into the subject-specific spectral patterns of LFP activity modulated during control.
    Journal of Neural Engineering 02/2014; 11(2):026002. · 3.42 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Young Hwan Chang1 (yhchangatberkeley.edu), Jim Korkola2 (korkolaatohsu.edu), Dhara N. Amin3 (dhara.aminatucsf.edu), Mark M. Moasser3 (mmoasseratmedicine.ucsf.edu), Jose M. Carmena4 (carmenaateecs.berkeley.edu), Joe W. Gray2 (grayjoatohsu.edu) and Claire J. Tomlin1,5 (tomlinateecs.berkeley.edu) 1 Department of Electrical Engineering and Computer Sciences, University of California, Berkeley; 2 Dept. of Biomedical Engineering and the Center for Spatial Systems Biomedicine, OHSU; 3 Department of Medicine, Helen Diller Family Comprehensive Cancer Center, UCSF; 4 Dept. of EECS, Helen Wills Neuroscience Institute,UC Berkeley and UCB/UCSF Graduate program in BIOE ↵* Corresponding author; email: tomlinateecs.berkeley.edu AbstractWith the advent of high-throughput measurement techniques, scientists and engineers are starting to grapple with massive data sets and encountering challenges with how to organize, process and extract information into meaningful structures. Multidimensional spatio-temporal biological data sets such as time series gene expression with various perturbations with different cell lines, or neural spike data sets across many experimental trials have the potential to acquire insight across multiple dimensions. For this potential to be realized, we need a suitable representation to turn data into insight. Since a wide range of experiments and the (unknown) complexity of underlying system make biological data more heterogeneous than those in other fields, we propose the method based on Robust Principal Component Analysis (RPCA), which is well suited for extracting principal components where we have corrupted observations. The proposed method provides us a new representation of these data sets which consists of its common and aberrant response. This representation might help users to acquire a new insight from data. %For example, identifying common event-related neural features across many experimental trials can be used as a signature to detect discrete events or state transitions. Also, the proposed method can be useful to biologists in clustering and analyzing gene expression time series data with a new perspective, for example, it can not only extract canonical cell signaling response but also inform them to get insight into the heterogeneity of different responses across different cell lines.Received April 22, 2014.Accepted April 28, 2014.textcopyright 2014, Published by Cold Spring Harbor Laboratory PressThe copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the authortextquoterights permission.
    bioRxiv. 01/2014;
  • [Show abstract] [Hide abstract]
    ABSTRACT: We analyze the power and voltage transfer in a wireless link from an on-body transmit antenna to 1×1×1 mm3 antenna in a cortical implant to provide power and data telemetry for a battery-free brain-machine interface microelectronic system. We compare the wireless link performance with regular, segmented, and tilted transmit loop antennas. Moreover, we analyze the performance improvement achieved by inserting a magneto-dielectric core in the implant antenna. We also attest the simulation model through measurements in a liquid head phantom.
    IEEE MTT-S International Microwave Workshop Series on RF and Wireless Technologies for Biomedical and Healthcare Applications, Singapore; 12/2013

Publication Stats

3k Citations
345.25 Total Impact Points

Institutions

  • 2007–2015
    • University of California, Berkeley
      • Department of Electrical Engineering and Computer Sciences
      Berkeley, California, United States
  • 2012
    • University of California, San Francisco
      • Department of Neurology
      San Francisco, California, United States
  • 2011
    • CSU Mentor
      Long Beach, California, United States
    • San Francisco VA Medical Center
      San Francisco, California, United States
  • 2010
    • Eawag: Das Wasserforschungs-Institut des ETH-Bereichs
      Duebendorf, Zurich, Switzerland
    • Atomic Energy and Alternative Energies Commission
      Fontenay, Île-de-France, France
  • 2003–2007
    • Duke University
      • Department of Biomedical Engineering (BME)
      Durham, North Carolina, United States
  • 2004
    • University of Southern Denmark
      Odense, South Denmark, Denmark
  • 2000–2002
    • The University of Edinburgh
      • • School of Informatics
      • • Institute of Perception, Action and Behaviour (IPAB)
      Edinburgh, SCT, United Kingdom
  • 2001
    • Duke University Medical Center
      • Department of Neurobiology
      Durham, North Carolina, United States