Generating Coherent Patterns of Activity from Chaotic Neural Networks

Department of Neuroscience, Department of Physiology and Cellular Biophysics, Columbia University College of Physicians and Surgeons, New York, NY 10032-2695, USA.
Neuron (Impact Factor: 15.98). 09/2009; 63(4):544-57. DOI: 10.1016/j.neuron.2009.07.018
Source: PubMed

ABSTRACT Neural circuits display complex activity patterns both spontaneously and when responding to a stimulus or generating a motor output. How are these two forms of activity related? We develop a procedure called FORCE learning for modifying synaptic strengths either external to or within a model neural network to change chaotic spontaneous activity into a wide variety of desired activity patterns. FORCE learning works even though the networks we train are spontaneously chaotic and we leave feedback loops intact and unclamped during learning. Using this approach, we construct networks that produce a wide variety of complex output patterns, input-output transformations that require memory, multiple outputs that can be switched by control inputs, and motor patterns matching human motion capture data. Our results reproduce data on premovement activity in motor and premotor cortex, and suggest that synaptic plasticity may be a more rapid and powerful modulator of network activity than generally appreciated.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Under uncertainty, the brain uses previous knowledge to transform sensory inputs into the percepts on which decisions are based. When the uncertainty lies in the timing of sensory evidence, however, the mechanism underlying the use of previously acquired temporal information remains unknown. We study this issue in monkeys performing a detection task with variable stimulation times. We use the neural correlates of false alarms to infer the subject's response criterion and find that it modulates over the course of a trial. Analysis of premotor cortex activity shows that this modulation is represented by the dynamics of population responses. A trained recurrent network model reproduces the experimental findings and demonstrates a neural mechanism to benefit from temporal expectations in perceptual detection. Previous knowledge about the probability of stimulation over time can be intrinsically encoded in the neural population dynamics, allowing a flexible control of the response criterion over time. Copyright © 2015 Elsevier Inc. All rights reserved.
    Neuron 05/2015; DOI:10.1016/j.neuron.2015.04.014 · 15.98 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Providing the neurobiological basis of information processing in higher animals, spiking neural networks must be able to learn a variety of complicated computations, including the generation of appropriate, possibly delayed reactions to inputs and the self-sustained generation of complex activity patterns, e.g. for locomotion. Many such computations require previous building of intrinsic world models. Here we show how spiking neural networks may solve these different tasks. Firstly, we derive constraints under which classes of spiking neural networks lend themselves to substrates of powerful general purpose computing. The networks contain dendritic or synaptic nonlinearities and have a constrained connectivity. We then combine such networks with learning rules for outputs or recurrent connections. We show that this allows to learn even difficult benchmark tasks such as the self-sustained generation of desired low-dimensional chaotic dynamics or memory-dependent computations. Furthermore, we show how spiking networks can build models of external world systems and use the acquired knowledge to control them.
  • [Show abstract] [Hide abstract]
    ABSTRACT: This paper focuses on the forecast of wind shear and turbulence at the Hong Kong International Airport. It presents a mesoscale prediction model that uses chaotic oscillatory-based neural networks (CONN) to forecast the evolution of wind fields along the glide path in the vicinity of the airport. This model makes use of accurate Doppler velocities measured by light detection and ranging (LiDAR) system and afterward collected by the Hong Kong Observatory. Simulation results show that the CONN model with a new learning algorithm is able to capture the occurrence, evolution, and sudden changes of the winds representing turbulence incidences in the region. Research findings show that Doppler velocities forecast using CONN can be transformed into headwind profiles and processed with the developed algorithm to identify the wind shear occurrence. These are shown to match actual observations made using LiDAR in terms of time, locations, and size of wind shear events with considerable accuracy. The model has better performance compared with that of the traditional multilayered perceptron model neural network. The results encourage further exploration and experimentation in the use of machine learning and chaotic neural network in weather forecast and alerting.
    IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) 11/2012; 42(6):1412-1423. DOI:10.1109/TSMCC.2012.2188284 · 1.53 Impact Factor