No file available
To read the file of this research,
you can request a copy directly from the authors.
Spiking Neuron Model Computational Performance
Preprints and early-stage research may not have been peer reviewed yet.
Abstract
Spiking neuron models can be dramatically more efficient than traditional ANN models and this paper analyzed the computational performance on a 100million neuron multicore server and a 16-billion neuron multi-server neocortex emulation.
ResearchGate has not been able to resolve any citations for this publication.
Inspired by biology, neuromorphic systems have been trying to emulate the human brain for decades, taking advantage of its massive parallelism and sparse information coding. Recently, several large-scale hardware projects have demonstrated the outstanding capabilities of this paradigm for applications related to sensory information processing. These systems allow for the implementation of massive neural networks with millions of neurons and billions of synapses. However, the realization of learning strategies in these systems consumes an important proportion of resources in terms of area and power. The recent development of nanoscale memristors that can be integrated with Complementary Metal–Oxide–Semiconductor (CMOS) technology opens a very promising solution to emulate the behavior of biological synapses. Therefore, hybrid memristor-CMOS approaches have been proposed to implement large-scale neural networks with learning capabilities, offering a scalable and lower-cost alternative to existing CMOS systems.
Neuro-biology inspired Spiking Neural Network (SNN) enables efficient learning and recognition tasks. To achieve a large scale network akin to biology, a power and area efficient electronic neuron is essential. Earlier, we had demonstrated an LIF neuron by a novel 4-terminal impact ionization based n+/p/n+ with an extended gate (gated-INPN) device by physics simulation. Excellent improvement in area and power compared to conventional analog circuit implementations was observed. In this paper, we propose and experimentally demonstrate a compact conventional 3-terminal partially depleted (PD) SOI- MOSFET (100 nm gate length) to replace the 4-terminal gated-INPN device. Impact ionization (II) induced floating body effect in SOI-MOSFET is used to capture LIF neuron behavior to demonstrate spiking frequency dependence on input. MHz operation enables attractive hardware acceleration compared to biology. Overall, conventional PD-SOI-CMOS technology enables very-large-scale-integration (VLSI) which is essential for biology scale (~10¹¹ neuron based) large neural networks.
This special issue focuses on elucidating computational neuroscience: an interdisciplinary field of scientific research in which one of the primary goals is to understand how electronic activity in brain cells and networks enables biological intelligence. The objective is to provide a selection of papers that expose and review research efforts in aspects of computational neuroscience that demonstrate its rapidly growing intersection with electrical, electronic and computer engineering, and the prospects for interaction in the near and long-term future.
Noise--random disturbances of signals--poses a fundamental problem for information processing and affects all aspects of nervous-system function. However, the nature, amount and impact of noise in the nervous system have only recently been addressed in a quantitative manner. Experimental and computational methods have shown that multiple noise sources contribute to cellular and behavioural trial-to-trial variability. We review the sources of noise in the nervous system, from the molecular to the behavioural level, and show how noise contributes to trial-to-trial variability. We highlight how noise affects neuronal networks and the principles the nervous system applies to counter detrimental effects of noise, and briefly discuss noise's potential benefits.
Electrophysiological recordings show that individual neurons in cortex are strongly activated when engaged in appropriate tasks, but they tell us little about how many neurons might be engaged by a task, which is important to know if we are to understand how cortex encodes information. For human cortex, I estimate the cost of individual spikes, then, from the known energy consumption of cortex, I establish how many neurons can be active concurrently. The cost of a single spike is high, and this severely limits, possibly to fewer than 1%, the number of neurons that can be substantially active concurrently. The high cost of spikes requires the brain not only to use representational codes that rely on very few active neurons, but also to allocate its energy resources flexibly among cortical regions according to task demand. The latter constraint explains the investment in local control of hemodynamics, exploited by functional magnetic resonance imaging, and the need for mechanisms of selective attention.
Synapses can change their strength in response to afferent activity, a property that might underlie a variety of neural processes such as learning, network synaptic weighting, synapse formation and pruning. Recent work has shown that synapses change their strength by jumping between discrete mechanistic states, rather than by simply moving up and down in a continuum of efficacy. Coincident with this, studies have provided a framework for understanding the potential mechanistic underpinnings of synaptic plastic states. Synaptic plasticity states not only represent a new and fundamental property of CNS synapses, but also can provide a context for understanding outstanding issues in synaptic function, plasticity and development.
Neuron firing rates in humans
- K Grace
K. Grace, ed, "Neuron firing rates in humans," [Survey of related
research], AI Impacts, https://aiimpacts.org/rate-of-neuron-firing/
Available for download at
- C Simon
C. Simon, Brain Simulator II (Software). Available for download at
http://brainsim.org.
Source:
https://github.com/FutureAIGuru/BrainSimII
New Brain Simulator II Open-Source Software
- C Simon
C. Simon, "New Brain Simulator II Open-Source Software" Proceedings,
AGI20, in press.
Simple Model of Spiking Neurons
- E Izhikovich
Izhikovich, E., "Simple Model of Spiking Neurons", IEEE Transactions
on Neural Networks, Nov, 2003.