Methods for reducing interference in the Complementary Learning Systems model: oscillating inhibition and autonomous memory rehearsal.

Department of Psychology Princeton University, Green Hall, Princeton, NJ 08544, USA.
Neural Networks (Impact Factor: 1.93). 12/2005; 18(9):1212-28. DOI: 10.1016/j.neunet.2005.08.010
Source: PubMed

ABSTRACT The stability-plasticity problem (i.e. how the brain incorporates new information into its model of the world, while at the same time preserving existing knowledge) has been at the forefront of computational memory research for several decades. In this paper, we critically evaluate how well the Complementary Learning Systems theory of hippocampo-cortical interactions addresses the stability-plasticity problem. We identify two major challenges for the model: Finding a learning algorithm for cortex and hippocampus that enacts selective strengthening of weak memories, and selective punishment of competing memories; and preventing catastrophic forgetting in the case of non-stationary environments (i.e. when items are temporarily removed from the training set). We then discuss potential solutions to these problems: First, we describe a recently developed learning algorithm that leverages neural oscillations to find weak parts of memories (so they can be strengthened) and strong competitors (so they can be punished), and we show how this algorithm outperforms other learning algorithms (CPCA Hebbian learning and Leabra at memorizing overlapping patterns. Second, we describe how autonomous re-activation of memories (separately in cortex and hippocampus) during REM sleep, coupled with the oscillating learning algorithm, can reduce the rate of forgetting of input patterns that are no longer present in the environment. We then present a simple demonstration of how this process can prevent catastrophic interference in an AB-AC learning paradigm.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The prefrontal cortex exerts top-down influences on several aspects of higher-order cognition by functioning as a filtering mechanism that biases bottom-up sensory information toward a response that is optimal in context. However, research also indicates that not all aspects of complex cognition benefit from prefrontal regulation. Here we review and synthesize this research with an emphasis on the domains of learning and creative cognition, and outline how the appropriate level of cognitive control in a given situation can vary depending on the organism's goals and the characteristics of the given task. We offer a Matched Filter Hypothesis for cognitive control, which proposes that the optimal level of cognitive control is task-dependent, with high levels of cognitive control best suited to tasks that are explicit, rule-based, verbal or abstract, and can be accomplished given the capacity limits of working memory and with low levels of cognitive control best suited to tasks that are implicit, reward-based, non-verbal or intuitive, and which can be accomplished irrespective of working memory limitations. Our approach promotes a view of cognitive control as a tool adapted to a subset of common challenges, rather than an all-purpose optimization system suited to every problem the organism might encounter.
    Neuropsychologia 10/2013; · 3.48 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Action potential timing is thought to play a critical role in neural representation. For example, theta phase precession is a robust phenomenon exhibited by spatial cells of the rat entorhinal-hippocampal circuit. In phase precession, the time a neuron fires relative to the phase of theta rhythm (6-10 Hz) oscillations in the local field potential reduces uncertainty about the position of the animal. This relationship between neural firing and behavior has made precession an important constraint for hypothetical mechanisms of temporal coding. However, challenges exist in identifying what regulates the spike timing of these cells. We have developed novel analytical techniques for mapping between behavior and neural firing that provide sufficient sensitivity to examine features of grid cell phase coding in open environments. Here, we show robust, omnidirectional phase precession by entorhinal grid cells in openfield enclosures. We present evidence that full phase precession persists regardless of how close the animal comes to the center of a firing field. Many conjunctive grid cells, previously thought to be phase locked, also exhibited phase coding. However, we were unable to detect directional- or field-specific phase coding predicted by some variants of models. Finally, we present data that suggest bursting of layer II grid cells contributes to the bimodality of phase precession. We discuss implications of these observations for models of temporal coding and propose the utility of these techniques in other domains where behavior is aligned to neural spiking.
    European Journal of Neuroscience 05/2013; · 3.75 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Declarative long-term memories are not created in an instant. Gradual stabilization and temporally shifting dependence of acquired declarative memories in different brain regions-called systems consolidation-can be tracked in time by lesion experiments. The observation of temporally graded retrograde amnesia (RA) following hippocampal lesions points to a gradual transfer of memory from hippocampus to neocortical long-term memory. Spontaneous reactivations of hippocampal memories, as observed in place cell reactivations during slow-wave-sleep, are supposed to drive neocortical reinstatements and facilitate this process. We propose a functional neural network implementation of these ideas and furthermore suggest an extended three-state framework that includes the prefrontal cortex (PFC). It bridges the temporal chasm between working memory percepts on the scale of seconds and consolidated long-term memory on the scale of weeks or months. We show that our three-stage model can autonomously produce the necessary stochastic reactivation dynamics for successful episodic memory consolidation. The resulting learning system is shown to exhibit classical memory effects seen in experimental studies, such as retrograde and anterograde amnesia (AA) after simulated hippocampal lesioning; furthermore the model reproduces peculiar biological findings on memory modulation, such as retrograde facilitation of memory after suppressed acquisition of new long-term memories-similar to the effects of benzodiazepines on memory.
    Frontiers in Computational Neuroscience 01/2014; 8:64. · 2.48 Impact Factor

Full-text (2 Sources)

Available from
Jun 4, 2014