Methods for reducing interference in the Complementary Learning Systems model: oscillating inhibition and autonomous memory rehearsal.

Department of Psychology Princeton University, Green Hall, Princeton, NJ 08544, USA.
Neural Networks (Impact Factor: 2.08). 12/2005; 18(9):1212-28. DOI: 10.1016/j.neunet.2005.08.010
Source: PubMed

ABSTRACT The stability-plasticity problem (i.e. how the brain incorporates new information into its model of the world, while at the same time preserving existing knowledge) has been at the forefront of computational memory research for several decades. In this paper, we critically evaluate how well the Complementary Learning Systems theory of hippocampo-cortical interactions addresses the stability-plasticity problem. We identify two major challenges for the model: Finding a learning algorithm for cortex and hippocampus that enacts selective strengthening of weak memories, and selective punishment of competing memories; and preventing catastrophic forgetting in the case of non-stationary environments (i.e. when items are temporarily removed from the training set). We then discuss potential solutions to these problems: First, we describe a recently developed learning algorithm that leverages neural oscillations to find weak parts of memories (so they can be strengthened) and strong competitors (so they can be punished), and we show how this algorithm outperforms other learning algorithms (CPCA Hebbian learning and Leabra at memorizing overlapping patterns. Second, we describe how autonomous re-activation of memories (separately in cortex and hippocampus) during REM sleep, coupled with the oscillating learning algorithm, can reduce the rate of forgetting of input patterns that are no longer present in the environment. We then present a simple demonstration of how this process can prevent catastrophic interference in an AB-AC learning paradigm.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Memories evolve. After learning something new, the brain initiates a complex set of post-learning processing that facilitates recall (i.e., consolidation). Evidence points to sleep as one of the determinants of that change. But whenever a behavioral study of episodic memory shows a benefit of sleep, critics assert that sleep only leads to a temporary shelter from the damaging effects of interference that would otherwise accrue during wakefulness. To evaluate the potentially active role of sleep for verbal memory, we compared memory recall after sleep, with and without interference before testing. We demonstrated that recall performance for verbal memory was greater after sleep than after wakefulness. And when using interference testing, that difference was even more pronounced. By introducing interference after sleep, this study confirms an experimental paradigm that demonstrates the active role of sleep in consolidating memory, and unmasks the large magnitude of that benefit.
    PLoS ONE 02/2009; 4(1):e4117. DOI:10.1371/journal.pone.0004117 · 3.53 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Declarative long-term memories are not created in an instant. Gradual stabilization and temporally shifting dependence of acquired declarative memories in different brain regions-called systems consolidation-can be tracked in time by lesion experiments. The observation of temporally graded retrograde amnesia (RA) following hippocampal lesions points to a gradual transfer of memory from hippocampus to neocortical long-term memory. Spontaneous reactivations of hippocampal memories, as observed in place cell reactivations during slow-wave-sleep, are supposed to drive neocortical reinstatements and facilitate this process. We propose a functional neural network implementation of these ideas and furthermore suggest an extended three-state framework that includes the prefrontal cortex (PFC). It bridges the temporal chasm between working memory percepts on the scale of seconds and consolidated long-term memory on the scale of weeks or months. We show that our three-stage model can autonomously produce the necessary stochastic reactivation dynamics for successful episodic memory consolidation. The resulting learning system is shown to exhibit classical memory effects seen in experimental studies, such as retrograde and anterograde amnesia (AA) after simulated hippocampal lesioning; furthermore the model reproduces peculiar biological findings on memory modulation, such as retrograde facilitation of memory after suppressed acquisition of new long-term memories-similar to the effects of benzodiazepines on memory.
    Frontiers in Computational Neuroscience 07/2014; 8:64. DOI:10.3389/fncom.2014.00064 · 2.23 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: There is currently an intense debate about the nature of recognition memory and about the roles of medial temporal lobe subregions in recognition memory processes. At a larger level, this debate has been about whether it is appropriate to propose unified theories to explain memory at neural, functional, and phenomenological levels of analysis. Here, I review findings from physiology, functional imaging, and lesion studies in humans, monkeys, and rodents relevant to the roles of medial temporal lobe subregions in recognition memory, as well as in short-term memory and perception. The results from these studies are consistent with the idea that there is functional heterogeneity in the medial temporal lobes, although the differences among medial temporal lobe subregions do not precisely correspond to different types of memory tasks, cognitive processes, or states of awareness. Instead, the evidence is consistent with the idea that medial temporal lobe subregions differ in terms of the kind of information they process and represent, and that these regions collectively support episodic memory by binding item and context information.
    Hippocampus 11/2010; 20(11):1263-90. DOI:10.1002/hipo.20852 · 4.30 Impact Factor