Calculating consequences: brain systems that encode the causal effects of actions.

Division of the Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125, USA.
The Journal of Neuroscience : The Official Journal of the Society for Neuroscience (Impact Factor: 6.75). 07/2008; 28(26):6750-5. DOI: 10.1523/JNEUROSCI.1808-08.2008
Source: PubMed

ABSTRACT The capacity to accurately evaluate the causal effectiveness of our actions is key to successfully adapting to changing environments. Here we scanned subjects using functional magnetic resonance imaging while they pressed a button to earn money as the response-reward relationship changed over time. Subjects' judgments about the causal efficacy of their actions reflected the objective contingency between the rate of button pressing and the amount of money they earned. Neural responses in medial orbitofrontal cortex and dorsomedial striatum were modulated as a function of contingency, by increasing in activity during sessions when actions were highly causal compared with when they were not. Moreover, medial prefrontal cortex tracked local changes in action-outcome correlations, implicating this region in the on-line computation of contingency. These results reveal the involvement of distinct brain regions in the computational processes that establish the causal efficacy of actions, providing insight into the neural mechanisms underlying the adaptive control of behavior.

  • [Show abstract] [Hide abstract]
    ABSTRACT: While there is accumulating evidence for the existence of distinct neural systems supporting goal-directed and habitual action selection in the mammalian brain, much less is known about the nature of the information being processed in these different brain regions. Associative learning theory predicts that brain systems involved in habitual control, such as the dorsolateral striatum, should contain stimulus and response information only, but not outcome information, while regions involved in goal-directed action, such as ventromedial and dorsolateral prefrontal cortex and dorsomedial striatum, should be involved in processing information about outcomes as well as stimuli and responses. To test this prediction, human participants underwent fMRI while engaging in a binary choice task designed to enable the separate identification of these different representations with a multivariate classification analysis approach. Consistent with our predictions, the dorsolateral striatum contained information about responses but not outcomes at the time of an initial stimulus, while the regions implicated in goal-directed action selection contained information about both responses and outcomes. These findings suggest that differential contributions of these regions to habitual and goal-directed behavioral control may depend in part on basic differences in the type of information that these regions have access to at the time of decision making. Copyright © 2015 the authors 0270-6474/15/353764-08$15.00/0.
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The impulse to act for immediate reward often conflicts with more deliberate evaluations that support long-term benefit. The neural architecture that negotiates this conflict remains unclear. One account proposes a single neural circuit that evaluates both immediate and delayed outcomes, while another outlines separate impulsive and patient systems that compete for behavioral control. Here we designed a task in which a complex payout structure divorces the immediate value of acting from the overall long-term value, within the same outcome modality. Using model-based fMRI in humans, we demonstrate separate neural representations of immediate and long-term value, with the former tracked in anterior caudate (AC) and the latter in ventromedial prefrontal cortex (vmPFC). Crucially, when subjects' choices were compatible with long-run consequences, value signals in AC were down-weighted and those in vmPFC were enhanced, while the opposite occurred when choice was impulsive. Thus, our data implicate a trade-off in value representation between AC and vmPFC as underlying controlled versus impulsive choice. Copyright © 2014. Published by Elsevier Inc.
    NeuroImage 01/2015; 109. DOI:10.1016/j.neuroimage.2014.12.071 · 6.13 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The recent focus of addiction research has been on effect of drug exposure on the neural processes that mediate the acquisition and performance of goal-directed instrumental actions. Deficits in goal-directed control and a consequent dysregulation of habit learning processes have been described as resulting in compulsive drug seeking. Similarly, considerable research has focussed on the motivational and emotional changes that drugs produce and that result in changes in the incentive processes that modulate goal-directed performance. Although these areas have developed independently, we argue that the effects they described are likely not independent. Here we hypothesize that these changes result from a core deficit in the way the learning and performance factors that support goal-directed action are integrated at a neural level to maintain behavioural control. A dorsal basal ganglia stream mediating goal-directed learning and a ventral stream mediating various performance factors find several points of integration in the cortical basal ganglia system, most notably in the thalamocortical network linking basal ganglia output to a variety of cortical control centres. Recent research in humans and other animals is reviewed suggesting that learning and performance factors are integrated in a network centred on the mediodorsal thalamus and that disintegration in this network may provide the basis for a 'switch' from recreational to dysregulated drug seeking resulting in the well documented changes associated with addiction. Copyright © 2014. Published by Elsevier B.V.
    Brain Research 12/2014; DOI:10.1016/j.brainres.2014.12.023 · 2.83 Impact Factor

Full-text (2 Sources)

Available from
May 31, 2014