Calculating consequences: brain systems that encode the causal effects of actions.

Division of the Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125, USA.
The Journal of Neuroscience : The Official Journal of the Society for Neuroscience (Impact Factor: 6.75). 07/2008; 28(26):6750-5. DOI: 10.1523/JNEUROSCI.1808-08.2008
Source: PubMed

ABSTRACT The capacity to accurately evaluate the causal effectiveness of our actions is key to successfully adapting to changing environments. Here we scanned subjects using functional magnetic resonance imaging while they pressed a button to earn money as the response-reward relationship changed over time. Subjects' judgments about the causal efficacy of their actions reflected the objective contingency between the rate of button pressing and the amount of money they earned. Neural responses in medial orbitofrontal cortex and dorsomedial striatum were modulated as a function of contingency, by increasing in activity during sessions when actions were highly causal compared with when they were not. Moreover, medial prefrontal cortex tracked local changes in action-outcome correlations, implicating this region in the on-line computation of contingency. These results reveal the involvement of distinct brain regions in the computational processes that establish the causal efficacy of actions, providing insight into the neural mechanisms underlying the adaptive control of behavior.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The impulse to act for immediate reward often conflicts with more deliberate evaluations that support long-term benefit. The neural architecture that negotiates this conflict remains unclear. One account proposes a single neural circuit that evaluates both immediate and delayed outcomes, while another outlines separate impulsive and patient systems that compete for behavioral control. Here we designed a task in which a complex payout structure divorces the immediate value of acting from the overall long-term value, within the same outcome modality. Using model-based fMRI in humans, we demonstrate separate neural representations of immediate and long-term value, with the former tracked in anterior caudate (AC) and the latter in ventromedial prefrontal cortex (vmPFC). Crucially, when subjects' choices were compatible with long-run consequences, value signals in AC were down-weighted and those in vmPFC were enhanced, while the opposite occurred when choice was impulsive. Thus, our data implicate a trade-off in value representation between AC and vmPFC as underlying controlled versus impulsive choice. Copyright © 2014. Published by Elsevier Inc.
    NeuroImage 01/2015; 109. DOI:10.1016/j.neuroimage.2014.12.071 · 6.13 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: After a relatively small amount of training, instrumental behavior is thought to be an action under the control of the motivational status of its goal or reinforcer. After more extended training, behavior can become habitual and insensitive to changes in reinforcer value. Recently, instrumental responding has been shown to weaken when tested outside of the training context. The present experiments compared the sensitivity of instrumental responding in rats with a context switch after training procedures that might differentially generate actions or habits. In Experiment 1, lever pressing was decremented in a new context after either short, medium, or long periods of training on either random-ratio or yoked random-interval reinforcement schedules. Experiment 2 found that more minimally trained responding was also sensitive to a context switch. Moreover, Experiment 3 showed that when the goal-directed component of responding was removed by devaluing the reinforcer, the residual responding that remained was still sensitive to the change of context. Goal-directed responding, in contrast, transferred across contexts. Experiment 4 then found that after extensive training, a habit that was insensitive to reinforcer devaluation was still decremented by a context switch. Overall, the results suggest that a context switch primarily influences instrumental habit rather than action. In addition, even a response that has received relatively minimal training may have a habit component that is insensitive to reinforcer devaluation but sensitive to the effects of a context switch.
    Journal of Experimental Psychology: Animal Learning and Cognition 11/2014; DOI:10.1037/xan0000045 · 2.38 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The recent focus of addiction research has been on effect of drug exposure on the neural processes that mediate the acquisition and performance of goal-directed instrumental actions. Deficits in goal-directed control and a consequent dysregulation of habit learning processes have been described as resulting in compulsive drug seeking. Similarly, considerable research has focussed on the motivational and emotional changes that drugs produce and that result in changes in the incentive processes that modulate goal-directed performance. Although these areas have developed independently, we argue that the effects they described are likely not independent. Here we hypothesize that these changes result from a core deficit in the way the learning and performance factors that support goal-directed action are integrated at a neural level to maintain behavioural control. A dorsal basal ganglia stream mediating goal-directed learning and a ventral stream mediating various performance factors find several points of integration in the cortical basal ganglia system, most notably in the thalamocortical network linking basal ganglia output to a variety of cortical control centres. Recent research in humans and other animals is reviewed suggesting that learning and performance factors are integrated in a network centred on the mediodorsal thalamus and that disintegration in this network may provide the basis for a 'switch' from recreational to dysregulated drug seeking resulting in the well documented changes associated with addiction. Copyright © 2014. Published by Elsevier B.V.
    Brain Research 12/2014; DOI:10.1016/j.brainres.2014.12.023 · 2.83 Impact Factor

Full-text (2 Sources)

Available from
May 31, 2014