No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Dorsal raphe neurons integrate the values of reward amount, delay, and uncertainty in multi-attribute decision-making
... The neuromodulators dopamine (DA) and serotonin (5-hydroxytryptamine; 5HT) powerfully regulate associative learning [1][2][3][4][5][6][7][8] . Similarities in the activity and connectivity of these neuromodulatory systems have inspired competing models of how DA and 5HT interact to drive the formation of new associations [9][10][11][12][13][14] . However, these hypotheses have not been tested directly because it has not been possible to interrogate and manipulate multiple neuromodulatory systems in a single subject. ...
... Historically, two contradictory hypotheses about the roles of DA and 5HT in associative learning have been debated. The synergy hypothesis posits that DA and 5HT signals carry information about reward expectation on short and long timescales, respectively 9,12,14 , thereby synthesizing theories about the function of DA in temporal-difference learning [21][22][23] and the role of 5HT in regulating mood 24,25 . The opponency hypothesis proposes that DA invigorates 26,27 and 5HT suppresses 28,29 behavioural activation to optimize reward seeking with respect to cognitive flexibility 30 , intertemporal choice trade-offs 29,[31][32][33] or under the threat of punishment 10,11,34,35 , such that imbalances between these processes could lead to compulsion and addiction 36,37 . ...
... This finding is consistent with previous work showing that inhibition of 5HT signalling, both systemically 37 and in the dorsal striatum 36 , potentiates the reinforcing properties of a cocaine reward, and with long-standing studies showing that 5HT-releasing drugs dampen the reinforcing potency of amphetamines 56,57 . Nevertheless, our experiments cannot formally exclude the possibility that slow fluctuations in tonic levels of DA and 5HT may also carry information about reward expectation or value 12,14,26 , as proposed by some synergy theories. ...
The neuromodulators dopamine (DA) and serotonin (5-hydroxytryptamine; 5HT) powerfully regulate associative learning1, 2, 3, 4, 5, 6, 7–8. Similarities in the activity and connectivity of these neuromodulatory systems have inspired competing models of how DA and 5HT interact to drive the formation of new associations9, 10, 11, 12, 13–14. However, these hypotheses have not been tested directly because it has not been possible to interrogate and manipulate multiple neuromodulatory systems in a single subject. Here we establish a mouse model that enables simultaneous genetic access to the brain’s DA and 5HT neurons. Anterograde tracing revealed the nucleus accumbens (NAc) to be a putative hotspot for the integration of convergent DA and 5HT signals. Simultaneous recording of DA and 5HT axon activity, together with genetically encoded DA and 5HT sensor recordings, revealed that rewards increase DA signalling and decrease 5HT signalling in the NAc. Optogenetically dampening DA or 5HT reward responses individually produced modest behavioural deficits in an appetitive conditioning task, while blunting both signals together profoundly disrupted learning and reinforcement. Optogenetically reproducing DA and 5HT reward responses together was sufficient to drive the acquisition of new associations and supported reinforcement more potently than either manipulation did alone. Together, these results demonstrate that striatal DA and 5HT signals shape learning by exerting opponent control of reinforcement.
... Merging ideas from reinforcement learning theory 6 with recent insights into the filtering properties of the dorsal raphe nucleus 7 , here we find a unifying perspective in a prospective code for value. This biological code for near-future reward explains why serotonin neurons are activated by both rewards and punishments 3,4,[8][9][10][11][12][13] , and why these neurons are more strongly activated by surprising rewards but have no such surprise preference for punishments 3,9 -observations that previous theories have failed to reconcile. Finally, our model quantitatively predicts in vivo population activity better than previous theories. ...
The in vivo responses of dorsal raphe nucleus serotonin neurons to emotionally salient stimuli are a puzzle¹. Existing theories centring on reward², surprise³, salience⁴ and uncertainty⁵ individually account for some aspects of serotonergic activity but not others. Merging ideas from reinforcement learning theory⁶ with recent insights into the filtering properties of the dorsal raphe nucleus⁷, here we find a unifying perspective in a prospective code for value. This biological code for near-future reward explains why serotonin neurons are activated by both rewards and punishments3,4,8, 9, 10, 11, 12–13, and why these neurons are more strongly activated by surprising rewards but have no such surprise preference for punishments3,9—observations that previous theories have failed to reconcile. Finally, our model quantitatively predicts in vivo population activity better than previous theories. By reconciling previous theories and establishing a precise connection with reinforcement learning, our work represents an important step towards understanding the role of serotonin in learning and behaviour.
... The serotonergic system dynamically interacts with the hippocampus to regulate reward-related information processing. DRN 5-HT neurons are responsible for encoding the reward signal by co-releasing 5-HT and glutamate [9,[123][124][125]; these neurons are selectively recruited by emotional stimuli rather than neutral stimuli, and subsequently, they activate the downstream ventral tegmental area but not the hippocampus [126]. Meanwhile, in vivo two-photon imaging has screened two distinct neuronal populations in the MRN that project to the hippocampus: one is associated with reward delivery and the other with locomotion, and stimulation of these hippocampal projection fibers modulates reward-induced behavior [127]. ...
Subcortical innervation of the hippocampus by the raphe nucleus is essential for emotional and cognitive control. The two major afferents from raphe to hippocampus originate from serotonergic and glutamatergic neurons, of which the serotonergic control of hippocampal inhibitory network, theta activity, and synaptic plasticity have been extensively explored in the growing body of literature, whereas those of glutamatergic circuits have received little attention. Notably, both serotonergic and glutamatergic circuits between raphe and hippocampus are disrupted in Alzheimer’s disease (AD), which may contribute to initiation and progression of behavioral and psychological symptoms of dementia. Thus, deciphering the mechanism underlying abnormal raphe–hippocampal circuits in AD is crucial to prevent dementia-associated emotional and cognitive symptoms. In this review, we summarize the anatomical, neurochemical, and electrophysiological diversity of raphe nuclei as well as the architecture of raphe–hippocampal circuitry. We then elucidate subcortical control of hippocampal activity by raphe nuclei and their role in regulation of emotion and cognition. Additionally, we present an overview of disrupted raphe–hippocampal circuits in AD pathogenesis and analyze the available therapies that can potentially be used clinically to alleviate the neuropsychiatric symptoms and cognitive decline in AD course.
... ;https://doi.org/10.1101https://doi.org/10. /2024 effects reflect the subjective value of the anticipated reward, a signed or unsigned reward prediction error (i.e., discrepancy between expected and actual rewards), or some related quantity (Feng et al. 2024;Jordan 2024). This remains an intriguing question for future research. ...
Subcortical nuclei of the ascending arousal system play an important role in regulating brain and cognition. However, functional MRI of these nuclei in humans involves unique challenges due to their size and location deep within the brain. Here, we used ultra-high-field MRI and other methodological advances to investigate the activity of six subcortical nuclei during reward anticipation and memory encoding: the locus coeruleus, basal forebrain, median and dorsal raphe nuclei, substantia nigra and ventral tegmental area. Participants performed a monetary incentive delay task, which successfully induced a state of reward anticipation, and a 24-hour delayed surprise memory test. Region-of-interest analyses revealed that activity in all subcortical nuclei increased in anticipation of potential rewards as opposed to neutral outcomes. In contrast, activity in none of the nuclei predicted memory performance 24 hours later. These findings provide new insights into the cognitive functions that are supported by the human ascending arousal system.
Daily life for humans and other animals requires switching between periods of threat- and reward-oriented behavior. We investigated neural activity associated with spontaneous switching, in a naturalistic task, between foraging for rewards and seeking information about potential threats with 7T fMRI in healthy humans. Switching was driven by estimates of likelihood of threat and reward. Both tracking of threat and switching to a vigilant mode in which people sought more information about potential threats were associated with specific but distributed patterns of activity spanning habenula, dorsal raphe nucleus (DRN), anterior cingulate cortex, and anterior insula cortex. Different aspects of the distributed activity patterns were linked to monitoring the threat level, seeking information about the threat, and actual threat detection. A distinct pattern of activity in the same circuit and elsewhere occurred during returns to reward-oriented behavior. Individual variation in DRN activity reflected individual variation in the seeking of information about threats.
Dopamine and serotonin are hypothesized to guide social behaviours. In humans, however, we have not yet been able to study neuromodulator dynamics as social interaction unfolds. Here, we obtained subsecond estimates of dopamine and serotonin from human substantia nigra pars reticulata during the ultimatum game. Participants, who were patients with Parkinson’s disease undergoing awake brain surgery, had to accept or reject monetary offers of varying fairness from human and computer players. They rejected more offers in the human than the computer condition, an effect of social context associated with higher overall levels of dopamine but not serotonin. Regardless of the social context, relative changes in dopamine tracked trial-by-trial changes in offer value—akin to reward prediction errors—whereas serotonin tracked the current offer value. These results show that dopamine and serotonin fluctuations in one of the basal ganglia’s main output structures reflect distinct social context and value signals.
Behavioral and economic theory dictate that we decide between options based on their values. However, humans and animals eagerly seek information about uncertain future rewards, even when this does not provide any objective value. This implies that decisions are made by endowing information with subjective value and integrating it with the value of extrinsic rewards, but the mechanism is unknown. Here, we show that human and monkey value judgements obey strikingly conserved computational principles during multi-attribute decisions trading off information and extrinsic reward. We then identify a neural substrate in a highly conserved ancient structure, the lateral habenula (LHb). LHb neurons signal subjective value, integrating information’s value with extrinsic rewards, and the LHb predicts and causally influences ongoing decisions. Neurons in key input areas to the LHb largely signal components of these computations, not integrated value signals. Thus, our data uncover neural mechanisms of conserved computations underlying decisions to seek information about the future.
Serotonin is implicated in the valuation of aversive costs, such as delay or physical effort. However, its role in governing sensitivity to cognitive effort, for example deliberation costs during information gathering, is unclear. We show that treatment with a serotonergic antidepressant in healthy human individuals of either sex enhances a willingness to gather information when trying to maximize reward. Using computational modelling, we show this arises from a diminished sensitivity to subjective deliberation costs during the sampling process. This result is consistent with the notion that serotonin alleviates sensitivity to aversive costs in a domain-general fashion, with implications for its potential contribution to a positive impact on motivational deficits in psychiatric disorders.
SIGNIFICANCE STATEMENT:
Gathering information about the world is essential for successfully navigating it. However, sampling information is costly, and we need to balance between gathering too little and too much information. The neurocomputational mechanisms underlying this arbitration between a putative gain, such as reward, and the associated costs, such as allocation of cognitive resources, remain unclear. In this study, we show that week-long daily treatment with a serotonergic antidepressant enhances a willingness to gather information when trying to maximize reward. Computational modelling indicates this arises from a reduced perception of aversive costs, rendering information gathering less cognitively effortful. This finding points to a candidate mechanism by which serotonergic treatment might help alleviate motivational deficits in a range of mental illnesses.
Background
Psilocybin has been suggested as a novel, rapid-acting treatment for depression. Two consecutive doses have been shown to markedly decrease symptom severity in an open-label setting or when compared to a waiting list group. To date, to our knowledge, no other trial compared a single, moderate dose of psilocybin to a placebo condition.
Methods
In this double-blind, randomised clinical trial, 52 participants diagnosed with major depressive disorder and no unstable somatic conditions were allocated to receive either a single, moderate dose (0.215 mg/kg body weight) of psilocybin or placebo in conjunction with psychological support. MADRS and BDI scores were assessed to estimate depression severity, while changes from baseline to 14 days after the intervention were defined as primary endpoints. The trial took place between April 11th, 2019 and October 12th, 2021 at the psychiatric university hospital in Zürich, Switzerland and was registered with clinicaltrials.gov (NCT03715127).
Findings
The psilocybin condition showed an absolute decrease in symptom severity of −13.0 points compared to baseline and were significantly larger than those in the placebo condition (95% CI −15.0 to −1.3; Cohens' d = 0.97; P = 0.0011; MADRS) and −13.2 points (95% CI; −13.4 to −1.3; Cohens’ d = 0.67; P = 0.019; BDI) 14 days after the intervention. 14/26 (54%) participants met the MADRS remission criteria in the psilocybin condition.
Interpretation
These results suggest that a single, moderate dose of psilocybin significantly reduces depressive symptoms compared to a placebo condition for at least two weeks. No serious adverse events were recorded. Larger, multi-centric trials with longer follow-up periods are needed to inform further optimisation of this novel treatment paradigm.
Funding
The study was funded by the Swiss National Science Foundation, Crowdfunding, the Swiss Neuromatrix Foundation, and the Heffter Research Institute.
Appropriate processing of reward and aversive information is essential for survival. Although a critical role of serotonergic neurons in the dorsal raphe nucleus (DRN) in reward processing has been shown, the lack of rewarding effects with selective serotonin reuptake inhibitors (SSRIs) implies the presence of a discrete serotonergic system playing an opposite role to the DRN in the processing of reward and aversive stimuli. Here, we demonstrated that serotonergic neurons in the median raphe nucleus (MRN) of mice process reward and aversive information in opposite directions to DRN serotonergic neurons. We further identified MRN serotonergic neurons, including those projecting to the interpeduncular nucleus (5-HT MRN→IPN ), as a key mediator of reward and aversive stimuli. Moreover, 5-HT receptors, including 5-HT 2A receptors in the interpeduncular nucleus, are involved in the aversive properties of MRN serotonergic neural activity. Our findings revealed an essential function of MRN serotonergic neurons, including 5-HT MRN→IPN , in the processing of reward and aversive stimuli.
Although we understand how serotonin receptors function at the single-cell level, what role different serotonin receptors play in regulating brain-wide activity and, in turn, human behavior, remains unknown. Here, we developed transcriptomic–neuroimaging mapping to characterize brain-wide functional signatures associated with specific serotonin receptors: serotonin receptor networks (SRNs). Probing SRNs with optogenetics–functional magnetic resonance imaging (MRI) and pharmacology in mice, we show that activation of dorsal raphe serotonin neurons differentially modulates the amplitude and functional connectivity of different SRNs, showing that receptors’ spatial distributions can confer specificity not only at the local, but also at the brain-wide, network level. In humans, using resting-state functional MRI, SRNs replicate established divisions of serotonin effects on impulsivity and negative biases. These results provide compelling evidence that heterogeneous brain-wide distributions of different serotonin receptor types may underpin behaviorally distinct modes of serotonin regulation. This suggests that serotonin neurons may regulate multiple aspects of human behavior via modulation of large-scale receptor networks.
Neuroeconomics studies how decision-making is guided by the value of rewards and punishments. But to date, little is known about how noxious experiences impact decisions. A challenge is the lack of an aversive stimulus that is dynamically adjustable in intensity and location, readily usable over many trials in a single experimental session, and compatible with multiple ways to measure neuronal activity. We show that skin laser stimulation used in human studies of aversion can be used for this purpose in several key animal models. We then use laser stimulation to study how neurons in the orbitofrontal cortex (OFC), an area whose many roles include guiding decisions among different rewards, encode the value of rewards and punishments. We show that some OFC neurons integrated the positive value of rewards with the negative value of aversive laser stimulation, suggesting that the OFC can play a role in more complex choices than previously appreciated.
Reinforcement allows organisms to learn which stimuli predict subsequent biological relevance. Hebbian mechanisms of synaptic plasticity are insufficient to account for reinforced learning because neuromodulators signaling biological relevance are delayed with respect to the neural activity associated with the stimulus. A theoretical solution is the concept of eligibility traces (eTraces), silent synaptic processes elicited by activity which upon arrival of a neuromodulator are converted into a lasting change in synaptic strength. Previously we demonstrated in visual cortical slices the Hebbian induction of eTraces and their conversion into LTP and LTD by the retroactive action of norepinephrine and serotonin Here we show in vivo in mouse V1 that the induction of eTraces and their conversion to LTP/D by norepinephrine and serotonin respectively potentiates and depresses visual responses. We also show that the integrity of this process is crucial for ocular dominance plasticity, a canonical model of experience-dependent plasticity. Previous work has identified synaptic eligibility traces in slice preparations. Here the authors provide demonstration of eligibility traces in vivo during reinforcement learning.
Lysergic acid diethylamide (LSD) is a serotonergic psychedelic compound receiving increasing interest due to putative anxiolytic and antidepressant properties. However, the potential neurobiological mechanisms mediating these effects remain elusive. Employing in vivo electrophysiology, microionthophoresis, behavioral paradigms and morphology assays, we assessed the impact of acute and chronic LSD administration on anxiety-like behavior, on the cortical dendritic spines and on the activity of serotonin (5-HT) neurons originating in the dorsal raphe nucleus (DRN) in male mice exposed to chronic restraint stress. We found that while the acute intraperitoneal (i.p.) administration of LSD (5, 15 and 30 and 60 μg/kg) did not produce any anxiolytic or antidepressant effects in non-stressed mice, the dose of 30 µg/kg (daily for 7 days) prevented the stress-induced anxiety-like behavior and the stress-induced decrease of cortical spine densitiy. Interestingly, while LSD acutely decreased the firing activity of 5-HT neurons, repeated LSD increased their basal firing rate and restored the low 5-HT firing induced by stress. This effect was accompanied by a decreased inhibitory response of 5-HT neurons to microiontophoretic applications of the 5-HT1A agonist 8-OH-DPAT (8-hydroxy-N,N-dipropyl-2-aminotetralin). In conclusion, repeated LSD prevents the exacerbation of anxiety-like behavior following chronic stress exposure, but has no behavioral effects in non-stressed mice. These effects are paralleled by increased cortical spinogenesis and an enhancement of 5-HT neurotransmission which might be due to 5-HT1A receptors desensitization. Increased cortical spine density and enhancement of serotonergic neurotransmission may thus represent a candidate mechanism which mediate the therapeutic effects of serotonergic psychedelics on stress-induced anxiety.
This review highlights the utility of applying concepts of temperament and personality traits in healthy individuals to functional studies of serotonin (5-hydroxytryptamine, 5-HT), in an effort to better elucidate the complex roles of 5-HT, and ultimately advance our understanding of psychopathology. We highlight empirical demonstrations of multifaceted and trait-dependent emotional and behavioural effects of manipulating 5-HT in humans, with emphasis on studies employing the technique of acute dietary tryptophan depletion, and additionally selective serotonin reuptake inhibitors. Relevant evidence from studies of 5-HT in non-human animals is also discussed. We show how the effects of central 5-HT manipulations affect behaviour depending not only upon situational context but also on pre-existing temperament and personality traits such as empathy, psychopathy, neuroticism, impulsivity, and intolerance of uncertainty. These effects can be related to the concept of the baseline (or rate-) dependency of neurochemical effects on behavioural control. We speculate about the neurochemical substrates for some of these trait-dependent effects, as well as their clinical significance.
Background: Preliminary data suggest that psilocybin-assisted treatment produces substantial and rapid antidepressant effects in patients with major depressive disorder (MDD), but little is known about long-term outcomes.
Aims: This study sought to examine the efficacy and safety of psilocybin through 12 months in participants with moderate to severe MDD who received psilocybin.
Methods: This randomized, waiting-list controlled study enrolled 27 patients aged 21–75 with moderate to severe unipolar depression (GRID-Hamilton Depression Rating Scale (GRID-HAMD)⩾17). Participants were randomized to an immediate or delayed (8weeks) treatment condition in which they received two doses of psilocybin with supportive psychotherapy. Twenty-four participants completed both psilocybin sessions and were followed through 12months following their second dose.
Results: All 24 participants attended all follow-up visits through the 12-month timepoint. Large decreases from baseline in GRID-HAMD scores were observed at 1-, 3-, 6-, and 12-month follow-up (Cohen d=2.3, 2.0, 2.6, and 2.4, respectively). Treatment response (⩾50% reduction in GRID-HAMD score from baseline) and remission were 75% and 58%, respectively, at 12months. There were no serious adverse events judged to be related to psilocybin in the long-term follow-up period, and no participants reported psilocybin use outside of the context of the study. Participant ratings of personal meaning, spiritual experience, and mystical experience after sessions predicted increased well-being at 12months, but did not predict improvement in depression.
Conclusions: These findings demonstrate that the substantial antidepressant effects of psilocybin-assisted therapy may be durable at least through 12 months following acute intervention in some patients.
Decision-making not only involves deciding about which action to choose but when and whether to initiate an action in the first place. Macaque monkeys tracked number of dots on a screen and could choose when to make a response. The longer the animals waited before responding, the more dots appeared on the screen and the higher the probability of reward. Monkeys waited longer before making a response when a trial’s value was less than the environment’s average value. Recordings of brain activity with fMRI revealed that activity in dorsal raphe nucleus (DRN)—a key source of serotonin (5-HT)—tracked average value of the environment. By contrast, activity in the basal forebrain (BF)—an important source of acetylcholine (ACh)—was related to decision time to act as a function of immediate and recent past context. Interactions between DRN and BF and the anterior cingulate cortex (ACC), another region with action initiation-related activity, occurred as a function of the decision time to act. Next, we performed two psychopharmacological studies. Manipulating systemic 5-HT by citalopram prolonged the time macaques waited to respond for a given opportunity. This effect was more evident during blocks with long inter-trial intervals (ITIs) where good opportunities were sparse. Manipulating systemic acetylcholine (ACh) by rivastigmine reduced the time macaques waited to respond given the immediate and recent past context, a pattern opposite to the effect observed with 5-HT. These findings suggest complementary roles for serotonin/DRN and acetylcholine/BF in decisions about when to initiate an action.
Economic choice is thought to involve the elicitation of the subjective values of the choice options. Thus far, value estimation in animals has relied upon stochastic choices between multiple options presented in repeated trials and expressed from averages of dozens of trials. However, subjective reward valuations are made moment-to-moment and do not always require alternative options; their consequences are usually felt immediately. Here we describe a Becker-DeGroot-Marschak (BDM) auction-like mechanism that provides more direct and simple valuations with immediate consequences. The BDM encourages agents to truthfully reveal their true subjective value in individual choices ('incentive compatibility'). Male monkeys reliably placed well-ranked BDM bids for up to five juice volumes while paying from a water budget. The bids closely approximated the average subjective values estimated with conventional binary choices, thus demonstrating procedural invariance and aligning with the wealth of knowledge acquired with these less direct estimation methods. The feasibility of BDM bidding in monkeys paves the way for an analysis of subjective neuronal value signals in single trials rather than from averages; the feasibility also bridges the gap to the increasingly used BDM method in human neuroeconomics.Significance:The subjective economic value of rewards cannot be measured directly but must be inferred from observable behavior. Until now, the estimation method in animals was rather complex and required comparison between several choice options during repeated choices; thus, such methods did not respect the imminence of the outcome from individual choices. However, human economic research has developed a simple auction-like procedure that can reveal in a direct and immediate manner the true subjective value in individual choices (Becker-DeGroot-Marschak, BDM, mechanism). The current study implemented this mechanism in rhesus monkeys and demonstrates its usefulness for eliciting meaningful value estimates of liquid rewards. The mechanism allows future neurophysiological assessment of subjective reward value signals in single trials of controlled animal tasks.
Classic foraging theory predicts that humans and animals aim to gain maximum reward per unit time. However, in standard instrumental conditioning tasks individuals adopt an apparently suboptimal strategy: they respond slowly when the expected value is low. This reward-related bias is often explained as reduced motivation in response to low rewards. Here we present evidence this behavior is associated with a complementary increased motivation to search the environment for alternatives. We trained monkeys to search for reward-related visual targets in environments with different values. We found that the reward-related bias scaled with environment value, was consistent with persistent searching after the target was already found, and was associated with increased exploratory gaze to objects in the environment. A novel computational model of foraging suggests that this search strategy could be adaptive in naturalistic settings where both environments and the objects within them provide partial information about hidden, uncertain rewards.
Vast amounts of personalized information are now available to individuals. A vital research challenge is to establish how people decide what information they wish to obtain. Here, over five studies examining information-seeking in different domains we show that information-seeking is associated with three diverse motives. Specifically, we find that participants assess whether information is useful in directing action, how it will make them feel, and whether it relates to concepts they think of often. We demonstrate that participants integrate these assessments into a calculation of the value of information that explains information seeking or its avoidance. Different individuals assign different weights to these three factors when seeking information. Using a longitudinal approach, we find that the relative weights assigned to these information-seeking motives within an individual show stability over time, and are related to mental health as assessed using a battery of psychopathology questionnaires.
The dorsal raphe nucleus (DR) and median raphe nucleus (MR) contain populations of glutamatergic and GABAergic neurons that regulate diverse behavioral functions. However, their whole-brain input-output circuits remain incompletely elucidated. We used viral tracing combined with fluorescence micro-optical sectioning tomography to generate a comprehensive whole-brain atlas of inputs and outputs of glutamatergic and GABAergic neurons in the DR and MR. We found that these neurons received inputs from similar upstream brain regions. The glutamatergic and GABAergic neurons in the same raphe nucleus had divergent projection patterns with differences in critical brain regions. Specifically, MR glutamatergic neurons projected to the lateral habenula through multiple pathways. Correlation and cluster analysis revealed that glutamatergic and GABAergic neurons in the same raphe nucleus received heterogeneous inputs and sent different collateral projections. This connectivity atlas further elucidates the anatomical architecture of the raphe nuclei, which could facilitate better understanding of their behavioral functions.
Psilocybin has shown promise for the treatment of mood disorders, which are often accompanied by cognitive dysfunction including cognitive rigidity. Recent studies have proposed neuropsychoplastogenic effects as mechanisms underlying the enduring therapeutic effects of psilocybin. In an open-label study of 24 patients with major depressive disorder, we tested the enduring effects of psilocybin therapy on cognitive flexibility (perseverative errors on a set-shifting task), neural flexibility (dynamics of functional connectivity or dFC via functional magnetic resonance imaging), and neurometabolite concentrations (via magnetic resonance spectroscopy) in brain regions supporting cognitive flexibility and implicated in acute psilocybin effects (e.g., the anterior cingulate cortex, or ACC). Psilocybin therapy increased cognitive flexibility for at least 4 weeks post-treatment, though these improvements were not correlated with the previously reported antidepressant effects. One week after psilocybin therapy, glutamate and N-acetylaspartate concentrations were decreased in the ACC, and dFC was increased between the ACC and the posterior cingulate cortex (PCC). Surprisingly, greater increases in dFC between the ACC and PCC were associated with less improvement in cognitive flexibility after psilocybin therapy. Connectome-based predictive modeling demonstrated that baseline dFC emanating from the ACC predicted improvements in cognitive flexibility. In these models, greater baseline dFC was associated with better baseline cognitive flexibility but less improvement in cognitive flexibility. These findings suggest a nuanced relationship between cognitive and neural flexibility. Whereas some enduring increases in neural dynamics may allow for shifting out of a maladaptively rigid state, larger persisting increases in neural dynamics may be of less benefit to psilocybin therapy.
Serotonin is involved in updating responses to changing environmental circumstances. Optimising behaviour to maximise reward and minimise punishment may require shifting strategies upon encountering new situations. Likewise, autonomic responses to threats are critical for survival yet must be modified as danger shifts from one source to another. Whilst numerous psychiatric disorders are characterised by behavioural and autonomic inflexibility, few studies have examined the contribution of serotonin in humans. We modelled both processes, respectively, in two independent experiments (N = 97). Experiment 1 assessed instrumental (stimulus-response-outcome) reversal learning whereby individuals learned through trial and error which action was most optimal for obtaining reward or avoiding punishment initially, and the contingencies subsequently reversed serially. Experiment 2 examined Pavlovian (stimulus-outcome) reversal learning assessed by the skin conductance response: one innately threatening stimulus predicted receipt of an uncomfortable electric shock and another did not; these contingencies swapped in a reversal phase. Upon depleting the serotonin precursor tryptophan—in a double-blind randomised placebo-controlled design—healthy volunteers showed impairments in updating both actions and autonomic responses to reflect changing contingencies. Reversal deficits in each domain, furthermore, were correlated with the extent of tryptophan depletion. Initial Pavlovian conditioning, moreover, which involved innately threatening stimuli, was potentiated by depletion. These results translate findings in experimental animals to humans and have implications for the neurochemical basis of cognitive inflexibility.
Choice-relevant brain regions in prefrontal cortex may progressively transform information about options into choices. Here, we examine responses of neurons in four regions of the medial prefrontal cortex as macaques performed two-option risky choices. All four regions encode economic variables in similar proportions and show similar putative signatures of key choice-related computations. We provide evidence to support a gradient of function that proceeds from areas 14 to 25 to 32 to 24. Specifically, we show that decodability of twelve distinct task variables increases along that path, consistent with the idea that regions that are higher in the anatomical hierarchy make choice-relevant variables more separable. We also show progressively longer intrinsic timescales in the same series. Together these results highlight the importance of the medial wall in choice, endorse a specific gradient-based organization, and argue against a modular functional neuroanatomy of choice.
The term ‘temporal discounting’ describes both choice preferences and motivation for delayed rewards. Here we show that neuronal activity in the dorsal part of the primate caudate head (dCDh) signals the temporally discounted value needed to compute the motivation for delayed rewards. Macaque monkeys performed an instrumental task, in which visual cues indicated the forthcoming size and delay duration before reward. Single dCDh neurons represented the temporally discounted value without reflecting changes in the animal’s physiological state. Bilateral pharmacological or chemogenetic inactivation of dCDh markedly distorted the normal task performance based on the integration of reward size and delay, but did not affect the task performance for different reward sizes without delay. These results suggest that dCDh is involved in encoding the integrated multidimensional information critical for motivation.
Significance
Ongoing consumption reduces the subjective value of rewards to different degrees depending on their individual properties, a phenomenon referred to as sensory-specific satiety. Such value change should be manifested in economic choices, and neuronal signals for subjective economic reward value should be sensitive to reward-specific satiety. We tested monkeys during the choice between two options that each contained two different rewards (“bundles”); the two rewards were prone to different degrees of satiety. Ongoing reward consumption affected choices in a way that indicated satiety-induced reward-specific change of subjective economic value. Neuronal responses in the monkey orbitofrontal cortex (OFC) followed the differential reduction of subjective economic value. These results satisfy a crucial requirement for subjective reward value coding in OFC neurons.
The primate prefrontal cortex (PFC) subserves our highest order cognitive operations, and yet is tremendously dependent on a precise neurochemical environment for proper functioning. Depletion of noradrenaline and dopamine, or of acetylcholine from the dorsolateral PFC (dlPFC), is as devastating as removing the cortex itself, and serotonergic influences are also critical to proper functioning of the orbital and medial PFC. Most neuromodulators have a narrow inverted U dose response, which coordinates arousal state with cognitive state, and contributes to cognitive deficits with fatigue or uncontrollable stress. Studies in monkeys have revealed the molecular signaling mechanisms that govern the generation and modulation of mental representations by the dlPFC, allowing dynamic regulation of network strength, a process that requires tight regulation to prevent toxic actions, e.g., as occurs with advanced age. Brain imaging studies in humans have observed drug and genotype influences on a range of cognitive tasks and on PFC circuit functional connectivity, e.g., showing that catecholamines stabilize representations in a baseline-dependent manner. Research in monkeys has already led to new treatments for cognitive disorders in humans, encouraging future research in this important field.
Significance
Preferences for foods high in sugar and fat are near universal and major contributors to obesity. Additionally, human food choices are sophisticated and individualistic: we choose by evaluating a food’s nutrients and sensory features and trading them against quantity and cost. To understand the mechanisms behind human-like food choices, we developed an experimental paradigm in which monkeys chose nutrient rewards offered in varying quantities. Resembling human suboptimal eating, the monkeys’ fat and sugar preferences shifted their nutrient balance away from dietary reference points. Formally defined economic values for specific nutrients and food textures explained the monkeys’ preferences and individual differences. Our findings show how human-like preferences derive from biologically critical food components and open up investigations of underlying neural mechanisms.
The high symptomatic and biological heterogeneity of major depressive disorder (MDD) makes it very difficult to find broadly efficacious treatments that work against all symptoms. Concentrating on single core symptoms that are biologically well understood might consist of a more viable approach. The Research Domain Criteria (RDoC) framework is a trans-diagnostic dimensional approach that focuses on symptoms and their underlying neurobiology. Evidence is accumulating that psychedelics may possess antidepressant activity, and this can potentially be explained through a multi-level (psychobiological, circuitry, (sub)cellular and molecular) analysis of the cognitive systems RDoC domain. Cognitive deficits, such as negative emotional processing and negativity bias, often lead to depressive rumination. Psychedelics can increase long-term cognitive flexibility, leading to normalization of negativity bias and reduction in rumination. We propose a theoretical model that explains how psychedelics can reduce the negativity bias in depressed patients. At the psychobiological level, we hypothesize that the negativity bias in MDD is due to impaired pattern separation and that psychedelics such as psilocybin help in depression because they enhance pattern separation and hence reduce negativity bias. Pattern separation is a mnemonic process that relies on adult hippocampal neurogenesis, where similar inputs are made more distinct, which is essential for optimal encoding of contextual information. Impairment in this process may underlie the negative cognitive bias in MDD by, for example, increased pattern separation of cues with a negative valence that can lead to excessive deliberation on aversive outcomes. On the (sub) cellular level, psychedelics stimulate hippocampal neurogenesis as well as synaptogenesis, spinogenesis and dendritogenesis in the prefrontal cortex. Together, these effects help restoring resilience to chronic stress and lead to modulation of the major connectivity hubs of the prefrontal cortex, hippocampus, and amygdala. Based on these observations, we propose a new translational framework to guide the development of a novel generation of therapeutics to treat the cognitive symptoms in MDD.
Rewarding choice options typically contain multiple components, but neural signals in single brain voxels are scalar and primarily vary up or down. In a previous study, we had designed reward bundles that contained the same two milkshakes with independently set amounts; we had used psychophysics and rigorous economic concepts to estimate two-dimensional choice indifference curves (IC) that represented revealed stochastic preferences for these bundles in a systematic, integrated manner. All bundles on the same ICs were equally revealed preferred (and thus had same utility, as inferred from choice indifference); bundles on higher ICs (higher utility) were preferred to bundles on lower ICs (lower utility). In the current study, we used the established behavior for testing with functional magnetic resonance imaging (fMRI). We now demonstrate neural responses in reward-related brain structures of human female and male participants, including striatum, midbrain and medial orbitofrontal cortex that followed the characteristic pattern of ICs: similar responses along ICs (same utility despite different bundle composition), but monotonic change across ICs (different utility). Thus, these brain structures integrated multiple reward components into a scalar signal, well beyond the known subjective value coding of single-component rewards.SIGNIFICANCE STATEMENT:Rewards have several components, like the taste and size of an apple, but it is unclear how each component contributes to the overall value of the reward. While choice indifference curves of economic theory provide behavioural approaches to this question, it is unclear whether brain responses capture the preference and utility integrated from multiple components. We report activations in striatum, midbrain and orbitofrontal cortex that follow choice indifference curves representing behavioral preferences over and above variations of individual reward components. In addition, the concept-driven approach encourages future studies on natural, multi-component rewards that are prone to irrational choice of normal and brain-damaged individuals.
The ability to recognize motivationally salient events and adaptively respond to them is critical for survival. Here we tested whether dopamine (DA) neurons in the dorsal raphe nucleus (DRN) contribute to this process in both male and female mice. Population recordings of DRN^(DA) neurons during associative learning tasks showed that their activity dynamically tracks the motivational salience, developing excitation to both reward- and shock-paired cues. The DRN^(DA) response to reward-predicting cues was diminished after satiety, suggesting modulation by internal states. DRN^(DA) activity was also greater for unexpected outcomes than for expected outcomes. Two-photon imaging of DRN^(DA) neurons demonstrated that the majority of individual neurons developed activation to reward-predicting cues and reward but not to shock-predicting cues, which was surprising and qualitatively distinct from the population results. Performing the same fear learning procedures in freely-moving and head-fixed groups revealed that head-fixation itself abolished the neural response to aversive cues, indicating its modulation by behavioral context. Overall, these results suggest that DRN^(DA) neurons encode motivational salience, dependent on internal and external factors.
Expected Utility Theory (EUT), the first axiomatic theory of risky choice, describes choices as a utility maximization process: decision makers assign a subjective value (utility) to each choice option and choose the one with the highest utility. The continuity axiom, central to EUT and its modifications, is a necessary and sufficient condition for the definition of numerical utilities. The axiom requires decision makers to be indifferent between a gamble and a specific probabilistic combination of a more preferred and a less preferred gamble. While previous studies demonstrated that monkeys choose according to combinations of objective reward magnitude and probability, a concept-driven experimental approach for assessing the axiomatically defined conditions for maximizing subjective utility by animals is missing. We experimentally tested the continuity axiom for a broad class of gamble types in four male rhesus macaque monkeys, showing that their choice behavior complied with the existence of a numerical utility measure as defined by the economic theory. We used the numerical quantity specified in the continuity axiom to characterize subjective preferences in a magnitude-probability space. This mapping highlighted a trade-off relation between reward magnitudes and probabilities, compatible with the existence of a utility function underlying subjective value computation. These results support the existence of a numerical utility function able to describe choices, allowing for the investigation of the neuronal substrates responsible for coding such rigorously defined quantity.SIGNIFICANCE STATEMENTA common assumption of several economic choice theories is that decisions result from the comparison of subjectively assigned values (utilities). This study demonstrated the compliance of monkey behavior with the continuity axiom of Expected Utility Theory, implying a subjective magnitude-probability trade-off relation which supports the existence of numerical subjective utility directly linked to the theoretical economic framework. We determined a numerical utility measure able to describe choices, which can serve as a correlate for the neuronal activity in the quest for brain structures and mechanisms guiding decisions.
Uncertainty is a ubiquitous component of human economic behaviour, yet people can vary in their preferences for risk across populations, individuals and different points in time. As uncertainty also characterizes many aspects of animal decision-making, comparative research can help evaluate different potential mechanisms that generate this variation, including the role of biological differences or maturational change versus cultural learning, as well as identify human-unique components of economic decision-making. Here, we examine decision-making under risk across non-human primates, our closest relatives. We first review theoretical approaches and current methods for understanding decision-making in animals. We then assess the current evidence for variation in animal preferences between species and populations, between individuals based on personality, sex and age, and finally, between different contexts and individual states. We then use these primate data to evaluate the processes that can shape human decision-making strategies and identify the primate foundations of human economic behaviour.
This article is part of the theme issue ‘Existence and prevalence of economic behaviours among non-human primates’.
In humans, the attitude toward risk is not neutral and is dissimilar between bets involving gains and bets involving losses. The existence and prevalence of these decision features in non-human primates are unclear. In addition, only a few studies have tried to simulate the evolution of agents based on their attitude toward risk. Therefore, we still ignore to what extent Prospect theory’s claims are evolutionarily rooted. To shed light on this issue, we collected data from nine macaques that performed bets involving gains or losses. We confirmed that their overall behaviour is coherent with Prospect theory’s claims. In parallel, we used a genetic algorithm to simulate the evolution of a population of agents across several generations. We showed that the algorithm selects progressively agents that exhibit risk-seeking, and has an inverted S-shape distorted perception of probability. We compared these two results and found that monkeys’ attitude toward risk is only congruent with the simulation when they are facing losses. This result is consistent with the idea that gambling in the loss domain is analogous to deciding in a context of life-threatening challenges where a certain level of risk-seeking behaviour and probability distortion may be adaptive.
This article is part of the theme issue ‘Existence and prevalence of economic behaviours among non-human primates’.
Transient variations in pupil size (PS) under constant luminance are coupled to rapid changes in arousal state,1, 2, 3 which have been interpreted as vigilance,⁴ salience,⁵ or a surprise signal.6, 7, 8 Neural control of such fluctuations presumably involves multiple brain regions⁵,9, 10, 11 and neuromodulatory systems,³,¹²,¹³ but it is often associated with phasic activity of the noradrenergic system.⁹,¹²,¹⁴,¹⁵ Serotonin (5-HT), a neuromodulator also implicated in aspects of arousal¹⁶ such as sleep-wake transitions,¹⁷ motivational state regulation,¹⁸ and signaling of unexpected events,¹⁹ seems to affect PS,20, 21, 22, 23, 24 but these effects have not been investigated in detail. Here we show that phasic 5-HT neuron stimulation causes transient PS changes. We used optogenetic activation of 5-HT neurons in the dorsal raphe nucleus (DRN) of head-fixed mice performing a foraging task. 5-HT-driven modulations of PS were maintained throughout the photostimulation period and sustained for a few seconds after the end of stimulation. We found no evidence that the increase in PS with activation of 5-HT neurons resulted from interactions of photostimulation with behavioral variables, such as locomotion or licking. Furthermore, we observed that the effect of 5-HT on PS depended on the level of environmental uncertainty, consistent with the idea that 5-HT could report a surprise signal.¹⁹ These results advance our understanding of the neuromodulatory control of PS, revealing a tight relationship between phasic activation of 5-HT neurons and changes in PS.
Individuals often assess past decisions by comparing what was gained with what would have been gained had they acted differently. Thoughts of past alternatives that counter what actually happened are called "counterfactuals." Recent theories emphasize the role of the prefrontal cortex in processing counterfactual outcomes in decision-making, although how subcortical regions contribute to this process remains to be elucidated. Here we report a clear distinction among the roles of the orbitofrontal cortex, ventral striatum and midbrain dopamine neurons in processing counterfactual outcomes in monkeys. Our findings suggest that actually gained and counterfactual outcome signals are both processed in the cortico-subcortical network constituted by these regions but in distinct manners and integrated only in the orbitofrontal cortex in a way to compare these outcomes. This study extends the prefrontal theory of counterfactual thinking and provides key insights regarding how the prefrontal cortex cooperates with subcortical regions to make decisions using counterfactual information.
Background
The nature of cognitive flexibility deficits in obsessive-compulsive disorder (OCD), which historically have been tested with probabilistic reversal learning tasks, remains elusive. Here, a novel deterministic reversal task and inclusion of unmedicated patients in the study sample illuminated the role of fixed versus uncertain rules/contingencies and of serotonergic medication. Additionally, our understanding of probabilistic reversal was enhanced through theoretical computational modeling of cognitive flexibility in OCD.
Methods
We recruited 49 patients with OCD, 21 of whom were unmedicated, and 43 healthy control participants matched for age, IQ, and gender. Participants were tested on 2 tasks: a novel visuomotor deterministic reversal learning task with 3 reversals (feedback rewarding/punishing/neutral) measuring accuracy/perseveration and a 2-choice visual probabilistic reversal learning task with uncertain feedback and a single reversal measuring win-stay and lose-shift. Bayesian computational modeling provided measures of learning rate, reinforcement sensitivity, and stimulus stickiness.
Results
Unmedicated patients with OCD were impaired on the deterministic reversal task under punishment only at the first and third reversals compared with both control participants and medicated patients with OCD, who had no deficit. Perseverative errors were correlated with OCD severity. On the probabilistic reversal task, unmedicated patients were only impaired at reversal, whereas medicated patients were impaired at both the learning and reversal stages. Computational modeling showed that the overall change was reduced feedback sensitivity in both OCD groups.
Conclusions
Both perseveration and increased shifting can be observed in OCD, depending on test conditions including the predictability of reinforcement. Perseveration was related to clinical severity and remediated by serotonergic medication.
Realistic, everyday rewards contain multiple components, such as taste and size. However, our reward valuations and the associated neural reward signals are single dimensional (vector to scalar transformation). Here, we present a protocol to identify these single-dimensional neural responses for multi-component choice options in humans and monkeys using concept-based behavioral choice experiments. We describe the use of stringent economic concepts to develop and implement behavioral tasks. We detail regional neuroimaging in humans and fine-grained neurophysiology in monkeys and describe approaches for data analysis.
For complete details on the use and execution of this protocol, please refer to our work on humans Seak et al.¹ and Pastor-Bernier et al.² and monkeys Pastor-Bernier et al. ³, Pastor-Bernier et al.⁴, and Pastor-Bernier et al.⁵.
Serotonin influences many aspects of animal behavior. But how serotonin acts on its diverse receptors across the brain to modulate global activity and behavior is unknown. Here, we examine how serotonin release in C. elegans alters brain-wide activity to induce foraging behaviors, like slow locomotion and increased feeding. Comprehensive genetic analyses identify three core serotonin receptors (MOD-1, SER-4, and LGC-50) that induce slow locomotion upon serotonin release and others (SER-1, SER-5, and SER-7) that interact with them to modulate this behavior. SER-4 induces behavioral responses to sudden increases in serotonin release, whereas MOD-1 induces responses to persistent release. Whole-brain imaging reveals widespread serotonin-associated brain dynamics, spanning many behavioral networks. We map all sites of serotonin receptor expression in the connectome, which, together with synaptic connectivity, helps predict which neurons show serotonin-associated activity. These results reveal how serotonin acts at defined sites across a connectome to modulate brain-wide activity and behavior.
Research in computational psychiatry is dominated by models of behavior. Subjective experience during behavioral tasks is not well understood, even though it should be relevant to understanding the symptoms of psychiatric disorders. Here, we bridge this gap and review recent progress in computational models for subjective feelings. For example, happiness reflects not how well people are doing, but whether they are doing better than expected. This dependence on recent reward prediction errors is intact in major depression, although depressive symptoms lower happiness during tasks. Uncertainty predicts subjective feelings of stress in volatile environments. Social prediction errors influence feelings of self-worth more in individuals with low self-esteem despite a reduced willingness to change beliefs due to social feedback. Measuring affective state during behavioral tasks provides a tool for understanding psychiatric symptoms that can be dissociable from behavior. When smartphone tasks are collected longitudinally, subjective feelings provide a potential means to bridge the gap between lab-based behavioral tasks and real-life behavior, emotion, and psychiatric symptoms.
Background:
Psilocybin is being studied for use in treatment-resistant depression.
Methods:
In this phase 2 double-blind trial, we randomly assigned adults with treatment-resistant depression to receive a single dose of a proprietary, synthetic formulation of psilocybin at a dose of 25 mg, 10 mg, or 1 mg (control), along with psychological support. The primary end point was the change from baseline to week 3 in the total score on the Montgomery-Åsberg Depression Rating Scale (MADRS; range, 0 to 60, with higher scores indicating more severe depression). Secondary end points included response at week 3 (≥50% decrease from baseline in the MADRS total score), remission at week 3 (MADRS total score ≤10), and sustained response at 12 weeks (meeting response criteria at week 3 and all subsequent visits).
Results:
A total of 79 participants were in the 25-mg group, 75 in the 10-mg group, and 79 in the 1-mg group. The mean MADRS total score at baseline was 32 or 33 in each group. Least-squares mean changes from baseline to week 3 in the score were -12.0 for 25 mg, -7.9 for 10 mg, and -5.4 for 1 mg; the difference between the 25-mg group and 1-mg group was -6.6 (95% confidence interval [CI], -10.2 to -2.9; P<0.001) and between the 10-mg group and 1-mg group was -2.5 (95% CI, -6.2 to 1.2; P = 0.18). In the 25-mg group, the incidences of response and remission at 3 weeks, but not sustained response at 12 weeks, were generally supportive of the primary results. Adverse events occurred in 179 of 233 participants (77%) and included headache, nausea, and dizziness. Suicidal ideation or behavior or self-injury occurred in all dose groups.
Conclusions:
In this phase 2 trial involving participants with treatment-resistant depression, psilocybin at a single dose of 25 mg, but not 10 mg, reduced depression scores significantly more than a 1-mg dose over a period of 3 weeks but was associated with adverse effects. Larger and longer trials, including comparison with existing treatments, are required to determine the efficacy and safety of psilocybin for this disorder. (Funded by COMPASS Pathfinder; EudraCT number, 2017-003288-36; ClinicalTrials.gov number, NCT03775200.).
Psychedelics are serotonin 2A receptor agonists that can lead to profound changes in perception, cognition and mood. In this review, we focus on the basic neurobiology underlying the action of psychedelic drugs. We first discuss chemistry, highlighting the diversity of psychoactive molecules and the principles that govern their potency and pharmacokinetics. We describe the roles of serotonin receptors and their downstream molecular signaling pathways, emphasizing key elements for drug discovery. We consider the impact of psychedelics on neuronal spiking dynamics in several cortical and subcortical regions, along with transcriptional changes and sustained effects on structural plasticity. Finally, we summarize neuroimaging results that pinpoint effects on association cortices and thalamocortical functional connectivity, which inform current theories of psychedelic action. By synthesizing knowledge across the chemical, molecular, neuronal, and network levels, we hope to provide an integrative perspective on the neural mechanisms responsible for the acute and enduring effects of psychedelics on behavior. Psychedelics are serotonergic drugs that have therapeutic potential. This Review article provides an integrative perspective on the basic neurobiology underlying the actions of psychedelics and highlights open questions in the field.
Depressive symptoms are associated with altered pupillary responses during learning and reward prediction as well as with changes in neurometabolite levels, including brain concentrations of choline, glutamate and gamma-aminobutyric acid (GABA). However, the full link between depressive symptoms, reward-learning-related pupillary responses and neurometabolites is yet to be established as these constructs have not been assessed in the same individuals. The present pilot study, investigated these relations in a sample of 24 adolescents aged 13 years. Participants completed the Revised Child Anxiety and Depression Scale (RCADS) and underwent a reward learning task while measuring pupil dilation and a single voxel dorsal anterior cingulate cortex (dACC) MEGA-PRESS magnetic resonance spectroscopy scan assessing choline, glutamate and GABA concentrations. Pupil dilation was related to prediction errors (PE) during learning, which was captured by a prediction error-weighted pupil dilation response index (PE-PDR) for each individual. Higher PE-PDR scores, indicating larger pupil dilations to negative prediction errors, were related to lower depressive symptoms and lower dACC choline concentrations. Dorsal ACC choline was positively associated with depressive symptoms, whereas glutamate and GABA were not related to PE-PDR or depressive symptoms. The findings support notions of cholinergic involvement in depressive symptoms and cholinergic influence on reward-related pupillary response, suggesting that pupillary responses to negative prediction errors may hold promise as a biomarker of depressive states.
The serotonin system modulates a wide variety of emotional behaviors and states, including reward processing, anxiety, and social interaction. To reveal the underlying patterns of neural activity, we visualized serotonergic neurons in the dorsal raphe nucleus (DRN5-HT) of mice using miniaturized microscopy during diverse emotional behaviors. We discovered ensembles of cells with highly correlated activity and found that DRN5-HT neurons are preferentially recruited by emotionally salient stimuli as opposed to neutral stimuli. Individual DRN5-HT neurons responded to diverse combinations of salient stimuli, with some preference for valence and sensory modality. Anatomically defined subpopulations projecting to either a reward-related structure (the ventral tegmental area) or an anxiety-related structure (the bed nucleus of the stria terminalis) contained all response types but were enriched in reward- and anxiety-responsive cells, respectively. Our results suggest that the DRN serotonin system responds to emotional salience using ensembles with mixed selectivity and biases in downstream connectivity.
Nervous systems evolved to effectively navigate the dynamics of the environment to achieve their goals. One framework used to study this fundamental problem arose in the study of learning and decision-making. In this framework, the demands of effective behavior require slow dynamics—on the scale of seconds to minutes—of networks of neurons. Here, we review the phenomena and mechanisms involved. Using vignettes from a few species and areas of the nervous system, we view neuromodulators as key substrates for temporal scaling of neuronal dynamics.
Expected final online publication date for the Annual Review of Neuroscience, Volume 45 is July 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Logistic regressions were developed in economics to model individual choice behavior. In recent years, they have become an important tool in decision neuroscience. Here, I describe and discuss different logistic models, emphasizing the underlying assumptions and possible interpretations. Logistic models may be used to quantify a variety of behavioral traits, including the relative subjective value of different goods, the choice accuracy, risk attitudes, and choice biases. More complex logistic models can be used for choices between good bundles, in cases of nonlinear value functions, and for choices between multiple options. Finally, logistic models can quantify the explanatory power of neuronal activity on choices, thus providing a valid alternative to receiver operating characteristic (ROC) analyses.
Regulating how fast to learn is critical for flexible behavior. Learning about the consequences of actions should be slow in stable environments, but accelerate when that environment changes. Recognizing stability and detecting change are difficult in environments with noisy relationships between actions and outcomes. Under these conditions, theories propose that uncertainty can be used to modulate learning rates (“meta-learning”). We show that mice behaving in a dynamic foraging task exhibit choice behavior that varied as a function of two forms of uncertainty estimated from a meta-learning model. The activity of dorsal raphe serotonin neurons tracked both types of uncertainty in the foraging task as well as in a dynamic Pavlovian task. Reversible inhibition of serotonin neurons in the foraging task reproduced changes in learning predicted by a simulated lesion of meta-learning in the model. We thus provide a quantitative link between serotonin neuron activity, learning, and decision making.
Energy balance is orchestrated by an extended network of highly interconnected nuclei across the central nervous system. While much is known about the hypothalamic circuits regulating energy homeostasis, the ‘extra-hypothalamic’ circuits involved are relatively poorly understood. In this review, we focus on the brainstem’s dorsal raphe nucleus (DRN), integrating decades of research linking this structure to the physiologic and behavioral responses that maintain proper energy stores. DRN neurons sense and respond to interoceptive and exteroceptive cues related to energy imbalance and in turn induce appropriate alterations in energy intake and expenditure. The DRN is also molecularly differentiable, with different populations playing distinct and often opposing roles in controlling energy balance. These populations are integrated into the extended circuit known to regulate energy balance. Overall, this review summarizes the key evidence demonstrating an important role for the DRN in regulating energy balance.
Hypotheses and beliefs guide credit assignment – the process of determining which previous events or actions caused an outcome. Adaptive hypothesis formation and testing are crucial in uncertain and changing environments in which associations and meanings are volatile. Despite primates’ abilities to form and test hypotheses, establishing what is causally responsible for the occurrence of particular outcomes remains a fundamental challenge for credit assignment and learning. Hypotheses about what surprises are due to stochasticity inherent in an environment as opposed to real, systematic changes are necessary for identifying the environment’s predictive features, but are often hard to test. We review evidence that two highly interconnected frontal cortical regions, anterior cingulate cortex and ventrolateral prefrontal area 47/12o, provide a biological substrate for linking two crucial components of hypothesis-formation and testing: the control of information seeking and credit assignment. Neuroimaging, targeted disruptions, and neurophysiological studies link an anterior cingulate – 47/12o circuit to generation of exploratory behaviour, non-instrumental information seeking, and interpretation of subsequent feedback in the service of credit assignment. Our observations support the idea that information seeking and credit assignment are linked at the level of neural circuits and explain why this circuit is important for ensuring behaviour is flexible and adaptive.
Humans and animals can be strongly motivated to seek information to resolve uncertainty about rewards and punishments. In particular, despite its clinical and societal relevance, very little is known about information seeking about punishments. We show that attitudes toward information about punishments and rewards are distinct and separable at both behavioral and neuronal levels. We demonstrate the existence of prefrontal neuronal populations that anticipate opportunities to gain information in a relatively valence-specific manner, separately anticipating information about either punishments or rewards. These neurons are located in anatomically interconnected subregions of anterior cingulate cortex (ACC) and ventrolateral prefrontal cortex (vlPFC) in area 12o/47. Unlike ACC, vlPFC also contains a population of neurons that integrate attitudes toward both reward and punishment information, to encode the overall preference for information in a bivalent manner. This cortical network is well suited to mediate information seeking by integrating the desire to resolve uncertainty about multiple, distinct motivational outcomes.
Adapting to changing environmental conditions requires a prospective inference of future actions and their consequences, a strategy also known as model-based decision making.1, 2, 3 In stable environments, extensive experience of actions and their consequences leads to a shift from a model-based to a model-free strategy, whereby behavioral selection is primarily governed by retrospective experiences of positive and negative outcomes. Human and animal studies, where subjects are required to speculate about implicit information and adjust behavioral responses over multiple sessions, point to a role for the central serotonergic system in model-based decision making.4, 5, 6, 7, 8 However, to directly test a causal relationship between serotonergic activity and model-based decision making, phase-specific manipulation of serotonergic activity is needed in a one-shot test, where learning by trial and error is neutralized. Moreover, the serotonergic origin responsible for this effect is yet to be determined. Herein, we demonstrate that optogenetic silencing of serotonin neurons in the dorsal raphe nucleus, but not in the median raphe nucleus, disrupts model-based decision making in lithium-induced outcome devaluation tasks.9, 10, 11 Our data indicate that the serotonergic behavioral effects are not due to increased locomotor activity, anxiolytic effects, or working memory deficits. Our findings provide insights into the neural mechanisms underlying neural weighting between model-free and model-based strategies.
Serotonin is a neuromodulator that is implicated in awake-sleep cycle, motor behaviors, reward, motivation, and mood. Recent molecular tools for cell-type-specific activity recording and manipulation with fine temporal and spatial resolutions are providing unprecedentedly detailed data about serotonergic neuromodulation. These newly gained information show substantial differences in the signaling and effect of serotonergic neuromodulation depending on the projection targets. To find the common denominator for this diversity, we conjecture that the evolution of serotonergic neuromodulation originates from signaling the time and resource available for action, learning, and development.
Selective serotonin reuptake inhibitors (SSRIs) are widely used to treat psychiatric disorders with affective biases such as depression and anxiety. How SSRIs exert a beneficial action on emotions associated with life events is still unknown. Here we ask whether and how the effectiveness of the SSRI fluoxetine is underpinned by neural mechanisms in the ventral striatum. To address these issues, we studied the spiking activity of neurons in the ventral striatum of monkeys during an approach-avoidance task in which the valence assigned to sensory stimuli was manipulated. Neural responses to positive and negative events were measured before and during a 4-week treatment with fluoxetine. We conducted PET scans to confirm that fluoxetine binds within the ventral striatum at a therapeutic dose. In our monkeys, fluoxetine facilitated approach of rewards and avoidance of punishments. These beneficial effects were associated with changes in tonic and phasic activities of striatal neurons. Fluoxetine increased the spontaneous firing rate of striatal neurons and amplified the number of cells responding to rewards versus punishments, reflecting a drug-induced positive shift in the processing of emotionally valenced information. These findings reveal how SSRI treatment affects ventral striatum neurons encoding positive and negative valence and striatal signaling of emotional information. In addition to a key role in appetitive processing, our results shed light on the involvement of the ventral striatum in aversive processing. Together, the ventral striatum appears to play a central role in the action of SSRIs on emotion processing biases commonly observed in psychiatric disorders.
Cognitive inflexibility is suggested by the hallmark symptoms of obsessive-compulsive disorder (OCD), namely the occurrence of repetitive thoughts and/or behaviours that persist despite being functionally impairing and egodystonic to the individual. As well as being implied by the top-level symptoms, cognitive inflexibility in OCD, and some related conditions, has also been objectively quantified in case-control studies using computerised cognitive tasks. This chapter begins by considering the objective measurement of different aspects of cognitive flexibility using neuropsychological paradigms, with a focus on neural and neurochemical substrates. It moves on to conduct a systematic review and meta-analysis of findings from a widely deployed flexibility task: the Intra-Dimensional/Extra-Dimensional Set-Shift Task (IDED). By pooling data from 11 studies (335 OCD patients and 311 controls), we show that Extra-Dimensional (ED) shift deficits are a robust and reproducible finding (effect size medium-large) in OCD across the literature, and that this deficit is not attributable to group differences in age or IQ. The OCD ED deficit is then discussed in terms of dysfunction of fronto-striatal pathways (as exemplified, for example, by functional connectivity data), and the putative role of different neurotransmitters. We consider evidence that impaired ED shifting constitutes a candidate vulnerability marker (or 'endophenotype') for OCD. The available literature is then surveyed as to ED findings in other obsessive-compulsive (OC) related disorders (e.g. hoarding, body-dysmorphic disorder, and trichotillomania), as well as in non-OC disorders (schizophrenia and anxiety symptoms in general). Lastly, we consider more recent, emerging developments in the quantification of compulsivity using cognitive tasks and questionnaires, as well as key directions for future research, including the need to refine compulsivity and its composite cognitive processes.