ArticlePDF Available

Dopamine Modulates Novelty Seeking Behavior During Decision Making

American Psychological Association
Behavioral Neuroscience
Authors:
Vincent Daniel Costa at Emory University
Vincent Daniel Costa
Valery L. Tran
Valery L. Tran
Valery L. Tran
  • This person is not on ResearchGate, or hasn't claimed this research yet.
Janita Turchi
Janita Turchi
Janita Turchi
  • This person is not on ResearchGate, or hasn't claimed this research yet.
Bruno Averbeck at U.S. Department of Health and Human Services
Bruno Averbeck
Download full-text PDF
Read full-text
Download citation

Abstract and Figures

Novelty seeking refers to the tendency of humans and animals to explore novel and unfamiliar stimuli and environments. The idea that dopamine modulates novelty seeking is supported by evidence that novel stimuli excite dopamine neurons and activate brain regions receiving dopaminergic input. In addition, dopamine is shown to drive exploratory behavior in novel environments. It is not clear whether dopamine promotes novelty seeking when it is framed as the decision to explore novel options versus the exploitation of familiar options. To test this hypothesis, we administered systemic injections of saline or GBR-12909, a selective dopamine transporter (DAT) inhibitor, to monkeys and assessed their novelty seeking behavior during a probabilistic decision making task. The task involved pseudorandom introductions of novel choice options. This allowed monkeys the opportunity to explore novel options or to exploit familiar options that they had already sampled. We found that DAT blockade increased the monkeys' preference for novel options. A reinforcement learning (RL) model fit to the monkeys' choice data showed that increased novelty seeking after DAT blockade was driven by an increase in the initial value the monkeys assigned to novel options. However, blocking DAT did not modulate the rate at which the monkeys learned which cues were most predictive of reward or their tendency to exploit that knowledge. These data demonstrate that dopamine enhances novelty-driven value and imply that excessive novelty seeking-characteristic of impulsivity and behavioral addictions-might be caused by increases in dopamine, stemming from less reuptake. (PsycINFO Database Record (c) 2014 APA, all rights reserved).
Figures - uploaded by Vincent Daniel Costa
Author content
All figure content in this area was uploaded by Vincent Daniel Costa
Content may be subject to copyright.
Content uploaded by Vincent Daniel Costa
Author content
All content in this area was uploaded by Vincent Daniel Costa on Sep 24, 2014
Content may be subject to copyright.
A preview of the PDF is not available
A preview of this full-text is provided by American Psychological Association.
Learn more
Content available from Behavioral Neuroscience 
This content is subject to copyright. Terms and conditions apply.
... OFC value computations influence animals' preference and motivation (Ballesta et al., 2020;Elston & Wallis, 2025;Knudsen & Wallis, 2022;Wilson et al., 2014) and top-down attention (Hunt et al., 2018;Lim et al., 2011;McGinty et al., 2016;Perkins & Rich, 2024;Xie et al., 2018). When OFC computations are disrupted by reducing AVMTC inputs, other circuits, and brain areas involved in novelty detection and novelty seeking (Burns et al., 1996;Chen et al., 2020;Costa et al., 2014Costa et al., , 2019Monosov et al., 2022;Ogasawara et al., 2022;Tapper & Molas, 2020;Yamamoto et al., 2012) may gain a relatively stronger influence over choice (particularly if AVMTC is not acting simply to increase the value of reward expectations when novelty is expected). For example, a faster process that guides animals towards future novelty through the zona incerta-brainstem circuits (Ahmadlou et al., 2021;Ogasawara et al., 2022) may become more dominant following the disruption of OFC. ...
Temporal–orbitofrontal pathway regulates choices across physical reward and visual novelty
Preprint
Full-text available
  • Apr 2025
Perceptually novel objects have profound impacts on our daily decisions. People often pay to try novel meals over familiar ones, or to see novel visual scenes at art exhibits and travel destinations. This suggests that perceptual novelty and the value of physical rewards, such as food, interact at the level of neural circuits to guide decisions, but where and how is unknown. We designed a behavioral task to study this novelty-reward interaction in animals and to uncover its neural underpinnings. Subjects chose among familiar offers associated with different expectations of novel objects and different expectations of juice rewards. Expectation of novel objects increased the preference for expected rewards. This novelty-reward interaction was reflected by neural activity in the anterior ventral temporal cortex (AVMTC) – a region previously implicated in the detection and prediction of novelty – and in the orbitofrontal cortex (OFC) – an area that receives prominent AVMTC inputs and is known for its capacity to signal subjective value of visual objects. Neural activity patterns suggested that AVMTC was upstream of OFC in the decision process. Chemogenetic disruption of the AVMTC → OFC circuit altered the impact of expected novelty on the valuation of physical reward. Hence, the ventral visual system impacts novelty-reward interactions during decisions through direct projections to OFC.
View
... In foraging contexts, novelty is inherently tied to pursuing new information and resources, as organisms must continuously adapt their strategies in response to changing environmental conditions (Addicott et al. 2017;Mobbs et al. 2018). Costa et al. (2014) and Menegas et al. (2018) explore how dopamine exploits novelty-seeking behavior during DM and approach-retreat behaviors in foraging, emphasizing the significance of understanding the neurological mechanisms underlying these behaviors. Nevertheless, these methodological approaches, which can be interpreted as risk assessments, are less applicable to conventional JDM tasks. ...
Adaptive Decision-Making "Fast" and "Slow": A Model of Creative Thinking
Article
Full-text available
The late Daniel Kahneman introduced the concept of fast and slow thinking, representing two distinct cognitive systems involved in decision-making (DM). Fast thinking (System 1) operates intuitively and spontaneously. In contrast, slow thinking (System 2) is characterized by deliberation and analytical reasoning. Following Kahneman's view, called the biases view, we suggest a framework involving the interplay between two systems, the bottom-up and top-down approaches. These two approaches involve various modalities, including learning skills, perception, cognition, attention, and emotion. Accordingly, we incorporate temporal modulation, which varies based on individual differences and accounts for adaptive DM. Our overarching framework elucidates how the brain dynamically allocates resources for adaptive DM and how creative mental processes could drive it. We highlight the immense value of interdisciplinary research collaboration in progressing the empirical research of our proposed framework.
View
... [163][164][165] Dopamine released from the SNpc preferentially activates the core of the nucleus accumbens (NAcc), which is implicated in motivation and reward-seeking behaviors, but minimally engages the NAcc shell, which mediates consummatory pleasure and endorphin release. 166,167 Consequently, each novel stimulus/event creates a cycle of dopamine-driven anticipation as opposed to endorphinmediated pleasure. 168,169 Even as each novel stimulus elicits dopamine release, incessant novelty overloads cognition and impairs focus, memory retention, and deep task engagement. ...
Human regulatory systems in the age of abundance: A predictive processing perspective
Article
Full-text available
Human regulatory systems largely evolved under conditions of food and information scarcity but are now being forced to deal with abundance. The impact of abundance and the inability of human regulatory systems to adapt to it have fed a surge in dual health challenges: (1) a rise in obesity related to food abundance and (2) a rise in stress and anxiety related to information abundance. No single framework has been developed to describe why and how the transition from scarcity to abundance has been so challenging. Here, we provide a speculative model based on predictive processing. We suggest that whereas scarcity (above destructive lower bounds like famine or information voids) preserves the fidelity of the relationship between prediction errors and predictions, abundance distorts this relationship. Furthermore, prediction error minimization is enhanced under scarcity (as the number of competing states in the niche is restricted), whereas the opposite is true under abundance. We also discuss how abundance warps the fundamental drive for seeking novelty by fueling the brain's exploration (as opposed to exploitation) mode. Ameliorative strategies for regulating food and information abundance may largely depend on simulating scarcity, that environmental condition to which human regulatory systems have adapted over millennia.
View
... This increased baseline dopamine BOX 2: Association vs. causality in the case of toxoplasmosis can lead to compensatory postsynaptic dopamine receptor hyposensitivity -a decrease in the sensitivity or number of dopamine receptors on the postsynaptic neurons. As a result, when dopamine release is stimulated, there is lower reactive dopaminergic activity due to the reduced receptor responsiveness (Cloninger et al. 1993, Ruegg et al. 1997, Costa et al. 2014. It is also known that high dopamine levels in certain areas of the brain are found in patients with schizophrenia (Derincon andBonilla 1983, Schulz et al. 2022). ...
Thirty years of studying latent toxoplasmosis: behavioural, physiological, and health insights
Article
  • Jan 2025
  • Folia Parasitol
In this article, I recount the journey of discovering the effects of latent toxoplasmosis on human psychology, behaviour, morphology, and health as I observed it from the closest perspective over the past 30+ years, during which our laboratory has been intensely focused on this research. I trace how we moved from the initial observations of differences between infected and uninfected individuals in certain personality traits to the systematic study of similar differences in behaviour, both in the laboratory and in everyday life, as well as in physiological and even morphological traits. This eventually led us to investigate the causal relationships behind these observed associations and their molecular basis. I describe some of the unexpected discoveries our research revealed - whether it was the impact of toxoplasmosis on the human sexual index, the prenatal and postnatal development, the sexual preferences and behaviour, the modulatory effect of blood Rh factor on toxoplasmosis, or the discovery of sexual transmission of toxoplasmosis. In exploring whether the toxoplasmosis-associated effects were merely side effects of an ongoing latent infection, we gradually uncovered that seemingly asymptomatic toxoplasmosis has profound (and certainly not positive) effects on the mental and physical health of infected individuals. The article also includes three separate boxes that discuss some key methodological challenges we encountered along the way, such as how to distinguish the effect of infection from mere statistical association, or how to differentiate parasitic manipulation from a simple side effect.
View
... Past research has demonstrated that novelty plays a significant role in human attention processes, with novel stimuli leading to increased attention [7,8]. Physiologically, novel stimuli trigger the release of the neurotransmitter dopamine, which heightens attention through cognitive pleasure and reward mechanisms that make the novel stimuli more enticing [9,10]. Ensuring that users experience novelty while browsing from one content item to the next can therefore be expected to heighten their attention and bolster their engagement with an app or website. ...
Quickly Finding the Semantically Optimal Presentation Order for a Set of Text Artifacts
Article
Full-text available
  • Jan 2025
This study considers how to quickly find the order in which to present a set of text artifacts on mobile apps or websites such that those artifacts are maximally semantically separated. Semantic separation is desirable because it ensures that users experience as much novelty as possible from one item to the next, thereby improving user attention and engagement. Since an exhaustive search of all possible sequences of text items becomes increasingly infeasible as the length of the sequence grows, a new algorithm is proposed to quickly find the semantically optimal presentation order for a set of text artifacts. The performance of the proposed algorithm is evaluated using an extensive set of experiments involving three different types of text artifacts, seven different sequence lengths, and more than 600 experimental trials. The results demonstrate that the proposed algorithm can select statistically optimal sequences of text artifacts extremely quickly, regardless of the type of text artifacts being used as input or the length of the sequence. App and website developers who are seeking to hold users’ attention and improve user engagement may therefore find the proposed algorithm very attractive in comparison to an exhaustive search.
View
... The finding that adolescents explore more optimally than adults could indicate that heightened novelty-seeking during adolescence is not primarily associated with negative outcomes (such as dangerous driving or substance misuse; Willoughby et al., 2014), as members of this age group were better than adults at determining the appropriate amount of exploration in the explore/exploit trade-off. As such, the rapid development of the dopaminergic reward system at the onset of puberty (Shulman et al., 2016), which promotes exploratory behaviour (Costa et al., 2014;Gershman & Tzovaras, 2018), may confer benefits in this decision-making context. ...
Stochastic decisions support optimal foraging of volatile environments, and are disrupted by anxiety
Article
Full-text available
  • Jan 2025
  • COGN AFFECT BEHAV NE
Adolescence is a developmental period of relative volatility, where the individual experiences significant changes to their physical and social environment. The ability to adapt to the volatility of one’s surroundings is an important cognitive ability, particularly while foraging, a near-ubiquitous behaviour across the animal kingdom. As adolescents experience more volatility in their surroundings, we predicted that this age group would be more adept than adults at using exploration to adjust to volatility. We employed a foraging task with a well-validated computational model to characterise the mechanisms of exploration in volatile environments, preregistering the hypothesis that adolescents (aged 16–17; N = 91) would exhibit more optimal adaptation of their learning rate to changes in environmental volatility compared with adults (aged 24+; N = 90). However, surprisingly, both adolescents and adults exhibited suboptimal adjustment of their learning rate to environmental volatility. In contrast to the learning rate, it was instead participants’ stochasticity (i.e., decision variability) that better resembled the adjustment to volatility made by the optimal RL agent. Although heightened stochasticity in the volatile environment led participants to more often trial different responses that facilitated discovery of changes to the environment, we also found that anxiety impaired this adaptive ability. The finding of heightened stochasticity in volatile environments contradicts expectations that the learning rate is responsible for successful adaptation and motivates future work on the deleterious role that anxiety plays when adolescents manage periods of transition.
View
... Indeed, the lack of self-control is a significant characteristic among problem gamblers (Bergen et al., 2014). Novelty seeking defines the exploratory level in response to novel situations and impulsive decision-making (Costa et al., 2014). High levels of this trait are characteristic of individuals who pursue excitement are inclined to explore new experiences and make decisions quickly and on the basis of limited information and therefore are at greater risk of engaging in addictive behaviors. ...
Online Gaming Disorder and Sports Betting Addiction: Convergences and Divergences
Article
Full-text available
  • Sep 2024
  • Int J Ment Health Addiction
Worldwide estimates of the prevalence of online gaming disorder (OGD) and online sports betting addiction (OSBA) have become exceedingly high, particularly among young people. The objective of this study was to compare the sociodemographic and clinical profiles of treatment-seeking patients for these mental health disorders. The sample included n = 495 patients (n = 108 OGD and n = 387 OSBA) recruited from a tertiary care unit specialized in the treatment of behavioral addictions. Sociodemographic variables, psychopathologic state, impulsivity, emotion regulation, substances, and personality traits were assessed and compared between both these diagnostic subtypes. The prevalence for OGD was 3.82% and for OSBA was 13.01% among the whole sample of n = 3,036 patients. Compared with OGD, OSBA presented a profile characterized by a greater proportion of non-single men with higher levels of education, employed, and of higher socioeconomic status. OSBA was also characterized by older chronological age, later age of onset of the addictive behaviors, worse psychopathology state (greater likelihood of depression and anxiety), higher impulsivity, and higher substance use. The personality profile related to OSBA presented higher novelty seeking, reward dependence and persistence, and lower harm avoidance. Despite the similarities between OGD and OSBA, and even though both behaviors could be perceived by the general population as low-risk leisure activities (as opposed to other gambling types, such as casinos or slot machines), the differences in the clinical profiles should be considered in efforts to improve assessment tools and specialized intervention plans.
View
Perceptual Novelty Drives Early Exploration in a Bottom-Up Manner
Article
Children are more likely than adults to explore new options, but is this due to a top‐down epistemic‐uncertainty‐driven process or a bottom‐up novelty‐driven process? Given immature cognitive control, children may choose a new option because they are more susceptible to the automatic attraction of perceptual novelty and have difficulty disengaging from it. This hypothesis is difficult to test because perceptual novelty is intertwined with epistemic uncertainty. To address this problem, we designed a new n‐armed bandit task to fully decouple novelty and epistemic uncertainty. By having adults and 4‐ to 6‐year‐olds perform the task, we found that perceptual novelty predominated 4‐year‐olds’ (but not adults’ or older children's) decisions even when it had no epistemic uncertainty and had the lowest reward value. Additionally, 4‐year‐olds showed such a novelty preference only when the option's novelty was directly observable, but not when it could only be anticipated, providing new evidence that perceptual novelty alone can drive elevated exploration in early development in a bottom‐up manner.
View
View
Individual differences in information demand have a low dimensional structure predicted by some curiosity traits
Article
  • Oct 2024
  • P NATL ACAD SCI USA
To understand human learning and progress, it is crucial to understand curiosity. But how consistent is curiosity’s conception and assessment across scientific research disciplines? We present the results of a large collaborative project assessing the correspondence between curiosity measures in personality psychology and cognitive science. A total of 820 participants completed 15 personality trait measures and 9 cognitive tasks that tested multiple aspects of information demand. We show that shared variance across the cognitive tasks was captured by a dimension reflecting directed (uncertainty-driven) versus random (stochasticity-driven) exploration and individual differences along this axis were significantly and consistently predicted by personality traits. However, the personality metrics that best predicted information demand were not the central curiosity traits of openness to experience, deprivation sensitivity, and joyous exploration, but instead included more peripheral curiosity traits (need for cognition, thrill seeking, and stress tolerance) and measures not traditionally associated with curiosity (extraversion and behavioral inhibition). The results suggest that the umbrella term “curiosity” reflects a constellation of cognitive and emotional processes, only some of which are shared between personality measures and cognitive tasks. The results reflect the distinct methods that are used in these fields, indicating a need for caution in comparing results across fields and for future interdisciplinary collaborations to strengthen our emerging understanding of curiosity.
View
Dopamine D4 Receptor-Knock-Out Mice Exhibit Reduced Exploration of Novel Stimuli
Article
Full-text available
  • Nov 1999
The involvement of dopamine neurotransmission in behavioral responses to novelty is suggested by reports that reward is related to increased dopamine activity, that dopamine modulates exploratory behavior in animals, and that Parkinson's disease patients report diminished responses to novelty. Some studies have reported that polymorphisms of the human dopamine D4 receptor (D4R) gene are associated with personality inventory measures of the trait called “novelty-seeking”. To explore a potential role for the D4R in behavioral responses to novelty, we evaluated D4R-knock-out (D4R−/−) and wild-type (D4R+/+) mice in three approach–avoidance paradigms: the open field, emergence, and novel object tests. These three paradigms differ in the degree to which they elicit approach, or exploratory behavior, and avoidance, or anxiety-related behavior. Thus, we used these three tests to determine whether the D4R primarily influences the exploratory or the anxious component of responses to approach–avoidance conflicts. D4R−/− mice were significantly less behaviorally responsive to novelty than D4R+/+ mice in all three tests. The largest phenotypic differences were observed in the novel object test, which maximizes approach behavior, and the smallest phenotypic differences were found in the open field test, which maximizes avoidance behavior. Hence, D4R−/− mice exhibit reductions in behavioral responses to novelty, reflecting a decrease in novelty-related exploration.
View
Cocaine alters cerebral metabolism within the ventral striatum and limbic cortex of monkeys
Article
Full-text available
  • Feb 1996
The functional consequences of acute cocaine administration in nonhuman primates were assessed using the quantitative 2-[14C]deoxyglucose method. Local rates of cerebral metabolism were determined after an intravenous infusion of 1.0 mg/kg cocaine or vehicle in six awake cynomolgus monkeys (Macaca fascicularis) trained to sit calmly in a primate chair. Cocaine administration decreased glucose utilization in a discrete set of structures that included both cortical and subcortical portions of the limbic system. Glucose metabolism in the core and shell of the nucleus accumbens was decreased markedly, and smaller decrements were observed in the caudate and anterior putamen. In addition, cocaine administration produced significant decreases in limbic cortex. Metabolism was decreased in orbitofrontal cortex (areas 11, 12o, 13, 13a, 13b), portions of the gyrus rectus including area 25, entorhinal cortex, and parts of the hippocampal formation. The cortical regions in which functional activity was altered provide dense projections to the nucleus accumbens, and the decreased activity in these projections may be responsible in part of the large alterations in functional activity within the ventral striatum. Decreased metabolism also was evident in the anterior nuclear group of the thalamus, raphe nuclei, and locus ceruleus. The acute cerebral metabolic effects of cocaine in the conscious macaque, therefore, were contained primarily within a set of interconnected limbic regions, including ventral prefrontal cortex, medial temporal regions, the ventral striatal complex, and anterior thalamus. The decreased rates of glucose metabolism reported here resemble decrements found using positron emission tomography in humans. In the rat, by contrast, metabolic activity increased and changes were focused in subcortical regions. The present results represent an important expansion of the neural circuitry on which cocaine acts in the monkey as compared with the rat, and this in turn implies that cocaine affects a broader spectra of behaviors in primates than in rodents.
View
Bandit Processes and Dynamic Allocation Indices [with discussion]
Article
Full-text available
  • Feb 1979
The paper aims to give a unified account of the central concepts in recent work on bandit processes and dynamic allocation indices; to show how these reduce some previously intractable problems to the problem of calculating such indices; and to describe how these calculations may be carried out. Applications to stochastic scheduling, sequential clinical trials and a class of search problems are discussed.
View
The Detection of Novelty Relies on Dopaminergic Signaling: Evidence from Apomorphine's Impact on the Novelty N2
Article
Full-text available
Despite much research, it remains unclear if dopamine is directly involved in novelty detection or plays a role in orchestrating the subsequent cognitive response. This ambiguity stems in part from a reliance on experimental designs where novelty is manipulated and dopaminergic activity is subsequently observed. Here we adopt the alternative approach: we manipulate dopamine activity using apomorphine (D1/D2 agonist) and measure the change in neurological indices of novelty processing. In separate drug and placebo sessions, participants completed a von Restorff task. Apomorphine speeded and potentiated the novelty-elicited N2, an Event-Related Potential (ERP) component thought to index early aspects of novelty detection, and caused novel-font words to be better recalled. Apomorphine also decreased the amplitude of the novelty-P3a. An increase in D1/D2 receptor activation thus appears to potentiate neural sensitivity to novel stimuli, causing this content to be better encoded.
View
The drive to strive: goal generation based on current needs
Article
Full-text available
  • Jun 2013
Hungry animals are influenced by a multitude of different factors when foraging for sustenance. Much of the work on animal foraging has focused on factors relating to the amount of time and energy animals expend searching for and harvesting foods. Models that emphasize such factors have been invaluable in determining when it is beneficial for an animal to search for pastures new. When foraging, however, animals also have to determine how to direct their search. For what food should they forage? There is no point searching for more of a particular food when you are sated from eating it. Here we review work in macaques and humans that has sought to reveal the neural circuits critical for determining the subjective value of different foods and associated objects in our environment and tracking this value over time. There is mounting evidence that a network composed of the orbitofrontal cortex (OFC), amygdala, and medial thalamus is critical for linking objects in the environment with food value and adjusting those valuations in real time based on current biological needs. Studies using temporary inactivation methods have revealed that the amygdala and OFC play distinct yet complementary roles in this valuation process. Such a network for determining the subjective value of different foods and, by extension, associated objects, must interact with systems that determine where and for how long to forage. Only by efficiently incorporating these two factors into their decisions will animals be able to achieve maximal fitness.
View
View
Effects of dopamine reuptake inhibitors on food- and cocaine-maintained responding: II. Comparisons with other drugs and repeated administrations.
Article
  • Aug 1995
A previous study (J. R. Glowa, F. H. E. Wojnicki, D. Matecka, et al, 1995) showed that acute doses of GBR 12909 selectively decreased cocaine-maintained responding without affecting food-maintained responding. This report extended these observations to some related drugs and to the effects of repeated administration. When responding was maintained under a multiple fixed ratio (FR) 30 food, FR 30 cocaine schedule, acute doses of GBRR 12935, CFT, and d -amphetamine decrease cocaine-maintained responding more than food-maintained responding. However, in contrast to GBR 12909, none of these drugs completely decreased cocaine-maintained responding without affecting food-maintained-responding. Repeated administration of GBR 12909 sustained and of GBR 12935 improved, these selective deceases in cocaine-maintained responding. The selective effect of these dopamine reuptake inhibitors on cocaine-maintained responding is consistent with their known pharmacological selectivity for the dopamine reuptake side and can be well-maintained with repeated administration.
View
View
View
View