Mark E. Bouton’s research while affiliated with University of Vermont and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (211)


Figure 3 Results of Experiment 1 Test of R1
Figure 6 Results of Experiment 2 Test of R1, R3, and R5
Figure 7 Trial Presentation and Outcome Screens in Experiment 3
Figure 9 Results of Experiment 3 Test of R1
Participant Characteristics From Experiment 3
Goal-Direction and Habit in Human and Nonhuman Behavioral Sequences (Behavior Chains)
  • Article
  • Full-text available

April 2025

·

67 Reads

·

Noah Elste

·

Catherine R. Thorpe

·

Mark E. Bouton

Habits are important in everyday life and are thought to be involved in several human behavioral pathologies, including addictions. Experiments with rats suggest that habit, as indexed by insensitivity of an instrumental response to separate devaluation of its outcome, develops with extended practice. Motivated behavior often involves a sequence or chain of behaviors (Rs), with each cued by a different discriminative stimulus (S). We therefore examined performance of a two-response discriminated heterogeneous behavior chain (R1–R2) in which R1 and R2 were occasioned by different Ss and were both required to earn a reinforcer. We further asked whether extended training decreases the sensitivity of R1 to the extinction of R2, which is known to decrease R1 and is analogous to an outcome devaluation effect. In Experiment 1 with rats, R1 was sensitive to extinction of R2 after moderate but not extended training, suggesting the development of habit. In Experiment 2, human participants learned three R1–R2 chains before one “R2” was extinguished. Extinction of R2 specifically decreased performance of the R1 that had been associated with it, but extended training did not reduce this effect. Based on findings in the nonhuman literature, Experiment 3 then had human participants learn only one R1–R2 chain before R2 was extinguished. Under these conditions, R1 became insensitive to extinction of R2 after extended training, consistent with the idea that habit can develop in a laboratory experiment with humans. The findings are discussed relative to difficulties demonstrating habits in humans.

Download


Situating Habit and Goal-Direction in a General View of Instrumental Behavior

April 2024

·

38 Reads

This chapter reviews recent research from the author’s laboratory on habit and goal-direction in instrumental learning and then considers some of its implications for a general view of instrumental behavior and addiction. Results suggest that habit develops under conditions that allow the individual to pay less attention to its behavior, i.e., when the habit’s trigger cue reliably predicts the reward. Other results suggest that a behavior’s status as a habit is not necessarily fixed or permanent; several environmental manipulations can make a habitual behavior become goal-directed again. Habit is more context-specific than goal-direction. The perspective that emerges suggests that habit may have an important but perhaps more circumscribed role in instrumental behavior (and addiction) than might often be assumed. For example, drug seeking can appear adaptable and flexible because behaviors that are more distal to the goal (e.g., general search behaviors) may be goal-directed at the same time behaviors that are more proximal to the goal (e.g., actual drug-taking responses) are habitual. And individuals with substance use habits might not appear more habit-prone than controls when they are tested for habit in the context of the lab. These and other challenges that have been raised for the role of habit in addiction are discussed.



An Analysis of Reinstatement After Extinction of a Conditioned Taste Aversion

Taste aversion learning has sometimes been considered a specialized form of learning. In several other conditioning preparations, after a conditioned stimulus (CS) is conditioned and extinguished, reexposure to the unconditioned stimulus (US) by itself can reinstate the extinguished conditioned response. Reinstatement has been widely studied in fear and appetitive Pavlovian conditioning, as well as operant conditioning, but its status in taste aversion learning is more controversial. Six taste-aversion experiments with rats therefore sought to discover conditions that might encourage it there. The results often yielded little to no evidence of reinstatement, and we also found no evidence of concurrent recovery, a related phenomenon in which responding to a CS that has been conditioned and extinguished is restored if a second CS is separately conditioned. However, a key result was that reinstatement occurred when the conditioning procedure involved multiple closely spaced conditioning trials that could have allowed the animal to learn that a US presentation signaled or set the occasion for another trial with a US. Such a mechanism is precluded in many taste aversion experiments because they often use very few conditioning trials. Overall, the results suggest that taste aversion learning is experimentally unique, though not necessarily biologically or evolutionarily unique.


Chemogenetic inhibition of the ventral hippocampus but not its direct projection to the prelimbic cortex attenuates context-specific operant responding

February 2024

·

34 Reads

Previous work has demonstrated the importance of the prelimbic cortex (PL) in contextual control of operant behavior. However, the associated neural circuitry responsible for providing contextual information to the PL is not well understood. In Pavlovian fear conditioning the ventral hippocampus (vH) and its projection to the PL have been shown to be important in supporting the effects of context on learning. The present experiments used chemogenetic inhibition of the direct vH-PL projection or the vH to determine involvement in expression of context-specific operant behavior. Rats were injected with an inhibitory DREADD (hM4Di) or mCherry-only into the vH, and subsequently trained to perform a lever press response for a food pellet in a distinct context. The DREADD ligand clozapine-n-oxide (CNO) was then delivered directly into the PL (experiment 1) and then systemically (experiment 2) prior to tests of the response in the training context as well as an equally familiar but untrained context. vH (systemic CNO) but not vH-PL (intra-PL CNO) inhibition was found to attenuate operant responding in its acquisition context. A third experiment, using the same rats, showed that chemogenetic inhibition of vH also reduced Pavlovian contextual fear. The present results suggest that multisynapatic connections between the vH and PL may be responsible for integration of contextual information with operant behavior.


Habit and persistence

December 2023

·

116 Reads

·

10 Citations

Journal of the Experimental Analysis of Behavior

Voluntary behaviors (operants) can come in two varieties: Goal‐directed actions, which are emitted based on the remembered value of the reinforcer, and habits, which are evoked by antecedent cues and performed without the reinforcer's value in active memory. The two are perhaps most clearly distinguished with the reinforcer‐devaluation test: Goal‐directed actions are suppressed when the reinforcer is separately devalued and responding is tested in extinction, and habitual behaviors are not. But what is the function of habit learning? Habits are often thought to be strong and unusually persistent. The present selective review examines this idea by asking whether habits identified by the reinforcer‐devaluation test are more resistant to extinction, resistant to the effects of other contingency change, vulnerable to relapse, resistant to the weakening effects of context change, or permanently in place once they are learned. Surprisingly little evidence supports the idea that habits are permanent or more persistent. Habits are more context‐specific than goal‐directed actions are. Methods that make behavior persistent do not necessarily work by encouraging habit. The function of habit learning may not be to make a behavior strong or more persistent but to make it automatic and efficient in a particular context.



Prelimbic Cortex Inactivation Prevents ABA Renewal Based on Stress State

October 2023

·

20 Reads

·

1 Citation

Our recent research suggests that the interoceptive state associated with stress can function as a contextual stimulus for operant behavior. In the present experiment, we investigated the role of the rodent prelimbic cortex (PL), a brain region that is critical in contextual control of operant behavior, in the ability of a stressed state to produce ABA renewal of an extinguished operant response. Rats were trained to perform a lever press response for a food pellet reward during daily sessions that followed exposure to a stressor that changed each day. The response was then extinguished in the absence of stress. ABA renewal of extinguished responding occurred following exposure to another stressor (different from any used during acquisition) in control rats but not in rats that received a PL-inactivating infusion (baclofen/muscimol). Results confirm that the interoceptive state of stress can play the role of a contextual stimulus and initiate renewal (relapse) of an inhibited behavior when stress has previously been associated with the behavior. In conjunction with our previous work, the present results support the hypothesis that the PL is important for contexts, both exteroceptive and interoceptive, to exert such control over operant behavior.


Early-life seizures alter habit behavior formation and fronto-striatal circuit dynamics

June 2023

·

23 Reads

·

2 Citations

Epilepsy & Behavior

Michelle L Kloc

·

·

R Davi Pressman

·

[...]

·

Gregory L Holmes

Obsessive compulsive disorder (OCD) can occur comorbidly with epilepsy; both are complex, disruptive disorders that lower quality of life. Both OCD and epilepsy are disorders of hyperexcitable circuits, but it is unclear whether common circuit pathology may underlie the co-occurrence of these two neuropsychiatric disorders. Here, we induced early-life seizures (ELS) in rats to examine habit formation as a model for compulsive behaviors. Compulsive, repetitive behaviors in OCD utilize the same circuitry as habit formation. We hypothesized that rats with ELS could be more susceptible to habit formation than littermate controls, and that altered behavior would correspond to altered signaling in fronto-striatal circuits that underlie decision-making and action initiation. Here, we show instead that rats with ELS were significantly less likely to form habit behaviors compared with control rats. This behavioral difference corresponded with significant alterations to temporal coordination within and between brain regions that underpin the action to habit transition: 1) phase coherence between the lateral orbitofrontal cortex and dorsomedial striatum (DMS) and 2) theta-gamma coupling within DMS. Finally, we used cortical electrical stimulation as a model of transcranial magnetic stimulation (TMS) to show that temporal coordination of fronto-striatal circuits in control and ELS rats are differentially susceptible to potentiating and suppressive stimulation, suggesting that altered underlying circuit physiology may lead to altered response to therapeutic interventions such as TMS.


Citations (84)


... In some studies, the test under extinction is followed by a reacquisition test in which outcomes are again delivered. Results from these reacquisition tests typically demonstrate outcome sensitivity, even when a test under extinction previously indicated outcome insensitivity (e.g., [25]; see also [71]). As pointed out by Bouton [71], the quick return of outcome-sensitivity in reacquisition tests indicates that habits are not stable and therefore not the end stage of behavior. ...

Reference:

Critical Review of the Habit Theory in Substance Use Disorder and Application of Moors' Goal-Directed Theory
Habit and persistence
  • Citing Article
  • December 2023

Journal of the Experimental Analysis of Behavior

... Similarly, we have consistently found that PL inactivation attenuates operant responding when tested in the context in which it was trained (i.e., its acquisition context), but has no effect when responding is tested in a context where it was never trained (Eddy et al., 2016;Trask et al., 2017;Thomas et al., 2020). Additionally, we have shown that the PL is involved in the ability of many different types of contexts (background stimuli), including satiety and stress interoceptive states, and previous behaviors, to affect performance of operant responses (Thomas et al., 2020(Thomas et al., , 2023a. The diverse nature of these types of contexts suggests that the PL may function as a hub in which contextual information is integrated with behavioral output. ...

Prelimbic Cortex Inactivation Prevents ABA Renewal Based on Satiety State
  • Citing Article
  • April 2023

Neurobiology of Learning and Memory

... Extinction involves new learning about the association between new outcomes and behaviors after observing the disappearance of the reward and is often used to measure cognitive flexibility [45,46]. Learning to cease existing behaviors is as crucial as acquiring new ones, which allows behavior to continuously adapt to dynamic environments, thereby mitigating or redirecting stress [47,48]. Our results show that as the experiment progressed, both male and female rats exhibited significant declines in their operant and exploratory behaviors. ...

Learning to Stop Responding
  • Citing Article
  • January 2023

Behavioural Processes

... In the later stages of training, the dogs were also trained in longer linear searches to ensure that differential responding to on-and off-target scats was adequately generalized to realistic search scenarios and risk of spontaneous recovery was mitigated (Broomer and Bouton 2022). These took place around the field station in search areas estimated in minutes walked down a road. ...

A comparison of renewal, spontaneous recovery, and reacquisition after punishment and extinction
  • Citing Article
  • November 2022

Learning & Behavior

... Two articles from this special issue address these issues. A key finding from Steinfeld and Bouton (2022) is that instrumental inhibitors transferred across responses trained with different outcomes. Lovibond et al. (2022) show that inhibition is not reversed by simple extinction, but it is reversed by explicitly removing the inhibitor's ability to modulate in human contingency learning. ...

Inhibition in Discriminated Operant Learning: Tests of Response-Specificity After Feature-Negative and Extinction Learning

... Additionally, if a period of time passes after extinction of a taste aversion, spontaneous recovery can occur (e.g., Brooks et al., 1999;Rosas & Bouton, 1996, 1998. And in a recent study, the partial reinforcement extinction effect was obtained in taste aversion learning: A taste that was paired with illness on only some trials ("partially reinforced") acquired an aversion that extinguished more slowly than that to a taste that was paired with illness on every trial (Bouton & Michaud, 2022). Although these phenomena are consistent with the idea that general laws apply to taste aversion learning, two other extinction phenomena, reinstatement and rapid reacquisition (defined below), appear to be more difficult to produce (Bouton, 1982;Danguir & Nicolaidis, 1977;Hart et al., 1995;Revusky & Coombes, 1979). ...

Partial reinforcement effects on acquisition and extinction of a conditioned taste aversion

Learning & Behavior

... Researchers who primarily study human behavior may be impressed by the apparent ease with which habit seems to be observed in rodents and conclude that there must be different processes operating in rodents and humans. However, observing habit learning in rats itself seems to depend on specific conditions (Bouton, 2021;Bouton et al., 2020Bouton et al., , 2021Thrailkill et al., 2018). For example, unexpected reinforcers can convert an otherwise habitual response back to goal-directed status Trask et al., 2020). ...

Context, attention, and the switch between habit and goal-direction in behavior

Learning & Behavior

... PrL, a homologous to Brodmann area 32 of the anterior cingulate cortex (ACC) in humans 16 , is a subregion of the mPFC that plays a crucial role in various cognitive and behavioral functions, particularly related to decision-making, executive control, addiction-related behaviors, and emotional regulation [17][18][19] . PrL plays a role in regulating cocaine/morphine addiction in rats, inactivation of the PrL significantly attenuated drug-seeking and drug-taking behaviors in cocaine self-administration [20][21][22] , and electrical stimulation of PrL suppressed morphine-induced CPP in rats 23 . ...

New functions of the rodent prelimbic and infralimbic cortex in instrumental behavior
  • Citing Article
  • October 2021

Neurobiology of Learning and Memory

... Researchers who primarily study human behavior may be impressed by the apparent ease with which habit seems to be observed in rodents and conclude that there must be different processes operating in rodents and humans. However, observing habit learning in rats itself seems to depend on specific conditions (Bouton, 2021;Bouton et al., 2020Bouton et al., , 2021Thrailkill et al., 2018). For example, unexpected reinforcers can convert an otherwise habitual response back to goal-directed status Trask et al., 2020). ...

Effect of Context on the Instrumental Reinforcer Devaluation Effect Produced by Taste-Aversion Learning

... While Vandaele et al. 15 argued that lever insertion as a stimulus was particularly effective in producing habits, Thrailkill et al. 12 found that lever insertion was no better at producing habits than a tone trained in a similar fashion. However, Thrailkill et al. 12 did report that animals trained with lever insertion acquired the instrumental response more quickly than those trained with a tone and so it is possible that lever insertion has unique properties for supporting habits. ...

Reinforcer Predictability and Stimulus Salience Promote Discriminated Habit Learning