Jan Philipp Gläscher

University of Hamburg | UHH · School of Medicine and University Hospital Hamburg-Eppendorf

Learning describes the process by which our internal expectation models of the world are updated by surprising outcomes (prediction errors [PEs]) to improve predictions of future events. However, the mechanisms through which error signals dynamically influence existing neural representations are unknown. Here, we use functional magnetic resonance i...

The human temporoparietal junction (TPJ) is a brain area crucial for processing social information. Although brain stimulation studies have started to explore the causal function of TPJ under social contexts, few have explicitly considered bilateral TPJ as target regions. Here, leveraging non-invasive continuous theta-burst stimulation (cTBS) and h...

Decision making under uncertainty in multiagent settings is of increasing interest in decision science. The degree to which human agents depart from computationally optimal solutions in socially interactive settings is generally unknown. Such understanding provides insight into how social contexts affect human interaction and the underlying contrib...

Animal studies show marked sex differences as well as effects of estrogen (E2) in the mesocorticolimbic dopaminergic (DA) pathways, which play a critical role in reward processing and reinforcement learning and are also implicated in drug addiction. In this computational pharmacological fMRI study, we investigate the effects of both factors, sex an...

Stressful events are thought to impair the flexible adaptation to changing environments, yet the underlying mechanisms are largely unknown. Here, we combined computational modeling and functional magnetic resonance imaging (fMRI) to elucidate the neurocomputational mechanisms underlying stress-induced deficits in flexible learning. Healthy particip...

Decision making under uncertainty and under incomplete evidence in multiagent settings is of increasing interest in decision science, assistive robotics, and machine assisted cognition. The degree to which human agents depart from computationally optimal solutions in socially interactive settings is generally unknown. Yet, this knowledge is critica...

A rich neural representation of its environment enables an adaptable organism to respond to changes

Humans learn from their own trial-and-error experience and observing others. However, it remains unknown how brain circuits compute expected values when direct learning and social learning coexist in uncertain environments. Using a multiplayer reward learning paradigm with 185 participants (39 being scanned) in real time, we observed that individua...

Recent years have witnessed a dramatic increase in the use of reinforcement learning (RL) models in social, cognitive and affective neuroscience. This approach, in combination with neuroimaging techniques such as functional magnetic resonance imaging, enables quantitative investigations into latent mechanistic processes. However, increased use of r...

Rationale: Whereas the effect of the sex steroid 17-beta-estradiol (E2) on dopaminergic (DA) transmission in the nucleus accumbens (NAc) is well evidenced in female rats, studies in humans are inconsistent. Moreover, linear and inverted u-shaped dose response curves have been observed for E2's effects on hippocampal plasticity, but the shape of do...

The ability to from a Theory of Mind (ToM) that is to theorize about others mental states and explain and predict behavior in relation to attributed intentional states, constitutes a hallmark of human cognition. These abilities are multi-faceted and include a variety of different cognitive sub-functions. Here, we focus on decision processes in soci...

Recent years have witnessed a dramatic increase in the use of reinforcement learning (RL) models in social, cognitive and affective neuroscience. This approach, in combination with neuroimaging techniques such as functional magnetic resonance imaging, enables quantitative investigations into latent mechanistic processes. However, increased use of r...

Efficient multisensory integration is often influenced by other cognitive processes including, but not limited to, semantic congruency and focused endogenous attention. Semantic congruency can re-allocate processing resources to the location of a congruent stimulus, while attention can prioritize the integration of multi-sensory stimuli under focus...

Image captioning models successfully describe the visual contents of images using natural language. To generate more natural and diverse descriptions, a model must learn style-specific patterns and requires collecting style-specific datasets, which is time-consuming. To address this issue, we propose a semi-supervised deep generative model, Semi-su...

Humans learn from their own trial-and-error experience and from observing others. However, it remains unanswered how brain circuits compute expected values when direct learning and social learning coexist in an uncertain environment. Using a multi-player reward learning paradigm with 185 participants (39 being scanned) in real-time, we observed tha...

The role of the frontal lobes in cognition and behavior has long been enigmatic. Over the past decade, computational models have provided a powerful approach to understanding cognition and decision-making. Here, we used a model-based approach to analyze data from a classical task used to assess frontal lobe function, the Wisconsin Card Sorting Test...

Successful adaptation to complex environments depends on the balance of at least two systems: a flexible but slow goal-directed system encoding action-outcome associations and an efficient but rigid habitual system linking responses to preceding stimuli. Recent evidence suggests that the inferolateral prefrontal cortex (ilPFC), a region well known...

In this issue of Neuron, Konovalov and Krajbich (2018) argue that a Bayesian inference is employed when learning new sequences and identify distinct brain networks that track the uncertainty of both the current state and the underlying pattern structure.

In animals, 17-beta-estradiol (E2) enhances hippocampal plasticity in a dose-dependent, monotonically increasing manner, but this relationship can also exhibit an inverted U-shaped function. To investigate E2’s dose-response function in the human hippocampus, we pharmacologically increased E2 levels in 125 naturally cycling women (who were in their...

All behavior is proximally caused by the brain, but the neural causes of most complex behaviors are still not understood. Much of our ignorance stems from the fact that complex behavior depends on distributed neural control. Unlike a reflex, where the arc from sensation to action can be traced through a few synapses, most volitional behavior involv...

In an elegant model-based fMRI study, Leong et al. (2017) demonstrate how attention and learning interact to facilitate value-based decision-making. They combine computational modeling with empirical measures of attentional selection derived from eye-tracking data and multivariate pattern analyses.

Goal-directed and instrumental learning are both important controllers of human behavior. Learning about which stimulus event occurs in the environment and the reward associated with them allows humans to seek out the most valuable stimulus and move through the environment in a goal-directed manner. Stimulus–response associations are characteristic...

Unlabelled: Most real-life cues exhibit certain inherent values that may interfere with or facilitate the acquisition of new expected values during associative learning. In particular, when inherent and acquired values are congruent, learning may progress more rapidly. Here we investigated such an influence through a 2 × 2 factorial design, using...

This experiment investigated whether behavioral surprise, an information-theoretic measure of the amount of memory and information integration associated with a response, is correlated with neural activity during decision making. 30 participants (ages 18-30) were scanned with fMRI while completing 240 trials of a sequential decision making task in...

Counterfactual information processing refers to the consideration of events that did not occur in comparison to those actually experienced, in order to determine optimal actions, and can be formulated as computational learning signals, referred to as fictive prediction errors. Decision making and the neural circuitry for counterfactual processing a...

Author Summary When making decisions in our everyday life (e.g. where to eat) we first have to identify a set of environmental features that are relevant for the decision (e.g. the distance to the place, current time or the price). Although we are able to make such inferences almost effortlessly, this type of problems is computationally challenging...

Rationale: Human motivation and decision-making is influenced by the interaction of Pavlovian and instrumental systems. The neurotransmitters dopamine and serotonin have been suggested to play a major role in motivation and decision-making, but how they affect this interaction in humans is largely unknown. Objective: We investigated the effect o...

The purpose of this experiment was to test a computational model of reinforcement learning with and without fictive prediction error (FPE) signals to investigate how counterfactual consequences contribute to acquired representations of action-specific expected value, and to determine the functional neuroanatomy and neuromodulator systems that are i...

Executive functions (EF) encompass a variety of higher-order capacities such as judgment, planning, decision-making, response monitoring, insight, and self-regulation. Measuring such abilities quantitatively and establishing their neural correlates has proven to be challenging. Here, using a lesion-deficit approach, we report the neural correlates...

A considerable body of previous research on the prefrontal cortex (PFC) has helped characterize the regional specificity of various cognitive functions, such as cognitive control and decision making. Here we provide definitive findings on this topic, using a neuropsychological approach that takes advantage of a unique dataset accrued over several d...

The combination of functional magnetic resonance imaging (fMRI) with computational models for a given cognitive process provides a powerful framework for testing hypotheses about the neural computations underlying such processes in the brain. Here, we outline the steps involved in implementing this approach with reference to the application of rein...

Reinforcement learning (RL) uses sequential experience with situations ("states") and outcomes to assess actions. Whereas model-free RL uses this experience directly, in the form of a reward prediction error (RPE), model-based RL uses it indirectly, building a model of the state transition and outcome structure of the environment, and evaluating ac...

General intelligence (g) captures the performance variance shared across cognitive tasks and correlates with real-world success. Yet it remains debated whether g reflects the combined performance of brain systems involved in these tasks or draws on specialized systems mediating their interactions. Here we investigated the neural substrates of g in...

The amygdala plays key roles in emotion and social cognition, but how this translates to face-to-face interactions involving real people remains unknown. We found that an individual with complete amygdala lesions lacked any sense of personal space. Furthermore, healthy individuals showed amygdala activation upon close personal proximity. The amygda...

The influence of counterfactual thinking and regret on choice behavior has been widely acknowledged in economic science (Bell in Oper Res 30:961-981, 1982; Kahneman and Tversky in Judgment under uncertainty: heuristics and biases. Cambridge University Press, Cambridge, pp 201-210, 1982; Loomes and Sugden in Econ J 92:805-824, 1982). Neuroimaging st...

The Wechsler Adult Intelligence Scale (WAIS) assesses a wide range of cognitive abilities and impairments. Factor analyses have documented four underlying indices that jointly comprise intelligence as assessed with the WAIS: verbal comprehension (VCI), perceptual organization (POI), working memory (WMI), and processing speed (PSI). We used nonparam...

The Wechsler Adult Intelligence Scale (WAIS) assesses a wide range of cognitive abilities and impairments. Factor analyses have documented four underlying indices that jointly comprise intelligence as assessed with the WAIS: verbal comprehension (VCI), perceptual organization (POI), working memory (WMI), and processing speed (PSI). We used nonparam...

While thresholded statistical parametric maps can convey an accurate account for the location and spatial extent of an effect in functional neuroimaging studies, their use is somewhat limited for characterizing more complex experimental effects, such as interactions in a factorial design. The resulting necessity for plotting the underlying data has...

Stimuli used for experiment. (21.49 MB AVI)

Document showing addition data. (0.55 MB DOC)

Considerable evidence has emerged to implicate ventromedial prefrontal cortex in encoding expectations of future reward during value-based decision making. However, the nature of the learned associations upon which such representations depend is much less clear. Here, we aimed to determine whether expected reward representations in this region coul...

According to the modulation hypothesis, arousal is the crucial factor in the emotional enhancement of memory (EEM). However, the multifactor theory of the EEM recently proposed that cognitive characteristics of emotional stimuli, e.g., relatedness and distinctiveness, also play an important role. The current study aimed to investigate the individua...

A motor component is pre-requisite to any communicative act as one must inherently move to communicate. To learn to make a communicative act, the brain must be able to dynamically associate arbitrary percepts to the neural substrate underlying the pre-requisite motor activity. We aimed to investigate whether brain regions involved in complex gestur...

Contrast weights for factorial designs that include a group factor (e.g. 2 different groups of subjects) are often a cause of confusion because the contrast weights that have to be entered in SPM diverge from the simple scheme for a single group. The reason for this is that the group sizes have to be taken into account when deriving contrast weight...

As shown in non-human primate and human fMRI studies the probability and magnitude of anticipated rewards modulate activity in the mesolimbic dopaminergic system. Importantly, non-human primate data have revealed that single dopaminergic neurons code for both probability and magnitude of expected reward, suggesting an identical system. Using a gues...

Oxytocin is known to reduce anxiety and stress in social interactions as well as to modulate approach behavior. Recent studies suggest that the amygdala might be the primary neuronal basis for these effects. In a functional magnetic resonance imaging study using a double-blind, placebo-controlled within-subject design, we measured neural responses...

It is well known that pain attracts attention and interferes with cognition. Given that the mechanisms behind this phenomenon are largely unknown, we used functional magnetic resonance imaging and presented visual objects with or without concomitant pain stimuli. To test for the specificity of pain, we compared this modulatory effect with a previou...

Reward processing depends on dopaminergic neurotransmission and is modulated by factors affecting dopamine (DA) reuptake and degradation. We used fMRI and a guessing task sensitive to reward-related activation in the prefrontal cortex and ventral striatum to study how individual variation in genes contributing to DA reuptake [DA transporter (DAT)]...

Emotional salience and working memory (WM) load are known to affect object processing in the ventral stream. However, the combined effect, which could be either synergistic or antagonistic, remains unclear. Using functional magnetic resonance imaging and a three-factorial design, we investigated the effects of WM load and emotional salience on obje...

The present study aimed to shed light on the neural underpinnings of high vs. low memory confidence. To dissociate memory confidence from accuracy, the Deese-Roediger McDermott (DRM) paradigm was employed, which - compared to other memory paradigms - elicits a rather evenly distributed number of high-confident responses across all possible combinat...

Evolutionary survival and procreation are augmented if an individual organism quickly detects environmental threats and rapidly initiates defensive behavioral reactions. Thus, facial emotions signaling a potential threat, e.g., fear or anger, should be perceived rapidly and automatically, possibly through a subcortical processing route which includ...

Midbrain dopaminergic neurons projecting to the ventral striatum code for reward magnitude and probability during reward anticipation and then indicate the difference between actual and predicted outcome. It has been questioned whether such a common system for the prediction and evaluation of reward exists in humans. Using functional magnetic reson...

Learning can be characterized as the extraction of reliable predictions about stimulus occurrences from past experience. In two experiments, we investigated the interval of temporal integration of previous learning trials in different brain regions using implicit and explicit Pavlovian fear conditioning with a dynamically changing reinforcement reg...