ArticlePDF Available

The Fictive Brain: Neurocognitive Correlates of Engagement in Literature

Authors:

Abstract

Fiction is vital to our being. Many people enjoy engaging with fiction every day. Here we focus on literary reading as one instance of fiction consumption from a cognitive neuroscience perspective. The brain processes which play a role in the mental construction of fiction worlds and the related engagement with fictional characters, remain largely unknown. We discuss the Neurocognitive Poetics Model (Jacobs, 2015a) of literary reading specifying the likely neuronal correlates of several key processes in literary reading, namely inference and situation model building, immersion, mental simulation and imagery, figurative language and style, and the issue of distinguishing fact from fiction. An overview of recent work on these key processes is followed by a discussion of methodological challenges in studying the brain bases of fiction processing. 3 Introduction Fiction does not take us outside the range of human nature into something else — " convention, " or " culture, " or " literary tradition. " Ultimately, it's all human nature. Carroll (2012, p. 298).
The fictive brain: neurocognitive correlates of engagement in literature
Arthur M. Jacobs1,2,3 & Roel M. Willems4, 5, 6
1 Experimental and Neurocognitive Psychology, Freie Universität Berlin, Germany
2 Center for Cognitive Neuroscience (CCNB), Freie Universität Berlin, Germany
3 Dahlem Institute for Neuroimaging of Emotion (D.I.N.E.), Freie Universität Berlin, Germany
4 Centre for Language Studies, Radboud University, Nijmegen, The Netherlands
5 Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The
Netherlands
6 Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
Correspondence: Arthur M. Jacobs
Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin,
Habelschwerdter Allee 45, D-14195 Berlin, Germany.
Email: ajacobs@zedat.fu-berlin.de
2"
"
Abstract
Fiction is vital to our being. Many people enjoy engaging with fiction every day. Here we focus
on literary reading as one instance of fiction consumption from a cognitive neuroscience
perspective. The brain processes which play a role in the mental construction of fiction worlds
and the related engagement with fictional characters, remain largely unknown. We discuss the
Neurocognitive Poetics Model (Jacobs, 2015a) of literary reading specifying the likely neuronal
correlates of several key processes in literary reading, namely inference and situation model
building, immersion, mental simulation and imagery, figurative language and style, and the issue
of distinguishing fact from fiction. An overview of recent work on these key processes is
followed by a discussion of methodological challenges in studying the brain bases of fiction
processing.
3"
"
Introduction
Fiction does not take us outside the range of human nature into something else — “convention,” or “culture,” or
“literary tradition.” Ultimately, it’s all human nature. Carroll (2012, p. 298).
People read a lot – many of us everyday – and a lot of it is fiction. Even before humans can read,
through tales told or stories read aloud by others, fiction changes the way we think and feel
about the world, ourselves and others. Thus, fiction is a major source shaping our brain
processes (Oatley, 2016; Schrott & Jacobs, 2011; Willems and Jacobs, 2016).
However, there is no too sharp a line between fact and fiction (cf. Oatley, 1999) for human
beings equipped with what Darwin considered the single most important factor in the evolution
of the modern human mind: Language (cf. Carroll, 2011). Listening to or reading language and
fiction can have important consequences for human experience or behavior from the earliest
moments of life. Lullabies as sung fiction or bed-stories shape our imagination, motivations,
emotions and expectations from the early days on. We are deeply fictive animals (Oatley, 2016) and
it is thus not astonishing that proponents of literary Darwinism (e.g., Carroll, 2011) posit that the
disposition for producing and consuming literature has a central function the very disposition
has been “designed” for by natural selection: Literature (re-)creates emotionally charged images
of our experience in the world and by means of such images we orient ourselves to the world,
organize our values and motives, and thus regulate our behavior. The fiction skill or fictionality1 of
humans has also been identified as the central aspect of capitalist macrodynamics giving
economic decisions the necessary hold in times of high uncertainty (Beckert, 2011).
Although all of this has been thought and written about for a long time in many scientific
disciplines, the questions how exactly fiction is constructed in our brains and what distinguishes
it from processing/re-constructing of facts is still an issue where research is basically fishing in
the dark (but see Altmann et al., 2012; 2014). Recent affective and social neuroscience studies
have begun to shed some light on issues related to our main topic, though. Here we review and
discuss the most relevant of those.
The paper is structured as follows: We start with discussing aspects of the ontogeny of
encounters with fiction and then move to literary reading in adulthood, viewed from the
perspective of the Neurocognitive Poetics Model (Jacobs, 2011; 2015a,b). In section three we
look at basic processes of engagement in literature, such as immersion or aesthetic appreciation.
A special section is dedicated to what is perhaps the most challenging kind of fiction: poetry.
Before concluding, three further sections deal with issues of i) how literary reading can change
brain processes, ii) methodological challenges in more natural and ecologically valid studies of
fiction, and iii) individual differences.
Reading acquisition and the ontogeny of literary response and experience
How do human beings come to like fiction? How do they acquire something like a lyrical sense?
Cognitive Neuroscience so far has not even begun to shed light on the neural bases of the
""""""""""""""""""""""""""""""""""""""""""""""""""""""""
1 “Fictionality” in economic action is the inhabitation in the mind of an imagined future state of the world and the beliefs in
causal mechanisms leading to this future state.
"
4"
"
development of literary experiences (Jacobs, 2015c). Yet, studies investigating the neural
underpinnings of written language processing in children and adolescents are informative for the
present purposes. In general, these studies focus on simple word recognition tasks, but a few
also used longer text segments and figurative language processing.
Regarding single word recognition, the neurodevelopmental hypothesis states that beginning
readers engage a widely distributed bilateral dorsal (temporo-parietal) pathway in conjunction
with articulatory recoding processes in the inferior frontal regions, while the ventral (occipito-
temporal) pathway is thought to be established with increasing reading experience and left-
hemispheric lateralization (Liebig et al., 2017). The dorsal pathway, hypothesized to support
phonology-based reading processes (i.e., grapheme– phoneme conversion, phonological
assembly), includes the posterior superior temporal gyrus and supramarginal and angular gyri of
the inferior parietal lobule. The ventral pathway includes lateral extrastriate, fusiform, and
inferior temporal regions hosting the putative visual word form area, and is linked to memory-
based visual-orthographic word recognition. Both pathways are complemented by a left inferior
frontal circuit around Broca’s area that includes inferior frontal and precentral gyri thought to
play a role in speech-gestural articulatory recoding of print (cf. Martin et al., 2015).
A well-developing functioning of this basic left-hemispheric (LH) reading system is a prerequisite
for pleasurable and reflective experiences with literature, while both structural and functional
anomalies are associated with poor reading or developmental dyslexia, both conditions which
will not favor the life-long pleasures of ludic literary reading, i.e. reading for pleasure (Jacobs,
2015c, Nell, 1988). Given that children have experiences with micro-poetry like one-word poetry
or nursery rhymes from early on (Jacobs & Kinder, 2015, Jacobs et al., 2015), knowledge about
these basic reading circuits is useful for future studies investigating the structural and functional
neural development of figurative language processing and ludic reading. While neurocognitive
studies on the ontogeny of literary response are still extremely rare, there isn’t much behavioral
or neurocognitive research on the co-development of language and emotion either (Sylvester et
al., 2016). However, learning more about the acquisition of affective semantics, for example, is
necessary for a better understanding of the development of ludic reading (Jacobs, 2015c).
In summary, the neurocognitive bases of the processes underlying the development of ludic
reading and the story-liking nature of the human mind are still very much in the shadow. It is
highly likely, though, that full-blown ludic reading experiences require a well-developed LH
reading system that automatically and efficiently decodes the written input, thus lending time and
(neural) space for more complex processes of inference, interpretation, and figurative meaning
construction to unfold. A well-developed vocabulary and grammar acquired through daily verbal
communication and reading episodes, ideally with increasingly rich and complex verbal materials,
helps, but learning to read never stops: Achieving new levels of deep reading, e.g. deliberating and
reflecting text passages through combinatorial semantic, syntactic and pragmatic unification in
order to enhance comprehension and enjoyment is a life-long learning process (Wolf, 2007). Its
neuronal basis lies in the fact that each millisecond gained by an efficient LH reading system
allows the brain to learn to better integrate (or separate) pieces of inferential, metaphoric,
analogue or affective background information and world knowledge, thus producing an endless
row of ever more complete thoughts and rich feelings (Schrott & Jacobs, 2011, Wolf, 2007).
5"
"
Literary reading in adulthood: A model for neurocognitive poetics
The above mentioned Neurocognitive Poetics Model unifies a set of hypotheses inspired by
rhetoric, aesthetics, poetics, linguistics or neuroscience within a comprehensive theoretical
framework. It allows predictions concerning factors facilitating and inhibiting affective and
aesthetic processes at the neuronal, subjective-experiential, and behavioral levels that should
generate further research coming to grips with the complex phenomenon of processing fiction.
Given both the complexity of literary reading and the paucity of empirical data from
neurocognitive studies using more natural and ecologically valid reading materials (cf. Burke,
2015; Jacobs, 2015b; Willems, 2015), the Neurocognitive Poetics Model is still „work in
progress“ containing underspecified parts as well as lacunae (Jacobs, 2016). However, the
available empirical evidence supports the central hypotheses of the model, such as the
background-foreground, the fiction feeling, or the Panksepp-Jakobson hypotheses. The
background-foreground hypothesis refers to the central claim of the model that any text offers a
mixture of background elements (e.g., familiar words, themes, scenes) and foreground elements
(e.g., defamiliarizing stylistic devices) which activate separate routes (immersion vs. aesthetic
appreciation) characterized by differing neurocognitive processes (i.e., implicit vs. explicit
processing) and reading behavior (i.e., fluent vs. dysfluent reading). The fiction feeling
hypothesis states that narratives with emotional contents invite readers more to be empathic with
the protagonists and immerse in the text world (e.g., by engaging the affective empathy network
of the brain), than do stories with neutral contents (cf. Hogan, 2010, 2014). The Panksepp-
Jakobson hypothesis submits that since evolution had no time to invent a proper neuronal
system for art reception, even less so for literary reading, the affective and aesthetic processes we
experience when reading (cf. Jakobson’s, 1960, ‘‘poetic function’’) must be linked to the ancient
emotion circuits we share with all mammals, as perhaps best described by Panksepp (1998; for
review see Jacobs, 2015b,c; Jacobs, 2017).
Next, we specify the likely neuronal correlates of fiction processing in more detail than in
previous versions of the model. The assumptions concerning these correlates – sketched
graphically in Figure 1 – are supported by an increasing number of neurocognitive studies on
fiction processing that were not all published at the time, such as Altmann et al. (2012, 2014),
Hsu et al. (2014; 2015b), O’Sullivan et al. (2015) or Nijhof and Willems (2015). They should
nevertheless be seen as heuristic given the relative scarcity of such studies and the necessity of
replication and cross-validation experiments. They can guide future region of interest, connectivity or
multivariate pattern analysis studies of fiction processing (e.g., Hsu et al., 2015a) and thus help to
constrain and refine neurocognitive models. In summary, the Neurocognitive Poetics Model
specifies a wealth of factors and processes that may cause beneficial effects of engagement in
literature organized around the two usually divergent core processes of immersion and aesthetic
evaluation/appreciation (cf. also Nicklas & Jacobs, 2017; Willems & Jacobs, 2016).
[insert Figure 1 around here]
6"
"
Basic processes of engagement in literature
In the following sections we discuss in more detail the likely main neural correlates of figurative
and poetic language processing sketched in Figure 1 (note that this list is not meant to be
exhaustive).
a. Inference and situation model building
Making meaning of a literary text or poem requires more than comprehending words and
sentences, in particular the mental (re-)construction of the situations described by a text
situation models — hypothesized to arise through the integration of a reader’s knowledge of the
world with information explicitly presented in a text (Bower & Morrow, 1996; Kintsch & van
Dijk, 1978; van den Broek, 2010; Zwaan, 2015). Important ‘cognitive’ subprocesses are inferences
for bridging successive events/situations, the use of background knowledge and discourse
context, and pragmatic interpretations. Crucial ‘affective’ subprocesses are personal
experience/resonance and knowledge about atmospheres and moods conveyed, e.g., by a poetic
text, and so-called mood empathy (Aryani et al., 2016; Chow et al., 2015; Gittel et al., 2016; Hogan,
2010, 2014; Jacobs et al., 2016a; Lüdtke et al., 2014; Oatley, 1999).
A special role in this process is played by the left inferior frontal gyrus (LIFG; Chow et al., 2014),
the dorso-medial prefrontal cortex and the (pre)/cuneus, all areas appearing sensitive to how
well a coherent structure can be built from a piece of text (Friese et al., 2008; Kurby & Zacks,
2015; Martin-Loeches et al., 2008). A related but different interpretation for the role of posterior
midline structures during narrative comprehension is that the (pre)/cuneus are areas with large
temporal receptive windows and hence the capacity to integrate information over extended
periods of time (Lerner et al., 2011). Posterior midline structures (including posterior cingulate
cortex, cuneus and precuneus) also play a special role in the coding of event boundaries, i.e., points
at which a narrative proceeds from one event to the other (Zacks et al., 2001; Zacks et al., 2010).
Similarly, activation in the precuneus and posterior cingulate cortex correlated with a priori
defined moments in a novella signaling narrative shifts (Whitney et al., 2009). Interestingly,
recent work suggests that these areas may be implicated in the recognition of structure across
time more generally, so not restricted to language stimuli (Tobia et al., 2012).
Both (pre)/cuneus and anterior medial prefrontal cortex also consistently appear among the
areas that are more strongly activated or connected to other regions during rest as compared to
during engagement in other cognitive tasks. In so-called resting-state connectivity, these areas are
considered major hubs of the ‘default mode network’/DMN (Raichle et al., 2001). However,
DMN might be a misnomer for areas that are co-activated during rest: Indeed, cuneus /
precuneus have been speculated to be involved in conceptual processing (Binder, 2012), or more
generally in internally generated cognition, sometimes labeled stimulus-independent thought,
internally focused cognition, or ‘mind wandering’ relating the DMN to the construction of
mental models or simulations that are adaptive and facilitate future behavior (Buckner & Carroll,
2007; Mason et al., 2007). A recent review suggests that mind wandering can occur either with or
without intention and that intentional and unintentional mind-wandering are dissociable; the
intentional type likely involving activation of executive-control regions (cf. Seli et al., 2016).
7"
"
It may seem that being in a resting state compared to engaging with fiction are activities which
overlap only minimally. However, these descriptions have in common that they relate to
narrative construction: internally focused cognition, mind wandering, and mental model
construction are all forms of meaning making, or of story-telling (albeit in a non-constructed
manner). From this perspective it should not come as a surprise that areas that are prominent
hubs when people do not engage in a specific task (‘rest’), are also prominent areas when
participants are taken in by a narrative context. The overlap between resting state (connectivity)
and mentalizing tasks has been described by reference to ‘self-projection’, i.e., understanding
others’ behavior by means of projecting oneself into that situation (Buckner & Carroll, 2007).
These functions relate to narrative comprehension directly. ‘Rest’ means that participants are not
engaged in specific cognitive operations, and as such it is contrasted to ‘active’ states of
performing a task. From a different perspective ‘rest’ can be regarded a mental task (or state), but
with poorly defined instructions. Perhaps, building a situation model is what humans typically do
when not engaged in a particular and specific task. The ‘resting state’ thus would better be
viewed as an active state of being, of narrative or situation model construction. The crucial
difference between situation model building during ‘rest’ and during engagement with fiction is
that in the case of fiction it is externally guided. It is the narrative which imposes a discourse
model upon us, whereas during mind wandering (and related constructs; cf. Smallwood et al.,
2008) the situation model is generated ‘from within’, based on our memories and experiences.
How much these processes overlap and relate to the notions of intentional and unintentional
mind-wandering (Seli et al., 2016) is an intriguing issue for future research.
b. Immersion and/or aesthetic appreciation
Probably the most salient feature of fiction is its power to transport readers into a narrative /
fictional world. This feeling of being in the story world is sometimes called transportation and is
closely related to the psychological constructs absorption and immersion. As a look through the
upcoming Handbook of Absorption (Kuijpers & Hakemulder, 2017) shows, the phenomenon
that people become emotionally involved, or carried away imaginatively in fiction is multi-
facetted, conceptually far from being unified, and difficult to measure empirically – be it with
behavioral or neurocognitive methods (for recent reviews see Jacobs, 2015b, Jacobs & Schrott,
2015, Jacobs & Lüdtke, 2017). An increasing number of behavioral studies on transportation,
immersion or absorption in different media and text types – including poetry (cf. Gittel et al.,
2016; Jacobs et al., 2016a; Lüdtke et al., 2016) – is complemented by a few neuroimaging studies,
but the evidence for neural correlates of the psychological state of immersion is still scarce and
inconclusive (for review see Schlochtermeier et al., 2015).
Still, the Neurocognitive Poetics Model makes testable predictions concerning factors
facilitating and inhibiting immersive processes. Thus, Hsu et al. (2014) tested and found support
for the above-mentioned fiction feeling hypothesis integrated in the Neurocognitive Poetics
Model. Comparing the neural correlates of post-hoc immersion ratings for fear-inducing versus
neutral passages from the Harry Potter series revealed that activity in the mid-cingulate cortex
correlated more strongly with the ratings for the emotional than for the neutral passages.
Descriptions of protagonists’ pain or personal distress featured in the fear-inducing passages may
have recruited the core structure of pain and affective empathy the more readers immersed in
the text. The predominant locus of effects in the mid-cingulate cortex suggests that the
8"
"
subjective immersive experience was particularly facilitated by the motor component of affective
empathy for the selected stimuli from the Harry Potter series which feature particularly vivid
descriptions of the behavioral aspects of emotion.
Factors facilitating immersion according to the Neurocognitive Poetics Model are related to the
processing of background information contained in fiction, in particular familiarity and fluency,
heightened unforced attention, empathy, identification and fiction feelings, as well as suspense,
curiosity and surprise (Jacobs & Lüdtke, 2017). Factors inhibiting immersion are related to the
processing of stylistic foregrounding devices (see section d) which in the Neurocognitive Poetics
Model is supported by another route than the one driving immersive processes (which can be
assimilated to Barthes’, 1973, readerly mode of processing; cf. Oatley, 2016). In general, defamiliarizing
text elements that make situation model building and meaning making harder, requiring schema
adaptation and broader/deeper reflection will inhibit immersive processes but increase readers’
likelihood of entering a trajectory resulting in aesthetic feelings.
c. Mental simulation and imagery
At least since Plato voiced his concerns about the evocation of images via reading (Plato, 1969,
605-606), scholars have argued about the nature of such ‘images in the head’. In cognitive
science, mental imagery refers to the deliberate and explicit creation of a (visual) image without
direct sensory stimulation (Farah, 1989). Visual and motor imagery are typically distinguished,
and imagery and actual visual perception or motor execution are to a large extent comparable at
the neural level (Jeannerod, 2006; Kosslyn, 1994).
There is however a very important difference between explicit imagery, and the more implicit
generation of images in the mind when we comprehend language (Burke, 2011; Jacobs, 2016;
Kuzmičová, 2014; Troscianko, 2013). Literary scholars have long recognized 'the optical poverty
of my images' during literary reading (Iser, 1976, p. 138). Indeed if humans experienced picture-
like images during reading, this would be cognitively too costly to be an effective reading
strategy. Explicit imagery takes a lot of time for the cognitive system, and is generally much
slower than the speed at which we read. In a direct comparison, it was shown that responses in
cortical motor areas during explicit motor imagery, and during reading of action verbs, could be
dissociated, suggesting different neural and cognitive computations (Willems et al., 2010). Thus,
we should conceptually distinguish between mental simulation or literary reading-induced (LRI,
Burke, 2011) mental imagery and explicit, deliberate mental imagery. The nature of mental
simulation or imagery during literary reading remains unclear (Jacobs, 2016), but some studies
have investigated its occurrence in other tasks using neurocognitive methods.
There is abundant evidence from studies at the single word or single sentence level that language
comprehension leads to simulation of sensori-motor and emotional content. For instance the
cortical motor system (primary and premotor cortex) is active when action-related words are
read (Fischer & Zwaan, 2008; see also Taylor & Zwaan, 2008; Willems & Casasanto, 2011;
Willems, Hagoort, & Casasanto, 2010; Willems, Labruna, D’Esposito, Ivry, & Casasanto, 2011).
Similarly, when participants read affective words or statements that imply an emotional event,
parts of the ‘emotional brain’ (e.g., amygdala, anterior insula) as well as the LIFG are activated
(Altmann et al., 2012; Citron, 2012; Lai, Willems, & Hagoort, 2015; Jacobs et al., 2015; 2016b;
9"
"
Kuhlmann et al., 2016; Ponz et al., 2013; Samur, Lai, Hagoort, & Willems, 2015). However,
simulation during language comprehension does not occur invariantly (Papeo et al., 2008), and
some current proposals suggest that sensori-motor simulation is not a necessary part of language
understanding (Louwerse, 2011; Willems & Casasanto, 2011; Willems & Francken, 2012).
Speer and colleagues (2009) addressed neural correlates of mental simulation during narrative
processing. They had participants read a short story – word after word in RSVP – about the day
in a life of a young boy. They observed activation in cortical motor areas when participants read
parts of the story related to actual movements (running, throwing something, etc.). Reading of
visual motion passages was found to activate brain regions involved in coding for biological /
visual motion (Deen & McCarthy, 2010; Wallentin et al., 2011). Interestingly, Kurby and Zacks
(2013) found that auditory and motor simulation led to activation of modality-specific cortices
(e.g., the premotor cortex) only when descriptions were embedded in a coherent story, not for
single sentences outside of a story context. The latter findings suggests that within a narrative
context facilitating situation model building, mental simulation may be more readily part of
language comprehension as compared to more decontextualized situations like single word
comprehension.
Finally, in auditory narrative processing, Nijhof and Willems (2015) discovered two types of
mental simulation: motor simulation of concrete actions (as in some of the studies discussed
above), and simulation of intentions, thoughts and beliefs of characters in the narrative
(‘mentalizing’). Activation in the motor cortex during fragments describing concrete actions
suggested motor simulation, while activation during ‘mentalizing fragments’ in parts of the
mentalizing/ToM network indicated mental simulation. Note that this is not a case of reverse
inference (Poldrack, 2006): The inference is based on a) mapping of mentalizing areas within the
subject sample of this specific study, b) previous findings as documented in meta-analyses, and c)
with reference to the content of the stories. That is, the authors knew that action events were
being described at certain points in the storie and related those points to neural activity in an area
known to be involved in action simulation (the premotor cortex) (see Hutzler, 2014 for extended
discussion of reverse inference).
Interestingly, a negative correlation between motor cortex activation (while listening to action
descriptions) and medial prefrontal cortex (‘mentalizing’) activation was observed. This suggests
that under natural listening circumstances some readers strongly preferred to engage in motor
simulation, and did not engage in mentalizing (note that no visual simulation was tested in this
experiment), while others showed the opposite pattern. The authors concluded that the results
reflect personal preferences. While waiting for replication, these results serve to illustrate the
potential of neuroimaging to get better insight into individual differences and preferences during
literary reading, and does so importantly in a task-neutral setting: All participants listened to the
stories naturally, without explicit task instruction.
It is still unclear what the nature of the images evoked during literary reading is, how exactly they
influence our reading experience, and how they impact appreciation and memory for narratives
(but see Hartung et al., 2016). An important avenue for future research is to add to our
understanding of the impact of our propensity for simulation on our fiction experience, e.g., the
10"
"
dependence of LRI simulation on personal experiences (e.g. Burke, 2011). One prediction
naturally following from this is that since personal experiences differ, readers will differ greatly in
their reliance on and preference for mental simulation during literary reading.
d. Figurative language and style
Several recent meta-analyses have looked at the neural correlates of figurative language
processing with partially mixed results (Bohrn et al., 2012a; Rapp et al., 2012; Vartanian et al.,
2012; Yang, 2014). Thus, Bohrn et al.’s (2012a) meta-analysis of 22 fMRI studies on the
processing of metaphor, idiom, and irony/sarcasm in adults revealed that areas linked to more
analytic, semantic processes (e.g., LIFG) are involved in metaphor comprehension, whereas
processing irony/sarcasm more involves mPFC activation, a key region of the mentalizing/ToM
network typically involved in story comprehension (Altmann et al., 2012; 2014; Mar, 2011). In
this meta-analysis, the following key regions were associated with figurative language processing:
LIFG (BA 45/46/47) extending to the anterior insular cortex, the right IFG (BA 45/46/47),
right STG, the left MTG (BA 21/37), the medFG (BA 10/9), the left ITG (BA 20/21) and the
left amygdala. Rapp et al.’s (2012) meta-analysis of 38 fMRI studies revealed 409 activation foci,
of which 129 (32%) were in the RH, indicating that a predominantly left lateralised network,
including left and right IFG, left, MTG/STG, or medial prefrontal, superior frontal, cerebellar,
parahippocampal, precentral, and inferior parietal regions, is important for non-literal
expressions. It should be noted that the use of figurative language processing as an umbrella term in
such meta-analyses does not mean that the authors think that idioms, proverbs, conventional
and novel metaphors or other pieces of text requiring non-literal interpretation involve identical
neurocognitive processes (see, e.g., Table 1 of Jacobs et al., 2016b, for different neuronal
structures involved in idiom and proverb processing).
Since the LIFG was activated in the majority of analyses, discussion of its multiple functional roles
for literature processing is in order (cf. Rapp et al., 2012). Indeed the LIFG may be involved in
various cognitive operations. The first is meaning integration: Its anterior–inferior part may play a
key role in integrating words into meaningful supralexical units (metaphors, phrases, similes,
sentences) so that activation reflects higher cognitive demands to integrate non-literal meanings,
as opposed to literal ones, into a context (e.g., Nagels et al., 2013). Indeed one can observe a
gradual increase in LIFG activation with increasing meaning making efforts in literal vs.
metaphoric noun-noun compound (NNC) processing (Forgács et al., 2012). In Hagoort's (2005)
Memory, Unification, Control (MUC) model, the LIFG is responsible for a unification gradient: the
interactive and concurrent integration of various word or text aspects (e.g., phonological,
syntactic, and semantic) into a coherent complex whole or meaning gestalt (Iser, 1976; cf. Jacobs,
2015b). The psychological construct of (verbal) working memory (WM) is an integral part of this
system, as the neural requirements of the unification include keeping the lexical building blocks
activated.
The second cognitive operation of the LIFG in non-literal language processing is meaning selection
and evaluation. To comprehend figurative text, it is necessary to decide whether the meaning of its
constituent words is intended to be literal or not. Thus, comprehension of the (German) idiom
“auf Wolke sieben schweben” (to float on cloud seven) likely involves a decision to read the
phrase figuratively: otherwise, the phrase will “make no sense” (Citron et al., 2015). Research on
11"
"
literal language indicates that BA 45/47 may indeed regulate the selection among multiple
competing responses during sentence comprehension. For example, Turken and Dronkers
(2011) argue that ‘reciprocal interactions’ between BA 47 and the left MTG play a key role in
selecting correct meanings, sustaining it in WM throughout sentence processing and integration
into context. The same mechanism could play a role in selection between literal and non-literal
meanings (Rapp et al., 2012). A third cognitive operation of the LIFG during (non-)literal
language comprehension is world knowledge integration into sentence contexts (Menenti et al., 2009;
Tesink et al., 2009) and stories, i.e. the situation model building discussed in section (a) above
(e.g., Chow et al., 2014). A fourth operation has to do with affective meaning integration and the fact
that words and texts are emotion-inducing stimuli (for review: Citron, 2012; Jacobs et al., 2015).
Using NNCs coupling nouns of opposite valence (e.g., BOMB-SEX, DEATH-LUST), thus
creating bivalent words creating a decision conflict in a valence decision task (Jacobs et al., 2015,
2016b), Kuhlmann et al. (2016) correctly predicted increased LIFG activation for bivalent as
opposed to monovalent NNCs (i.e., NNCs composed of two positive or negative words, such as
EROTIKENGEL/erotic angel or LEPRAELEND/leper misery).
Integrating the valence of several words into an affective meaning gestalt (Lüdtke & Jacobs, 2015) may
involve an even more basic operation involving deeper and older brain networks such as the
limbic system (cf. Bohrn et al., 2012b, 2013). Neurocognitive results concerning the liking and
beauty of verbal materials reviewed by Jacobs et al. (2016b) indeed suggest that word/text valence
is a compound superfeature neuronally computed at the so-called tertiary (i.e., neocortical) level of
affective processing according to Panksepp’s (1998) hierarchical theory of emotions. In contrast,
discrete emotions like joy/happiness and disgust appear to be more basic and central affective
responses likely being computed at the secondary level (i.e., the limbic system). The
neuroimaging results from Briesemeister et al. (2015) indicate that words associated with joy
produce reduced brain activity in the amygdala, i.e., at the secondary level of Panksepp’s theory,
while words that have positive valence, but are not associated with the basic emotion
joy/happiness activate the orbitofrontal cortex at the tertiary level of affective processing.
To wrap up, while LIFG appears to be involved in many mental operations, it plays a key role in
figurative language processing including affective and cognitive meaning integration, world and
context knowledge, selection, and evaluation all being essential to engagement in literature. This
does not mean that a wonderfully rich, subtle, and complex phenomenon like literary reading can
be reduced to the well-functioning of a single brain structure; only that LIFG activation can be
used in neurocognitive studies of engagement in literature as a special ROI and an index of
sensitivity to figurative meaning making and aesthetic appreciation, both being closely connected
according to the Neurocognitive Poetics Model (Jacobs, 2015b), e.g., via an effort after meaning
dynamic (Pelowski et al., 2016). The process of closing meaning gestalts during literary reading
requires slowed down eye movements, thinking and feeling, because the multitude of meaning
potentials, the author has subtly created, allows to discover or construct various new ones (Iser,
1976). The reward for this increased effort comes at the end of the aesthetic trajectory: after initial
moments of familiar recognition, followed by surprise, ambiguity, and tension, the closure of
meaning gestalts and tension, full of relish, results from processes of integration and synthesis,
occasionally supplemented by an AHA experience (Qiu et al., 2010) or feeling of good fit, ‘rightness’,
12"
"
or harmony which accompanies an aesthetic feeling motivating to continue to read (Mangan,
2008; Jacobs, 2011; Kintsch, 2012).
e. Fact versus Fiction
Although fiction can feel very real, readers in the back of their heads always realize that a fiction
story is just that: a creation coming from the mind of a writer, something which is made up. In a
recent on-line experiment, Hartung et al. (in revision) had participants read short stories and rate
their appreciation and immersion using standardized questionnaires. The stories were presented
either as being written by a young writer (fiction: ‚He writes short fictional stories that are inspired by his
imagination’) or as being written by a young columnist (fact: ‘He writes about his everyday life, always
inspired by a real event’). Despite a large and diverse sample (N>1800) no effects were observed of
the belief of the reader in whether the text was fact or fiction on their immersion or appreciation
for the stories. The authors argue that differences in reading behavior may be more driven by
genre expectations (newspaper versus novel) than by fact versus fiction per se when it is
manipulated within the same (or similar) genre.
An fMRI study on this topic did reveal interesting differences between short stories believed to
be real or not. Altmann and colleagues (2014) had participants read short narratives and labelled
the stories as either ‘real’ or ‘invented’. There was large overlap in areas activated in both
readings of the stories, but also critical differences: Activations in motor areas for texts labelled
FACT suggested ‘an action-based [...] reconstruction of what happened’ in the story. Reading the
same texts as FICTION, i.e. on the assumption that they refer to fictional events such as those
narrated in a novel, a short story or a crime story selectively engaged an activation pattern
comprising the dACC, the right lateral FPC/DLPFC and left precuneus, which are part of the
fronto-parietal control network (Smallwood et al., 2012) as well as the right IPL and dPCC,
which are related to the default mode network. The lateral frontopolar region has been
specifically associated with the simulation of past and future events when compared to the recall
of reality-based episodic memories (Addis et al., 2009). This suggests a process of constructive
content simulation taking place during fictional reading.
In summary, the results of Altmann et al. (2014) support the assumption that reading fiction
invites for mind-wandering and thinking about what might have happened or could happen.
Such simulation processes require perspective taking and relational inferences which make a
coactivation of ToM and empathy related areas likely. Importantly, in this study, also a
personality factor co-determined neural responses to fact vs. fiction: the score on a ‘fantasy’ scale
which assesses the individual tendency to put oneself into fictional characters. A stronger
‘readiness’ of readers to transpose themselves imaginatively into the feelings and actions of
fictitious characters in books, movies and plays indeed lead to a stronger coupling between FPC
and mPFC activity.
The distinction between fact and fiction is obviously very relevant in real life: some things we
wished were real, for others we are glad they are fiction. The power of fiction lies partially in
how real it can feel, and the mixed results we described in this section suggest that fact – fiction
is not always a determining factor in immersion and comprehension of narratives. An engaging
style, different reading goals, and – importantly – content of narratives will determine how
13"
"
important it is whether something has really happened or not for how it is perceived by the
reader (cf. van Krieken et al., 2015). Genette (1991) discusses five aspects theoretically allowing
to discriminate between factual and fictional texts (i.e., order, speed, frequency, mood, and voice)
and concludes that if at all, mode – i.e. internal focalization or direct access to the subjectivity of
characters by describing their thoughts, intentions, feelings, inner dialogues etc. – is the most
likely candidate. Thus, future empirical studies of fact vs. fiction processing should carefully
control and/or manipulate these different aspects, in particular mode, and additionally take
personality variables into account.
Poetry in the brain
Poetry is perhaps the most challenging kind of fiction, potentially revealing new layers of
meaning at each and every re-reading act (Schrott & Jacobs, 2011). There is an awakening
interest in the neuroscience of poetry reception and production (e.g., Chen et al., 2016; Keidel et
al., 2013; Liu et al., 2015; Obermeier et al., 2016; O’Sullivan et al., 2015; Zeman et al., 2013)
which we discuss in this section. Neuronal correlates of processing poetic (vs. non-poetic) texts
are the bilateral precentral and IFG, as well as the right dlPFC extending into the anterior insula,
and beyond to the TP. Interestingly, the dmPFC showed deactivation during reading of poetic
pieces, compared to the reading of prosaic pieces (O’Sullivan et al., 2015). Further areas
apparently specifically related to poetry reception are the right posterior/mid-cingulate,
parahippocampal and left STG, as well as bilateral hippocampus (Zeman et al., 2013).
In their innovative comparative neuroimaging study, O’Sullivan et al. (2015) used well-construed
four-line poetic vs. prosaic pieces presented incrementally, line after line, in the scanner. Their
aim was to uncover the neural bases of literary awareness, i.e., the capacity to consider, manipulate,
and derive meaning in complex texts which involves a more flexible situation model building
process for accommodating varying related meaning threads, sensitivity to subtle meaning
differences, as well as augmented social reasoning skills (likely based on empathy and ToM).
According to the authors, PCC activation is related to the extent to which a situation model has
been updated, ATL activity is believed to store the narrative of a situation model, and dmPFC
„forces“ attention to settle on a narrative for a particular (mental) simulation. Moreover,
activation of TPJ and surrounding ventrolateral parietal areas is believed to indicate reflexive
updating of situation models in line with information retrieved from memory, while left IFG is
thought to maintain contextual separation between representations that are similar, such as in
metaphors (see above). Texts with evolving meaning are supposed to activate vmPFC – likely
reflecting the motivational significance of the developing meaning – as well as lateral anterior
PFC thought to be involved in construing relationships between less directly related
words/meaning threads.
To sum up, in line with the results of O’Sullivan et al. (2015) in our Figure 1 three larger
networks are assumed to cooperate in the meaning making of texts:
the DMN, especially the PCC, dmPCF and ATL nodes
the WM network including the dlPFC and superior and posterior parietal nodes, and
the salience network including the putamen and left dorsal caudate nucleus.
14"
"
The latter’s activity was triggered by Shakespearean functional shifts (e.g., I believed you were a saint;
you have
unhappied
me by showing a bad nature) that required individuals to reason about a familiar
word, and its context, in a novel way (Keidel et al., 2013). Specifically sensitive to the poetic texts
in that study was a cluster of voxels that spanned from the right dorsal caudate to dACC, and
further to medial and lateral anterior PFC. A continued increase in the extent of activation in
IFG and LOC while readers were reflecting on poetry may indicate that they were appraising varying
meanings. As concerns literary awareness, co-activation of dlPFC, IFG, temporo-occipital
regions, and ATL during reading of poetry relative to prose suggests that poetic texts require the
representation of multiple meaning threads (IFG), needing more focused attention during
processing (dlPFC; temporo-occipital regions) in order to generate a holistic model of meaning
(ATL). The observed deactivation in dmPFC, in the context of increased activation in dlPFC and
AI, suggests that processing of poetic content requires a switch away from stored representations
to build meaning from a novel external source. Finally, deactivation of multiple regions that
typically co-activate in the DMN during the reflection phase (i.e., during 8 seconds readers reflected
upon each piece of text in the scanner) potentially points to the longer time needed to establish a
stable representation of meaning for poetic pieces.
How does literary reading change brain processes: the example of mentalizing and
empathizing
As we noted above, it is a long-standing hypothesis that engaging with fiction can serve as a
training mode for real life (Mar & Oatley, 2008; Oatley, 2016). The main proposal is that
engaging with fiction trains social cognition in readers (e.g., Bruner, 1986; Gerrig, 1999; Mar &
Oatley, 2008; Oatley, 2016; Willems & Jacobs, 2016). Readers of fiction make inferences (implicit
or explicit) about characters’ intentions, beliefs and more generally speaking, their mental states.
By doing so they implicitly train the ability to ‘step into someone else’s shoes’, an important trait
for humans as a species living in a rich and often complex social environment. The abilities that
have been focused on most are empathizing and mentalizing which we regard here as separable
but related constructs (Kanske et al., 2016). Recent behavioral evidence indeed suggests that
engaging with fiction (such as written narratives) is positively correlated with empathizing and
mentalizing skills. For instance, fiction exposure was positively correlated with performance on
the ‘Reading the Mind in the Eyes’ test, a validated measure of recognition of mental states (Mar
et al., 2006). Others have argued that reading of a literary narrative can also lead to a direct
increase in mentalizing skills, as opposed to the hypothesis that the effect of fiction reading is
one that builds up over the course of development into a relatively stable personality trait; but
this direct effect has been contested recently (Kidd & Castano, 2013; cf. Panero et al., 2016;
Samur et al., 2017).
Neuroimaging is a promising tool to investigate the link between mentalizing and fiction reading
since one can rely on a well-established set of regions known to be activated by mentalizing and
empathizing tasks. The so-called mentalizing or ToM network is functionally separable both
from the empathy network (Kanske et al., 2016, p. 201) as well as from the neural network
involved in the basic aspects of language comprehension, such as semantic and syntactic
processing (Willems & Varley, 2010). Despite its promise, the available evidence from
neuroimaging for a link between engaging with fiction and changes in neural make-up is limited,
especially as concerns developmental aspects. In an innovative neurocognitive study on the
15"
"
development of cognitive and affective empathy in auditory story processing, Brink et al. (2011)
found that empathizing with a character not only entails understanding why the other person is
happy or sad (i.e., cognitive empathy), but also the ability to experience these emotions with her
or him (i.e., affective empathy). With increasing age (4 – 8 years) activation in medial OFC, left
IFG, and left DLPFC increased for the affective empathy conditions suggesting that these areas
play a role in age-dependent shifts in affective empathy possibly co-occurring with maturation of
the above-mentioned fronto-subcortical circuits and the development of the ToM network.
Thus, a facilitatory factor for later episodes of ludic reading may be the acquisition of good
mentalizing abilities associated with the well-functioning of neuronal ToM networks and
domain-general nodes of the DMN (Aboud et al., 2016), the development of which, in turn, is
facilitated by reading fiction (Mar, 2011; Oatley, 2016).
Regarding adult readers, parts of the neural network involved in social cognition were shown to
be more strongly activated during comprehension of brief excerpts of fiction related to social
content in those that engaged with fiction more (Tamir et al., 2016). Willems and Hartung
looked at differences in correlations of time courses between regions while participants listened
to literary narratives or a reversed speech version of the same stories – which served as a low-
level baseline – to investigate the influence of self-reported amount of fiction reading on these
(Willems & Hartung, under review). The outcome was that several regions turned out to be
connected to many more other regions during listening of the narratives in those that reported to
read more as compared to those who reported to read less. Key regions showing increased
connectivity in avid readers are: inferior frontal cortices bilaterally, lingual gyri bilaterally, right
middle frontal gyrus, posterior part of SMG, and anterior part of the MFC. These include
regions that are part of the mentalizing and language networks, and hence these data can be
taken as tentative support for the hypothesis that regularly reading fiction trains the language
network (unsurprisingly perhaps) as well as the mentalizing network.
Although these neurocognitive studies provide correlational evidence only and the relation
between lifetime reading and ToM is also correlational (and, presumably, bidirectional) hints to
direct causal effects have been found in behavioral experiments summarized in Oatley (2016):
for example, better performance in objective empathy tests or subjective self-reports for
participants in fiction vs. non-fiction reading groups, as we briefly outlined above. Interestingly,
the behavioral study by Bal and Veltkamp (2013) suggests that a potentially causal effect of
fiction on empathy may be mediated by emotional transportation into the story.
Methodological challenges
Neuroimaging using continuous stimuli
A commonly named hindrance to applying neuroimaging to the study of literary reading is that
fMRI cannot be used with continuously presented stimuli. It is common ‘wisdom’ that in using
fMRI, stimuli have to be presented with a considerable intertrial interval of several seconds
making the technique less suitable for use when participants read or listen to longer stretches of
narrative. However, modern analysis techniques make it possible to use while participants read
or listen to narratives presented at a natural pace. The reason why continuous stimuli are
typically avoided in fMRI has to do with the slowness of the BOLD response. If one presents
16"
"
stimuli in rapid succession, BOLD curves to each stimulus start to overlap, and it’s difficult to
assess which stimulus generated which response. Using an RSVP variant Yarkoni et al. (2008)
had participants read short narratives one word at a time, presented for 200 ms, with an inter-
word interval of 150 ms. Estimating the BOLD curves to several word characteristics, they asked,
e.g., which brain regions were sensitive to differences in lexical frequency between words,
variation in the latter creating the necessary variance in the estimated BOLD curve. In a similar
vein the BOLD response to action and mentalizing events was modeled within a narrative
presented auditorily at a normal speech rate (Nijhof & Willems, 2015). While in the auditory
modality this rapid serial presentation is the natural mode of processing, the reading results by
Yarkoni et al. (2008) or Speer et al. (2009) require replication with materials that are read at a
more natural reading speed. Note that this is technically feasible as studies show which
successfully combine eye movement measures (eye tracking) with fMRI (Choi et al., 2014;
Schuster et al., 2016).
Another way of analyzing fMRI data that are acquired while participants engage in viewing or
listening to continuous stimuli is to present short narratives scrambled in time at different time
scales. Participants listen to the original (no scrambling), to a version in which paragraphs are
scrambled (breaking continuity at that particular time scale), to a version in which sentence order
is scrambled, or a version in which words are scrambled. (Lerner et al., 2011). Inter-subject
correlation analysis can then be used to assess which brain regions show a similar time course
across participants for the original story, comparing this to brain areas which show the same time
course across participants for the scrambled versions (for other analysis techniques see Andric &
Small, 2015).
Individual differences
Another methodological challenge for neurocognitive – or more precisely, all – studies of literary
reading are individual differences. It is well known, for example, that cognitive variables such as
WM span or vocabulary scores co-determine speed and accuracy of language comprehension as
can do affective variables such as mood (Van Berkum et al., 2013). More generally, it is often
remarked (but not empirically investigated) that individual differences in brain responses would
increase once researchers start investigating language processing at the discourse level, and the
above mentioned studies by Altmann et al. (2012, 2014) or Nijhof and Willems (2015) lend
support to this argument. This can be considered a nuisance if one adheres strongly to a research
tradition which focuses on explaining common variance within a research sample. In this
tradition, effects which can be observed reliably across the sample are taken to be reliable effects
which can be extrapolated to the population level. Crucially, individual differences hinder
common group effects since they are not observed across the sample but at the level of the
single reader. As is well known, psychology has a rich tradition of investigating individual
differences, and there is no formal reason why the approaches developed in the past cannot be
used in cognitive neuroscience as well.
One problem, though, are the traditionally very low sample sizes in neuroimaging (mainly driven
by the high costs). The current trends of increased sample sizes and data sharing could provide
an impetus for more commonly looking at individual differences, and we have indeed quoted
several studies in this paper that combine fMRI data with measures of individual differences. A
17"
"
related development is the increasing popularity of doing statistical analysis with the help of
linear mixed or hierarchical drift diffusion models which allow for flexibly and explicitly testing
individual differences (e.g., Lüdtke et al., 2014; Froehlich et al., 2016; van den Hoven et al.,
2016).
Conclusion
Neurocognitive studies on fiction constitute a small but rapidly evolving niche in cognitive
neuroscience. We have outlined several areas of active investigation and showcased examples of
how neurocognitive methods and models can help in understanding how we engage with
narratives. It should be clear that there are only few hard and replicated facts in this still juvenile
area of research. We hope our contribution facilitates identifying promising topics for future
research. Instead of summarizing the points we made in the paper we would like to end with two
general statements.
First, brain imaging is a tool, not a goal in itself, and within the field of (neuro-)cognitive poetics
requires complementary direct measures, e.g., of experiential processes (Dixon & Bortolussi,
2015; Jacobs, 2015c, 2016; Kuiken, 2015). Neuroimaging can help in characterizing processes
involved in narrative comprehension, thus aiding to understand which psychological or social
constructs neurofunctionally overlap and which do not. Neurocognitive findings like those of
Altmann et al. (2014), Brink et al. (2011) or Willems and Hartung (in revision) can lead to a
deeper understanding of the effects of fiction, and how we engage with it emotionally and
cognitively. They complement behavioral studies like those of Kidd and Castano (2013), Bal and
Veltkamp (2013) or Jacobs et al. (2016a) by casting light on the ‘on-line’ microprocesses and
allow to test hypotheses difficult to test with behavioral measures alone. For example, Bal and
Veltkamps’ (2013) conclusions concerning the effects of fiction reading are based on off-line,
post-hoc ratings (i.e., memories) of reading entire texts (e.g., a 2750- word story). Thus, here the
construct emotional transportation refers to a remembered experience (more or less vulnerable
to memory decay and distortions) concerning effects of the text as a whole, at a macroscopic
level (Jacobs, 2015c). If we had complementing fMRI data that, say, indicate selective
recruitment of brain networks previously associated with fiction feelings and immersion (e.g.,
Altmann et al., 2012; Hsu et al., 2014, 2015) in the conditions yielding higher ratings, then this
would increase our confidence in the rating data. More importanly, it would also allow testing
more specific hypotheses (by using psycho-physiological interaction analysis or dynamic causal
modeling), e.g., to what extent the ToM network, the autobiographical memory network or other
networks of interest were co-activated. This, in turn, could lead to new hypotheses allowing to
refine the fuzzy construct ‘emotional transportation’ (Jacobs & Lüdtke, 2017)
The long-term goal should be understanding how fiction ‘works’ in neurocognitive terms, a goal
that cannot be reached without general theoretical tools such as the Neurocognitive Poetics
Model and specific computational and process models (e.g., Hofmann & Jacobs, 2014; Jacobs et
al., 2016b). Second, next to researchers interested in fiction per se, the empirical study of fiction
is a useful arena also for those who work in seemingly distant subdisciplines of cognitive science.
Fiction is a natural habitat of (among others) mental simulation and mentalizing, integration of
information in memory, language comprehension, or emotion (Willems & Jacobs, 2016).
Researchers interested in these topics should consider fiction as a way of performing their
18"
"
studies, greatly increasing ecological validity. In the present paper we have shown that this is
possible and – so we hope – worthwhile.
19"
"
References
Aboud, K., Bailey, S., Petrill, S., Cutting, L. (2016). Comprehending text versus reading words in
young readers with varying reading ability: distinct patterns of functional connectivity
from common processing hubs, Dev. Sci., 1–25, http://dx.doi.org/10.1111/desc.12422.
Addis, D.R., Pan, L., Vu, M.-A., Laiser, N., Schacter, D.L. (2009). Constructive episodic
simulation of the future and the past: distinct subsystems of a core brain network
mediate imagining and remembering. Neuropsychologia, 47(11), 2222–38.
Altmann, U., Bohrn, I. C., Lubrich, O., Menninghaus, W., and Jacobs, A. M. (2012). The power
of emotional valence-from cognitive to affective processes in reading. Front. Hum.
Neurosci. 6:192. doi: 10.3389/fnhum.2012. 00192
Altmann, U., Bohrn, I. C., Lubrich, O., Menninghaus, W., & Jacobs, A. M. (2014). Fact vs
fiction--how paratextual information shapes our reading processes. Social Cognitive and
Affective Neuroscience, 9(1), 22–9. https://doi.org/10.1093/scan/nss098
Andric, M., & Small, S. L. (2015). fMRI methods for studying the neurobiology of language
under naturalistic conditions. In R. M. Willems (Ed.), Cognitive Neuroscience of Natural
Language Use. Cambridge, UK: Cambridge University Press.
Aryani, A., Kraxenberger, M., Ullrich, S., Conrad, M. (2016): Measuring the basic affective tone
of poems via phonological saliency and iconicity. Psychology of Aesthetics Creativity and the
Arts, 10, 191–204.
Bal, P. M., & Veltkamp, M. (2013). How Does Fiction Reading Influence Empathy? An
Experimental Investigation on the Role of Emotional Transportation. PLoS ONE, 8(1),
e55341. https://doi.org/10.1371/journal.pone.0055341
Barthes, R. (1973). S/Z. Paris: Editions du Seuil.
Beckert, J. (2011). Imagined Futures: Fictionality in Economic Action. MPIfG Discussion Paper
11/8, www.mpifg.de: Publications / Discussion Papers
Binder, J. R. (2012). Task-induced deactivation and the “resting” state. NeuroImage, 62(2), 1086–
1091. https://doi.org/10.1016/j.neuroimage.2011.09.026
Bohrn, I. C., Altmann, U., and Jacobs, A. M. (2012a). Looking at the brains behind figurative
language—A quantitative meta-analysis of neuroimaging studies on metaphor, idiom and
irony processing. Neuropsychologia 50, 2669–2683. doi:
10.1016/j.neuropsychologia.2012.07.021
Bohrn, I. C., Altmann, U., Lubrich, O., Menninghaus, W., and Jacobs, A. M. (2012b). Old
proverbs in new skins—an FMRI study on defamiliarization. Front. Psychol. 3:204. doi:
10.3389/fpsyg.2012.00204
Bohrn, I. C., Altmann, U., Lubrich, O., Menninghaus, W., and Jacobs, A. M. (2013). When we
like what we know—a parametric fMRI analysis of beauty and familiarity. Brain Lang.
124, 1–8. doi: 10.1016/j.bandl.2012.10.003
Bower, G.H., & Morrow, D.G. (1990). Mental models in narrative comprehension. Science, 247,
44-48.
Briesemeister, B. B., Kuchinke, L., Jacobs, A. M., and Braun, M. (2015). Emotions in reading:
dissociation of happiness and positivity. Cogn. Affect. Behav. Neurosci. 15, 287–298. doi:
10.3758/s13415-014-0327-2
Bruner, J. S. (1986). Actual minds, possible worlds. Cambridge, Mass.: Harvard University Press.
Buckner, R. L., & Carroll, D. C. (2007). Self-projection and the brain. Trends in Cognitive Sciences,
11(2), 49–57. https://doi.org/10.1016/j.tics.2006.11.004
Burke, M. (2011). Literary Reading, Cognition and Emotion: An Exploration of the Oceanic Mind. Taylor
& Francis.
Burke M (2015) The neuroaesthetics of prose fiction: pitfalls, parameters and prospects. Front.
Hum. Neurosci. 9:442. doi: 10.3389/fnhum.2015.00442
Carroll, J. (2011). Reading Human Nature : Literary Darwinism in Theory and Practice. Albany: SUNY
PRINT.
20"
"
Carroll, J. (2012). Meaning and Effect in Fiction: An Evolutionary Model of Interpretation
Illustrated with a Reading of ‘Occurrence at Owl Creek Bridge. Style 26: 297– 316.
Chen, Q., Zhang, J., Xu, X., Scheepers, C., Yang, Y., & Tanenhaus, M. K. (2016). Prosodic
expectations in silent reading: ERP evidence from rhyme scheme and semantic
congruence in classic Chinese poems. Cognition, 154, 11-21.
Choi, W., Desai, R. H., & Henderson, J. M. (2014). The neural substrates of natural reading: a
comparison of normal and nonword text using eyetracking and fMRI. Frontiers in Human
Neuroscience, 8, 1024. https://doi.org/10.3389/fnhum.2014.01024
Chow HM, Mar RA, Xu Y, Liu S, Wagage S, Braun AR (2014): Embodied Comprehension of
Stories: Interactions between Language Regions and Modality-specific Neural Systems. J
Cogn Neurosci 26:279–295.
Chow, H.M., Mar, R.A., Xu,Y. Liu,S., Wagage, & Braun, A.R. (2015). Personal experience with
narrated events modulates functional connectivity within visual and motor systems
during story comprehension. Human Brain Mapping, 36:14941505.
Citron, F. M. M. (2012). Neural correlates of written emotion word processing: a review of
recent electrophysiological and hemodynamic neuroimaging studies. Brain and Language,
122(3), 211–226. https://doi.org/10.1016/j.bandl.2011.12.007
Citron, F. M., Cacciari, C., Kucharski, M., Beck, L., Conrad, M., and Jacobs, A. M. (2015). When
emotions are expressed figuratively: psycholinguistic and a ective norms of 619 idioms
for German (PANIG). Behav. Res. Methods 48, 91–111. doi:10.3758/s13428-015-0581-4
Deen, B., & McCarthy, G. (2010). Reading about the actions of others: biological motion
imagery and action congruency influence brain activity. Neuropsychologia, 48(6), 1607–
1615. https://doi.org/10.1016/j.neuropsychologia.2010.01.028
Dixon, P., Bortolussi, M. (2015). Measuring Literary Experience: Comment on Jacobs (2015).
Scientific Study of Literature, 5(2), 178–182.
Farah, M. J. (1989). The neural basis of mental imagery. Trends Neurosci, 12(10), 395–9.
Fischer, M. H., & Zwaan, R. A. (2008). Embodied language: a review of the role of the motor
system in language comprehension. Q J Exp Psychol (Colchester), 61(6), 825–50.
Forgács, B., Bohrn, I. C., Baudewig, J., Hofmann, M. J., Pléh, C., and Jacobs, A. M. (2012).
Neural correlates of combinatorial semantic processing of literal and figurative noun-
noun compound words. Neuroimage 63, 1432–1442. doi: 10.
1016/j.neuroimage.2012.07.029
Friese, U., Rutschmann, R., Raabe, M., & Schmalhofer, F. (2008). Neural Indicators of Inference
Processes in Text Comprehension: An Event-related Functional Magnetic Resonance
Imaging Study. Journal of Cognitive Neuroscience, 20(11), 2110–2124.
https://doi.org/10.1162/jocn.2008.20141
Froehlich E, Liebig J, Ziegler JC, Braun M, Lindenberger U, Heekeren HR and Jacobs AM
(2016) Drifting through Basic Subprocesses of Reading: A Hierarchical Diffusion Model
Analysis of Age Effects on Visual Word Recognition. Front. Psychol. 7:1863. doi:
10.3389/fpsyg.2016.01863
Genette, G. (1991). Fictional Narrative, Factual Narrative. Poetics Today, 11, 4, 755-774
Gerrig, R. J. (1999). Experiencing Narrative Worlds: On the Psychological Activities of Reading. Westview
Press.
Gittel, B., Deutschländer, R., & Hecht, M. (2016). Conveying moods and knowledge-what-it-is-
like through lyric poetry: An empirical study of authors’ intentions and readers’
responses. Scientific Study of Literature 6:1 (2016), 131–163. doi 10.1075/ssol.6.1.07git
Hagoort, P., 2005. On Broca, brain, and binding: a new framework. Trends Cogn. Sci. 9, 416–
423.
Hartung, F., Burke, M., Hagoort, P., & Willems, R. M. (2016). Taking Perspective: Personal
Pronouns Affect Experiential Aspects of Literary Reading. PLOS ONE, 11(5), e0154732.
https://doi.org/10.1371/journal.pone.0154732
21"
"
Hartung, F., Withers, P., Hagoort, P., & Willems, R. M. (under review). When fiction is just as
real as fact: No differences in reading behaviour between stories believed to be based on
true or fictional events.
Hofmann, M. J., & Jacobs, A. M. (2014). Interactive activation and competition models and
semantic context: from behavioral to brain data. Neuroscience & Biobehavioral Reviews, 46,
85–104. doi: 10.1016/j.neubiorev.2014.06.011
Hogan, P. C. (2010). Fictions and feelings: on the place of literature in the study of emotion.
Emot. Rev. 2, 184–195. doi: 10.1177/1754073909352874
Hogan, P. C. (2014), Literary Brains: Neuroscience, Criticism, and Theory. Literature Compass,
11: 293–304. doi:10.1111/lic3.12144
Hsu, C.-T., Conrad, M., and Jacobs, A. M. (2014). Fiction feelings in Harry Potter:
Haemodynamic response in the mid-cingulate cortex correlates with immersive reading
experience. Neuroreport, 25, 1356–1361. doi: 10.1097/ WNR.0000000000000272
Hsu, C.-T., Jacobs, A. M., and Conrad, M. (2015a). Can Harry Potter still put a spell on us in a
second language? An fMRI study on reading emotion-laden literature in late bilinguals.
Cortex 63, 282–295. doi: 10.1016/j.cortex.2014. 09.002
Hsu, C. T., Jacobs, A. M., Citron, F., & Conrad, M. (2015b). The emotion potential of words and
passages in reading Harry Potter - An fMRI study. Brain and Language, 142, 96-114.
Hutzler, F. (2014). Reverse inference is not a fallacy per se: Cognitive processes can be inferred
from functional imaging data. NeuroImage, 84, 1061–1069.
https://doi.org/10.1016/j.neuroimage.2012.12.075
Iser, W. (1976). The act of reading: A theory of aesthetic response. London: Routledge. (Original
work published 1974).
Jacobs, A. M. (2011). Neurokognitive Poetik: Elemente eines Modells des literarischen Lesens
[Neurocognitive poetics: Elements of a model of literary reading]. In R. Schrott and A.
M. Jacobs (Eds.), Gehirn und Gedicht: Wie wir unsere Wirklichkeiten konstruieren [Brain and
poetry: How we construct our realities] (pp. 492–520). Munich: Carl Hanser.
Jacobs, A. M. (2015a). Towards a neurocognitive poetics model of literary reading, in Towards a
Cognitive Neuroscience of Natural Language Use, ed R. Willems (Cambridge:
Cambridge University Press), 135–159.
Jacobs AM (2015b) Neurocognitive poetics: methods and models for investigating the neuronal
and cognitive-affective bases of literature reception. Front. Hum. Neurosci. 9:186. doi:
10.3389/fnhum.2015.00186
Jacobs, A. (2015c). The scientific study of literary experience: Sampling the state of the art.
Scientific Study of Literature, 5(2), 139-170.
Jacobs, A. (2016). The scientific study of literary experience and neuro-behavioral responses to
Literature: Reply to Commentaries, Scientific Study of Literature, 6(1), 164174. doi
10.1075/ssol.6.1.08jac issn 22104372.
Jacobs, A. M. (2017). Affective and aesthetic processes in literary reading: A neurocognitive
poetics perspective. In M. Burke & E. Troscianko (Eds.), Dialogues between literature and
cognition. In press.
Jacobs, A. M., and Kinder, A. (2015). Worte als Worte erfahren: wie erarbeitet das Gehirn
Gedichte (Experience words as words: how the brain constructs poems), in Kind und
Gedicht (Child and Poem), ed A. Pompe (Berlin: Rombach), 57–76.
Jacobs, A. M., and Schrott, R. (2015). Gefesselt im Kopfkino: Von Kippschaltern, Madeleine
Effekten und Don Quichote Syndromen bei der Immersion in Textwelten (Captivated in
the mind’s cinema: of trigger-switches, Don Quichote syndroms and immersion in text
worlds). Available online at: FIKTION.CC
Jacobs AM, Võ ML-H, Briesemeister BB, Conrad M, Hofmann MJ, Kuchinke L, Lüdtke J and
Braun M (2015) 10 years of BAWLing into affective and aesthetic processes in reading:
what are the echoes? Front. Psychol. 6:714. doi: 10.3389/fpsyg.2015.00714
22"
"
Jacobs, A. M., Lüdtke, J., Aryani, A., Meyer-Sickendiek, B., and Conrad, M. (2016a). Mood-
empathic and aesthetic responses in poetry reception: A model-guided, multilevel,
multimethod approach. Scientific Study of Literature, 6(1), 87130.
doi:10.1075/ssol.6.1.06jac
Jacobs AM, Hofmann MJ and Kinder A (2016b) On Elementary Affective Decisions: To Like
Or Not to Like, That Is the Question. Front. Psychol. 7:1836. doi:
10.3389/fpsyg.2016.01836
Jacobs, A. M., & Lüdtke, J. (2017). Immersion into narrative and poetic worlds: A neuro-
cognitive poetics perspective. In M. Kuipers & F. Hakemulder (Eds.), Handbook of
Narrative Absorption. John Benjamins.
Jakobson, R. (1960). Closing statement: linguistics and poetics, in Style in Language, ed T. A.
Sebeok (Cambridge, MA: MIT Press), 350–377.
Jeannerod, M. (2006). Motor cognition. Oxford: Oxford University Press.
Kanske, P., Böckler, A., Trautwein, F.-M., Lesemann, F. H. P., & Singer, T. (2016). Are strong
empathizers better mentalizers? Evidence for independence and interaction between the
routes of social cognition. Social Cognitive and Affective Neuroscience.
https://doi.org/10.1093/scan/nsw052
Keidel, J. L., Davis, P. M., Gonzalez-Diaz, V., Martin, C. D., & ierry, G. (2013). How
Shakespeare tempests the brain: Neuroimaging insights. Cortex, 49(4), 913e919.doi:
10.1016/j.cortex.2012.03.011.
Kidd, D. C., & Castano, E. (2013). Reading Literary Fiction Improves Theory of Mind. Science,
342(6156), 377–380. https://doi.org/10.1126/science.1239918
Kintsch, W. (2012). Musing about beauty. Cogn. Sci. 36, 635–654. doi: 10.1111/j. 1551-
6709.2011.01229.x
Kintsch, W., and van Dijk, T. A. (1978). Toward a model of text comprehension and production.
Psychol. Rev. 85, 363–394. doi: 10.1037/0033-295x.85.5.363
Kosslyn, S. M. (1994). Image and brain. Cambridge, MA: MIT press.
Kuhlmann, M., Hofmann, M. J., Briesemeister, B. B., and Jacobs, A. M. (2016). Mixing positive
and negative valence: affective-semantic integration of bivalent words. Sci. Rep. 6:30718.
doi: 10.1038/srep30718
Kuiken, D. (2015). The Implicit Erasure of “Literary Experience” in Empirical Studies of
Literature: Comment on “ The Scientific Study of Literary Experience: Sampling the
State of the Art” by Arthur Jacobs. Scientific Study of Literature, 5(2), 171–177.
Kurby, C. A., & Zacks, J. M. (2013). The activation of modality-specific representations during
discourse processing. Brain and Language, 126(3), 338–349.
https://doi.org/10.1016/j.bandl.2013.07.003
Kurby, C. A., & Zacks, J. M. (2015). Situation models in naturalistic comprehension. In R. M.
Willems (Ed.), Cognitive Neuroscience of Natural Language Use. Cambridge: Cambridge
University Press.
Kuzmičová, A. (2014). Literary narrative and mental imagery: A view from embodied cognition.
Style, 48(3), 275–293.
Lai, V. T., Willems, R. M., & Hagoort, P. (2015). Feel between the Lines: Implied Emotion in
Sentence Comprehension. Journal of Cognitive Neuroscience, 1–14.
https://doi.org/10.1162/jocn_a_00798
Lerner, Y., Honey, C. J., Silbert, L. J., & Hasson, U. (2011). Topographic mapping of a hierarchy
of temporal receptive windows using a narrated story. Journal of Neuroscience, 31(8), 2906–
2915.
Liebig, J., Froehlich, E., Ziegler, J.C., Morawetz, C., Braun, M., Heekeren, H.R., Jacobs, A. M.
(2017). Neurofunctionally dissecting the developing reading system into its central
subcomponents. Developmental Cognitive Neuroscience, in revision.
Liu, S., Erkkinen, M. G., Healey, M. L., Xu, Y., Swett, K. E., Chow, H. -M., & Braun, A. R.
23"
"
(2015). Brain activity and connectivity during poetry composition: Toward a
multidimensional model of the creative process. Human Brain Mapping, 36, 3351–3372
doi: 10.1002/hbm.22849
Louwerse, M. M. (2011). Symbol Interdependency in Symbolic and Embodied Cognition. Topics
in Cognitive Science, 3(2), 273–302. https://doi.org/10.1111/j.1756-8765.2010.01106.x
Lüdtke, J., Meyer-Sickendieck, B., and Jacobs, A. M. (2014). Immersing in the stillness of an early
morning: testing the mood empathy hypothesis of poetry reception. Psychol. Aesthet. Creat.
Arts 8, 363–377. doi: 10.1037/a00 36826
Mangan, B. (2008). Representation, rightness and the fringe. J. Conscious. Stud. 15, 75–82.
Mar, R. A., & Oatley, K. (2008). The function of fiction is the abstraction and simulation of
social experience. Perspectives on Psychological Science, 3, 173–192.
Mar, R. A. , Oatley, K. , Hirsh, J. , dela Paz, J. , & Peterson, J. B. (2006). Bookworms versus
nerds: Exposure to fiction versus non-fiction, divergent associations with social ability,
and the simulation of fictional social worlds. Journal of Research in Personality, (40), 694–712.
Martin, A., Schurz, M., Kronbichler, M., Richlan, F., 2015. Reading in the brain of children and
adults: A meta-analysis of 40 functional magnetic resonance imaging studies. Human
Brain Mapping, 36(5), 1963-1981. doi: 10.1002/hbm.22749.
Martin-Loeches, M., Casado, P., Hernandez-Tamames, J. A., & Alvarez-Linera, J. (2008). Brain
activation in discourse comprehension: A 3t fMRI study. Neuroimage, 41(2), 614–22.
Mason, M. F., Norton, M. I., Van Horn, J. D., Wegner, D. M., Grafton, S. T., & Macrae, C. N.
(2007). Wandering minds: the default network and stimulus-independent thought. Science
(New York, N.Y.), 315(5810), 393–395. https://doi.org/10.1126/science.1131295
Menenti, L., Petersson, K. M., Scheeringa, R., & Hagoort, P. (2009). When elephants fly:
differential sensitivity of right and left inferior frontal gyri to discourse and world
knowledge. Journal of Cognitive Neuroscience, 21(12), 2358–2368.
https://doi.org/10.1162/jocn.2008.21163
Nagels A, Kauschke C, Schrauf J, Whitney C, Straube B and Kircher T (2013) Neural substrates
of figura- tive language during natural speech per- ception: an fMRI study. Front. Behav.
Neurosci. 7:121. doi: 10.3389/fnbeh. 2013.00121
Nell, V. (1988). Lost in a Book: The Psychology of Reading for Pleasure. New Haven/London: Yale
University Press.
Nicklas, P., & Jacobs, A. M. (2017). Rhetorics, neurocognitive poetics and the aesthetics of
adaptation. Poetics Today. In press.
Nijhof, A. D., & Willems, R. M. (2015). Simulating Fiction: Individual Differences in Literature
Comprehension Revealed with fMRI. PLoS ONE, 10(2), e0116492.
https://doi.org/10.1371/journal.pone.0116492
Oatley, K. (1999). Why fiction may be twice as true as fact: Fiction as cognitive and emotional
simulation. Review of General Psychology, 3, 101–117.
Oatley, K. (2016). Fiction: Simulation of Social Worlds. Trends in Cognitive Sciences.
https://doi.org/10.1016/j.tics.2016.06.002
Obermeier, C., Menninghaus, W., Von Koppenfels, M., Raettig, T., Schmidt-Kassow, M.,
Otterbein, S., and Kotz, S. A. (2013). Aesthetic and emotional effects of meter and
rhyme in poetry. Frontiers in Psychology, 4, 1-10. doi:10.3389/fpsyg.2013.00010
O’Sullivan, N., Davis, P., Billington, J., Gonzalez-Diaz, V., and Corcoran, R. (2015). “Shall I
compare thee”: the neural basis of literary awareness, and its benefits to cognition. Cortex
73, 144–157. doi: 10.1016/j.cortex.2015.08.014
Panero, M. E., Weisberg, D. S., Black, J., Goldstein, T. R., Barnes, J. L., Brownell, H., & Winner,
E. (2016). Does reading a single passage of literary fiction really improve theory of mind?
An attempt at replication. Journal of Personality and Social Psychology, 111(5), e46–e54.
https://doi.org/10.1037/pspa0000064
24"
"
Panksepp, J. (1998). Affective Neuroscience: The Foundations of Human and Animal Emotions. New
York, NY: Oxford University Press. doi: 10.3389/fpsyg.2015. 01250
Papeo, L., Vallesi, A., Isaja, A., & Rumiati, R. I. (2009). Effects of TMS on different stages of
motor and non-motor verb processing in the primary motor cortex. PLoS ONE, 4(2),
e4508.
Pelowski, M., Oi, M., Liu, T., Meng, S., Saito, G., & Saito, H. (2016). Understand after like:
viewer's delight? A fNIRS study of order-effect in combined hedonic and cognitive
appraisal of art, Acta Psychologica, 170, 127-138.
Plato. (1969). Plato in twelve volumes: Republic. (P. Shorey, Trans.) (Vols. 1–Vols 5 and 6).
Cambridge, MA: Harvard University Press.
Poldrack, R. A. (2006). Can cognitive processes be inferred from neuroimaging data? Trends in
Cognitive Sciences, 10(2), 59–63. https://doi.org/10.1016/j.tics.2005.12.004
Ponz, A., Montant, M., Liegeois-Chauvel, C., Silva, C., Braun, M., Jacobs, A. M., et al. (2013).
Emotion processing in words: a test of the neural re-use hypothesis using surface and
intracranial EEG. Soc. Cogn. A ect. Neurosci. 9, 619–627. doi: 10.1093/scan/nst034
Qiu, J., Li, H., Yang, D., Luo, Y., Li, Y., Wu, Z., et al. (2008). The neural basis of insight problem
solving: an event-related potential study. Brain Cogn. 68, 100–106. doi:
10.1016/j.bandc.2008.03.004
Raichle, M. E., MacLeod, A. M., Snyder, A. Z., Powers, W. J., Gusnard, D. A., & Shulman, G. L.
(2001). A default mode of brain function. Proc Natl Acad Sci U S A, 98(2), 676–82.
Rapp, A. M., Mutschler, D. E., and Erb, M. (2012). Where in the brain is nonliteral language? A
coordinate-based meta-analysis of functional magnetic resonance imaging studies.
Neuroimage 63, 600–610. doi: 10.1016/j.neuroimage.2012. 06.022
Samur, D., Tops, M., & Koole S. L. (2017). Does a single session of reading literary fiction prime
enhanced mentalising performance? Four replication experiments of Kidd and Castano (2013).
Cognition and Emotion.
Samur, D., Lai, V. T., Hagoort, P., & Willems, R. M. (2015). Emotional context modulates
embodied metaphor comprehension. Neuropsychologia, 78, 108–114.
Schrott, R., and Jacobs, A. M. (2011). Gehirn und Gedicht: Wie wir unsere Wirklichkeiten konstruieren
(Brain and Poetry: How We Construct Our Realities). München: Hanser.
Schlochtermeier, L. H., Pehrs, C., Kuchinke, L., Kappelho , H., & Jacobs, A. M. (2015). Emotion
processing in di erent media types: Realism, complexity, and immersion. Journal of Systems
and Integrative Neuroscience, 1, 41–47. DOI: 10.15761/JSIN.1000109
Schuster, S., Hawelka, S., Richlan, F., Ludersdorfer, P., & Hutzler, F. (2015). Eyes on words: A
fixation-related fMRI study of the left occipito-temporal cortex during self-paced silent
reading of words and pseudowords. Scientific Reports, 5, 12686.
https://doi.org/10.1038/srep12686
Seli, P., Risko, E. F., Smilek, D., & Schacter, D. L. (2016). Mind-wandering with and without
intention. Trends in Cognitive Sciences, 20(8), 605-617.
https://doi.org/10.1016/j.tics.2016.05.010
Smallwood, J., McSpadden, M.C., & Schooler, J.W. (2008). When attention matters: the curious
incident of the wandering mind. Memory & Cognition 36 (6), 1144–1150.
Smallwood, J., Brown, K., Baird, B., Schooler, J.W. (2012). Cooperation between the default
mode network and the frontal-parietal network in the production of an internal train of
thought. Brain research, 1428, 60–70, Elsevier B.V. doi:10.1016/ j.brainres.2011.03.072.
Speer, N. K., Reynolds, J. R., Swallow, K. M., & Zacks, J. M. (2009). Reading stories activates
neural representations of visual and motor experiences. Psychological Science, 20(8), 989–
999. https://doi.org/10.1111/j.1467-9280.2009.02397.x
Sylvester T, Braun M, Schmidtke D and Jacobs AM (2016) The Berlin Affective Word List for
Children (kidBAWL): Exploring Processing of Affective Lexical Semantics in the Visual
and Auditory Modalities. Front. Psychol. 7:969. doi: 10.3389/fpsyg.2016.00969
25"
"
Tamir, D. I., Bricker, A. B., Dodell-Feder, D., & Mitchell, J. P. (2016). Reading fiction and
reading minds: the role of simulation in the default network. Social Cognitive and Affective
Neuroscience, 11(2), 215–224. https://doi.org/10.1093/scan/nsv114
Taylor, L. J., & Zwaan, R. A. (2008). Motor resonance and linguistic focus. Q J Exp Psychol
(Colchester), 61(6), 896–904.
Tesink, C. M. J. Y., Petersson, K. M., van Berkum, J. J. A., van den Brink, D., Buitelaar, J. K., &
Hagoort, P. (2009). Unification of speaker and meaning in language comprehension: an
FMRI study. Journal of Cognitive Neuroscience, 21(11), 2085–2099.
https://doi.org/10.1162/jocn.2008.21161
Tobia, M. J., Iacovella, V., & Hasson, U. (2012). Multiple sensitivity profiles to diversity and
transition structure in non-stationary input. NeuroImage, 60(2), 991–1005.
https://doi.org/10.1016/j.neuroimage.2012.01.041
Troscianko, E. T. (2013). Reading imaginatively: The imagination in cognitive science and
cognitive literary studies. Journal of Literary Semantics, 42(2), 181–198.
Turken, A.U., Dronkers, N.F., 2011. The neural architecture of the language comprehen- sion
network: converging evidence from lesion and connectivity analyses. Front. Syst.
Neurosci. 5, 1 (Feb 10).
Ullrich, S., Aryani, A., Kraxenberger, M., Jacobs, A. M., & Conrad, M. (2016). Where are emo-
tions in a poem? Sub-lexical iconicity, lexical surface features and dynamic inter-lexical
shi s. Frontiers in Psychology. in press.
Van Berkum, J. J. A., De Goede, D., Van Alphen, P. M., Mulder, E. R., & Kerstholt, J. H.
(2013). How robust is the language architecture? The case of mood. Frontiers in Psychology,
4, 505. https://doi.org/10.3389/fpsyg.2013.00505
van den Broek, P. (2010). Using texts in science education: Cognitive processes and knowledge
representation. Science 328:453456.
van den Hoven, E., Hartung, F., Burke, M., & Willems, R. M. (2016). Individual Differences in
Sensitivity to Style During Literary Reading: Insights from Eye-Tracking. Collabra, 2(1):
25, pp. 1–16, DOI: http://dx.doi. org/10.1525/collabra.39""
van Krieken, K., Hoeken, H., & Sanders, J. (2015). From Reader to Mediated Witness: The
Engaging Effects of Journalistic Crime Narratives. Journalism & Mass Communication
Quarterly, 92(3).
Vartanian, O. (2012). Dissociable neural systems for analogy and metaphor: implications for the
neuroscience of creativity. Br. J. Psychol. 103, 302–316. doi: 10.1111/j.2044-
8295.2011.02073.x
Wallentin, M., Nielsen, A. H., Vuust, P., Dohn, A., Roepstorff, A., & Lund, T. E. (2011). BOLD
response to motion verbs in left posterior middle temporal gyrus during story
comprehension. Brain and Language, 119(3), 221–225.
https://doi.org/10.1016/j.bandl.2011.04.006
Whitney, C., Huber, W., Klann, J., Weis, S., Krach, S., & Kircher, T. (2009). Neural correlates of
narrative shifts during auditory story comprehension. NeuroImage, 47(1), 360–366.
https://doi.org/10.1016/j.neuroimage.2009.04.037
Willems, R. (ed) (2015). Cognitive Neuroscience of Natural Language Use. Cambridge: Cambridge
University Press.
Willems, R. M., & Casasanto, D. (2011). Flexibility in embodied language understanding. Frontiers
in Psychology, 2, 116. https://doi.org/10.3389/fpsyg.2011.00116
Willems, R. M., & Francken, J. C. (2012). Embodied cognition: taking the next step. Frontiers in
Cognitive Science, 3, 582. https://doi.org/10.3389/fpsyg.2012.00582
Willems, R. M., Hagoort, P., & Casasanto, D. (2010). Body-specific representations of action
verbs: Neural evidence from right- and left-handers. Psychological Science, 21(1), 67–74.
Willems, R M, & Hartung, F. (under review). Engaging regularly with fiction influences
connectivity in cortical areas for language and mentalizing.
26"
"
Willems, R. M., & Jacobs, A. M. (2016). Caring About Dostoyevsky: The Untapped Potential of
Studying Literature. Trends in Cognitive Sciences, 20(4), 243–245.
https://doi.org/10.1016/j.tics.2015.12.009
Willems, R. M., Labruna, L., D’Esposito, M., Ivry, R., & Casasanto, D. (2011). A functional role
for the motor system in language understanding: evidence from theta-burst transcranial
magnetic stimulation. Psychological Science, 22(7), 849–854.
https://doi.org/10.1177/0956797611412387
Willems, R. M., Toni, I., Hagoort, P., & Casasanto, D. (2010). Neural dissociations between
action verb understanding and motor imagery. Journal of Cognitive Neuroscience, 22(10),
238723400.
Willems, R. M., & Varley, R. (2010). Neural Insights into the Relation between Language and
Communication. Frontiers in Human Neuroscience, 4, 203.
https://doi.org/10.3389/fnhum.2010.00203
Wolf, M. (2007), Proust and the Squid – The Story and Science of the Reading Brain, New York
Yang, J. (2014). The role of the right hemisphere in metaphor comprehension: a meta-analysis of
functional magnetic resonance imaging studies. Hum. Brain Mapp. 35, 107–122. doi:
10.1002/hbm.22160
Yarkoni, T., Speer, N. K., Balota, D. a, McAvoy, M. P., & Zacks, J. M. (2008). Pictures of a
thousand words: investigating the neural mechanisms of reading with extremely rapid
event-related fMRI. NeuroImage, 42(2), 973–987.
https://doi.org/10.1016/j.neuroimage.2008.04.258
Zacks, J. M., Braver, T. S., Sheridan, M. A., Donaldson, D. I., Snyder, A. Z., Ollinger, J. M., …
Raichle, M. E. (2001). Human brain activity time-locked to perceptual event boundaries.
Nature Neuroscience, 4(6), 651–655. https://doi.org/10.1038/88486
Zacks, J. M., Speer, N. K., Swallow, K. M., & Maley, C. J. (2010). The Brain’s Cutting-Room
Floor: Segmentation of Narrative Cinema. Frontiers in Human Neuroscience, 4.
https://doi.org/10.3389/fnhum.2010.00168
Zeman, A., Milton, F., Smith, A., & Rylance, R. (2013). By heart: An fMRI study of brain activa-
tion by poetry and prose. Journal of Consciousness Studies, 20, 132–158.
Zwaan, R.A. (2015). Situation models, mental simulations, and abstract concepts in discourse
comprehension. Psychon Bull Rev, 23: 1028. doi:10.3758/s13423-015-0864-x
27"
"
Figure Caption.
Figure 1. Extension of the Neurocognitive Poetics Model sketching the likely main neural
correlates of subprocesses involved in implicit and explicit fiction processing, e.g. situation
model building, immersion, or aesthetic appreciation. Some of these structures are included in
networks, in particular: the DMN (PCC, dmPCF, ATL) nodes, the WM network (dlPFC, superior
and posterior parietal nodes), and the salience network (putamen, left dorsal caudate nucleus).
Abbreviations: LH = Left hemisphere, RH = right hemisphere, vOT = ventral occipital cortex,
MTG = medial temporal gyrus, IFG = inferior frontal gyrus, AG = angular gyrus, SPL =
superior parietal lobulus, SMG = supramarginal gyrus, ATP = anterior temporal pole, A/PmCC
= anterior/posterior/medial cingulate cortex, TPJ = temporo-parietal junction, dlPFC =
dorsolateral prefrontal cortex, Ins = Insula, OFC = orbitofrontal cortex.
... The study employed a descriptivecorrelational, mixed-methods research design that gathered data over an academic semester via a questionnaire, group interviews, a literary competence assessment, and reading logs. As its overarching framework, the study drew on information processing theory (Chaiken, 1980), the transactional theory of reading (Rosenblatt, 1985), and the neurocognitive poetics model (Jacobs & Willems, 2018) to hypothesize that the more receptive participants were to literature, the deeper their sense of immersion, the less their need for structure, and the greater their use of reading strategies promoting systematic analysis, the more advanced their literary competence would be. ...
... Literature is distinct in that it falls under the category of representational language, which is characterized by its creative and imaginative use of language (Beach & Appleman, 1984;Jacobs & Willems, 2018). In contrast, texts containing referential language, such as news articles, scientific papers, and instruction manuals, aim to convey facts straightforwardly and concisely. ...
... The implication is that information can be processed differently when reading literature as opposed to referential texts (Kuzmičová, 2014), that literary reading is likely enhanced through immersion (seeing as it strives to engage the reader's imagination), greater tolerance of complexity (and a weaker need for structure given the creative use of language) (Jacobs & Willems, 2018), and that some reading strategies may not be suitable when reading literature (Beach & Appleman, 1984;Blau, 2014). Indeed, according to the neurocognitive poetics model (Jacobs & Willems, 2018), literature contains both background elements (familiar words, themes, scenes) and foreground elements (stylistic devices). ...
Article
Full-text available
Literary competence is a critical component of foreign language education and has far-reaching implications for language learners’ linguistic and cultural development. This article reports on a study that examined how the receptiveness to literature, immersion, reading strategies, need for structure, and information processing of 72 English as a foreign language (EFL) learners in upper-secondary schools predicted their literary competence. The study adopted a mixed-methods approach, including a scored assessment of learners’ EFL literary competence via a cooperative argumentative dialogue (CAD) involving four short stories, post-CAD group interviews, reading logs, and an online questionnaire. The results revealed that participants had significantly higher levels of interpretative and empathic competence than aesthetic-stylistic and cultural-discursive competence. They also tended to favour problem-solving and global reading strategies, which negatively correlated with their literary competence. Meanwhile, their ability to process information analytically and systematically positively moderated the relationship between their receptiveness to literature and their literary competence.
... Models of literary processing describe reader responses to fiction and verbal art in terms of neuronal activity, subjective experiences, and/or objective (i.e., intersubjectively examinable, directly observable) behavior. In any case, these models have to find a way to account for the complexity of the process (Jacobs, 2015(Jacobs, , 2023Jacobs and Willems, 2018;Willems and Jacobs, 2016). This is true for studies testing such models as well, in the sense that the stimulus material should ideally contain the potential to elicit a wide variety of possible responses from the readers. ...
... The more complex a text is, the more complex it seems to be to accurately predict how much subjects will like it (cf. Jacobs, 2015Jacobs, , 2023Jacobs and Willems, 2018;Willems and Jacobs, 2016). That notwithstanding, we conclude that liking ratings for narrative poetry are mostly a result of the reader's evaluation of a text's comprehensibility, structural cohesion, and narrative content. ...
Article
Full-text available
Literary reading is an interactive process between a reader and a text that depends on a balance between cognitive effort and emotional rewards. By studying both the crucial features of the text and of the subjective reader reception, a better understanding of this interactive process can be reached. In the present study, subjects (N=31) read and rated a work of narrative fiction that was written in a poetic style, thereby offering the readers two pathways to cognitive rewards: Aesthetic appreciation and narrative immersion. Using purely text-based quantitative descriptors, we were able to independently and accurately predict the subjective ratings in the dimensions comprehensibility, valence, arousal, and liking across roughly 140 pages of naturalistic text. The specific text features that were most important in predicting each rating dimension are discussed in detail. In addition, the implications of the findings are discussed more generally in the context of existing models of literary processing and future research avenues for empirical literary studies.
... When perceiving the world, we segment continuous perceptual input into discrete events, centred around details such as characters, character interactions, spatial locations, and temporality 54 . Several studies suggest that when consuming media, we use the same mechanisms as in real life to construct event representations 55 and interpret characters' emotional states 56 . To this extent, fiction has been considered a simulation of social worlds 23,57 . ...
Article
Full-text available
Audio-visual media possesses a remarkable ability to synchronise audiences’ neural, behavioural, and physiological responses. This synchronisation is considered to reflect some dimension of collective attention or engagement with the stimulus. But what is it about these stimuli that drives such strong engagement? There are several properties of media stimuli which may lead to synchronous audience response: from low-level audio-visual features, to the story itself. Here, we present a study which separates low-level features from narrative by presenting participants with the same content but in separate modalities. In this way, the presentations shared no low-level features, but participants experienced the same narrative. We show that synchrony in participants’ heart rate can be driven by the narrative information alone. We computed both visual and auditory perceptual saliency for the content and found that narrative was approximately 10 times as predictive of heart rate as low-level saliency, but that low-level audio-visual saliency has a small additive effect towards heart rate. Further, heart rate synchrony was related to a separate cohorts’ continuous ratings of immersion, and that synchrony is likely to be higher at moments of increased narrative importance. Our findings demonstrate that high-level narrative dominates in the alignment of physiology across viewers.
... is not well-specified within theories of discourse comprehension (McNamara & Magliano, 2009). Extensive work is still required to understand the cognitive and neural mechanisms underlying literary reading and the processing of fictional narratives, especially as they relate to experiences of imagery (Jacobs & Willems, 2018). Additional research is needed to better understand how our current results shed light on the multimodality within these mental representations. ...
Article
Full-text available
Research suggests that individuals have different phenomenological experiences across various tasks. However, little is known about how these experiences vary by task or over time. This study examined participants’ experiences of task-unrelated thoughts (i.e., TUTs), visual, and verbal thoughts across two experimental sessions and two different tasks. In addition, we examined relations between participants’ thoughts and key individual difference factors. In Session 1, participants (n = 85) engaged in a focused-attention meditation and a reading task, then completed a second identical session with a new text. Throughout both tasks, participants were prompted to report on the characteristics of their thoughts. Participants’ ratings of TUT, visual, and verbal thoughts were subject to change over time. Furthermore, on average, participants visualized more and had fewer TUTs while reading compared to meditation; however, no task difference was found for verbal-thinking reports. This suggests that visual imagery is more malleable than verbal-thinking. There was a strong negative correlation between visual and verbal thoughts, suggesting that at any given time, individuals’ thoughts tended to be either predominantly visual or verbal. Finally, individual differences in the tendency to become immersed in narratives and motivation to engage with other people’s perspectives (i.e., mind-reading motivation) were related to higher reports of visual imagery during reading, whereas verbal-thinking was negatively associated with mind-reading motivation and unrelated to TUT. Overall, this study revealed that individuals’ phenomenological experiences vary during tasks and across time, providing a foundation for future work to examine why and how variability in these phenomenological experiences emerge.
Article
Full-text available
The Default Mode Network (DMN) is a network of brain regions responsible for active or passive narration and the sharing of experiences. The ability to simulate experiences and use memories to construct hypothetical tales about how people might behave is a fundamental skill in building a social aggregate as it allows us to foreshadow the consequences of our actions and reflect on the intentions of others, simulating their experiences to anticipate their behavior. We can process imaginary situations whose accuracy is a measure of our social skills since the closer the imagination approaches social reality, the better we negotiate our social worlds. The DMN is responsible for these activities that encompass the frontal and parietal structures of the brain along the midline, the lateral and medial temporal lobes, and the lateral parietal cortex. This work reviews the DMN in all its aspects, both in the construction of narrative plots and in the preparation of believable and immersive emotional scenarios, including endocrine outcomes (oxytocin and cortisol).
Article
In this article, we introduce a neurocognitive model as a useful analytical approach to a wide range of representations (written, oral, and/or visual) of a comprehensive and dramatic collapse of the world order (cosmic, social, and/or moral). We gather these variegated representations under the term End Time Narratives ( ETN ). The widespread reception of ETN s, and their popularity and variability across different periods and cultures, is evidence that these representations continually affect us and hold power over us. Prominent and well-known examples of ETN s are the Jewish and Christian apocalypses from antiquity, which have been widely influential through the centuries. This prevalence raises the question of why ETN s exercise such an influence. The reasons, we suggest, are based on the following hypotheses: (1) that the efficacy and attraction of ETN s can be traced to identifiable cognitive mechanisms, (2) that these underlying mechanisms are linked to certain emotional reactions activated by the particular structure and design of these narratives, and (3) ETN s – as cultural products – seem to be designed and structured to elicit cognitive and emotional responses through effects on the brain. To investigate the possible neurocognitive and psychological mechanisms that are simulated and enacted in recipients by ETN s, we apply the model through an “enactive reading” of a classical ETN , the Book of Revelation 14–16.
Article
Full-text available
Scientific interest in the processing and effects of narrative information has substantially increased in recent years. The focus of this chapter is on narrative transportation, an experiential state of immersion in which all mental processes are concentrated on the events occurring in the narrative. We describe and integrate interdisciplinary advances in the study of narrative transportation. After an introduction of the concept and related approaches, we outline antecedents in terms of story factors, individual differences, situational variables, and related interactions. In the following sections, we introduce processes and effects that are facilitated by stories and narrative transportation. This includes research on persuasion, misinformation and its correction, self and identity, social cognitive skills, and on the fulfillment of belongingness needs. We close with an outlook on the role of technology and artificial intelligence, meaning making, and climate change communication as emerging and future directions.
Article
Full-text available
Künstliche Intelligenz dringt zunehmend in künstlerisch-kreative Handlungsfelder vor, die bislang als genuin menschliche Tätigkeiten angesehen wurden. Damit rücken auch Facetten der digitalen Rezeption und Produktion literarischer Gegenstände in den Blick, die bisher im literaturdidaktischen Diskurs kaum eine Rolle gespielt haben: Mit nichtmenschlichen Akteuren zu literarischen Texten interagieren oder literarisch mit Hilfe einer Maschine schreiben, verändert die Erfordernisse und Bedingungen literarischer Texterschließung und Kommunikation außerhalb und innerhalb von schulischen Kontexten. Da es im Umgang mit Literatur jedoch seit jeher nicht nur auf das "Verstehen" eines Ausgangstextes, sondern ebenso auf seine emotionale, körperliche und somit individuelle bzw. erfahrungsbezogene Aneignung ankommt, wirft der Einbezug von KI-Tools in den Literaturunterricht weitreichende Fragen auf. Der Beitrag fragt daher explorativ, wie sich die Anschlusskommunikation zu literarischen Texten mit Unterstützung von sprachbasierten KI-Tools hier einordnen lässt und welche Transformationen bisheriger schreib-und literaturdidaktischer Normen und Praktiken damit ggf. einhergehen werden.
Article
Full-text available
The reading system can be broken down into four basic subcomponents in charge of prelexical, orthographic, phonological, and lexico-semantic processes. These processes need to jointly work together to become a fluent and efficient reader. Using functional magnetic resonance imaging (fMRI), we systematically analyzed differences in neural activation patterns of these four basic subcomponents in children (N=41, 9–13 years) using tasks specifically tapping each component (letter identification, orthographic decision, phonological decision, and semantic categorization). Regions of interest (ROI) were selected based on a meta-analysis of child reading and included the left ventral occipito-temporal cortex (vOT), left posterior parietal cortex (PPC), left inferior frontal gyrus (IFG), and bilateral supplementary motor area (SMA). Compared to a visual baseline task, enhanced activation in vOT and the IFG was observed for all tasks with very little differences between tasks. Activity in the dorsal PPC system was confined to prelexical and phonological processing. Activity in the SMA was found in orthographic, phonological, and lexico-semantic tasks. Our results are consistent with the idea of an early engagement of the vOT accompanied by executive control functions in the frontal system, including the bilateral SMA.
Article
Full-text available
Rhetorical effects in speech and writing have a great strategic importance in achieving the communicative end of being persuasive: they are key in the exertion of power through language. Persuasion occurs by cognitive-affective stimulation, relying on specific psychosomatic perceptual patterns which are used on all levels of speech reception in cultural and political contexts. This makes rhetorically conspicuous texts efficient as stimulus material for empirical research into neurocognitive modeling of how poetic texts are read. Adaptations as revisitations of prior works share with the rhetorical repertoire of repetition similar cognitive-affective properties, because both function via recognition of sameness or similarity. Recent paradigm shifts in adaptation studies have much enlarged the field of research, so Linda Hutcheon's as yet empirically unsupported insight that adaptation is the norm and not the exception in human imagination finds an unexpectedly large field of application. This shift away from the narrow standard paradigm of novels adapted for the screen to a more fundamental aesthetics of adaptation has also helped establish connections between adaptation studies and the experiment-based methodologies of empirical aesthetics and neuroaes-thetics with a view to developing cognitive and affective models of the processes underlying the reception of adaptations.
Chapter
When we think of everyday language use, the first things that come to mind include colloquial conversations, reading and writing e-mails, sending text messages or reading a book. But can we study the brain basis of language as we use it in our daily lives? As a topic of study, the cognitive neuroscience of language is far removed from these language-in-use examples. However, recent developments in research and technology have made studying the neural underpinnings of naturally occurring language much more feasible. In this book a range of international experts provide a state-of-the-art overview of current approaches to making the cognitive neuroscience of language more 'natural' and closer to language use as it occurs in real life. The chapters explore topics including discourse comprehension, the study of dialogue, literature comprehension and the insights gained from looking at natural speech in neuropsychology.
Preprint
Behavioral evidence suggests that engaging with fiction is positively correlated with social abilities. The rationale behind this link is that engaging with fictional narratives offers a ‘training modus’ for mentalizing and empathizing. We investigated the influence of the amount of reading that participants report doing in their daily lives, on connections between brain areas while they listened to literary narratives. Participants (N=57) listened to two literary narratives while brain activation was measured with fMRI. We computed time-course correlations between brain regions, and compared the correlation values from listening to narratives to listening to reversed speech. The between-region correlations were then related to the amount of fiction that participants read in their daily lives. Our results show that amount of fiction reading is related to functional connectivity in areas known to be involved in language and mentalizing. This suggests that reading fiction influences social cognition as well as language skills.
Preprint
Experiments have shown that compared to fictional texts, readers read factual texts faster and have better memory for described situations. Reading fictional texts on the other hand seems to improve memory for exact wordings and expressions. Most of these studies used a ‘newspaper’ versus ‘literature’ comparison. In the present study, we investigated the effect of reader’s expectation to whether information is true or fictional with a subtler manipulation by labelling short stories as either based on true or fictional events. In addition, we tested whether narrative perspective or individual preference in perspective taking affects reading true or fictional stories differently. In an online experiment, participants (final N=1742) read one story which was introduced as based on true events or as fictional (factor fictionality). The story could be narrated in either 1st or 3rd person perspective (factor perspective). We measured immersion in and appreciation of the story, perspective taking, as well as memory for events. We found no evidence that knowing a story is fictional or based on true events influences reading behavior or experiential aspects of reading. We suggest that it is not whether a story is true or fictional, but rather expectations towards certain reading situations (e.g. reading newspaper or literature) which affect behavior by activating appropriate reading goals. Results further confirm that narrative perspective partially influences perspective taking and experiential aspects of reading.
Book
What does it mean to be transported by a narrative?to create a world inside one’s head? How do experiences of narrative worlds alter our experience of the real world? In this book Richard Gerrig integrates insights from cognitive psychology and from research linguistics, philosophy, and literary criticism to provide a cohesive account of what we have most often treated as isolated aspects of narrative experience.Drawing on examples from Tolstoy to Toni Morrison, Gerrig offers new analysis of some classic problems in the study of narrative. He discusses the ways in which we are cognitively equipped to tackle fictional and nonfictional narratives; how thought and emotion interact when we experience narrative; how narrative information influences judgments in the real world; and the reasons we can feel the same excitement and suspense when we reread a book as when we read it for the first time. Gerrig also explores the ways we enhance the experience of narratives, through finding solutions to textual dilemmas, enjoying irony at the expense of characters in the narrative, and applying a wide range of interpretive techniques to discover meanings concealed by and from authors.
Chapter
Narrative Absorption brings together research from the social sciences and Humanities to solve a number of mysteries: Most of us will have had those moments, of being totally absorbed in a book, a movie, or computer game. Typically we do not have any idea about how we ended up in such a state. Nor do we fully realize how we might have changed as we return for the fictional worlds we have visited. The feeling of being absorbed is one of the most illusive and transient feelings, but also one that motivates audiences to spend considerable amounts of time in narrative worlds, and one that is central to our understanding of the effects of narratives on beliefs and behavior. Key specialists inform the reader of this book about the nature of the peculiar state of consciousness during episodes of absorption, the perception of absorption in history, the role of absorption in meaningful experiences with narratives, the relation with related phenomena such as suspense and identification, issues of measurement, and the practical implications, for instance in education-entertainment. Various fields have worked separately on topics of absorption, albeit using different terminology and methods, but having reached a high level of development and complexity in understanding absorption. Now is the time to bring them together. This volume will be a point of reference for years to come.