ArticlePDF Available

“Look at Me” – Eye Movements During Autobiographical Retrieval in Face-to-Face Interactions

Hogrefe Publishing
Journal of Psychophysiology
Authors:

Abstract and Figures

There has been a surge in social cognition and social neurosciences research comparing laboratory and real eye movements. Eye movements during the retrieval of autobiographical memories (i.e., personal memories) in laboratory situations are also receiving more attention. We compared eye movements during the retrieval of autobiographical memories using a strict laboratory design versus a design mimicking social interactions. In the first design, eye movements were recorded during autobiographical memory retrieval while participants were looking at a blank screen; in the second design, participants wore eye-tracking glasses and communicated autobiographical memories to the experimenter. Compared with the “screen” design, the “glasses” design yielded more fixations (p < .05), shorter duration of fixations (p < .001), more saccades (p < .01), and longer duration of saccades (p < .001). These findings demonstrate how eye movements during autobiographical memory retrieval differ between strict laboratory design and face-to-face interactions.
This content is subject to copyright. Terms and conditions apply.
Autobiographical memory 1
Short title: autobiographical memory
“Look at me”:
eye movements during autobiographical retrieval in face-to-face interactions
Quentin LENOBLE 1, 2
Mohamad EL HAJ 3, 4, 5
1 Univ. Lille, CNRS, CHU Lille, UMR 9193 - SCALab - Sciences Cognitives et
Sciences Affectives, F-59000 Lille, France
2 Univ. Lille, Inserm, CHU Lille, U1172 - LilNCog - Lille Neuroscience & Cognition, F-
59000 Lille, France
3 Nantes Université, Univ Angers, Laboratoire de Psychologie des Pays de la Loire (LPPL -
EA 4638), F-44000 Nantes, France
4 Unité de Gériatrie, Centre Hospitalier de Tourcoing, Tourcoing, France
5 Institut Universitaire de France, Paris, France
Correspondence concerning this manuscript should be addressed to :
Mohamad EL HAJ
Faculté de Psychologie, LPPL Laboratoire de Psychologie des Pays de la Loire, Université
de Nantes, Chemin de la Censive du Tertre, BP 81227, 44312 Nantes Cedex 3, France. E-
Mail: mohamad.elhaj@univ-nantes.fr
Autobiographical memory 2
There has been a surge in social cognition and social neurosciences research comparing
laboratory and real eye movements. Eye movements during retrieval of autobiographical
memories (i.e., personal memories) in laboratory situations is also receiving more attention.
We compared eye movements during retrieval of autobiographical memories using a strict
laboratory design vs. a design mimicking social interactions. In the first design, eye movement
were recorded during autobiographical memory retrieval while participants were looking at a
blank screen; in the second design, participants wore eye-tracking glasses and communicated
autobiographical memories to the experimenter. Compared with the “screen” design, the
“glasses” design yielded more fixations (p < .05), shorter duration of fixations (p < .001), more
saccades (p < .01), and longer duration of saccades (p < .001). These findings demonstrate how
eye movements during autobiographical memory retrieval differ between strict laboratory
design and face-to-face interactions.
Keywords: autobiographical memory; eye movements; fixations; saccades
Autobiographical memory 3
Autobiographical memory refers to the recollection of past personal experiences
(Conway, 2005; Rubin, 2005). At the physiological and behavioral level, autobiographical
memory has been associated with particular neural substrates (Bauer, Pathman, Inman,
Campanella, & Hamann, 2017; St Jacques, Carpenter, Szpunar, & Schacter, 2017; Svoboda,
McKinnon, & Levine, 2006), particular cardiovascular and electrodermal activities (Labouvie-
Vief, Lumley, Jain, & Heinze, 2003; Robertson, Swickert, Connelly, & Galizio, 2015; Schaefer
& Philippot, 2005), and particular activities in facial expressions (El Haj, Antoine, & Nandrino,
2016, 2017; El Haj, Daoudi, Gallouj, Moustafa, & Nandrino, 2018; Gandolphe et al., 2017).
Autobiographical memory has also been studied with respect to eye movements. This paper
extends these studies by assessing eye movements during autobiographical retrieval in
naturalistic vs. laboratory settings.
Eye movements during autobiographical memory retrieval was previously evaluated in
a study in which participants were invited to retrieve autobiographical memories, and, in a
control condition, to count aloud; an eye-tracker recorded the scan path of participants in both
conditions (El Haj et al., 2014). Analysis demonstrated a lower number of fixations but a higher
number, longer amplitude, and longer duration of saccades during autobiographical memory
retrieval than during counting. Eye movements activity, as observed during autobiographical
memory retrieval, was attributed to the attempt of the visual system to create and manipulate
mental representations of the retrieved memories (El Haj et al., 2014). A similar assumption
was made in a study comparing eye movements during retrieval of neutral autobiographical
memories and emotional autobiographical memories (El Haj, Nandrino, Antoine, Boucart, &
Lenoble, 2017). Participants were asked to remember emotional autobiographical memories
and neutral autobiographical memories while their scan path was recorded by an eye-tracker.
Analysis demonstrated that autobiographical emotional memories triggered more fixations and
saccades but shorter fixation duration than neutral autobiographical memories. Another study
Autobiographical memory 4
compared eye movements during retrieval of autobiographical memories and during future
thinking (El Haj & Lenoble, 2017). Participants were invited to retrieve autobiographical
memories and to imagine future scenarios while their scan path was recorded by an eye-tracker.
Autobiographical memory retrieval and future thinking were accompanied by similar durations
of fixations and saccades, as well as by similar amplitudes of saccades. The fixations and
saccades during autobiographical memory retrieval were attributed to attempts by the visual
system to find (through saccades) and activate (through fixations) stored memory
representations.
While the previous literature has highlighted how autobiographical memory retrieval
activates eye movements, its experimental design does not allow firm conclusions about eye
movements to be made, as it may occur during autobiographical memory retrieval in everyday
interactions. Until now (El Haj, Boutoleau-Bretonnière, & Janssen, 2020; El Haj et al., 2014;
El Haj & Lenoble, 2017; El Haj, Nandrino, et al., 2017; Lenoble, Janssen, & El Haj, 2018),
participants had to retrieve autobiographical memories while looking at a blank screen/wall
under which the eye-tracker was positioned. While this design is useful to record eye
movements in a restricted visual field (i.e., the screen), it does not accurately reflect
autobiographical memory retrieval in everyday interactions. Autobiographical memory is
typically retrieved to share and communicate our personal experiences with others in social
interactions. (Bartoli & Smorti, 2018; Bluck, Alea, Habermas, & Rubin, 2005; Fivush,
Habermas, Waters, & Zaman, 2011; Mahr & Csibra, 2017; Nelson & Fivush, 2004). It therefore
follows that eye movements during autobiographical memory retrieval may be better
understood with an experimental design mimicking these face-to-face interactions.
Thanks to recent advances in eye movements technology, it is now possible to record
gaze in face-to-face interactions; eye-tracking glasses can be used to track and record gaze in
these interactions. The face-to-face approach, as implemented in our study, can be compared
Autobiographical memory 5
with the research in social cognition and social neurosciences comparing eye movements in
laboratory vs. everyday interactions. For instance, Laidlaw, Foulsham, Kuhn, and Kingstone
(2011) compared participants’ tendency to look at other people in a video and in live conditions.
Participants wearing a head-mounted eye-tracker were instructed to wait in a room. For half of
the participants, there was a person sitting in the room and for the other half there was a
videotape of the same person. The study therefore compared gaze in the room where the
potential for social interaction existed or not. Results demonstrated that participants looked at
the person, as depicted in the videotape, for a longer duration than when the person was present.
Eye movements in social interactions was also evaluated by Wu, Bischof, and Kingstone
(2014) who evaluated how participants gazed to provide information to other people while
eating. Participants tended to 1) look away when a person began to bite 2) look down at their
food just before taking a bite, and 3) look down when a person looked down, signaling that a
bite was forthcoming. These findings demonstrate how eye movement can be influenced by
social norms (e.g., looking away when people eat). Building on these findings, we implemented
in this study an experimental design in which eye movements was recorded while participants
shared autobiographical memories with the experimenter. In our view, this face-to-face design
may yield better understanding of eye movements as triggered by autobiographical retrieval in
social interactions.
To summarize, eye movements during autobiographical retrieval may be better
understood by using experimental designs in which social interactions are mimicked. We
therefore compared 1) data from our previous study (El Haj & Lenoble, 2017) in which eye
movements was recorded during autobiographical memory retrieval while participants were
looking at a blank screen (i.e., screen design) vs. 2) data recollected in the present study in
which participants wore eye-tracking glasses and communicated autobiographical memories to
the experimenter (i.e., glasses design). We expected significant differences in eye movement
Autobiographical memory 6
between the “screen” and “glasses” design. More specifically, we expected more fixations and
saccades in the “glasses” that in the “screen” design, probably because participants would have
a richer environment to explore in the “glasses” than in the “screen” condition. Our hypothesis
aimed to throw light on the following issue: are eye movements different when triggered by
autobiographical memory retrieval in a strict laboratory design and in a design mimicking
social interactions?
Method
Participants
The study included 35 graduate/undergraduate students at the University of Lille. The
study aimed at comparing 1) data from our previous study (El Haj & Lenoble, 2017) in which
we recorded the eye movements of 18 participants (10 females, M age = 23.89 years, SD =
6.62, M education = 14.72 years, SD = 5.13) during autobiographical memory while they were
looking at a blank screen (“screen condition”), and 2) data collected in the present study in
which 17 participants (10 females, M age = 24.09 years, SD = 6.11, M education = 14.92 years,
SD = 4.87) wore eye-tracking glasses and communicated autobiographical memories to the
experimenter (“glasses condition”). All participants were native French speakers. Exclusion
criteria were a history of psychiatric or neurological disorders. Informed consent was obtained
in accordance with the principles laid down by the Helsinki Declaration. The participants
recruited for the present study were matched with those from our previous study according to
sex ratio [χ2(1, N = 35) = .21, p > .10], age [t(33) = .14, p > .10], and educational level [t(33) =
.15, p > .10]. The two groups were also matched according to verbal episodic memory as
evaluated by the test of Grober and Buschke (1987). In this test, participants try to retain 16
words, each describing an item belonging to a different semantic category. After a 20-second
distraction phase, they recall as many words as possible, the maximum score being 16 points.
Autobiographical memory 7
The mean score of the participants in the “screen” and “glasses” conditions was 13.03 (SD =
2.31) and 13.50 (SD = 3.31) [t(33) = .23, p > .10], respectively. We matched the two groups
regarding verbal memory to ensure that any differences in eye movement between the “screen”
and “glasses” would not be influenced by differences in memory encoding/retrieval.
Procedures and materials
As early emphasized, procedures consisted of two conditions: a “screen” condition and
a “glasses” condition. Although procedures of the “screen” condition are detailed in our
previous study (El Haj & Lenoble, 2017), we provide here a concise summary. Participants
were seated in front of a 21-inch flat blank-displayed screen, under which an eye-tracker was
positioned. The eye-tracker was a remote pupil-tracking system that uses infrared illumination
(RED-m, Senso-Motoric Instruments) with a gaze position accuracy of < 0.1°. Participants
were free to explore all parts of the screen and were asked not to look outside its borders, their
gaze location being recorded throughout. Prior to each autobiographical retrieval, calibration
was checked by displaying five successive test positions (center, top-left, top-right, bottom-
left, bottom-right).
In the “glasses” condition, participants wore SMI (Senso-Motoric Instruments,
Germany) eye-tracking glasses. These glasses are binocular, thereby allowing pupil dilation to
be recorded by two infrared cameras (one for each eye) integrated in the inner eyeglass frame.
The pupils are tracked by infrared illumination (RED-m, Senso-Motoric Instruments) with a
gaze position accuracy of < 0.1°. We performed a 1-point calibration for each subject.
Participants were seated in front of the experimenter, there was a white wall behind the
experimenter, and the distance between the subjects and experimenter was approximately 30
to 40 cm. As mentioned above, this face-to-face design mimicked remembering in everyday
life, since autobiographical memory mainly serves to communicate and share personal
Autobiographical memory 8
experiences (Fivush et al., 2011; Mahr & Csibra, 2017; Nelson & Fivush, 2004; Westerhof,
Bohlmeijer, & Webster, 2010).
The lightness of the room (60-watt fluorescent lamp) was the same in both conditions
to ensure that differences in eye movements were not caused by differences in retinal
illumination. We used BeGaze software (Senso-Motoric Instruments) to analyze the data. In
both conditions, participants were tested individually and were informed that the experiment
was concerned with memory, in order not to influence their performance. They were not
provided with any further details about the relationship between autobiographical memory and
eye movements.
In both conditions, participants were invited to verbally generate one autobiographical
memory. They were asked to remember a personal event in detail. The event had to be
experienced personally in the past, and the description had to be precise and specific (e.g.,
when and where the event occurred, what they were doing during it, who was present, what
their feelings were, etc.). Two minutes was allocated to generate each autobiographical
memory, and the duration was made clear so that the participants could structure their
memories accordingly.
Variables
We calculated the number of fixations, fixation duration, number of saccades, saccade
duration, and total amplitude. Fixation and saccade counts were expressed as the number of
fixation or saccades per minute. We applied a ratio, because the retrieval of some participants
ended before the two-minute interval was over. Average fixation and saccade durations were
expressed as the mean duration of fixation/saccades in milliseconds. Total amplitude size was
expressed as the total angle covered by the saccades. Blinks were identified by the typical loss
of corneal reflection and were automatically excluded from the data. Gazes were also excluded
when the horizontal deviation of gaze exceeded 2° (5% of our dataset). Besides eye movements
Autobiographical memory 9
variables, we measured the total duration of recording in order to determine whether the two
conditions had triggered a similar reconstruction time.
Results
We compared the characteristics of eye movements between both conditions. Because
data were not distributed normally as observed by Kolmogorov-Smirnov tests, the non-
parametric Mann-Whitney U test for between-subject designs was used to compare the results.
When reporting significant values, we provided effect sizes by using Cohen’s d (Cohen, 1992):
0.20 = small, 0.50 = medium, 0.80 = large. Cohen’s d was calculated for non-parametric tests
according to the recommendations of Rosenthal and DiMatteo (2001) and Ellis (2010).
Eye movements.
Eye movements data is summarized in Table 1. Compared with the “screen” condition,
the “glasses” condition triggered more fixations (Z = -1.96, p < .05, Cohen’s d = .70), shorter
duration of fixations (Z = -3.89, p < .001, Cohen’s d = 1.80), more saccades (Z = -2.66, p <
.01, Cohen’s d = .89), and longer duration of saccades (Z = -4.98, p < .001, Cohen’s d = 3.16).
However, amplitude of saccades (Z = -1.55, p = .12, Cohen’s d = .52) and duration of recording
(Z = -.22, p > .1, Cohen’s d = .07) were similar in both conditions.
[INSERT TABLE 1 APPROXIMATELY HERE]
Discussion
We investigated eye movements during autobiographical memory retrieval as it may
occur in everyday interactions. Eye movements were compared in two conditions: when
participants retrieved autobiographical memories while looking at screen under which eye-
tracker was positioned vs. when they wore eye-tracking glasses and communicated
autobiographical memories to the experimenter. The “glasses” condition triggered more
fixations, shorter duration of fixations, more saccades, and longer duration of saccades.
However, amplitude of saccades was similar in both conditions.
Autobiographical memory 10
The main finding of this paper was the significant differences in eye movements, except
for the amplitude of saccades, between both conditions. More fixations and saccades were
observed in the “glasses” condition. In other words, during autobiographical memory retrieval,
participants explored the environment more when wearing eye-tracking glasses than when
looking at the screen. This might be because they had a richer environment to explore in the
“glasses” condition. When wearing the glasses, they were exposed to more stimuli (e.g., the
experimenter), so this triggered more visual exploration than when looking at the screen. The
higher number saccades in the “glasses” condition can also be attributed to a potential shift in
gaze from the experimenter to the environment, perhaps due to the need to look at nothing
when retrieving memories. According to Ferreira, Apel, and Henderson (2008), looking at
nothing is important for the visual system to find and activate stored memory representations.
In this view, fixations reflect the attempt to activate memories. This shift can also be attributed
to the emotional weight of memories, participants preferring to look away when retrieving
emotional material. However, this is only hypothetical as we did not ask them to retrieve
emotional memories.
Participants also demonstrated shorter fixations but longer saccades when wearing the
glasses. These findings mirror previous research in which participants looked at the person in
a video for longer than when the person was present (Laidlaw et al., 2011). In normal social
interactions, staring at others may be interpreted as infringing specific moral and social codes
(e.g., staring at others may be interpreted as intimidatory). For example, Wu et al. (2014)
demonstrated how we tend to look away when a person begins to bite. They found that social
codes may shape eye movements in face-to-face interactions, so it is likely that these social
codes shaped eye movements when our participants told memories to the experimenter.
Therefore, these social codes might result in shorter fixation times, as observed in our
participants when wearing the glasses. Furthermore, in the “glasses” conditions, the relatively
Autobiographical memory 11
short duration of fixations was accompanied by longer saccades, so the participants spent more
time exploring the environment than staring at it. The opposite was observed in the “screen”
condition with longer saccades and shorter duration of staring. When wearing the glasses,
participants might have benefited from a richer environment to explore than when looking at
the blank screen, so they probably spent more time staring at it.
Because the “glasses” condition triggered longer saccades than the “screen” condition,
it was reasonable to expect that their amplitude would be longer with the glasses. In terms of
their spatiotemporal dynamics, saccades tend to be larger in conditions of unconstrained action
than in the laboratory (Hart et al., 2009). In our study, although the amplitude of saccades was
longer in the “glasses” than in the “screen” condition, the difference was not significant,
probably because the two conditions involved different subjects or even because of the
relatively small sample size. Despite this sample size, however, all other effects (e.g., number
of fixations and saccades) had a satisfactory effect size. Another aspect to be considered is the
potential effect of the glasses regarding the comfortability of participants with this
measurement tool, although this effect is probably small owing to the light design on the glasses
(e.g., their tiny weight = 22.75 gram).
Regardless of the potential limitations of this study, its findings pave the way for new
research into the effects of social interactions on eye movements during retrieval of
autobiographical memory. One avenue would be to assess mutual gaze during autobiographical
retrieval by utilizing two pairs of glasses to track the gaze of the transmitter and receiver of the
memory. This would build upon the work of Kendon (1967) who identified a general
asymmetry in the behavior of speakers and recipients; whereas recipients tend to maintain their
gaze on speakers, the latter tend to alternate their gaze toward and away from recipients as they
speak. Supporting this assumption, Ho, Foulsham, and Kingstone (2015) used eye-tracking
glasses and demonstrated that participants tended to begin a speaking turn with an averted gaze
Autobiographical memory 12
and ended the turn with a direct gaze toward the receiver. These findings could be investigated
by testing autobiographical retrieval in face-to-face interactions. Future research could also
assess mutual gaze for emotional memories as they may trigger more mutual gaze than neutral
ones. Such research would demonstrate how eye movements during autobiographical memory
retrieval is a two-way process in which each person signals as well as reads gaze information
during retrieval. This would be crucial to understanding the social function of autobiographical
memory.
To summarize, laboratory investigations of memory offer only a limited view of how
the real world functions. The present study sought to understand eye movements during
retrieval of autobiographical memory using a design mimicking face-to-face interactions.
Thanks to the use of eye-tracking glasses, we found that eye movements during retrieval of
autobiographical memory in face-to-face interactions differs from that observed in previous
research in which participants retrieved autobiographical memories while looking at a screen.
The differences in eye movements between the “glasses” and “screen” conditions may reflect
the freedom of immersed participants in the “glasses” condition to move their head and eyes
and the social constraints involved when telling memories to other people. By reporting these
differences and suggesting their potential causes, our paper provides an insight into the eye
movements triggered by the retrieval of autobiographical memory in social interactions. It also
paves the way for new research into eye movements, and more generally into non-verbal
communication, during autobiographical memory retrieval.
Autobiographical memory 13
References
Bartoli, E., & Smorti, A. (2018). Facing the Language-Memory Problem in the Study of
Autobiographical Memory. Integr Psychol Behav Sci. doi: 10.1007/s12124-018-9434-
x
Bauer, P. J., Pathman, T., Inman, C., Campanella, C., & Hamann, S. (2017). Neural correlates
of autobiographical memory retrieval in children and adults. Memory, 25(4), 450-466.
doi: 10.1080/09658211.2016.1186699
Bluck, S., Alea, N., Habermas, T., & Rubin, D. C. (2005). A tale of three functions: The Self
Reported Uses of Autobiographical Memory. Social Cognition, 23(1), 91-117. doi:
10.1521/soco.23.1.91.59198
Cohen, J. (1992). Statistical Power Analysis. Current Directions in Psychological Science,
1(3), 98-101. doi: 10.2307/20182143
Conway, M. A. (2005). Memory and the self. Journal of Memory and Language, 53(4), 594-
628.
El Haj, M., Antoine, P., & Nandrino, J. L. (2016). More emotional facial expressions during
episodic than during semantic autobiographical retrieval. Cognitive, affective &
behavioral neuroscience, 16(2), 374-381. doi: 10.3758/s13415-015-0397-9
El Haj, M., Antoine, P., & Nandrino, J. L. (2017). Facial expressions triggered by imagining
the future. J Integr Neurosci, 16(4), 483-492. doi: 10.3233/JIN-170030
El Haj, M., Boutoleau-Bretonnière, C., & Janssen, S. M. J. (2020). Eye movements of recent
and remote autobiographical memories: fewer and longer lasting fixations during the
retrieval of childhood memories. Psychological Research. doi: 10.1007/s00426-020-
01403-3
El Haj, M., Daoudi, M., Gallouj, K., Moustafa, A. A., & Nandrino, J.-L. (2018). When your
face describes your memories: facial expressions during retrieval of autobiographical
memories Reviews in the Neurosciences (Vol. 0).
El Haj, M., Delerue, C., Omigie, D., Antoine, P., Nandrino, J. L., & Boucart, M. (2014).
Autobiographical recall triggers visual exploration. Journal of Eye Movement
Research, 7(5), 1-7. doi: https://doi.org/10.16910/jemr.7.5.1
El Haj, M., & Lenoble, Q. (2017). Eying the future: Eye movement in past and future thinking.
Cortex. doi: 10.1016/j.cortex.2017.05.024
El Haj, M., Nandrino, J. L., Antoine, P., Boucart, M., & Lenoble, Q. (2017). Eye movement
during retrieval of emotional autobiographical memories. Acta Psychol (Amst), 174,
54-58. doi: 10.1016/j.actpsy.2017.02.002
Ellis, P. D. (2010). The Essential Guide to Effect Sizes: Statistical Power, Meta-Analysis, and
the Interpretation of Research Results. New York, NY: Cambridge University Press.
Ferreira, F., Apel, J., & Henderson, J. M. (2008). Taking a new look at looking at nothing.
Trends in cognitive sciences, 12(11), 405-410. doi: 10.1016/j.tics.2008.07.007
Fivush, R., Habermas, T., Waters, T. E., & Zaman, W. (2011). The making of autobiographical
memory: intersections of culture, narratives and identity. Int J Psychol, 46(5), 321-345.
doi: 10.1080/00207594.2011.596541
Gandolphe, M. C., Nandrino, J. L., Delelis, G., Ducro, C., Lavallee, A., Saloppe, X., . . . El
Haj, M. (2017). Positive facial expressions during retrieval of self-defining memories.
Journal of Integrative Neuroscience. doi: 10.3233/JIN-170073
Grober, E., & Buschke, H. (1987). Genuine memory deficits in dementia. Developmental
neuropsychology, 3(1), 13-36.
Hart, M. B., Vockeroth, J., Schumann, F., Bartl, K., Schneider, E., König, P., & Einhäuser, W.
(2009). Gaze allocation in natural stimuli: Comparing free exploration to head-fixed
Autobiographical memory 14
viewing conditions. Visual Cognition, 17(6-7), 1132-1158. doi:
10.1080/13506280902812304
Ho, S., Foulsham, T., & Kingstone, A. (2015). Speaking and Listening with the Eyes: Gaze
Signaling during Dyadic Interactions. PLOS ONE, 10(8), e0136905. doi:
10.1371/journal.pone.0136905
Kendon, A. (1967). Some functions of gaze-direction in social interaction. Acta Psychologica,
26, 22-63. doi: https://doi.org/10.1016/0001-6918(67)90005-4
Labouvie-Vief, G., Lumley, M. A., Jain, E., & Heinze, H. (2003). Age and gender differences
in cardiac reactivity and subjective emotion responses to emotional autobiographical
memories. Emotion, 3(2), 115-126. doi: 10.1037/1528-3542.3.2.115
Laidlaw, K. E. W., Foulsham, T., Kuhn, G., & Kingstone, A. (2011). Potential social
interactions are important to social attention. Proceedings of the National Academy of
Sciences, 108(14), 5548-5553. doi: 10.1073/pnas.1017022108
Lenoble, Q., Janssen, S. M. J., & El Haj, M. (2018). Don’t stare, unless you don’t want to
remember: Maintaining fixation compromises autobiographical memory retrieval.
Memory, 1-8. doi: 10.1080/09658211.2018.1501068
Mahr, J., & Csibra, G. (2017). Why do we remember? The communicative function of episodic
memory. Behav Brain Sci, 1-93. doi: 10.1017/S0140525X17000012
Nelson, K., & Fivush, R. (2004). The emergence of autobiographical memory: a social cultural
developmental theory. Psychol Rev, 111(2), 486-511. doi: 10.1037/0033-
295X.111.2.486
Robertson, S. M., Swickert, R. J., Connelly, K., & Galizio, A. (2015). Physiological reactivity
during autobiographical narratives in older adults: the roles of depression and anxiety.
Aging Ment Health, 19(8), 689-697. doi: 10.1080/13607863.2014.962010
Rosenthal, R., & DiMatteo, M. R. (2001). Meta-analysis: recent developments in quantitative
methods for literature reviews. Annu Rev Psychol, 52, 59-82. doi:
10.1146/annurev.psych.52.1.59
Rubin, D. C. (2005). A basic-systems approach to autobiographical memory. Current
Directions in Psychological Science, 14(2), 79-83.
Schaefer, A., & Philippot, P. (2005). Selective effects of emotion on the phenomenal
characteristics of autobiographical memories. Memory, 13(2), 148-160. doi:
10.1080/09658210344000648
St Jacques, P. L., Carpenter, A. C., Szpunar, K. K., & Schacter, D. L. (2017). Remembering
and imagining alternative versions of the personal past. Neuropsychologia. doi:
10.1016/j.neuropsychologia.2017.06.015
Svoboda, E., McKinnon, M. C., & Levine, B. (2006). The functional neuroanatomy of
autobiographical memory: a meta-analysis. Neuropsychologia, 44(12), 2189-2208. doi:
10.1016/j.neuropsychologia.2006.05.023
Westerhof, G. J., Bohlmeijer, E., & Webster, J. D. (2010). Reminiscence and mental health: a
review of recent progress in theory, research and interventions. Ageing & Society,
30(04), 697-721. doi: doi:10.1017/S0144686X09990328
Wu, D. W. L., Bischof, W. F., & Kingstone, A. (2014). Natural gaze signaling in a social
context. Evolution and Human Behavior, 35(3), 211-218. doi:
10.1016/j.evolhumbehav.2014.01.005
Autobiographical memory 15
Table 1. Characteristics of eye movements in both conditions
Screen
Glasses
Fixation count per min
98.44 (30.27)
153.76 (93.56)*
Fixation duration in ms
593.66 (312.83)
377.25 (158.68)***
Saccade count per min
95.22 (29.02)
160.24 (70.89)*
Saccade duration in ms
35.15 (13.93)
121.52 (38.55) ***
Total amplitude of saccades
1173.23 (938.65)
1549.75 (547.71) ns
Duration of recording in msec
85327.11 (29622.13)
88543.22 (32212.11) ns
Note. Standard deviations are given between brackets; maximum duration of recording was
120 000 msec; the difference with the following group was significant at: *p < .05, **p < .01; ns
the difference with the following group was not significant.
... Their results demonstrated more detailed and faster memories when retrieved in the free-gaze condition than when retrieved in the maintained fixation condition. These studies show how retrieval of autobiographical memory can activate fixations and saccades and how these eye movements may mirror the generation and manipulation of mental representations in the visual system [21]. Thus, eye movements as activated by autobiographical retrieval would reflect mental imagery operations underlying autobiographical information recollection. ...
... To summarize, while research has demonstrated how autobiographical memory can trigger visual exploration [17,18,20,21,30,31], this prior research has not investigated gender differences. Because gender differences have been observed for visual processing [22,24], we investigated gender differences in eye movement during autobiographical retrieval. ...
... Mental imagery refers to the ability to generate and manipulate mental images of the retrieved memories [43], and this ability is closely linked to the subjective experience of autobiographical memory: the more vivid the constructed image, the stronger the subjective experience [44,45]. Mental imagery is also closely associated with eye movement during autobiographical retrieval [16][17][18]21]. The role of visual imagery was shown by Lenoble, Janssen [20], who invited participants to remember autobiographical events while fixating on a cross in the center of a screen or while exploring the screen without constraints. ...
Article
Full-text available
While research has consistently demonstrated how autobiographical memory triggers visual exploration, prior studies did not investigate gender differences in this domain. We thus compared eye movement between women and men while performing an autobiographical retrieval task. We invited 35 women and 35 men to retrieve autobiographical memories while their gaze was monitored by an eye tracker. We further investigated gender differences in eye movement and autobiographical specificity, that is, the ability to retrieve detailed memories. The analysis demonstrated shorter fixations, larger duration and amplitude of saccades, and higher autobiographical specificity in women than in men. The significant gender differences in eye movement disappeared after controlling for autobiographical specificity. When retrieving autobiographical memory, female participants generated a large scan with short fixation and high saccade amplitude, while male participants increased their fixation duration and showed poorer gaze scan. The large saccades in women during autobiographical retrieval may constitute an exploratory gaze behavior enabling better autobiographical memory functioning, which is reflected by the larger number of autobiographical details retrieved compared to men.
... Internal attention has been associated with different types of eye movements, such as longer blink duration, higher blink frequency, or change in pupil diameter or eye vergence (e.g., Benedek et al., 2017;Walcher et al., 2017). Interestingly, a recent study has shown that eye movements related to internal attention can be modified when occurring during social interactions: facing the experimenter while retrieving memories generates shorter fixations along with longer saccades compared to facing a screen (Lenoble and El Haj, 2021). From a cognitive point of view, all the eye movements reported above participate in perceptual decoupling (Smallwood and Schooler, 2006)-the reduction of visual processing to optimize internal cognition. ...
Article
Full-text available
Gaze direction is a powerful social cue that indicates the direction of attention and can be used to decode others’ mental states. When an individual looks at an external object, inferring where their attention is focused from their gaze direction is easy. But when people are immersed in memories, their attention is oriented towards their inner world. Is there any specific gaze direction in this situation, and if so, which one? While trying to remember, a common behavior is gaze aversion, which has mostly been reported as an upward-directed gaze. Our primary aim was to evaluate whether gaze direction plays a role in the inference of the orientation of attention—i.e., external vs. internal—in particular, whether an upward direction is considered as an indicator of attention towards the internal world. Our secondary objective was to explore whether different gaze directions are consistently attributed to different types of internal mental states and, more specifically, memory states (autobiographical or semantic memory retrieval, or working memory). Gaze aversion is assumed to play a role in perceptual decoupling, which is supposed to support internal attention. We therefore also tested whether internal attention was associated with high gaze eccentricity because the mismatch between head and eye direction alters visual acuity. We conducted two large-sample (160–163 participants) online experiments. Participants were asked to choose which mental state—among different internal and external attentional states—they would attribute to faces with gazes oriented in different directions. Participants significantly associated internal attention with an upward-averted gaze across experiments, while external attention was mostly associated with a gaze remaining on the horizontal axis. This shows that gaze direction is robustly used by observers to infer others’ mental states. Unexpectedly, internal attentional states were not more associated with gaze eccentricity at high (30°) than low (10°) eccentricity and we found that autobiographical memory retrieval, but not the other memory states, was highly associated with 10° downward gaze. This reveals the possible existence of different types of gaze aversion for different types of memories and opens new perspectives.
Article
Full-text available
There is an increased interest in the study of eye movements during the retrieval of autobiographical memories. Following this trend, the aim of the current study was to evaluate eye movements during the retrieval of remote and recent autobiographical memories. We instructed 71 participants to retrieve memories of personal events from early childhood (6–10 years), late childhood/early adolescence (11–14 years), late adolescence (15–18 years), and the last month. During the retrieval of these memories, participants wore eye-tracking glasses. Analyses showed that early childhood memories triggered fewer fixations and fixations with longer durations than memories from the last month. However, no significant differences were observed for the number of saccades, saccade durations, or total amplitude of the saccades. The fewer and longer lasting fixations during the retrieval of early childhood memories can be attributed either to the visual system reconstructing remote memories from an observer perspective or to difficulties when reconstructing remote memories.
Article
Full-text available
This study has developed an original approach to the relationship between eye movements and autobiographical memory, by investigating how maintained fixation could influence the characteristics of retrieved memories. We invited participants to retrieve autobiographical memories in two conditions: while fixating a cross at the centre of a screen and while freely exploring the screen. Memories retrieved during the maintained fixation condition were less detailed and contained less visual imagery than those retrieved during the free-gaze condition. Memories retrieved during the maintained fixation condition were retrieved slower and took less time to describe than those retrieved during the free-gaze condition. As for the characteristics of eye movements, analysis showed fewer and longer fixations as well as fewer saccades in the maintained fixation than in the free-gaze condition. Maintaining fixation is likely to tax cognitive resources that are necessary for the reconstruction of autobiographical memory. Our findings demonstrate how maintained fixation may result in a more effortful construction of autobiographical memory and memories with lower spatiotemporal specificity and poorer mental images.
Article
Full-text available
This paper discusses the problem of the role of language in autobiographical memory, that is barely considered in studies on autobiographical memories and narratives. As a matter of fact, most of the current studies on autobiographical memory confounded memory and narrative together. The present paper focuses on two main issues. Firstly, it debates how narratives contribute to the construction of autobiographical memories through self-other communication. Secondly, it reflects on how language and communication should be manipulated in studies about autobiographical memory. This paper is made of three sections: the first section discusses the role of language, particularly in the form of narrative, as a social tool by which autobiographical memories can be organised in a life story; the second section examines previous methods of investigation used in the study of autobiographical memories; finally, the third section proposes different methodological alternatives to overcome the problems emerging from our analysis of literature.
Article
Full-text available
Thanks to the current advances in the software analysis of facial expressions, there is a burgeoning interest in understanding emotional facial expressions observed during the retrieval of autobiographical memories. This review describes the research on facial expressions during autobiographical retrieval showing distinct emotional facial expressions according to the characteristics of retrieved memoires. More specifically, this research demonstrates that the retrieval of emotional memories can trigger corresponding emotional facial expressions (e.g. positive memories may trigger positive facial expressions). Also, this study demonstrates the variations of facial expressions according to specificity, self-relevance, or past versus future direction of memory construction. Besides linking research on facial expressions during autobiographical retrieval to cognitive and affective characteristics of autobiographical memory in general, this review positions this research within the broader context research on the physiologic characteristics of autobiographical retrieval. We also provide several perspectives for clinical studies to investigate facial expressions in populations with deficits in autobiographical memory (e.g. whether autobiographical overgenerality in neurologic and psychiatric populations may trigger few emotional facial expressions). In sum, this review paper demonstrates how the evaluation of facial expressions during autobiographical retrieval may help understand the functioning and dysfunctioning of autobiographical memory.
Article
Full-text available
In this study, we investigated, for the first time, facial expressions during the retrieval of Self-defining memories (i.e., those vivid and emotionally intense memories of enduring concerns or unresolved conflicts). Participants self-rated the emotional valence of their Self-defining memories and autobiographical retrieval was analyzed with a facial analysis software. This software (Facereader) synthesizes the facial expression information (i.e., cheek, lips, muscles, eyebrow muscles) to describe and categorize facial expressions (i.e., neutral, happy, sad, surprised, angry, scared, and disgusted facial expressions). We found that participants showed more emotional than neutral facial expressions during the retrieval of Self-defining memories. We also found that participants showed more positive than negative facial expressions during the retrieval of Self-defining memories. Interestingly, participants attributed positive valence to the retrieved memories. These findings are the first to demonstrate the consistency between facial expressions and the emotional subjective experience of Self-defining memories. These findings provide valuable physiological information about the emotional experience of the past.
Article
Full-text available
A body of research has investigated the cognitive and affective features of imagining the future. Our study aimed at extending this research by evaluating expressions that are triggered by future thinking. Participants were asked to remember and to imagine personal events. Both past and future thinking were video-recorded and the recording was later analyzed by a software for facial analysis that detects and classifies basic emotional expressions (i.e., happy, sad, angry, surprised, scared, disgusted and neutral). The analysis showed more emotional and fewer neutral facial expressions during imagining the future than during remembering the past. These findings mirror a wealth of psychological research highlighting the emotional valence of future thinking, which has been mainly assessed in this research by subjective methodologies. Our work provides an empirical description of facial expressions that can be triggered by imagining the future.
Article
Full-text available
We investigated eye movement during past and future thinking. Participants were invited to retrieve past events and to imagine future events while their scan path was recorded by an eye-tracker. Past thinking triggered more fixation (p < .05), and saccade counts (p < .05) than future thinking. Past and future thinking triggered a similar duration of fixations and saccades, as well as a similar amplitude of saccades. Interestingly, participants rated past thinking as more vivid than future thinking (p < .01). Therefore, the vividness of past thinking seems to be accompanied by an increased number of fixations and saccades. Fixations and saccades in past thinking can be interpreted as an attempt by the visual system to find (through saccades) and activate (through fixations) stored memory representations. The same interpretation can be applied to future thinking as this ability requires activation of past experiences. However, future thinking triggers fewer fixations and saccades than past thinking: this may be due to its decreased demand on visual imagery, but could also be related to a potentially deleterious effect of eye movements on spatial imagery required for future thinking.
Article
Full-text available
This study assessed whether specific eye movement patterns are observed during emotional autobiographical retrieval. Participants were asked to retrieve positive, negative and neutral memories while their scan path was recorded by an eye-tracker. Results showed that positive and negative emotional memories triggered more fixations and saccades but shorter fixation duration than neutral memories. No significant differences were observed between emotional and neutral memories for duration and amplitude of saccades. Positive and negative retrieval triggered similar eye movement (i.e., similar number of fixations and saccades, fixation duration, duration of saccades, and amplitude of saccades). Interestingly, the participants reported higher visual imagery for emotional memories than for neutral memories. The findings demonstrate similarities and differences in eye movement during retrieval of neutral and emotional memories. Eye movement during autobiographical retrieval seems to be triggered by the creation of visual mental images as the latter are indexed by autobiographical reconstruction.
Article
Full-text available
Episodic memory has been analyzed in a number of different ways in both philosophy and psychology, and most controversy has centered on its self-referential, ‘autonoetic’ character. Here, we offer a comprehensive characterization of episodic memory in representational terms, and propose a novel functional account on this basis. We argue that episodic memory should be understood as a distinctive epistemic attitude taken towards an event simulation. On this view, episodic memory has a metarepresentational format and should not be equated with beliefs about the past. Instead, empirical findings suggest that the contents of human episodic memory are often constructed in the service of the explicit justification of such beliefs. Existing accounts of episodic memory function that have focused on explaining its constructive character through its role in ‘future-oriented mental time travel’ neither do justice to its capacity to ground veridical beliefs about the past nor to its representational format. We provide an account of the metarepresentational structure of episodic memory in terms of its role in communicative interaction. The generative nature of recollection allows us to represent and communicate the reasons for why we hold certain beliefs about the past. In this process, autonoesis corresponds to the capacity to determine when and how to assert epistemic authority in making claims about the past. A domain where such claims are indispensable are human social engagements. Such engagements commonly require the justification of entitlements and obligations, which is often possible only by explicit reference to specific past events.
Article
Although autobiographical memory and episodic simulations recruit similar core brain regions, episodic simulations engage additional neural recruitment in the frontoparietal control network due to greater demands on constructive processes. However, previous functional neuroimaging studies showing differences in remembering and episodic simulation have focused on veridical retrieval of past experiences, and thus have not fully considered how retrieving the past in different ways from how it was originally experienced may also place similar demands on constructive processes. Here we examined how alternative versions of the past are constructed when adopting different egocentric perspectives during autobiographical memory retrieval compared to simulating hypothetical events from the personal past that could have occurred, or episodic counterfactual thinking. Participants were asked to generate titles for specific autobiographical memories from the last five years, and then, during functional magnetic resonance (fMRI) scanning, were asked to repeatedly retrieve autobiographical memories or imagine counterfactual events cued by the titles. We used an fMRI adaptation paradigm in order to isolate neural regions that were sensitive to adopting alternative egocentric perspectives and counterfactual simulations of the personal past. The fMRI results revealed that voxels within left posterior inferior parietal and ventrolateral frontal cortices were sensitive to novel visual perspectives and counterfactual simulations. Our findings suggest that the neural regions supporting remembering become more similar to those underlying episodic simulation when we adopt alternative egocentric perspectives of the veridical past.