ArticlePDF Available

The role of bodily self-consciousness in episodic memory of naturalistic events: an immersive virtual reality study

Springer Nature
Scientific Reports
Authors:

Abstract and Figures

Recent studies suggest that the human body plays a critical role in episodic memory. Still, the precise relationship between bodily self-consciousness (BSC) and memory formation of specific events, especially in real-life contexts, remains a topic of ongoing research. The present study investigated the relationship between BSC and episodic memory (EM) using immersive virtual reality (VR) technology. Participants were immersed in an urban environment with naturalistic events, while their visuomotor feedback was manipulated in three within-subjects conditions: Synchronous, Asynchronous, and Nobody. Our results show that asynchronous visuomotor feedback and not seeing one's body, compared to synchronous feedback, decrease the sense of self-identification, self-location and agency, and sense of presence. Moreover, navigating in the Asynchronous condition had a detrimental impact on incidental event memory, perceptual details, contextual association, subjective sense of remembering, and memory consolidation. In contrast, participants in the NoBody condition were only impaired in egocentric spatial memory and the sense of remembering at ten-day delay. We discuss these findings in relation to the role of bodily self-representation in space during event memory encoding. This study sheds light on the complex interplay between BSC, sense of presence, and episodic memory processes, and strengthens the potential of embodiment and VR technology in studying and enhancing human cognition.
This content is subject to copyright. Terms and conditions apply.
1
Vol.:(0123456789)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports
The role of bodily
self‑consciousness in episodic
memory of naturalistic events:
an immersive virtual reality study
Sylvain Penaud
*, Delphine Yeh , Alexandre Gaston‑Bellegarde & Pascale Piolino
*
Recent studies suggest that the human body plays a critical role in episodic memory. Still, the precise
relationship between bodily self‑consciousness (BSC) and memory formation of specic events,
especially in real‑life contexts, remains a topic of ongoing research. The present study investigated the
relationship between BSC and episodic memory (EM) using immersive virtual reality (VR) technology.
Participants were immersed in an urban environment with naturalistic events, while their visuomotor
feedback was manipulated in three within‑subjects conditions: Synchronous, Asynchronous, and
No‑body. Our results show that asynchronous visuomotor feedback and not seeing one’s body,
compared to synchronous feedback, decrease the sense of self‑identication, self‑location and
agency, and sense of presence. Moreover, navigating in the Asynchronous condition had a detrimental
impact on incidental event memory, perceptual details, contextual association, subjective sense
of remembering, and memory consolidation. In contrast, participants in the No‑Body condition
were only impaired in egocentric spatial memory and the sense of remembering at ten‑day delay.
We discuss these ndings in relation to the role of bodily self‑representation in space during event
memory encoding. This study sheds light on the complex interplay between BSC, sense of presence,
and episodic memory processes, and strengthens the potential of embodiment and VR technology in
studying and enhancing human cognition.
Like every workday, you are sitting in a cafe enjoying your coee when suddenly the memory of a brief con-
versation that took place in the same cafe comes to mind. In addition to recalling objective details about the
conversation, yourself, and the other people involved, as well as contextual information about the specic place
and time the event occurred, this meaningful representation also includes subjective vivid perceptual details,
emotional states, and thoughts, all bound together in a rich multidimensional reexperience14. Hence, your
memory comes with a sense of self. Indeed, when we remember a personal event from our past, we not only
undergo the experience of being the protagonist of a conscious episode but also of being the subject in the
memory5. According to Tulving, this subjective experience linked to the memory of everyday eventsthat occurred
at particular times and places is a hallmark of episodic memory (EM), which is closely related to what researchers
refer to as episodic autobiographical memory6. It is supported by autonoetic consciousness (i.e., the ability to
remember previous events as a sense of self-recollection), a specic form of self-consciousness that allows one
to mentally travel in time and reexperience specic events from one’s past. Moreover, autonoetic consciousness
distinguishes EM from semantic memory, which is supported by noetic consciousness (i.e., the ability to know
facts without recollection)7.
e central role of the self in EM retrieval raises questions about the inuence of self-consciousness during
the process of initial encoding8,9. Numerous studies have explored the importance of cognitive self-referencing
in the process of encoding and retrieving episodic memories, which is commonly referred to as the self-refer-
ence eect10,11. Over the years, self-reference has been shown to enhance the recall of objective and subjective
information12, and to promote associative memory (i.e., feature binding)13. However, other dimensions of self-
hood have been overlooked. Indeed, it has been emphasized that experiences assume an “I” who is the subject of
the ongoing ow of events14,15. is minimal sense of self is characterized by the pre-reective feeling of being a
self in a body, dissociated from its environment and providing a sense of presence in the world16,17. Over recent
OPEN
Université Paris Cité, Laboratoire Mémoire, Cerveau & Cognition (LMC2 UR 7536), Institut de Psychologie, 71 Ave
Édouard Vaillant, 92100 Boulogne-Billancourt, France. *email: sylvain.penaud@u-paris.fr; pascale.piolino@u-paris.
fr
Content courtesy of Springer Nature, terms of use apply. Rights reserved
2
Vol:.(1234567890)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
decades, convergent ndings from psychology and neuroscience have demonstrated that this minimal sense of
self is exible, plastic, and depends upon multi-sensory integration processes that combine bodily signals1820.
Research has consistently demonstrated that simultaneous visual and tactile or motor stimulation that is both
spatially and temporally congruent can trigger body illusions dened as an incorporation of an extra-corporeal
body part or even an entire body into the sense of bodily-self21,22. Central features of body self-consciousness
(BSC) encompass the sense of identication with one’s own body (i.e., self-identication), the sense of being
located in space and time (i.e., self-location), the feeling of having control over one’s own body (i.e., agency) and
the centeredness of experience around the body (i.e., rst-person perspective)23.
Proponents of the embodied approach of EM argue that bodily and sensorimotor information is integrated
into the memory trace and later reactivated to support memory retrieval2426. Several recent theoretical frame-
works on memory and the self have also stressed the inuence of bodily processes and BSC on autonoetic con-
sciousness and mental time travel2732. For example, Prebble, Addis and Tippett argued that episodic recollection
“requires the sensory-perceptual and internal aspects of the original experience to be encoded from a subjective,
egocentric perspective”27. us, according to these authors, BSC is a necessary precursor of higher order and
extended forms of selood. In addition, a growing amount of clinical evidence indicates that compromised
BSC is associated with impairments in EM, as observed in individuals with schizophrenia or depersonalization
disorders27,33.
Noteworthy, the rapid growth and broad accessibility of computer-based 3D technologies have enabled
researchers to make signicant progress in understanding memory and the self. Devices such as Virtual Reality
(VR) provide many advantages for evaluating EM34,35. VR is a computer-generated immersive technology that
enables users to interact with a simulated world in a three-dimensional space, providing a sense of presence or
“being there”36,37. It allows researchers to create self-involving experiences and simulate expansive and ecologi-
cally valid environments that better capture how cognition operates in real-world settings over various popula-
tions, including children, young adults, and healthy and pathological aging3842. Moreover, VR allows for the
presentation of complex stimuli such as 3D objects and everyday-like scenes that provide the opportunity for
evaluating the multidimensional and associative nature of EM in naturalistic settings while maintaining a high
degree of experimental control43. Accordingly, it has been shown that assessments of EM using VR were more
reliably associated with daily memory complaints in healthy aging and pathological populations and were more
sensitive to memory impairments than standard neuropsychological tools. Furthermore, knowledge acquired
in VR is more easily transferable to the real world44. VR has also established itself as an embodied technology,
allowing us to assess the inuence of the body on cognition45. For example, the enactment eect—the nding that
actively navigating in a virtual environment enhances EM compared to passively observing—generally improves
factual, contextual, and associative memory and the sense of remembering46,47. In more recent times, scientic
research has used the aordances of VR technology to manipulate the synchrony of bodily signals, producing
a complete bodily illusion over a virtual avatar perceived from a rst-person perspective (1PP). is form of
bodily illusion has been employed to investigate the role of body self-consciousness in EM4853 (see Table1).
For example, Bréchet and colleagues used a head-mounted display to immerse participants in a sequence
of virtual rooms in which a collection of everyday-life objects were organized. During the encoding phase of
the experiment, participants were instructed to explore each room freely. Half of the subjects experienced the
integration of their physical body in the virtual environment from a rst-person perspective, while the other half
did not have any visible body representation. en, participants were immersed again in the same rooms for a
retrieval session in which they underwent a surprise forced-choice recognition task immediately or one hour
aer the encoding session. e results indicated that participants recalled fewer objects when the participants
physical bodies were not visible during encoding, but only with a 1-h delay49. Additionally, in a subsequent
neuroimaging investigation, the same group demonstrated that observing ones own body during the process
of encoding was linked to a higher connectivity between the brain regions associated with BSC and EM51. e
authors conclude that the multisensory stimulations associated with the perception of one’s body in 1PP are
essential for memory encoding.
More recently, Tacikowski etal. (2020)52 asked pairs of friends to complete a personality-trait judgment task
serving as an incidental encoding. e HMD device was connected to two sets of cameras so that participants
could see either their own or the friend’s body in a supine position from a rst-person perspective. Depending
on the experimental condition, the seen body was stroked with a wooden stick either synchronously or asyn-
chronously to manipulate sense of body ownership. Next, participants were asked to complete a body-ownership
questionnaire and underwent an unattended recognition task. eir results showed that participants who received
Table 1. Summary of the methodology and main ndings of previous studies. Synch, synchronous;
Asynch, asynchronous; V-T, visuo-tactile.
Studies Stimuli Encoding Method Main ndings
Tuena etal.48 Virtual scenes Incidental High vs. Medium vs. Low embodiment High > Medium and Low embodiment for source and hit rate (immediate)
Bréchet etal.49,50 3D objects Incidental Body vs. No-Body Body > No-body in a delayed recognition task
Gauthier etal.51 3D objects Incidental Body vs. No-Body Body = No-body in a recognition task (immediate and delayed)
Tacikowski etal.52 Trait-adjectives Incidental Synch vs
Asynch V-T stimulation Synch > Asynch in a recognition task (immediate)
Iriye and Ehrsson53 Videoscenes Intentional Synch vs
Asynch V-T stimulation Synch > Asynch for details, reliving (immediate), vividness, emotional intensity,
and condence (one week delay)
Content courtesy of Springer Nature, terms of use apply. Rights reserved
3
Vol.:(0123456789)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
synchronous stroking during the incidental learning phase performed better in the recognition task. Moreover,
changes in memory performances during the recognition task were positively correlated with rating changes in
body ownership between the synchronous and asynchronous conditions52.
Lastly, Iriye and Ehrsson53 presented a series of videos using a head-mounted display that depicted realistic
everyday life scenarios. Each scenario consisted of a stereoscopic view of a mannequins body seen from a supine
position and aligned with the participant’s actual body. During the scenarios, participants observed a wooden
stick repeatedly stroking the mannequin at a regular pace, either synchronously or asynchronously. Subsequently,
participants were administered a cued recall test immediately and aer one week to assess memory accuracy
for both central and peripheral details. Participants also rated their memories on seven-point Likert scales for
reliving, emotional intensity, vividness, and condence in memory accuracy. e authors found that synchronous
stroking improved memory accuracy regardless of the time delay between the encoding and retrieval of informa-
tion. Additionally, analysis of subjective measures indicated that participants remembered the encoded event
with a stronger sense of reliving immediately aer the encoding session and with higher emotional intensity and
condence aer a one-week delay. Taken together, these ndings demonstrate that the sense of owning a virtual
body observed from a rst-person perspective during encoding has an impact on the encoding of both objective
and subjective elements of EM. Nevertheless, various issues remain to be addressed.
First, the studies mentioned above mostly used simple stimuli such as words or 3D objects or intentional
encoding instructions that do not account for EM complexity and multidimensionality in everyday life, thereby
deviating from its functioning in real-world situations. To date, only one study has used full embodiment and
incidental encoding of virtual scenes48. is study from our team compared the impact of high, medium, and low
levels of embodiment on source memory and hit rate. e results indicated that participants in the high embodi-
ment condition trended towards superior performance compared to those in the medium and low embodiment
conditions. However, the sense of embodiment was not measured in all conditions, which makes it challenging
to link memory performance to bodily self-consciousness. Additionally, the study’s sample size was small, and
the materials used (Kinect) did not allow for perfect real-time tracking of bodily movements. Second, the stud-
ies above used simplistic encoding material, whichdoes not enable the complete examination of the associative
component of EM54,55. e integration of spatial and temporal information encoding, along with associative
mechanisms that bind items and contextual information, is at the core of EM56. Interestingly, recent studies
have shown that BSC may inuence both spatial57 and temporal processing58, as well as their association in the
hippocampus59. erefore, assessing contextual information is crucial to understand better how BSC aects
EM. ird, the studies mentioned above focused exclusively on the impact of body ownership. However, other
studies on BSC and EM have demonstrated that spatial, including sense of self-location59 and perspective9, and
agentive components of BSC may also play a role in EM encoding. Moreover, changes in self-location may occur
even when participants are embodied in rst-person60. Hence, a comprehensive evaluation that encompasses
all aspects of somatic self-awareness is crucial for gaining a better comprehension of its function in EM and its
distinct constituents. Lastly, the literature reported mixed ndings regarding the eect of delay and used dierent
types of memory tests and experimental designs, which makes it dicult to compare them.
In this experiment, we sought to explore the role of BSC on EM in conditions close to its expression in daily
life, examining incidental memory of new events experienced in a naturalistic controlled environment. We were
especially interested in assessing complex EM traces by considering the objective and subjective components
(event details, contextual information, and sense of reexperiencing). We used HMD to embody participants in
a personalized avatar seen from a rst-person perspective and manipulated visuo-motor feedback to modulate
BSC. Visuomotor stimulation has been widely used to induce body-part and full-body illusions61,62. Like visuo-
tactile stimulation, visuomotor stimulation relies on the spatiotemporal congruence between the seen and the
felt movements. However, in contrast to visuo-tactile stimulation, visuomotor stimulation conveys a variety of
bodily signals that goes beyond the integration of mere visual and tactile information. It provides information
on how the relative position and orientation of the real and fake bodies change over time, allowing individuals to
track how the body moves in relation to the environment. Moreover, visuomotor signals bear signicant signals
for the self-other distinction and have been shown to produce stronger and more stable changes in BSC (for a
review, see Kilteni etal.63). Finally, visuomotor stimulation is more ecologically valid than visuo-tactile stimula-
tion, as it more closely resembles the way in which we typically experience the world.
us, using a within-subjects design, participants were immersed in a personalized avatar’s body, either
synchronized, desynchronized, or occluded from the participant’s view during their walk in the virtual environ-
ment. In light of the results mentioned above, we hypothesized rst that participants in the Asynchronous and
No-Body conditions would report lower self-identication, self-localization, agency, and sense of presence than
those in the Synchronous condition. Second, for the memory tests, we hypothesized that participants would
recall fewer events and less contextual information and report a weaker sense of remembering and associated
phenomenology in the Asynchronous and No-Body conditions compared to the Synchronous condition. Finally,
as our study is the rst to contrast Asynchronous and No-Body conditions directly, there is no clear evidence to
anticipate there would be any dierences between the two conditions for any of our measures. Similarly, we did
not have expectations regarding the interaction between BSC and recall’s delay.
Method
Participants
A total of 38 young adults (11 males; mean age: 22.11yo ± 4.77) were recruited for this experiment. Two partici-
pants were removed from the pool due to cybersickness issues, and two others as they did not attend the second
session. us, the nal number of participants was 34 (10 males; m: 22.11yo (4.75)). All participants had nor-
mal or corrected visual acuity, declared no history of neurological and psychopathological disorders, and were
Content courtesy of Springer Nature, terms of use apply. Rights reserved
4
Vol:.(1234567890)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
blind to the purpose of the experiment. Participants were recruited from the University of Paris-Cité and from
the Relais d’Information sur les Sciences de la Cognition (RISC). All participants signed informed consent and
received course credits or a 20€ voucher in exchange for their participation. All the experimental procedures
and methods were approved by the Ethical Research Committee of Paris-Cité University (N° IRB: 0012021-107)
and have been conducted in accordance with the Declaration of Helsinki.
Material
e virtual environment was built in our lab using Unity 2019.2.5f1 soware. e environment was designed to
immerse participants in a close-to-daily-life urban landscape with rich ambient sounds, animations, and scenes
displayed on an HTC Vive Pro headset equipped with headphones (stereoscopic). We further circumscribed three
paths of approximately equal length (~ 5min) at dierent locations in the virtual environment (Fig.1a). A bright
white line was visible on the ground to delineate all paths and indicate the route to follow. Each path included
12 short audiovisual animated scenes representing everyday-life events for a total of 36 scenes (Fig.1b–d). e
scenes depicted characters, animals, or objects engaged in daily-life situations (e.g., a street musician playing the
guitar, a trashcan on re, or a group of friends saying “Hello”) and were evenly distributed around the white line
so that as many events were on the le, right, or in front of the participants. Animations started when participants
entered a dened area around the events and were played only once. ree mirrors were also placed respectively at
one-third, halfway, and two-thirds along each path. e purpose of these mirrors was to maintain multi-sensory
stimulation as body illusion may decay over time64 (see Procedure below and Fig.2a). Virtual avatars were cre-
ated using Character Creator 3. Each avatar was personalized by means of a headshot sent by the participants a
few days before the experiment. is was meant to increase participants’ identication with virtual avatars. e
photo was matched (gender, age, skin color, haircut, hair color, and facial traits) on the avatar’s body using the
Character Creator 3 headshot functionality. Participants’ body movements were tracked in real-time by means of
ve HTC-Vive sensors installed on participants’ heads, hands, ankles, and waists, and two base stations installed
at the corners of the experimental room.
Figure1. Study paths and events—(a) Map of the three dierent paths used in the study (red, blue, and green;
the yellow path is for training). (b) Virtual event of a man playing the guitar. (c) Virtual event of a trashcan on
re. (d) Virtual event of a dog barking aggressively. (e) First-person view of the mirror. Participants are asked to
stop in front of each mirror and raise each of their limbs once. (f) First-person view of the cellphone. Images and
map were obtained in the MC2 Lab using UNITY v2019.2.5f1 soware.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
5
Vol.:(0123456789)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
Behavioral data acquisition
Free recalls were registered using audio recording soware for later scoring. e recognition tasks were imple-
mented using Neuropsydia soware65 and presented on a 15.6 laptop screen.
Procedure
e experiment comprised two sessions approximately ten days apart (m = 9.34; sd = 3.7; min = 4, max = 21)
(Fig.2).
Encoding session
Upon arrival, participants signed an informed consent form and were given the task instructions. Participants
were told that they would be immersed successively in three dierent parts of a city and that they should visit
each as if they were planning to live there (incidental encoding). ey were asked to pay careful attention to each
path and the events that might occur in it as we would question them on which district they preferred and why
at the end of the experiment. Next, participants were fully equipped with VR sensors, controllers, and headset.
Figure2. Experimental design—the experiment has a within-participant design. All sessions started with an
induction phase in front of a virtual mirror. In the No-Body condition, there was no reection of the participant
in the mirror (see induction phase). Next, participants were assigned to one of the paths in a counterbalanced
order. Aer each navigation, participants completed the body-illusion, presence, and cybersickness
questionnaires. is procedure was repeated for each experimental condition. Once all the navigation tasks
had been completed, participants were administered an unattended free recall and recognition task, both
immediately and 10days aer the encoding session. Figure and maps designed in the MC2 Lab using UNITY
v2019.2.5f1 soware.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
6
Vol:.(1234567890)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
Training
Before starting the experimental navigation, participants were rst immersed in a training environment to famil-
iarize them with the virtual city and the controls. e training session took place in a dedicated path similar to,
but not overlapping with, the path used in the experimental condition. e training comprised three events not
used for the experimental conditions and one mirror. Mirrors were marked with a ashing panel, and participants
were asked to stop in front of each mirror to raise each of their limbs once, rst looking at their reection in the
mirror, then looking directly at their limbs to actualize embodiment (Fig.1e). Moreover, a virtual cellphone was
added in the right hand of the virtual avatar during the training session and experimental navigations (Fig.1f).
Participants were told they could freely use the cellphone to take pictures in the environment by pressing a trig-
ger placed behind the right controller. e purpose of the cellphone was to encourage participants to use their
virtual bodies to maintain multi-sensory stimulation throughout the navigation.
Experimental session
Once the participants had completed the training, they were immersed in a virtual empty room equipped with
a large virtual mirror from a rst-person perspective. Each participant successively underwent each of three
experimental conditions in a counterbalanced order (see Induction phase and Fig.2). In the Synchronous Ava-
tar condition, the movements of the virtual avatar were visible and fully synchronized with the participant’s
head, arms, legs, and waist movement. In the Asynchronous Avatar condition, the virtual avatar was visible,
but a 650ms delay was introduced between the participant and the avatar’s movements. is delay was chosen
because a pilot study revealed that shorter asynchrony (i.e., 500ms) failed to dierentiate synchronous from
asynchronous ratings on the body-illusion questionnaire. Finally, in the No Avatar condition, the virtual avatar’s
body was not visible from the participant’s view. Importantly, in the Asynchronous condition, a 650-ms delay was
also introduced between the participant’s movements and the cellphone, as well as between the trigger push and
the camera’s click sound. In the No-Body condition, the cellphone was fully synchronized with the participant’s
movements; thus, it was visible at the location of the (not visible) participant’s avatar hand.
Induction phase
e induction phase was designed to induce the body illusion over the virtual avatar depending on the experi-
mental condition before experimental navigation started. To this end, participants were immersed in a room
equipped with a large mirror. e induction started with a calibration procedure to ensure the correct position-
ing of the avatar relative to the participant’s body. Next, participants were instructed to slowly raise each of their
arms and legs ve times in front of the mirror, once looking at their reection in the mirror and then looking
directly at the avatar’s body. For the No-Body condition, participants were asked to raise each of their limbs ve
times as if they were seeing them in the mirror and then as if they were seeing them directly. us, the induction
phase was identical in all conditions except for body visibility and synchrony.
Navigation
Aer completing the induction phase, participants were immersed in the assigned virtual path. Every naviga-
tion started with a new calibration. Aer each navigation, the participant completed three short questionnaires
assessing body illusion, sense of presence, and level of cybersickness.
Questionnaires
e body-illusion questionnaire included ve statements and was adapted from various existing questionnaires
to accommodate ratings on visible and invisible virtual bodies53,66 (see Table2). Q1 (“I felt I had control over
the body under the virtual reality headset/my head”), Q2 (“I felt that the body under the virtual reality headset/
my head was my body”), and Q3 (“I had the feeling that I was located in the same place as the body under the
virtual reality headset/my head”) assessed the sense of self-identication with the avatar, sense of agency, and
sense of self-location, respectively. C1 (“I had the feeling that I couldn’t feel my body anymore”), and C2 (“I felt
as if I had two bodies”) were control statements assessing compliance and suggestibility. Participants were asked
to rate each statement on a 7-point Likert scale (−3 = Strongly Disagree, 0 = Neutral, 3 = Strongly Agree). Sense
of presence was measured using a short version of the Igroup Presence Questionnaire (IPQ)67, and cybersickness
using the French version of the Simulator Sickness Questionnaire68.
Table 2. Body-illusion questionnaire—Q1, Q2, and Q3 assess self-identication, self-location, and sense of
agency respectively. C1 and C2 are control questions.
Body illusion questionnaire
Sometimes during navigation…
Q1 I felt I had control over the body under the virtual reality headset/my head (Agency)
Q2 I felt that the body under the virtual reality headset/my head was my body (Self-identication)
Q3 I had the feeling that I was located in the same place as the body under the virtual reality headset/my head (Self-location)
C1 I had the feeling that I couldn’t feel my body anymore (Control)
C2 I felt as if I had two bodies (Control)
Content courtesy of Springer Nature, terms of use apply. Rights reserved
7
Vol.:(0123456789)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
Retrieval session
Once all three navigations were completed, participants underwent an unattended free recall and recognition
test. e free recall test lasted 20min and was adapted from a Virtual Reality EM questionnaire previously
validated by our team9. Participants were asked to recall as many events as possible in the allotted time while
being recorded for later scoring. To assess contextual egocentric spatial and temporal information, participants
were further asked to indicate if the events took place on their right, on their le, or in front of them (egocentric
spatial situation) and had to roughly tell if the event happened at the beginning, in the middle, or at the end of a
given district (temporal situation). Finally, they were asked to provide as many specic details as possible about
each event. Details could be visual or auditive perceptual details, characters’ actions, or details pertaining to the
background of the scene.
For the recognition task, the 36 old events were presented in a random order mixed up with 18 new events for
a total of 54 trials. is ratio has been chosen because it accommodates better e new events were like the old
events regarding the types of content and complexity and could have been used interchangeably with the events
used in the navigations (e.g., A man playing football, two peoples laughing out loud in the street). e stimuli
were presented on the center of a white 15.6 laptop screen. Background information was removed from the
events to avoid contextual cues. For each event, participants had to indicate if it was seen before in one of the three
paths by clicking on the right mouse button. When the event was correctly recognized, participants were further
asked to indicate the source (condition of encoding) and their degree of remembering (i.e., reexperiencing) on a
continuous scale (0 = I don’t remember, I know; 100 = I fully remember)69, which is a more ne-grained measure
of remembering experienced events than the classic dichotomous Remember/Know paradigm7 used for simple
material such as words70. Finally, each event with a remember score > 50 was presented again in random order.
To assess egocentric spatial memory, the participants were asked to indicate if the event happened on their le,
right, or in front of them. For temporal memory, three events pertaining to the same path were presented on the
upper part of the screen and numbered randomly from 1 to 3. e participants had to choose the correct order
of appearance of the events among all six possible orders noted in the lower part of the screen (e.g., 2–3–1).
We only asked for contextual information on the correct recognized events to avoid participants deducing old
and new events based on the temporal order task: because all the events presented in a single trial were part of
the same path, participants could have deduced the old event based on this information. For source memory,
participants were asked to indicate whether the event pertained to the rst, second or third navigation. Lastly,
participants assessed each past event they had previously recognized and associated to a Remembering score
greater than 50 with respect to rst-person perspective, vividness, condence in memory, emotional intensity
and memory ownership using a series of Likert 0–100 scales.
Finally, the participants completed an unattended free recall and recognition test in the same way approxi-
mately ten days later.
Scoring
For the scoring of the free recall and the recognition tasks, all the measures were computed for each of three
conditions (Synchronous, Asynchronous and No-Body): one point was attributed for every correctly recognized
or recalled event (what), spatial egocentric (where), and temporal information (when). Specic details for each
event were scored up to a maximum of three points (one point per detail). is maximum was decided based
on a pilot study. Importantly, details had to be specic to the remembered event (e.g., reporting that characters
in a scene representing a meditating group were in a lotus position was not considered specic as it is com-
mon to most meditating situations, whereas saying that one character was wearing a white and green shirt was
considered specic). Each score was then normalized by dividing it by the maximum attainable score and was
expressed as a percentage to account for individual performances. For example, the “What” score of a partici-
pant was determined by dividing the count of correctly retrieved events by the highest attainable score (i.e., 12).
In contrast, the scores for “Where,” “When, “Details” and “Source” were computed by dividing the number of
correct responses for each of these categories by the number of “What” responses for that particular condition.
For the recognition task, we further calculated a d-prime score by subtracting the Z score of the false-alarm rate
from the Z score of the hit rate to assess overall performance.
To assess the richness of contextual information, we calculated a total associative memory score that cor-
respond to the mean amount of information category per condition in the free recall task : 1 point was given for
each information category associated with What (i.e., where, when, and at least one specic detail) and summed
up for each event out of a maximum of 3 points. For example, a participant recalling an event with its spatial
egocentric location and in the correct temporal order would have an associative memory score of 2 points. If
the participant further recalled at least one specic detail, this raised the associative memory score to 3 points.
We then calculated the mean amount of information per condition and expressed this score as a proportion of
the maximum possible given the “What” responses.
Statistical analysis
We performed a mixed model analysis that included the within factors of Condition (Synch, Asynch, and No-
Body). We also examined the interaction between Condition and Delay (Immediate or Delayed) for the memory
tests by adding Delay as an additional within factor. Mixed models are well suited for repeated measure designs
as they enable dependencies in the data to be considered. Models were computed using the lmer function from
the lme4 package in R studio version 4.0.4. When data residuals were not normally distributed (as assessed by a
Shapiro–Wilk test), we used a robust version of the lmer function named rlmer using the robustlmm package71.
Estimates, condence intervals, and p-values for xed eects estimates were computed using a Wald t-distri-
bution approximation using the parameters function of the performance package72. Marginal and conditional
Content courtesy of Springer Nature, terms of use apply. Rights reserved
8
Vol:.(1234567890)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
R2 were computed following the method prescribed by Nakagawa and Schielzeth73. Pairwise comparisons and
adjusted means were obtained with the emmeans package, version 1.7.574. e alpha level was set at 0.05, and
p-values were adjusted for multiple comparisons using the Holm-Bonferroni correction. e “Results” section
presents signicant results only. Non-signicant results are accessible in the supplementary material (see Sup-
plementary Material).
Results
Control check for conditions
We rst checked for potential dierences in cybersickness and navigation between conditions. To assess dier-
ences in cybersickness, we tted a hierarchical mixed model on the main and the sub-scores of the Simulation
Sickness Questionnaire (SSQ) with Condition as a xed eect and subjects as a random intercept. Importantly,
none of our subjects exceeded the SSQ threshold for cybersickness. Our model revealed no signicant predic-
tor of condition on the oculomotor sub-type of the SSQ. For the nausea sub-type, our model indicated that the
Asynchronous (β = 0.62, SE = 0.25, CI(95%) = [0.14, 1.10], t = 2.52, p = 0.012) and No-Body conditions (β = 0.58,
SE = 0.25, CI(95%) = [0.10, 1.06], t = 2.37, p = 0.018) were signicant positive predictors of nausea score (η2c = 0.83,
η2m = 0.007). Pairwise comparisons showed that participants in the Asynchronous condition had a higher feeling
of nausea compared to those in the Synchronous condition (Masynch = 3.84, SE = 0.564, Msynch = 3.22, SE = 0.564,
β = −0.6172, SE = 0.245, p = 0.0356) and No-Body condition (Mnob = −3.80, SE = 0.564, β = −0.5807, SE = 0.245,
p = 0.0358). For the total cybersickness score, our model indicated that the Asynchronous (β = 0.95, SE = 0.46,
CI(95%) = [0.06, 1.85], t = 2.08, p = 0.037) and the No-Body conditions (β = 0.91, SE = 0.46, CI(95%) = [0.02, 1.81],
t = 2.00, p = 0.046) were signicant positive predictors of total cybersickness score (η2c = 0.83, η2m = 0.005).
However, pairwise comparisons did not indicate any signicant dierences between conditions (all p > 0.05).
Regarding the oculomotor subtype, neither being in the Asynchronous (β = −1.12, SE = 2.71, CI(95%) = [−6.46,
4.23], t = −0.41, p = 0.681) nor in the No-Body condition (β = -0.56, SE = 2.66, CI(95%) = [−5.81, 4.70], t = −0.21,
p = 0.835) were signicant predictors of oculomotor cybersickness.
To assess dierences in navigation duration between conditions, we tted the same model with navigation
duration as the dependent variable and SSQ nausea as a covariate to control for dierences in cybersickness.
Analysis of navigation duration showed that being in the Asynchronous condition was a positive predictor of
navigation duration (β = 0.79, SE = 0.30, CI(95%) = [0.53, 1.05], t = 5.99, p < 0.001; η2c = 0.81, η2m = 0.085). Pair-
wise comparisons showed that navigation duration was higher in Asynchronous compared to the Synchronous
(Msynch = 8.44, SE = 0. 273, Masynch = 9.23, SE = 0. 273; β = −0. 7941, SE = 0.133, p < 0.0001) and the No-Body con-
dition (Mnob = 8.44, SE = 0. 273; β = 0. 8385, SE = 0.131, p < 0.0001). erefore, we decided to add the navigation
duration and SSQ Nausea sub-scores as two covariates in all the subsequent models.
Body illusion
First, to ensure that our experimental manipulation worked as expected, we conducted an analysis of the body-
illusion questionnaire responses aer each navigation. To analyze the body-illusions score, we tted a model with
Condition as a xed eect and Subjects as a random intercept. Based on our previous results, we also included
Navigation Duration and SSQ Nausea sub-scores as covariates in the model. Analysis of sense of body self-
identication showed that being in the Asynchronous (β = −1.09, SE = 0.23, CI(95%) = [−1.54, -0.64], t(203) =
−4.74, p < 0.001) and No-Body conditions (β = −1.00, SE = 0.22, CI(95%) = [−1.44, −0.56], t(203) = −4.50,
p < 0.001) were negative predictors of sense of self-identication (η2c = 0.50, η2m = 0.08). Pairwise comparisons
showed that participants in the Asynchronous condition had a higher sense of self-identication score than
participants in the Synchronous condition (Masynch = −0.687, SE = 0.242, Msynch = 0.402, SE = 0.239, β = 1.0887,
SE = 0.230, p = 0.0001), and the No-Body condition (Mnob = −0.600, SE = 0.240, β = 1.0022, SE = 0.223, p = 0.0001).
Our model also indicated that the Asynchronous (β = −1.00, SE = 0.18, CI(95%) = [−1.34, −0.66], z = −5.69,
p < 0.001) and No-Body conditions (β = −1.12, SE = 0.17, CI(95%) = [−1.45, -0.80], z = −6.75, p < 0.001) were
negative predictors of sense of agency (η2c = 0.67, η2m = 0.20). Post hoc pairwise comparisons indicated that
participants in the Asynchronous condition had a lower sense of agency than participants in the Asynchronous
(Masynch = 1.075, SE = 0. 227, Msynch = 2.049, SE = 0.224, β = − 0.973, SE = 0.173, p < 0.0001) and in the No-Body
condition (Mnob = 0.953, SE = 0.223, β = −1.095, SE = 0.163, p < 0.0001). Similarly, being in the Asynchronous con-
dition (β = −0.65, SE = 0.19, CI(95%) = [−1.02, −0.28], t = −3.49, p < 0.001) and No-Body condition (β = −0.44,
SE = 0.18, CI(95%) = [−0.79, −0.09], t = −2.46, p < 0.014) were negative predictors of sense of self-location
(η2c = 0.67, η2m = 0.15). e pairwise comparison conrmed this result and indicated a lower sense of self-loca-
tion for Asynchronous compared to Synchronous conditions (Maynch = 0.831, SE = 0.257, Msynch = 1.481, SE = 0.255,
β = 0.650, SE = 0.187, p = 0.0015) as well as a lower score in the No-Body compared to the Synchronous condition
(Mnob = 1.039, SE = 0.255, β = 0.442, SE = 0.179, p = 0.0276) (Fig.3A–C).
Analysis of the control questions revealed that being in the Asynchronous condition was a negative predic-
tor of the feeling of having no body (β = −0.29, SE = 0.13, CI(95%) = [−0.55, −0.03], t = −2.18, p = 0.029) while
being in the No-Body condition was a positive predictor (β = 0.26, SE = 0.12, CI(95%) = [0.02, 0.50], t = 2.14,
p = 0.032) compared to the Synchronous condition (η2c = 0.88, η2m = 0.02). Pairwise comparisons showed a trend
toward a higher score in the Asynchronous compared to the Synchronous condition (Masynch = −0.798, SE = 0.336,
Msynch = − 0.510, SE = 0.335, β = 0.288, SE = 0.132, p = 0.0583) and the No-Body condition (Mnob = −0.247,
SE = 0.334, β = −0.263, SE = 0.123, p = 0.0583), and also indicated a lower score in the Asynchronous compared
to the No-Body condition (β = −0.551, SE = 0.131, p = 0.0001). For the Two-bodies question, our model indicated
that being in the Asynchronous condition was a positive predictor (β = 0.56, SE = 0.23, CI(95%) = [0.11, 1.01],
z = −2.45, p = 0.014; η2c = 0.58, η2m = 0.03). Pairwise comparisons conrmed this result and revealed a higher
score for the Asynchronous compared to the Synchronous condition (Maynch = 0.149, SE = 0.281, Msynch = −0.716,
Content courtesy of Springer Nature, terms of use apply. Rights reserved
9
Vol.:(0123456789)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
SE = 0.278, β = -0.566, SE = 0.222, p = 0.0211) (Fig.3D, E) and the No-Body condition (Mnob = -0.821, SE = 0.279,
β = −0.672, SE = 0.223, p = 0.0079).
Sense of presence
Next, to test for dierences in the sense of presence, we analyzed each subscore of the IPQ independently while
controlling for the nausea subscore and navigation duration. e mixed model analysis revealed that the Asyn-
chronous condition (β = −0.51, SE = 0.12, CI(95%) = [−0.75, − 0.27], t = − 3.54, p < 0.001) and the No-Body
condition (β = −0.27, SE = 0.12, CI(95%) = [−0.50, −0.04], t = −2.27, p < 0.001) were signicant negative pre-
dictors of the general sense of presence. (η2c = 0.80, η2m = 0.07). Pairwise comparisons indicated a lower sense
of general presence in the Asynchronous compared to the Synchronous condition (Msynch = 4.17, SE = 0.241,
Masynch = 3.66, SE = 0.242, β = 0.509, SE = 0.124, p = 0.0001), and in the No-Body compared to the Synchronous
condition (Mnob = 3.90, SE = 0.241, β = 0.267, SE = 0.118, p = 0.0469). Moreover, pairwise comparisons also indi-
cated a trend toward a lower sense of general presence in the Asynchronous compared to the No-Body condition
(β = -0.242, SE = 0.125, p = 0.0525). For the Spatial Presence subscore, our model revealed that being in the Asyn-
chronous condition was a negative predictor of spatial presence (β = −1.16, SE = 0.42, CI(95%) = [−2.00, −0.30],
t = −2.75, p = 0.006; η2c = 0.75, η2m = 0.06). Pairwise comparisons indicated that the sense of spatial presence
was lower in Asynchronous than the Synchronous condition (Msynch = 20.9, SE = 0.726, Masynch = 19.7, SE = 0.730,
β = 1.164, SE = 0.424, p = 0.0181). Our model indicated similar results for ecological validity (β = −1.24, SE = 0.40,
CI(95%) = [−2.03, −0.44], t(203) = −3.06, p = 0.003; η2c = 0.77, η2m = 0.04). Pairwise comparisons indicated a
lower sense of ecological validity in the Asynchronous compared to the Synchronous condition (Msynch = 11.02,
SE = 0.732, Masynch = 9.79, SE = 0.736, β = 1.235, SE = 0.404, p = 0.0078). Lastly, the Psychological Implication sub-
score did not indicate any signicant dierences between conditions (p > 0.05) (Fig.4).
Memory performances
To analyze memory performance, we tted a model with Condition and Delay as a xed eect and Subject as
a random eect. For this model, in addition to the SSQ Nausea and Navigation Duration, we added the inter-
session duration as a covariate, as it may vary substantially between participants.
Free recall
Our model indicated that being in the Asynchronous condition was a negative predictor of the number of
events (What) recalled (β = −9.99, SE = 4.07, CI5(95%) = [−18.03, −1.96], t(199) = −2.45, p = 0.015; η2c = 0.30;
η2m = 0.07). Pairwise comparisons indicated a lower score in the Asynchronous compared to the Synchronous
Figure3. Results of the Body illusion questionnaire.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
10
Vol:.(1234567890)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
condition (Masynch = 40.5, SE = 2.63, Msynch = 49.9, SE = 2.60, β = 9.4, SE = 2.93, p = 0.0047). ere was no eect of
the delay or interaction (Fig.5A).
Regarding Egocentric Spatial and Temporal Situation memory, our model did not indicate any signicant pre-
dictor. However, being in the Asynchronous condition was also a negative predictor of specic details (β = −9.59,
SE = 3.44, CI5(95%) = [−16.32, −2.85], t = −2.79, p = 0.005; η2c = 0.39, η2m = 0.06). e pairwise comparison
indicated that, on average, participants recalled fewer specic details in the Asynchronous compared to the Syn-
chronous condition (Masynch = 27.5, SE = 2.48, Msynch = 36.1, SE = 2.45, β = 8.57, SE = 2.47, p = 0.0016). e model
did not indicate any other main eect or interaction (Fig.5B).
Analysis of the mean total associative memory score revealed that being in the Asynchronous condition was
a signicant negative predictor of the total associative memory score. (β = −3.49, SE = 1.66, CI5(95%) = [−6.76,
−0.23], t(198) = −2.11, p = 0.036; η2c = 0.39, η2m = 0.06). Pairwise comparisons indicated a lower association
score in the Asynchronous compared to the Synchronous condition (Masynch = 16.6, SE = 1.008, Msynch = 20.3,
SE = 0.995, β = 3.71, SE = 1.19, p = 0.0063). No other result was signicant, and no eect of delay or interaction
was found (Fig.5C).
Recognition
Regarding the hit score, being in the Asynchronous condition was a negative predictor (β = −6.94, SE = 2.95,
CI(95%) = [−12.71, −1.16], t = −2.35, p = 0.019; η2c = 0.42; η2m = 0.07). Pairwise comparisons further showed
a lower hit score in the Asynchronous compared to the Synchronous condition (Msynch = 85.8, SE = 2.16,
Masynch = 79.5, SE = 2.19, β = 6.274, SE = 2.12, p = 0.0094), and a lower hit score in the Asynchronous compared to
the No-Body condition (Mnob = 85.2, SE = 2.17, β = −5.662, SE = 2.14, p = 0.0163) (Fig.6A). Regarding false alarms,
our model indicated that recall aer a 10-day delay was a positive predictor of the false alarm rate (β = 4.85,
SE = 0.94, CI(95%) = [3.01, 6.69], t = −2.35, p < 0.001; η2c = 0.59; η2m = 0.18). Post hoc comparisons conrmed
this result and indicated a lower False Alarm percentage in the Immediate compared to the Delayed condition
(Mimm = 1.83, SE = 0.929, Mdel = −6.91, SE = 0.928, β = −5.08, SE = 0.543, p < 0.0001). To assess overall p erformance
in the recognition task, we calculated a d prime score based on the hit and false alarm scores. Our model indicated
that being in the Asynchronous condition (β = −0.41, SE = 0.22, CI(95%) = [−0.84, 0.02], t = −1.89, p = 0.059)
or Delayed recall (β = −0.44, SE = 0.21, CI(95%) = [−0.85, −0.03], t = −2.08, p = 0.037) was a negative predictor
of the d’ score (η2c = 0.63; η2m = 0.08). Post hoc comparisons indicated a trend toward a lower d’ score in the
Asynchronous compared to the Synchronous condition (Masynch = −0.126, SE = 0.215, Msynch = 0.247, SE = 0.214,
β = 0.3722, SE = 0.157, p = 0.0544), as well as a trend toward a lower score in the Asynchronous compared to the
No-Body condition (Mnob = 0.193, SE = 0.214, β = − 0.3188, SE = 0.159, p = 0.0897). Moreover, the d’ score was
higher in the Immediate, compared to the Delayed condition (Mimm = 0.30, SE = 0.204, Mdel = -0.09, SE = 0.204,
Figure4. Results of the Igroup presence questionnaire.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
11
Vol.:(0123456789)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
β = −0.39, SE = 0.122, p = 0.0014) (Fig.6B). Our model did not reveal any eect of delay or interaction between
delay and condition.
Regarding contextual information, our model indicated that being in the No-Body condition was a nega-
tive predictor of egocentric spatial recall at 10days delay (β = −10.91, SE = 5.34, CI(95%) = [−21.44, −0.37],
t(199) = −2.04, p = 0.043) (η2c = 0.31; η2m = 0.09). Post hoc comparisons indicated a lower score in the No-Body
compared to the Synchronous condition (Mnob = 57.5, SE = 3.11, Msynch = 67.1, SE = 3.10, β = 9.631, SE = 3.79,
p = 0.0361) as well as a trend toward a lower score in the Asynchronous compared to the Synchronous condition
(Masynch = 59.3, SE = 3.13, β = 7.805, SE = 3.84, p = 0.0873) at 10days delay only (Fig.6C). Analysis of temporal
order and source recognition percentage did not reveal any signicant main eect or interaction (All p > 0.05; See
Supplementary TableS4). We did not nd any other eect of delay or interaction between delay and condition.
Lastly, we did not nd any signicant predictor regarding source condition (all p > 0.05) (Fig.6D).
For sense of remembering, our model showed that recall at 10days was a negative predictor of sense of
remembering (β = −8.08, SE = 2.65, CI(95%) = [−13.30, −2.86], t(199) = − 3.05, p = 0.003). Moreover, our
model revealed a signicant interaction between Condition and Delay such that being in the No-Body condi-
tion (β = −7.58, SE = 3.74, CI(95%) = [−14.97, −0.20], t(199) = −2.02, p = 0.044) was a negative predictor of
sense of remembering at 10days delay only (η2c = 0.64; η2m = 0.23). e post hoc test revealed that the sense
of remembering was lower for the No-Body compared to the Synchronous condition (Mnob = 63.5, SE = 2.66,
β = 8.137, Msynch = 71.6, SE = 2.66, SE = 2.66, p = 0.0078) and in the Asynchronous than in the Synchronous condi-
tion (Masynch = 65.2, SE = 2.68, β = 6.420, SE = 2.71, p = 0.0381), but only aer a 10-day delay (Fig.6E).
Lastly, we analyzed mean subjective ratings of the events associated with a sense of remembering. Our
model indicated that recall at 10days was a negative predictor of memory Vividness, Condence, Perspective,
and Emotional intensity. Post hoc tests indicated a higher score for Immediate compared to Delayed recall for
all measures (all p < 0.5, see Supplementary TableS4). No other eect of condition or interaction was found.
Discussion
e role of bodily self-consciousness (BSC) in episodic memory (EM) has been the subject of increasing inter-
est in recent years due to growing evidence suggesting that the body plays a crucial part in memory formation
and retrieval8,9. In this study, we aimed to investigate further the impact of BSC on the incidental encoding of
Figure5. Results of the What, specic details and total association score of the EM free recall.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
12
Vol:.(1234567890)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
experienced specic events and its contribution to the objective, subjective, and associative components of EM
by using immersion in a naturalistic virtual environment. By manipulating visuomotor synchronicity and body
visibility to induce a body illusion over a personalized virtual avatar, participants navigated through a rich, mul-
timodal naturalistic virtual environment in which a series of ecological, close-to-daily-life events were arranged.
Our results revealed that synchronous visuo-motor stimulation positively enhances both objective and subjective
components of EM compared to the Asynchronous condition and, to a lesser extent, the No-Body condition. In
this discussion, we will rst explore how our manipulations aected BSC in the three conditions, then we will
focus on the comparison between Synchronous and Asynchronous conditions, followed by a discussion of the
No-Body condition.
BSC manipulation check and sense of presence
e results of our body-illusion questionnaire conform to our rst hypothesis as the participants reported a lower
sense of self-identication, a lower sense of agency, and a lower sense of being located within the avatar’s body
in the Asynchronous and No-Body conditions compared to the Synchronous condition. ese results conrm
that our manipulation worked as expected and show that manipulating visuo-motor feedback on a virtual avatar
eectively modulated all three components of BSC. Noteworthy, the self-identication score was positive only in
the Synchronous condition, suggesting that it was the only condition where participants experienced a positive
sense of identication with the virtual avatar. In contrast, sense of self-location and sense of agency scores were
positive in all three conditions. For the No-Body condition, the positive agency score may be attributed to the
presence of the virtual cellphone. e cellphone provided a minimal visual representation of the participants’
bodies in space, which may have helped them feel more embodied and experience a better sense of their actions.
Additionally, the cellphone was synchronized with the participants’ movements, which may have helped them
to feel more in control of their actions and to have a stronger sense of agency. For the Asynchronous condition,
we expected sense of agency scores to follow self-identication as a sense of agency is known to depend on the
comparison between the expected and actual multi-sensory consequences of motor commands, including their
temporal dynamics75. us, as the visual feedback delay increases, the sense of agency should be diminished
or abolished76. However, in our study, visuo-motor delay was kept constant, allowing participants to adjust to
the altered temporal gap between their actions and consequences, thereby increasing their sense of agency over
Figure6. Results of the recognition tests.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
13
Vol.:(0123456789)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
time77. Of note, although body parts and trunk movements were desynchronized, head movements and naviga-
tion controls remained synchronized with participants’ actions, which may have inuenced participants while
judging feelings of control over the virtual avatar. Nevertheless, large dierences in questionnaire ratings between
conditions may reect various degrees of condence or vividness of the illusion. Together, these results support
the role of the multi-sensory integration of bodily signals for BSC and show that visuo-motor congruency may
inuence not only the sense of self-identication but also the sense of control and sense of self-location in space
over an avatar seen from the 1PP.
Turning to the sense of presence, participants in the Synchronous condition had a higher feeling of general
presence compared to the Asynchronous and No-Body conditions, as well as a higher sense of spatial presence
and ecological validity compared to the Asynchronous but not the No-body condition. General presence refers
to the subjective feeling of “being there” and measures the psychological immersion of the participants in the
virtual environment. It has been argued that looking down at one’s body is strong evidence of being present in a
given environment78. is result aligns with this claim and shows that multi-sensory congruency of body signals
and body visibility are both important for sense of presence. Spatial presence, in turn, relates to the feeling of
being physically present in a given environment78 and is tightly linked to body representation and the possibility
of acting upon the immediate environment. Interacting with the environment requires monitoring the position
of one’s body and eectors in relation to external objects79. Sense of body in space relies heavily on multi-sensory
integration processes that blend spatial information about body position from various modalities80. us, one
possible explanation for this result is that contrary to the No-Body condition, the discrepancy between visual
and proprioceptive information in the Asynchronous condition may have prevented correct monitoring of the
participant’s body in space due to ambiguous or conicting body representations and disrupted sensorimotor
coupling between the body, the self, and the world, leading to a lower sense of spatial presence and ecological
validity. In support of this, a detailed inspection of our body illusion questionnaire revealed that the feeling of
having no-body decreased from the No-Body to the Asynchronous condition. In contrast, participants in the
Asynchronous condition had a higher feeling of having two bodies and a lower feeling of being in the avatar’s
body. Another interpretation is that a lower sense of spatial presence and ecological validity results from higher
cybersickness in the Asynchronous condition. However, in this case, we would have expected a similar pattern
of results in the No-Body condition. Moreover, this result remains even when dierences in cybersickness were
controlled for.
Together, these results link the sense of bodily-self in space and a sense of presence. A strong sense of bodily
self in space, as produced by synchronous visuomotor feedback, is associated with higher immersion, as well
as a high psychological and physical sense of being “here” in the virtual environment. As sense of bodily-self
decreases, the sense of psychological implication decreases while the sense of spatial presence and ecological
validity remains. Lastly, a weak or conicting bodily-self representation impairs both the psychological and
physical sense of presence, as well as the participant’s feeling that the virtual environment is real. We will next
discuss the relevance of these results for EM encoding.
BSC and multifaceted episodic memory performance
e ndings of the present EM tests oer partial support for our original hypotheses. Our results indicate that
participants in the Asynchronous condition had a lower score on nearly all memory tests than those in the
Synchronous condition. However, participants in the No-Body condition showed only slight deterioration in
a few tests compared to those in the Synchronous condition. Consequently, our discussion will rst focus on
the dierences between the Synchronous and Asynchronous conditions before analyzing the results from the
No-Body condition separately.
e impact of Synchronous vs. Asynchronous condition
Concerning factual information, our results corroborate the ndings of previous studies. We found that par-
ticipants recalled fewer new events (i.e., specic scenes encountered during navigation) in the Asynchronous
condition, regardless of the delay interval, and across both free recall and recognition tasks. More specically,
it was demonstrated through a lower proportion of event recall in the free recall task, a lower hit rate and a
trend toward a lower d’ score in the recognition task, irrespective of the recall delay. is nding is consistent
with previous studies showing that asynchronous visuo-tactile stimulation diminishes memory performance
for factual information using words52, 3D objects49,50, and complex video scenes53, and extends this result to the
incidental encoding of ecological events in naturalistic settings.
In addition to these results, our study reports several novel ndings regarding the inuence of bodily self-
awareness on objective and subjective components of episodic memory.
First, we found that the free recall of events (What) was less oen associated with multifaceted informa-
tion(associativememoryscore), including contextual (Where, When) and specic details, in the Asynchronous
condition compared to the Synchronous condition, showing for the rst time that BSC may play a crucial role
in the richness of EM traces (multiple features association). In fact, the Asynchronous condition signicantly
reduced the number of specic details recalled regardless of retention duration compared to the Synchronous
condition. e present ndings replicate those of Iriye and Ehrsson53, who found that asynchronous visuo-tactile
stimulation during the encoding of an everyday-like scene decreased memory for central and peripheral details
of the scene. Here, we extend these results to encoding ecological events in a naturalistic virtual environment
in line with the view that the self-related bodily cues in the environment increase the event’s self-relevance of
an experienced scene. us, the interaction between the BSC system and the memory system may help bind
the various dimensions of experience into a well-integrated representation of the event in memory encoding,
Content courtesy of Springer Nature, terms of use apply. Rights reserved
14
Vol:.(1234567890)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
reinstatement, and long-term consolidation81,82. In support of this claim, Bréchet etal.50 found that seeing one’s
own body in a given environment retroactively strengthened memories of material encoded in this environment.
Concerning more specically spatial information, our results from the recognition tests indicated that fac-
tual information tended to be less frequently linked to egocentric spatial information aer a 10-day delay in the
Asynchronous than the Synchronous condition. Remarkably, being in the Asynchronous condition altered the
egocentric spatial reference frame57. According to the Scene Construction Hypothesis, reconstructing space is
essential to EM and mental time travel76. Previous studies have shown that manipulating BSC modulates space
perception, such as size estimation or depth perception. More recently, it has been demonstrated that changes
in BSC are also associated with decreased spatial memory and spatial navigation performances. For example,
Bergouignan and colleagues found that discrepancies between physical and seen body position during memory
encoding may disturb binding processes in the hippocampus and impair EM for spatial, temporal, and emo-
tional information59. It suggests that sense of bodily-self in space is essential for the EM of naturalistic events in
context. In another study, Moon etal.60 immersed participants in a large virtual empty space where participants
had to memorize the position of 3D objects while navigating freely. Notably, during the navigation, participants
could see the body of a virtual mannequin in a supine position matching their physical body being stroked either
synchronously or asynchronously. At retrieval, participants were again placed in the virtual environment and
asked to navigate to the previous position of the object memorized. ey demonstrated fewer distance errors
and shorter path navigations when the participants saw the avatar associated with synchronous sensorimotor
stimulation60.
Because of a ceiling eect, we failed to nd signicant dierences between our conditions for egocentric
spatial information in the free recall task. is means that when participants had to draw on internal resources
to recall an event, it was quasi-systematically associated with correct egocentric spatial information. Future
research could extend these investigations to dierent aspects of spatial information connected to EM, including
visuospatial and allocentric measures (e.g., location of events on a map). Otherwise, there was no signicant
eect of conditions regarding specically temporal information in the free recall and recognition tasks assessing
the temporal order of events. ese results depart from a recent study showing that BSC may modulate time
perception58. However, this study investigates time duration estimation rather than sequential event memory,
which was particularly dicult for our participants. Similar to spatial measurements, further studies could
examine dierent types of temporal information to better understand the role of BSC in the precision of EM
for temporal information83. Lastly, we found no dierence between conditions regarding source memory. Our
instructions directed participants’ attention to the environment (which route) rather than their bodies (which
condition). Consequently, it seems that none of our participants targeted visuo-motor changes as the primary
goal of the experiment, leading to poor remembering of the condition. Future studies should explore additional
measures to assess source information in greater detail.
Secondly, regarding the subjective dimensions of EM, we found that participants reported a higher sense
of remembering (i.e., autonoetic recollection) in the Synchronous compared to the Asynchronous condition at
delayed retrieval. Immediately aer the rst-person incidental encoding in VR, the sense of remembering was
similar, whatever the BSC condition, but with a retention delay, there was a lower decrease in memory phenom-
enology in the Synchronous condition. is result supports previous VR studies demonstrating a link between
body self-awareness and autonoetic consciousness for immediate and delayed recall51,53. For instance, Gauthier
and colleagues used functional neuroimaging to measure changes in connectivity aer encoding a virtual scene
composed of a series of objects. ey showed that post-encoding changes in connectivity strength between
cerebral regions associated with BSC and the medial temporal lobe region correlated with the participant’s
autonoetic recollection rating at one month delay only when the participant’s virtual body was visible during
encoding51. Iriye and Ehrsson found that synchronous visuo-tactile stimulation over a virtual body seen from
the rst-person perspective enhanced the sense of reliving immediately aer encoding and memory vividness,
condence, and emotional intensity at one week of delay53. However, their most recent study has not replicated
these ndings84. Regarding memory phenomenological scales, we did not reproduce all of Iriye and Ehrsson’s
results, as we only found a main eect of delay on the memory vividness, condence, emotional intensity, reliv-
ing, and rst-person perspective, but no eect of condition or interaction. One relevant explanation is that
compared to Iriye and Ehrsson, our phenomenological evaluation of event memory retrieval was only proposed
to participants with a remembering state attested by a score above 50 on the remembering scale. Consequently,
all the participants who completed the phenomenological scales had a high level of remembering, which may
have erased subtle dierences in memory phenomenology in our participants.
Altogether, the present results reinforce our prior research on the eect of self-awareness on EM of naturalistic
events using virtual reality9,47,85 and extend previous studies (see Table1) revealing that BSC plays a crucial role
in incidental encoding of naturalistic events supporting associative memory and autonoetic consciousness at
retrieval, thus the objective and subjective properties of EM. ese ndings suggest, for the rst time, that the
perception of ones body in space may impact the level of detail in incidental memories of real-life events. e
result of this study provides support to the claim that the integrated properties of self-perception may extend
to the most basic form of bodily self-consciousness and improve the formation and retention of distinctive
memory traces.
e special case of the No-Body condition
In addition to Synchronous and Asynchronous conditions, we also investigated a condition where the virtual
body was removed from the participant’s rst-person view. To date, no studies have directly compared Synchro-
nous, Asynchronous, and No-Body conditions. Our results indicated that the No-Body condition is intermedi-
ate between the Synchronous and Asynchronous conditions. Specically, we found that memory performance
Content courtesy of Springer Nature, terms of use apply. Rights reserved
15
Vol.:(0123456789)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
was better in the No-Body condition than in the Asynchronous condition regarding hit rates in the recognition
task. Conversely, scores in the No-Body condition for egocentric spatial memory and sense of remembering
were lower than in the Synchronous condition when the recall was delayed. No further dierences were found
regarding the other scores.
Before delving deeper into the possible reasons for this nding, it is essential rst to discuss the nature of
our No-Body condition. When participants are immersed in a virtual environment without a visible body, they
must rely on proprioceptive and motor information to monitor the spatial position of their body. However, the
lack of visual feedback for sensorimotor information may constitute a surprise event for the brain that may lead
to a decrease in BSC. is is consistent with our data and ndings showing that asynchronous visuo-tactile and
visuomotor stimulation can reduce the sense of identication with one’s own body86. Additionally, proprioceptive
representations of the body in space are known to be less reliable than visual representation, which can further
impair cognitive operations that rely on BSC. Only a few studies have investigated the impact of synchronous
visuo-motor stimulation on memory performance compared to a No-Body condition4951, but they have reported
inconsistent results. Bréchet etal.49,50 found that occluding participants’ bodies while encoding objects in a vir-
tual room decreased memory performance in a subsequent surprise recognition task. However, Gauthier etal.51
failed to replicate this result using a similar procedure. Moreover, as a subjective BSC measure was not assessed
in these studies, it is impossible to ensure that changes in memory performances were specically related to
changes in the sense of bodily self.
Nevertheless, a signicant dierence between our study and the studies cited above is to be noted. As men-
tioned above, participants in each condition, including the No-Body condition, were equipped with a virtual
cellphone placed in their right-hand during navigation. is procedure was chosen to motivate participants to
use their virtual bodies and to ensure the comparability of our experimental conditions. Although the avatar’s
body was occluded in the No-Body condition, the cellphone moved congruently and synchronously with the
participant’s physical hand. us, congruent spatial and temporal feedback from the cellphone may have been
sucient to help participants to build a more stable and accurate bodily-self representation in the No-Body
compared to the Asynchronous condition, as shown by their higher sense of spatial presence. Indeed, it has
been demonstrated that synchronous multi-sensory stimulation may elicit a sense of self-identication over an
invisible body66. Similarly, Kondo etal.87 found that the mere perception of spatially congruent but disconnected
hands and feet might suce to create a sense of self-identication, sense of agency, and sense of self-location
over the corresponding interpolated body. us, we suggest that minimal visuo-motor cues, as provided by the
spatially congruent position of the cellphone, may have been sucient for participants to form a weak but coher-
ent representation of the body in space that helped them to construct an organized and integrated memory trace
from encoding and in turn, helped them to form a coherent representation of the event in memory.
An alternative explanation is that the additional cognitive resources required to adapt to the desynchroniza-
tion of visual and motor information in the Asynchronous condition may have specially altered event encoding.
Consistent with this claim is that participants in the Asynchronous condition exhibited longer navigation dura-
tion, which is a consequence of higher cognitive load40. However, by including this parameter as a covariate in
our analysis, we accounted for a portion of the dierences in cognitive load between our conditions. Furthermore,
the extent to which this explanation is valid is unclear. For example, adaptation time to a mismatch can be very
rapid, with some studies reporting adaptation aer only a few trials88 Moreover, it has been shown that visuomo-
tor adaptation rate is robust to cognitive load89. us, it is unlikely that visuo-motor adaptation was disturbed
by the experimental task. In the present study, participants in the Asynchronous condition performed nearly 80
movements during the induction phase, which is likely to have been sucient for adaptation to occur. Finally, an
explanation centered on executive functions cannot explain the lower performance in remembering and egocen-
tric spatial memory in the No-Body condition. erefore, while the present study does not completely rule out
the possibility that cognitive demands played a role in the impairment in event encoding in the Asynchronous
condition compared to the No-Body one, it is likely to have played a minor role. Nevertheless, further research
is needed to determine the extent to which visuomotor adaptation can account for the eect of BSC on EM.
New direction for a theoretical framework of the eects of BSC on EM
Our study unravels the links between sense of bodily-self in space and EM of naturalistic events by highlighting
that BSC supports memory performance (i.e., number of events, richness of details, associative information,
and discriminability), and preserves contextual information and sense of remembering over time. How can BSC
account for these results?
Neuroimaging studies have identied a network of interconnected brain regions, including frontoparietal,
temporoparietal, and subcortical areas associated with BSC, with dierent sub-networks supporting spatial
and self-components of BSC90. ese regions dynamically integrate available sensory signals from dierent
modalities to build a coherent sense of being a self in a body and have been associated with a variety of functions
including spatial navigation, EM and sense of self in space9193. Interestingly, recent behavioral and neuroimag-
ing studies suggest that the multi-sensory processes involved in BSC are integrated into the memory trace to
support encoding and episodic remembering66,94. As such, it has been argued that the parietal areas support
the integration of multimodal memory features within an egocentric framework into the kind of rst-person-
perspective representation that enables the subjective reexperiencing of past events95. For example, it was found
that subjective reports of self-location correlated with the increased connectivity between posterior parietal
and hippocampal activity. Similarly, Moon etal.60 found that rst-person perspective navigation decreased
entorhinal cortex activity and increased retrosplenial cortex activity, linked with spatial navigation and spatial
memory performances. Moreover, Bergouignan etal.59,96 found that experimentally induced out-of-body experi-
ence reduced hippocampal activity during retrieval and the ability to remember events from a eld perspective.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
16
Vol:.(1234567890)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
It suggests that multi-sensory processes in the posterior parietal regions are conveyed to the hippocampus to
build a coherent representation of the bodily-self, which may increase the richness of the memory trace, lead-
ing to better performance in our Synchronous condition compared to the other two. In parallel, interactions
with subnetworks related to the sense of agency and sense of self-identication may signal the self-relevance of
the event9,49,84, enhancing associative encoding for intra-event features and contextual information, increasing
memory precision and preventing memory decay over time50. Finally, at retrieval, these processes are reinstated
or reenacted, producing a rich and vivid recollection of the event centered around the bodily-self and imbued
with a sense of agency, and autonoetic consciousness. is claim was supported by a recent neuroimaging
study by Iriye etal.84. Using a similar paradigm as Iriye and Ehrsson53, they found increased similarity between
encoding and retrieval activity for highly vivid memories in brain regions including the hippocampus and the
bilateral angular gyrus, when events were encoded in the synchronous condition. e authors concluded that
sense of bodily-self in space during encoding is likely a fundamental contextual memory cue based on spatial
relationships that delineate oneself from the external world84. Continuing previous research9, we argue that the
multifaceted self-reference eect via grounding personal everyday experiences through bodily self in space and
narrative self is crucial to promote the formation of the self-memory system and long-lasting EM (i.e., episodic
autobiographical memory).
Limitations and future directions
e current study oers a unique perspective on the impact of bodily self-consciousness on EM, but there are
some limitations that may have inuenced the results and call for further investigation. Firstly, we cannot entirely
rule out the possibility that our ndings result partially from increased cognitive demand in the Asynchronous
condition. Future research could therefore explore the relationship between multi-sensory processing, executive
function, and EM, as this issue may not be restricted to visuo-motor stimulation. e implementation of control
devices such as eye-tracking systems could also help to track dierences in environmental exploration between
conditions. Another solution would be to manipulate interoceptive rather than exteroceptive signals to modulate
BSC97,98. Secondly, our study did not enable us to disentangle the specic role of each BSC component on EM.
A thorough examination of the role played by self and spatial components of BSC would help the eld to better
understand the link between BSC and EM and its functions. irdly, we need to substantiate how these ndings
are transferable to real life and contribute to the long-lasting EM, also referred to as episodic autobiographi-
cal memory2,6. While EM can refer to any event that happened to us in the past and any contextual learning of
new information, in contrast, episodic autobiographical memory concerns self-relevant specic experienced
events99. Future research should examine the role of BSC in EM according to the self-relevance of experienced
events. Overall, our study provides a foundation for further exploration of the role of bodily self-consciousness
in naturalistic episodic memory, but additional research is needed to address these limitations and expand our
understanding of this complex phenomenon.
Conclusion
In conclusion, our study provides new insights into the relationship between bodily-self in space and memory of
incidental encoding of specic events in a naturalistic environment. We found that manipulating the visuomotor
feedback associated with BSC during encoding can modulate the subsequent EM performance, even at long reten-
tion delay, showing for the rst time that BSC may play a role in feature binding and autonoetic consciousness
associated with the memory of everyday events. Our ndings are in accordance with previous studies showing
the importance of multi-sensory integration for EM and suggest that the bodily-self representation plays a crucial
role in this process. However, future work is needed to conrm our results as some issues persist regarding that
underly EM alteration performance when BSC is degraded and discard alternative explanations. is research
may have implications for the design of virtual environments as tools for learning and rehabilitation. By optimiz-
ing the feedback signals that promote BSC, it may be possible to optimize the encoding and retention of complex
events75. Furthermore, our study may contribute to the understanding of memory decits in bodily-self disorders
such as depersonalization and schizophrenia, which are characterized by a disruption of the integration between
body signals100. Future research could investigate whether similar eects on memory consolidation occur in
these populations and whether virtual reality interventions could help to alleviate their cognitive impairments.
Overall, this study highlights the importance of considering the multi-sensory processes that build the sense of
bodily-self as an integral part of the encoding and retrieval processes in memory consolidation, and it opens up
new avenues for investigating the neural and cognitive mechanisms underlying this phenomenon.
Data availability
e data of this study are available on request to the corresponding authors.
Received: 10 May 2023; Accepted: 28 September 2023
References
1. Tulving, E. Episodic memory: From mind to brain. Annu. Rev. Psychol. 53, 1–25 (2002).
2. Piolino, P., Desgranges, B. & Eustache, F. Episodic autobiographical memories over the course of time: Cognitive, neuropsycho-
logical and neuroimaging ndings. Neuropsychologia 47, 2314–2329 (2009).
3. Moscovitch, M., Cabeza, R., Winocur, G. & Nadel, L. Episodic memory and beyond: e hippocampus and neocortex in trans-
formation. Annu. Rev. Psychol. 67, 105–134 (2016).
4. Boyle, A. e impure phenomenology of episodic memory. Mind Lang. 35, 641–660 (2020).
5. Lin, Y.-T. Visual perspectives in episodic memory and the sense of self. Front. Psychol. 9, 2196 (2018).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
17
Vol.:(0123456789)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
6. Staniloiu, A., Kordon, A. & Markowitsch, H. J. Quo vadis ‘episodic memory’?—Past, present, and perspective. Neuropsychologia
141, 107362 (2020).
7. Tulving, E. Memory and consciousness. Can. Psychol. Psychol. Can. 26, 1–12 (1985).
8. Bréchet, L. Personal memories and bodily-cues inuence our sense of self. Front. Psychol. 13, 6 (2022).
9. Penaud, S. et al. Episodic memory and self-reference in a naturalistic context: New insights based on a virtual walk in the Latin
Quarter of Paris. J. Environ. Psychol. 81, 101801 (2022).
10. Cunningham, S. J. & Turk, D. J. Editorial: A review of self-processing biases in cognition. Q. J. Exp. Psychol. 70, 987–995 (2017).
11. Klein, S. B. “What is the self?”: Approaches to a very elusive question. Soc. Cogn. 30, 363–366 (2012).
12. Lalanne, J., Rozenberg, J., Grolleau, P. & Piolino, P. e self-reference eect on episodic memory recollection in young and older
adults and alzheimer’s disease. Curr. Alzheim. Res. 10, 1107–1117 (2013).
13. Andrews, G., Murphy, K. & Dunbar, M. Self-referent encoding facilitates memory binding in young children: New insights into
the self-reference eect in memory development. J. Exp. Child Psychol. 198, 104919 (2020).
14. Nida-Rümelin, M. Self-awareness. Rev. Philos. Psychol. 8, 88 (2017).
15. Ciaunica, A., Safron, A. & Delaeld-Butt, J. Back to Square One: e Bodily Roots of Conscious Experiences in Early Life. (2021).
https:// doi. org/ 10. 31234/ osf. io/ zspm2.
16. Gallagher, S. Philosophical conceptions of the self: implications for cognitive science. Trends Cogn. Sci. 4(1), 14–21 (2000).
17. Seth, A., Suzuki, K. & Critchley, H. An interoceptive predictive coding model of conscious presence. Front. Psychol. 2, 896 (2012).
18. Blanke, O. Multisensory brain mechanisms of bodily self-consciousness. Nat. Rev. Neurosci. 13, 556–571 (2012).
19. Blanke, O., Slater, M. & Serino, A. Behavioral, neural, and computational principles of bodily self-consciousness. Neuron 88,
145–166 (2015).
20. Ehrsson, H. H. (2012). 43 e concept of body ownership and its relation to multisensory integration. e New Handbook of
Multisensory Process.
21. Tsakiris, M. & Haggard, P. e rubber hand illusion revisited: Visuotactile integration and self-attribution. J. Exp. Psychol. Hum.
Percept. Perform. 31, 80–91 (2005).
22. Slater, M., Spanlang, B., Sanchez-Vives, M. V. & Blanke, O. First person experience of body transfer in virtual reality. PLoS ONE
5, e10564 (2010).
23. Salomon, R. e assembly of the self from sensory and motor foundations. Soc. Cogn. 35, 87–106 (2017).
24. Barsalou, L. W. Grounded cognition. Annu. Rev. Psychol. 59, 617–645 (2008).
25. Versace, R. et al. Act-In: An integrated view of memory mechanisms. J. Cogn. Psychol. 26, 280–306 (2014).
26. Ianì, F. Embodied memories: Reviewing the role of the body in memory processes. Psychon. Bull. Rev. 26, 1747–1766 (2019).
27. Prebble, S. C., Addis, D. R. & Tippett, L. J. Autobiographical memory and sense of self. Psychol. Bull. 139, 815–840 (2013).
28. Vandekerckhove, M. M. P. Memory, autonoetic consciousness and the self: Consciousness as a continuum of stages. Self Identity
8, 4–23 (2009).
29. Vandekerckhove, M. & Panksepp, J. A neurocognitive theory of higher mental emergence: From anoetic aective experiences
to noetic knowledge and autonoetic awareness. Neurosci. Biobehav. Rev. 35, 2017–2025 (2011).
30. Vandekerckhove, M., Bulnes, L. C. & Panksepp, J. e emergence of primary anoetic consciousness in episodic memory. Front.
Behav. Neurosci. 7, 741 (2014).
31. Klein, S. B., German, T. P., Cosmides, L. & Gabriel, R. A theory of autobiographical memory: Necessary components and dis-
orders resulting from their loss. Soc. Cogn. 22, 460–490 (2004).
32. Klein, S. B. What memory is. WIREs Cogn. Sci. 6, 1–38 (2015).
33. Sierra, M. & David, A. S. Depersonalization: A selective impairment of self-awareness. Conscious. Cogn. 20, 99–108 (2011).
34. Smith, S. A. Virtual reality in episodic memory research: A review. Psychon. Bull. Rev. 26, 1213–1237 (2019).
35. Reggente, N. VR for Cognition and Memory (Springer, 2023). https:// doi. org/ 10. 1007/ 7854_ 2023_ 425.
36. Fuchs, P. Virtual Reality Headsets—A eoretical and Pragmatic Approach (CRC Press, 2017).
37. Sanchez-Vives, M. V. & Slater, M. From presence to consciousness through virtual reality. Nat. Rev. Neurosci. 6, 332–339 (2005).
38. Sauzéon, H. et al. e use of virtual reality for episodic memory assessment. Exp. Psychol. 59, 99–108 (2011).
39. Ouellet, É., Boller, B., Corriveau-Lecavalier, N., Cloutier, S. & Belleville, S. e Virtual Shop: A new immersive virtual reality
environment and scenario for the assessment of everyday memory. J. Neurosci. Methods 303, 126–135 (2018).
40. Armougum, A., Orriols, E., Gaston-Bellegarde, A., Marle, C.J.-L. & Piolino, P. Virtual reality: A new method to investigate
cognitive load during navigation. J. Environ. Psychol. 65, 101338 (2019).
41. La Corte, V., Sperduti, M., Abichou, K. & Piolino, P. Episodic memory assessment and remediation in normal and pathological
aging using virtual reality: A mini review. Front. Psychol. 10, 173 (2019).
4 2. Cadet, L. B., Reynaud, E. & Chainay, H. Memory for a virtual reality experience in children and adults according to image quality,
emotion, and sense of presence. Virtual Real. 26, 55–75 (2022).
4 3. Plancher, G. & Piolino, P. Virtual Reality for Assessment of Episodic Memory in Normal and Pathological Aging (Oxford University
Press, 2017). https:// doi. org/ 10. 1093/ oso/ 97801 90234 737. 003. 0015.
44. Wallet, G. et al. Virtual/real transfer of spatial knowledge: Benet from visual delity provided in a virtual environment and
impact of active navigation. Cyberpsychol. Behav. Soc. Netw. 14, 417–423 (2011).
45. Repetto, C., Serino, S., Macedonia, M. & Riva, G. Virtual reality as an embodied tool to enhance episodic memory in elderly.
Front. Psychol. 7, 789 (2016).
46. Plancher, G., Barra, J., Orriols, E. & Piolino, P. e inuence of action on episodic memory: A virtual reality study. Q. J. Exp.
Psychol. 66, 895–909 (2013).
47. Jebara, N., Orriols, E., Zaoui, M., Berthoz, A. & Piolino, P. Eects of enactment in episodic memory: A pilot virtual reality study
with young and elderly adults. Front. Aging Neurosci. 6, 1089 (2014).
48. Tuena, C. et al. How virtual embodiment aects episodic memory functioning: A proof-of-concept study. Annu. Rev. Cyberther.
Tel emed 15, 98–103 (2017).
49. Bréchet, L. et al. First-person view of one’s body in immersive virtual reality: Inuence on episodic memory. PLOS ONE 14,
e0197763 (2019).
50. Bréchet, L. et al. Subjective feeling of re-experiencing past events using immersive virtual reality prevents a loss of episodic
memory. Brain Behav. 10, 6 (2020).
51. Gauthier, B. et al. First-person body view modulates the neural substrates of episodic memory and autonoetic consciousness:
A functional connectivity study. NeuroImage 223, 117370 (2020).
52. Tacikowski, P., Weijs, M. L. & Ehrsson, H. H. Perception of our own body inuences self-concept and self-incoherence impairs
episodic memory. iScience 23, 101429 (2020).
53. Iriye, H. & Ehrsson, H. H. Perceptual illusion of body-ownership within an immersive realistic environment enhances memory
accuracy and re-experiencing. iScience 25, 103584 (2022).
54. Cabeza, R. et al. Brain activity during episodic retrieval of autobiographical and laboratory events: An fMRI study using a novel
photo paradigm. J. Cogn. Neurosci. 16, 1583–1594 (2004).
55. Lenormand, D. & Piolino, P. In search of a naturalistic neuroimaging approach: Exploration of general feasibility through the
case of VR-fMRI and application in the domain of episodic memory. Neurosci. Biobehav. Rev. 133, 104499 (2022).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
18
Vol:.(1234567890)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
56. Yonelinas, A. P., Ranganath, C., Ekstrom, A. D. & Wiltgen, B. J. A contextual binding theory of episodic memory: Systems
consolidation reconsidered. Nat. Rev. Neurosci. 20, 364–375 (2019).
57 . Banakou, D., Groten, R. & Slater, M. Illusory ownership of a virtual child body causes overestimation of object sizes and implicit
attitude changes. Proc. Natl. Acad. Sci. 110, 12846–12851 (2013).
58. Droit-Volet, S., Monceau, S., Dambrun, M. & Martinelli, N. Embodied time and the out-of-body experience of the self. PeerJ 8,
e8565 (2020).
59. Bergouignan, L., Nyberg, L. & Ehrsson, H. H. Out-of-body-induced hippocampal amnesia (supp). Proc. Natl. Acad. Sci. 111,
4421–4426 (2014).
6 0. Moon, H.-J., Gauthier, B., Park, H.-D., Faivre, N. & Blanke, O. Sense of Self Impacts Spatial Navigation and Hexadirectional Coding
in Human Entorhinal Cortex (2020). https:// doi. org/ 10. 1101/ 2020. 09. 13. 295246.
61. Kokkinara, E. & Slater, M. Measuring the eects through time of the inuence of visuomotor and visuotactile synchronous
stimulation on a virtual body ownership illusion. Perception 43, 43–58 (2014).
62. Sanchez-Vives, M. V., Spanlang, B., Frisoli, A., Bergamasco, M. & Slater, M. Virtual hand illusion induced by visuomotor cor-
relations. PLOS ONE 5, e10381 (2010).
63. Kilteni, K., Maselli, A., Kording, K. P. & Slater, M. Over my fake body: Body ownership illusions for studying the multisensory
basis of own-body perception. Front. Hum. Neurosci. 9, 12 (2015).
64. Abdulkarim, Z., Hayatou, Z. & Ehrsson, H. H. Sustained rubber hand illusion aer the end of visuotactile stimulation with a
similar time course for the reduction of subjective ownership and proprioceptive dri. Exp. Brain Res. 239, 3471–3486 (2021).
65. Makowski, D. & Dutriaux, L. Neuropsydia.py: A python module for creating experiments, tasks and questionnaires. J. Open
Source Sow. 2, 259 (2017).
66. Guterstam, A., Abdulkarim, Z. & Ehrsson, H. H. Illusory ownership of an invisible body reduces autonomic and subjective
social anxiety responses. Sci. Rep. 5, 9831 (2015).
67. Schubert, T., Friedmann, F. & Regenbrecht, H. e experience of presence: Factor analytic insights. Presence Teleoperat. Virtual
Environ. 10, 266–281 (2001).
68. Bouchard, S., Robillard, G., & Renaud, P. (2007). Revising the factor structure of the Simulator Sickness Questionnaire. Annual
review of cybertherapy and telemedicine, 5(Summer), 128–137.
6 9. Wixted, J. T. & Mickes, L. A continuous dual-process model of remember/know judgments. Psychol. Rev. 117, 1025–1054 (2010).
70. Viard, A. et al. Hippocampal activation for autobiographical memories over the entire lifetime in healthy aged subjects: An fmri
study. Cereb. Cortex 17, 2453–2467 (2007).
71. Koller, M. robustlmm : An R package for robust estimation of linear mixed-eects models. J. Stat. Sow. 75, 6 (2016).
72. Lüdecke, D., Ben-Shachar, M., Patil, I., Waggoner, P. & Makowski, D. performance: An R package for assessment, comparison
and testing of statistical models. J. Open Sourc. Sow. 6, 3139 (2021).
73. Nakagawa, S. & Schielzeth, H. A general and simple method for obtaining R2 from generalized linear mixed-eects models.
Methods Ecol. Evol. 4, 133–142 (2013).
74. Russell V. Lenth (2022). emmeans: Estimated Marginal Means, aka Least-Squares Means. R package version 1.7.5. https://
CRAN.R- proje ct. org/ packa ge= emmea ns
75. Blakemore, S.-J. & Frith, C. Self-awareness and action. Curr. Opin. Neurobiol. 13, 219–224 (2003).
76. Haggard, P. Sense of agency in the human brain. Nat. Rev. Neurosci. 18, 196–207 (2017).
77. Wen, W. Does delay in feedback diminish sense of agency? A review. Conscious. Cogn. 73, 102759 (2019).
78. Durneva, P., Ma, Y., Marakas, G. & Aguirre-Urreta, M. Being there: Spatial presence in immersive environments. AMCIS Proc.
2022, 89 (2022).
79. Maravita, A., Spence, C. & Driver, J. Multisensory integration and the body schema: Close to hand and within reach. Curr. Biol.
13, R531–R539 (2003).
8 0. Ionta, S., Gassert, R. & Blanke, O. Multi-sensory and sensorimotor foundation of bodily self-consciousness—an interdisciplinary
approach. Front. Psychol. 2, 89 (2011).
81. Sui, J. & Humphreys, G. W. e integrative self: How self-reference integrates perception and memory. Trends Cogn. Sci. 19,
719–728 (2015).
82. Sui, J. & Gu, X. Self as object: Emerging trends in self research. Trends Neurosci. 40, 643–653 (2017).
83. Scoeld, J. E. & Johnson, J. D. e diminishing precision of memory for time. Psychon. Bull. Rev. 29, 212–219 (2022).
8 4. Iriye, H., Chancel, M. & Ehrsson, H. H. e Sense of Body Ownership and the Neural Processes of Memory Encoding and Reinstate-
ment (2023). https:// doi. org/ 10. 1101/ 2023. 03. 07. 531497.
85. Plancher, G., Tirard, A., Gyselinck, V., Nicolas, S. & Piolino, P. Using virtual reality to characterize episodic memory proles in
amnestic mild cognitive impairment and Alzheimer’s disease: Inuence of active and passive encoding. Neuropsychologia 50,
592–602 (2012).
86. Roel Lesur, M., Weijs, M. L., Nguyen, T. D. & Lenggenhager, B. Staying in touch with our bodies: Stronger sense of ownership
during self- compared to other touch despite temporal mismatches. Cognition 214, 104769 (2021).
87. Kondo, R. et al. Illusory body ownership of an invisible body interpolated between virtual hands and feet via visual-motor
synchronicity. Sci. Rep. 8, 7541 (2018).
88. Ruttle, J. E., Cressman, E. K., Hart, B. M. & Henriques, D. Y. P. Time course of reach adaptation and proprioceptive recalibration
during visuomotor learning. PLOS ONE 11, e0163695 (2016).
89. Langsdorf, L., Goehringer, F., Schween, R., Schenk, T. & Hegele, M. Additional cognitive load decreases performance but not
adaptation to a visuomotor transformation. Acta Psychol. Amst. 226, 103586 (2022).
90. Park, H.-D. & Blanke, O. Coupling inner and outer body for self-consciousness. Trends Cogn. Sci. 23, 377–388 (2019).
91. Bonnici, H. M., Cheke, L. G., Green, D. A. E., FitzGerald, T. H. M. B. & Simons, J. S. Specifying a causal role for angular gyrus
in autobiographical memory. J. Neurosci. 38, 10438–10443 (2018).
92 . de Boer, D. M. L., Johnston, P. J., Kerr, G., Meinzer, M. & Cleeremans, A. A causal role for the right angular gyrus in self-location
mediated perspective taking. Sci. Rep. 10, 19229 (2020).
93. Humphreys, G. F., Lambon-Ralph, M. A. & Simons, J. S. A unifying account of angular gyrus contributions to episodic and
semantic cognition. Trends Neurosci. 44, 452–463 (2021).
94. Bréchet, L., Grivaz, P., Gauthier, B. & Blanke, O. Common recruitment of angular gyrus in episodic autobiographical memory
and bodily self-consciousness. Front. Behav. Neurosci. 12, 270 (2018).
95. Simons, J. S., Ritchey, M. & Fernyhough, C. Brain mechanisms underlying the subjective experience of remembering. Annu.
Rev. Psychol. 73, 159–186 (2022).
96. Bergouignan, L., Nyberg, L. & Ehrsson, H. H. Out-of-body memory encoding causes third-person perspective at recall. J. Cogn.
Psychol. 2021, 1–19. https:// doi. org/ 10. 1080/ 20445 911. 2021. 19588 23 (2021).
97. Bögge, L., Colás-Blanco, I. & Piolino, P. Respiratory sinus arrhythmia during biofeedback is linked to persistent improvements
in attention, short-term memory, and positive self-referential episodic memory. Front. Neurosci. 16, 791498 (2022).
98. Monti, A., Porciello, G., Panasiti, M. S. & Aglioti, S. M. Gut markers of bodily self-consciousness in men. iScience 25, 105061
(2022).
99. Conway, M. A. Memory and the self. J. Mem. Lang. 53, 594–628 (2005).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
19
Vol.:(0123456789)
Scientic Reports | (2023) 13:17013 | https://doi.org/10.1038/s41598-023-43823-2
www.nature.com/scientificreports/
100. Yeh, D., Penaud, S., Scoriels, L., Krebs, M.-O. & Piolino, P. An Immersive Virtual Reality Study of the Modulation of Episodic
Memory of Naturalistic Events by the Minimal Self in Patients with a First Episode of Psychosis, in 26th Annual CyberPsychol-
ogy, Cybererapy & Social Networking Conference, 11-13 July, Paris (2023). https:// doi. org/ 10. 13140/ RG.2. 2. 19912. 08961
Acknowledgements
e authors thank Elizabeth Rowley-Jolivet for the English proofreading.
Author contributions
S.P. and P.P. conceptualized the experiments, D.Y. programmed the recognition task, A.G.B. created the virtual
environment, S.P. and A.G.B created the virtual events, S.P. conducted the experiments, S.P. conducted the analy-
sis, S.P. and P.P. wrote the original dra. P.P. supervised the experiment, S.P. and P.P. reviewed the manuscript.
Funding
SP received a PhD scholarship from the French Ministry of Higher Education, Research, and Innovation.is
article was published with the support of the faculty Sociétés & Humanités atUniversitéParis Cité.
Competing interests
e authors declare no competing interests.
Additional information
Supplementary Information e online version contains supplementary material available at https:// doi. org/
10. 1038/ s41598- 023- 43823-2.
Correspondence and requests for materials should be addressed to S.P.orP.P.
Reprints and permissions information is available at www.nature.com/reprints.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and
institutional aliations.
Open Access is article is licensed under a Creative Commons Attribution 4.0 International
License, which permits use, sharing, adaptation, distribution and reproduction in any medium or
format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the
Creative Commons licence, and indicate if changes were made. e images or other third party material in this
article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the
material. If material is not included in the article’s Creative Commons licence and your intended use is not
permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from
the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/.
© e Author(s) 2023
Content courtesy of Springer Nature, terms of use apply. Rights reserved
1.
2.
3.
4.
5.
6.
Terms and Conditions
Springer Nature journal content, brought to you courtesy of Springer Nature Customer Service Center GmbH (“Springer Nature”).
Springer Nature supports a reasonable amount of sharing of research papers by authors, subscribers and authorised users (“Users”), for small-
scale personal, non-commercial use provided that all copyright, trade and service marks and other proprietary notices are maintained. By
accessing, sharing, receiving or otherwise using the Springer Nature journal content you agree to these terms of use (“Terms”). For these
purposes, Springer Nature considers academic use (by researchers and students) to be non-commercial.
These Terms are supplementary and will apply in addition to any applicable website terms and conditions, a relevant site licence or a personal
subscription. These Terms will prevail over any conflict or ambiguity with regards to the relevant terms, a site licence or a personal subscription
(to the extent of the conflict or ambiguity only). For Creative Commons-licensed articles, the terms of the Creative Commons license used will
apply.
We collect and use personal data to provide access to the Springer Nature journal content. We may also use these personal data internally within
ResearchGate and Springer Nature and as agreed share it, in an anonymised way, for purposes of tracking, analysis and reporting. We will not
otherwise disclose your personal data outside the ResearchGate or the Springer Nature group of companies unless we have your permission as
detailed in the Privacy Policy.
While Users may use the Springer Nature journal content for small scale, personal non-commercial use, it is important to note that Users may
not:
use such content for the purpose of providing other users with access on a regular or large scale basis or as a means to circumvent access
control;
use such content where to do so would be considered a criminal or statutory offence in any jurisdiction, or gives rise to civil liability, or is
otherwise unlawful;
falsely or misleadingly imply or suggest endorsement, approval , sponsorship, or association unless explicitly agreed to by Springer Nature in
writing;
use bots or other automated methods to access the content or redirect messages
override any security feature or exclusionary protocol; or
share the content in order to create substitute for Springer Nature products or services or a systematic database of Springer Nature journal
content.
In line with the restriction against commercial use, Springer Nature does not permit the creation of a product or service that creates revenue,
royalties, rent or income from our content or its inclusion as part of a paid for service or for other commercial gain. Springer Nature journal
content cannot be used for inter-library loans and librarians may not upload Springer Nature journal content on a large scale into their, or any
other, institutional repository.
These terms of use are reviewed regularly and may be amended at any time. Springer Nature is not obligated to publish any information or
content on this website and may remove it or features or functionality at our sole discretion, at any time with or without notice. Springer Nature
may revoke this licence to you at any time and remove access to any copies of the Springer Nature journal content which have been saved.
To the fullest extent permitted by law, Springer Nature makes no warranties, representations or guarantees to Users, either express or implied
with respect to the Springer nature journal content and all parties disclaim and waive any implied warranties or warranties imposed by law,
including merchantability or fitness for any particular purpose.
Please note that these rights do not automatically extend to content, data or other material published by Springer Nature that may be licensed
from third parties.
If you would like to use or distribute our Springer Nature journal content to a wider audience or on a regular basis or in any other manner not
expressly permitted by these Terms, please contact Springer Nature at
onlineservice@springernature.com
... They have begun to successfully circumvent the issues of person-dependent (active role of participants, embodiment, and sense of agency) and situation-dependent factors (contextualization of the tasks), two traditional limitations of laboratory Similarly, the implication of the self in events, especially through the self-reference effect [78][79][80] , has a positive influence on memory: self-related stimuli tend to be better remembered than other-related ones (see for instance, for a recent study, Moses-Payne, et al. 9 ), and that effect is still present even when the self is slowly eroding (e.g. in Alzheimer's disease 81,82 ). In VR, a few studies have studied the self in relationship with memory (for a recent review, see Bréchet 83 ), hinting at a link between the bodily self and autobiographical memory 84 . Combined with an enhanced sense of presence in VR, the virtual enactment effect, stemming from sensorimotor and cognitive interaction in a VE, is defined as the effect on memory retrieval of one or more dimensions among "motor commands, proprioceptive information, vestibular information, decision-making, and allocation of attentional resources" 85 . ...
... A total of 30 participants was planned to be included in the study, based on similar previous studies examining long-term memory retention via VR (e.g., Foudil, et al. 25 , Penaud, et al 84 ., or Girardeau, et al 100 .). A power analysis for a Repeated Measures ANOVA (within factors; simple main effect of time) indicated that the minimum sample size to yield a statistical power of at least 0.8 with an alpha of 0.05 and a medium effect size (f = 0.25) is 28. ...
... They had different valences: 12 positive, 12 negative and 6 neutral; and could either be interacted with (highlighted object) or simply observed: 15 interactions and 15 observations. The specificity and emotional value of the events had previously been assessed in the laboratory 84 . All events had both visual detailed components and an audio track with appropriate sound (voices, noises related to the events…). ...
Article
Full-text available
Episodic autobiographical memory (EAM) is a long-term memory system of personally experienced events with their context – what, where, when – and subjective elements, e.g., emotions, thoughts, or self-reference. EAM formation has rarely been studied in a controlled, real-life-like paradigm, and there is no predictive model of long-term retrieval from self-rated subjective experience at encoding. The present longitudinal study, with three surprise free recall memory tests immediately, one-week and one-month after encoding, investigated incidental encoding of EAM in an immersive virtual environment where 30 participants either interacted with or observed specific events of varying emotional valences with simultaneous physiological recordings. The predictive analyses highlight the temporal dynamics of the predictors of EAM from subjective ratings at encoding: common characteristics related to sense of remembering and infrequency of real-life encounter of the event were identified over time, but different variables become relevant at different time points, such as the emotion and mental imagery or prospective aspects. This dynamic and time-dependent role of memory predictors challenges traditional views of a uniform influence of encoding factors over time. Current evidence for the multiphasic nature of memory formation points to the role of different mechanisms at play during encoding but also consolidation and subsequent retrieval.
... Emotion plays an integral role in memory formation. Previous work has shown that the emotional valence and arousal of an experience can influence remembering and forgetting (McGaugh, 2004) and that our brains prioritize emotional information to consolidate after sleep (Denis et al., 2022;Payne et al., 2008). While we often consider emotional experiences to be better remembered, gist versus detail trade-offs are known to occur, where the central aspect of a memory, or the gist, is better remembered while the details are more often forgotten (Kensinger, 2009;Loftus et al., 1987;Mather & Sutherland, 2011). ...
... Recent efforts to use more naturalistic paradigms can help us to elucidate better about how memory functions in the real-world: e.g., the effort of moving toward video and movie stimuli that are more dynamic and multimodal than static images (Bainbridge & Baker, 2022;Leal et al., 2019;Reagh & Ranganath, 2023). The use of tasks that measure beyond oversimplified principles of memory, including tasks that include more naturalistic stimuli, such as people of diverse racial and ethnic makeups (Mannion et al., 2023), the use of technological advancements, such as virtual and augmented reality (Iriye & St. Jacques, 2021;Penaud et al., 2023), and the use of real-world neural recordings in freely moving participants are essential toward tapping into episodic memory more holistically. Likewise, testing these paradigms in more diverse populations, including but not limited to diversity in terms of national origin, race and ethnicity, disability, age, sex and gender, education level, socioeconomic status, language, etc., and testing memory over extended time delays, will allow us to better comprehend typically occurring memory processes. ...
Article
Full-text available
Endel Tulving defined episodic memory as consisting of a spatiotemporal context. It enables us to recollect personal experiences of people, things, places, and situations. In other words, it is made up of what , where , and when components. However, this definition does not include arguably the most important aspect of episodic memory: the why . Understanding why we remember has important implications to better understand how our memory system works and as a potential target of intervention for memory impairment. The intrinsic and extrinsic factors related to why some experiences are better remembered than others have been widely investigated but largely independently studied. How these factors interact with one another to drive an event to become a lasting memory is still unknown. This review summarizes research examining the why of episodic memory, where we aim to uncover the factors that drive core features of our memory. We discuss the concept of episodic memory examining the what , where , and when , and how the why is essential to each of these key components of episodic memory. Furthermore, we discuss the neural mechanisms known to support our rich episodic memories and how a w hy signal may provide critical modulatory impact on neural activity and communication. Finally, we discuss the individual differences that may further drive why we remember certain experiences over others. A better understanding of these elements, and how we experience memory in daily life, can elucidate why we remember what we remember, providing important insight into the overarching goal of our memory system.
... However, there is still a lack of discussion on the relationship between XR and consumer memory. VR has been used as a context tool to create a naturalistic situation for assessing e.g., episodic memory (Penaud et al., 2023;Smith, 2019) and the everyday memory (Ouellet et al., 2018) of elders and patients, while AR has often been associated with spatial memory in education and training (e.g., Hoe et al., 2019;Munoz-Montoya et al., 2019;Yang et al., 2023). To pursue more heuristic thinking and to clarify the research questions, we reviewed the most relevant empirical studies that have examined how memory has been influenced by different XR technologies in various fields (see Table 1). ...
... However, due to the complexity of consumption and marketing management, it is difficult to apply these findings from diverse contexts to understand whether XR would influence information processing and storage for consumers, especially in daily-life business settings. Second, probably due to the difficulty in designing and developing different XR systems, the majority of relevant literature has mainly investigated a single technology (e.g., VR or AR) by comparing different design interfaces, content, interaction and perceptions (see e.g., 2D vs. 3D content, Lin et al., 2023;immersion, Smith & Mulligan, 2021; bodily self-consciousness, Penaud et al., 2023), rather than comparing the different experiences brought by the two XR technologies. Therefore, there is a lack of comprehensive understanding of the extent to which the "augmenting" and "replacing" features, respectively supported by AR and VR, may differentially and interactively influence consumers' memory. ...
Article
Full-text available
There are high expectations towards extended reality (XR), namely the “metaverse”. However, human performance in the metaverse has been called into question when undertaking everyday activities (e.g., working, shopping, and learning etc.), as complex human-technology interaction required may hinder cognitive abilities such as processing of information. Therefore, this study attempts to address whether and how XR impacts abilities to recall and recognize information in daily-life settings. We investigated the effects of VR and AR in a 2 (VR: yes vs. no) × 2 (AR: yes vs. no) between-subjects design experiment related to a shopping task (N = 153) on textual (product names) and pictorial (product pictures) recognition and recall. The results show that textual information recall and pictorial information recognition did not significantly suffer in XR compared to shopping in a brick-and-mortar store. While regarding textual information recognition performance, the results show that fully physical environments offered the highest performance compared to the different XR technologies being used. Overall, the study provides important findings and guidance for the use of extended reality technologies in consumer-facing businesses, as well as the use of XR in everyday life in general.
... Existing studies outline a strong link between body, memory, and emotions. For example, several studies showed that affective states (Apgáua & Jaeger, 2019;Auguste et al., 2023), visual feedback from one's own body Penaud et al., 2023), and shifts among ego and allocentric spatial perspectives (King et al., 2022) affect memory retrieval (and possibly memory formation, see Gauthier et al., 2020), resulting in changes in informational content and access to both the semantic and perceptual details of memory. Moreover, experiencing temporal blunting or stuck perception of time has been consistently linked to major depression (Thönes & Oberfeld, 2015;Vogel et al., 2018Vogel et al., , 2019. ...
Article
Perception of one's own body in time and space is a fundamental aspect of self-consciousness. It scaffolds our subjective experience of being present, in the here and now, a vital condition for our survival and well-being. Depersonalisation (DP) is characterized by a distressing feeling of being 'spaced out', detached from one's self, as well as atypical 'flat' time perception. Using an audio-tactile paradigm, we conducted a study looking at the effect of DP experiences on peripersonal space (PPS) - the space close to the body - and time perception. Strikingly, we found no difference in PPS perception in people with higher DP experiences (High DPe) versus low occurrences of DP experiences (Low DPe). To assess time perception, we used the Mental Time Travel (MTT) task measuring the individuals' capacity to take one's present as a reference point for situating personal versus general events in the past and the future. We found an overall poorer performance in locating events in time relative to their present reference point in High DPe. By contrast, Low DPe showed significant variation in performance when answering to relative past events, while High DPe did not. Our study sheds light on the close link between altered sense of self and egocentric spatiotemporal perception in individuals with DP experiences, the third most common psychological symptom in the general population.
... For both memory tests, participants will be asked to provide systematically and the most precisely possible, for each recalled event: description of the event, spatiotemporal situation, source, referent for the personal significance rating, perceptive and phenomenological details, degree of reliving or familiarity of the event. This task has been designed by Delphine Yeh under the supervision of Pascale Piolino, and derived from Sylvain Penaud's protocol for the procedures linked to the minimal self-reference [90]. The virtual environment has been developed by Alexandre Gaston-Bellegarde using Unity. ...
Article
Full-text available
Background Quantitative electroencephalography (EEG) analysis offers the opportunity to study high-level cognitive processes across psychiatric disorders. In particular, EEG microstates translate the temporal dynamics of neuronal networks throughout the brain. Their alteration may reflect transdiagnostic anomalies in neurophysiological functions that are impaired in mood, psychosis, and autism spectrum disorders, such as sensorimotor integration, speech, sleep, and sense of self. The main questions this study aims to answer are as follows: 1) Are EEG microstate anomalies associated with clinical and functional prognosis, both in resting conditions and during sleep, across psychiatric disorders? 2) Are EEG microstate anomalies associated with differences in sensorimotor integration, speech, sense of self, and sleep? 3) Can the dynamic of EEG microstates be modulated by a non-drug intervention such as light hypnosis? Methods This prospective cohort will include a population of adolescents and young adults, aged 15 to 30 years old, with ultra-high-risk of psychosis (UHR), first-episode psychosis (FEP), schizophrenia (SCZ), autism spectrum disorder (ASD), and major depressive disorder (MDD), as well as healthy controls (CTRL) (N = 21 × 6), who will be assessed at baseline and after one year of follow-up. Participants will undergo deep phenotyping based on psychopathology, neuropsychological assessments, 64-channel EEG recordings, and biological sampling at the two timepoints. At baseline, the EEG recording will also be coupled to a sensorimotor task and a recording of the characteristics of their speech (prosody and turn-taking), a one-night polysomnography, a self reference effect task in virtual reality (only in UHR, FEP, and CTRL). An interventional ancillary study will involve only healthy controls, in order to assess whether light hypnosis can modify the EEG microstate architecture in a direction opposite to what is seen in disease. Discussion This transdiagnostic longitudinal case–control study will provide a multimodal neurophysiological assessment of clinical dimensions (sensorimotor integration, speech, sleep, and sense of self ) that are disrupted across mood, psychosis, and autism spectrum disorders. It will further test the relevance of EEG microstates as dimensional functional biomarkers. Trial registration ClinicalTrials.gov Identifier NCT06045897.
Article
Full-text available
Background Self-disorders constitute a core feature of the schizophrenia spectrum, including early stages such as first-episode psychosis (FEP). These disorders impact the minimal Self, or bodily self-consciousness, which refers to the basic, pre-reflective sense of embodied experience. The minimal Self is intrinsically linked to episodic memory, which captures specific past experiences of the Self. However, research on this relationship in the schizophrenia spectrum remains scarce. This pilot study aimed to investigate how the minimal Self modulated episodic memory of naturalistic events in FEP, using immersive virtual reality. A secondary objective was to examine the relationships between sense of Self, embodiment, episodic memory, schizotypal personality traits in healthy participants (CTL), and psychopathology in FEP. Methods A full-body illusion was induced in 10 FEP and 35 matched CTL, using a first-person avatar, with synchronous or asynchronous visuomotor stimulation (strong or weak embodiment conditions, respectively). Following embodiment induction, participants navigated a virtual city and encountered naturalistic daily life events, which were incidentally encoded. Episodic memory of these events was assessed through a comprehensive recognition task (factual and contextual information, retrieval phenomenology). Sense of Self, schizotypal personality traits, and psychopathology were assessed via self-reported questionnaires or clinical assessments. Results Synchronous visuomotor stimulation successfully induced a stronger sense of embodiment in both FEP and CTL. The strong embodiment condition was associated with reduced perceived virtual space occupation by the body in FEP. Under strong embodiment, FEP performed significantly worse than CTL in contextual information recognition, but their ratings for retrieval phenomenology were comparable to CTL. Conversely, under weak embodiment, FEP performed similarly to CTL in contextual information recognition, but they rated retrieval phenomenology significantly lower. For CTL, we observed a slight, though non-significant, enhancement in recognition memory under strong compared to weak embodiment. Additionally, higher schizotypy in CTL correlated with a diminished sense of Self and poorer episodic memory. Conclusions Disturbances in the minimal Self in FEP are associated with episodic memory impairments. These findings emphasise the importance of targeting minimal Self-disorders in schizophrenia spectrum disorders, since episodic memory impairments may negatively affect patients’ quality of life and psychosocial outcomes. Additionally, they support a fully dimensional model of schizotypy.
Article
Vagally mediated heart rate variability (vmHRV) at resting state has been associated to cognitive functions dependent on cognitive control, such as memory. However, little is known about the phasic interaction between cognitive and autonomic control. In a pre‐registered within‐between‐subject designed experiment, the potential of vmHRV biofeedback to simultaneously stimulate vmHRV during memory processing and cognitive control over long‐term memory was tested, along with investigating psychophysiological association. 71 young healthy adults completed (twice) a false memory task in virtual reality. Immediately before memory encoding and retrieval, participants practiced either vmHRV biofeedback or a control breathing exercise. Cognitive control over long‐term memory was assessed as the confidence toward false memories and the capability to discriminate them from true memories. Resting‐state vmHRV before each test and phasic vmHRV during memory encoding and retrieval were measured as the root mean square differences (RMSSD) in the heart period. vmHRV biofeedback had neither an immediate effect on measures of cognitive control over long‐term memory nor on phasic RMSSD. Moreover, neither resting‐state nor phasic vmHRV correlated to the cognitive scores. Consequently, the utility of HRV biofeedback as a psychophysiological stimulation tool and a link between vmHRV and cognitive control over long‐term memory could not be verified. Exploratory analyses revealed that baseline shift in parasympathetic activity confounded the psychophysiological association. Future directions are provided that could shed light on the relationship between cognition and vmHRV.
Article
Full-text available
How is the fundamental sense of one’s body, a basic aspect of selfhood, incorporated into memories for events? Disrupting bodily self-awareness during encoding impairs functioning of the left posterior hippocampus during retrieval, which implies weakened encoding. However, how changes in bodily self-awareness influence neural encoding is unknown. We investigated how the sense of body ownership, a core aspect of the bodily self, impacts encoding in the left posterior hippocampus and additional core memory regions including the angular gyrus. Furthermore, we assessed the degree to which memories are reinstated according to body ownership during encoding and vividness during retrieval as a measure of memory strength. We immersed participants in naturalistic scenes where events unfolded while we manipulated feelings of body ownership with a full-body-illusion during functional magnetic resonance imaging scanning. One week later, participants retrieved memories for the videos during functional magnetic resonance imaging scanning. A whole brain analysis revealed that patterns of activity in regions including the right hippocampus and angular gyrus distinguished between events encoded with strong versus weak body ownership. A planned region-of-interest analysis showed that patterns of activity in the left posterior hippocampus specifically could predict body ownership during memory encoding. Using the wider network of regions sensitive to body ownership during encoding and the left posterior hippocampus as separate regions-of-interest, we observed that patterns of activity present at encoding were reinstated more during the retrieval of events encoded with strong body ownership and high memory vividness. Our results demonstrate how the sense of physical self is bound within an event during encoding, which facilitates reactivation of a memory trace during retrieval.
Chapter
Full-text available
This chapter will provide a review of research into human cognition through the lens of VR-based paradigms for studying memory. Emphasis is placed on why VR increases the ecological validity of memory research and the implications of such enhancements.KeywordsVirtual realityCognitionMemoryCognitive enhancementMemory enhancementCognitive assessmentsMemory assessmentsCognitive rehabilitationMemory rehabilitationEmbodied cognitionEmbodied memoryExtended cognitionExtended memoryEnvironmental enrichment
Preprint
Full-text available
Every event we experience that results in a memory involves experiencing our conscious self at its heart. The spatial and perceptual experience of one's own body is the most basic form of selfhood. Disrupting bodily selfhood during memory formation impairs functioning of the hippocampus during retrieval, which implies a weakening of encoding mechanisms. However, neural activity present as individuals encode memories during manipulations of bodily selfhood have yet to be assessed. We investigated how body ownership, a core aspect of bodily selfhood, impacts encoding processes in the hippocampus and additional core memory regions (e.g. posterior parietal cortex). Further, we assessed the degree to which memories are reinstated according to body ownership during encoding and vividness during retrieval as a measure of memory strength. Participants viewed immersive videos through VR glasses, which depicted everyday events that included a first-person view of a mannequin's body aligned with participants' real bodies during fMRI scanning. We manipulated feelings of body ownership over the mannequin using a perceptual full-body illusion. One week later, participants retrieved memories for the videos during fMRI scanning. We observed that patterns of activity in several regions including the hippocampus and posterior parietal cortex distinguished between videos encoded with strong versus weak illusory body ownership. Moreover, these same regions reinstated memories to a greater degree when they were formed with a strong sense of body ownership and retrieved with increasing levels of vividness. Our findings demonstrate how the fundamental sense of owning one's body shape neural signatures of memory formation and strengthen reinstatement at retrieval.
Article
Full-text available
Background Heart rate variability (HRV) biofeedback, an intervention based on the voluntary self-regulation of autonomic parameters, has been shown to affect prefrontal brain functioning and improve executive functions. The interest in using HRV biofeedback as cognitive training is typically ascribed to parasympathetic activation and optimized physiological functioning deriving from increased cardiac vagal control. However, the persistence of cognitive effects is poorly studied and their association with biofeedback-evoked autonomic changes has not yet been explored. In addition, no study has so far investigated the influence of HRV biofeedback in adults on long-term episodic memory, which is particularly concerned with self-referential encoding processing. Methods In the present study, a novel training system was developed integrating HRV and respiratory biofeedback into an immersive virtual reality environment to enhance training efficacy. Twenty-two young healthy adults were subjected to a blinded randomized placebo-controlled experiment, including six self-regulation training sessions, to evaluate the effect of biofeedback on autonomic and cognitive changes. Cardiac vagal control was assessed before, during, and 5 min after each training session. Executive functions, episodic memory, and the self-referential encoding effect were evaluated 1 week before and after the training program using a set of validated tasks. Results Linear mixed-effects models showed that HRV biofeedback greatly stimulated respiratory sinus arrhythmia during and after training. Moreover, it improved the attentional capabilities required for the identification and discrimination of stimuli (ηp2 = 0.17), auditory short-term memory (ηp2 = 0.23), and self-referential episodic memory recollection of positive stimuli (ηp2 = 0.23). Episodic memory outcomes indicated that HRV biofeedback reinforced positive self-reference encoding processing. Cognitive changes were strongly dependent on the level of respiratory sinus arrhythmia evoked during self-regulation training. Conclusion The present study provides evidence that biofeedback moderates respiration-related cardiac vagal control, which in turn mediates improvements in several cognitive processes crucial for everyday functioning including episodic memory, that are maintained beyond the training period. The results highlight the interest in HRV biofeedback as an innovative research tool and medication-free therapeutic approach to affect autonomic and neurocognitive functioning. Finally, a neurocognitive model of biofeedback-supported autonomic self-regulation as a scaffolding for episodic memory is proposed.
Article
Full-text available
Bodily self-consciousness, the state of mind that allows humans to be aware of their own body, forms the backdrop for almost every human experience, yet its underpinnings remain elusive. Here we combine an ingestible, minimally invasive capsule with surface electrogastrography to probe if gut physiology correlates with bodily self-consciousness in a sample of healthy men during a virtual bodily illusion. We discover that specific patterns of stomach and bowel activity (temperature, pressure, and pH) covary with specific facets of bodily self-consciousness (feelings of body location, agency, and disembodiment). These results uncover the hitherto untapped potential of minimally invasive probes to study the link between mental and gut states, and show the significance of deep visceral organs in the self-conscious perception of ourselves as embodied beings.
Article
Full-text available
Sigmund Freud famously noted some memories are recalled with a perspective of “an observer from outside the scene”. According to Freud—and most memory researchers today—the third-person perspective occurs due to reconstructive processes at recall. An alternative possibility is that the third-person perspective have been adopted when the actual event is experienced and later recalled in its original form. Here we test this hypothesis using a perceptual out-of-body illusion during the encoding of real events. Participants took part in a social interaction while experiencing an out-of-body illusion where they viewed the event and their own body from a third-person perspective. In recall sessions ∼1 week later, events encoded in the out-of-body compared to the in-body control condition were significantly less recalled from a first-person perspective. An out-of-body experience leads to more third-person perspective during recollection.
Article
Full-text available
How do our bodies influence who we are? Recent research in cognitive neuroscience has examined consciousness associated with the self and related multisensory processing of bodily signals, the so-called bodily self-consciousness. A parallel line of research has highlighted the concept of the autobiographical self and the associated autonoetic consciousness, which enables us to mentally travel in time. The subjective re-experiencing of past episodes is described as re-living them from within or outside one’s body. In this brief perspective, I aim to explore the underlying characteristics of self-consciousness and its relation to bodily signals and episodic memory. I will outline some recent behavioral and neuroimaging evidence indicating that bodily cues play a fundamental role in autobiographical memory. Finally, I will discuss these emerging concepts regarding the current understanding of bodily-self, autobiographical-self, their links to self-consciousness, and suggest directions for future research.
Article
Full-text available
Grid cells in entorhinal cortex (EC) encode an individual’s location in space and rely on environmental cues and self-motion cues derived from the individual’s body. Body-derived signals are also primary signals for the sense of self and based on integrated sensorimotor signals (proprioceptive, tactile, visual, motor) that have been shown to enhance self-centered processing. However, it is currently unknown whether such sensorimotor signals that modulate self-centered processing impact grid cells and spatial navigation. Integrating the online manipulation of bodily signals, to modulate self-centered processing, with a spatial navigation task and an fMRI measure to detect grid cell-like representation (GCLR) in humans, we report improved performance in spatial navigation and decreased GCLR in EC. This decrease in entorhinal GCLR was associated with an increase in retrosplenial cortex activity, which was correlated with participants’ navigation performance. These data link self-centered processes during spatial navigation to entorhinal and retrosplenial activity and highlight the role of different bodily factors at play when navigating in VR. fMRI recordings from human participants manipulating a virtual avatar in a spatial navigation task show higher performance, but lower grid cell-like activity, compared to the navigation where no avatar is visible.
Article
Full-text available
Dual-task paradigms are procedures for investigating interference with two tasks performed simultaneously. Studies that previously addressed dual-task paradigms within a visuomotor reaching task yielded mixed results. While some of the studies found evidence of cognitive interference, called dual-task costs, other studies did not. We assume that dual-task costs only manifest themselves within the explicit component of adaptation, as it involves cognitive resources for processing. We suspect the divergent findings to be due to the lack of differentiation between the explicit and implicit component. In this study, we aimed to investigate how a cognitive secondary task affects visuomotor adaptation overall and its different components, both during and after adaptation. In a series of posttests, we examined the explicit and implicit components separately. Eighty participants performed a center-outward reaching movement with a 30° cursor perturbation. Participants were either assigned to a single task group (ST) or a dual-task group (DT) with an additional auditory 1-back task. To further enhance our predicted effect of dual-task interference on the explicit component, we added a visual feedback delay condition to both groups (ST/DTDEL). In the other condition, participants received visual feedback immediately after movement termination (ST/DTNoDEL). While there were clear dual-task costs during the practice phase, there were no dual-task effects on any of the posttest measures. On one hand, our findings suggest that dual-task costs in visuomotor adaptation tasks can occur with sufficient cognitive demand, and on the other hand, that cognitive constraints may affect motor performance but not necessarily motor adaptation.