Retinotopic memory is more precise than spatiotopic memory

McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
Proceedings of the National Academy of Sciences (Impact Factor: 9.67). 01/2012; 109(5):1796-801. DOI: 10.1073/pnas.1113168109
Source: PubMed


Successful visually guided behavior requires information about spatiotopic (i.e., world-centered) locations, but how accurately is this information actually derived from initial retinotopic (i.e., eye-centered) visual input? We conducted a spatial working memory task in which subjects remembered a cued location in spatiotopic or retinotopic coordinates while making guided eye movements during the memory delay. Surprisingly, after a saccade, subjects were significantly more accurate and precise at reporting retinotopic locations than spatiotopic locations. This difference grew with each eye movement, such that spatiotopic memory continued to deteriorate, whereas retinotopic memory did not accumulate error. The loss in spatiotopic fidelity is therefore not a generic consequence of eye movements, but a direct result of converting visual information from native retinotopic coordinates. Thus, despite our conscious experience of an effortlessly stable spatiotopic world and our lifetime of practice with spatiotopic tasks, memory is actually more reliable in raw retinotopic coordinates than in ecologically relevant spatiotopic coordinates.

Full-text preview

Available from:
  • Source
    • "remapping visual features relative to gaze (Prime et al., 2006, 2007, 2011; Melcher & Colby, 2008; Golomb & Kanwisher, 2011). "
    [Show abstract] [Hide abstract]
    ABSTRACT: Humans typically make several rapid eye movements (saccades) per second. It is thought that visual working memory can retain and spatially integrate three to four objects or features across each saccade but little is known about this neural mechanism. Previously we showed that transcranial magnetic stimulation (TMS) to the posterior parietal cortex and frontal eye fields degrade trans-saccadic memory of multiple object features (Prime, Vesia, & Crawford, 2008, 2010). Here, we used a similar protocol to investigate whether dorsolateral prefrontal cortex (DLPFC), an area involved in spatial working memory, is also involved in trans-saccadic memory. Subjects were required to report changes in stimulus orientation with (saccade task) or without (fixation task) an eye movement in the intervening memory interval. We applied single-pulse TMS to left and right DLPFC during the memory delay, timed at three intervals to arrive approximately 100ms before, 100ms after, or at saccade onset. In the fixation task, left DLPFC TMS produced inconsistent results, whereas right DLPFC TMS disrupted performance at all three intervals (significantly for presaccadic TMS). In contrast, in the saccade task, TMS consistently facilitated performance (significantly for left DLPFC / perisaccadic TMS and right DLPFC / postsaccadic TMS) suggesting a dis-inhibition of trans-saccadic processing. These results are consistent with a neural circuit of trans-saccadic memory that overlaps and interacts with, but is partially separate from the circuit for visual working memory during sustained fixation.
    Neuropsychologia 09/2014; 63. DOI:10.1016/j.neuropsychologia.2014.08.025 · 3.30 Impact Factor
  • Source
    • "They observed that eccentric head roll increases the variability in subjects' ability to discriminate visual object location, as indicated by increased thresholds. Golomb and Kanwisher (2012a) tested a spatial working memory task in which subjects remembered a cued location in spatiotopic or retinotopic coordinates while making saccadic eye movements during the memory delay. Subjects were more precise at reporting retinotopic rather than spatiotopic location. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Judging object trajectory during self-motion is a fundamental ability for mobile organisms interacting with their environment. This fundamental ability requires the nervous system to compensate for the visual consequences of self-motion in order to make accurate judgments, but the mechanisms of this compensation are poorly understood. We comprehensively examined both the accuracy and precision of observers' ability to judge object trajectory in the world when self-motion was defined by vestibular, visual, or combined visual-vestibular cues. Without decision feedback, subjects demonstrated no compensation for self-motion that was defined solely by vestibular cues, partial compensation (47%) for visually defined self-motion, and significantly greater compensation (58%) during combined visual-vestibular self-motion. With decision feedback, subjects learned to accurately judge object trajectory in the world, and this generalized to novel self-motion speeds. Across conditions, greater compensation for self-motion was associated with decreased precision of object trajectory judgments, indicating that self-motion compensation comes at the cost of reduced discriminability. Our findings suggest that the brain can flexibly represent object trajectory relative to either the observer or the world, but a world-centered representation comes at the cost of decreased precision due to the inclusion of noisy self-motion signals.
    Cerebral Cortex 09/2013; 25(3). DOI:10.1093/cercor/bht247 · 8.67 Impact Factor
  • Source
    • "We make no claim here as to the manner in which locations are memorized on their own. Locations could be represented either relative to the current fixation point [62], to each other [63] or relative to the scene and context [44], [45], [64]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Although we frequently take advantage of memory for objects locations in everyday life, understanding how an object's identity is bound correctly to its location remains unclear. Here we examine how information about object identity, location and crucially object-location associations are differentially susceptible to forgetting, over variable retention intervals and memory load. In our task, participants relocated objects to their remembered locations using a touchscreen. When participants mislocalized objects, their reports were clustered around the locations of other objects in the array, rather than occurring randomly. These 'swap' errors could not be attributed to simple failure to remember either the identity or location of the objects, but rather appeared to arise from failure to bind object identity and location in memory. Moreover, such binding failures significantly contributed to decline in localization performance over retention time. We conclude that when objects are forgotten they do not disappear completely from memory, but rather it is the links between identity and location that are prone to be broken over time.
    PLoS ONE 10/2012; 7(10):e48214. DOI:10.1371/journal.pone.0048214 · 3.23 Impact Factor
Show more