Visual Memory Capacity in Transsaccadic Integration

Total Page:16

File Type:pdf, Size:1020Kb

Visual Memory Capacity in Transsaccadic Integration Exp Brain Res (2007) 180:609–628 DOI 10.1007/s00221-007-0885-4 RESEARCH ARTICLE Visual memory capacity in transsaccadic integration Steven L. Prime Æ Lia Tsotsos Æ Gerald P. Keith Æ J. Douglas Crawford Received: 14 June 2006 / Accepted: 9 January 2007 / Published online: 16 February 2007 Ó Springer-Verlag 2007 Abstract How we perceive the visual world as stable by inputting a noisy extra-retinal signal into an eye- and unified suggests the existence of transsaccadic centered feature map. Our results suggest that trans- integration that retains and integrates visual informa- saccadic memory has a similar capacity for storing tion from one eye fixation to another eye fixation simple visual features as basic visual memory, but this across saccadic eye movements. However, the capacity capacity is dependent both on the metrics of the sac- of transsaccadic integration is still a subject of con- cade and allocation of attention. troversy. We tested our subjects’ memory capacity of two basic visual features, i.e. luminance (Experiment 1) Keywords Visual perception Á Saccades Á Visual and orientation (Experiment 2), both within a single working memory fixation (i.e. visual working memory) and between separate fixations (i.e. transsaccadic memory). Exper- iment 2 was repeated, but attention allocation was Introduction manipulated using attentional cues at either the target or distracter (Experiment 3). Subjects were able to A central question in cognitive neuroscience is how we retain 3–4 objects in transsaccadic memory for lumi- perceive a unified and continuous visual world despite nance and orientation; errors generally increased as viewing it in a disjointed and discontinuous manner. saccade size increased; and, subjects were more accu- The typical observer makes 2–5 eye movements, called rate when attention was allocated to the same location saccades, per second (Rayner 1978, 1998). This means as the impending target. These results were modelled that a visual scene is processed in what is often per- ceived as discrete ‘snapshots’ during eye fixations of approximately 300 ms between saccades (Henderson S. L. Prime Á G. P. Keith Á J. D. Crawford (&) Centre for Vision Research, York University, and Hollingworth 1998). In some way, the brain retains 4700 Keele Street, Toronto, ON, Canada M3J 1P3 and integrates visual input from each eye fixation to e-mail: [email protected] form a unified mental percept of the visual sce- ne—often this leaves observers with the impression S. L. Prime Á G. P. Keith Á J. D. Crawford CIHR Group for Action and Perception, that their perception of the visual world is much like York University, 4700 Keele Street, putting together a jigsaw puzzle. This process is called Toronto, ON, Canada M3J 1P3 transsaccadic integration (e.g. Irwin 1991; Prime et al. 2006). S. L. Prime Á G. P. Keith Á J. D. Crawford Department of Psychology, York University, A related, but separate, process that is necessary for 4700 Keele Street, Toronto, ON, Canada M3J 1P3 transsaccadic integration is transsaccadic memory: the ability to retain information from previous fixations. L. Tsotsos Á J. D. Crawford However, the capacity of such memory is a much- Department of Biology and Kinesiology and Health Sciences, York University, debated topic. Some early studies assumed that de- 4700 Keele Street, Toronto, ON, Canada M3J 1P34 tailed visual information is retained across saccades 123 610 Exp Brain Res (2007) 180:609–628 in an internal ‘spatial buffer’ (Jonides et al. 1982; when reporting on the object closest to the next to-be- McConkie and Rayner 1976). Evidence of the exis- fixated target (i.e. saccade-target). This finding has tence of such a highly detailed spatial buffer has been since been replicated and expanded in several other questioned by several studies (Bridgeman and Mayer studies (Currie et al. 2000; Henderson and Holling- 1983; Irwin et al. 1983; McConkie and Zola 1979; worth 1999; McConkie and Currie 1996). This has led O’Regan and Levy-Schoen 1983; Rayner and Pollatsek to the suggestion that the allocation of attention to 1983). In particular, it has been noted that observers intended saccade-targets plays a crucial role in trans- are largely insensitive to unexpected changes in the saccadic integration—the ‘saccade-target’ theory (see visual scene that occur during saccades and other visual Deubel and Schneider 1996; Kowler et al. 1995). disruptions (Grimes 1996; Simons 1996; Simons and Several important questions remain. First, in most Levin 1997; O’Regan et al. 2000; Rensink et al. 1997). previous studies of transsaccadic memory, the These ‘change blindness’ experiments have questioned remembered objects, such as letters and toys, had the very existence of transsaccadic memory and semantic meaning for human subjects (e.g. Irwin and prompted some researchers to propose that visual Zelinsky 2002; cf. Carlson et al. 2001; Deubel et al. memory is essentially wiped clean with the acquisition 2002). It is possible that these stimuli engaged memory of a new fixation after an eye movement (Bridgeman systems or top–down processes that are not available to et al. 1994; O’Regan 1992; Tatler 2001). early vision. Moreover, while this may show that However, there are other explanations for trans- meaningful objects can be retained across saccades saccadic change blindness that do not rely on the (e.g., for the purpose of complex scene analysis), little assumption that memory is wiped clean (Niemeier is still known how many pre-semantic visual features et al. 2003). Moreover, a ‘‘no memory’’ theory of visual can be stored, for example to recognize larger objects search is inconsistent with evidence that scene per- that are not visible in a single fixation. Second, a few ception is more accurate when observers are free to studies have shown evidence of transsaccadic memory make eye movements (Schilingensiepen et al. 1986) in the absence of allocentric cues (De Graef et al. 2001; requiring an accumulation of visual information across Hayhoe et al. 1991; Verfaillie 1997). However, in these saccades during visual search (McCarley et al. 2003; studies allocentric spatial cues were not entirely elim- Peterson et al. 2001) even for more complex natural inated and remained visible across saccades (e.g. the scenes (Melcher 2001; Tatler et al. 2003, 2005). edges of the computer monitor), which likely aided in Most recent studies propose an intermediate view of solving the problem of spatial correspondence between transsaccadic memory, where some, but not all infor- pre- and post-saccadic stimuli. Moreover, accuracy in mation is retained across saccades to influence pro- the transsaccadic integration study by Hayhoe et al. cessing of visual information in subsequent fixations (1991) still depended on a reference point remaining (e.g. Pollatsek et al. 1984; Rayner and Pollatsek 1983; present during the saccade trials for performance to be Rayner et al. 1980). It is well known that visual on par with a similar fixation condition. Thus, it is still working memory can maintain about four objects each unknown if transsaccadic memory has the same as units of integrated feature conjunctions (Luck and capacity when forced to rely on the egocentric sense of Vogel 1997; Vogel et al. 2001), depending on the eye movement. It is also not known how saccade complexity of the object’s features (Alvarez and Cav- metrics might influence this process. If signals from the anagh 2004). These studies, however, did not take into oculomotor system are used to ‘update’ visual memory, account eye movements during the memory delay then one would expect performance to degrade with interval. If transsaccadic memory does not exist as saccade size, because larger saccades are underrepre- suggested by some of the studies mentioned earlier sented compared to smaller saccades in oculomotor (e.g. O’Regan 1992), subjects in the study by Luck and topography (Gandhi and Keller 1999; Robinson 1972; Vogel (1997), for example, should have difficulty in Sparks and Hartwich-Young 1989). maintaining objects in memory when a saccade is ad- Finally, in previous studies, the attended location ded to the task. This does not seem to be the case. usually coincided with the target of the next saccade; Irwin and colleagues have found that subjects can re- thus, little is still known how the dissociation of tain up to 3–4 objects when cued to remember several attention from the saccade-target modulates trans- visual stimuli across saccades (Irwin 1992; Irwin and saccadic memory. One exception is a study by Irwin Andrews 1996; Irwin and Gordon 1998). and Gordon (1998). They manipulated their subjects’ Moreover, these studies by Irwin and colleagues attention by instructing subjects to pay attention to a (Irwin 1992; Irwin and Andrews 1996; Irwin and Gor- particular location of a stimulus array about to be don 1998) have found that subjects were most accurate presented. In the present study, however, we used a 123 Exp Brain Res (2007) 180:609–628 611 more rigorous method of manipulating attention by not the case. Another possibility may be that the two using exogenous cues intended to draw the subjects’ memory systems are identical except transsaccadic attention to a specific stimulus—either the critical to- memory preferentially retains items related to the be-remembered target or a distracter—rather than a saccade due to attention (e.g. Kowler et al. 1995). If general location as in Irwin and Gordon (1998). this were the case we would expect judgement accuracy In a recent paper we showed that humans can spa- of unattended items (e.g. unrelated to the saccade) to tially retain and integrate a single pre-saccadic feature be at chance. However, this did not occur in our study; with a single post-saccadic feature in the absence of non-saccade targets were remembered above chance any allocentric visual cues, although small errors oc- for at least 3–4 objects.
Recommended publications
  • Functions of Memory Across Saccadic Eye Movements
    Functions of Memory Across Saccadic Eye Movements David Aagten-Murphy and Paul M. Bays Contents 1 Introduction 2 Transsaccadic Memory 2.1 Other Memory Representations 2.2 Role of VWM Across Eye Movements 3 Identifying Changes in the Environment 3.1 Detection of Displacements 3.2 Object Continuity 3.3 Visual Landmarks 3.4 Conclusion 4 Integrating Information Across Saccades 4.1 Transsaccadic Fusion 4.2 Transsaccadic Comparison and Preview Effects 4.3 Transsaccadic Integration 4.4 Conclusion 5 Correcting Eye Movement Errors 5.1 Corrective Saccades 5.2 Saccadic Adaptation 5.3 Conclusion 6 Discussion 6.1 Optimality 6.2 Object Correspondence 6.3 Memory Limitations References Abstract Several times per second, humans make rapid eye movements called saccades which redirect their gaze to sample new regions of external space. Saccades present unique challenges to both perceptual and motor systems. During the move- ment, the visual input is smeared across the retina and severely degraded. Once completed, the projection of the world onto the retina has undergone a large-scale spatial transformation. The vector of this transformation, and the new orientation of D. Aagten-Murphy (*) and P. M. Bays University of Cambridge, Cambridge, UK e-mail: [email protected] © Springer Nature Switzerland AG 2018 Curr Topics Behav Neurosci DOI 10.1007/7854_2018_66 D. Aagten-Murphy and P. M. Bays the eye in the external world, is uncertain. Memory for the pre-saccadic visual input is thought to play a central role in compensating for the disruption caused by saccades. Here, we review evidence that memory contributes to (1) detecting and identifying changes in the world that occur during a saccade, (2) bridging the gap in input so that visual processing does not have to start anew, and (3) correcting saccade errors and recalibrating the oculomotor system to ensure accuracy of future saccades.
    [Show full text]
  • Binding of Visual Features in Human Perception and Memory
    BINDING OF VISUAL FEATURES IN HUMAN PERCEPTION AND MEMORY SNEHLATA JASWAL Thesis presented for the degree of Doctor of Philosophy The University of Edinburgh 2009 Dedicated to my parents PhD – The University of Edinburgh – 2009 DECLARATION I declare that this thesis is my own composition, and that the material contained in it describes my own work. It has not been submitted for any other degree or professional qualification. All quotations have been distinguished by quotation marks and the sources of information acknowledged. Snehlata Jaswal 31 August 2009 PhD – The University of Edinburgh – 2009 ACKNOWLEDGEMENTS Adamant queries are a hazy recollection Remnants are clarity, insight, appreciation A deep admiration, love, infinite gratitude For revered Bob, John, and Jim One a cherished guide, ideal teacher The other a personal idol, surrogate mother Both inspiring, lovingly instilled certitude Jagat Sir and Ritu Ma’am A sister sought new worlds to conquer A daughter left, enticed by enchanter Yet showered me with blessings multitude My family, Mum and Dad So many more, whispers the breeze Without whom, this would not be Mere mention is an inane platitude For treasured friends forever PhD – The University of Edinburgh – 2009 1 CONTENTS ABSTRACT.......................................................................................................................................... 5 LIST OF FIGURES ............................................................................................................................. 6 LIST OF ABBREVIATIONS.............................................................................................................
    [Show full text]
  • Visual Scene Perception
    Galley: Article - 00632 Level 1 Visual Scene Perception Helene Intraub, University of Delaware, Newark, Delaware, USA CONTENTS Introduction Transsaccadic memory Scene comprehension and its influence on object Perception of `gist' versus details detection Boundary extension When studying a scene, viewers can make as many a single glimpse without any bias from prior con- as three or four eye fixations per second. A single text. Immediately after viewing a rapid sequence fixation is typically enough to allow comprehension like this, viewers participate in a recognition test. of a scene. What is remembered, however, is not a The pictures they just viewed are mixed with new photographic replica, but a more abstract mental pictures and are slowly presented one at a time. representation that captures the `gist' and general The viewers' task is to indicate which pictures they layout of the scene along with a limited amount of detail. remember seeing before. Following rapid presenta- tion, memory for the previously seen pictures is rather poor. For example, when 16 pictures were INTRODUCTION presented in this way, moments later, viewers were only able to recognize about 40 to 50 per 0632.001 The visual world exists all around us, but physio- logical constraints prevent us from seeing it all at cent in the memory test. One explanation is that once. Eye movements (called saccades) shift the they were only able to perceive about 40 to 50 per position of the eye as quickly as three or four cent of the scenes that had flashed by and those times per second. Vision is suppressed during were the scenes they remembered.
    [Show full text]
  • Retinotopic Memory Is More Precise Than Spatiotopic Memory
    Retinotopic memory is more precise than spatiotopic memory Julie D. Golomb1 and Nancy Kanwisher McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 Edited by Tony Movshon, New York University, New York, NY, and approved December 14, 2011 (received for review August 10, 2011) Successful visually guided behavior requires information about spa- possible that stability could be achieved on the basis of retinotopic- tiotopic (i.e., world-centered) locations, but how accurately is this plus-updating alone. information actually derived from initial retinotopic (i.e., eye-centered) Most current theories of visual stability favor some form of visual input? We conducted a spatial working memory task in which retinotopic-plus-updating, but they vary widely in how quickly, subjects remembered a cued location in spatiotopic or retinotopic automatically, or successfully this updating might occur. For coordinates while making guided eye movements during the memory example, several groups have demonstrated that locations can be delay. Surprisingly, after a saccade, subjects were significantly more rapidly “remapped,” sometimes even in anticipation of an eye accurate and precise at reporting retinotopic locations than spatiotopic movement (20–22), but a recent set of studies has argued that locations. This difference grew with each eye movement, such that updating requires not only remapping to the new location, but spatiotopic memory continued to deteriorate, whereas retinotopic also extinguishing the representation at the previous location, memory did not accumulate error. The loss in spatiotopic fidelity and this latter process may occur on a slower time scale (23, 24). is therefore not a generic consequence of eye movements, but a Moreover, it is an open question just how accurate we are at direct result of converting visual information from native retinotopic spatiotopic perception.
    [Show full text]
  • Copyright 2013 Jeewon Ahn
    Copyright 2013 JeeWon Ahn THE CONTRIBUTION OF VISUAL WORKING MEMORY TO PRIMING OF POP-OUT BY JEEWON AHN DISSERTATION Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Psychology in the Graduate College of the University of Illinois at Urbana-Champaign, 2013 Urbana, Illinois Doctoral Committee: Associate Professor Alejandro Lleras, Chair Professor John E. Hummel Professor Arthur F. Kramer Professor Daniel J. Simons Associate Professor Diane M. Beck ABSTRACT Priming of pop-out (PoP) refers to the facilitation in performance that occurs when a target- defining feature is repeated across consecutive trials in a pop-out singleton search task. While the underlying mechanism of PoP has been at the center of debate, a recent finding (Lee, Mozer, & Vecera, 2009) has suggested that PoP relies on the change of feature gain modulation, essentially eliminating the role of memory representation as an explanation for the underlying mechanism of PoP. The current study aimed to test this proposition to determine whether PoP is truly independent of guidance based on visual working memory (VWM) by adopting a dual-task paradigm composed of a variety of both pop-out search and VWM tasks. First, Experiment 1 tested whether the type of information represented in VWM mattered in the interaction between PoP and the VWM task. Experiment 1A aimed to replicate the previous finding, adopting a design almost identical to that of Lee et al., including a VWM task to memorize non-spatial features. Experiment 1B tested a different type of VWM task involving remembering spatial locations instead of non-spatial colors.
    [Show full text]
  • Scene and Position Specificity in Visual Memory for Objects
    Journal of Experimental Psychology: Copyright 2006 by the American Psychological Association Learning, Memory, and Cognition 0278-7393/06/$12.00 DOI: 10.1037/0278-7393.32.1.58 2006, Vol. 32, No. 1, 58–69 Scene and Position Specificity in Visual Memory for Objects Andrew Hollingworth University of Iowa This study investigated whether and how visual representations of individual objects are bound in memory to scene context. Participants viewed a series of naturalistic scenes, and memory for the visual form of a target object in each scene was examined in a 2-alternative forced-choice test, with the distractor object either a different object token or the target object rotated in depth. In Experiments 1 and 2, object memory performance was more accurate when the test object alternatives were displayed within the original scene than when they were displayed in isolation, demonstrating object-to-scene binding. Experiment 3 tested the hypothesis that episodic scene representations are formed through the binding of object representations to scene locations. Consistent with this hypothesis, memory performance was more accurate when the test alternatives were displayed within the scene at the same position originally occupied by the target than when they were displayed at a different position. Keywords: visual memory, scene perception, context effects, object recognition Humans spend most of their lives within complex visual envi- that work on scene perception and memory often assumes the ronments, yet relatively little is known about how natural scenes existence of scene-level representations (e.g., Hollingworth & are visually represented in the brain. One of the central issues in Henderson, 2002).
    [Show full text]
  • SINCLAIR-THESIS-2019.Pdf
    COGNITIVE MECHANISMS OF TRANSSACCADIC PERCEPTION A Thesis Submitted to the College of Graduate and Postdoctoral Studies In Partial Fulfillment of the Requirements For the Degree of Master of Arts In the Department of Psychology University of Saskatchewan Saskatoon By AMANDA SINCLAIR © Copyright Amanda Jane Sinclair, September 2019. All rights reserved. PERMISSION TO USE In presenting this thesis/dissertation in partial fulfillment of the requirements for a Postgraduate degree from the University of Saskatchewan, I agree that the Libraries of this University may make it freely available for inspection. I further agree that permission for copying of this thesis/dissertation in any manner, in whole or in part, for scholarly purposes may be granted by the professor or professors who supervised my thesis/dissertation work or, in their absence, by the Head of the Department or the Dean of the College in which my thesis work was done. It is understood that any copying or publication or use of this thesis/dissertation or parts thereof for financial gain shall not be allowed without my written permission. It is also understood that due recognition shall be given to me and to the University of Saskatchewan in any scholarly use which may be made of any material in my thesis/dissertation. DISCLAIMER Reference in this thesis/dissertation to any specific commercial products, process, or service by trade name, trademark, manufacturer, or otherwise, does not constitute or imply its endorsement, recommendation, or favoring by the University of Saskatchewan. The views and opinions of the author expressed herein do not state or reflect those of the University of Saskatchewan, and shall not be used for advertising or product endorsement purposes.
    [Show full text]
  • Transsaccadic Memory: Building a Stable World from Glance to Glance
    Elsevier AMS Ch10-I044980 Job code: EMAW 14-2-2007 1:06p.m. Page:213 Trimsize:165×240MM Chapter 10 TRANSSACCADIC MEMORY: BUILDING A STABLE WORLD FROM GLANCE TO GLANCE DAVID MELCHER Oxford Brookes University, UK, and University of Trento, Italy CONCETTA MORRONE San Raffaele University and Institute of Neuroscience of the National Research Council, Italy Eye Movements: A Window on Mind and Brain Edited by R. P. G. van Gompel, M. H. Fischer, W. S. Murray and R. L. Hill Copyright © 2007 by Elsevier Ltd. All rights reserved. Basal Fonts:Times Margins:Top:4.6pc Gutter:4.6pc Font Size:10/12 Text Width:30pc Depth:43 Lines Elsevier AMS Ch10-I044980 Job code: EMAW 14-2-2007 1:06p.m. Page:214 Trimsize:165×240MM 214 D. Melcher and C. Morrone Abstract During natural viewing, the eye samples the visual environment using a series of jerking, saccadic eye movements, separated by periods of fixation. This raises the fundamental question of how information from separate fixations is integrated into a single, coherent percept. We discuss two mechanisms that may be involved in generating our stable and continuous perception of the world. First, information about attended objects may be integrated across separate glances. To evaluate this possibility, we present and discuss data showing the transsaccadic temporal integration of motion and form. We also discuss the potential role of the re-mapping of receptive fields around the time of saccades in transsaccadic integration and in the phenomenon of saccadic mislocalization. Second, information about multiple objects in a natural scene is built up across separate glances into a coherent representation of the environment.
    [Show full text]
  • Understanding the Function of Visual Short-Term Memory: Transsaccadic Memory, Object Correspondence, and Gaze Correction
    Journal of Experimental Psychology: General Copyright 2008 by the American Psychological Association 2008, Vol. 137, No. 1, 163–181 0096-3445/08/$12.00 DOI: 10.1037/0096-3445.137.1.163 Understanding the Function of Visual Short-Term Memory: Transsaccadic Memory, Object Correspondence, and Gaze Correction Andrew Hollingworth and Ashleigh M. Richard Steven J. Luck University of Iowa University of California, Davis Visual short-term memory (VSTM) has received intensive study over the past decade, with research focused on VSTM capacity and representational format. Yet, the function of VSTM in human cognition is not well understood. Here, the authors demonstrate that VSTM plays an important role in the control of saccadic eye movements. Intelligent human behavior depends on directing the eyes to goal-relevant objects in the world, yet saccades are very often inaccurate and require correction. The authors hypothesized that VSTM is used to remember the features of the current saccade target so that it can be rapidly reacquired after an errant saccade, a task faced by the visual system thousands of times each day. In 4 experiments, memory-based gaze correction was accurate, fast, automatic, and largely unconscious. In addition, a concurrent VSTM load interfered with memory-based gaze correction, but a verbal short-term memory load did not. These findings demonstrate that VSTM plays a direct role in a fundamentally important aspect of visually guided behavior, and they suggest the existence of previously unknown links between VSTM representations and the occulomotor system. Keywords: visual short-term memory, visual working memory, eye movements, saccades, gaze correc- tion Human vision is active and selective.
    [Show full text]
  • Transsaccadic Integration Relies on a Limited Memory Resource
    Journal of Vision (2021) 21(5):24, 1–12 1 Transsaccadic integration relies on a limited memory resource Garry Kong* Department of Psychology, University of Cambridge, UK Lisa M. Kroell* Department of Psychology, University of Cambridge, UK Sebastian Schneegans Department of Psychology, University of Cambridge, UK David Aagten-Murphy Department of Psychology, University of Cambridge, UK Paul M. Bays Department of Psychology, University of Cambridge, UK Saccadic eye movements cause large-scale necessarily means withdrawing it from others. To transformations of the image falling on the retina. support detailed and stable scene perception across Rather than starting visual processing anew after each eye movement-induced displacements, it has been saccade, the visual system combines post-saccadic proposed that information from previous fixations can information with visual input from before the saccade. be used to supplement current foveal input in a process Crucially, the relative contribution of each source of known as transsaccadic integration (Irwin & Andrews, information is weighted according to its precision, 1996). consistent with principles of optimal integration. We Because transsaccadic integration relies on reasoned that, if pre-saccadic input is maintained in a information from the recent past to facilitate resource-limited store, such as visual working memory, performance in the present, an intuitive hypothesis is its precision will depend on the number of items stored, that visual working memory contributes to the process as well as their attentional priority. Observers estimated (Aagten-Murphy & Bays, 2019; Irwin, 1991; Prime, the color of stimuli that changed imperceptibly during a saccade, and we examined where reports fell on the Vesia, & Crawford, 2011).
    [Show full text]
  • Thesis Document (1.403Mb)
    TRANSSACCADIC MEMORY OF MULTI-FEATURE OBJECTS by Jerrold Jeyachandra A thesis submitted to the Centre for Neuroscience Studies In conformity with the requirements for the degree of Masters of Science Queen’s University Kingston, Ontario, Canada (September, 2017) Copyright © Jerrold Jeyachandra, 2017 Abstract Our visual world is observed as a complete and continuous percept. However, the nature of eye movements, saccades, preclude this illusion at the sensory level of the retina. Current theories suggest that visual short-term memory (VSTM) may allow for this perceptual illusion through spatial updating of object locations. While spatial updating has been demonstrated to impose a cost on the precision of spatial memory, it is unknown whether saccades also influence feature memory. This thesis investigated whether there is a cost of spatial updating on VSTM of non-spatial features. To this end, participants performed comparisons of features (location, orientation, size) between two bars presented sequentially with or without an intervening saccade. In addition, dependent on the block condition, they had to compare either one of the features or all three features; to test for memory load effects. Saccades imposed a cost on precision of location memory of the first bar in addition to a direction-specific bias; this effect held with greater memory load. Orientation memory became less precise with saccades, and with greater memory load resulted in a remembered rotation of the first bar opposite to the direction of the saccade. Finally, after a saccade, participants consistently underestimated the size of the first bar in addition to being less precise; the precision effect did not hold with greater memory load.
    [Show full text]
  • How the Brain's Navigation System Shapes Our Visual Experience
    Review How the Brain’s Navigation System Shapes Our Visual Experience 1,5 1,5, 1,2,3,4, Matthias Nau, Joshua B. Julian, * and Christian F. Doeller * We explore the environment not only by navigating, but also by viewing our Highlights surroundings with our eyes. Here we review growing evidence that the mam- The hippocampal formation (HF) has traditionally been studied in the context malian hippocampal formation, extensively studied in the context of navigation of navigation and memory. and memory, mediates a representation of visual space that is stably anchored Recent electrophysiological and neu- to the external world. This visual representation puts the hippocampal formation roimaging research demonstrates that in a central position to guide viewing behavior and to modulate visual processing similar HF mechanisms supporting beyond the medial temporal lobe (MTL). We suggest that vision and navigation navigation also mediate a world-cen- tered representation of visual space (i. share several key computational challenges that are solved by overlapping and e., where a viewer is looking) during potentially common neural systems, making vision an optimal domain to explore purely visual exploration. whether and how the MTL supports cognitive operations beyond navigation. Visual information is transformed from eye- to world-centered coordinates All Eyes on the Hippocampal Formation using similar computations as those Navigation and vision are two fundamental strategies used to explore the world, and how we that support reference frame transfor- use one often directly affects how we use the other [1,2]. Like navigation—defined here as mations during navigation. physical body-based movement through the environment—, eye movements make it possible HF visuospatial representations may to acquire new information rapidly.
    [Show full text]