University of Southampton Research Repository Eprints Soton

Total Page:16

File Type:pdf, Size:1020Kb

University of Southampton Research Repository Eprints Soton University of Southampton Research Repository ePrints Soton Copyright © and Moral Rights for this thesis are retained by the author and/or other copyright owners. A copy can be downloaded for personal non-commercial research or study, without prior permission or charge. This thesis cannot be reproduced or quoted extensively from without first obtaining permission in writing from the copyright holder/s. The content must not be changed in any way or sold commercially in any format or medium without the formal permission of the copyright holders. When referring to this work, full bibliographic details including the author, title, awarding institution and date of the thesis must be given e.g. AUTHOR (year of submission) "Full thesis title", University of Southampton, name of the University School or Department, PhD Thesis, pagination http://eprints.soton.ac.uk University of Southampton Faculty of Social and Human Sciences School of Psychology The Relationship between Encoding and Recall for the Identities and Locations of Objects David Corck-Adelman Thesis for the degree of Doctor of Philosophy November 2011 UNIVERSITY OF SOUTHAMPTON ABSTRACT FACULTY OF SOCIAL AND HUMAN SCIENCES SCHOOL OF PSYCHOLOGY Doctor of Philosophy THE RELATIONSHIP BETWEEN ENCODING AND RECALL FOR THE IDENTITIES AND LOCATIONS OF OBJECTS By David Corck-Adelman Five experiments are reported which investigated the relationship between the number of fixations that participants made on objects in a photograph of a visual scene and the memory that participants exhibited for the identities and locations of those objects. The results of Experiment 1 showed that there is a very close relationship between encoding and recall for both the identities and locations of objects, and provided evidence that information about identities and locations of objects might be encoded differently. Specifically, the data suggested that object identities were encoded across multiple fixations, thereby accumulating in memory across separate fixations. However, object locations were encoded accurately after the first fixation on an object and did not appear to improve significantly with subsequent fixations. Experiment 2 demonstrated that the relationship between encoding and recall can be influenced using a lower-level attentional capture technique to draw - Experiment 3 investigated whether a primacy or recency effect was found for object identity and location memory. No such evidence was obtained for either. Experiment 4 provided evidence that information about the overall configuration of objects was encoded without the need for each object to be directly fixated. Experiments 4 and 5 both found that objects must be fixated for their specific location to be encoded, but also provided some suggestive evidence that object location memory might also accumulate across fixations (though to a lesser extent than for object identity memory). Hollingworth and experimental work. Modifications to this model were proposed to account for the current findings. In conclusion, the five experiments provide significant insight into encoding processes associated with memory for the identities and locations of objects. i ii Contents 1 Literature Review ............................................................................................... 1 1.1 Research on picture recognition .......................................................... 1 1.2 Change blindness ............................................................................... 9 1.3 Flicker paradigms ............................................................................. 15 1.4 Why does change blindness occur? Coherence Theory .................... 18 1.5 A challenge to Coherence Theory ...................................................... 21 1.6 Basic characteristics of eye movements ............................................. 24 1.7 Further challenges to Coherence Theory: Eye movements and change detection tasks ........................................................................................... 26 1.8 Why does change blindness occur? Visual Memory Model ............... 32 1.9 Why are change blindness results interesting? .................................. 34 1.10 Research into memory for object identities ....................................... 36 1.11 Research into memory for object locations ....................................... 46 1.12 Summary of previous literature ......................................................... 53 1.13 Proposed research and introduction to the novel paradigm ............... 54 2 The role of visual encoding in memory for object identity and object location ......................................................................................................... 57 2.1 Introduction ...................................................................................... 57 2.1.1 Explanation of key procedures used in the thesis: General methods ...... 66 2.1.2 Calculation of placement error ............................................................... 67 2.1.3 Calculation of best fit error .................................................................... 70 2.1.4 Monte Carlo simulation to calculate random placement error ................ 71 2.2 Method ............................................................................................. 73 2.3 Results ............................................................................................. 74 2.4 Discussion ........................................................................................ 85 3 Using attentional capture to modulate the relationship between encoding and recall for object identity and object location ................ 95 3.1 Introduction ...................................................................................... 95 iii 3.1.1 Higher-level influences on eye movements: Task instructions ............... 96 3.1.2 Higher-level influences on eye movements: Prior knowledge................. 99 3.1.3 Higher-level Influences on eye movements: Linguistically-driven eye movements ......................................................................................................... 100 3.1.4 Lower-level Influences on eye movements: Saliency maps ................... 103 3.1.5 Lower-level influences on eye movements: Colour and visual search... 106 3.1.6 The present experiment ....................................................................... 110 3.2 Method ........................................................................................... 114 3.3 Results ........................................................................................... 117 3.4 Discussion ...................................................................................... 126 4 The influence of fixation order on memory for object identity and object location .............................................................................................. 133 4.1 Introduction .................................................................................... 133 4.1.1 Serial order and memory for words in lists ........................................... 134 4.1.2 Serial order and memory for the identity of objects in scenes .............. 136 4.1.3 Serial order and memory for the locations of objects in scenes ........... 141 4.1.4 Comparison of memory for word lists and memory for objects in scenes: Manner of encoding ............................................................................................ 142 4.1.5 Comparison of memory for word lists and memory for objects in scenes: Identification period ........................................................................................... 143 4.1.6 The present experiment ....................................................................... 144 4.2 Method ........................................................................................... 147 4.3 Results ........................................................................................... 149 4.4 Discussion ...................................................................................... 171 5 The relationship between the number of fixations on an object and memory for the configuration of objects and specific object locations .................................................................................................................. 187 5.1 Introduction .................................................................................... 187 5.1.1 .......................... 187 5.1.2 The time course of encoding for the spatial map: The link between the spatial map and scene gist ................................................................................. 190 iv 5.1.3 Scene gist ............................................................................................ 190 5.1.4 The nature of the spatial map: The link between the spatial map and saliency maps ..................................................................................................... 193 5.1.5 Are object identities and specific object locations encoded in the same way? What is the time course of encoding for object identities and object locations? ........................................................................................................... 196 5.1.6 When does consolidation of information from short-term to long-term memory happen? ................................................................................................ 202 5.1.7 Summary of the Visual Memory Model and its relationship
Recommended publications
  • Limitations of Perceptual Segmentation on Contextual Cueing in Visual Search
    VISUAL COGNITION, 2011, 19 (2), 203Á233 Limitations of perceptual segmentation on contextual cueing in visual search Markus Conci1 and Adrian von Mu¨hlenen2 1Department Psychologie, Ludwig-Maximilians Universita¨tMu¨nchen, Mu¨nchen, Germany 2Department of Psychology, University of Warwick, Warwick, UK In visual search, detection of a target in a repeated layout is faster than search within a novel arrangement, demonstrating that contextual invariances can implicitly guide attention to the target location (‘‘contextual cueing’’; Chun & Jiang, 1998). Here, we investigated how display segmentation processes influence contextual cueing. Seven experiments showed that grouping by colour and by size can considerably reduce contextual cueing. However, selectively attending to a relevant subgroup of items (that contains the target) preserved context-based learning effects. Finally, the reduction of contextual cueing by means of grouping affected both the latent learning and the recall of display layouts. In sum, all experiments show an influence of grouping on contextual cueing. This influence is larger for variations of spatial (as compared to surface) features and is consistent with the view that learning of contextual relations critically interferes with processes that segment a display into segregated groups of items. Keywords: Contextual cueing; Implicit learning; Perceptual grouping; Visual search. Complex, natural environments require the visual system to focus only on Downloaded By: [Bayerische Staatsbibliothek] At: 09:25 9 February 2011 goal-relevant aspects of a scene while suppressing irrelevant information. Therefore, attention is concerned with selecting only a subset of significant Please address all correspondence to Markus Conci, Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians Universita¨t, Leopoldstr. 13, D-80802 Mu¨nchen, Germany.
    [Show full text]
  • Sleep-Effects on Implicit and Explicit Memory in Repeated Visual Search
    Sleep-Effects on Implicit and Explicit Memory in Repeated Visual Search Thomas Geyer1*., Hermann J. Mueller1,2., Leonardo Assumpcao2, Steffen Gais1 1 Department Psychologie, Ludwig-Maximilians-Universita¨t, Mu¨nchen, Germany, 2 Department of Psychological Sciences, Birkbeck College, University of London, London, United Kingdom Abstract In repeated visual search tasks, facilitation of reaction times (RTs) due to repetition of the spatial arrangement of items occurs independently of RT facilitation due to improvements in general task performance. Whereas the latter represents typical procedural learning, the former is a kind of implicit memory that depends on the medial temporal lobe (MTL) memory system and is impaired in patients with amnesia. A third type of memory that develops during visual search is the observers’ explicit knowledge of repeated displays. Here, we used a visual search task to investigate whether procedural memory, implicit contextual cueing, and explicit knowledge of repeated configurations, which all arise independently from the same set of stimuli, are influenced by sleep. Observers participated in two experimental sessions, separated by either a nap or a controlled rest period. In each of the two sessions, they performed a visual search task in combination with an explicit recognition task. We found that (1) across sessions, MTL-independent procedural learning was more pronounced for the nap than rest group. This confirms earlier findings, albeit from different motor and perceptual tasks, showing that procedural memory can benefit from sleep. (2) Likewise, the sleep group compared with the rest group showed enhanced context-dependent configural learning in the second session. This is a novel finding, indicating that the MTL-dependent, implicit memory underlying contextual cueing is also sleep-dependent.
    [Show full text]
  • University of Groningen the Long and the Short of Priming in Visual Search
    University of Groningen The long and the short of priming in visual search Kruijne, Wouter; Meeter, Martijn Published in: Attention, Perception & Psychophysics DOI: 10.3758/s13414-015-0860-2 IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document version below. Document Version Publisher's PDF, also known as Version of record Publication date: 2015 Link to publication in University of Groningen/UMCG research database Citation for published version (APA): Kruijne, W., & Meeter, M. (2015). The long and the short of priming in visual search. Attention, Perception & Psychophysics, 77(5), 1558-1573. https://doi.org/10.3758/s13414-015-0860-2 Copyright Other than for strictly personal use, it is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license (like Creative Commons). The publication may also be distributed here under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license. More information can be found on the University of Groningen website: https://www.rug.nl/library/open-access/self-archiving-pure/taverne- amendment. Take-down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Downloaded from the University of Groningen/UMCG research database (Pure): http://www.rug.nl/research/portal. For technical reasons the number of authors shown on this cover page is limited to 10 maximum.
    [Show full text]
  • Darby, K. P., Burling, J. M., & Yoshida, H. (2014)
    Cognitive Development 29 (2014) 17–29 Contents lists available at ScienceDirect Cognitive Development The role of search speed in the contextual cueing of children’s attention a,1 b,1 b, Kevin P. Darby , Joseph M. Burling , Hanako Yoshida ∗ a Department of Psychology, The Ohio State University, 267 Psychology Building, 1835 Neil Avenue, Columbus, OH 43210, United States b Department of Psychology, University of Houston, 126 Heyne Building, Houston, TX 77204, United States a r t i c l e i n f o a b s t r a c t Keywords: The contextual cueing effect is a robust phenomenon in which Contextual cueing repeated exposure to the same arrangement of random elements Memory development guides attention to relevant information by constraining search. Attentional learning The effect is measured using an object search task in which a target Visual search task (e.g., the letter T) is located within repeated or nonrepeated visual contexts (e.g., configurations of the letter L). Decreasing response times for the repeated configurations indicates that contextual information has facilitated search. Although the effect is robust among adult participants, recent attempts to document the effect in children have yielded mixed results. We examined the effect of search speed on contextual cueing with school-aged children, com- paring three types of stimuli that promote different search times in order to observe how speed modulates this effect. Reliable effects of search time were found, suggesting that visual search speed uniquely constrains the role of attention toward contextually cued information. Published by Elsevier Inc. 1. Introduction Knowing where to look for relevant information in a cluttered visual environment is crucial to mak- ing rapid responses and learning from that information.
    [Show full text]
  • Eye-Tracking Contribute to Contextual Cueing: Evidence from Fmri And
    Downloaded from learnmem.cshlp.org on October 24, 2012 - Published by Cold Spring Harbor Laboratory Press Procedural learning and associative memory mechanisms contribute to contextual cueing: Evidence from fMRI and eye-tracking Anna Manelis and Lynne M. Reder Learn. Mem. 2012 19: 527-534 Access the most recent version at doi:10.1101/lm.025973.112 References This article cites 50 articles, 9 of which can be accessed free at: http://learnmem.cshlp.org/content/19/11/527.full.html#ref-list-1 Email alerting Receive free email alerts when new articles cite this article - sign up in the box at the service top right corner of the article or click here To subscribe to Learning & Memory go to: http://learnmem.cshlp.org/subscriptions © 2012 Cold Spring Harbor Laboratory Press Downloaded from learnmem.cshlp.org on October 24, 2012 - Published by Cold Spring Harbor Laboratory Press Research Procedural learning and associative memory mechanisms contribute to contextual cueing: Evidence from fMRI and eye-tracking Anna Manelis1,2,3 and Lynne M. Reder1,2 1Department of Psychology, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, USA; 2The Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, USA Using a combination of eye tracking and fMRI in a contextual cueing task, we explored the mechanisms underlying the facilitation of visual search for repeated spatial configurations. When configurations of distractors were repeated, greater activation in the right hippocampus corresponded to greater reductions in the number of saccades to locate the target. A psychophysiological interactions analysis for repeated configurations revealed that a strong functional connectiv- ity between this area in the right hippocampus and the left superior parietal lobule early in learning was significantly reduced toward the end of the task.
    [Show full text]
  • Awareness in Contextual Cueing of Visual Search As Measured with Concurrent Access- and Phenomenal- Consciousness Tasks
    Journal of Vision (2012) 12(11):25, 1–12 http://www.journalofvision.org/content/12/11/25 1 Awareness in contextual cueing of visual search as measured with concurrent access- and phenomenal- consciousness tasks Department Psychologie, Ludwig-Maximilians-Universita¨tMu¨nchen, Bernhard Schlagbauer Mu¨nchen, Germany $ Department Psychologie, Ludwig-Maximilians-Universita¨tMu¨nchen, Mu¨nchen, Germany School of Psychology, Birkbeck College, # Hermann J. Muller¨ University of London, UK $ Department Psychologie, Ludwig-Maximilians-Universita¨tMu¨nchen, # Michael Zehetleitner Mu¨nchen, Germany $ Department Psychologie, Ludwig-Maximilians-Universita¨tMu¨nchen, # Thomas Geyer Mu¨nchen, Germany $ In visual search, context information can serve as a cue to guide attention to the target location. When observers repeatedly encounter displays with identical target-distractor arrangements, reaction times (RTs) are faster for repeated relative to nonrepeated displays, the latter containing novel configurations. This effect has been termed ‘‘contextual cueing.’’ The present study asked whether information about the target location in repeated displays is ‘‘explicit’’ (or ‘‘conscious’’)in nature. To examine this issue, observers performed a test session (after an initial training phase in which RTs to repeated and nonrepeated displays were measured) in which the search stimuli were presented briefly and terminated by visual masks; following this, observers had to make a target localization response (with accuracy as the dependent measure) and indicate
    [Show full text]
  • A Thesis Submitted for the Degree of Doctor of Philosophy at the University of Queensland in 2019 School of Psychology
    The Causal Neural Substrates of Statistical Learning Abbey S. Nydam Bachelor of Psychological Science (Hons 1) A thesis submitted for the degree of Doctor of Philosophy at The University of Queensland in 2019 School of Psychology Abstract Although humans often struggle to make rational decisions based on probability, there are types of information processing that appear highly sensitive to statistics. In fact, the human brain can extract information about complex statistical probabilities present in the environment through an automatic statistical learning process. Statistical learning is the primary way that human infants, with no developed frontal cortex or reasoing skills, can learn the complexities of language and grammar. As adults, statistical learning enables us to benefit from the many repetitive and predictable elements of our sensory environment, such as visual scenes or event sequences. Statistical knowledge is often implicit, but it can be used by the explicit system to facilitate other cognitive processes; such as decision-making, skill learning, and social capabilities. The reach of statistical learning across the cognitive landscape is broad, and this brings into question the nature of the neural substrates that govern this process. Neuroscientific research supports there being a critical role of the hippocampus, as it relates to long-term memory. But neuroimaging work suggests a role of higher-level cortical regions, within the frontal and parietal cortices. These areas are more commonly associated with explicit executive functions, and less so for implicit learning abilities. Recent advances in non-invasive brain stimulation allow is to directly control cortical brain acitvity in order to unearth causal relationships between the brain and behaviour.
    [Show full text]
  • Bi-Directional Relationship Between Attention and Long-Term Context Memory
    Bi-directional relationship between attention and long-term context memory Efsun Annaç Dissertation der Graduate School of Systemic Neurosciences der Ludwig-Maximilians-Universität München München th 30 of October 2017 Disputation date: 18th of April 2018 Thesis Advisory Committee: Prof. Dr. Thomas Geyer (1st Supervisor) Prof. Dr. Hermann J. Müller (2nd Supervisor) Prof. Dr. Stefan Pollmann (External Supervisor) Exanimation Committee: Prof. Dr. Thomas Geyer (Supervisor and 1st reviewer) Dr. Virginia L. Flanagin (2nd reviewer) Prof. Dr. Melissa Le-Hoa Võ (3rd reviewer) Prof. Dr. Hermann J. Müller PD Dr. Markus Conci Prof. Dr. Paul C. J. Taylor ~ 2 ~ Table of contents Table of contents ......................................................................................................................... 3 Acknowledgements ..................................................................................................................... 7 Summary ...................................................................................................................................... 8 1. Chapter 1: General Introduction ............................................................................................ 11 1.1 Visual attention .................................................................................................................... 13 1.2 Context-based guidance of visual search: contextual cueing paradigm .............................. 16 1.3 The influence of spatial factors on the adaptation of contextual cueing ............................
    [Show full text]
  • The Long and the Short of Priming in Visual Search
    Atten Percept Psychophys DOI 10.3758/s13414-015-0860-2 The long and the short of priming in visual search Wouter Kruijne · Martijn Meeter © The Author(s) 2015. This article is published with open access at Springerlink.com Abstract Memory affects visual search, as is particularly Introduction evident from findings that when target features are repeated from one trial to the next, selection is faster. Two views A powerful factor determining where we look and what have emerged on the nature of the memory representations we attend is where we have looked and what we have and mechanisms that cause these intertrial priming effects: attended before. The effects of our previous overt and covert independent feature weighting versus episodic retrieval of shifts of attention on our current ones are often investi- previous trials. Previous research has attempted to disen- gated by comparing visual search in which targets must tangle these views focusing on short term effects. Here, be found with either the same features as on previous tri- we illustrate that the episodic retrieval models make the als, or with different features. When compared to feature unique prediction of long-term priming: biasing one target switch trials, feature repetitions have been found to shorten type will result in priming of this target type for a much response times (RT) and decrease the amount of errors longer time, well after the bias has disappeared. We demon- (Maljkovic and Nakayama, 1994). In addition, repetitions strate that such long-term priming is indeed found for the cause shorter saccade latencies (Becker, 2008; McPeek et visual feature of color, but only in conjunction search and al., 1999) and bias target selection (Brascamp et al., 2011a; not in singleton search.
    [Show full text]
  • Neural Correlates of Contextual Cueing Are Modulated by Explicit Learning
    G Model NSY-4235; No. of Pages 9 ARTICLE IN PRESS Neuropsychologia xxx (2011) xxx–xxx Contents lists available at SciVerse ScienceDirect Neuropsychologia jo urnal homepage: www.elsevier.com/locate/neuropsychologia Neural correlates of contextual cueing are modulated by explicit learning a,∗ a a b a Carmen E. Westerberg , Brennan B. Miller , Paul J. Reber , Neal J. Cohen , Ken A. Paller a Department of Psychology, Northwestern University, United States b Department of Psychology, Beckman Institute, University of Illinois at Urbana-Champaign, United States a r t i c l e i n f o a b s t r a c t Article history: Contextual cueing refers to the facilitated ability to locate a particular visual element in a scene due to Received 7 January 2011 prior exposure to the same scene. This facilitation is thought to reflect implicit learning, as it typically Received in revised form 15 August 2011 occurs without the observer’s knowledge that scenes repeat. Unlike most other implicit learning effects, Accepted 19 August 2011 contextual cueing can be impaired following damage to the medial temporal lobe. Here we investigated Available online xxx neural correlates of contextual cueing and explicit scene memory in two participant groups. Only one group was explicitly instructed about scene repetition. Participants viewed a sequence of complex scenes Keywords: that depicted a landscape with five abstract geometric objects. Superimposed on each object was a letter Visual scene perception ◦ fMRI T or L rotated left or right by 90 . Participants responded according to the target letter (T) orientation. Responses were highly accurate for all scenes.
    [Show full text]
  • November 15, 2018 New Orleans, LA
    November 15, 2018 New Orleans, LA 2018 Organizers Caitlin Mullin Briana Kennedy Steve Walenchok Yelda Semizer 2018 Keynote Address Wei Ji Ma, PhD Associate Professor of Neural Science & Psychology, New York University Ma Lab | New York University Meyer Hall | 4 Washington Place | New York, NY 10003 The talk will consist of two parts: a scientific part and a Growing up in Science part. Models of "simple" visual search Visual search is an important task in daily life and arguably has been across evolution. Celebrated models of visual search include those of Anne Treisman and Jeremy Wolfe. In a lesser-known approach, spearheaded by the likes of John Palmer, Preeti Verghese, and Miguel Eckstein, stimuli are kept as simple as possible and search displays are brought under tight experimental control. While this reductionist approach lacks in naturalness, it has the advantage of allowing for precise mathematical models in the tradition of signal detection theory, which can be used to disentangle encoding and decision stages. I will describe a series of studies from my lab in which we use this approach to examine: 1) set size effects on encoding precision; 2) the optimality or suboptimality of decision rules. I hope to convince you that such combinations of a simplified experimental paradigm and rigorous modeling fill an important niche in the study of visual search. Growing up in science: Wei Ji Ma's unofficial story More information about the "Growing up in science" mentorship concept: www.growingupinscience.com Official story Weiji received his Ph.D. in Physics from the University of Groningen, the Netherlands.
    [Show full text]
  • Context Processing and Aging: Older Adults’ Ability to Learn And
    CONTEXT PROCESSING AND AGING: OLDER ADULTS’ ABILITY TO LEARN AND UTILIZE VISUAL CONTEXTS A Dissertation Submitted to the Graduate Faculty of the North Dakota State University of Agriculture and Applied Science By Nora Denise Gayzur In Partial Fulfillment for the degree of DOCTOR OF PHILOSOPHY Major Department: Psychology April 2013 Fargo, North Dakota North Dakota State University Graduate School Title Context Processing and Aging: Older Adults’ Ability to Learn and Use Visual Contexts By Nora Denise Gayzur The Supervisory Committee certifies that this disquisition complies with North Dakota State University’s regulations and meets the accepted standards for the degree of DOCTOR OF PHILOSOPHY SUPERVISORY COMMITTEE: Linda K. Langley, PhD. Chair Robert D. Gordon, PhD. Paul Rokke, PhD. Gregory Sanders, PhD. Approved: 5/31/2013 James Council, PhD. Date Department Chair ABSTRACT The purpose of the present study was to examine how older adults utilize contextual information to guide attention in visual scenes. Studies that have examined context and attentional deployment have used the contextual cueing task. Contextual cueing reflects faster responses to repeated spatial configurations (consistent context-target covaration) than random spatial configurations (inconsistent covariation). Research has shown mixed results in older adults’ ability to utilize context with this task. Young (18-23 years) and older (60-85 years) adults were tested in two contextual cuing experiments to assess age differences in how individuals utilize context in novel and real-world visual scenes. Experiment 1 investigated the development of contextual cueing effects using low-meaning visual contexts (letter arrays). In low-meaning arrays, young and older adults were able to use context effeciently with no age differences in the development of contextual cueing effects.
    [Show full text]