The Visual World in Memory Current Issues in Memory Series Editor: Robert Logie Professor of Human Cognitive Neuroscience, University of Edinburgh, UK Current Issues in Memory is a series of edited books that refl ect the state of the art in areas of current and emerging interest in the psychological study of memory. Each volume is tightly focused on a particular topic and consists of seven to ten chapters contributed by international experts. The editors of indi- vidual volumes are leading fi gures in their areas and provide an introductory overview. Example topics include: binding in working memory, prospective memory, memory and ageing, autobiographical memory, visual memory, implicit memory, amnesia, retrieval, memory development. The Visual World in Memory Edited by James R. Brockmole First published 2009 by Psychology Press 27 Church Road, Hove, East Sussex, BN3 2FA Simultaneously published in the USA and Canada by Routledge 270 Madison Avenue, New York, NY 10016 This edition published in the Taylor & Francis e-Library, 2008. “To purchase your own copy of this or any of Taylor & Francis or Routledge’s collection of thousands of eBooks please go to www.eBookstore.tandf.co.uk.” Psychology Press is an imprint of the Taylor & Francis Group, an Informa business © 2009 Psychology Press All rights reserved. No part of this book may be reprinted or reproduced or utilised in any form or by any electronic, mechanical, or other means, now known or hereafter invented, including photocopying and recording, or in any information storage or retrieval system, without permission in writing from the publishers. The publisher makes no representation, express or implied, with regard to the accuracy of the information contained in this book and cannot accept any legal responsibility or liability for any errors or omissions that may be made. This publication has been produced with paper manufactured to strict environmental standards and with pulp derived from sustainable forests. British Library Cataloguing in Publication Data A catalogue record for this book is available from the British Library Library of Congress Cataloging-in-Publication Data The visual world in memory / [edited by] James R. Brockmole. p. cm. Includes bibliographical references and index. ISBN 978-1-84169-684-3 (hardcover) 1. Memory. 2. Visual perception. 3. Vision. I. Brockmole, James R., 1977– BF371.V58 2009 153.1′32—dc22 2008012565 ISBN 0-203-88977-0 Master e-book ISBN ISBN 978-1-84169-684-3 (Print Edition) Contents List of contributors vi Preface viii 1 Fragmenting and integrating visuospatial working memory 1 ROBERT H. LOGIE AND MARIAN VAN DER MEULEN 2 Visual memory for features, conjunctions, objects, and locations 33 YUHONG V. JIANG, TAL MAKOVSKI, AND WON MOK SHIM 3 Remembering faces 66 VICKI BRUCE 4 Memory for real-world scenes 89 ANDREW HOLLINGWORTH 5 Visual memory in motor planning and action 117 MARY M. HAYHOE 6 Visual memory, spatial representation, and navigation 140 AMY L. SHELTON AND NAOHIDE YAMAMOTO 7 Expectancies, emotion, and memory reports for visual events 178 DEBORAH DAVIS AND ELIZABETH F. LOFTUS 8 Visual mental imagery: More than “seeing with the mind’s eye” 215 GIORGIO GANIS, WILLIAM L. THOMPSON, AND STEPHEN M. KOSSLYN Author index 251 Subject Index 265 v List of contributors James R. Brockmole, Department of Psychology, University of Edinburgh, 7 George Square, Edinburgh, EH8 9JZ, UK Vicki Bruce, School of Psychology, Newcastle University, Ridley Building, Newcastle upon Tyne, NE1 7RU, UK Deborah Davis, Department of Psychology/296, University of Nevada, Reno, Reno, NV 89557, USA Giorgio Ganis, Department of Radiology, Harvard Medical School, 149 Thir- teenth Street, Charles town, MA 02129, USA Mary M. Hayhoe, Department of Psychology, The University of Texas at Aus- tin, 1 University Station A8000, Austin, Texas 78712–0187, USA Andrew Hollingworth, Department of Psychology, The University of Iowa, 11 Seashore Hall E, Iowa City, IA 52242–1407, USA Yuhong V. Jiang, Department of Psychology, University of Minnesota, 75 East River Road, S251 Elliott Hall, Minneapolis, MN 55455, USA Stephen M. Kosslyn, Department of Psychology, Harvard University, 830 Wil- liam James Hall, 33 Kirkland St, Cambridge MA 02138, USA Elizabeth F. Loftus, Department of Psychology and Social Behavior, University of California, Irvine, 2393 Social Ecology II, Irvine, CA 92697-7085, USA Robert H. Logie, Department of Psychology, University of Edinburgh, 7 George Square, Edinburgh, EH8 9JZ, UK Tal Makovski, Department of Psychology, University of Minnesota, 75 East River Road, N504 Elliott Hall, Minneapolis, MN 55455, USA Amy L. Shelton, Department of Psychological and Brain Sciences, Johns Hop- kins University, 223 Ames Hall, 3400 North Charles Street, Baltimore, MD 21218, USA vi List of contributors vii Won Mok Shim, McGovern Institute for Brain Research, Building 46–3160, Massachusetts Institute of Technology, 77 Massachusetts Ave., Cambridge, MA 02139, USA William L. Thompson, Department of Psychology, Harvard University, 844 William James Hall, 33 Kirkland Street, Cambridge MA 02138, USA Marian van der Meulen, University of Edinburgh, 7 George Square, Edinburgh, EH8 9JZ, UK (now at Department of Neuroscience, University of Geneva Medical Center, 1 rue Michel-Servet, 1211 Geneva, Switzerland) Naohide Yamamoto, Department of Psychology, George Washington Univer- sity, 2125 G Street, NW, Washington, DC 20052, USA Preface Every morning at the same time (give or take 15 minutes depending on the speed with which my 2- and 5-year-olds decide to eat their cereal), I head off on a one-mile walk to the Psychology Department at the University of Edin- burgh. The windswept Scottish rain aside, I thoroughly enjoy this walk—fi rst among the eighteenth-century Georgian townhouses, then down the sixteenth- century streets, with the rocky crags of Holyrood Park and the majesty of Edinburgh Castle all the while framing my path (how could one not be in awe?). It was on these walks that the idea for this book slowly developed. I’d occasionally discover new and interesting objects in shop windows or aspects of the panoramic scenes I hadn’t noticed before while standing on the bridges and hilltops overlooking the city. I started to realize that I was passing the same faces every morning coming down the hill from the city centre as I climbed up. When a traffi c accident blocked my normal route home, I found that I was able to navigate home along a completely novel path (happily dis- covering quaint hidden pubs along the way). I’d come home and tell my wife about the interesting street performances and other events that I’d stumbled across. I constantly found myself captivated by the city’s ancient buildings and tried to create mental images of what the city must have looked like centuries ago. In short, it struck me just how much of what I thoroughly enjoy about my walk to work depends on my ability to represent the visual world around me in memory. This book, in some sense, then, is a story of a one-mile stroll through Edinburgh and the amazing, striking, and at times desperately limited nature of memory for our visually based experiences, from simple patterns to highly complex, dynamic, and emotion-inspiring events. How is the visual world represented in memory? The question has literally been asked for centuries, but the past decade has witnessed an explosion in scien- tifi c research on the question. With a recent PsycInfo search, I found 1,605 peer- reviewed journal articles that included “visual memory” as a key concept or major index term, dating as far back as 1897. Strikingly, 1,056 of these articles (66%) have been published in the last 10 years. It seemed, then, that the time was right to produce a volume that surveys the current issues confronting visual memory research and previews the challenges for researchers in the years ahead. viii Preface ix Although terms like “visual memory” sound as though they might be addressed by a unitary line of scientifi c enquiry, research on visual representa- tion varies tremendously across the timescales, stimuli, and scenarios of inter- est. As will be apparent in this book, while some researchers are interested in memory for events in the distant past, other researchers’ investigations are restricted to memory for visual experiences that occurred no longer than a sec- ond ago. While some examine memory for simple visual features such as color or shape, others consider memory for entire scenes. While some are interested in memory for specifi c objects, places, or events, others are interested in how memory for those objects, places, and events can be mentally manipulated to support future action and reasoning. While some are interested in the veridical- ity of memory, others are interested in the susceptibility of memory to various errors and distortions. Although all of these areas of study combine to characterize our visually based experiences and memories, because of these disparate interests, research in the fi eld of visual representation is in practice rather compartmentalized and as such is disseminated across a range of nonoverlapping literatures. The purpose of this book, therefore, was to collect a series of chapters written by leaders in the fi eld that concisely present the state-of-the-science in all the aforementioned areas of memory research. The chapters are written by researchers who have made infl u- ential and lasting contributions to the study of memory mechanisms involved in representing the visual world; when taken together, these contributions provide a single source of information that uniquely bridges the fi eld. In the fi rst chapter, “Fragmenting and Integrating Visuospatial Working Mem- ory,” Robert H. Logie and Marian van der Meulen introduce the concepts of visual and spatial working memory and analyze the major theories regarding working memory for visual information.