DOCSLIB.ORG

Eye-Movement Research: an Overview of Current and Past Developments

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Eye-Movement Research: an Overview of Current and Past Developments Elsevier AMS Ch01-I044980 Job code: EMAW 14-2-2007 1:04p.m. Page:1 Trimsize:165×240MM Chapter 1 EYE-MOVEMENT RESEARCH: AN OVERVIEW OF CURRENT AND PAST DEVELOPMENTS ROGER P. G. VAN GOMPEL, MARTIN H. FISCHER AND WAYNE S. MURRAY University of Dundee, UK ROBIN L. HILL University of Edinburgh, UK Eye Movements: A Window on Mind and Brain Edited by R. P. G. van Gompel, M. H. Fischer, W. S. Murray and R. L. Hill Copyright © 2007 by Elsevier Ltd. All rights reserved. Basal Fonts:Times Margins:Top:4.6pc Gutter:4.6pc Font Size:10/12 Text Width:30pc Depth:43 Lines Elsevier AMS Ch01-I044980 Job code: EMAW 14-2-2007 1:04p.m. Page:2 Trimsize:165×240MM 2 R. P. G. van Gompel et al. Abstract This opening chapter begins with an overview of the issues and questions addressed in the remainder of this book, the contents of which reflect the wide diversity of eye-movement research. We then provide the reader with an up-to-date impression of the most significant developments in the area, based on findings from a survey of eye-movement researchers and database searches. We find that the most heavily cited publications are not necessarily those rated as most influential. It is clear that eye-movement research is published across a wide variety of journals and the number of articles is increasing, but the relative proportion of eye-movement articles has remained almost constant. The United States produces the largest number of these articles, but other countries actually produce more per capita. Finally, we see that computational modelling, new eye-tracking technologies and anatomical and physiological mapping of the visual-oculomotor system are viewed as the most important recent developments. Basal Fonts:Times Margins:Top:4.6pc Gutter:4.6pc Font Size:10/12 Text Width:30pc Depth:43 Lines Elsevier AMS Ch01-I044980 Job code: EMAW 14-2-2007 1:04p.m. Page:3 Trimsize:165×240MM Ch. 1: Eye-Movement Research 3 Orpheus called the eyes, the looking glasses of nature: Hesichius, the doores for the Sunne to enter in by: Alexander the Peripatecian, the windowes of the mind, because that by the eyes we doe cleerely see what is in the same, we pearce into the deepe thoughts thereof, and enter into the privities of his secret chamber. (Du Laurens, 1596, translated by Surphlet, 1599, p. 19) When Du Laurens (1596), a sixteenth-century French anatomist and medical scientist, referred to the eyes as windowes of the mind, he reflected a view both ancient and modern. And it seems clear today that people’s eye movements do indeed reveal much about the workings of both mind and brain. In recent years, the study of eye movements has become one of the most important and productive ways for investigating aspects of mind and brain across a wide variety of topic areas. This book contains a collection of chapters that reflect that breadth and, we believe, the sort of productivity that stems from this type of research. The 12th European Conference on Eye Movements, ECEM12, held in Dundee, Scotland, provided the foundation for this collection. This biennial conference brings together a large number of eye-movement researchers drawn from a wide variety of differ- ent disciplines, such as clinical researchers, neurophysiologists, cognitive psychologists, vision scientists and ergonomists, to mention but a few, and this book contains a similarly wide range of research topics. The research is grouped into eight parts, each of which presents a different area central to current eye-movement research. Each section begins with an overview chapter that provides a critical review of current research in the area, fol- lowed by a series of chapters reporting new findings and addressing new topics. Of course, the organisation into sections does not imply that there are no links between the chapters in the different sections. Although eye-movement research can be divided into several fairly well-defined research areas, much research draws on findings from more than a single area, and research frequently crosses the boundaries between different disciplines – per- haps one reason why the interdisciplinary nature of ECEM has always been so successful. The chapters in this book present an overview of current developments in eye-movement research. However, eye-movement research has become a vast area, so naturally, some research fields are better represented than others. Included in this book are areas that have recently developed as well as established areas with a much longer tradition in eye-movement research. Recent developments include the history of eye-movement research (Part 1), eye movements as a method for investigating spoken language pro- cessing (Part 6), and eye movements in natural environments (Part 8). The modelling of eye movements (Part 4), although not really new, has also seen a great deal of recent change and development. Areas that have been longer established but continue to produce important new findings are physiology and clinical studies of eye movements (Part 2), transsaccadic integration (Part 3), eye-movements and reading (Part 5), and eye movements as a method for investigating attention and scene perception (Part 7). In this opening chapter, we aim to highlight the most important developments in eye- movement research. We begin by providing an overview of the chapters in the different sections of this book. This should provide the reader with a thorough subjective impression of the most important current developments in eye-movement research. We then follow Basal Fonts:Times Margins:Top:4.6pc Gutter:4.6pc Font Size:10/12 Text Width:30pc Depth:43 Lines Elsevier AMS Ch01-I044980 Job code: EMAW 14-2-2007 1:04p.m. Page:4 Trimsize:165×240MM 4 R. P. G. van Gompel et al. this with a more objective form of assessment. We consider the state of eye-movement research (both in the present and the past) by reporting results from a survey sent to participants of ECEM12 and a journal database search. Based on this combination, our aim is to provide the reader with a synoptic overview of current and past developments across the field in general. 1. Overview of the parts in this book 1.1. History of eye-movement research Looking backwards is the perfect way to begin a book on eye-movement research. Knowing the genesis and evolution of any subject is critical to understanding the motivation and driving forces (both psychological and technological) that lie behind sci- entific progress in the area. Our first part therefore examines the historical foundations of eye-movement research; something which has permeated through an extremely rich and diverse range of multidisciplinary empirical topics. The opening chapter by Wade places the birth of the modern scientific study of eye movements firmly in the eighteenth century, before charting its historical progress via the thoughts and works of many generations of eminent scientists. Central to this was the growth in physiological experimentation, and the examination/exploitation of visual vertigo, torsion, and afterimages in particular. Wade also describes how through the ingenious use of technology, techniques for acquiring eye-movement records and studying scan paths were developed to facilitate reading research and the study of visual perception. The immediate post-war period is the focus of Westheimer’s historical account. He documents how multidisciplinary scientific work forged under conditions of war later sparked a mini-renaissance in instrumentation and neurophysiological techniques. This naturally fed through into a greater understanding of the oculomotor system and helped establish the investigation of eye movements as a major tool in psychological research. Following Westheimer, Land’s exposition begins in the 1950s but rapidly brings us up to date. Again, he relates how the development of modern technology, choosing head-mounted mobile eye-trackers as his specific example, has led to advances across a range of eye-movement research areas. The flexibility afforded by such devices frees us from many constraints (often literally in the case of head-vices and bite-bars) and opens up the “real” world to greater investigation. Together, these three chapters make it clear that the act of looking backwards results in our forward vision becoming sharper and brighter. 1.2. Physiology and clinical studies of eye movements The second part of the book deals with physiological and clinical studies of eye movements. First, Munoz, Armstrong, and Coe provide an authoritative overview on how Basal Fonts:Times Margins:Top:4.6pc Gutter:4.6pc Font Size:10/12 Text Width:30pc Depth:43 Lines Elsevier AMS Ch01-I044980 Job code: EMAW 14-2-2007 1:04p.m. Page:5 Trimsize:165×240MM Ch. 1: Eye-Movement Research 5 to use simple eye-movement tasks to diagnose both the developmental state and the pos- sible dysfunctions of the cortical and subcortical oculomotor system. Their accumulator model allows an understanding of performance profiles across a wide range of deficits, such as Parkinson’s disease, Tourette syndrome, and Attention Deficit Hyperactivity Disorder. In the second Chapter in this part, Ford, Brown, and Everling report an fMRI study which shows that anti-saccade task performance depends on specific brain activation prior to stimulus presentation. Their work describes the relationship between frontal brain activity and the accuracy of a subsequent saccadic decision. It also illustrates how eye-tracking can be combined with high-tech brain imaging methods that have become popular over the last two decades. The final chapter in this part is by Bour, Van der Meer, and Van Mourik. These authors describe commutative eye rotations in congenital nystagmus (a fixation instability resulting from visual or oculomotor deficits) and a computational model that predicts anatomical aberrations in a patient with congenital nystagmus.
Load more

Recommended publications
  • A Model of Discourse Predictions in Human Sentence Processing
    A Model of Discourse Predictions in Human Sentence Processing Amit Dubey and Frank Keller and Patrick Sturt Human Communication Research Centre, University of Edinburgh 10 Crichton Street, Edinburgh EH8 9AB, UK {amit.dubey,frank.keller,patrick.sturt}@ed.ac.uk Abstract prediction has been demonstrated by studies that show anticipation based on selectional restrictions: This paper introduces a psycholinguistic listeners are able to launch eye-movements to the model of sentence processing which combines predicted argument of a verb before having encoun- a Hidden Markov Model noun phrase chun- tered it, e.g., they will fixate an edible object as soon ker with a co-reference classifier. Both mod- els are fully incremental and generative, giv- as they hear the word eat (Altmann and Kamide, ing probabilities of lexical elements condi- 1999). Semantic prediction has also been shown in tional upon linguistic structure. This allows the context of semantic priming: a word that is pre- us to compute the information theoretic mea- ceded by a semantically related prime or by a seman- sure of surprisal, which is known to correlate tically congruous sentence fragment is processed with human processing effort. We evaluate faster (Stanovich and West, 1981; Clifton et al., our surprisal predictions on the Dundee corpus 2007). An example for syntactic prediction can be of eye-movement data show that our model achieve a better fit with human reading times found in coordinate structures: readers predict that than a syntax-only model which does not have the second conjunct in a coordination will have the access to co-reference information.
    [Show full text]
  • A Method to Analyze Similarities of Eye Movements: a Giscience Based Spatiotemporal Approach
    University of South Florida Scholar Commons Graduate Theses and Dissertations Graduate School November 2019 A Method to Analyze Similarities of Eye Movements: a GIScience Based Spatiotemporal Approach Mehrdad Vaziri University of South Florida Follow this and additional works at: https://scholarcommons.usf.edu/etd Part of the Geographic Information Sciences Commons Scholar Commons Citation Vaziri, Mehrdad, "A Method to Analyze Similarities of Eye Movements: a GIScience Based Spatiotemporal Approach" (2019). Graduate Theses and Dissertations. https://scholarcommons.usf.edu/etd/8691 This Dissertation is brought to you for free and open access by the Graduate School at Scholar Commons. It has been accepted for inclusion in Graduate Theses and Dissertations by an authorized administrator of Scholar Commons. For more information, please contact [email protected]. A Method to Analyze Similarities of Eye Movements: a GIScience Based Spatiotemporal Approach by Mehrdad Vaziri A dissertation submitted in partial fulfillment of the requirement for the degree of Doctor of Philosophy in Geography and Environmental Science and Policy School of Geosciences College of Arts and Sciences University of South Florida Major Professor: Joni Firat, Ph.D. Steven Reader, Ph.D. Philip Van Beynen, Ph.D. Elizabeth Schotter, Ph.D. Date of Approval: November 19, 2019 Keywords: Similarity Analysis, GIScience, Eye Tracking, Spatiotemporal Copyright © 2019, Mehrdad Vaziri DEDICATION Dedicated to my wife Tina and my Uncle Reza, my Mother and Father, My Brothers and Sisters and all their beautiful children, Mahshid, Sina, Kian, Parnyan ACKNOWLEDGMENT I would like to thank my major professor Dr. Joni Firat for her neverending support and mentorship throughout my time at USF.
    [Show full text]
  • The Effects of Word Length and Suffixation on Eye Movement Control in Turkish Reading
    THE EFFECTS OF WORD LENGTH AND SUFFIXATION ON EYE MOVEMENT CONTROL IN TURKISH READING A THESIS SUBMITTED TO THE GRADUATE SCHOOL OF INFORMATICS OF THE MIDDLE EAST TECHNICAL UNIVERSITY BY TUĞÇE NUR BOZKURT IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF MASTER OF SCIENCE IN THE DEPARTMENT OF COGNITIVE SCIENCE SEPTEMBER 2017 THE EFFECTS OF WORD LENGTH AND SUFFIXATION ON EYE MOVEMENT CONTROL IN TURKISH READING Submitted by TUĞÇE NUR BOZKURT in partial fulfillment of the requirements for the degree of Master of Science in Cognitive Science Department, Middle East Technical University by, Prof. Dr. Deniz Zeyrek Bozşahin Dean, Graduate School of Informatics Prof. Dr. Cem Bozşahin Head of Department, Cognitive Science Asst. Prof. Dr. Cengiz Acartürk Supervisor, Cognitive Science Dept., METU Examining Committee Members: Prof. Dr. Cem Bozşahin Cognitive Science Dept., METU Asst. Prof. Dr. Cengiz Acartürk Cognitive Science Dept., METU Prof. Dr. Deniz Zeyrek Bozşahin Cognitive Science Dept., METU Asst. Prof. Dr. Burcu Can Buğlalılar Computer Engineering Dept., Hacettepe University Assoc. Prof. Dr. Bilal Kırkıcı Foreign Language Education Dept., METU Date: _September 7, 2017 I hereby declare that all information in this document has been obtained and presented in accordance with academic rules and ethical conduct. I also declare that, as required by these rules and conduct, I have fully cited and referenced all material and results that are not original to this work. Name, Last name : Tuğçe Nur Bozkurt Signature : iii ABSTRACT THE EFFECTS OF WORD LENGTH AND SUFFIXATION ON EYE MOVEMENT CONTROL IN TURKISH READING Bozkurt, Tuğçe Nur MSc., Department of Cognitive Science Supervisor: Asst.
    [Show full text]
  • I COGNITIVE CONTROL of EYE MOVEMENTS in READING and VISUAL
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by D-Scholarship@Pitt COGNITIVE CONTROL OF EYE MOVEMENTS IN READING AND VISUAL SEARCH: EVIDENCE FROM FREQUENCY-BASED EFFECTS by Polina M. Vanyukov B.S., Carnegie Mellon University, 2001 Submitted to the Graduate Faculty of the Kenneth P. Dietrich School of Arts and Sciences in partial fulfillment of the requirements for the degree of Doctor of Philosophy University of Pittsburgh 2013 i UNIVERSITY OF PITTSBURGH THE KENNETH P. DIETRICH SCHOOL OF ARTS AND SCIENCES This dissertation was presented by Polina M. Vanyukov It was defended on March 20th, 2013 and approved by Charles A. Perfetti, Professor, Department of Psychology David C. Plaut, Professor, Department of Psychology, Carnegie Mellon University Natasha Tokowicz, Associate Professor, Department of Psychology Dissertation Advisor: Tessa Warren, Associate Professor, Department of Psychology ii Copyright © by Polina M. Vanyukov 2013 iii COGNITIVE CONTROL OF EYE MOVEMENTS IN READING AND VISUAL SEARCH: EVIDENCE FROM FREQUENCY-BASED EFFECTS Polina M. Vanyukov, PhD University of Pittsburgh, 2013 Experiments in this dissertation investigate the role of cognition in eye-movement behavior during scanning and reading. Shorter and fewer fixations on the more frequent and predictable words have been observed during reading, but not when scanning text for a target word, e.g., zebra (e.g., Rayner & Raney, 1996). Past research has employed these effects of word frequency and predictability to argue that cognition drives eye movements during reading, but not during scanning. Similarly, the present studies use effects of stimulus frequency and predictability to index cognitive control of eye-movement behavior.
    [Show full text]
  • The Imagined Voice 2017 JULY
    Cover Page The handle http://hdl.handle.net/1887/58691 holds various files of this Leiden University dissertation. Author: Kyriakides, Y. Title: Imagined Voices : a poetics of Music-Text-Film Issue Date: 2017-12-21 PART I: Three Voices 16 Chapter 1: The Mimetic Voice One of the bedrocks of the history of aesthetics in western culture is Plato's formulation of 'mimesis' and 'diegesis'. In a dialogue between Socrates and Adeimantus in Book 3 of The Republic, Plato sets out to differentiate all forms of poetry in 'mimesis' and 'diegesis', which roughly translate respectively into 'showing' and 'telling': One kind of poetry and story-telling employs only imitation - tragedy and comedy, as you say. Another kind employs only narration by the poet himself - you find this most of all in Dithyrambs. A third kind uses both - as in epic poetry... (Plato, The Republic, 394c) Here Plato sets out the basic duality between narration and imitation. In diegesis the poet or narrator is speaking in their own voice, never leading the audience into thinking they are anyone other than that. In mimesis, the poet utilises imitation, and takes on the persona of another, by voice or gesture to show, to act out, as is the convention of much staged drama. In later chapters of The Republic, Plato expresses his prejudice against mimetic art, which he considers inferior, because in his view it simply copies the appearance of the real, reproducing shadows rather than shedding light on truths. This is somewhat ironic, because Plato himself utilises the form of the dramatic dialogue in much of his writing, using the voice of Socrates as a medium to channel his ideas.
    [Show full text]
  • Eye Movement, Perception, and Legibility in Reading by Miles A
    EYE MOVEMENT, PERCEPTION, AND LEGIBILITY IN READING BY MILES A. TINKER University of Minnesota This review is a continuation of the series previously published in this journal (69, 70, 71, 73). A few early papers which were missed in the previous reviews are included in the list of references (31,32, 33,34,51,55,57,79,86). No publications appearing later than October, 1935, are included. Bibliographies, popular discussions, summaries of part of the field,, and textbook surveys will be found in references 12, 28, 35, 36, 37, 45, 46, 49, 50a, 66. New methods and new devices, or modifications of previous apparatus constructed for use in reading investigations are described in references 2, 6, 7, 16, 17, 18, 60, 68, 72, 78, 83. EYE MOVEMENTS Recent investigations of eye movements in reading have involved for the most part the measurement of oculomotor behavior in special reading and learning situations, determination of validity and relia- bility of the measures, and evaluation of the importance of eye move- ments in diagnostic and remedial reading. A few experiments have been concerned with establishing norms, the use of eye movements as measures of legibility, and the relation of eye movements to other measures of performance. Studies of eye movements in the reading of oriental and foreign languages continue to appear. Futch (27) reports on a comparison of the various measures of eye move- ments in reading Latin and English by beginning and experienced students. Both groups of subjects exhibited less efficiency in reading Latin than in reading English. Although the beginning and the advanced Latin students were affected similarly in going from English to Latin, the performance of the beginners was most affected.
    [Show full text]
  • Eye-Movement Analysis in Reading Content Words and Function Words
    Eye-movement analysis in reading content words and function words Sophie Roussel1, Anne Rohr1, Eric Raufaste 2, Jean-Luc Nespoulous1 1Laboratoire Lordat – CEA.1941- IFR N°96 - Université Toulouse-II, France 2 Laboratoire Travail et Cognition – UMR5551 du CNRS - Université Toulouse-II, France Address for correspondence: Sophie Roussel - Laboratoire Lordat Université Toulouse-II Maison de la Recherche 5, Allées A. Machado, 31058 Toulouse Cedex France Email: [email protected] Tel: (+33) 561-503-594 Fax: (+33) 561-504-918 Running Head: EYE-MOVEMENTS in READING ROUSSEL EYE-MOVEMENTS in READING 1 ABSTRACT Detection task studies and studies of eye-movement in reading all pointed out a differential processing of content and function words. Several determinants were proposed: grammatical class, word configuration, word frequency, etc. Although function words are both “short” and “highly frequent”, interactions between those factors were left widely underdetermined. Hence, the present eye-movement study aimed at isolate the specific effect of grammatical class, controlling other factors, and specifically frequency and form properties (e.g. word length). Results confirm that grammatical class induces by itself different attentional patterns with more fixations on content words than on function words. When words were gazed, there were longer gaze durations and smaller pupil diameter on content words than on function words. Keywords: Reading - Eye-movements - content word – function words ROUSSEL EYE-MOVEMENTS in READING 2 When reading a text, all words are not read in a similar way. The hypothesis of a differential processing of content and function words in non-pathological persons comes from the observation of aphasic patients with agrammatism.
    [Show full text]
  • Eye-Based Interaction in Graphical Systems: Theory & Practice
    Eye-Based Interaction in Graphical Systems: Theory & Practice Andrew Duchowski Clemson University Part I Introduction to the Human Visual System (HVS) Siggraph 2000 Course Notes I–1 Eye-Based Interaction in Graphical Systems A Visual Attention “Everyone knows what attention is. It is the taking possession by the mind, in clear and vivid form, of one out of what seem several simultaneously possible objects or trains of thought. Focalization, concentration, of consciousness are of its essence. It implies withdrawal from some things in order to deal effectively with others...” “When the things are apprehended by the senses, the number of them that can be attended to at once is small, ‘Pluribus intentus, minor est ad singula sensus.’” –William James [Jam81, pp.381-382,p.384] The Latin phrase used above by James roughly translates to “Many filtered into few for perception”. The faculty implied as the filter is attention. Humans are finite beings that cannot attend to all things at once. Attention is used to focus our mental capacities on selections of the sensory input so that the mind can successfully process the stimulus of interest. Our capacity for information processing is roughly bounded by the “magic” number 7 2 [Mil56]. While listening to an orchestra, it is possible to concentrate on specific instruments, e.g., the flute or the oboe. The brain processes sensory input by concentrating on specific components of the entire sensory realm so that interesting sights, sounds, smells, etc., may be examined with greater attention to detail than peripheral stimuli. This is particularly true of vision.
    [Show full text]
  • The Impact of Left to Right Eye Movement on Arab EFL/ESP Learners’ Output∗
    Sino-US English Teaching, January 2017, Vol. 14, No. 1, 16-24 doi:10.17265/1539-8072/2017.01.003 D DAVID PUBLISHING The Impact of Left to Right Eye Movement on Arab EFL/ESP Learners’ Output∗ Dr. Abdellah Benahnia Casablanca: Morocco English Language Center, King Fahad Medical City, Riyadh, Kingdom of Saudi Arabia Though a lot has been said about L2 acquisition and learners’ output, there is still much to be done in terms of research pertaining to the cognitive part of eye movement based on the nature of the target language (TL) within the process of learning. Thus, eye movement according to the nature of L2 can be a challenge that learners might face. Arab EFL, or ESP learners might find it more difficult, taking into consideration the nature of the script of their Arabic language mother tongue (MT) going from right to left, and being a total opposite of all Anglo Saxon scripts (left to right). The following article tries to focus on the input process of Arab learners while trying to adapt to, or learn English as a foreign language, and find out if the paradox of eye movement which is left to right vs. right to left, (in the case of EFL/ESP learning), has any impact on these particular learners’ actual output and performance. Keywords: eye movement, reading span, learning, EFL Arab learners Introduction Though it has been claimed that lexical access cannot be the “engine” driving eye movements during reading, and that when and where the eyes move are instead primarily determined by visual and oculomotor factors (Reilly & O’Regan, 1998), there are yet other claims that eye movement in reading scripts can be subject to habit formation.
    [Show full text]
  • Exploring Translation and Interpreting Hybrids. the Case of Sight Translation Barbara Dragsted and Inge Gorm Hansen
    Document generated on 09/28/2021 11:24 p.m. Meta Journal des traducteurs Translators' Journal Exploring Translation and Interpreting Hybrids. The Case of Sight Translation Barbara Dragsted and Inge Gorm Hansen Volume 54, Number 3, septembre 2009 Article abstract This article reports on a comparative study of written translation and sight URI: https://id.erudit.org/iderudit/038317ar translation, drawing on experimental data combining keystroke logging, DOI: https://doi.org/10.7202/038317ar eye-tracking and quality ratings of spoken and written output produced by professional translators and interpreters. Major differences in output rate See table of contents were observed when comparing oral and written modalities. Evaluation of the translation products showed that the lower output rate in the written condition was not justified by significantly higher quality in the written products. Publisher(s) Observations from the combination of data sources point to fundamental behavioural differences between interpreters and translators. Overall, Les Presses de l'Université de Montréal working in the oral modality seems to have a lot to offer in terms of saving time and effort without compromising the output quality, and there seems to ISSN be a case for increasing the role of oral translation in translator training, incorporating it as a deliberate practice activity. 0026-0452 (print) 1492-1421 (digital) Explore this journal Cite this article Dragsted, B. & Hansen, I. G. (2009). Exploring Translation and Interpreting Hybrids. The Case of Sight Translation. Meta, 54(3), 588–604. https://doi.org/10.7202/038317ar Tous droits réservés © Les Presses de l’Université de Montréal, 2009 This document is protected by copyright law.
    [Show full text]
  • An Integrated Model of Eye Movements and Visual Encoding Dario D
    Journal of Cognitive Systems Research 1 (2001) 201±220 www.elsevier.com/locate/cogsys An integrated model of eye movements and visual encoding Dario D. Salvucci* Cambridge Basic Research, Four Cambridge Center, Cambridge, MA 02142, USA Received 6 June 2000; accepted 2 October 2000 Abstract Recent computational models of cognition have made good progress in accounting for the visual processes needed to encode external stimuli. However, these models typically incorporate simpli®ed models of visual processing that assume a constant encoding time for all visual objects and do not distinguish between eye movements and shifts of attention. This paper presents a domain-independent computational model, EMMA, that provides a more rigorous account of eye movements and visual encoding and their interaction with a cognitive processor. The visual-encoding component of the model describes the effects of frequency and foveal eccentricity when encoding visual objects as internal representations. The eye-movement component describes the temporal and spatial characteristics of eye movements as they arise from shifts of visual attention. When integrated with a cognitive model, EMMA generates quantitative predictions concerning when and where the eyes move, thus serving to relate higher-level cognitive processes and attention shifts with lower-level eye-movement behavior. The paper evaluates EMMA in three illustrative domains Ð equation solving, reading, and visual search Ð and demonstrates how the model accounts for aspects of behavior that simpler models of cognitive and visual processing fail to explain. 2001 Elsevier Science B.V. All rights reserved. Keywords: Eye movements; Cognitive models; Reading; Visual search; Computational models 1. Introduction researchers have developed such models in domains including reading (e.g., Just & Carpenter, 1980), Models of cognition have recently taken great arithmetic (e.g., Suppes, 1990), analogy (e.g., Sal- strides in interacting with the visual world.
    [Show full text]
  • Eye Movements While Reading and Searching Spatially Transformed Text: a Developmental Examination
    Memory & Cognition 1976, Vol. 4 (1),3642 Eye movements while reading and searching spatially transformed text: A developmental examination ANNE B. SPRAGINS and LESTER A. LEFTON University ofSouth Carolina, Columbia, South Carolina 29208 and DENNIS F. FISHER HumanEngineering Laboratory, AberdeenProving Ground, Maryland The effects of spatial manipulation on eye movement when subjects either read or searched through paragraphs were examined. Adults, third, and fifth graders were presented with paragraphs which were typed normally or in alternating case (upper and lower). The spacing between the words was either normal, filled, or absent. The results show that approximately twice as many character spaces are processed during search as during reading. Subjects made more fixations of shorter duration during search than reading. The data indicated that the ability to vary the size of the perceptual unit develops with experience. When spatial cues were unavailable, all subjects resorted to a letter-by-letter-like processing strategy in reading but not in search. Although reading and search were found to be sensitive to the same types of spatial manipulations, discrepancies of span and speed suggest qualitative differences; comprehension demands during reading can account for these differences. The data were interpreted to provide support for the two-stage model of Hochberg (1970). Reading can be defined as a translation of spatially stimulus materials. Reliance upon the periphery was presented lines and spaces into meaningful information. hypothesized to be developmentally related. According A number of experiments have recently been performed to this view, adults are reliant upon the periphery for examining the spacial manipulations of printed text in physical featural cues, whereas children rely upon foveal reading and visual search.
    [Show full text]