I COGNITIVE CONTROL of EYE MOVEMENTS in READING and VISUAL
Total Page:16
File Type:pdf, Size:1020Kb
View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by D-Scholarship@Pitt COGNITIVE CONTROL OF EYE MOVEMENTS IN READING AND VISUAL SEARCH: EVIDENCE FROM FREQUENCY-BASED EFFECTS by Polina M. Vanyukov B.S., Carnegie Mellon University, 2001 Submitted to the Graduate Faculty of the Kenneth P. Dietrich School of Arts and Sciences in partial fulfillment of the requirements for the degree of Doctor of Philosophy University of Pittsburgh 2013 i UNIVERSITY OF PITTSBURGH THE KENNETH P. DIETRICH SCHOOL OF ARTS AND SCIENCES This dissertation was presented by Polina M. Vanyukov It was defended on March 20th, 2013 and approved by Charles A. Perfetti, Professor, Department of Psychology David C. Plaut, Professor, Department of Psychology, Carnegie Mellon University Natasha Tokowicz, Associate Professor, Department of Psychology Dissertation Advisor: Tessa Warren, Associate Professor, Department of Psychology ii Copyright © by Polina M. Vanyukov 2013 iii COGNITIVE CONTROL OF EYE MOVEMENTS IN READING AND VISUAL SEARCH: EVIDENCE FROM FREQUENCY-BASED EFFECTS Polina M. Vanyukov, PhD University of Pittsburgh, 2013 Experiments in this dissertation investigate the role of cognition in eye-movement behavior during scanning and reading. Shorter and fewer fixations on the more frequent and predictable words have been observed during reading, but not when scanning text for a target word, e.g., zebra (e.g., Rayner & Raney, 1996). Past research has employed these effects of word frequency and predictability to argue that cognition drives eye movements during reading, but not during scanning. Similarly, the present studies use effects of stimulus frequency and predictability to index cognitive control of eye-movement behavior. Experiments 1 and 2 focus on the frequency effects for non-word and word stimuli, respectively. Experiment 1 employed clusters of Landolt Cs to examine how the gap size of and frequency of exposure to clusters affected eye movements during a scanning task. The findings demonstrated that, in parallel to word frequency effects observed in reading, more frequent clusters elicited fewer and shorter fixations. Experiment 2 compared eye-movement behavior on fully-crossed high- and low-frequency adjective-noun pairs embedded in paragraphs when participants were reading vs. scanning for a target word with an asterisk (e.g., “h*rse”), a word containing the letter "q" (e.g., “quilt”), or a word rhyming with "blue" (e.g., “shoe”). The results demonstrated that eye-movement measures are affected by frequency in the tasks requiring in-depth processing, such as reading and rhyme-judgment, but not in shallow-processing tasks like asterisk-detection. Experiments 3 and 4 focus on the frequency-based predictability effects for non-word and word stimuli, respectively. Experiment 3 iv employed similar materials to Experiment 1 and, in addition, manipulated frequency for pairs of clusters. The more predictable clusters in the repeating pairs elicited fewer fixations, providing tentative evidence of transitional predictability effects during scanning. Experiment 4 examined the effect of transitional probability in reading by increasing the frequency of co-occurrence for pairs of words (e.g., tulip’s blossoms) in paragraphs of text. The more predictable words elicited shorter first fixation durations, suggesting that co-occurrence frequency may result in forming short-term predictions during reading. Cumulatively, the findings demonstrate that cognitive effects are not unique to reading, and afford a more sophisticated characterization of the cognitive-oculomotor coordination. v TABLE OF CONTENTS 1.0 INTRODUCTION ........................................................................................................ 1 1.1 COGNITION AND EYE-MOVEMENT CONTROL ...................................... 2 1.2 EYE MOVEMENTS IN VISUAL SEARCH AND READING ....................... 5 1.3 STATISTICAL LEARNING .............................................................................. 8 1.4 SUMMARY OF EXPERIMENTS ................................................................... 10 2.0 EXPERIMENT 1: THE EMERGENCE OF FREQUENCY EFFECTS IN EYE MOVEMENTS ............................................................................................................................ 11 2.1 METHOD ........................................................................................................... 13 2.1.1 Participants .................................................................................................... 13 2.1.2 Procedure ....................................................................................................... 13 2.1.3 Experimental design and materials.............................................................. 14 2.1.4 Equipment ...................................................................................................... 14 2.2 RESULTS ........................................................................................................... 15 2.2.1 Behavioral results .......................................................................................... 15 2.2.2 Eye-movement results ................................................................................... 15 2.3 DISCUSSION ..................................................................................................... 19 3.0 EXPERIMENT 2: EFFECTS OF WORD FREQUENCY AND PROCESSING DEPTH ON EYE MOVEMENTS IN READING AND VISUAL SEARCH ........................ 23 vi 3.1 METHOD ........................................................................................................... 28 3.1.1 Participants .................................................................................................... 28 3.1.2 Materials ......................................................................................................... 28 3.1.3 Experimental design ...................................................................................... 29 3.1.4 Procedure ....................................................................................................... 29 3.1.1 Equipment ...................................................................................................... 30 3.2 RESULTS ........................................................................................................... 31 3.2.1 Behavioral results .......................................................................................... 31 3.2.2 Eye-tracking results ....................................................................................... 31 3.2.2.1 Word-frequency effects ...................................................................... 33 3.2.2.2 First-fixation durations....................................................................... 33 3.2.2.3 Gaze durations..................................................................................... 33 3.2.2.4 Foveal-load and parafoveal-on-foveal effects ................................... 34 3.3 DISCUSSION ..................................................................................................... 36 4.0 EFFECTS OF TRANSITIONAL PREDICTABILITY IN VISUAL SEARCH AND READING: LEARNING FROM FREQUENCY OF CO-OCCURRENCE. .............. 42 4.1 EXPERIMENT 3: CO-OCCURRENCE EFFECTS IN VISUAL SEARCH46 4.1.1 Method ............................................................................................................ 47 4.1.1.1 Participants .......................................................................................... 47 4.1.1.2 Experimental design and materials ................................................... 47 4.1.1.3 Procedure ............................................................................................. 48 4.1.1.4 Equipment............................................................................................ 48 4.1.2 Results ............................................................................................................. 49 vii 4.1.2.1 Behavioral results ................................................................................ 49 4.1.2.2 Eye-movement results ......................................................................... 49 4.1.2.3 First-fixation durations....................................................................... 50 4.1.2.4 Gaze durations..................................................................................... 53 4.1.2.5 Number of fixations ............................................................................ 54 4.1.3 Discussion ....................................................................................................... 56 4.2 EXPERIMENT 4: CO-OCCURRENCE EFFECTS IN READING............. 64 4.2.1 Method ............................................................................................................ 67 4.2.1.1 Participants .......................................................................................... 67 4.2.1.2 Experimental design and materials ................................................... 67 4.2.1.3 Procedure ............................................................................................. 69 4.2.1.4 Equipment............................................................................................ 69 4.2.2 Results ............................................................................................................. 70 4.2.2.1 Eye-tracking results ...........................................................................