Proquest Dissertations
Total Page:16
File Type:pdf, Size:1020Kb
The integration of semantic versus world knowledge during on-line sentence comprehension Item Type text; Dissertation-Reproduction (electronic) Authors Hald, Lea Ann Publisher The University of Arizona. Rights Copyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author. Download date 30/09/2021 07:10:26 Link to Item http://hdl.handle.net/10150/280182 INFORMATION TO USERS This manuscript has been reproduced from the microfilm master. UMI films the text directly from the original or copy submitted. Thus, some thesis and dissertation copies are in typewriter face, while others may be from any type of computer printer. The quality of this reproduction is dependent upon the quality of the copy submitted. Broken or indistinct print, colored or poor quality illustrations and photographs, print bleedthrough, substandard margins, and improper alignment can adversely affect reproduction. In the unlikely event that the author did not send UMI a complete manuscript and there are missing pages, these will be noted. Also, if unauthorized copyright material had to be removed, a note will indicate the deletion. Oversize materials (e.g., maps, drawings, charts) are reproduced by sectioning the original, beginning at the upper left-hand comer and continuing from left to right in equal sections with small overiaps. ProQuest Information and Learning 300 North Zeeb Road, Ann Arbor, Ml 48106-1346 USA 800-521-0600 THE INTEGRATION OF SEMANTIC VERSUS WORLD KNOWLEDGE DURING ON-LINE SENTENCE COMPREHENSION by Lea Ann Hald A Dissertation Submitted to the Faculty of the DEPARTMENT OF PSYCHOLOGY In Partial Fulfillment of the Requirements For the Degree of DOCTOR OF PHILOSOPHY In the Graduate College THE UNIVERSITY OF ARIZONA 2002 UMI Number: 3073228 ® UMI UMI Microform 3073228 Copyright 2003 by ProQuest Information and Learning Company. All rights reserved. This microform edition is protected against unauthorized copying under Title 17, United States Code. ProQuest Information and Learning Company 300 North Zeeb Road P.O. Box 1346 Ann Arbor, Ml 48106-1346 2 THE UNIVERSITY OF ARIZONA « GRADUATE COLLEGE As members of the Final Examination Committee, we certify that we have read the dissertation prepared by Lea Ann Ha Id entitled The Integration of Semantic Versus World Knowledge Purina On-line Sentence Comprehens ion. and recommend that it be accepted as fulfilling the dissertation requirement for the Degree of Doctor of Philosophy 11 / V\ ! ^ Nicol Date U't^'OZ. Dr. M Date //- Dr. Ken Forster Date II - -oZ. Dr. Heidi HarlLey Date H - to ^ t>L Date Final approval and acceptance of this dissertation is contingent upon the candidate's submission of the final copy of the dissertation to the Graduate College. I hereby certify that I have read this dissertation prepared under my direction and recommend that it be accepted as fulfilling the dissertation requirement. 11 >is:«rtation Director Dr. .^anet Nicol Date 3 STATEMENT BY AUTHOR This dissertation has been submitted in partial fulfillment of requirements for an advanced degree at The University of Arizona and is deposited in the University Library to be made available to borrowers under rules of the Library. Brief quotations from this dissertation are allowable without special permission, provided that accurate acknowledgement of source is made. Requests for permissions for extended quotation from or reproduction of this manuscript in whole or in part may be granted by the head of the major department or the Dean of the Graduate College when in his or her judgment the proposed use of the material is in the interests of scholarship. In all other instances, however, permission must be obtained from the author. SIGNED: 4 ACKNOWLEDGEMENTS I would have never completed this project without the help I received from mentcM's, colleagues, friends and family. I would like to express my thanks and appreciation to Peter Hagooft, Ph. D. Peter has given me guidance through all aqiects of my research and career during my time in Nijm^en. I cannot thank you enough. I would also like to thank Janet Nicol, Ph. D. who helped me through my projects in Tucson and gave me indispensable guidance on this project. I would also like to thank you for being so supportive of my choice to woric in Nijmegen. My other committee members, Merrill G^ett, Ph. D., Kenneth Forster, Ph. D., and Heidi Harley, Ph. D. were essential for both the advice they gave me regarding the project and their help in tackling the more tricky aspects of the implications of this research. I would like to extend an extra thanks to Merrill for helping me through administrative and funding hurdles I encountered along the way. Without your help in that area I would not have been able to stay two years in Nijmegen. I also would like to thank the U.S. Fulbright Foundation. It was by acquiring a Fulbright that I was able to pursue my research interests in the Netherlands. In this regard, I would also like to thank Cecile McKee, Ph. D. for the advice she gave me regarding the Fulbright i^iplication. There were many other individuals in Nijmegen that helped me throughout this project. In particular I would like to thank Karl Magnus Peterson, Ph. D., whose work made the fMRI project possible. In addition, Mirte van Galen helped me immensely with the testing and analysis of the second ERP experiment and she dso made me a better Dutch speaker. I would also like to extend my thanks to Valesca Kooijman, whose help and instruction made this project possible. Many student assistams and fellow researchers helped me in various aspects of this research, in particular I would like to thank Jelle van Dijk for teaching me so many things about working at the MPI and for being a great officemate. Thanks to Marieke van der Linden for all her help with subjects. Additionally I would like to thank Marcel Bastiaansen, Ph. D., Oliver Miiller, Peter Indefrey, Ph.D., Frauke Hellwig, Jos van Berkum, Ph. D., Rene de Bruin and Ad Verbunt. Each of you helped me with various aspects of this project and I really appreciate your support. I have made many friers in the last five years who made life as a graduate student not only more bearable, ^t actually fiin. First I want to thank my fellow Arizona students Connie and Erika for always being such great friends, Chris for idways being around to listen to my complaints, Jen, Ethan, Patrick, Rachel, Peter F. and Jason for adding some extra fiin and craziness to my life. I want to especially thank Ethan and Jen for making my return to Tucson as smooth and painless as possible; I cannot thank you both enough. Of course I cannot forget my Nijmegen friends. Mandana you were always so much fiin to 'keep fit' with, Simone for being such a great friend and always giving me inspiration to speak more Dutch. Thanks to Joana, Fermin, Femke, Gr^ and Alissa for all the fun diversions each of you provided. I must especially thank Natalie for being a wonderful housemate and for being an exceptional friend. Further, thanks to Keith, Betty and Eddie for always being so supportive. Finally, I would like to thank Dirk. You have helped me through so many aspects of this project and I would not have been able to finish this dissertation so smoothly if it were not for your help and continual support. You motivated me to work hard and have a great time when I wasn't working. Hartelijk Bedankt! 5 DEDICATION This work is dedicated to my parents Keith and Betty Hald. Thank you for always supporting me through this long road. 6 TABLE OF CONTENTS LIST OF FIGURES 8 ABSTRACT 9 INTRODUCTION 11 Event-Related Brain Potentials 14 TheN400 Effect 15 Functional Magnetic Resonance Imaging 18 fMRI and Semantic Processing 18 The Current Research 20 Semantic versus World Knowledge 22 The Experiments 32 EXPERIMENT 1: A VISUAL WORD-BY-WORD ERP STUDY 35 METHOD 37 Participants 37 Materials 38 Pretests 39 Procedure 41 EEG Recording and Analysis 42 RESULTS 45 Descriptive Statistics 45 Analysis for the 300-550 millisecond Time Window 48 Analysis for the 800-1200 millisecond Time Window 50 DISCUSSION 52 EXPERIMENT 2: AN AUDITORY ERP STUDY 55 METHOD 56 Participants 56 Materials 56 Procedure 58 EEG Recording and Analysis 58 RESULTS ' 59 Descriptive Statistics 59 Analysis for the 250-650 millisecond Time Window 61 Analysis of Early Onset of the N400 63 Analysis for the 1200-1800 millisecond Time Window 67 DISCUSSION 69 EXPERIMENT 3: A VISUAL fMRI STUDY 78 METHOD 86 Participants 86 Materials and Design 87 Procedure 87 MRI Data Acquisition 89 7 TABLE OF CONTENTS - Continued MR Image Pre-processing and Analysis 89 RESULTS 92 Reading Compared to Visual Fixation 92 Semantic Condition Compared to Correct Condition 94 Semantic Condition Compared to World Knowledge Condition 96 Conjunction Analysis: Correct versus Semantic Compared to World Knowledge versus Semantic 97 DISCUSSION 99 CONCLUSIONS 102 Integration of World Knowledge and Semantic Knowledge 102 Late Verification Processes 106 World Knowledge and Processing Models 106 A Follow-up Experiment 110 APPENDIX A. Full set of stimulus materials utilized 113 REFERENCES 124 8 LIST OF FIGURES FIGURE 1, Distribution of the 29 electrodes 43 FIGURE 2, Experiment 1 grand average ERP waveforms for electrode Cz 46 FIGURE 3, Experiment 1 topographical distribution of the N400 effect 47 FIGURE 4, Experiment 1 topographical distribution of the late positivity 47 FIGURE 5, Experiment 2 grand average ERP waveforms for electrode Cz 59 FIGURE 6, Experiment 2 topographical distribution of the N400 effect 60 FIGURE 7, Experiment 2 topographical distribution of the late positivity 61 FIGURE 8, Experiment 2 ERP waveforms for posterior electrodes 72 FIGURE 9, Activation for sentence reading versus visual fixation 93 FIGURE 10, Activation for the semantic condition compared to the correct condition.