The following page is the Signature Page. The Signature Page needs to be given to the Grad School, but it should not be bound with the thesis. Don't bind this page either! We approve the thesis of Jorge Vald´esKroff. Date of Signature Paola E. Dussias Associate Professor of Spanish, Linguistics, and Psychology Dissertation Co-Advisor, Chair of Committee Chip Gerfen Associate Professor of Linguistics and Spanish Linguistics Dissertation Co-Advisor Rena Torres Cacoullos Associate Professor of Spanish and Linguistics Judith F. Kroll Distinguished Professor of Psychology, Linguistics, and Women's Studies Dan J. Weiss Associate Professor of Psychology and Linguistics The Pennsylvania State University The Graduate School USING EYE-TRACKING TO STUDY AUDITORY COMPREHENSION IN CODESWITCHING: EVIDENCE FOR THE LINK BETWEEN COMPREHENSION AND PRODUCTION A Dissertation in Spanish, Italian, and Portuguese & Language Science by Jorge Vald´esKroff c 2012 Jorge Vald´esKroff Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy August 2012 The thesis of Jorge Vald´esKroff was reviewed and approved∗ by the following: Paola E. Dussias Associate Professor of Spanish, Linguistics, and Psychology Dissertation Co-Advisor, Chair of Committee Chip Gerfen Associate Professor of Linguistics and Spanish Linguistics Dissertation Co-Advisor Rena Torres Cacoullos Associate Professor of Spanish and Linguistics Judith F. Kroll Distinguished Professor of Psychology, Linguistics, and Women's Studies Dan J. Weiss Associate Professor of Psychology and Linguistics ∗Signatures are on file in the Graduate School. Abstract Bilinguals in the presence of other known bilinguals engage in codeswitching, broadly defined as the fluid alternation between languages in bilingual discourse (Poplack, 1980). Although the specific factors that influence codeswitching are varied, bilingual members of a community of codeswitchers are more likely to en- gage in intra-sentential codeswitching (e.g. El ni~no caught his friend a punto de romper el blender, \The boy caught his friend about to break the blender") in contrast to bilinguals who maintain a functional separation between the two languages. Codeswitching has been studied extensively in production, particu- larly from structural and social perspective . In contrast, few studies have ex- amined the comprehension of codeswitched speech from an experimental perspec- tive. This dissertation attempts to address this gap by employing an innovative eye-tracking methodology known as the visual world paradigm (Cooper, 1974; Tanenhaus, Spivey-Knowlton, Eberhard, & Sedivy, 1995) to examine the role of grammatical gender in the processing of Spanish-English codeswitched speech. We focus on grammatical gender because researchers have observed a produc- tion asymmetry in its use in Spanish-English codeswitching. Specifically, article { noun constructions (Mixed NPs) frequently appear as Spanish masculine arti- cles followed by English nouns regardless of the gender of the Spanish translation equivalent, e.g. el juice, Sp. elmasc jugomasc and el cookie, Sp. lafem galletafem. Al- ternatively, Mixed NPs with Spanish feminine articles are infrequent and restric- tively appear with English nouns that have feminine Spanish translation equiv- alents, e.g. la cookie, Sp. lafem galletafem but *la juice, Sp. elmasc jugomasc. This observation leads us to propose that codeswitching is an ideal test case to investi- gate the direct link between production and comprehension. Working within the Production-Distribution-Comprehension (PDC) framework (Gennari & MacDon- ald, 2009), we hypothesize that the gender production asymmetry reported in the production of codeswitched speech should be reflected in comprehension. iii To investigate this hypothesis, we first quantified the distribution of Mixed NPs using a bilingual spoken language corpus (Deuchar, Davies, Herring, Parafita Cuoto, & Carter, 2012) as a means to confirm the production asymmetry described by other researchers (Jake, Myers-Scotton, & Gross, 2002a; Otheguy & Lapidus, 2003; Clegg, 2006). Validating previous observations, we found that masculine marked Mixed NPs constitute the overwhelming majority of Mixed NPs (92%). In contrast, feminine marked Mixed NPs were rare in our corpus (3%). To examine the impact of this production asymmetry in comprehension, we recruited 2 groups of Spanish-English bilinguals from City College of New York (CCNY) categorized by their place of birth (U.S. born, N = 21, v. Latin born, N = 25). Both groups of bilinguals participated in three separate eyetracking experiments within one ex- perimental session: a Spanish unilingual block, a lexical-level codeswitching block, and a sentence-level codeswitching block. In all three blocks, participants were shown a simple 2-picture display of concrete objects. While listening to recorded stimuli in Spanish (Spanish unilingual block) or in codeswitching, a target picture was named, and participants were instructed to click on the target picture. Concur- rently, participants' eye movements were recorded with a desk-mounted eyetracker at a sampling rate of 1000 Hz. We capitalized on two previous findings in the eye-tracking literature. First, Spanish gender has been shown to be used as a facilitatory morpho-syntactic cue in informative contexts (Lew-Williams & Fernald, 2007). In contrast, phonological competition (i.e. overlapping phonology in potential target candidates) is shown to delay spoken language recognition (e.g. Allopenna, Magnuson, & Tanenhaus, 1998). Therefore, our experimental items in the codeswitching blocks introduced a phonological manipulations such that all paired items overlapped in initial phonol- ogy but had Spanish translation equivalents that differed in gender, e.g. candy [kændi], Sp. caramelomasc and candle [kændl], Sp. velafem. Furthermore, in both the Spanish unilingual and lexical-level codeswitching" block, target items were em- bedded phrase-finally in a simple carrier phrase. In the sentence-level block, target items were embedded in sentence-medial position in variable sentential contexts. In order to encourage listening for comprehension, we introduced a plausibility judgment at the end of each trial. Moreover, half of the sentences began in En- glish and the other half in Spanish. Each member of an experimental pair was a target and was combined with both Spanish articles resulting in four experimental conditions: feminine match trials, feminine mismatch trials, masculine match tri- als, and masculine mismatch trials. If the predictions of the PDC framework are correct, then bilinguals should not show any facilitatory processing for masculine conditions given its documented preference as the default article in Spanish-English codeswitching. In contrast, the feminine mismatch trial should result in increased delayed processing in comparison to feminine match trials. iv In our analysis, we compared the proportion of fixations to target items and distractor items for each condition in each experimental block. We conducted paired-t tests on the difference between the mean proportion of target and distrac- tor fixations in 100 msec time regions from article onset. The Spanish unilingual block served as a baseline to examine gender processing in Spanish. To further support the validity of our materials and to interpret the bilingual data, we in- cluded a control group of Spanish monolinguals (N = 24). Replicating a previous study, the Spanish monolinguals revealed the online use of grammatical gender in informative contexts as evidenced by significantly higher mean proportion of fixa- tions to target items in different gender trials at earlier time regions than for same gender trials. In contrast, the U.S. born bilingual group showed no facilitation due to gender in spoken language processing, exhibited by a similar timecourse for both different and same gender trials. The Latin born group showed facilitatory effects only for feminine conditions. The lexical level codeswitching block revealed that U.S. born bilinguals can use grammatical gender to strongly facilitate target identification in masculine conditions. Differences were also found for feminine conditions but were mainly attributable to increased difficulty in integration of feminine mismatch targets. In contrast, the Latin born group continued to exhibit strong facilitatory effects for feminine conditions. For masculine conditions, differences were found but were mainly attributable to increased difficulty in integration of masculine mismatch tar- gets. For the sentence-level codeswitching block, the U.S. born bilinguals showed little modulation attributable to grammatical gender except for a strong facilita- tory effect for feminine mismatch targets in Spanish-first codeswitching trials. In contrast, the Latin born group did reveal differences based on language manip- ulation and gender. Specifically, in English-first codeswitching trials, the Latin born bilinguals exhibited a weak facilitatory effect for feminine conditions that was neutralized in Spanish-first codeswitching trials. For masculine conditions, the masculine match trials revealed a similar timecourse of processing in both English-first and Spanish-first codeswitching trials, but masculine mismatch trials were more difficult to integrate in Spanish-first codeswitching trials. We discuss the findings in terms of gender processing in bilingualism and implications for the PDC model. v Contents List of Figures ix List of Tables x Acknowledgments xi Chapter 1 Investigating Auditory Comprehension