語言心理學 • Speech Processing • Word Reading 陳欣進 • Language Production 國立中正大學心理學系 • Bilingualism • Dyslexia 神經與認知科學工作坊 02/10/12
Total Page:16
File Type:pdf, Size:1020Kb
Outline • Geschwind’s Model of Language Processing 語言心理學 • Speech Processing • Word Reading 陳欣進 • Language Production 國立中正大學心理學系 • Bilingualism • Dyslexia 神經與認知科學工作坊 02/10/12 1 2 Brain Mechanisms and Language 語言心理學是啥? • Geschwind’s Model of Language Processing (1972) Conduction • 心理語言學(Psycholinguistics): aphasia 研究語言使用所需之心理歷程 • 此心理歷程包括: – 語言理解 Language Comprehension – 語言產製 Language Production – 語言發展 Language Acquisition Wernicke’s Broca’s aphasia aphasia 4 言語知覺 – Speech Perception Perception of Isolated Speech Segments • Is speech perception simple ? • The Motor Theory of Speech Perception – just categorize the sounds that they hear into one –聽者會使用隱顯的發音知識 (如何發音) 以協助語音知覺 of many classes of sounds that exist in their (Liberman et al. 1967) language 用以說明類別知覺 • Actually, speech perception is extraordinarily complex !!! although the relationship between acoustic structure and perception is complex – the environmental context often interferes with the speech signal the link between articulation and perception is more direct other auditory signals competes your limited processing resources 證據 1:學第二外語多需由唸出音來學習 – the variability of the speech signal itself 證據 2:McGurk Effect (1978) (BA+GA=DA) no one-to-one correspondence between the when visual information and auditory characteristics of the acoustic stimulus and the information are in conflict, perceivers use both speech sound we hear information to arrive at a stable perception 1 Perception of Continuous Speech Speech Processing • 語音本身並不足以達成辨識 –Pollack & Pickett (1964) • 雖然個別字音在對話中可以被辨識出 受試者無法辨識由對話中切割出的個別字音 –語音知覺中的音韻音素(prosodic factor) • Stress, Intonation, and rate –語音知覺中的語義與語法音素 • 當單字尤其脈絡抽離後會較難以辨識 –Phonemic Restoration (音素復原效果) • Warren & Warren (1970) –It was found that the *eel was on the axle. –It was found that the *eel was on the shoe. –It was found that the *eel was on the orange. –It was found that the *eel was on the table. • wheel, heel, peel, meal • 消失的音素會被自動填補 • 在沒有 bottom-up processing 時,亦有能 top-down processing (Hickok & Poeppel, 2007) 8 Neural Basis of Word Reading Neural Basis of Reading 10 (Bolger, Perfetti, & Schneider, 2005) 9 (Shaywitz, Mody, & Shaywitz, 2006) Proto-Writing Aztec Family:Mesoamerican Chinese Location:Southern Mesoamerica Time:1400 CE to ~1600 CE Logographic Family:Sinitic Location:China, East Asia Time:~1500 BCE to present Adopted from Adopted from http://www.ancientscripts.com/ http://www.ancientscripts.com/ 2 Egyptian Maya Logophonetic Family:Mesoamerican Location:Southern Mesoamerica Time: 400 BCE to 1697 Logophonetic Egyptian Location: Africa > Egypt Time: 3100 BCE to 400 CE Adopted from http://www.ancientscripts.com/ Adopted from http://www.ancientscripts.com/ Logophonetic Family:Sinitic Maya Japanese Kana Location: East Asia Time: 5th Century CE to Present Adopted from Adopted from http://www.ancientscripts.com/ http://www.ancientscripts.com/ Hebrew C and V Alphabetic Latin Family:Proto-Canaanite Consonantal Alphabetic Location:Europe Family:Proto-Canaanite Time:700 BCE to Present Location:West Asia Time:10th century BCE A B C D E F G H I K to Present [a] [b] [k] [d] [e] [f] [g] [h] [i,y] [k] L M N O P Q R S T V X [l] [m] [n] [o] [p] [kw] [r] [s] [t] [u,w] [ks] Adopted from Adopted from http://www.ancientscripts.com/ http://www.ancientscripts.com/ 3 C and V Alphabetic Classic Dual Route Models Korean Hangul Family:Sinitic Location:East Asia Mental Lexicon Time: 15 Century CE to Present Two distinct and independent routes: . Direct access route: operates analogously to a direct association between spelling and meaning, that is, this process is a set of word-specific rules that map orthographic representations to lexical entries. Indirect access route: is analogous to a rule-governed mapping from spelling to phonology that is in turn mapped to meaning. This indirect process requires one set of rules for phonologic coding, which maps representations of graphemes to representations of phonemes, and it requires a second set of rules to map these combinations of phonologic units to lexical Adopted from entries (Van Orden, Pennington, & Stone, 1990). http://www.ancientscripts.com/ Orthographic Depth Hypothesis Neural Basis of Word Reading • ODH as a special case of Dual Route Theory – Word recognition process differs for various orthographies – Shallow (transparent) orthographies (ex. Italian, Dutch, Serbo-Croatain): rely more on indirect route – Deep (opaque) orthographies (ex. English, Hebrew, Chinese): rely more on direct route (Tan, Laird, Li, & Fox, 2005) 22 Sentence Comprehension Sentence Comprehension • Bilateral Activation, Integration, and Selection Model, • Memory, Unification, Control Model (Hagoort, 2005) (Jung-Beeman, 2005 ) Control Posterior Middle/ Superior Inferior Frontal Gyrus Temporal Gyri Dorsolateral Prefrontal Cortex Selection Activation Unification Memory Integration Inferior Frontal Gyrus Anterior Middle/ Superior Temporal Cortex Temporal Gyri Adapted from Jung-Beeman (2005) 23 Adapted from Hagoort (2005) 24 4 Speech Production Formulating Linguistic Plans • Language production simply the reverse of comprehension ? • Serial Models of Linguistic Planning – No !!! – Fromkin’s (1971) model of speech production We can recognize words automatically Six stages Both intention and effort are needed in language 1.Identification of meaning production 2.Selection of a syntactic structure • Four stages of production (Levelt, 1989) 3.Generation of intonation contour – Conceptualizing 4.Insertion of content words conceptualize what we want to communicate 5.Formation of affixes and function words – Formulating 6.Specification of phonetic segments formulate the thought into linguistic plan e.g., She’s already trunked two packs (packed two trunks). – Articulating S V O execute the plan through muscles in the speech system Meaning – Self-monitoring she has already pack two trunkpack s check if our speech is what we intended to say trunked Language Production (Indefrey & Levelt, 2004) Language Production (Indefrey & Levelt, 2004) Articulation Syllabification Phonology Lemma 27 28 Bilingualism Bilingualism Bilingual in Chinese Bilingual in English Monolingu al in English 29 30 (Tan, Spinks, Feng, SiokT, Perfetti, Xiong, Fox, & Gao, 2003) 5 Bilingualism 何謂失讀症與閱讀障礙? • Lyon, Shaywitz, & Shaywitz (2003); Shaywitz (1998) – 發展性閱讀障礙(developmental dyslexia)屬於一種特 殊的學習障礙(learning disability) – 無法正確或流暢的辨識文字 – 無法歸咎於其他認知能力的問題(包含智力)、學習 動機、或是弱勢教育環境 (Lyon, Shaywitz, & Shaywitz, 2003; Shaywitz, 1998) 31 (Perfetti, Liu, Fiez, Nelson, Bolger, & Tan, 2007) Neural閱讀障礙的認知神經基礎 Basis of Dyslexia 何謂失讀症與閱讀障礙? • Magnocellular Deficit Hypotheses (Ramus, 2001 ) • International Dyslexia Association, IDA (Lyon et al., 2003) – 讀寫障礙是一種有腦神經基礎的特殊學習障礙 – 認字或流暢性有困難 – 拼字能力與解碼能力差 – 這種困難通常是因語言的聲韻能力有缺陷 – 並非其他認知能力或教學所造成 – 衍生之問題包括閱讀理解有困難、因閱讀經驗減少而 妨礙詞彙和背景知識的成長 34 Neural Basis of Dyslexia Neural Basis of Dyslexia • Shaywitz, Morris, & Shaywitz (2008) 35 36 (Siok, Perfetti, Jin, & Tan, 2004) 6 Neural Basis of Dyslexia Neural Basis of Dyslexia • Intervention (Gabrieli, 2009) 37 38 (Siok, Perfetti, Jin, & Tan, 2004) 7.