"Comprehenon of Natural and Synthetic Speech: II. Effects of Predictability on Verification of Sentences Controlled for Intelligibility" (D

Total Page:16

File Type:pdf, Size:1020Kb

DOCUMENT RESUME ED 318 056 CS 507 127 AUTHOR Pisoni, David B.; And Others TITLE Research on Speech Perception. Progress Report No. 12. INSTITUTION Indiana Uiiv., Bloomington. Dept. of Psychology. SPONS AGENCY Air Force Armstrong Aerospace Medical Research Lab, Wright- Patterson AFB, OH.; National Institu' es of Health (DHHS), Bethesda, Md.; National Science Foundation, Washington, D.C. PUB DATE 86 CONTRACT AF-F-33615-83-K-0501 GRANT BNS-83-05387; NS-07134-08; NS-12179-10 NOTE 457p.; For other reports in this series, see CS 507 123-129. PUB TYPE Reports - Research/Technical (143) -- Collected Works - General (020) -- Information Analyses (070) EDRS PRICE MFO1 /PC19 Plus Postage. DESCRIPTORS *Acoustic Phonetics; Auditory Discrimination; *Auditory Perception; Communication Research; Computer Software Development; Infants; *Language Processing; Language Research; Linguistics; Speech; *Speech Synt'lesizers IDENTIFIERS Indiana University Bloomington; *Speech Perception; Speech Research; Theory Development ABSTRACT Summarizing research activities in 1986, this is the twelfth annual report of research on speech perception, analysis, synthesis, and recognition conducted in the Speech Research Laboratory of the Department of Psychology at Indiana University. The report contains the following 23 articles: "Comprermision of Digitally Encoded Natural Speech Using a Sentence Verification ...sk (SVT): A -st Report" (D. B. Pisoni and M. J. Dedina); "Comprehenon of Natural and Synthetic Speech: II. Effects of Predictability on Verification of Sentences Controlled for Intelligibility" (D. B. Pisoni and others); "Perceptual Learning of Synthetic Speech Produced by Rule" (S. L. Greenspan and others); "Trading Relations, Acoustic Cue Integration, and Context Effects in Speech Perception" (D. B. Pisoni and P. A. Luce); "Using Template Pattern Structure Information to Improve Speech Recognition Performance" (M. Yuchtman and H. C. Nusbaum); "On Word-Initial Voicing: Converging Sources of Evidence in Phonologically Disordered Speech" (O. A. Gierut and D. A. Dinnsen); "On the Assessment of Productive Phonological Knowledge" (J. A. Gierut); "Generative Phonology and Error Pattern Analyses: Empirical Claims and Differences" (J. A. Gierut); "Effects of Talker Uncertainty on Auditory Word Recognition: A First Report" (J. W. Mullenix and D. B. Pisoni); "Effects of Stress and Final-Consonant Voicing on Vowel Production: Articulatory and Acoustic Analyses"(V. Summers); "Preference Judgments Comparing Different Synthetic Voices" (3. S. Logan and D. B. Pisoni); "Auditory Perception of Complex Sounds: Some Comparisons of Speech vs. Nonspeech Signals" (D. B. Pisoni); "Perceptual Attention in Monitoring Natural and Synthetic Speech" (H. C. Nusbaum and others); "Intelligibility of Phoneme Specific Sentences Using Three Text-to-Speech Systems and a Natural. Speech Control" (J. S. Logan and D. B. Pisoni); "PRONOUNCE: A Program for Pronunciation by Analogy" (M. J. Dedina and H. C. Nusbaum); "The Role of the Lexicon in Speech Perception" (D. B. Pisoni and others); "The Role of Structural Constraints in Auditory Word Recognition" (H. C. Nusbaum and D. B. Pisoni); "A Brief Overview of Speech Synthesis and Recognition Technologies" (D. B. Pisoni); "Developing Methods for Assessing the Performance of Speech Synthesis and Recognition Systems" (D. B. Pisoni and H. C. Nusbaum); "Recognition Performance of Six Isolated Utterance Speech Recognicion Systems" (H. C. Nusbaum and others); "Human Factors Issues for the Next Generation of Speech Recognition Systems" (H. C. Nusbaum and D. B. Pisoni); "Using Speech as an Index of Alcohol Intoxication" (C. S. Martin and M. Yuchtman); "Effects of Wholistic versus Dimensional Training on Learning to Identify Epectographic Displays of Speech" (B. G. Greene); and "Testing the Performance of Isolated Utterance Speech Recognition Devices" (H. C. Nusbaum and others). (SR) *****************************************************************t**** Reproductions supplied by EDRS are the best that can be made * from the original document. RESEARCH ON SPEECH PERCEPTION Progress Report No. 12 (1986) Speech Research Laboratory Department of Psychology Indiana Unit'ersity Bloomington, Indiana 47405 .Supporitil 1)1 Department of flealth and Human Services U.S. Public Health Service National Institutes of Health Research Grant No. NS-12179- I() "PERMISSION TO REPRODUCE THIS National Institutes of Health MATERIAL HAS BEEN GRANTED BY "Training Grant No. NS-07131-08 U.S DEPARTMENT rIF EDUCATION r.)frK. e Uf F durt.onl Research and Improvement ePisok)i EDUCATIONAL RESOURCES INFORMATION CE ^ITE R ;ERIC; :National Science Foundation Tr,s dot urrenl has been reproduced as RestaRh Grant No. liNS-82)-05',8- rece.ved from the person or orcin,talton 1' Mnor r nargeS have been made t1 improve TO THE EDUCATIONAL RESOURCES ,eurock,.ton duality INFORMATION CENTER (ERIC).- and P,,nts of ,,ea, or c,g). mon s staled 1",,S d(K. not r,er r Syanly represent officlad OE RI Pos.twn or pot ry U.S. Air Force Armstrong Aerospace Medical Research Lahoratory (AFSC) Contra( t No. AF-F-1,1;615-83-K-0501 BEST COPY AVAILABLE RESEARCH ON SPEECH PERCEPTION Progress Report No. 12 (1986) David B. Pisoni, Ph.D. Principal Investigator Speech Research Laboratory Department of Psychology Irdiana University Bloomington, Indiana 47405 Research Supported by: Department of Health and Human Services U. S. Public Health Service National Institutes of Health Research Grant No. NS-12179-10 National Institutes of Health Training Grant No. NS-0/134-08 National Science Foundation Research Grant No. BNS 83-05387 and U.S. Air Force Armstrong Aerospace Medical Research Laboratory(AFSC) Contract No. AF-F-33615-83-K-0501 [RESEARCH ON SPEECH PERCEPTION ProgressReport No. 12 (1986)] Table of Contents Introduction iii I. Extender' Manuscripts . 1 Comprehension of digitally encoded natural speechusing a sentence verification task (SVT): A firstreport; David B. Pisoni and Michael J. Dedina 3 Comprehension of natural and synthetic speech: II. Effects of predictability on verification ofsentences controlled for intelligibility; David B. Pisoni, Laura M. Manaus, and MichaelJ. Dedina 19 Perceptual learning of synthetic speechproduced by rule; Steven L. Greenspan, Howard C. Nusbaum, and David B. Pisoni . '43 Trading relations, acousticcue integration, and context effects in speech perception; David B. Pisoni andPaul A. Luce 87 Using template pattern structure informationto improve speech recognition performance; Moshe Yuchtman andHoward C. Nusbaum . 107 On word-initial voicing: Convergingsources of evidence in phonologically disordered speech; Judith A. Gierut and Daniel A. WaInsen 125 On the assessment of productive phonologicalknowledge; Judith A. Gierut 151 Generative phonology and error pattern analyses:Empirical claims and differences; Judith A. Gierut 175 Effects of talker uncertaintyon auditory word recognition: A first report; John W. Mullennix and David B.Pisoni 205 Effects of stress and final-consonant voicingon vowel production: Articulatory and acoustic analyses; Van Summers 223 Preference judgements comparing differentsynthetic voices; John S. Logan and David B. Pisoni 263 II. Short Reports and Work in Progress . 291 Auditory perception of complex sounds:Some comparisons of speech vs. nonspeech signals; David B. Pisani 293 Perceptual attention in monitoring natural andsynthetic speech; Howard C. Nusbaum, Steven L. Greenspan, and David B. Pisani . 307 Intelligibility of phoneme specificsentences using three text-to-speech systems anda natural speech control; John S. Logan and David B. Pisoni 319 PRONOUNCE: A program for pronunciation byanalogy; Michael J. Dedina and Howard C. Nusbaum 335 The role of the lexicon inspeech perception; David B. Pisoni, Paul A. Luce,and Howard C. Nusbaum 349 The role of structural constraints inauditory word recognition; Howard C. Nusbaum and i",avid B. Pisani 361 A brief overview of speech synthesis andrecognition technologies; David B. Pisoni 369 Developing methods for assessing theperformance of speech synthesis and recognition systems; David B. Pisoni and Howard C.Nusbaum 379 Recognition performance of six isolatedutterance speech recognition systems; Howard C. Nusbaum,C. Noah Davis, David B. Pisoni and Ella Davis 389 Human factors issues for thenext generation of speech recognition systems; Howard C. Nusbaum and David B. Pisoni 403 Using speech as an index of alcoholintoxication; Christopher S. Martin and Moshe Yuchtman 413 Effects of wholisticversus dimensional training on learning to identify spectrographic displays of speech; Beth G. Greene . 427 III. Instrumentation and Software Development . 439 Testing the performance of isolatedutterance speech recognition devices; Howard C. Nusbaum,Christopher K. uavis, David B. Pisoni, and Ella K. Davis 441 IV. PubliLations 457 V. SRL Laboratory Staff and Personnel . 461 INTRODUCTION This is the twelfth annual report summarizing the research activities on speech perception, analysis, synthesis, and recognition carried out in the Speech Research Laboratory, Department of Psychology, Indiana University in Bloomington. As withprevious reports, our main goal has been to summarize various research activities over the past year and make them readily available to grantingagencies, sponsors and interested colleagues in the field. Some of the papers contained in this report are extended manuscripts that have been prepared for formal publication as journal articlesor book chapters. Other papers are simply short reports of research presented
Recommended publications
  • The Role of Emotion in Musical Improvisation: an Analysis of Structural Features
    The Role of Emotion in Musical Improvisation: An Analysis of Structural Features Malinda J. McPherson1*, Monica Lopez-Gonzalez1,2, Summer K. Rankin1, Charles J. Limb1,2 1 Department of Otolaryngology-Head and Neck Surgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, United States of America, 2 Peabody Conservatory of The Johns Hopkins University, Baltimore, Maryland, United States of America Abstract One of the primary functions of music is to convey emotion, yet how music accomplishes this task remains unclear. For example, simple correlations between mode (major vs. minor) and emotion (happy vs. sad) do not adequately explain the enormous range, subtlety or complexity of musically induced emotions. In this study, we examined the structural features of unconstrained musical improvisations generated by jazz pianists in response to emotional cues. We hypothesized that musicians would not utilize any universal rules to convey emotions, but would instead combine heterogeneous musical elements together in order to depict positive and negative emotions. Our findings demonstrate a lack of simple correspondence between emotions and musical features of spontaneous musical improvisation. While improvisations in response to positive emotional cues were more likely to be in major keys, have faster tempos, faster key press velocities and more staccato notes when compared to negative improvisations, there was a wide distribution for each emotion with components that directly violated these primary associations. The finding that musicians often combine disparate features together in order to convey emotion during improvisation suggests that structural diversity may be an essential feature of the ability of music to express a wide range of emotion.
    [Show full text]
  • Talker Variability in Audiovisual Speech Perception
    Language Sciences Talker Variability in Audiovisual Speech Perception Shannon Heald and Howard C Nusbaum Journal Name: Frontiers in Psychology ISSN: 1664-1078 Article type: Original Research Article Received on: 02 Apr 2014 Accepted on: 17 Jun 2014 Provisional PDF published on: 17 Jun 2014 www.frontiersin.org: www.frontiersin.org Citation: Heald S and Nusbaum HC(2014) Talker Variability in Audiovisual Speech Perception. Front. Psychol. 5:698. doi:10.3389/fpsyg.2014.00698 /Journal/Abstract.aspx?s=603& /Journal/Abstract.aspx?s=603&name=language%20sciences& name=language%20sciences& ART_DOI=10.3389/fpsyg.2014.00698 ART_DOI=10.3389 /fpsyg.2014.00698: (If clicking on the link doesn't work, try copying and pasting it into your browser.) Copyright statement: © 2014 Heald and Nusbaum. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. This Provisional PDF corresponds to the article as it appeared upon acceptance, after rigorous peer-review. Fully formatted PDF and full text (HTML) versions will be made available soon. Talker Variability 1 Running Head: Talker Variability in AV Speech Perception Talker Variability in Audiovisual Speech Perception Shannon L.M. Heald a* Howard Nusbaum a a The University of Chicago, Psychology Department *Corresponding Author: Shannon Heald 5848 S. University Ave. – B402 Chicago, IL 60637 Email: [email protected] Phone: 781-492-7568 Talker Variability 3 Statement of Significance A shift between talkers can pose a perceptual challenge to a listener due to an increase in the variability of how acoustic patterns map on to phonetic categories.
    [Show full text]
  • Curriculum Vitae Department of Psychological Sciences University of Connecticut 406 Babbidge Road, Unit 1020 Storrs, CT 06269-1
    JAMES STEPHEN MAGNUSON Curriculum Vitae Department of Psychological Sciences University of Connecticut Office: (860) 617-0853 406 Babbidge Road, Unit 1020 [email protected] Storrs, CT 06269-1020 Research interests Psycholinguistics (word recognition, sentence processing, speech perception), neurobiological and genetic bases of typical and atypical language development and function, learning, representation (integration of internal representations with environmental context), probability matching, computational modeling. Teaching interests Psycholinguistics, cognitive science, sensation and perception, judgment and decision making, connectionist modeling, simulation and modeling, laboratory methods, neurobiology of language, behavior genetics of language Education and academic positions 2015 - Associate Director CT Institute for the Brain and Cognitive Sciences Aug. 2014 - Professor University of Connecticut, Department of Psychology 2008-2014 Associate Professor University of Connecticut, Department of Psychology 2012 - Director Neurobiology of Language Training Program, interdisciplinary program involving: Behavioral Neuroscience; Clinical Psychology; Developmental Psychology; Linguistics; Perception-Action-Cognition (Psychological Sciences); Physiology & Neurobiology; Speech, Language & Hearing Sciences 2012 - Director Cognitive Science Shared Electrophysiology Resource Laboratory 2008-2012 Director Psychology Shared Electrophysiology Resource Lab (PSERL) 2004-2008 Assistant Professor University of Connecticut, Department of
    [Show full text]
  • A Computational Analysis of Uniqueness Points in Auditory Word Recognition
    Perception & Psychophysws 1986, 39 (3), 155-158 A computational analysis of uniqueness points in auditory word recognition PAUL A. LUCE Indiana University, Bloomington, Indiana To determine the extent to which words in isolation may be recognized prior to their offsets, uniqueness points or optimal discrimination points were computed for all words in a 20,000oword computerized lexicon with more than two phonemes. The results of this analysis revealed that the frequency-weighted probability of a word’s diverging from all other words in the lexicon prior to the last phoneme was only .39. This finding suggests that an optimally efficient strategy of word recognition may be severely limited in scope due to structural properties of the mental lexicon. According to Marslen-Wilson’s (1984; Marslen-Wilson example, words of shorter length (e.g., car) may over- & Tyler, 1980; Marslen-Wilson & Welsh, 1978) cohort lap completely with the initial portions of words of longer theory of auditory word recognition, the initial acoustic- length (e.g., card or carbohydrate). Thus, in a large num- phonetic information of a word presented to the listener ber of cases, shorter words presented without any con- activates a "cohort" of lexical candidates that share word- textual support may have no uniqueness point whatsoever. initial acoustic-phonetic information. Lexical candidates Furthermore, given the well-known finding that frequency that are incompatible with ensuing top-down and bottom- of usage varies inversely with word length, it is possible up information are successively eliminated from the co- that for words most frequently used in the language, an hort until only one word remains, at which time that word optimally efficient strategy is of little or no importance is recognized.
    [Show full text]
  • Dimension-Based Attention in Learning and Understanding Spoken Language
    Dimension-based Attention in Learning and Understanding Spoken Language Frederic K Dick ([email protected]) Birkbeck/UCL Centre for NeuroImaging, 26 Bedford Way, London WC1H 0DS Lori L Holt ([email protected]) Department of Psychology, Carnegie Mellon University, 5000 Forbes Avenue Pittsburgh, PA 15213 Howard Nusbaum ([email protected]) Department of Psychology, The University of Chicago, 5848 South University Avenue Chicago, Illinois 60637 Neeraj Sharma ([email protected]) Department of Electrical Communication Engineering, Indian Institute of Science, Bangalore, 560 012 Barbara Shinn-Cunningham ([email protected]) Department of Biomedical Engineering, Boston University, 610 Commonwealth Ave. Boston, MA 02215 Thus, a basic problem is discovering the acoustic Keywords: attention; learning; computational modeling; speech communication. dimensions that allow for speech decoding. In particular, the listener must track parameters of speech-relevant acoustic Background dimensions, so that the information they provide for speech decoding can be appropriately weighted. This information The acoustic world is variable and messy. Signals that includes 1) a dimension's validity (how strong is the mapping allow listeners to identify and/or disambiguate important between variability across an auditory dimension, and sound auditory objects (an unusual rustle of leaves in a darkening identity or category?); 2) its availability (how often is that forest, your winning bingo number) will likely share many dimension encountered); 3) its redundancy (how much acoustic characteristics with other sounds in the environment. informational overlap is there between this dimension and What is more, the most diagnostic auditory dimensions for others?); 4) its salience (to what degree do the basic acoustics detecting the ominously rustling leaves or categorizing a of the dimension attract exogenous attention); and 5) its cost crucial syllable may be obscured, distorted, or missing.
    [Show full text]
  • SAYURI HAYAKAWA Curriculum Vitae March, 2019
    SAYURI HAYAKAWA Curriculum Vitae March, 2019 Northwestern University [email protected] 2240 Campus Drive (847) 467-2709 Evanston, IL 60208 www.sayurihayakawa.com CURRENT POSITION Post-Doctoral Fellow 2017-present Northwestern University Department of Communication Sciences and Disorders Bilingualism and Psycholinguistics Research Group PI: Dr. Viorica Marian EDUCATION Ph.D., Cognitive Psychology 2017 University of Chicago Dissertation: Why using a foreign language changes our choices Committee: Dr. Boaz Keysar (Chair), Dr. Howard Nusbaum, Dr. Greg Norman, Dr. Albert Costa M.A., Cognitive Psychology 2013 University of Chicago Thesis: Using a foreign language to delay gratification Committee: Dr. Boaz Keysar, Dr. Howard Nusbaum, Dr. Katherine Kinzler M.A., Social Sciences 2009 University of Chicago Concentration: Psychology Thesis: Eye-gazing while thinking: The effects of language and location for Japanese-American biculturals B.A., Psychology 2008 Boston University Major in Psychology; Minor in Statistics and Probability RESEARCH INTERESTS Language (bilingualism, foreign language processing) Judgement and Decision-Making (moral judgment, risk-taking, medical/consumer choice) Culture Emotion Mental Imagery and Sensory Perception 1 PUBLICATIONS Journal Articles 1. Hayakawa, S., Ning, S., & Marian, V. (forthcoming). From Klingon to Colbertian: What artificial languages tell us about natural word learning. Bilingualism: Language and Cognition. 2. Hayakawa, S., & Marian, V. (2019). Consequences of multilingualism for neural architecture. Behavioral and Brain Functions, 15(6). 3. Marian, V., & Hayakawa, S. (2019). Neuroemergentism: At the intersection of ontogeny and phylogeny. Commentary. Journal of Neurolinguistics, 49, 252-254. 4. Marian, V., Lam, T.Q., Hayakawa, S., & Dhar, S. (2018). Spontaneous otoacoustic emissions reveal an efficient auditory efferent network. Journal of Speech, Language, and Hearing Research, 1-6.
    [Show full text]
  • Alexander L. Francis
    Alexander L. Francis Curriculum Vitae Spring, 2020 Work Home Speech, Language & Hearing Sciences 3008 Covington St. Purdue University West Lafayette, IN 47906 Lyles-Porder Hall USA 715 Clinic Drive phone +1 765.463.6776 West Lafayette, IN 47907 USA phone +1 765 494 3815 fax +1 765 494 0771 [email protected] EDUCATION Ph.D. in Linguistics and in Psychology (with Distinction), The University of Chicago, 1999 Dissertation Title: “Perceptual Learning, Attention, and Phonetic Categorization” Committee: Howard C. Nusbaum, Karen L. Landahl (co-supervisors), David McNeill, Terry Regier, Janellen Huttenlocher (reader) M.A. in Linguistics, The University of Chicago, June, 1993 B.A. in Linguistics (with Honors), University of Illinois at Urbana-Champaign, 1991 ACADEMIC EMPLOYMENT Associate Professor, Dept. of Speech, Language & Hearing Sciences, Purdue University, August 2008–present Assistant Professor, Dept. of Speech, Language & Hearing Sciences, Purdue University, August 2002–2008 Post-doctoral Fellow, Dept. of Speech and Hearing, University of Hong Kong, August, 1999– July, 2002 Research Assistant (Part-time), Dept. of Psychology, University of Chicago, 1995–1999 Graduate Research Assistant, C-3 Group (Computer Research and Applications), Los Alamos National Laboratories, Summer 1993 FUNDED RESEARCH NIH New R01 Program Award: Does effortful listening induce physiological stress? PI. Purdue University Office of Research and Partnerships and Office of the Provost. $29,928. December 1, 2015-June 30, 2017. Provost’s Fellowship for Study in a Second Discipline: Psychophysiology of Listening Effort. PI. Purdue University. $7,000. August 15, 2014 – May 15, 2015. Alexander L. Francis, p. 2 FUNDED RESEARCH (continued) Do older adults attend to speech differently than younger adults? PI (with Joshua Alexander).
    [Show full text]
  • The Self, Motivation & Virtue Project
    THE SELF, MOTIVATION & VIRTUE PROJECT supporting innovative, interdisciplinary moral self research Turning Points: Finding Experiential Forks in the Path to Wisdom and Virtues Howard Nusbaum, Ph.D. Department of Psychology University of Chicago [email protected] Copyright © 2016 Howard Nusbaum. This article was originally published in the Self, Motivation & Virtue Project’s e-Newsletter 06 (July 2016). Link to this work: https://shareok.org/handle/11244/44589 Link to the Moral Self Archive: https://shareok.org/handle/11244/22702 This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-nd/4.0/. Noncommercial re-use, distribution, and reproduction in any medium, provided the original work is properly attributed, cited, and is not altered, transformed, or built upon in any way, is permitted. Website: http://www.smvproject.com The University of Oklahoma Email: [email protected] 620 Parrington Oval, #207 Phone: (405) 325-8657 Norman, OK 73019-3051 The Self, Motivation & Virtue Project is a 3-year, interdisciplinary research initiative on the moral self. It is funded by generous support from the Templeton Religion Trust, the University of Oklahoma, the Spencer Foundation, and Marquette University. TURNING POINTS: FINDING EXPERIENTIAL FORKS IN THE PATH TO WISDOM AND VIRTUES Howard Nusbaum, Ph.D. University of Chicago People often believe that, by adulthood, the psychology of the way they think, feel, believe, and act is set in stone—that an adult’s personality cannot really change. In part, this may be why people think that wisdom is something unat- tainable because they think you are either wise or you are not.
    [Show full text]
  • The Psychology of Music in Multimedia Annabel J
    Chapter 1 Introduction: The psychology of music in multimedia Annabel J. Cohen , Scott D. Lipscomb, Siu-Lan Tan , and Roger A. Kendall The term ‘multimedia’ commonly refers to audiovisual presentations in fi lm, television, video, interactive gaming, computer interfaces, and on the Internet. Such multimedia forms are typically created collaboratively by artists and technicians. Multimedia pres- entations often have the power to engage audiences thoroughly, be it in a narrative, a game, or an advertisement. These spectator-listeners typically take for granted the role played by music and audio; although, if asked, most would agree that the music and sound contribute to the entertainment value, communication function, aesthetic pleasure, or educational purpose that multimedia can provide. In contrast to audi- ences, however, some researchers across numerous academic disciplines are directing attention to the role of music and sound in the multimedia experience. The present vol- ume gathers the work of leading scholars from these diverse disciplines to inform our understanding of the role of music in the experiences and functions of multimedia. The primary focus of this book is on the growing body of empirical research inves- tigating the cognition of musical multimedia. The term empirical refers to the process of collecting data from human participants via systematically designed experiments. The results of such empirical research provide a framework for understanding the relationships between music, sound, and image in multimedia contexts. The empirical approach can ultimately facilitate the acquisition of knowledge to support or refute insightful speculation proposed in comprehensive theoretical works (e.g., Chion, 1990/1994; Cook, 1998; Gorbman, 1987).
    [Show full text]
  • Shannon Lm Heald
    SHANNON L. M. HEALD Curriculum Vitae Psychology Department, University of Chicago 781-492-7568 5848 S. University Ave., Green Hall 302 [email protected] Chicago, IL 60637 Degrees: Ph.D. in Cognitive Psychology, University of Chicago, 2012 M.A. in Cognitive Psychology, University of Chicago, 2005 A.B. in Psychology, University of Chicago, 2002 Employment: Research Professional, Center for Practical Wisdom, University of Chicago, Fall 2017- present Post-Doctoral Scholar, Cognitive Neuroscience Lab, University of Chicago Fall 2012 - Summer 2017 Honors: Elected Fellow, Open and User Innovation Society – Summer 2019 Elected Fellow, Psychonomic Society - Spring, 2016 University of Chicago Unendowed Merit-Based Fellowship - Fall, 2002 John Dewey Prize Lectureship - Spring, 2010 Wayne C. Booth Graduate Student Prize in Teaching Nomination - Fall, 2008 Doolittle-Harrison Travel Fellowship - Spring, 2008 Graduated with Honors (A.B.), University of Chicago – 2002 Peer-Reviewer for: Journal of Phonetics Language, Cognition, Neuroscience Attention, Perception, & Psychophysics Journal of Experimental Psychology: Human Perception and Performance Journal of Memory and Language Journal of the Acoustical Society of America Journal of Neurolinguistics PLOS ONE Psychonomic Bulletin and Review Brain and Language Journal of the Association for Laboratory Phonology Linguistics Program at the National Science Foundation Language and Speech Peer-Reviewed Publications: 1. Stock-Homburg, R. M., Heald, S. L., Holthaus, C., Gillert, N. L., & von Hippel, E. (2020). Need-solution pair recognition by household sector individuals: Evidence, and a cognitive mechanism explanation. Research Policy, 104068. 2. Uddin, S., Reis, K. S., Heald, S. L., Van Hedger, S. C., & Nusbaum, H. C. (2020). Cortical mechanisms of talker normalization in fluent sentences.
    [Show full text]
  • December 2014
    If you're having trouble viewing this email, you may see it online. Share this: December 2014 The State of the Department William S. Gray Professor and Department Chair Amanda Woodward highlights some of the department's most important news- from new faculty hires to graduate student and faculty accomplishments to new research collaborations. Full Story» Can Bedtime Learning Change Kids' Attitudes Toward Math? Susan Levine and Sian Beilock have been collaborating on the Bedtime Learning Together (BLT) project to evaluate whether parent-child interaction around fun and interesting math problems results in positive changes in children’s’ math learning and attitudes. Full Story» Wisdom Research at Chicago An interdisciplinary group of scientists and scholars at Chicago, led by Howard Nusbaum in the Department of Psychology, have begun collaborating on a set of projects that use a range of methods from textual analysis to cognitive neuroscience to understand wisdom. Full Story» The Department Welcomes Three New Faculty This year the Department of Psychology hired three new junior faculty. We look forward to seeing their research programs develop and create new opportunities for interdisciplinary collaborations. Full Story» Team Science: Graduate Student Collaborations at Chicago Graduate student research is taken in exciting new directions as a result of collaborationas across labs and across areas. By forming research teams, graduate students are pursuing innovative ways to research a more complex set of questions. Full Story» Alumni Gifts Create New Opportunities for the Department Several gifts to the Psychology Department have allowed us to continue to offer an alumni lecture series as well as offer new undergraduate funding opportunities for conference travel and summer research.
    [Show full text]
  • The Impact of Allophony Versus Contrast on Speech Perception*
    The Impact of Allophony versus Contrast on Speech Perception* Amanda Boomershine,a Kathleen Currie Hall,b Elizabeth Hume,b Keith Johnsonc aUniversity of North Carolina, Wilmington bThe Ohio State University cUniversity of California, Berkeley 1. Introduction The perceptual consequences of phonological contrast have long been of interest to phonologists and phoneticians. In Trubetzkoy's well-known Grundzüge der Phonologie (1939: 78), for example, he speculates that an opposition between speech sounds that is always contrastive in a given language will be perceived more clearly than an opposition that is neutralizable in some context. Furthermore, even within the category of neutralizable oppositions, he predicts that perception will fluctuate depending on factors such as context. There are three important assumptions that underlie Trubetzkoy's speculations. First, that one's native language experience influences the ability to perceive speech sounds. Second, that the phonological relation holding between sounds in a language has an impact on a listener’s perception of those sounds. And third, that it is not simply the presence versus the absence of phonological contrast that is relevant to perceiving a sound. Rather, Trubetzkoy pinpoints different categories, or degrees, of contrast and suggests that each may have a particular consequence for speech perception. Trubetzkoy’s first and second assumptions, that one's native language experience – particularly the phonological relations between sounds – influences the ability to perceive speech sounds, are now well established in the literature. For example, studies in second language learning have found that listeners are more adept at perceiving sounds of their native language than those of a second language acquired later in life, e.g., Polka and Werker (1994), Strange (1995), Dupoux et al.
    [Show full text]