Music and Language: Relations and Disconnections

Total Page:16

File Type:pdf, Size:1020Kb

Music and Language: Relations and Disconnections Handbook of Clinical Neurology, Vol. 129 (3rd series) The Human Auditory System G.G. Celesia and G. Hickok, Editors © 2015 Elsevier B.V. All rights reserved Chapter 12 Music and language: relations and disconnections NINA KRAUS1,2,3,4*,† AND JESSICA SLATER1,2 1Auditory Neuroscience Laboratory, Northwestern University, Evanston, IL, USA 2Department of Communication Sciences, Northwestern University, Evanston, IL, USA 3Department of Neurobiology and Physiology, Northwestern University, Evanston, IL, USA 4Department of Otolaryngology, Northwestern University, Evanston, IL, USA INTRODUCTION some of the very same aspects of sound encoding that are deficient in impaired populations and discuss the Above all, music and language are forms of human com- implications for clinical and social contexts. munication. Since sensory function is ultimately shaped by what is biologically important to the organism, the human urge to communicate has been a powerful driving MUSIC AND LANGUAGE: STRUCTURAL force in both the evolution of auditory function and the AND FUNCTIONAL ORIGINS ways in which it can be changed by experience within an individual lifetime. The ability to extract meaning from Structure rooted in sound sound requires that all aspects of the auditory system Both music and language are complex communication work together in concert: by considering human auditory systems, in which basic components are combined into function in the context of communication, we hope to higher-order structures in accordance with rules. emphasize the highly interactive nature of the auditory Whether music was an evolutionary precursor to lan- system as well as the depth of its integration with other guage (Mithen, 2005) or merely a byproduct of cognitive sensory and cognitive systems. Through consideration faculties that developed to support language (Pinker, of relations and dissociations between music and lan- 1999), music is pervasive across human cultures and guage we will explore key themes in auditory function, throughout history, with evidence of prehistoric bone learning and plasticity. and ivory flutes dating back over 42,000 years First we will look to the origins of music and lan- (Higham et al., 2012). The capacity of music to convey guage: we shall not attempt to resolve the ongoing debate emotion is driven not only by cultural conventions but regarding their evolutionary status, but we will consider by the underlying psychophysical properties of sound what their structural characteristics and functional ori- and cochlear mechanics (Balkwill and Thompson, gins reveal about the human relationship with sound. 1999; Tramo et al., 2001; Gomez and Danuser, 2007). Then we will focus on the role of temporal structure For example, the perception of consonance and disso- in music and language, and how temporal patterns pro- nance arises at least in part from the different vibration vide a framework for information processing in the patterns generated by combinations of frequencies and brain. Next we will consider how music and language their harmonics on the basilar membrane, where conso- are learned, emphasizing interactions between the audi- nant intervals comprise simple frequency ratios and gen- tory system, cognition, and emotion and reward centers erate less interference than dissonant intervals (Von in the brain. The final section of this chapter will focus on Helmholtz, 1912). Consonant intervals are typically con- the biology of sound processing and how experience with sidered to be pleasing to the ear (Trainor, 2008), which music and language influences underlying neural func- may reflect a relationship between ease of perceptual tion. We will show that auditory expertise strengthens processing and positive emotional state (Reber et al., *Correspondence to: Nina Kraus, Ph.D., Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA. Tel: +1-847-491- 3181, Fax: +1-847-491-2523, E-mail: [email protected] †Auditory neuroscience lab website: www.brainvolts.northwestern.edu 208 N. KRAUS AND J. SLATER 1998, 2004). Children’s innate receptivity to music from background (Parbery-Clark et al., 2009b; Kraus and a very young age, including their ability to perceive con- Chandrasekaran, 2010; Anderson et al., 2013). Taken sonance and dissonance (Trainor and Heinmiller, 1998; together, these outcomes emphasize that the ability to Zentner and Kagan, 1998; Trehub, 2003), reinforces make sense of sound in a communication context relies the idea that musical structure is rooted in fundamental heavily upon integration between the auditory system characteristics of sound and sensory perception. and other cognitive and sensory systems. We will provide An important distinction between music and lan- further discussion of how these relationships are medi- guage is in their differing degrees of semantic specific- ated by experience with music and language in the final ity. While language can be used to convey precise section of this chapter. semantic content between individuals, precision can also lead to disagreement; music lacks semantic specificity TEMPORAL PROCESSING IN MUSIC but plays an important role in promoting social bonding AND LANGUAGE (Cross, 1999; Trehub, 2003), as demonstrated experi- mentally by an increase in cooperative behavior in young The auditory system plays a unique role as the temporal children following joint music making (Kirschner and processing “expert” in the nervous system, with micro- Tomasello, 2010). In this sense, language enables articu- second precision required for the localization of sounds lation of what is within us, whereas music strengthens (Mauk and Buonomano, 2004). The ability to lock on to what is shared between us. temporal patterns is a fundamental aspect of auditory processing, and is especially important for the percep- tion of communication sounds: meaningful information Communication in context unfolds simultaneously over multiple timescales in both While we are largely focused on music and language as speech and music, from overarching rhythms and stress forms of auditory communication, it is important to patterns, to the fine-grained timing differences which acknowledge that the auditory system does not function differentiate consonants and characterize the distinctive in isolation, especially within the context of communica- timbre of a voice or musical instrument. tion. Other sensory modalities, such as vision, help the The timing precision of the auditory system is also brain to construct a percept of sound object (Schutz important for sensorimotor coordination, with a study and Lipscomb, 2007; Musacchia et al., 2008) and can of 16 normal adults showing that synchronization of fin- influence speech perception. This is demonstrated by ger tapping to an auditory stimulus is more accurate than the McGurk effect, in which a video presenting repeated to a visual stimulus (Repp and Penel, 2002), and a study utterances of the syllable [ba] dubbed on to the lip move- from our laboratory with 124 typically developing ado- ments for [ga] result in normal-hearing adults perceiving lescents showing that the ability to synchronize with a a hybrid percept, the syllable [da] (McGurk and beat tracks with more consistent subcortical neural tim- MacDonald, 1976). In the case of music and language, ing in the auditory system in response to speech sounds this cross-modal integration is important in helping to (Tierney and Kraus, 2013a). determine the communicative intent which produced a The integration between auditory and motor systems sound, and thereby determining its meaning, thus: is especially strong in vocal learning species, with “Speech is processed both as a sound and as an action” co-activation of comparable motor and auditory brain (Scott and Johnsrude, 2003). Similarly, it has been shown regions in both humans and songbirds during vocal that the perception of musical performances can be sig- learning tasks (Brown et al., 2004). Rhythm perception nificantly influenced by non-auditory cues, such as body involves activation of motor regions of the brain movements (Tsay, 2013). (Zatorre et al., 2007; Chen et al., 2008), and it has been Music and language are likely to have evolved in con- proposed that the ability to synchronize to a beat may junction with important shifts in the emergence of rely upon the same auditory-motor neural infrastructure human cognition, and while the exact sequences and that evolved to support vocal learning (Patel, 2006; Patel interdependence of these evolutionary trajectories are et al., 2008, 2009; Patel and Iversen, 2014). This ability debated (Cross, 1999; Mithen, 2005; Fitch, 2006), it is has been observed in humans and other vocal learning clear that processing of music and language relies upon species but is otherwise very rare in non-human animals, cognitive capacities, such as working memory. There is however, individual cases of beat-keeping abilities in evidence that expertise such as musical training is asso- non-vocal-learning species such as the sea lion (Cook ciated with greater auditory working-memory capacity et al., 2013) leave this a matter of continuing research. across the lifespan (Bugos et al., 2007; Kraus et al., The motor system is not only involved in the produc- 2012), which also relates to better performance on every- tion of linguistic and musical sounds (Zatorre et al., day listening tasks such as perceiving speech in a noisy 2007; Nasir and Ostry, 2009); motor areas are also MUSIC AND LANGUAGE: RELATIONS AND DISCONNECTIONS 209 activated
Recommended publications
  • Australian Music & Psychology Society Newsletter
    Australian Music & Psychology Society March, 2016 Edition 2 Australian Music & Psychology Society Newsletter Welcome to our second edition After a slight delay, we are delighted to be able to bring this second edition of the AMPS newsletter to you. This newsletter is a student led publication, to facilitate discussion within the AMPS membership, and to provide a forum for researchers to write about any Inside this issue topics which may take their fancy. Music an antidote for aging? ...... 2 This issue contains some exciting submissions, including summaries of music and neuro- In Memory of Oliver Sacks .......... 3 science, the protective effect of music against cognitive aging, and a book review. We also have an obituary to Oliver Sacks, a prominent neurologist and advocate for music New AMPS Committee ................ 3 psychology. Many of the articles feature hyperlinks and web addresses, so you can access Book Review ............................... 4 additional material, or delve more deeply into this research by exploring web content if Rhythm Tracker .......................... 4 you wish. Music and Neuroscience ............. 5 This is also the last issue that Joanne Ruksenas has worked on as editor-in-chief. All of us on the AMPS Newsletter team would like to thank her for her hard work in putting Music Trust Research Award ....... 6 together this publication, and wish her all the best on her next project! Upcoming Conferences ............... 6 For future editions, please send original articles of scholarly research, book and perfor- AMPS2016 review ....................... 7 mance reviews, discussions of current research, and other items relating to music psy- About AMPS ................................ 8 chology. All are warmly welcomed.
    [Show full text]
  • Speaking in Tones Music and Language Are Partners in the Brain
    Speaking in Tones Music and language are partners in the brain. Our sense of song helps us learn to talk, read and even make friends By Diana Deutsch 36 SCIENTIFIC AMERICAN MIND July/August 2010 © 2010 Scientific American ne afternoon in the summer of opera resembling sung ordinary speech), the cries 1995, a curious incident occurred. of street vendors and some rap music. I was fi ne-tuning my spoken com- And yet for decades the experience of musicians mentary on a CD I was preparing and the casual observer has clashed with scientifi c ) about music and the brain. To de- opinion, which has held that separate areas of the music tect glitches in the recording, I was looping phrases brain govern speech and music. Psychologists, lin- O so that I could hear them over and over. At one point, guists and neuroscientists have recently changed their sheet ( when I was alone in the room, I put one of the phras- tune, however, as sophisticated neuroimaging tech- es, “sometimes behave so strangely,” on a loop, be- niques have helped amass evidence that the brain ar- gan working on something else and forgot about it. eas governing music and language overlap. The latest iStockphoto Suddenly it seemed to me that a strange woman was data show that the two are in fact so intertwined that singing! After glancing around and fi nding nobody an awareness of music is critical to a baby’s language there, I realized that I was hearing my own voice re- development and even helps to cement the bond be- petitively producing this phrase—but now, instead tween infant and mother.
    [Show full text]
  • SMPC 2011 Attendees
    Society for Music Perception and Cognition August 11­14, 2011 Eastman School of Music of the University of Rochester Rochester, NY Welcome Dear SMPC 2011 attendees, It is my great pleasure to welcome you to the 2011 meeting of the Society for Music Perception and Cognition. It is a great honor for Eastman to host this important gathering of researchers and students, from all over North America and beyond. At Eastman, we take great pride in the importance that we accord to the research aspects of a musical education. We recognize that music perception/cognition is an increasingly important part of musical scholarship‐‐and it has become a priority for us, both at Eastman and at the University of Rochester as a whole. This is reflected, for example, in our stewardship of the ESM/UR/Cornell Music Cognition Symposium, in the development of several new courses devoted to aspects of music perception/cognition, in the allocation of space and resources for a music cognition lab, and in the research activities of numerous faculty and students. We are thrilled, also, that the new Eastman East Wing of the school was completed in time to serve as the SMPC 2011 conference site. We trust you will enjoy these exceptional facilities, and will take pleasure in the superb musical entertainment provided by Eastman students during your stay. Welcome to Rochester, welcome to Eastman, welcome to SMPC 2011‐‐we're delighted to have you here! Sincerely, Douglas Lowry Dean Eastman School of Music SMPC 2011 Program and abstracts, Page: 2 Acknowledgements Monetary
    [Show full text]
  • Prior Experience Biases Subcortical Sensitivity to Sound Patterns
    Prior Experience Biases Subcortical Sensitivity to Sound Patterns Erika Skoe*, Jennifer Krizman, Emily Spitzer, and Nina Kraus Downloaded from http://mitprc.silverchair.com/jocn/article-pdf/27/1/124/1781947/jocn_a_00691.pdf by MIT Libraries user on 17 May 2021 Abstract ■ To make sense of our ever-changing world, our brains sequences, the eight tones were presented such that the search out patterns. This drive can be so strong that the brain transitional probability (TP) between neighboring tones was imposes patterns when there are none. The opposite can also either 33% (low predictability) or 100% (high predictability). occur: The brain can overlook patterns because they do not Although both sequences werenoveltothehealthyyoung conform to expectations. In this study, we examined this neural adult listener and had similar TP distributions, one was per- sensitivity to patterns within the auditory brainstem, an evo- ceived to be more musical than the other. For the more musical lutionarily ancient part of the brain that can be fine-tuned by sequence, participants performed above chance when tested experience and is integral to an array of cognitive functions. on their recognition of the most predictable two-tone com- We have recently shown that this auditory hub is sensitive to binations within the sequence (TP of 100%); in this case, the patterns embedded within a novel sound stream, and we cABR differed from a baseline condition where the sound established a link between neural sensitivity and behavioral sequence had no predictable structure. In contrast, for the less indices of learning [Skoe, E., Krizman, J., Spitzer, E., & Kraus, musical sequence, learning was at chance, suggesting that N.
    [Show full text]
  • Musical Sophistication Explains a Good Deal of Cognitive Performance. a Cross-Sectional Study of Musicians and Non-Musicians
    Resonancias vol. 24, n°47, julio-noviembre 2020, pp. 147-167/ Artículos Musical sophistication explains a good deal of cognitive performance. A cross-sectional study of musicians and non-musicians Felipe Porflitt Facultad de Educación, Pontificia Universidad Católica de Chile [email protected] Ricardo Rosas Facultad de Ciencias Sociales, Pontificia Universidad Católica de Chile [email protected] Abstract Musical sophistication is a psychometric construct that can be measured both in people with musical training and without training. Through backgrounds related to musical activities in their lifetime, and other indicators referring to their current events, the person’s musical sophistication can be estimated with a relatively high level of reliability (Cronbach’s =.78). In turn, few studies have covered the relationships between variables of this type and cognitive performance, leaving an area of research with little evidence. This study explores the relationship between musical sophistication and cognition, taking a sample of 35 musicians and 35 non-musicians (N=70). The objective was to determine to what extent musical sophistication explains cognitive performance. The Ollen Musical Sophistication Index (Ollen 2006) was used to measure this variable, and a battery of tests enabled the measurement of cognitive performance, which considered verbal and visual-spatial working memory, inhibition, flexibility, a go/no-go test, processing speed, fluid intelligence, and divided attention. Exploratory factor analysis was run, showing two factors for cognition variables. Then regression analyses were run for factors 1 and 2, and both collapsed. The results show that 6 out of 8 cognitive variables correlate positively with musical sophistication, explaining 30% of cognitive performance, after controlling for demographic variables.
    [Show full text]
  • Music of the Hemispheres
    (((( a mind for music )))) Music of the heMispheres won’t make you smarter, a growing body of evidence suggests that playing his music will. Musical training doesn’t Music of the just make you a better musician — the acquired skills seem to transfer to other areas, various studies have found. And research focused on the brain’s particu- hemispheres lar relationship with music and language suggests that engaging the mind with Playing instruments gives brains a boost musical training could remedy language By Rachel Ehrenberg s Photograph by Cary Wolinsky impairments such as dyslexia. “There really is now so much evidence ot so long ago, Mozart mania music and smarts. In the original study, showing that musical experience has a swept the nation. A small the “Mozart effect” was minor and lasted pervasive effect on how the nervous sys- study found that students only minutes. Follow-up studies found tem gets molded and shaped throughout who listened to 10 minutes of the effect specific neither to the com- our lifetimes,” says Nina Kraus, head of Na Mozart sonata performed better on poser nor to music. Students listening to the Auditory Neuroscience Laboratory a paper-folding task than their peers, Mozart were just more stimulated than at Northwestern University in Evanston, and suddenly a flourishing industry those listening to a relaxation tape or Ill. “This kind of transformation comes sprouted. Mozart’s music sang from CDs silence. And while arousal can improve about only with active engagement with and videos marketed for children, babies learning, research suggests, the effects sound. My daddy always said, ‘You never and moms-to-be.
    [Show full text]
  • Music and the Brain Course Guidebook
    Topic Subtopic Science Neuroscience & Psychology Music and the Brain Course Guidebook Professor Aniruddh D. Patel Tufts University PUBLISHED BY: THE GREAT COURSES Corporate Headquarters 4840 Westfields Boulevard, Suite 500 Chantilly, Virginia 20151-2299 Phone: 1-800-832-2412 Fax: 703-378-3819 www.thegreatcourses.com Copyright © The Teaching Company, 2015 Printed in the United States of America This book is in copyright. All rights reserved. Without limiting the rights under copyright reserved above, no part of this publication may be reproduced, stored in or introduced into a retrieval system, or transmitted, in any form, or by any means (electronic, mechanical, photocopying, recording, or otherwise), without the prior written permission of The Teaching Company. Aniruddh D. Patel, Ph.D. Professor of Psychology Tufts University rofessor Aniruddh D. Patel is a Professor of Psychology at Tufts University. After Pattending the University of Virginia as a Jefferson Scholar, he received his Ph.D. in Organismic and Evolutionary Biology from Harvard University, where he studied with Edward O. Wilson and Evan Balaban. His research focuses on the cognitive neuroscience of music. Prior to arriving at Tufts, Professor Patel was the Esther J. Burnham Senior )HOORZ DW 7KH 1HXURVFLHQFHV ,QVWLWXWH D VFLHQWL¿F UHVHDUFK RUJDQL]DWLRQ founded by the late Nobel laureate Gerald M. Edelman. Professor Patel’s major contributions have included research on music-language relations, the processing of musical rhythm, cross-species comparisons, and relations between musical training and neural plasticity. Professor Patel is the author of Music, Language, and the Brain, which won a Deems Taylor Award from the American Society of Composers, Authors and Publishers in 2008.
    [Show full text]
  • Scientific Research Into the Effects of Music
    Scientific Research into the Effects of Music Geetanjali Vaidya says one great problem that arises in trying to study music's emotional power is that the emotional content of music is very subjective. A piece of music may be emotionally powerful but is experienced in very different ways by each person who hears it. The emotion created by a piece of music may be affected by: – 1. The memories associated with the piece 2. The environment it is being played in 3. The mood of the person listening and their personality 4. The culture they were brought up in 5. Any number of factors both impossible to control and impossible to quantify. Under such circumstances, it is extremely difficult to deduce what intrinsic quality of the music, if any created a specific emotional response in the listener. Even when such seemingly intrinsic qualities are found, they are often found to be at least partially culturally dependent. (Geetanjali Vaidya (2002) - Music, Emotion and the Brain) Musical Tempo According to studies published in the ‘The Economist’ and ‘The Scientific American’ major keys and rapid tempos cause happiness, whereas minor keys and slow tempos cause sadness, and rapid tempos together with dissonance cause fear. ("Exploring the Musical Brain” - Kristin Leutwyler, January 22, 2001 Scientific American) ("The Biology of Music", February 12th - 18th 2000, The Economist) Dissonance Most people find dissonant music unpleasant. Dissonance is to a certain degree culture-dependent, but also appears to be partly intrinsic to the music. Studies have shown that infants as young as 4 months old show negative reactions to dissonance.
    [Show full text]
  • Periodicity Pitch Detection in Complex Harmonies on EEG Timeline Data
    Periodicity Pitch Detection in Complex Harmonies on EEG Timeline Data Maria Heinze1,2, Lars Hausfeld2, Rainer Goebel2, and Frieder Stolzenburg1 1Department of Automation and Computer Sciences, Harz University of Applied Sciences, Friedrichstr. 57-59, 38855 Wernigerode, Germany 2Department of Cognitive Neuroscience, Maastricht University, Minderbroedersberg 4-6, 6211 LK Maastricht, Netherlands An acoustic stimulus, e.g., a musical harmony, is transformed in a highly non- linear way during the hearing process in ear and brain. We study this by comparing the frequency spectrum of an input stimulus and its response spectrum in the auditory processing stream using the frequency following response (FFR). Using electroencephalography (EEG), we investigate whether the periodicity pitches of complex harmonies (which are related to their missing fundamentals) are added in the auditory brainstem by analyzing the FFR. While other experi- ments focus on common musical harmonies like the major and the minor triad and dyads, we also consider the suspended chord. The suspended chord causes tension foreign to the common triads and therefore holds a special role among the triads. While watching a muted nature documentary, the participants hear synthesized classic piano triads and single tones with a duration of 300 ms for the stimulus and 100 ms interstimulus interval. We acquired EEG data of 64 electrodes with a sampling rate of 5 kHz to get a detailed enough resolution of the perception process in the human brain. Applying a fast Fourier transformation (FFT) on the EEG response, starting arXiv:2002.04990v2 [cs.SD] 18 Dec 2020 50ms after stimulus onset, the evaluation of the frequency spectra shows that the periodicity pitch frequencies calculated beforehand ±3 Hz occur with some ac- curacy.
    [Show full text]
  • Final Report. NSF Workshop on Art, Creativity and Learning
    Christopher W Tyler 0824762 Final Workshop Report ________________________________________________________ Art, Creativity and Learning June 11-13, 2008 National Science Foundation ________________________________________________________ Organizers Christopher Tyler1 (lead organizer), Daniel Levitin2, Lora Likova1 1. The Smith-Kettlewell Eye Research Institute, San Francisco 2. Department of Psychology, McGill University, Montreal ________________________________________________________ 1 TABLE OF CONTENTS ___________________________________________________________________________ EXECUTIVE SUMMARY 3 Organization of the Workshop 3 Main Outcomes from the Workshop 4 Evaluation of the Current Status 4 Recommendations for Future Research 5 Consensus for a New Field of Learning Enhancement through Art 7 PARTICIPANTS 9 NSF Program Officers 9 Organizers 9 Speakers 9 Students 9 Group photograph 9 WORKSHOP SCHEDULE 10 OVERVIEW 14 Evaluation of the Current Status 14 Introduction 15 Prior Studies on Art, Creativity and Learning 15 Prior Studies of Intersensory Connections and the Arts 17 Recommendations 19 Research Strategy for a New Field of Learning Enhancement through Art 19 Methodological Recommendations 21 SPECIFIC BREAKOUT GROUP RECOMMENDATIONS 23 Visual Break-Out Group: Group leader: Christopher Tyler 23 Auditory Break-Out Group: Group leader: Daniel Levitin 25 Educational Break-Out Group: Group leader: Ellen Winner 27 DISSEMINATION OF THE RESULTS OF THE WORKSHOP 29 REFERENCES 29 APPENDIX I: Abstracts of the talks 33 APPENDIX II: Participant
    [Show full text]
  • Program Book for Music and Health
    NIH Music and Health AssessingAssessing andand MeasuringMeasuring TargetTarget Engagement:Engagement: Mechanistic and Clinical Outcome Measures for Brain Disorders of Aging SOUND HEALTH Friday June 18, 2021 U.S. Department of Health & Human Services 1:00-4:00 p.m. ET National Institutes of Health Table of Contents Foreword From Dr. Francis Collins ...........................................................................3 Foreword From Renée Fleming ................................................................................4 Agenda .......................................................................................................................5 Guiding Principles for the Choice of Outcome Measures .......................................7 Abstract for Dr. Bill Riley’s Presentation ..................................................................9 Facilitator and Panelist Biographies .......................................................................10 Group Abstracts ......................................................................................................25 Panelists’ Questions ................................................................................................35 NIH Planning Committee .........................................................................................36 Suggested Reading List ..........................................................................................37 Suggested Resources .............................................................................................38
    [Show full text]
  • Table of Contents Welcome Messages
    Table of Contents Welcome Messages..................................................................................................................................2 ICMPC11 Conference Team ..................................................................................................................5 ICMPC11 Committees .............................................................................................................................6 Awards .....................................................................................................................................................10 Information for delegates..................................................................................................................12 ICMPC Area Map .......................................................................................................................12 Registration/Help Desk.........................................................................................................13 Lunch............................................................................................................................................13 Getting Around Seattle...........................................................................................................14 Internet Access .........................................................................................................................15 Venue Map..................................................................................................................................15
    [Show full text]