The Neural Dynamics of Perceptual Adaptation to Degraded Speech
Total Page:16
File Type:pdf, Size:1020Kb
Julia Erb: The neural dynamics of perceptual adaptation to degraded speech. Leipzig: Max Planck Institute for Human Cognitive and Brain Sciences, 2014 (MPI Series in Human Cognitive and Brain Sciences; 159) The neural dynamics of perceptual adaptation to degraded speech Impressum Max Planck Institute for Human Cognitive and Brain Sciences, 2014 Diese Arbeit ist unter folgender Creative Commons-Lizenz lizenziert: http://creativecommons.org/licenses/by-nc/3.0 Druck: Sächsisches Druck- und Verlagshaus Direct World, Dresden Titelbild: © Moritz Ellerich / RaumZeitPiraten / Fabelphonetikum (rhizome schematic) 2014 ISBN 978-3-941504-43-1 The neural dynamics of perceptual adaptation to degraded speech Der Fakultät für Biowissenschaften, Pharmazie und Psychologie der Universität Leipzig eingereichte D I S S E R T A T I O N zur Erlangung des akademischen Grades doctor rerum naturalium (Dr. rer. nat.) vorgelegt von Julia Erb, M.Sc. (Neuroscience) geboren am 17. September 1985 in Heilbronn Leipzig, den 14. Februar 2014 Acknowledgements I would like to thank several people who supported me and decisively contributed to my work during the last three years at the Max Planck Institute. First, I cordially thank my supervisor Jonas Obleser. Jonas was incredibly supportive in all stages of this thesis, during the conception, analysis and the publication of the experiments. Thank you for your generous encouragement to my development as a scientist. I am obliged to Erich Schröger and Mark Eckert who agreed to assess my work. I thank my colleagues and friends from the Auditory Cognition group, Björn Herrmann, Sung-Joo Lim, Mathias Scharinger, Antje Strauß, Anna Wilsch and Malte Wöstmann, for fruitful discussions in Tuesday morning group meetings and Friday evening Cantona sessions – I miss them. In particular, I thank Molly Henry, with whom I discussed many ideas and whose traces can be found throughout this thesis. I am grateful to Alexandra Ludwig and Michael Fuchs for their prompt acceptance of collaborating on the cochlear implant patient project. Several scientists gave helpful advice and comments at different phases of this dissertation; I particularly thank Frank Eisner, Carolyn McGettigan, Jonathan Peelle and Sonja Kotz. Many helpers deserve credit for their support in the realisation of this research. In particular, Dunja Kunke and our student assistants tirelessly invited participants and helped with behavioural data acquisition. Without the MRI team, namely André Pampel, Sylvie Neubert, Nicole Pampus, Mandy Jochemko, Anke Kummer and Simone Wipper, acquisition of the imaging data would have been impossible - many thanks for accepting my special scanning wishes. Jöran Lepsien, Lars Meyer and Zoe Schlüter supported me in the analysis of MRI data. I am thankful to Elizabeth Kelly, Armand Morel and Nicola Filippini for proofreading these pages and Kerstin Flake and Steven Kalinke who assured good quality of the graphics and layout of this thesis. Several people have modified, with their friendship, my geography of Leipzig, and provided me with shelter and support, particularly in the final steps of this thesis. I am thinking of Bruno, Jonathan, Tomas, Roberta, and Christian. I thank my dear sisters, Stephanie and Christiane, for their unconditional support, and Marlon for changing my universe – you’re spring to me, all things to me. This work is dedicated to my parents, Bärbel and Helmut Erb. Julia Erb, Leipzig, February 2014 III Bibliographic details Julia Erb, The neural dynamics of perceptual adaptation to degraded speech Fakultät für Biowissenschaften, Pharmazie und Psychologie, Universität Leipzig Dissertation 201 pages, 339 references, 21 figures, 9 tables This thesis investigates how the speech perception system copes with challenging listening situations, caused by external degradation of the speech signal, age-related hearing loss, and cochlear implanta- tion. In particular, we aim to isolate predictors of successful adaptation to degraded speech and to understand the underlying neural mechanisms. Five experiments of short-term adaptation to, and pro- cessing of, degraded speech were conducted using cognitive and psychoacoustical testing, structural and functional magnetic resonance imaging (fMRI). Speech was degraded using noise-vocoding, which reduces the spectral detail in an auditory signal while leaving the temporal envelope cues intact. The results show that individual differences in thalamic brain morphology and auditory temporal pro- cessing skills, as assessed by amplitude modulation rate discrimination, were predictive of rapid adaptation to degraded speech in healthy adults. Importantly, these findings could be replicated in cochlear implant patients whose sensitivity to temporal modulations shortly after implantation could even prospectively predict speech recognition abilities 6 months later. In an fMRI experiment in normal-hearing listeners, the neural plasticity underlying short-term adaptation to degraded speech was found to be rooted in a haemodynamic upregulation of premotor activity and a concurrent down- regulation in a striato-thalamo-cortical circuit. An additional fMRI study on AM rate discrimination revealed a cingulo-opercular network (comprising the anterior insula and anterior cingulate cortex) on which increasingly difficult non-speech discrimination and effortful degraded speech perception jointly relied, most likely reflecting executive (e.g., attentional) processes. In older adults, this network exhibited a generalised upregulation, during perception of both degraded and clear speech, corroborating hypotheses of increased reliance on cognitive control systems in older adults. Lastly, a signal processing scheme which enhances temporal envelope cues in a speech signal was shown to improve comprehension in noise, confirming the importance of temporal envelope cues in speech perception. The results provide novel evidence on the central neural mechanisms of adaptation to adverse listening conditions in listeners of different ages and hearing acuities. These findings are discussed in a speculative framework of adaptive brain mechanisms, integrating evidence across behavioural, cellular and macroanatomical levels. V Contents Preface ................................................................................................................................................XIII 1 General introduction ................................................................................................................ 15 1.1 Perceptual adaptation ................................................................................................................... 15 1.1.1 Mechanisms of perceptual adaptation ............................................................................... 16 1.1.2 Speech degradation .............................................................................................................. 17 1.1.3 Cochlear implant listeners................................................................................................... 18 1.1.4 Temporal envelope cues in speech perception ................................................................. 20 1.2 The neural bases of perceptual adaptation ................................................................................ 20 1.2.1 Brain morphology and perceptual adaptation .................................................................. 21 1.2.2 Brain function and perceptual adaptation ........................................................................ 22 1.2.3 Neural adaptation in older adults ....................................................................................... 24 1.3 Overview of the present thesis .................................................................................................... 25 2 General methods ....................................................................................................................... 29 2.1 Stimulus material: German SPIN sentences .............................................................................. 29 2.2 Signal processing: Noise-vocoding ............................................................................................. 30 2.3 Modelling of learning curves ....................................................................................................... 32 2.4 Psychoacoustical methods ........................................................................................................... 33 2.4.1 Method of constant stimuli ................................................................................................. 33 2.4.2 Adaptive methods................................................................................................................. 34 2.4.3 Response paradigms ............................................................................................................ 36 2.5 Short-term memory tests ............................................................................................................. 37 2.5.1 Auditory forward and backward digit span ...................................................................... 37 2.5.2 Auditory nonword repetition test ....................................................................................... 38 2.6 Neuroimaging methods ................................................................................................................ 38 2.6.1 Principles of structural and functional MRI ....................................................................