PDF hosted at the Radboud Repository of the Radboud University Nijmegen The following full text is a publisher's version. For additional information about this publication click this link. http://hdl.handle.net/2066/168722 Please be advised that this information was generated on 2019-01-10 and may be subject to change. Sensorimotor Experience in Speech Perception c 2017, William Schuerman ISBN: 978-90-76203-82-9 Cover photo: Kees Peerdeman, “Sounds bananas”, referring to the metaphor by Albert S. Bregman, likening auditory perception to observing the ripples made by objects moving on a lake. Printed and bound by Ipskamp Drukkers b.v. Sensorimotor Experience in Speech Perception Proefschrift ter verkrijging van de graad van doctor aan de Radboud Universiteit Nijmegen op gezag van de rector magnificus prof. dr. J.H.J.M. van Krieken, volgens besluit van het college van de decanen in het openbaar te verdedigen op maandag 27 maart 2017 om 12.30 uur precies door William Lawrence Schuerman geboren op 28 september 1984 te Sonoma, Verenigde Staten Promotoren: Prof. dr. J. M. McQueen Prof. dr. A. Meyer Manuscriptcommissie: Prof. dr. M. Ernestus Prof. dr. H. Bekkering Dr. P. Adank (University College London, Verenigd Koninkrijk) This research was supported by the The Max Planck Society for the Advancement of Science, Munich, Germany. Sensorimotor Experience in Speech Perception Doctoral Thesis to obtain the degree of doctor from Radboud University Nijmegen on the authority of the Rector Magnificus prof. dr. J.H.J.M. van Krieken, according to the decision of the Council of Deans to be defended in public on Monday, March 27, 2017 at 12:30 hours by William Lawrence Schuerman born in Sonoma, USA on September 28,1984 Supervisors: Prof. dr. J. M. McQueen Prof. dr. A. Meyer Doctoral Thesis Committee: Prof. dr. M. Ernestus Prof. dr. H. Bekkering Dr. P. Adank (University College London, United Kingdom) This research was supported by the The Max Planck Society for the Advancement of Science, Munich, Germany. Acknowledgements In taking this opportunity to acknowledge the many people who made my doctoral research possible, it is regretfully inevitable that I will fail to name many who deserve to be recognized. For this my deepest apologies. This thesis would never have been completed were it not for my family, friends, colleagues, and supervisors. I say this not only out of gratitude, but in recognition of the extensive social support structure behind every line of text in this book. Thank you all for helping me do this. To begin the particulars, I wish to thank my fellow PoL group members. You formed the cornerstone of my MPI experience, and the atmosphere of shared camaraderie was one of the greatest parts of coming to work. There are way too many of you to thank, so I’ll just say thank you to you all (like a group hug). Carrying out research required constantly grappling with new ideas and techniques. Had I not been able to turn to colleagues who graciously shared their knowledge, I could have easily fallen far behind. In particular, thank you to Seán Roberts and Mitty Casillas-Tice, for introducing me to trees, forests, and many other analytic techniques. Thank you to Linda Drijvers and Valeria Mongelli for sharing your expertise, scripts, and time. Also thanks to numerous other people in all the departments who at one time or another I went to for help. The MPI’s greatest resource was your support and generosity. Special thanks are due to my incredible officemates, paranymphs, and friends, Johanne Tromp and Merel Maslowski. Working, commiserating, rejoicing, and drinking lots and lots of coffee together created a gezellig little place to go every day. Johanne, yeah, I mean, come on! You are an awesome officemate, a great friend, and a very good dancer. Merel, thank you for sharing high fives, endless cups of coffee, and being exactly the way you are. I really lucked out sharing 363 with you both. One of the greatest things about being at the MPI was being able to participate in a wide range of discussion groups and collaborations that broadened my perspective on a wide range of topics. Thank you to all the members of the Radboud University Sound Learning group, for the excellent feedback on my experiments and sharing your work with me. Similarly, thank you to the Radboud University SPRAC group for excellent suggestions and interpretations. I want to sincerely thank the MPI conversation analysis meetings (and in particular the SiN group) for welcoming me in, teaching me the ropes of CA (many thanks to Elliott for guiding my education), and letting me take part in a really fun project. It. Is. The. Best. Period. Similarly, deep thanks to John Houde, Sri Nagarajan, and the members of the UCSF Speech Neuroscience Lab for letting me invite myself over to collaborate and learn their sound altering secrets. i ii To Prof. Mirjam Ernestus, Prof. Harold Bekkering, and Dr. Patti Adank, thank you for giving my thesis thoughtful consideration and provide such incisive remarks. To the TG staff, in particular Alex Dukers, Ronald Fischer, and Ad Verbunt, thanks for your patience and ever-present assistance. Even when it started raining in the experi- ment rooms, you were all ready to help figure out what was going on. To the library staff, Karin Kastens and Meggie Uijen, thank you so much for finding numerous odd articles, getting through paywalls, and obtaining obscure books. This next part is a bit hard to write, but I think it’s important. Mid-way through my PhD I had a personal crisis and did not know if I could (or should) continue. Looking back now, I am so very glad that I saw it through to the end. To all of you, I am immensely grateful. I would like to specifically thank Marjoleine Sloos, Katie Drager, Nicolai Pharao, Erez Levon, Cynthia Blanco, Shiri Lev-Ari, Richard Todd, and all those at the Bias in Auditory Perception conference. It may seem a bit strange to call a small conference on phonetics as being ‘life-changing’, but that is exactly what it was. Marjoleine, thank you so much for taking the time to talk with me, and for showing me that it’s okay to ask for breathing room when it is desperately needed. To Johanne, I couldn’t have asked for a better office-mate and sympathetic ear during that hard time. To Elliott, I hope you know how important your friendship and support was. To Huub, I hope you know that you helped me work through a lot of things just by sharing your time with me, and I am very glad to have become friends with you. To Antje and James, thank you for showing such support for my emotional well-being, and such willingness to help me through that long rough patch. Your kindness meant a great deal. To Elliott, thank you for adventure times, for going to distant lands together, for being critical, for introducing me to new ideas, for listening and talking and just being one of the coolest people I have ever had the honor of being friends with. Maybe the real treasure was the journey. Maybe the real thesis is friendship. Social life is just as important to surviving a Ph.D. as educational support. Sunday brunch crew, there was never a week so bad that a few beers, waffles, and hours spent with close friends couldn’t make all better. Lisa, René, Rick, Ellen, David, the PHD band, we had a great run, thanks for making my last few months filled with so much music. My housemates at Le Fab, for turning dishes into dancing, birthdays into all-day brunches, living rooms into karaoke dens, a house into a home and friends into a family, thank you all so much. The cover art was graciously illustrated by Kees Peerdeman, thanks champ! Bart and Louise, for just being great people to cook, protest, and volunteer with. iii To my supervisors, Antje Meyer and James McQueen. You allowed me to work indepen- dently, yet were always responsive and ready to give feedback and advice when needed. James, thank you for helping me delve deeper into phonetics and for offering great ad- vice and feedback when I struggled with writing or analyses. Antje, thank you for always having an open door, for replying to emails with astonishing speed, and for providing critical feedback while always being encouraging. Lastly, thank you to my family, for dealing with me running around the world, for en- couraging my interests, and for always just wanting me to be happy. You even tried being participants in one of my weird experiments (sorry I put you through that. it may happen again). Love you lots. Contents Acknowledgements i List of Figures vii List of Tables viii 1 Introduction 1 1.1 Action and perception . 1 1.1.1 Sensorimotor control theory and speech production . 2 1.1.2 Sensorimotor experience in speech perception . 4 1.1.2.1 Sensorimotor predictions shape speech perception . 5 1.1.2.2 Sensorimotor experience maps acoustic information to linguistic representations . 6 1.1.3 Methodology . 7 1.1.4 Thesis Outline . 9 2 Sensorimotoric Adaptation Affects Perceptual Compensation for Coarticula- tion 13 2.1 Introduction . 14 2.2 Experiment 1 . 17 2.2.1 Participants . 19 2.2.2 Ethics Declaration . 19 2.2.3 Design . 19 2.2.4 Speaking Task . 20 2.2.4.1 Equipment and AAF signal processing . 20 2.2.4.2 Speaking Task Stimuli . 21 2.2.4.3 Procedure . 21 2.2.4.4 Acoustic Analysis .