Sounds on Time

Total Page:16

File Type:pdf, Size:1020Kb

Sounds on Time Sounds on time - N° d’ordre 232 - 2013 THESE DE L‘UNIVERSITE DE LYON Délivrée par L’UNIVERSITE CLAUDE BERNARD LYON 1 ECOLE DOCTORALE NEUROSCIENCES ET COGNITION (NSCo) DIPLOME DE DOCTORAT EN NEUROSCIENCES COGNITIVES (arrêté du 7 août 2006) Soutenue publiquement le 27 novembre 2013 à Lyon par Floris Tijmen VAN VUGT Directeurs de hèse: Dr. Barbara TILLMANN et Prof. Eckart ALTENMÜLLER Composition du Jury Prof. Eckart ALTENMÜLLER (directeur de thèse) Dr. Barbara TILLMANN (directeur de thèse) Prof. Peter KELLER (rapporteur) Prof. Virginia PENHUNE (rapporteur) Dr. Fabien PERRIN (président du jury) | 3 | Sounds on time - Sounds on time: auditory feedback in motor learning, re-learning and over-learning of timing regularity. Auditory feedback is an auditory signal that contains information about performed movement. Music performance is an excellent candidate to study its inluence on motor actions, since the auditory result is the explicit goal of the movement. Indeed, auditory feedback can guide online motor actions, but its inluence on motor learning has been investigated less. his thesis investigates the inluence of auditory feedback in motor learning, focusing particularly on how we learn temporal control over movements. First, we investigate motor learning in non-musicians, inding that they beneit from temporal information supplied by the auditory signal and are sensitive to distortions of this temporal information. Second, we turn to stroke patients that are re-learning motor actions in a rehabilitation seting. Patients improved their movement capacities but did not depend on the time-locking between movements and the resulting auditory feedback. Surprisingly, they appear to beneit from distortions in feedback. hird, we investigate musical experts, who arguably have established strong links between movement and auditory feedback. We develop a novel analysis framework that allows us to segment timing into systematic and non-systematic variability. Our inding is that these experts have become largely independent of the auditory feedback. he main claim defended in this thesis is that auditory feedback can and does play a role in motor learning of regularity, but the way in which it is used varies qualitatively between diferent populations. hese indings provide new insights into auditory-motor integration and are relevant for developing new perspectives on the role of music in training and rehabilitation setings. Keywords: Sensorimotor Integration, Auditory Feedback, Motor Learning, Motor regularity, Timing, Rehabilitation, Expert musicians, Sequence Production, Sequence Learning | 4 | Sounds on time - Feedback auditif et régularité motrice : apprentissage, rehabilitation et expertise Le feedback auditif se déinit comme un signal auditif qui contient de l'information sur un mouvement. Il a été montré que le feedback auditif peut guider le mouvement en temps réel, mais son inluence sur l'apprentissage moteur est moins clair. Cete thèse a pour but d'examiner l'inluence du feedback auditif sur l'apprentissage moteur, en se focalisant sur le contrôle temporel des mouvements. Premièrement, nous étudions l'apprentissage moteur chez les non-musiciens sains et montrons qu'ils bénéicient de l'information temporelle contenue dans le feedback auditif et qu'ils sont sensibles aux distortions de cete information temporelle. Deuxièmement, nous appliquons ces connaissances à la rehabilitation de patients cérébro-lésés. Nous trouvons que ces patients améliorent leurs capacités de mouvement mais ne dépendent pas de la correspondance temporelle entre le mouvement et le son. Paradoxalement, ces patients ont même benéicié des distortions temporelles dans le feedback. Troisièmement, nous étudions les experts musicaux, car ils ont établi des liens particulièrement forts entre leur mouvement et le son. Nous développons de nouveaux outils d'analyse qui nous permetent de séparer les déviations temporelles en variation systématique et non-systématique. Le résultat principal est que ces experts sont devenu largement indépendents du feedback auditif. La proposition centrale de cete thèse est que le feedback auditif joue un rôle dans l'apprentissage moteur de la regularité, mais la façon dont le cerveau l'utilise dépend de la population étudiée. Ces résultats donnent une nouvelle perspective sur l'intégration audio-motrice et contribuent au développement de nouvelles approches pour l'apprentissage de la musique et la réhabilitation. Mots clés: Intégration sensorimotrice, feedback auditif, apprentissage moteur, regularité motrice, timing, réhabilitation, experts musicaux, production de séquences, apprentissage de séquences. | 5 | Sounds on time - Institutes: Institute of Music Physiology and Musicians’ Medicine, University of Music, Drama and Media, Emmichplatz 1, 30175 Hanover Germany Lyon Neuroscience Research Center CNRS-UMR 5292, INSERM U1028, University Lyon-1, 50 av Tony Garnier, 69007 Lyon, France his research was supported by the EBRAMUS (European Brain and Music) grant, ITN MC FP7, GA 238157. | 6 | Sounds on time - he musician may sing to you of the rhythm which is in all space, but he cannot give you the ear which arrests the rhythm nor the voice that echoes it. – Kahlil Gibran, he Prophet | 7 | Sounds on time - | 8 | Sounds on time - Table of Contents I. Sensorimotor integration: a conceptual map.......................19 I.1. Introduction.......................................20 1.1 Aim.................................................20 1.2 Disclaimer: inding a balance between unity and diversity...............21 I.2. Preliminaries......................................22 2.1 he human motor system – a brief overview........................23 2.1.a Motor control areas – a brief outline..............................23 2.1.b Control Strategies..........................................26 I.3. Towards a deinition of sensorimotor integration................28 3.1 Sensorimotor integration....................................28 3.2 Aim.................................................29 I.4. Motor theories of cognition..............................31 I.5. Motor involvement in perception...........................32 5.1 Movement making perception possible..........................34 5.1.a Microsaccades (vision)......................................35 5.1.b Motor-induced suppression....................................36 5.2 Action perception.......................................39 5.2.a Mirror neurons...........................................39 5.2.b Mirror networks...........................................43 5.2.c Direct matching hypothesis and motor resonance......................46 5.2.d Plasticity of mirror networks: arbitrariness of the associations..............47 5.3 Speech perception and comprehension...........................50 5.3.a Perception of speech sounds...................................50 5.3.b Syntactic processing........................................54 | 9 | Sounds on time - 5.3.c Semantic processing........................................55 5.3.d Conversational interaction....................................56 5.3.e Anatomical substrates.......................................57 5.3.f Necessity and role of motor involvement............................57 5.4 Music perception.........................................58 5.4.a Why music?.............................................58 5.4.b Motor systems supporting perceptual memory formation.................59 5.4.c Music perception in novices: a focus on rhythm perception................61 5.4.d Musical experts..........................................62 5.4.e Creation of auditory-motor associations: music learning in novices...........64 I.6. Sensory involvement in action............................66 6.1 Sensory feedback in action...................................70 6.1.a Representing action by its sensory consequences (action selection)............70 6.1.b Sensory guidance of action (action execution).........................72 6.1.c Motor learning through sensory feedback (action learning)................73 6.2 Sensory stimulation in action................................75 6.2.a Sensorimotor corticospinal facilitation............................75 6.2.b Sensation as a reference for movement.............................77 6.3 Speech production........................................79 6.3.a Sensory co-activation........................................79 6.3.b Reliance on feedback........................................79 6.4 Music production........................................80 6.4.a Sensory co-activation during silent performance......................81 6.4.b Reliance on feedback........................................82 6.4.c Soniication feedback in musical novices...........................82 I.7. Synthesis.........................................84 I.8. Outline of the thesis...................................85 II. Learning in musical novices...............................87 II.1. Introduction......................................88 1.1 Motor regularity........................................88 | 10 | Sounds on time - 1.2 Serial Reaction Time......................................89 1.3 Aims and Hypotheses......................................91 II.2. hresholds of auditory-motor coupling measured with a simple task in musicians and non-musicians: Was the sound simultaneous to the keystroke?.92 2.1 Introduction............................................94 2.2 Materials and Methods....................................96 2.2.a Participants..............................................96
Recommended publications
  • Scummvm Documentation
    ScummVM Documentation CadiH May 10, 2021 The basics 1 Understanding the interface4 1.1 The Launcher........................................4 1.2 The Global Main Menu..................................7 2 Handling game files 10 2.1 Multi-disc games...................................... 11 2.2 CD audio.......................................... 11 2.3 Macintosh games...................................... 11 3 Adding and playing a game 13 3.1 Where to get the games.................................. 13 3.2 Adding games to the Launcher.............................. 13 3.3 A note about copyright.................................. 21 4 Saving and loading a game 22 4.1 Saving a game....................................... 22 4.2 Location of saved game files............................... 27 4.3 Loading a game...................................... 27 5 Keyboard shortcuts 30 6 Changing settings 31 6.1 From the Launcher..................................... 31 6.2 In the configuration file.................................. 31 7 Connecting a cloud service 32 8 Using the local web server 37 9 AmigaOS 4 42 9.1 What you’ll need...................................... 42 9.2 Installing ScummVM.................................... 42 9.3 Transferring game files.................................. 42 9.4 Controls........................................... 44 9.5 Paths............................................ 44 9.6 Settings........................................... 44 9.7 Known issues........................................ 44 10 Android 45 i 10.1 What you’ll need.....................................
    [Show full text]
  • How to Create Music with GNU/Linux
    How to create music with GNU/Linux Emmanuel Saracco [email protected] How to create music with GNU/Linux by Emmanuel Saracco Copyright © 2005-2009 Emmanuel Saracco How to create music with GNU/Linux Warning WORK IN PROGRESS Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is available on the World Wide Web at http://www.gnu.org/licenses/fdl.html. Revision History Revision 0.0 2009-01-30 Revised by: es Not yet versioned: It is still a work in progress. Dedication This howto is dedicated to all GNU/Linux users that refuse to use proprietary software to work with audio. Many thanks to all Free developers and Free composers that help us day-by-day to make this possible. Table of Contents Forword................................................................................................................................................... vii 1. System settings and tuning....................................................................................................................1 1.1. My Studio....................................................................................................................................1 1.2. File system..................................................................................................................................1 1.3. Linux Kernel...............................................................................................................................2
    [Show full text]
  • Midi Player Download Free Free Audio and Video Player Software – Media Player Lite
    midi player download free Free Audio and Video Player Software – Media Player Lite. MediaPlayerLite is a free open source audio and video player on Windows. You can play DVD, AVI, mpeg, FLV, MP4, WMV, MOV, DivX, XviD & more! Play your video and audio now completely free! Features – what can MediaPlayerLite do? Video, Image & Audio Player MPEG- 1, MPEG-2 and MPEG-4 playback. Free MIDI Player. Clicking the download button begins installation of InstallIQ™, which manages your MediaPlayerLite installation. Learn More. You may be offered to install the File Association Manager. For more information click here. You may be offered to install the Yahoo Toolbar. More Information. MediaPlayerLite – Best Software to Open Audio, Music & Sound Files. MediaPlayerLite is a extremely light-weight media player for Windows. It looks just like Windows Media Player v6.4, but has additional features for playing your media. Fast and efficient file playback and without any codecs. Advanced settings for bittrate and resolutions Batch conversion for many files needing to be converted. MediaPlayerLite Features. MediaPlayerLite is based on MPC-HT and supports the following audio, video and image formats: WAV, WMA, MP3, OGG, SND, AU, AIF, AIFC, AIFF, MIDI, MPEG, MPG, MP2, VOB, AC3, DTS, ASX, M3U, PLS, WAX, ASF, WM, WMA, WMV, AVI, CDA, JPEG, JPG, GIF, PNG, BMP, D2V, MP4, SWF, MOV, QT, FLV. Play VCD, SVCD and DVDs Option to remove Tearing Support for EVR (Enhanced Video Renderer) Subtitle Support Playback and recording of television if a supported TV tuner is installed H.264 and VC-1 with DXVA support DivX, Xvid, and Flash Video formats is available MediaPlayerLite can also use the QuickTime and the RealPlayer architectures Supports native playing of OGM and Matroska container formats Use as a Audio player.
    [Show full text]
  • Argomanuv23.Pdf (All Rights Reserved for All Countries) Modules Générateurs Audio Audio Generator Modules
    ARGO est constitué de plus de 100 modules ARGO is made of more than 100 de synthèse et de traitement sonore real-time sound synthesis "modules" fonctionnant en temps réel sous Max/MSP. A module is a Max/MSP patch ARGO est conçu pour des utilisateurs qui ARGO is conceived for users who n'ont jamais programmé avec Max et MSP have never programmed with Max/MSP Pour Macintosh (OS9 & OSX) For Macintosh (OS9 & OSX) et PC (Windows XP) and PC (Windows XP) Logiciel libre Freeware http://perso.orange.fr/Paresys/ARGO/ Auteur Gérard Parésys Author [email protected] ARGOManuv23.pdf (All rights reserved for all countries) Modules générateurs audio Audio generator modules Modules filtres audio Audio filter modules Modules modulateurs audio Audio Modulator modules Modules transformateurs audio Audio transformer modules Modules lecteurs/enregisteurs audio Audio Play/record modules Modules liens audio Audio link modules Modules contrôleurs Control modules Modules visu Visu modules Modules MIDI MIDI modules Les modules ARGO sont des fichiers ARGO Modules are files ("patches") (des "patches") exécutés par executed by Max/MSP application . l'application Max/MSP. Sous Windows, les patches ont l'extension For Windows, the patches have the .pat ou .mxf extension .pat or .mxf Rapidement: Quickly: (Si Max/MSP est déjà installé) (If Max/MSP is installed) 1 Ouvrir un ou plusieurs modules 1 Open one or several modules 2 Relier les modules avec : 2 Link the modules with: les 12 "ARGO Bus" 12 "ARGO Bus" les 16 "ARGO MIDI Bus" 16 "ARGO MIDI Bus" (les entrées sont en haut,
    [Show full text]
  • Release 0.23~Git Max Kellermann
    Music Player Daemon Release 0.23~git Max Kellermann Sep 24, 2021 CONTENTS: 1 User’s Manual 1 1.1 Introduction...............................................1 1.2 Installation................................................1 1.3 Configuration...............................................4 1.4 Advanced configuration......................................... 12 1.5 Using MPD................................................ 14 1.6 Advanced usage............................................. 16 1.7 Client Hacks............................................... 18 1.8 Troubleshooting............................................. 18 2 Plugin reference 23 2.1 Database plugins............................................. 23 2.2 Storage plugins.............................................. 24 2.3 Neighbor plugins............................................. 25 2.4 Input plugins............................................... 25 2.5 Decoder plugins............................................. 27 2.6 Encoder plugins............................................. 32 2.7 Resampler plugins............................................ 33 2.8 Output plugins.............................................. 35 2.9 Filter plugins............................................... 42 2.10 Playlist plugins.............................................. 43 2.11 Archive plugins.............................................. 44 3 Developer’s Manual 45 3.1 Introduction............................................... 45 3.2 Code Style...............................................
    [Show full text]
  • Squishbox User Guide Models 0001-0099 Software Version 3.0
    Squishbox User Guide models 0001-0099 software version 3.0 Contents Overview....................................................................................................................................................1 Quick Start.................................................................................................................................................2 Hardware....................................................................................................................................................3 Squishbox Diagram...............................................................................................................................3 Adjusting Contrast.................................................................................................................................3 Interface.....................................................................................................................................................4 Left Button Menu..................................................................................................................................4 Right Button Menu................................................................................................................................4 Wifi Access............................................................................................................................................5 Settings Files..............................................................................................................................................6
    [Show full text]
  • Sounds on Time: Auditory Feedback in Motor Learning, Re-Learning and Over-Learning of Timing Regularity
    Sounds on time: auditory feedback in motor learning, re-learning and over-learning of timing regularity. Floris van Vugt To cite this version: Floris van Vugt. Sounds on time: auditory feedback in motor learning, re-learning and over-learning of timing regularity.. Neuroscience. Université Claude Bernard - Lyon I, 2013. English. tel-00915893 HAL Id: tel-00915893 https://tel.archives-ouvertes.fr/tel-00915893 Submitted on 9 Dec 2013 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Sounds on time - N° d’ordre 232 - 2013 THESE DE L‘UNIVERSITE DE LYON Délivrée par L’UNIVERSITE CLAUDE BERNARD LYON 1 ECOLE DOCTORALE NEUROSCIENCES ET COGNITION (NSCo) DIPLOME DE DOCTORAT EN NEUROSCIENCES (arrêté du 7 août 2006) Soutenue publiquement le 27 novembre 2013 à Lyon par Floris Tijmen VAN VUGT Directeurs de hèse: Dr. Barbara TILLMANN et Prof. Eckart ALTENMÜLLER Composition du Jury Prof. Eckart ALTENMÜLLER (directeur de thèse) Dr. Barbara TILLMANN (directeur de thèse) Prof. Peter KELLER (rapporteur) Prof. Virginia PENHUNE (rapporteur) Dr. Fabien PERRIN (président du jury) | 3 | Sounds on time - Sounds on time: auditory feedback in motor learning, re-learning and over-learning of timing regularity.
    [Show full text]
  • Automated Composition of Picture-Synched Music Soundtracks for Movies
    Automated Composition of Picture-Synched Music Soundtracks for Movies Vansh Dassani Jon Bird Dave Cli e University of Bristol e University of Bristol e University of Bristol Bristol BS8 1UB, UK Bristol BS8 1UB, UK Bristol BS8 1UB, UK [email protected] [email protected] [email protected] ABSTRACT 15-minute music track to your liking, the chances are that you’d We describe the implementation of and early results from a system need to go back into edit to adjust the cut, so that key events in the that automatically composes picture-synched musical soundtracks movie t well to the timeline imposed by the choice of music: but for videos and movies. We use the phrase picture-synched to mean what if you don’t want to do that (remember, your movie is already that the structure of the automatically composed music is deter- at picture-lock)? If you’re a gied auteur, you could compose your mined by visual events in the input movie, i.e. the nal music is own soundtrack, ing the music to the video, but that will likely synchronised to visual events and features such as cut transitions take some time; and maybe you just don’t have the music skills. or within-shot key-frame events. Our system combines automated If instead you have money, you could pay a composer to write a video analysis and computer-generated music-composition tech- specically commissioned soundtrack, synchronised to the cut of niques to create unique soundtracks in response to the video input, the video.
    [Show full text]
  • Pytuning Documentation Release 0.7.1
    PyTuning Documentation Release 0.7.1 Mark Conway Wirt Jul 21, 2017 Contents 1 Installation 3 2 Documentation 5 3 Roadmap 7 3.1 Basic Concepts..............................................7 3.2 Scale Creation.............................................. 12 3.3 Metric Functions............................................. 18 3.4 Scale Analysis and Creation (Redux).................................. 20 3.5 Tuning Tables.............................................. 26 3.6 Number Theory............................................. 32 3.7 Utilities.................................................. 34 3.8 Visualizations.............................................. 38 3.9 Using PyTuning Interactively...................................... 42 4 Index 55 i ii PyTuning Documentation, Release 0.7.1 PyTuning is a Python library intended for the exploration of musical scales and microtonalities. It can be used by developers who need ways of calculating, analyzing, and manipulating musical scales, but it can also be used interac- tively. It makes heavy use of the SymPy package, a pure-Python computer algebra system, which allows scales and scale degrees to be manipulated symbolically, with no loss of precision. There is also an optional dependency on Matplotlib (and Seaborn) for some visualizations that have been included in the package. Some of the package’s features include: • Creation of scales in a variety of ways (EDO, Euler-Fokker, Diatonic, Harmonic, from generator intervals, etc.) • Ability to represent created scales in ways that are understood
    [Show full text]
  • 1. Why POCS.Key
    Symptoms of Complexity Prof. George Candea School of Computer & Communication Sciences Building Bridges A RTlClES A COMPUTER SCIENCE PERSPECTIVE OF BRIDGE DESIGN What kinds of lessonsdoes a classical engineering discipline like bridge design have for an emerging engineering discipline like computer systems Observation design?Case-study editors Alfred Spector and David Gifford consider the • insight and experienceof bridge designer Gerard Fox to find out how strong the parallels are. • bridges are normally on-time, on-budget, and don’t fall ALFRED SPECTORand DAVID GIFFORD • software projects rarely ship on-time, are often over- AS Gerry, let’s begin with an overview of THE DESIGN PROCESS bridges. AS What is the procedure for designing and con- GF In the United States, most highway bridges are budget, and rarely work exactly as specified structing a bridge? mandated by a government agency. The great major- GF It breaks down into three phases: the prelimi- ity are small bridges (with spans of less than 150 nay design phase, the main design phase, and the feet) and are part of the public highway system. construction phase. For larger bridges, several alter- There are fewer large bridges, having spans of 600 native designs are usually considered during the Blueprints for bridges must be approved... feet or more, that carry roads over bodies of water, preliminary design phase, whereas simple calcula- • gorges, or other large obstacles. There are also a tions or experience usually suffices in determining small number of superlarge bridges with spans ap- the appropriate design for small bridges. There are a proaching a mile, like the Verrazzano Narrows lot more factors to take into account with a large Bridge in New Yor:k.
    [Show full text]
  • Hands-On Engineering Experience, a Liberal Arts Case
    Paper ID #29699 Hands-on Engineering Experience, a Liberal Arts Case Dr. Niloofar Kamran, Cornell College Mr. Qingbao Wang, Cornell College Mr. Andy Grove William Nitschke Dragon II, Cornell College c American Society for Engineering Education, 2020 Hands-on Engineering Experience, a Liberal Arts Case Will Dragon, Qingbao Wang, Andy Grove, Niloofar Kamran Abstract Our project was a part of the 2019 Cornell College Summer Research Institute (CSRI), where Cornell College students and faculty work in close collaboration on a research project for eight weeks during summer. The program includes one faculty member and one or two students per each research topic. As the educational goals of the program, we expect our students to commit to the eight-week timeline, and we hope to get them ready for their future workplace and give them some ideas of the graduate school experience. They practice to learn how a research project is done from the literature review to the built, and we hope to encourage them to be independent thinkers. To satisfy the educational goals of the program, the students were given the flexibility to lead the project in the direction they wished, and the supervisor provided a guiding hand, emulating a graduate-level research work. In addition, the students presented their work for their peers and public audience multiple times during the project that helped them with their presentation skills. We chose the project based on the students' background and passion and with having their degree, general engineering, in mind. Students at Cornell College are heavily involved in artistic and athletic activities.
    [Show full text]
  • Linux Audio Conference 2019
    Proceedings of the Linux Audio Conference 2019 March 23rd – 26th, 2019 Center for Computer Research in Music and Acoustics (CCRMA) Stanford University, USA “In Ping(uins) e trust! Published by CCRMA, Stanford University, California, US March 2019 All copyrights remain with the authors http://lac.linuxaudio.org/2019 ISBN 978-0-359-46387-9 Credits Layout: Frank Neumann and Romain Michon Typesetting: LATEX and pdfLaTeX Logo Design: The Linuxaudio.org logo and its variations copyright Thorsten Wilms c 2006, imported into "LAC 2014" logo by Robin Gareus Thanks to: Martin Monperrus for his webpage "Creating proceedings from PDF files" ii Partners and Sponsors Linuxaudio.org iii iv Foreword Welcome everyone to LAC 2019 at CCRMA! For the second time in its seventeen year history, the Linux Audio Conference (LAC) is hosted in the United Stated of America by the Center for Computer Research in Mu- sic and Acoustics (CCRMA) at Stanford University. With its informal workshop-like at- mosphere, LAC is a blend of scientific and technical papers, tutorials, sound installations, and concerts centered on the free GNU/Linux operating system and open-source free soft- ware for audio, multimedia, and musical applications. LAC is a unique platform during which members of this community gather to exchange ideas, draft new projects, and see old friends. In these times of increasing political tensions and of rising extremism throughout the world, we believe that emphasizing and promoting the universality of this type of event is of the utmost importance. The Linux audio community exists worldwide; we believe it should remain a priority to diversify LAC’s geographical location from year to year for the benefit of those who can’t afford to travel to the other side of the world.
    [Show full text]