The Influence of Sensory and Cognitive Consonance/Dissonance on Musical Signal Processing

Total Page:16

File Type:pdf, Size:1020Kb

The Influence of Sensory and Cognitive Consonance/Dissonance on Musical Signal Processing The Influence of Sensory and Cognitive Consonance/Dissonance on Musical Signal Processing Susan E. Rogers Department of Psychology McGill University, Montréal June, 2010 A thesis submitted to McGill University in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Experimental Psychology. © Susan E. Rogers, 2010 Table of Contents Abstract ........................................................................................................................... vii Résumé ........................................................................................................................... viii Acknowledgements .......................................................................................................... ix Preface............................................................................................................................... xi Manuscript-Based Thesis................................................................................................... xi Contributions of Authors ................................................................................................... xi CHAPTER 1.......................................................................................................................1 Introduction........................................................................................................................2 Overview of Literature.........................................................................................................3 A Brief History of Consonance and Dissonance......................................................3 “Natural” Musical Intervals ...................................................................................5 Auditory Short-term Memory...................................................................................6 Auditory Roughness in Sensory Dissonance............................................................8 Psychophysical Scaling of Musical Sounds .............................................................8 Rationale and Research Objectives .....................................................................................9 CHAPTER 2.....................................................................................................................11 Roughness Ratings for Just- and Microtuned dyads from Expert and Nonexpert Listeners............................................................................................................................12 Abstract.............................................................................................................................13 Introduction......................................................................................................................14 Auditory Roughness and Sensory Dissonance...................................................................14 Musical Expertise and Processing Differences .................................................................16 Subjective Rankings: Sources of Error and Variability.....................................................18 Experiment 1—Pure-tone dyads: Method.....................................................................20 Participants............................................................................................................20 Apparatus and Stimuli ...........................................................................................21 Procedure...............................................................................................................21 Results ...................................................................................................................22 Experiment 2— Complex-tone, just-tuned dyads: Method .........................................24 Participants............................................................................................................24 Apparatus and Stimuli ...........................................................................................25 Procedure...............................................................................................................25 Results ...................................................................................................................25 Experiment 3— Microtuned dyads: Method ................................................................27 Participants............................................................................................................27 Apparatus and stimuli............................................................................................27 Procedure...............................................................................................................28 Results ...................................................................................................................28 Comparative Analysis: Method......................................................................................30 Results: Pure-tone, just-tuned dyads.....................................................................30 Results: Complex-tone, just-tuned dyads ..............................................................31 Results: Microtuned, complex-tone dyads.............................................................31 Analyzer Cross-Comparisons ................................................................................32 ii Discussion .........................................................................................................................32 Conclusion ........................................................................................................................35 Acknowledgements ..........................................................................................................36 Appendix...........................................................................................................................37 Footnote ............................................................................................................................39 Tables ................................................................................................................................40 Figure Captions................................................................................................................53 CHAPTER 3.....................................................................................................................65 Short-term Memory for Consonant and Dissonant Pure-Tone Dyads.......................66 Abstract.............................................................................................................................67 Introduction......................................................................................................................68 Consonance and Dissonance .............................................................................................68 Auditory STM.....................................................................................................................70 Method ..............................................................................................................................71 Participants............................................................................................................71 Apparatus and Stimuli ...........................................................................................72 Procedure...............................................................................................................73 Results ...............................................................................................................................75 Data Analysis.....................................................................................................................75 Overall Performance and the Effect of Musical Training .....................................76 The Effect of Retention Period...............................................................................76 The Effect of Consonance and Dissonance............................................................77 Cognitive C/D ............................................................................................77 Sensory C/D ...............................................................................................78 Tests of Auditory Memory Duration ......................................................................79 The Effect of Secondary Variables.........................................................................79 Discussion .........................................................................................................................80 Conclusion ........................................................................................................................83 Acknowledgements ..........................................................................................................84 Appendix A.......................................................................................................................85 Deriving sensory consonance/dissonance levels ...................................................85 Deriving cognitive consonance/dissonance levels.................................................89 Appendix B .......................................................................................................................90 Tables ................................................................................................................................91
Recommended publications
  • A Psychological Approach to Musical Form: the Habituation–Fluency Theory of Repetition
    A Psychological Approach to Musical Form: The Habituation–Fluency Theory of Repetition David Huron With the possible exception of dance and meditation, there appears to be nothing else in common human experience that is comparable to music in its repetitiveness (Kivy 1993; Ockelford 2005; Margulis 2013). Narrative arti- facts like movies, novels, cartoon strips, stories, and speeches have much less internal repetition. Even poetry is less repetitive than music. Occasionally, architecture can approach music in repeating some elements, but only some- times. There appears to be no visual analog to the sort of trance–inducing music that can engage listeners for hours. Although dance and meditation may be more repetitive than music, dance is rarely performed in the absence of music, and meditation tellingly relies on imagining a repeated sound or mantra (Huron 2006: 267). Repetition can be observed in music from all over the world (Nettl 2005). In much music, a simple “strophic” pattern is evident in which a single phrase or passage is repeated over and over. When sung, it is common for successive repetitions to employ different words, as in the case of strophic verses. However, it is also common to hear the same words used with each repetition. In the Western art–music tradition, internal patterns of repetition are commonly discussed under the rubric of form. Writing in The Oxford Companion to Music, Percy Scholes characterized musical form as “a series of strategies designed to find a successful mean between the opposite extremes of unrelieved repetition and unrelieved alteration” (1977: 289). Scholes’s characterization notwithstanding, musical form entails much more than simply the pattern of repetition.
    [Show full text]
  • Absolute and Relative Pitch Processing in the Human Brain: Neural and Behavioral Evidence
    bioRxiv preprint doi: https://doi.org/10.1101/526541; this version posted March 18, 2019. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY 4.0 International license. Absolute and relative pitch processing in the human brain: Neural and behavioral evidence Simon Leipold a, Christian Brauchli a, Marielle Greber a, Lutz Jäncke a, b, c Author Affiliations a Division Neuropsychology, Department of Psychology, University of Zurich, 8050 Zurich, Switzerland b University Research Priority Program (URPP), Dynamics of Healthy Aging, University of Zurich, 8050 Zurich, Switzerland c Department of Special Education, King Abdulaziz University, 21589 Jeddah, Kingdom of Saudi Arabia Corresponding Authors Simon Leipold Binzmühlestrasse 14, Box 25 CH-8050 Zürich Switzerland [email protected] Lutz Jäncke Binzmühlestrasse 14, Box 25 CH-8050 Zürich Switzerland [email protected] Keywords Absolute Pitch, Multivariate Pattern Analysis, Neural Efficiency, Pitch Processing, fMRI Acknowledgements This work was supported by the Swiss National Science Foundation (SNSF), grant no. 320030_163149 to LJ. We thank our research interns Anna Speckert, Chantal Oderbolz, Désirée Yamada, Fabian Demuth, Florence Bernays, Joëlle Albrecht, Kathrin Baur, Laura Keller, Marilena Wilding, Melek Haçan, Nicole Hedinger, Pascal Misala, Petra Meier, Sarah Appenzeller, Tenzin Dotschung, Valerie Hungerbühler, Vanessa Vallesi,
    [Show full text]
  • Cognitive Processes for Infering Tonic
    University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Student Research, Creative Activity, and Performance - School of Music Music, School of 8-2011 Cognitive Processes for Infering Tonic Steven J. Kaup University of Nebraska-Lincoln, [email protected] Follow this and additional works at: https://digitalcommons.unl.edu/musicstudent Part of the Cognition and Perception Commons, Music Practice Commons, Music Theory Commons, and the Other Music Commons Kaup, Steven J., "Cognitive Processes for Infering Tonic" (2011). Student Research, Creative Activity, and Performance - School of Music. 46. https://digitalcommons.unl.edu/musicstudent/46 This Article is brought to you for free and open access by the Music, School of at DigitalCommons@University of Nebraska - Lincoln. It has been accepted for inclusion in Student Research, Creative Activity, and Performance - School of Music by an authorized administrator of DigitalCommons@University of Nebraska - Lincoln. COGNITIVE PROCESSES FOR INFERRING TONIC by Steven J. Kaup A THESIS Presented to the Faculty of The Graduate College at the University of Nebraska In Partial Fulfillment of Requirements For the Degree of Master of Music Major: Music Under the Supervision of Professor Stanley V. Kleppinger Lincoln, Nebraska August, 2011 COGNITIVE PROCESSES FOR INFERRING TONIC Steven J. Kaup, M. M. University of Nebraska, 2011 Advisor: Stanley V. Kleppinger Research concerning cognitive processes for tonic inference is diverse involving approaches from several different perspectives. Outwardly, the ability to infer tonic seems fundamentally simple; yet it cannot be attributed to any single cognitive process, but is multi-faceted, engaging complex elements of the brain. This study will examine past research concerning tonic inference in light of current findings.
    [Show full text]
  • Psychoacoustics Perception of Normal and Impaired Hearing with Audiology Applications Editor-In-Chief for Audiology Brad A
    PSYCHOACOUSTICS Perception of Normal and Impaired Hearing with Audiology Applications Editor-in-Chief for Audiology Brad A. Stach, PhD PSYCHOACOUSTICS Perception of Normal and Impaired Hearing with Audiology Applications Jennifer J. Lentz, PhD 5521 Ruffin Road San Diego, CA 92123 e-mail: [email protected] Website: http://www.pluralpublishing.com Copyright © 2020 by Plural Publishing, Inc. Typeset in 11/13 Adobe Garamond by Flanagan’s Publishing Services, Inc. Printed in the United States of America by McNaughton & Gunn, Inc. All rights, including that of translation, reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, recording, or otherwise, including photocopying, recording, taping, Web distribution, or information storage and retrieval systems without the prior written consent of the publisher. For permission to use material from this text, contact us by Telephone: (866) 758-7251 Fax: (888) 758-7255 e-mail: [email protected] Every attempt has been made to contact the copyright holders for material originally printed in another source. If any have been inadvertently overlooked, the publishers will gladly make the necessary arrangements at the first opportunity. Library of Congress Cataloging-in-Publication Data Names: Lentz, Jennifer J., author. Title: Psychoacoustics : perception of normal and impaired hearing with audiology applications / Jennifer J. Lentz. Description: San Diego, CA : Plural Publishing,
    [Show full text]
  • Timbre in Musical and Vocal Sounds: the Link to Shared
    TIMBRE IN MUSICAL AND VOCAL SOUNDS: THE LINK TO SHARED EMOTION PROCESSING MECHANISMS A Dissertation by CASADY DIANE BOWMAN Submitted to the Office of Graduate and Professional Studies of Texas A&M University in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Chair of Committee, Takashi Yamauchi Committee Members, Jyotsna Vaid Jayson Beaster-Jones Thomas Ferris Head of Department, Douglass Woods December 2015 Major Subject: Psychology Copyright 2015 Casady Diane Bowman ABSTRACT Music and speech are used to express emotion, yet it is unclear how these domains are related. This dissertation addresses three problems in the current literature. First, speech and music have largely been studied separately. Second, studies in these domains are primarily correlational. Third, most studies utilize dimensional emotions where motivational salience has not been considered. A three-part regression study investigated the first problem, and examined whether acoustic components explained emotion in instrumental (Experiment 1a), baby (Experiment 1b), and artificial mechanical sounds (Experiment 1c). Participants rated whether stimuli sounded happy, sad, angry, fearful and disgusting. Eight acoustic components were extracted from the sounds and a regression analysis revealed that the components explained participants’ emotion ratings of instrumental and baby sounds well, but not artificial mechanical sounds. These results indicate that instrumental and baby sounds were perceived similarly compared to artificial mechanical sounds. To address the second and third problems, I examined the extent to which emotion processing for vocal and instrumental sounds crossed domains and whether similar mechanisms were used for emotion perception. In two sets of four-part experiments participants heard an angry or fearful sound four times, followed by a test sound from an anger-fear morphed continuum and judged whether the test sound was angry or fearful.
    [Show full text]
  • Absolute Pitch (AP)
    Absolute Pitch (AP) • A.k.a. ‘perfect pitch’ • The ability to name or produce a tone without a reference tone • Very rare: 1 in 10,000 Vs. Relative pitch (RP) • Most people use relative pitch: • Recognizing tones relative to other tones • Remember and produce intervals abstracted from specific pitch, or given a reference pitch AP: how it works • Thought to be a labeling process: – AP possessors associate names/ meaning with pitches or pitch classes – Retain this association over time • AP is not ‘perfect’; i.e., auditory perception/ pitch discrimination not more accurate than RP Imaging evidence • When making judgments using AP: • possessors compared to non- possessors show more activation in frontal naming/labeling areas • Anatomically, AP possessors show greater planum temporale asymmetry – Apparently due to reduced RH PT size AP ‘flavors’ • AP not purely ‘have’ or ‘have-not; ability level varies along continuum • Some possessors make more accurate judgments with certain instruments – e.g. piano vs. pure sine wave tones – Sometimes called ‘absolute piano’ AP ‘flavors’ cont’d • Other possessors may perform more accurately with white-key notes than black-key notes – E.g. C,D,E vs. C#, D# • May be due to early learning influence – Early musical training on keyboard usually starts with white-key notes only • So, is AP learned? Learnable? Nature vs. Nurture, of course • The debate continues: – Some researchers ascribe genetic origins to AP, suspecting that early musical training is neither sufficient nor necessary – Others find most possessors
    [Show full text]
  • Transposition, Hors-Série 2 | 2020, « Sound, Music and Violence » [Online], Online Since 15 March 2020, Connection on 13 May 2020
    Transposition Musique et Sciences Sociales Hors-série 2 | 2020 Sound, Music and Violence Son, musique et violence Luis Velasco-Pufleau (dir.) Electronic version URL: http://journals.openedition.org/transposition/3213 DOI: 10.4000/transposition.3213 ISSN: 2110-6134 Publisher CRAL - Centre de recherche sur les arts et le langage Electronic reference Luis Velasco-Pufleau (dir.), Transposition, Hors-série 2 | 2020, « Sound, Music and Violence » [Online], Online since 15 March 2020, connection on 13 May 2020. URL : http://journals.openedition.org/ transposition/3213 ; DOI : https://doi.org/10.4000/transposition.3213 This text was automatically generated on 13 May 2020. La revue Transposition est mise à disposition selon les termes de la Licence Creative Commons Attribution - Partage dans les Mêmes Conditions 4.0 International. 1 TABLE OF CONTENTS Introduction Introduction. Son, musique et violence Luis Velasco-Pufleau Introduction. Sound, Music and Violence Luis Velasco-Pufleau Articles Affordance to Kill: Sound Agency and Auditory Experiences of a Norwegian Terrorist and American Soldiers in Iraq and Afghanistan Victor A. Stoichita Songs of War: The Voice of Bertran de Born Sarah Kay Making Home, Making Sense: Aural Experiences of Warsaw and East Galician Jews in Subterranean Shelters during the Holocaust Nikita Hock Interview and Commentaries De la musique à la lutte armée, de 1968 à Action directe : entretien avec Jean-Marc Rouillan Luis Velasco-Pufleau From Music to Armed Struggle, from 1968 to Action Directe: An Interview with Jean-Marc
    [Show full text]
  • A Picture Is Worth a Thousand Songs: Exploring Visual Aspects of Music
    A Picture is Worth a Thousand Songs: Exploring Visual Aspects of Music Alexander Schindler Safety & Security Department AIT Austrian Institute of Technology GmbH Vienna, Austria [email protected] ABSTRACT The abstract nature of music makes it intrinsically hard to describe. To alleviate this problem we use well known songs or artists as a reference to describe new music. Music infor- mation research has mimicked this behavior by introducing Figure 1: Examples of music genres that are easy to identify in images - a) Dance, b) Rock, c) Heavy Metal, d) Rap search systems that rely on prototypical songs. Based on similarity models deducing from signal processing or collab- of music" became an important factor in people's apprecia- orative filtering an according list of songs with similar prop- tion of music and the rise of music videos in the early 80s erties is retrieved. Yet, music is often searched for a specific provided further momentum to this development. In that intention such as music for workout, to focus or for a com- period the structure of the prevalent music business changed fortable dinner with friends. Modeling music similarities completely by shifting the focus from selling whole records based on such criteria is in many cases problematic or vi- to hit singles [2]. Their accentuation and the new accompa- sionary. Despite these open research challenges a more user nied intensification of celebrity around pop music played an focused question should be raised: Which interface is ade- important role in the development of the pinup culture. This quate for describing such intentions? Traditionally queries emphasis on visual aspects of music transcended from top- are either based on text input or seed songs.
    [Show full text]
  • Web-Based Psychoacoustics: Hearing Screening, Infrastructure, And
    bioRxiv preprint doi: https://doi.org/10.1101/2021.05.10.443520; this version posted May 11, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC-ND 4.0 International license. Web-based Psychoacoustics: Hearing Screening, Infrastructure, and Validation Brittany A. Moka, Vibha Viswanathanb, Agudemu Borjiginb, Ravinderjit Singhb, Homeira Kafib, and ∗Hari M. Bharadwaja,b aDepartment of Speech, Language, and Hearing Sciences, Purdue University, West Lafayette, IN, United States bWeldon School of Biomedical Engineering, Purdue University, West Lafayette, IN, United States Abstract Anonymous web-based experiments are increasingly and successfully used in many domains of behavioral research. However, online studies of auditory perception, especially of psychoacoustic phe- nomena pertaining to low-level sensory processing, are challenging because of limited available control of the acoustics, and the unknown hearing status of participants. Here, we outline our approach to mitigate these challenges and validate our procedures by comparing web-based measurements to lab- based data on a range of classic psychoacoustic tasks. Individual tasks were created using jsPsych, an open-source javascript front-end library. Dynamic sequences of psychoacoustic tasks were imple- mented using Django, an open-source library for web applications, and combined with consent pages, questionnaires, and debriefing pages. Subjects were recruited via Prolific, a web-based human-subject marketplace. Guided by a meta-analysis of normative data, we developed and validated a screening pro- cedure to select participants for (putative) normal-hearing status; this procedure combined thresholding of scores in a suprathreshold cocktail-party task with filtering based on survey responses.
    [Show full text]
  • Alternate Tuning Guide
    1 Alternate Tuning Guide by Bill Sethares New tunings inspire new musical thoughts. Belew is talented... But playing in alternate Alternate tunings let you play voicings and slide tunings is impossible on stage, retuning is a between chord forms that would normally be nightmare... strings break, wiggle and bend out impossible. They give access to nonstandard of tune, necks warp. And the alternative - carry- open strings. Playing familiar fingerings on an ing around five special guitars for five special unfamiliar fretboard is exciting - you never know tuning tunes - is a hassle. Back to EBGDAE. exactly what to expect. And working out familiar But all these "practical" reasons pale com- riffs on an unfamiliar fretboard often suggests pared to psychological inertia. "I've spent years new sound patterns and variations. This book mastering one tuning, why should I try others?" helps you explore alternative ways of making Because there are musical worlds waiting to be music. exploited. Once you have retuned and explored a Why is the standard guitar tuning standard? single alternate tuning, you'll be hooked by the Where did this strange combination of a major unexpected fingerings, the easy drone strings, 3rd and four perfect 4ths come from? There is a the "new" open chords. New tunings are a way to bit of history (view the guitar as a descendant of recapture the wonder you experienced when first the lute), a bit of technology (strings which are finding your way around the fretboard - but now too high and thin tend to break, those which are you can become proficient in a matter of days too low tend to be too soft), and a bit of chance.
    [Show full text]
  • Memory and Production of Standard Frequencies in College-Level Musicians Sarah E
    University of Massachusetts Amherst ScholarWorks@UMass Amherst Masters Theses 1911 - February 2014 2013 Memory and Production of Standard Frequencies in College-Level Musicians Sarah E. Weber University of Massachusetts Amherst Follow this and additional works at: https://scholarworks.umass.edu/theses Part of the Cognition and Perception Commons, Fine Arts Commons, Music Education Commons, and the Music Theory Commons Weber, Sarah E., "Memory and Production of Standard Frequencies in College-Level Musicians" (2013). Masters Theses 1911 - February 2014. 1162. Retrieved from https://scholarworks.umass.edu/theses/1162 This thesis is brought to you for free and open access by ScholarWorks@UMass Amherst. It has been accepted for inclusion in Masters Theses 1911 - February 2014 by an authorized administrator of ScholarWorks@UMass Amherst. For more information, please contact [email protected]. Memory and Production of Standard Frequencies in College-Level Musicians A Thesis Presented by SARAH WEBER Submitted to the Graduate School of the University of Massachusetts Amherst in partial fulfillment of the requirements for the degree of MASTER OF MUSIC September 2013 Music Theory © Copyright by Sarah E. Weber 2013 All Rights Reserved Memory and Production of Standard Frequencies in College-Level Musicians A Thesis Presented by SARAH WEBER _____________________________ Gary S. Karpinski, Chair _____________________________ Andrew Cohen, Member _____________________________ Brent Auerbach, Member _____________________________ Jeff Cox, Department Head Department of Music and Dance DEDICATION For my parents and Grandma. ACKNOWLEDGEMENTS I would like to thank Kristen Wallentinsen for her help with experimental logistics, Renée Morgan for giving me her speakers, and Nathaniel Liberty for his unwavering support, problem-solving skills, and voice-over help.
    [Show full text]
  • ISSN -2347-856X ISSN -2348-0653 International Journal of Business and Administrati
    Research Paper IJBARR Impact Factor: 3.072 E- ISSN -2347-856X ISSN -2348-0653 MUSIC IS AN ART AND SCIENCE Prof. P.Thenmozhi Associate Professor and Head, Department of Home Science, Seethalakshmi Ramaswami College, Tiruchirappalli,,India. Music is an art form whose medium is sound and silence. Its common elements are pitch (science which governs melody and harmony), rhythm (and its associated concepts tempo, meter, and articulation), dynamics, and the sonic qualities of timbre and texture. The word derives from Greek μουσική (mousike; "art of the Muses").The creation, performance, significance, and even the definition of music vary according to culture and social context. Music ranges from strictly organized compositions (and their recreation in performance), through improvisational music to aleatoric forms. Within the arts, music may be classified as a performing art, a fine art, and auditory art. It may also be divided among art music and folk music. There is also a strong connection between music and mathematics (Talas-counts). Music may be played and heard live, may be part of a dramatic work or film, or may be recorded. Music is a miniature of the harmony of the whole universe, for the harmony of the universe is life itself, and humans, being a miniature of the universe, show harmonious and inharmonious chords in their pulsations, in the beat of their hearts, in their vibration, rhythm and tone. Their health or illness, their joy or discomfort, all show the music or lack of music in their life.Tanjore is to Carnatic Music where Germany is to Western Music. Music is the language of our soul and the soul is the residence of our spirituality.
    [Show full text]