Diversity in Pitch Perception Revealed by Task Dependence

Total Page:16

File Type:pdf, Size:1020Kb

Diversity in Pitch Perception Revealed by Task Dependence ARTICLES https://doi.org/10.1038/s41562-017-0261-8 Diversity in pitch perception revealed by task dependence Malinda J. McPherson! !1,2* and Josh H. McDermott! !1,2 Pitch conveys critical information in speech, music and other natural sounds, and is conventionally defined as the perceptual correlate of a sound’s fundamental frequency (F0). Although pitch is widely assumed to be subserved by a single F0 esti- mation process, real-world pitch tasks vary enormously, raising the possibility of underlying mechanistic diversity. To probe pitch mechanisms, we conducted a battery of pitch-related music and speech tasks using conventional harmonic sounds and inharmonic sounds whose frequencies lack a common F0. Some pitch-related abilities—those relying on musical interval or voice recognition—were strongly impaired by inharmonicity, suggesting a reliance on F0. However, other tasks, including those dependent on pitch contours in speech and music, were unaffected by inharmonicity, suggesting a mechanism that tracks the frequency spectrum rather than the F0. The results suggest that pitch perception is mediated by several different mechanisms, only some of which conform to traditional notions of pitch. itch is one of the most common terms used to describe sound. could involve first estimating the F0 of different parts of a sound Although in lay terms pitch denotes any respect in which and then registering how the F0 changes over time. However, pitch sounds vary from high to low, in scientific parlance pitch is changes could also be registered by measuring a shift in the con- P 24–27 the perceptual correlate of the rate of repetition of a periodic sound stituent frequencies of a sound, without first extracting F0 . It (Fig. 1a). This repetition rate is known as the sound’s fundamental thus seemed plausible that pitch perception in different stimulus frequency, or F0, and conveys information about the meaning and and task contexts might involve different computations. identity of sound sources. In music, F0 is varied to produce melo- We probed pitch computations using inharmonic stimuli, ran- dies and harmonies. In speech, F0 variation conveys emphasis and domly jittering each frequency component of a harmonic sound intent, as well as lexical content in tonal languages. Other everyday to make the stimulus aperiodic and inconsistent with any single sounds (birdsong, sirens, ringtones and so on) are also identified F0 (Fig. 1b)30. Rendering sounds inharmonic should disrupt in part by their F0. Pitch is thus believed to be a key intermediate F0-specific mechanisms and impair performance on pitch-related perceptual feature and has been a topic of intense interest through- tasks that depend on such mechanisms. A handful of previous out history1–3. studies have manipulated harmonicity for this purpose and found The goal of pitch research has historically been to characterize modest effects on pitch discrimination that varied somewhat the mechanism for estimating F0 from sound4,5. Periodic sounds across listeners and studies25–27. As we revisited this line of inquiry, contain frequencies that are harmonically related, being multiples it became clear that effects of inharmonicity differed substantially of the F0 (Fig. 1a). The role of peripheral frequency cues, such as across pitch tasks, suggesting that pitch perception might parti- the place and timing of excitation in the cochlea, have thus been a tion into multiple mechanisms. The potential diversity of pitch focal point of pitch research6–10. The mechanisms for deriving F0 mechanisms seemed important both for the basic understanding from these peripheral representations are also the subject of a rich of the architecture of the auditory system and for understanding research tradition6–14. Neurophysiological studies in non-human the origins of pitch deficits in listeners with hearing impairment or animals have revealed F0-tuned neurons in the auditory cortex of cochlear implants. one species (the marmoset)15,16, although as of yet there are no com- We thus examined the effect of inharmonicity on essentially parable findings in other species17,18. Functional imaging studies in every pitch-related task we could conceive and implement. These humans suggest pitch-responsive regions in non-primary auditory ranged from classic psychoacoustic assessments with pairs of notes cortex19–21. The role of these regions in pitch perception is an active to ethologically relevant melody and voice recognition tasks. Our area of research22,23. Despite considerable efforts to characterize the results show that some pitch-related abilities—those relying on mechanisms for F0 estimation, there has been relatively little con- musical interval or voice perception—are strongly impaired by sideration of whether behaviours involving pitch might necessitate inharmonicity, suggesting a reliance on F0 estimation. However, other sorts of computations24–27. tasks relying on the direction of pitch change, including those using One reason to question the underlying basis of pitch percep- pitch contours in speech and music, were unaffected by inhar- tion is that our percepts of pitch support a wide variety of tasks. In monicity. Such inharmonic sounds individually lack a well-defined some cases it seems likely that the F0 of a sound must be encoded, pitch in the normal sense, but when played sequentially nonetheless as when recognizing sounds with a characteristic F0, such as a per- elicit the sensation of pitch change. The results suggest that what son’s voice28, but in many situations we instead judge the way that has traditionally been couched as ‘pitch perception’ is subserved by F0 changes over time—often referred to as relative pitch—as when several distinct mechanisms, only some of which conform to the recognizing a melody or speech intonation pattern29. Relative pitch traditional F0-related notion of pitch. 1Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA. 2Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA, USA. *e-mail: [email protected] NATURE HUMAN BEHAVIOUR | www.nature.com/nathumbehav © 2017 Macmillan Publishers Limited, part of Springer Nature. All rights reserved. ARTICLES NATURE HUMAN BEHAVIOUR a Waveform Power spectrum Autocorrelation 1.0 1.0 –10 0.8 0.8 –20 0.6 0.6 –30 ) 0.4 0.4 r ( 0.2 0.2 –40 0 0 –0.2 –50 –0.2 Power (dB) –0.4 –60 Correlation –0.4 –0.6 –0.6 –70 –0.8 –0.8 Sound pressure (arbitrary units) –1.0 –80 –1.0 21 23 25 27 29 31 0 500 1,000 1,500 2,000 2,500 3,000 012345678 Time (ms) Frequency (Hz) Lag (ms) b Waveform Power spectrum Autocorrelation 1.0 –10 1.0 0.8 0.8 –20 0.6 0.6 –30 ) 0.4 0.4 r ( 0.2 –40 0.2 0 0 –0.2 –50 –0.2 Power (dB) –0.4 –60 Correlation –0.4 –0.6 –0.6 –70 –0.8 –0.8 Sound pressure (arbitrary units) –1.0 –80 –1.0 21 23 25 27 29 31 0 500 1,000 1,500 2,000 2,500 3,000 012345678 Time (ms) Frequency (Hz) Lag (ms) Fig. 1 | Example harmonic and inharmonic tones. a, Waveform, power spectrum and autocorrelation for a harmonic complex tone with a F0 of 250!Hz. The waveform is periodic (repeating in time), with a period corresponding to one cycle of the F0. The power spectrum contains discrete frequency components (harmonics) that are integer multiples of the F0. The harmonic tone yields an autocorrelation of 1 at a time lag corresponding to its period (1/F0). b, Waveform, power spectrum and autocorrelation for an inharmonic tone generated by randomly ‘jittering’ the harmonics of the tone in a. The waveform is aperiodic and the constituent frequency components are not integer multiples of a common F0 (evident in the irregular spacing in the frequency domain). Such inharmonic tones are thus inconsistent with any single F0. The inharmonic tone exhibits no clear peak in its autocorrelation, indicative of its aperiodicity. Results by detecting shifts in the spectrum without estimating F0, perfor- Experiment 1: Pitch discrimination with pairs of synthetic tones. mance should be impaired for Inharmonic-changing but similar for We began by measuring pitch discrimination using a two-tone dis- Harmonic and Inharmonic conditions. Finally, if the jitter manipu- crimination task standardly used to assess pitch perception31–33. lation was insufficient to disrupt F0 estimation, performance should Participants heard two tones and were asked whether the second be similar for all three conditions. tone was higher or lower than the first (Fig. 2a). We compared per- To isolate the effects of harmonic structure, a fixed bandpass fil- formance for three conditions: a condition where the tones were ter was applied to each tone (Fig. 2c). This filter was intended to harmonic, and two inharmonic conditions (Fig. 2b). Here and else- approximately equate the spectral centroids (centres of mass) of where, stimuli were made inharmonic by adding a random amount the tones, which might otherwise be used to perform the task, and of ‘jitter’ to the frequency of each partial of a harmonic tone (up to to prevent listeners from tracking the frequency component at the 50% of the original F0 in either direction) (Fig. 1b). This manipula- F0 (by filtering it out). This type of tone also mimics the acous- tion was designed to severely disrupt the ability to recover the F0 tics of many musical instruments, in which a source that varies in of the stimuli. One measure of the integrity of the F0 is available in F0 is passed through a fixed filter (for example, the resonant body the autocorrelation peak height, which was greatly reduced in the of the instrument). Here, and in most other experiments, low-pass inharmonic stimuli (Fig. 1 and Supplementary Fig.
Recommended publications
  • Virtual Pitch and Pitch Shifts in Church Bells
    Open Journal of Acoustics, 2017, 7, 52-68 http://www.scirp.org/journal/oja ISSN Online: 2162-5794 ISSN Print: 2162-5786 Virtual Pitch and Pitch Shifts in Church Bells William A. Hibbert, Shahram Taherzadeh, David B. Sharp School of Engineering and Innovation, Open University, Milton Keynes, UK How to cite this paper: Hibbert, W.A., Abstract Taherzadeh, S. and Sharp, D.B. (2017) Virtual Pitch and Pitch Shifts in Church It is well established that musical sounds comprising multiple partials with Bells. Open Journal of Acoustics, 7, 52-68. frequencies approximately in the ratio of small integers give rise to a strong https://doi.org/10.4236/oja.2017.73006 sensation of pitch even if the lowest or fundamental partial is missing—the so-called virtual pitch effect. Experiments on thirty test subjects demonstrate Received: August 3, 2017 Accepted: September 5, 2017 that this virtual pitch is shifted significantly by changes in the spacing of the Published: September 8, 2017 constituent partials. The experiments measured pitch by comparison of sounds of similar timbre and were automated so that they could be performed Copyright © 2017 by authors and remotely across the Internet. Analysis of the test sounds used shows that the Scientific Research Publishing Inc. This work is licensed under the Creative pitch shifts are not predicted by Terhardt’s classic model of virtual pitch. The Commons Attribution International test sounds used were modelled on the sounds of church bells, but a further License (CC BY 4.0). experiment on seventeen test subjects showed that changes in partial ampli- http://creativecommons.org/licenses/by/4.0/ tude only had a minor effect on the pitch shifts observed, and that a pitch shift Open Access was still observed when two of the lowest frequency partials were removed, so that the effects reported are of general interest.
    [Show full text]
  • The Cuba Chronicles
    cuba https://www.racewalking.org/cuba.htm The Cuba Chronicles A Travel Log from an Altitude Training Camp in the Wilds of New Mexico ©1998 Dave McGovern--Dave's World Class These reports were originally sent to the [email protected] mailing list, hence the odd format. Wigglers; First off, It's been called to my attention that I've made no effort to tell the world I'm going to be conducting one of my World Class clinics in conjunction with the National 10km in Niagara Falls in July. Details on my web site at surf.to/worldclass. Secondly, what's been going on in my life... Several months ago when Mike Rohl called and asked if I'd like to join him for a high-altitude training camp outside Albuquerque, the "What the Hell, Why Not?" side of my brain pistol-whipped the rational side and I agreed to the deal": 5 weeks living in a free cabin at 8,500' outside of Cuba, NM with thrice weekly trips into Albuquerque to get in our quality speed work at a more reasonable elevation. When Mike called from Albuquerque a few weeks before my arrival with the news that the cabin was stilled snowed in and he was staying with his saint of a wife Michelle and their three kids at Judy Climer's house "for a while" it still didn't register that this was doomed to be another "we'll laugh about this in 20 years" Rohl/McGovern racewalking fiasco... Mike and family finally gave up on the original cabin last week and rented a somewhat smaller, lime green two bed/1bath box plunked down in the middle of a muddy cow flop and gopher hole ridden field somewhere in the Jemez Mountains above the non-town of Cuba, NM.
    [Show full text]
  • (Autumn 2004) Pitch Perception: Place Theory, Temporal Theory, and Beyond
    EE 391 Special Report (Autumn 2004) Pitch Perception: Place Theory, Temporal Theory, and Beyond Advisor: Professor Julius Smith Kyogu Lee Center for Computer Research in Music and Acoustics (CCRMA) Music Department, Stanford University [email protected] Abstract to explain are easily explained by a temporal theory, and vice versa. Hence it would be fairer to call them complementary than competing, which may be proved by later hybrid models. Two competing theories on pitch perception are reviewed with brief history and several significant works that contributed to building such theories. Fundamental concepts behind these 2 Place Theory two theories - place theory and temporal theory - are briefly described, and the further steps their successors took are pre- The place theory has a long history which may hark back sented, followed by possible future directions. to the days of Helmholtz (von Helmholtz 1954) although most ideas can be traced back far beyond him.(de Cheveigne´ 2004). According to his resonance-place theory of hearing, the inner 1 Introduction ear acts like a frequency analyzer, and the stimulus reach- ing our ear is decomposed into many sinusoidal components, Pitch is one of the most important attributes of audio sig- each of which excites different places along the basilar mem- nals such as speech and music. In speech, pitch can greatly brane, where hair cells with distinct characteristic frequencies improve speech intelligibility and thus can be very useful are linked with neurones. He also suggested that the pitch of in speech recognition systems. Sound source separation is a stimulus is related to the pattern of the excitation produced another application where pitch information is critical espe- by the stimulus along the basilar membrane.
    [Show full text]
  • Application of Virtual Pitch Theory in Music Analysis
    Application of virtual pitch theory in music analysis Llorenç Balsach Abstract In the course of this article a model of harmonic analysis is worked out based on certain properties of the auditory system, which I think will shed new light on the study of cadences and local harmonic resolutions. This model consists basically of extracting the two main fundamentals (roots) which are to be found in 93.3% of chords of less than 6 notes. To do this I apply the basic concepts of virtual pitch but taking into account only those harmonics which are in a prime position in the first seven, which in our thesis include the rest of the harmonics as far as the human auditory is concerned. With this model we found new information about the "internal" harmonic tension which is created by every single note and the tendencies of chords towards resolutions. I compare and discuss other models which apply the theory of virtual pitch in harmonic analysis. Introduction E. Terhardt's concept of "virtual pitch" is used in psycho-acoustics as a method of extracting pitch(es) from (harmonic) complex tone signals (see Terhardt, Stoll & Seewann (1982b, 1982c), Meddis & Hewitt (1991), van Immerseel & Martens (1992), Leman (1995)). The concept could be briefly described as the pitch which the auditory system perceives from a sound or group of sounds. There have been some attempts to bring the acoustic concept of virtual pitch into musical theory. Terhardt himself (1982a) applied his theory to extract the root(s) of a chord. R. Parncutt (1988) saw that the results obtained from Terhardt's model did not fit in sufficiently with conventional musical theory; he worked out a revised version of the model, producing significantly different results from Terhardt's original.
    [Show full text]
  • A Biological Rationale for Musical Consonance Daniel L
    PERSPECTIVE PERSPECTIVE A biological rationale for musical consonance Daniel L. Bowlinga,1 and Dale Purvesb,1 aDepartment of Cognitive Biology, University of Vienna, 1090 Vienna, Austria; and bDuke Institute for Brain Sciences, Duke University, Durham, NC 27708 Edited by Solomon H. Snyder, Johns Hopkins University School of Medicine, Baltimore, MD, and approved June 25, 2015 (received for review March 25, 2015) The basis of musical consonance has been debated for centuries without resolution. Three interpretations have been considered: (i) that consonance derives from the mathematical simplicity of small integer ratios; (ii) that consonance derives from the physical absence of interference between harmonic spectra; and (iii) that consonance derives from the advantages of recognizing biological vocalization and human vocalization in particular. Whereas the mathematical and physical explanations are at odds with the evidence that has now accumu- lated, biology provides a plausible explanation for this central issue in music and audition. consonance | biology | music | audition | vocalization Why we humans hear some tone combina- perfect fifth (3:2), and the perfect fourth revolution in the 17th century, which in- tions as relatively attractive (consonance) (4:3), ratios that all had spiritual and cos- troduced a physical understanding of musi- and others as less attractive (dissonance) has mological significance in Pythagorean phi- cal tones. The science of sound attracted been debated for over 2,000 years (1–4). losophy (9, 10). many scholars of that era, including Vincenzo These perceptual differences form the basis The mathematical range of Pythagorean and Galileo Galilei, Renee Descartes, and of melody when tones are played sequen- consonance was extended in the Renaissance later Daniel Bernoulli and Leonard Euler.
    [Show full text]
  • Factors Affecting Pitch Judgments As a Function of Spectral Composition
    Perception & Psychophysics 1987, 42 (6), 511-514 Factors affecting pitch judgments as a function of spectral composition E.TERHARDTandA.GRUBERT Institute for Electroacoustics, Technical University Munchen, Munich, West Germany Stimulated by a recent paper by Platt and Racine (1985), we discuss the factors that probably are involved in certain inconsistencies observed in pitch judgments of tones with different spec­ tral composition. Typically, discrepancies reported in the literature are of the order of 10 cents in magnitude. We point out that measurement of such small pitch effects is heavily dependent on systematic individual differences, and that, when individual differences are averaged out (as is essentially the case in Platt and Racine's experiments), verification ofthe actual auditory stimu­ lus sound pressure level (SPL) within a few decibels is necessary. Utilizing the virtual-pitch the­ ory, we evaluate the effects of frequency, SPL, and earphone-frequency response. Furthermore, we present experimental and theoretical data on pitch of piano tones relevant to the problem. The study elucidates that, taking into account the factors mentioned, agreement between the various data considered, as well as theoretical understanding, actually is much better than would be apparent at first sight. .Recently, Platt and Racine (1985) provided further ex­ spectral components. To evaluate pitch deviations of com­ perimental data on small, but systematic, differences in plex tones of the type reported by Platt and Racine, it is the judgment of the pitch of tones having different spec­ thus appropriate to begin by considering the following in­ tral composition (see the literature listed by Platt and Ra­ fluences on the pitch of individual pure tones.
    [Show full text]
  • Binaural Localization of Musical Pitch Using Interaural Time Differences in Congenital Amusia
    RESEARCH ARTICLE Binaural localization of musical pitch using interaural time differences in congenital amusia I-Hui HsiehID*, Ssc-Chen Chen, Jia-Wei Liu Institute of Cognitive Neuroscience, National Central University, Jhongli County, Taoyuan City, Taiwan * [email protected] a1111111111 a1111111111 a1111111111 Abstract a1111111111 a1111111111 Naturally occurring sounds are routinely periodic. The ability to phase-lock to such periodicity facilitates pitch perception and interaural time differences (ITDs) determination in binaural localization. We examined whether deficient pitch processing in individuals with congenital amusia (tone deafness) is accompanied by impaired ability to lateralize musical pitch at audi- OPEN ACCESS tory periphery and memorize the location of pitch at the working memory level. If common Citation: Hsieh I-H, Chen S-C, Liu J-W (2018) mechanisms subserve processing of temporal-fine-structure based pitch and ITDs, then defi- Binaural localization of musical pitch using cient processing of one feature should impair performance on the other. Thus, we measured interaural time differences in congenital amusia. ITD discrimination thresholds using an adaptive-tracking procedure for lateralizing musical PLoS ONE 13(9): e0204397. https://doi.org/ 10.1371/journal.pone.0204397 tone pairs separated by different semitone intervals. Amusic individuals exhibited normal ITD thresholds comparable to those of matched controls, which were not affected by concurrent Editor: Ifat Yasin, University College London, UNITED KINGDOM pitch
    [Show full text]
  • Music and the Brain
    Music and the Brain Psyche Loui Department of Music, Center for Brain and Cognitive Health Northeastern University 360 Huntington Ave, Boston, MA 02115 [email protected] Alexander Belden Department of Biology, Center for Brain and Cognitive Health Northeastern University 360 Huntington Ave, Boston, MA 02115 [email protected] Teaser: Activity and connectivity throughout the human brain enable the complex experience of music Running Title: Music and the Brain Key Words: cognitive, neuroscience, neuropsychology, psychology, pitch, rhythm, harmony, melody, timbre, absolute pitch, amusia, tone deafness Technical Committee(s): Psychological and Physiological Acoustics; Music In recent years, the cognitive neuroscience of music has captured increasing interest from scientists, scholars, and the public alike. Part of this interest comes from methodological advancements to examine the living human brain. Another source of interest comes from increased awareness of the value of interdisciplinary research. Researchers come from diverse backgrounds, ranging from neurobiology to music education. This brings about a diversity of ideas. Finally, interest comes from the possibility that findings may translate towards better tools for music therapy, something that is being applied to an increasing variety of neurological and psychiatric disorders. Even for the healthy brain, there is a push towards using music to improve mood and cognition both in adulthood and in development. This article reviews recent advances in the cognitive neuroscience of music, with special attention to the cognitive neuroscience of pitch, rhythm, harmony, and melody. We begin with a brief introduction of the tools in use to examine musical functions in the brain with both spatial and temporal accuracy and precision.
    [Show full text]
  • TOWN of RYE – PLANNING BOARD MEETING Tuesday, December 8, 2020 6:00 P.M
    DRAFT MINUTES of the PB Meeting 12-02-20 TOWN OF RYE – PLANNING BOARD MEETING Tuesday, December 8, 2020 6:00 p.m. – via ZOOM Members Present: Chair Patricia Losik, Vice-Chair JM Lord, Steve Carter, Katy Sherman, Jim Finn, Nicole Paul, Selectmen’s Rep Bill Epperson, and Alternates Jeffrey Quinn and Bill MacLeod Others Present for the Town: Planning/Zoning Administrator Kim Reed and Attorney Michael Donovan (joined meeting at 6:30 p.m.) Call to Order Chair Losik called the meeting to order via Zoom teleconferencing at 6:00 p.m. Statement by Patricia Losik: As chair of the Rye Planning Board, I find that due to the State of Emergency declared by the Governor as a result of the COVID-19 pandemic and in accordance with the Governor’s Emergency Order #12 pursuant to Executive Order 2020-04, this public body is authorized to meet electronically. Please note that there is no physical location to observe and listen contemporaneously to this meeting, which was authorized pursuant to the Governor’s Emergency Order. However, in accordance with the Emergency Order, I am confirming that we are providing public access to the meeting by telephone, with additional access possibilities by video and other electronic means. We are utilizing Zoom for this electronic meeting. All members of the board have the ability to communicate contemporaneously during this meeting through this platform, and the public has access to contemporaneously listen and, if necessary, participate in this meeting by clicking on the following website address: www.zoom.com ID #835-9967-0907 Password: 123456 Public notice has been provided to the public for the necessary information for accessing the meeting, including how to access the meeting using Zoom telephonically.
    [Show full text]
  • Tonality of Low-Frequency Synthesized Piano Tones
    Tonality of Low-Frequency Synthesized Piano Tones Lola L. Cuddy Queen’s University Frank A. Russo Ryerson University Alexander Galembo Russian Academy of Sciences digital.library.ryerson.ca/object/153 Please Cite: Cuddy, L. L., Russo, F. A., & Galembo, A. (2014). Tonality of low-frequency synthesized piano tones. Archives of Acoustics, 32(3), 541-550. library.ryerson.ca ARCHIVES OF ACOUSTICS 32, 3, 541–550 (2007) TONALITY OF LOW-FREQUENCY SYNTHESIZED PIANO TONES Lola L. CUDDY(1), Frank A. RUSSO(2), Alexander GALEMBO(3) (1)Queen’s University Department of Psychology, Kingston, Canada e-mail: [email protected] (2)Ryerson University Department of Psychology, Toronto, Canada e-mail: [email protected] (3)Russian Academy of Sciences Setchenov Institute of Evolutionary Physiology and Biochemistry, St. Petersburg, Russia (received May 15, 2007; accepted June 6, 2007) The influences of inharmonicity and bandwidth on sensitivity to tonality in the low- frequency range (A0 to G#1) were tested in a listening experiment. Participants were presented a key-defining context (do-mi-do-so) and were asked to rate the goodness of fit of probe tones to the context. Probe tones were the 12 tones of the chromatic scale beginning on do. The set of 12 ratings, called the probe-tone profile, was compared to an established standardized pro- file for the Western tonal hierarchy. Prior research employing this method with real (sampled) piano tones has suggested that sensitivity to tonality is influenced by inharmonicity, partic- ularly in the lowest octaves of the piano where inharmonicity levels are substantially above the detection threshold.
    [Show full text]
  • Simultaneous Consonance in Music Perception and Composition
    Running head: SIMULTANEOUS CONSONANCE 1 Simultaneous Consonance in Music Perception and Composition Peter M. C. Harrison1 & Marcus T. Pearce1,2 1 Cognitive Science Research Group, Queen Mary University of London 2 Center for Music in the Brain, Aarhus University Author Note This article has been peer-reviewed and accepted for publication in Psychological Review. © 2019, American Psychological Association. This paper is not the copy of record and may not exactly replicate the final, authoritative version of the article. Please donot copy or cite without authors’ permission. The final article will be available, upon publication, via its DOI: https://doi.org/10.1037/rev0000169. Correspondence concerning this article should be addressed to Peter M. C. Harrison, School of Electronic Engineering and Computer Science, Queen Mary University of London, E1 4NS. E-mail: [email protected] SIMULTANEOUS CONSONANCE 2 Abstract Simultaneous consonance is a salient perceptual phenomenon corresponding to the perceived pleasantness of simultaneously sounding musical tones. Various competing theories of consonance have been proposed over the centuries, but recently a consensus has developed that simultaneous consonance is primarily driven by harmonicity perception. Here we question this view, substantiating our argument by critically reviewing historic consonance research from a broad variety of disciplines, re-analyzing consonance perception data from four previous behavioral studies representing more than 500 participants, and modeling three Western musical corpora representing more than 100,000 compositions. We conclude that simultaneous consonance is a composite phenomenon that derives in large part from three phenomena: interference, periodicity/harmonicity, and cultural familiarity. We formalize this conclusion with a computational model that predicts a musical chord’s simultaneous consonance from these three features, and release this model in an open-source R package, incon, alongside 15 other computational models also evaluated in this paper.
    [Show full text]
  • The Influence of Spectral Composition of Complex Tones and of Musical Experience on the Perceptibility of Virtual Pitch
    Perception & Psychophysics /993. 54 (5), 589-003 The influence of spectral composition of complex tones and of musical experience on the perceptibility of virtual pitch ANNEMARIE PREISLER Karl-Franzens-Unioersity, Graz, Austria A matching paradigm was used to evaluate the influence of the spectral characteristics num­ ber, relative height, and density of harmonics on the perceptibility of the missing fundamental. Fifty-eight musicians and 58 nonmusicians were instructed to adjust mistuned sinusoids to the subjectively perceived fundamental pitches of corresponding overtone spectra. Analyses of vari­ ance were used to compare the average of absolute and relative deviations of the tunings from the highest common divisors of the complex tones. The results indicate that musical experience is the most influential single factor determining the assessment offundamental pitch. Neverthe­ less, all spectral parameters significantly affect tuning performance. Systematic relative devia­ tions (stretching/compression effects) were observed for all considered variables. An increase of the optimum subjective distance between an overtone spectrum and its corresponding fundamental was characteristic of musicians and unambiguous spectra, whereas the compression effect was typical of nonmusicians and complex tones containing spectral gaps. Since Seebeck (1843) discovered that humans are able ically, a pitch evoked by the periodicity of the envelope to perceive the pitch of a complex tone even though the of the rest of the unresolved partials should correspond tone does not contain any spectral component correspond­ to that of the missing fundamental. This model, based on ing to that pitch, the perception of the missingfundamen­ the restricted filter characteristics of the inner ear, was tal has been the subject ofvarious experimental and the­ shown to be insufficient by the discovery ofthe principle oretical approaches.
    [Show full text]