Inharmonic Speech: a Tool for the Study of Speech Perception and Separation∗

Total Page:16

File Type:pdf, Size:1020Kb

Inharmonic Speech: a Tool for the Study of Speech Perception and Separation∗ Inharmonic Speech: A Tool for the Study of Speech Perception and Separation∗ Josh H. McDermott Daniel P. W. Ellis Hideki Kawahara Center for Neural Science Dept. Elec. Eng. Faculty of Systems Engineering New York University, USA Columbia University, USA Wakayama University, Japan [email protected] [email protected] [email protected] Abstract vidual sources – to separate the sound energy produced by a target source from that produced by other sources Sounds created by a periodic process have a Fourier rep- [2]. resentation with harmonic structure – i.e., components at multiples of a fundamental frequency. Such harmonic Human sound segregation relies in part on acoustic frequency relations are a prominent feature of speech and grouping cues – sound properties that are characteristic many other natural sounds. Harmonicity is closely re- of individual natural sound sources such as speech [3, 4], lated to the perception of pitch and is believed to provide and that can be used to infer groupings of sound energy an important acoustic grouping cue underlying sound from a mixture of sources. Harmonic frequency relations segregation. Here we introduce a method to manipulate are believed to be among the most powerful of such cues. the harmonicity of otherwise natural-sounding speech to- Harmonicity is the frequency-domain analogue of the pe- kens, providing the stimuli needed to study the role of riodicity that characterizes many natural sounds, includ- harmonicity in speech perception. Our algorithm utilizes ing voiced speech. Periodicity produces frequency com- elements of the STRAIGHT framework for speech ma- ponents that are multiples of the fundamental frequency nipulation and synthesis, in which a recorded speech ut- (f0), a relationship known as harmonicity. Frequency terance is decomposed into voiced and unvoiced vocal components that are harmonically related are generally excitation and vocal tract filtering. Unlike the conven- heard as a single sound with a common pitch, and mistun- tional STRAIGHT method, we model voiced excitation ing a single component of a harmonic series by as little as a combination of time-varying sinusoids, the frequen- as 1% causes it to be heard as a distinct sound [5]. More- cies of which can then be individually modified. By shift- over, two concurrent tones with different f0s are typically ing, stretching, or jittering the harmonic frequencies, we heard as two distinct sources [6]. introduce inharmonic excitation without changing other Machine systems that attempt to replicate human seg- aspects of the speech signal. The resulting signal remains regation abilities also make use of harmonicity. Com- highly intelligible, and can be used to assess the role of putational auditory scene analysis (CASA) systems typi- harmonicity in the perception of prosody or in the segre- cally compute a measure of periodicity and f0 within lo- gation of speech from mixtures of talkers. cal time-frequency cells and then group cells in part based Index Terms: speech synthesis, harmonicity, sound seg- on the consistency of the f0 estimates. CASA systems in regation fact rely more strongly on harmonicity than common on- set, the other main bottom up grouping cue believed to 1. Introduction underlie human segregation [7, 8]. Despite the widespread assumption that harmonic- Human speech recognition is remarkable for its robust- ity is critical to sound segregation, its role in the seg- ness to background noise. Our ability to recognize tar- regation of real-world sounds such as speech remains get utterances from mixtures with other sound sources largely untested. Given the potential importance of spec- sets humans apart from state-of-the-art speech recogni- trotemporal sparsity in the segregation of complex nat- tion systems [1], which typically perform well in quiet ural sounds [9, 10], it is conceivable that the most im- but are adversely affected by the presence of additional portant role of harmonicity could simply be to produce sound sources. The robustness of human recognition to discrete frequency components, the sparsity of which re- competing sounds reflects our ability to segregate indi- duces masking and could facilitate common onset and This∗ work was supported in part by the National Science Foun- other grouping cues. Moreover, experimental results with dation (NSF) via grant IIS-1117015, by Grants-in-Aid for Scientific artificial stimuli have raised questions about whether har- Research 22650042 from JSPS, and by the Howard Hughes Medical monicity is in fact critical for segregation. Mistuned fre- Institute. Any opinions, findings and conclusions or recommendations expressed in this material are those of the authors and do not necessarily quency components of complex tones can be detected reflect the views of the sponsors. even when the frequencies of all components are in- creased by a fixed amount, or when the complex is components are combined using a sigmoid function (de- “stretched” such that adjacent components are no longer fined by the boundary frequency between the voiced and separated by a fixed number of Hz [11]. Although such unvoiced components, and a transition slope) [16]. tones are inharmonic (lacking a fundamental frequency The synthesis procedure of the basic STRAIGHT common to all the components they contain), component framework generates excitation with a pulse-plus-noise mistuning detection thresholds are comparable to those model. A linear phase shifter is used to implement frac- for harmonic tones. This result suggests that various tional pitch control. Time-varying filter characteristics forms of spectral regularity, rather than harmonicity per are implemented with a minimum phase response. se, could be most critical to segregation. The most relevant and convincing test of the im- 2.2. Sinusoidal Modeling of Voiced Excitation portance of harmonic structure in segregation would ar- To permit the manipulation of harmonicity, the pulse- guably be to assess the segregation of real-world sounds based voicing synthesis of the original STRAIGHT pro- compared to that of inharmonic equivalents that are cedure was was replaced by a sum of multiple sinusoids. matched in other respects. To usefully alter the harmonic- Let A(t, f) represent the amplitude at a time- ity of natural sounds, however, one must avoid disrupting frequency location (t, f) of the spectral envelope esti- other aspects of the sound structure. Speech in partic- mated using the STRAIGHT procedure. The determin- ular is difficult to manipulate in this manner, as it con- istic (voiced) component s(t) of the sinusoidal synthesis sists of a highly structured interaction of periodic and procedure is defined by the following equation. noise excitation with vocal tract filtering to which hu- mans are exquisitely sensitive. To explore the role of N(t) X Z t harmonicity in speech perception and segregation, we s(t) = A(t, fn(t)) cos 2π fn(τ)dτ +ϕn (1) devised a method to generate inharmonic versions of n=1 0 recorded speech utterances. We used the framework of STRAIGHT, a powerful tool for representing and manip- where fn(t) represents the time-varying frequency of the ulating speech [12, 13]. n-th constituent sinusoid and ϕn represents its initial phase (set to zero for the experiments described here). The total number of harmonic components N(t) at time 2. Methods t is adaptively adjusted to keep the highest component Spectral envelopes extracted by STRAIGHT were used to frequency lower than the Nyquist frequency. set the amplitudes of time-varying sinusoids. This section Equation 1 is approximated using a fixed frame-rate outlines the original STRAIGHT procedure and its exten- overlap-add procedure (6 ms Hanning-windowed frames, sion to enable sinusoidal modeling of excitation, which 3 ms frame rate, and 50% overlap between adjacent we used to generate inharmonic voicing. frames). A linear phase FIR time-varying filter, derived from A(t, f), is applied to each frame using a 64 ms FFT 2.1. STRAIGHT Framework buffer. To synthesize speech, s(t) is added to the un- Spectral envelope estimation in STRAIGHT consists of voiced speech component estimated as in conventional a two-stage procedure to eliminate interference from the STRAIGHT. periodic speech excitation on the the representation of spectral power [13]. In the first stage, temporal interfer- 2.3. Inharmonicity Manipulations ence is eliminated by averaging power spectra calculated Following manipulations from prior psychoacoustics at two time points separated by half a pitch period. In the studies [11, 17], we altered the frequencies of speech har- second stage, spectral interference is eliminated by spec- monics in three ways. tral smoothing using an f0-adaptive rectangular smoother followed by post processing to preserve harmonic com- • Shifting: the frequencies of all harmonics were in- ponent levels based on consistent sampling theory. These creased by a fixed proportion of the f0, preserving frequency domain procedures are implemented with cep- the regular spacing (in Hz) between components. stral liftering. More details are provided in [14]. Hence, the frequency of harmonic n became: Speech excitation estimation also relies on a tem- porally stable representation of the power spectrum and fn(t) = nf0(t) + af0(t) (2) combines this with a temporally stable representation of instantaneous frequency [15]. Excitation is represented • Stretching: the frequency spacing between adja- using a time-varying fundamental frequency f0(t) (for cent components was increased with increasing
Recommended publications
  • Extracting Vibration Characteristics and Performing Sound Synthesis of Acoustic Guitar to Analyze Inharmonicity
    Open Journal of Acoustics, 2020, 10, 41-50 https://www.scirp.org/journal/oja ISSN Online: 2162-5794 ISSN Print: 2162-5786 Extracting Vibration Characteristics and Performing Sound Synthesis of Acoustic Guitar to Analyze Inharmonicity Johnson Clinton1, Kiran P. Wani2 1M Tech (Auto. Eng.), VIT-ARAI Academy, Bangalore, India 2ARAI Academy, Pune, India How to cite this paper: Clinton, J. and Abstract Wani, K.P. (2020) Extracting Vibration Characteristics and Performing Sound The produced sound quality of guitar primarily depends on vibrational char- Synthesis of Acoustic Guitar to Analyze acteristics of the resonance box. Also, the tonal quality is influenced by the Inharmonicity. Open Journal of Acoustics, correct combination of tempo along with pitch, harmony, and melody in or- 10, 41-50. https://doi.org/10.4236/oja.2020.103003 der to find music pleasurable. In this study, the resonance frequencies of the modelled resonance box have been analysed. The free-free modal analysis was Received: July 30, 2020 performed in ABAQUS to obtain the modes shapes of the un-constrained Accepted: September 27, 2020 Published: September 30, 2020 sound box. To find music pleasing to the ear, the right pitch must be set, which is achieved by tuning the guitar strings. In order to analyse the sound Copyright © 2020 by author(s) and elements, the Fourier analysis method was chosen and implemented in Scientific Research Publishing Inc. MATLAB. Identification of fundamentals and overtones of the individual This work is licensed under the Creative Commons Attribution International string sounds were carried out prior and after tuning the string. The untuned License (CC BY 4.0).
    [Show full text]
  • An Exploration of Monophonic Instrument Classification Using Multi-Threaded Artificial Neural Networks
    University of Tennessee, Knoxville TRACE: Tennessee Research and Creative Exchange Masters Theses Graduate School 12-2009 An Exploration of Monophonic Instrument Classification Using Multi-Threaded Artificial Neural Networks Marc Joseph Rubin University of Tennessee - Knoxville Follow this and additional works at: https://trace.tennessee.edu/utk_gradthes Part of the Computer Sciences Commons Recommended Citation Rubin, Marc Joseph, "An Exploration of Monophonic Instrument Classification Using Multi-Threaded Artificial Neural Networks. " Master's Thesis, University of Tennessee, 2009. https://trace.tennessee.edu/utk_gradthes/555 This Thesis is brought to you for free and open access by the Graduate School at TRACE: Tennessee Research and Creative Exchange. It has been accepted for inclusion in Masters Theses by an authorized administrator of TRACE: Tennessee Research and Creative Exchange. For more information, please contact [email protected]. To the Graduate Council: I am submitting herewith a thesis written by Marc Joseph Rubin entitled "An Exploration of Monophonic Instrument Classification Using Multi-Threaded Artificial Neural Networks." I have examined the final electronic copy of this thesis for form and content and recommend that it be accepted in partial fulfillment of the equirr ements for the degree of Master of Science, with a major in Computer Science. Jens Gregor, Major Professor We have read this thesis and recommend its acceptance: James Plank, Bruce MacLennan Accepted for the Council: Carolyn R. Hodges Vice Provost and Dean of the Graduate School (Original signatures are on file with official studentecor r ds.) To the Graduate Council: I am submitting herewith a thesis written by Marc Joseph Rubin entitled “An Exploration of Monophonic Instrument Classification Using Multi-Threaded Artificial Neural Networks.” I have examined the final electronic copy of this thesis for form and content and recommend that it be accepted in partial fulfillment of the requirements for the degree of Master of Science, with a major in Computer Science.
    [Show full text]
  • Timbre Preferences in the Context of Mixing Music
    applied sciences Article Timbre Preferences in the Context of Mixing Music Felix A. Dobrowohl *, Andrew J. Milne and Roger T. Dean The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW 2751, Australia; [email protected] (A.J.M.); [email protected] (R.T.D.) * Correspondence: [email protected]; Tel.: +61-2-9772-6585 Received: 21 March 2019; Accepted: 16 April 2019; Published: 24 April 2019 Abstract: Mixing music is a highly complex task. This is exacerbated by the fact that timbre perception is still poorly understood. As a result, few studies have been able to pinpoint listeners’ preferences in terms of timbre. In order to investigate timbre preference in a music production context, we let participants mix multiple individual parts of musical pieces (bassline, harmony, and arpeggio parts, all sounded with a synthesizer) by adjusting four specific timbral attributes of the synthesizer (lowpass, sawtooth/square wave oscillation blend, distortion, and inharmonicity). After participants mixed all parts of a musical piece, they were asked to rate multiple mixes of the same musical piece. Listeners showed preferences for their own mixes over random, fixed sawtooth, or expert mixes. However, participants were unable to identify their own mixes. Despite not being able to accurately identify their own mixes, participants consistently preferred the mix they thought to be their own, regardless of whether or not this mix was indeed their own. Correlations and cluster analysis of the participants’ mixing settings show most participants behaving independently in their mixing approaches and one moderate sized cluster of participants who are actually rather similar.
    [Show full text]
  • The Origins of Phantom Partials in the Piano
    Rollins College Rollins Scholarship Online Honors Program Theses Spring 2020 The Origins of Phantom Partials in the Piano Lauren M. Neldner Rollins College, [email protected] Follow this and additional works at: https://scholarship.rollins.edu/honors Part of the Other Physics Commons, and the Statistical, Nonlinear, and Soft Matter Physics Commons Recommended Citation Neldner, Lauren M., "The Origins of Phantom Partials in the Piano" (2020). Honors Program Theses. 105. https://scholarship.rollins.edu/honors/105 This Open Access is brought to you for free and open access by Rollins Scholarship Online. It has been accepted for inclusion in Honors Program Theses by an authorized administrator of Rollins Scholarship Online. For more information, please contact [email protected]. THE ORIGINS OF PHANTOM PARTIALS IN THE PIANO Lauren M. Neldner A Senior Honors Project Submitted in Partial Fulfillment of the Requirements of the Honors Degree Program March 2020 Faculty Sponsor: Thomas R. Moore Rollins College Winter Park, FL Contents Acknowledgments 6 1 Introduction 7 1.1 History of the Piano . 7 1.2 The Modern Piano . 9 1.2.1 Frame and Case . 11 1.2.2 Soundboard . 11 1.2.3 Bridges . 13 1.2.4 Strings . 14 1.2.5 Hammers and Action . 16 1.2.6 Pedals and Dampers . 17 2 Phantom Partials 19 2.1 Historical Context . 20 2.2 Historic Theory of Phantom Partials . 21 2.3 Production in Non-string Components . 25 3 Two Plausible Theories 30 3.1 Pressure Induced Nonlinearity . 30 3.2 Contact Nonlinearity . 33 1 4 Experiments and Results 37 4.1 Pressure experiments .
    [Show full text]
  • The Perceptual Representation of Timbre
    Chapter 2 The Perceptual Representation of Timbre Stephen McAdams Abstract Timbre is a complex auditory attribute that is extracted from a fused auditory event. Its perceptual representation has been explored as a multidimen- sional attribute whose different dimensions can be related to abstract spectral, tem- poral, and spectrotemporal properties of the audio signal, although previous knowledge of the sound source itself also plays a role. Perceptual dimensions can also be related to acoustic properties that directly carry information about the mechanical processes of a sound source, including its geometry (size, shape), its material composition, and the way it is set into vibration. Another conception of timbre is as a spectromorphology encompassing time-varying frequency and ampli- tude behaviors, as well as spectral and temporal modulations. In all musical sound sources, timbre covaries with fundamental frequency (pitch) and playing effort (loudness, dynamic level) and displays strong interactions with these parameters. Keywords Acoustic damping · Acoustic scale · Audio descriptors · Auditory event · Multidimensional scaling · Musical dynamics · Musical instrument · Pitch · Playing effort · Psychomechanics · Sound source geometry · Sounding object 2.1 Introduction Timbre may be considered as a complex auditory attribute, or as a set of attributes, of a perceptually fused sound event in addition to those of pitch, loudness, per- ceived duration, and spatial position. It can be derived from an event produced by a single sound source or from the perceptual blending of several sound sources. Timbre is a perceptual property, not a physical one. It depends very strongly on the acoustic properties of sound events, which in turn depend on the mechanical nature of vibrating objects and the transformation of the waves created as they propagate S.
    [Show full text]
  • Inharmonicity of Sounds from Electric Guitars
    Inharmonicity of Sounds from Electric Guitars: Physical Flaw or Musical Asset? Hugo Fastl, Florian Völk AG Technische Akustik, MMK, Technische Universität München, Germany [email protected] ABSTRACT II. EXPERIMENTS Because of bending waves, strings of electric guitars produce (slightly) A. Inharmonicity of guitar strings inharmonic spectra. One aim of the study was to find out - also in view of synthesized musical instruments - whether sounds of electric The deviation of the sound signals produced by a plucked guitars should preferably produce strictly harmonic or slightly string from being exactly harmonically is dependent on the inharmonic spectra. Inharmonicities of typical sounds from electric inharmonicity of the string, which itself is dependent on the guitars were analyzed and studied in psychoacoustic experiments. stiffness of the string. The latter is dependent primarily on Strictly harmonic as well as slightly inharmonic spectra were realized physical parameters of the considered string-material. If the and evaluated with respect to audibility of beats, possible differences inharmonicity is given, it is possible to compute the frequency in pitch height, and overall preference. Strictly harmonic as well as of the nth component for a string, which would have the fun- slightly inharmonic spectra produce essentially the same pitch height. damental frequency without stiffness (cf. Fletcher and Rossing Depending on the magnitude of the inharmonicity, beats are clearly 1998) the following way: audible. Low, wound strings (e.g. E2, A2) usually produce larger inharmonicities than high strings (e.g. E4), and hence beats of low 1 for 1; [1] notes are easily detected. The inharmonicity increases with the diameter of the respective string's kernel.
    [Show full text]
  • Inharmonicity of Piano Strings Simon Hendry, October 2008
    School of Physics Masters in Acoustics & Music Technology Inharmonicity of Piano Strings Simon Hendry, October 2008 Abstract: Piano partials deviate from integer harmonics due to the stiffness and linear density of the strings. Values for the inharmonicity coefficient of six strings were determined experimentally and compared with calculated values. An investigation into stretched tuning was also performed with detailed readings taken from a well tuned Steinway Model D grand piano. These results are compared with Railsback‟s predictions of 1938. Declaration: I declare that this project and report is my own work unless where stated clearly. Signature:__________________________ Date:____________________________ Supervisor: Prof Murray Campbell Table of Contents 1. Introduction - A Brief History of the Piano ......................................................................... 3 2. Physics of the Piano .............................................................................................................. 5 2.1 Previous work .................................................................................................................. 5 2.2 Normal Modes ................................................................................................................. 5 2.3 Tuning and inharmonicity ................................................................................................ 6 2.4 Theoretical prediction of partial frequencies ................................................................... 8 2.5 Fourier Analysis
    [Show full text]
  • Correlation Between the Frequencies of Harmonic Partials Generated from Selected Fundamentals and Pitches of Supplied Tones
    University of Montana ScholarWorks at University of Montana Graduate Student Theses, Dissertations, & Professional Papers Graduate School 1962 Correlation between the frequencies of harmonic partials generated from selected fundamentals and pitches of supplied tones Chester Orlan Strom The University of Montana Follow this and additional works at: https://scholarworks.umt.edu/etd Let us know how access to this document benefits ou.y Recommended Citation Strom, Chester Orlan, "Correlation between the frequencies of harmonic partials generated from selected fundamentals and pitches of supplied tones" (1962). Graduate Student Theses, Dissertations, & Professional Papers. 1913. https://scholarworks.umt.edu/etd/1913 This Thesis is brought to you for free and open access by the Graduate School at ScholarWorks at University of Montana. It has been accepted for inclusion in Graduate Student Theses, Dissertations, & Professional Papers by an authorized administrator of ScholarWorks at University of Montana. For more information, please contact [email protected]. CORRELATION BETWEEN THE FREQUENCIES OF HARMONIC PARTIALS GENERATED FROM SELECTED FUNDAMENTALS AND PITCHES OF SUPPLIED TONES by CHESTER ORLAN STROM BoMo Montana State University, 1960 Presented in partial fulfillment of the requirements for the degree of Master of Music MONTANA STATE UNIVERSITY 1962 Approved by: Chairman, Board of Examine Dean, Graduate School JUL 3 1 1902 Date UMI Number: EP35290 All rights reserved INFORMATION TO ALL USERS The quality of this reproduction is dependent upon the quality of the copy submitted. In the unlikely event that the author did not send a complete manuscript and there are missing pages, these will be noted. Also, if material had to be removed, a note will indicate the deletion.
    [Show full text]
  • Musical Acoustics Research Library (MARL) M1711
    http://oac.cdlib.org/findaid/ark:/13030/kt6h4nf6qc Online items available Guide to the records of the Musical Acoustics Research Library (MARL) M1711 Musical Acoustics Research Library (MARL) Finding aid prepared by Processed by Andrea Castillo Dept. of Special Collections & University Archives Stanford University Libraries. 557 Escondido Mall Stanford, California, 94305 Email: [email protected] August 2011 Guide to the records of the M1711 1 Musical Acoustics Research Library (MARL) M1711 Title: Musical Acoustics Research Library (MARL) Identifier/Call Number: M1711 Contributing Institution: Dept. of Special Collections & University Archives Language of Material: Multiple languages Physical Description: 59.39 Linear feet(138 manuscript boxes, 3 card boxes) Date (inclusive): 1956-2007 Abstract: The MARL collection is dedicated to the study of all aspects of musical acoustics. The collection, established in 1996, came about through the joint effort of the representatives of the Catgut Acoustical Society (CAS), founded by Carleen M. Hutchins and devoted to the study of violin making; Stanford’s Center for Computer Research in Music Acoustics (CCRMA), and Virginia Benade, the widow of the wind instrument acoustician Arthur Benade. MARL consists of the research materials from acousticians around the world who were dedicated to studying different aspects of violin making, which make up the Catgut Acoustical Society papers, and the archives of three prominent wind instrument acousticians of our time, John Backus, John W. Coltman, and especially Arthur H. Benade, which deal not only wiht wind instruments, but also room acoustics, and the interplay between acoustical physics and the mechanisms of auditory processing. The collection consists of papers, photographs, media, digital materials, wood samples, clarinet mouth pieces, and lab equipment Physical Location: Special Collections materials are stored offsite and must be paged 36 hours in advance.
    [Show full text]
  • Acoustics for Physics Pedagogy and Outreach Kent L
    Resource Letter APPO-1: Acoustics for Physics Pedagogy and Outreach Kent L. Gee and Tracianne B. Neilsen Citation: American Journal of Physics 82, 825 (2014); doi: 10.1119/1.4869298 View online: http://dx.doi.org/10.1119/1.4869298 View Table of Contents: http://scitation.aip.org/content/aapt/journal/ajp/82/9?ver=pdfcov Published by the American Association of Physics Teachers Articles you may be interested in Resource Letter NTUC-1: Noether's Theorem in the Undergraduate Curriculum Am. J. Phys. 82, 183 (2014); 10.1119/1.4848215 The Shapes of Physics Phys. Teach. 51, 524 (2013); 10.1119/1.4830062 Resource Letter MPCVW-1: Modeling Political Conflict, Violence, and Wars: A Survey Am. J. Phys. 81, 805 (2013); 10.1119/1.4820892 “Physics Questions Without Numbers” from Monash University, tinyurl.com/WS-qwn Phys. Teach. 50, 510 (2012); 10.1119/1.4758167 Resource Letter ALIP–1: Active-Learning Instruction in Physics Am. J. Phys. 80, 478 (2012); 10.1119/1.3678299 This article is copyrighted as indicated in the article. Reuse of AAPT content is subject to the terms at: http://scitation.aip.org/termsconditions. Downloaded to IP: 128.187.97.22 On: Sat, 30 Aug 2014 15:04:44 RESOURCE LETTER Resource Letters are guides for college and university physicists, astronomers, and other scientists to literature, websites, and other teaching aids. Each Resource Letter focuses on a particular topic and is intended to help teachers improve course content in a specific field of physics or to introduce nonspecialists to this field. The Resource Letters Editorial Board meets at the AAPT Winter Meeting to choose topics for which Resource Letters will be commissioned during the ensuing year.
    [Show full text]
  • Harmonic Temperaments and Patterns of Interference
    City University of New York (CUNY) CUNY Academic Works School of Arts & Sciences Theses Hunter College Winter 5-14-2021 Signal to Noise: Harmonic Temperaments and Patterns of Interference Dylan A. Marcheschi CUNY Hunter College How does access to this work benefit ou?y Let us know! More information about this work at: https://academicworks.cuny.edu/hc_sas_etds/761 Discover additional works at: https://academicworks.cuny.edu This work is made publicly available by the City University of New York (CUNY). Contact: [email protected] Signal to Noise: Harmonic Temperaments and Patterns of Interference by Dylan A. Marcheschi Submitted in partial fulfillment of the requirements for the degree of Master of Fine Arts in Integrated Media Arts, Hunter College The City University of New York May 2021 05/14/21 Andrew Demirjian Date Thesis Sponsor 05/14/21 Ricardo Miranda Date Second Reader Marcheschi 1/66 Abstract Signal to Noise is a collection of long-form microtonal sound compositions and corresponding audio- reactive videos. The project constitutes an audio/visual exploration of historical tuning systems and temperaments. Most contemporary Western audiences will seldom if ever encounter harmony outside of post-Renaissance tuning conventions. This material highlights some of those pre-orthodox harmonic relationships which existed throughout most of history, and continue to exist outside of the sphere of Western influence. This corresponding paper documents that history, as well as recent correlates in advances of acoustic ecology and music as therapeutic intervention. Marcheschi 2/66 List of Figures 1. Word Frequency in the Brown Corpus of English Text … 4 2. Harmonic Nodes of a String … 5 3.
    [Show full text]
  • Perceptual Significance of Inharmonicity and Spectral Envelope in the Piano Bass Range
    Perceptual Significance of Inharmonicity and Spectral Envelope in the Piano Bass Range Alexandre Galembo Ryerson University Anders Askenfelt Royal Institute of Technology Lola L. Cuddy Queen’s University Frank A. Russo Queen’s University digital.library.ryerson.ca/object/60 Please Cite: Galembo, A., Askenfelt, A., Cuddy, L. L., & Russo, F. A. (2004). Ergonomics action research II: A Framework for Integrating Human Factors into Work- System Design. Acta Acustica united with Acustica, 90(3), 528-536. library.ryerson.ca 1 Perceptual relevance of inharmonicity and spectral envelope in the piano bass range Alexander Galembo Setchenov Institute of Evolutionary Physiology and Biochemistry, Russian Academy of Sciences, Thorez pr. 44, St. Petersburg, 194223 Russia. Anders Askenfelt Dept. of Speech, Music and Hearing, Royal Institute of Technology, SE-100 44 Stockholm, Sweden. Lola L. Cuddy & Frank A. Russo Dept. of Psychology, Queen’s University, Kingston ON K7L 3N6, Canada. Abstract Professionals consider the differences in the timbre of bass tones between large grand pianos and small uprights as significant. By tradition this difference has been attributed mainly to lower inharmonicity in grand pianos, due to longer bass strings. In this study, the importance of the spectral envelope, representing the dynamic balance between high-frequency and low- frequency energy in the spectrum, is contrasted against the importance of the level of inharmonicity. Results from two listening tests indicate that the inharmonicity is less important than the spectrum bandwidth in determining the timbre of piano bass tones. Submitted May 23, 2002 Galembo et al Perceptual relevance of inharmonicity and spectral envelope 2 1. INTRODUCTION Even a well-made upright piano of high quality is not considered appropriate for concert performances.
    [Show full text]