Sound of How It Works Session 7 Singing

OLLI at Illinois Spring 2020 Plainsong and Gregorian Chants Hymn Lucis Creator and a Canticle Beauty in Sound (2019) D. H. Tracy Reconstruction of Sounds from Roman Cornu Horn

Music played on Virtual Cornu using Modalys simulation program. [René Caussé & team, Institute for Research and Coordination in Acoustics and Music, Paris (2017)] Cornu dimensions, materials and construction details from Pompei artifacts at Museo Archeologico Nazionale di Napoli. 3.4 m Length, Conical, Sheet metal, Bronze Alloy

Traditional Military Call

 Cornu

Floor mosaic, Zliten, Libya ca 1st Century CE. Musicians at Gladiatorial Music: Gustav Mahler Contest with Roman Tuba, Hydraulis pipe organ, two Conua. 2nd Symphony

From Physics, online magazine of the 3/3/20 American Physical Society (March 5, 2020) Sound of Music 6 2 Sound of Music How It Works Session 7 Singing

OLLI at Illinois Spring 2020

D. H. Tracy Course Outline

1. Building Blocks: Some basic concepts 2. Resonance: Building Sounds 3. Hearing and the Ear 4. Musical Scales 5. Musical Instruments 6. More Musical Instruments 7. Singing 8. Notation; Harmony and Dissonance

3/3/20 Sound of Music 6 4 Feb 28, 2020

PERSPECTIVES 3/3/20 Sound of Music 6 5 PERSPECTIVES 3/3/20 Sound of Music 6 6 Albouy et al 10 novel Melodies 10 Lyric lines

3/3/20 Sound of Music 6 7 The McGill Experiment Albouy et al Science Feb 28, 2020

Different Try the Demo Experiment yourself online at ??? Same www.Zlab.McGill.ca/Spectro_Temporal_Modulations/

• Listen to Pairs of Songs • Judge whether either Melodies or Lyrics are ➢ The Same ➢ or Different • Spoiler: Some Songs may be distorted either ➢ Spectrally (by smearing Frequencies) or ➢ Temporally (by smearing Time) • Note: You will be lying in a fMRI Machine ➢ Just relax!

3/3/20 Sound of Music 6 8 The hall-way leads to doors that let us out I think she has a soft and love-ly voice

Song Pair 1:

Same Melody Different Lyrics

3/3/20 Sound of Music 6 9 They said it was a cross they saw in church They said it was a cross they saw in church

Song Pair 2:

Diff. Melody Same Lyrics

3/3/20 Sound of Music 6 10 He chose to take a long and lone-ly road Magicians like to trick and fool their fans

Song Pair 3:

Diff. Melody Diff. Lyrics

3/3/20 Sound of Music 6 11 xxxxx yyyyyyy

Song Pair 4:

High Temporal Degradation Listen toMelodies: Melodies and Lyrics Are theySame theor same Different or different?

3/3/20 Sound of Music 6 12 ??#%?&!#?? ???*%#@%?#

Song Pair 4:

High Temporal Degradation

SAME Melodies

3/3/20 Sound of Music 6 13 xxxxx yyyyyyy

Song Pair 5:

High Spectral Degradation Listen to MelodiesLyrics: and Lyrics Are theySame theor same Different or different?

3/3/20 Sound of Music 6 14 We told them that a tax would sure-ly help We told them that a tax would sure-ly help

Song Pair 5:

High Spectral Degradation SAME Lyrics

3/3/20 Sound of Music 6 15 xxxxx yyyyyyy

Song Pair 6:

High Spectral Degradation Listen to Melody:Melodies and Lyrics Are theySame theor same Different or different?

3/3/20 Sound of Music 6 16 He chose to take a long and lone-ly road The hallway leads to doors that let us out

Song Pair 6:

High Spectral Degradation Different Melody

3/3/20 Sound of Music 6 17 xxxxx yyyyyyy

Song Pair 7:

High Temporal Degradation Listen to MelodiesLyrics: and Lyrics Are theySame theor same Different or different?

3/3/20 Sound of Music 6 18 ??#?&*@??? ??*$##?@?!

Song Pair 7:

High Temporal Degradation Different Lyrics

3/3/20 Sound of Music 6 19 xxxxx yyyyyyy

Song Pair 8:

High Spectral Degradation Listen to Melody:Melodies and Lyrics Are theySame theor same Different or different?

3/3/20 Sound of Music 6 20 Jack Jim and John wear three a-ma-zing hats We’d like to go to Boston Monday night

Song Pair 8:

High Spectral Degradation SAME Melody

3/3/20 Sound of Music 6 21 Song Pair 9:

High Temporal Degradation Listen to MelodiesLyrics: and Lyrics Are theySame theor same Different or different?

3/3/20 Sound of Music 6 22 Song Pair 9:

High Temporal Degradation SAME Lyrics

3/3/20 Sound of Music 6 23 McGill Results (for Right-handed People) • Spectral Degradation hurts Melody recognition • Temporal Degradation hurts Lyric recognition • Right Auditory Cortex primarily decodes Melody • Left Auditory Cortex primarily decodes Lyrics

L R Lyrics Melody L R L R

3/3/20 Sound of Music 6 24 Singing

3/3/20 Sound of Music 6 25 Coloratura Soprano Audrey Luna

Audrey Luna (2010) singing Mad Scene from Donizetti’s (1835)

Listen carefully to the lyrics….

3/3/20 Sound of Music 6 26 Coloratura Audrey Luna

Audrey Luna (Nov. 2017) hits A6 at the Met in Thomas Adès’s The Exterminating Angel

She actually hit above A#6 (1910 Hz)

3/3/20 Sound of Music 6 27 Coloratura Audrey Luna

15 kHz

Audrey Luna (Nov. 2017) hits A6 at the Met in Thomas Adès’s The Exterminating Angel

She actually hit above A#6 1910 Hz 0 Hz

3/3/20 Sound of Music 6 28 Coloratura Audrey Luna

15 kHz Audrey Luna (Nov. 2017) hits A6 at the Met 1/20 s in Thomas Adès’s The Exterminating Angel She actually hit above A#6 (1910 Hz)

0 Hz

3/3/20 Sound of Music 6 29 The Singing Voice as a Musical Instrument Source of Controllable Variable Air Pressure Vibrating Acoustic Valve Resonator

Lips

f1 + Harmonics Selects desired harmonics

Nasal Cavity

Tongue

Vocal Vocal Folds Tract

3/3/20 Sound of Music 6 30 Vocal Tract Crudely Similar to Closed/Open Pipe

f1  400 Hz

3/3/20 Sound of Music 6 31 The Overall Voice Apparatus

LearnLanguagesOnYourOwn.com

3/3/20 Sound of Music 6 32 But Not All Sounds are Voiced using Vocal Folds Also: • Sounds produced by turbulent flow – sss, shh, fff, th – Frictive • Sounds produced by sudden release of pressure – t , k, p – Plosive • Combinations of these with Voicing – z, v, b, d, g

3/3/20 Sound of Music 6 33 Types of Vocalization

Turbulence Stops “Voiced” Phonemes (Fricatives) (Plosives)

Vocal Cord Sound Due to Vocal Tract Vibration Turbulent Air Blocked by Creates Sound Flow Tongue or Lips

Harmonics Modified High Reynolds • Catch by Resonances of Number • Hold Vocal Tract • Release

Examples: Examples: Examples: Vowels Sibilants (s, z, sh, zh) Voiced Consonants [tongue curled] Voiceless (p, t, k) (l, m, n, r) Non-Sibilants - l, m, n, r etc. (f, v, thing, that) Voiced (b, d, g) voiced

3/3/20 Sound of Music 6 34 Vocal Tract

Larynx

3/3/20 Sound of Music 6 35 Larynx 3D Model

Top View Front Rear View 3/3/20 Sound of Music 6 36

Done Vocal Folds (Cords): Top View Open vs Closed

Front

3/3/20 Sound of Music 6 37 Vocal Folds (Cords): Top View Open vs Closed

Front

3/3/20 Sound of Music 6 38 Phonation: Generating Chopped Glottal Air Flow via Vocal Fold Vibrations

Phonation Types: 1. “Breathy” Folds do not close Weak harmonics

2. Modal (flow, normal)

3. “Pressed” Folds tightly squeezed Shrill sound Power to Sing

3/3/20 Sound of Music 6 39 Phonation: What if we Eliminated the Vocal Tract? Estimated Vocalization without Modification by Vocal Tract 1. Synthetic voice (glissando)

2. Male speech voice (based on EGG)

3. Singing (Modal Phonation) 100 Hz 260 Hz 750 Hz Power to Sing

3/3/20 Sound of Music 6 40 Glottal Closings Generate Most Sound Vibration of Vocal Fold

Google: Columbia Power to Sing “Human Voice” pdf 3/3/20 Sound of Music 6 41 Glottal Closings Generate Most Sound Vibration of Vocal Fold

Google: Columbia Power to Sing “Human Voice” pdf 3/3/20 Sound of Music 6 42 Glottal Airflow Mask System

3/3/20 Sound of Music 6 43 Electroglottograph

3/3/20 Sound of Music 6 44 Phonation: and Glottal 3/3/20 Sound Resulting Pressed Breathy Flow Phonation Phonation

Glottal Flow → Sound Pressure → Closings Glottal Sound Sound 6 of Music Speech P. Mokhtari Vowel f 0 = 110 = 110 Hz Communication /a / 0 (2018 45 ) Laryngoscopy: Viewing the Vocal Folds Nasal Laryngoscopy

Mirror

Oral Laryngoscope

3/3/20 Sound of Music 6 46 Laryngoscopy: Viewing the Vocal Folds

Using a Stroboscopic Lamp flashing at the vibration rate of the vocal folds freezes the action

3/3/20 Sound of Music 6 47 Power to Sing 3/3/20 Sound of Music 6 48 Action of Vocal Folds While Singing

3/3/20 Sound of Music 6 49 Modifies the 3/3/20 The Vocal Tract Sound Sound Sound 6 of Music

Frequency → f 1 Folds Vocal (Formants) Resonances Vocal F1 F2 F3 F4 Tract Formant Formant 2 Formant 3 Formant 4 Formant Formant 1 50 Modifies the 3/3/20 The Vocal Tract Sound Sound Sound 6 of Music

Frequency → f 1 Folds Vocal (Formants) Resonances Vocal F1 F2 F3 F4 Tract Result 51 Modifies the 3/3/20 The Vocal Tract Sound Sound Sound 6 of Music

Frequency → f 1 Folds Vocal Resonances (Formants) Vocal F1 F2 F3 F4 Tract Result 52 Modifies the 3/3/20 The Vocal Tract Sound Sound Sound 6 of Music

Frequency → f 1 Folds Vocal Resonances (Formants) Vocal F1 F2 F3 F4 Tract Result 53 Modifies the 3/3/20 The Vocal Tract Sound Sound Sound 6 of Music

Frequency → f 1 Folds Vocal Resonances (Formants) Vocal F1 F2 F3 F4 Tract Result 54 Speaking “Olli” He said “OLLI”

4 kHz Frequency

3/3/20 0 Hz Sound of Music 6 55 Speech Formants: “Olli” He said “OLLI” She said “OLLI”

3/3/20 ~125 Hz Sound of Music 6 ~260 Hz 56 Harmonics of Voice Fundamental Shaped by Formants

Average Formant F3 Frequencies for Vowels

F2

F1

3/3/20 Sound of Music 6 57 Approximate Locations of First 2 Formants

3/3/20 Sound of Music 6 58 The “Singer’s Formant”

Singing voice of To Compete with Orchestra: tenor Jussi Björling, (dB) showing prominent Singers try to shift their Singer’s Formant Vocal Tract Formants to maximize power around Ordinary 1911-1960 2 to 3 kHz . speech Orchestral

Tricky since each note has accompaniment Relative Intensity Intensity Relative different harmonics which need to coincide with a Formant.

Even Trickier if lyrics must be Frequency (Hz) understood HyperPhysics: after Sundberg, The Acoustics of the Singing Voice

3/3/20 Sound of Music 6 59 Audrey Luna hits Eb6 in Lucia di Lammermoor

15 kHz

$$ Eb6 1245 Hz

Audrey Luna (2010) 3/3/20 Sound of Music 6 60 Donizetti: Lucia di Lammermoor King of High C’s

Luciano Pavarotti (1935-2007) as the Duke of Mantua in Verdi’s singing La Donna È Mobile La donna è mobil’ [Opera Film Rigoletto (1982)] Qual piuma al vento, muta d'accento di pensiero !

Woman is fickle. Like a feather in the wind, she changes her words, and her thoughts !

3/3/20 Sound of Music 6 61 King of High C’s

Luciano Pavarotti (1935-2007) as the Duke of Mantua in Verdi’s Rigoletto singing La Donna È Mobile La donna è mobil’ [Opera Film Rigoletto (1982)] Qual piuma al vento, muta d'accento e di pensiero !

Woman is fickle. Like a feather in the wind, she changes her words, *According to D.G. Miller, and her thoughts ! Resonance in Singing (2008)

3/3/20 Sound of Music 6 62 e di pensier’ ! King of High C’s and her thoughts !

La donna è mobil' Qual piuma al vento, muta d'accento Luciano Pavarotti (1935-2007) e di pensier’!

as the Duke of Mantua Woman is fickle. in Verdi’s Rigoletto Like a feather in the wind, she changes her words, singing La Donna È Mobile and her thoughts! Opera Film Rigoletto (1982)

*According to D.G. Miller, Resonance in Singing (2008)

3/3/20 Sound of Music 6 63 Pavarotti: Rigoletto -- La donna è mobile

5 kHz

e……………………………………………………………. di pensi-e…………………………………r

Luciano Pavarotti (1982) 3/3/20 Sound of Music 6 64 Rigoletto: La donna è mobile [B Major] Pavarotti: Rigoletto -- La donna è mobile

5 kHz

Note High Vibrato Amplitude (8th Harmonic)

C5

fermata e……………………………………………………………. di pensi-e…………………………………r

3/3/20 F#4 A#4 Sound of Music 6 G#4 F#4 B4? 65 Pavarotti: Rigoletto – King of 2nd Formant Tuning

5 kHz

Example of 2nd Formant Tuning

e……………………………………………………………. di pensi-e…………………………………r

3/3/20 F#4 A#4 Sound of Music 6G#4 F#4 B4? 66 A Music Lesson

Chest Voice vs Head Voice

Vocal Warmups for Singing: The 7 Best Exercises (2018) 3/3/20 Sound of Music 6 TakeLessons.com 67 A Music Lesson

Siren Singing: Vowel changes from who to ahh

Vocal Warmups for Singing: The 7 Best Exercises (2018) 3/3/20 Sound of Music 6 TakeLessons.com 68 “Siren”

3/3/20 Sound of Music 6 69 “Siren”

924 Hz

151 Hz

3/3/20 Sound of Music 6 70 Solfege Diatonic

Note that Solfege syllables have 1. different sung notes and 2. different vowels

Andrew Rostas Solfege Tutorial – Video 1 (2016) 3/3/20 Sound of Music 6 71 Solfege: Diatonic Scale [ C3 to C4 ]

5 kHz

Do Re Mi Fa So La Ti Do Do Ti La So Fa Mi Re Do

Andrew Rostas 3/3/20 Sound of Music 6 72 Solfege Tutorial – Video 1 (2016) Solfege: Diatonic C Major Scale [ C3 to C4 ]

4 kHz

Do Re Mi Fa So La Ti Do

Andrew Rostas 3/3/20 Sound of Music 6 73 Solfege Tutorial – Video 1 (2016) Solfege: Diatonic C Major Scale [ C3 to C4 ]

4 kHz

Do (C3) 131 Hz

Do Re Mi Fa So La Ti Do

Andrew Rostas 3/3/20 Sound of Music 6 74 Solfege Tutorial – Video 1 (2016) Solfege: Diatonic C Major Scale [ C3 to C4 ]

4 kHz

Re (D3) 147 Hz

Do Re Mi Fa So La Ti Do

Andrew Rostas 3/3/20 Sound of Music 6 75 Solfege Tutorial – Video 1 (2016) Solfege: Diatonic C Major Scale [ C3 to C4 ]

4 kHz

Mi (E3) 175 Hz

Do Re Mi Fa So La Ti Do

Andrew Rostas 3/3/20 Sound of Music 6 76 Solfege Tutorial – Video 1 (2016) Solfege: Diatonic C Major Scale [ C3 to C4 ]

4 kHz

So (G3) 196 Hz

Do Re Mi Fa So La Ti Do

Andrew Rostas 3/3/20 Sound of Music 6 77 Solfege Tutorial – Video 1 (2016) Solfege: Diatonic C Major Scale [ C3 to C4 ]

Movie of Spectrum shows how harmonics dynamically follow vowel formants

Andrew Rostas 3/3/20 Sound of Music 6 78 Solfege Tutorial – Video 1 (2016) Sandra Oberoi Solfege Diatonic Major Scale

Sandra Oberoi Solfege Singing: Major Scale and Intervals (2013) Harmony – the music school 3/3/20 Sound of Music 6 79 Solfege: Diatonic C Major Scale [ C4 to C5 ]

5 kHz

Do Re Mi Fa So La Ti Do Do Ti La So Fa Mi Re Do

Sandra Oberoi 3/3/20 Sound of Music 6 80 Solfege Singing: Major Scale (2013) Solfege: Diatonic C Major Scale [ C4 to C5 ]

5 kHz

Let’s just look at the Oh’s

Do Re Mi Fa So La Ti Do Do Ti La So Fa Mi Re Do

Sandra Oberoi 3/3/20 Sound of Music 6 81 Solfege Singing: Major Scale (2013) Solfege: Diatonic C Major Scale [ C4 to C5 ]

5 kHz

Now let’s just look at the EE’s

Do Re Mi Fa So La Ti Do Do Ti La So Fa Mi Re Do

Sandra Oberoi 3/3/20 Sound of Music 6 82 Solfege Singing: Major Scale (2013) Solfege: Diatonic C Major Scale [ C4 to C5 ]

5 kHz * Huber et al, JASA (1999)

Formant 3 Or just look at the Ah’s

Formant 2

Formant 1*

Do Re Mi Fa So La Ti Do Do Ti La So Fa Mi Re Do

Sandra Oberoi 3/3/20 Sound of Music 6 83 Solfege Singing: Major Scale (2013) Solfege: Diatonic C Major Scale [ C4 to C5 ]

5 kHz

Do Re Mi Fa So La Ti Do Do Ti La So Fa Mi Re Do

Sandra Oberoi 3/3/20 Sound of Music 6 84 Solfege Singing: Major Scale (2013) Solfege:Female Diatonic Voice C Humming Major Scale a Scale [ C4 to C5 ]

5 kHz

Do Re Mi Fa So La Ti Do Do Ti La So Fa Mi Re Do

3/3/20 Sound of Music 6 85 Throat Singing a.k.a. Overtone Singing

Germany

3/3/20 Sound of Music 6 86 Overtone Singing Example

• Anna-Maria Hefele • Music Video 2017 – Regular singing – Harp – Overtone singing • Song: By This River (Brian Eno) • MRI Sequences: – Prof. Bernhard Richter et. al. Freiburg Institute for Musician’s Medicine (University of Music Freiburg)

3/3/20 Sound of Music 6 87 Overtone Singing Overtone Singing Example

Anna-Maria 3/3/20 Sound of Music 6 Hefele 201788 Overtone Singing Overtone Singing Example

MRI Showing tongue creating a a special formant, isolating one drone harmonic

Anna-Maria 3/3/20 Sound of Music 6 Hefele 201789 Isolated vocal fold harmonics sound disconnected from the fundamental drone, since they pop up suddenly. Anna-Marie Hefele overtone singing Perceived as entirely separate tones.

Everything but the vocal drone harmonics is due to the musical instrument accompaniment

Drone 294 Hz (D4) Drone 234 Hz (A#3)

3/3/20 Sound of Music 6 90 Missing Harmonic Hardly Noticed…

NOW can you hear it? Hear the Difference? 11

10 9 8 7 6 1200 Hz 5 4 3 2 1 200 Hz

2/11/2020 Sound of Music 3 91 Harmony

• Human Voice can only play one note at a time – with harmonics, of course… • Solution: – Multiple Voices • Examples: – Quartets – Choruses

3/3/20 Sound of Music 6 92 Signature: 2019 International Barbershop Quartet Champions Salt Lake City

3/3/20 Sound of Music 6 93 Vocal Ranges

• Soprano: the highest female voice, being able to sing C4 to C6 , and possibly higher.

• Mezzo-soprano: a female voice between A3 and A5 .

• Contralto: the lowest female voice, F3 to E5. Rare contraltos possess a range similar to the tenor.

• Tenor: the highest male voice, B2 to A4 , and possibly higher.

• Baritone: a male voice, G2 to F4 .

• Bass: the lowest male voice, E2 to E4 .

3/3/20 Sound of Music 6 94 Course Outline

1. Building Blocks: Some basic concepts 2. Resonance: Building Sounds 3. Hearing and the Ear 4. Musical Scales 5. Musical Instruments 6. More Musical Instruments 7. Singing 8. Notation; Harmony and Dissonance

3/3/20 Sound of Music 6 95 San Francisco Exploratorium Exhibit

Attempting to Simulate Human Voice

Duck Call (Glottis) Resonant Tube (Vocal Tract)

“Clarinet”

3/3/20 Sound of Music 6 96 Duck Call Spectrogram

3/3/20 Sound of Music 6 97 San Francisco Exploratorium Exhibit: Vowels Ah Ee Eh

Oh Oo

3/3/20 Sound of Music 6 98 Vowels with Male and

Female Female Voices

Male

3/3/20 Sound of Music 6 99