Music-enhanced experience: Perception, learning, memorys

Psych. Lydia Schneider

Thomas Hans Fritz

fritz@.mpg.de IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences „Music Evoked Brain Plasticity Group“, MPI

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences

Readiness to engage in music throughout the life span

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences

Hepper PG (1988) Fetal soap addiction, Lancet

- Response to the theme tune of the program “Neighbours” was studied -! 4-5 days after birth -! Response in infants with mothers who watched it daily during pregnancy (N=7) was compared with infants whose mothers had not watched it (N=8) -! Greater alertness of “soap opera” babies to theme song (stopped crying, adopted quiet alert state)

Partanen et al. (2013) Prenatal music exposure induces long term neural effects, PlosOne

-! During last trimester of pregnancy, exposure to ‘Twinkle twinkle little star’ 5 times per week -! After birth and at the age of 4 months these infants and control group (no prenatal stimulation) were presented a modified melody in which some of the notes were changed -! EEG showed differences in ERPs when listening to familiar notes

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Influence of music before birth

Investigation of an influence of pregnancy on musical appreciation and blood pressure response

Participants:

-! Pregnant: 15 women between an age of 21 and 33 (mean age 27), Week of pregnancy 8-34

-! Non-pregnant: 17 women between an age of 19-28 (mean age 27), contraceptive (20 - 35 g ethinyl estradiol + progestin)

Fritz et al., Psychophysiology, 2014 [email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Influence of music before birth

Investigation of an influence of pregnancy on musical appreciation and blood pressure response

Stimuli:

Instrumental music (consonant) and dissonantly manipulated counterparts (Fritz et al., 2009; Koelsch et al., 2006, Sammler et al., 2007, Fritz et al., 2013a, Fritz et al., 2013b)

consonant consonant reversed dissonant dissonant reversed

Fritz et al., Psychophysiology, 2014 [email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Influence of music before birth

Results:

-! In pregnant women same pattern but stronger blood pressure response

-! Blood pressure responses independent of pleasantness/unpleasantness of the music

-! Stronger physiological response of mother might increase prenatal conditioning to music

Fritz et al., Psychophysiology, 2014 [email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences

Readiness to engage in music throughout the life span

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences

Professional instrumentalists as compared to nonmusicians and amateurs show a number of adaptations (e.g. enhancement of gray matter density in cortical sensory-motor regions, auditory regions, the left dorsolateral prefrontal cortex, the cerebellum, corpus callosum; Gaser and Schlaug, 2003).

Interestingly, these plastic adaptations depend on critical periods:

Musicians, who start early, before the age of seven display less observable structural adaptations of the brain, while they seem to have an “early optimized network” which allows for a superior performance of motor tasks without enlarged anatomical structures (Steele et al., 2013; Vaquero et al., 2014).

Later starters, after age seven, do show the above mentioned structural adaptations (e.g., Bangert and Schlaug, 2006; Gärtner et al., 2013).

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Job offer: PhD position (3 years):

Investigation of music-feedback environments for infants using EEG and/or fNIRS

Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, and Musikkindergarten Berlin in coop. with Berlin School of Mind and Brain

Research project with 1 and 2 year old infants.

Cognitive benefit (language, attention, social) of musical feedback in early age, investigating combining physical activity with music making. This work relates to recent research on cognitive benefits of the music feedback technology Jymmin.

Applicants must hold a master’s degree (or equivalent) in Psychology, Cognitive Science, Neuroscience, Linguistics, or a related field, and have a profound background in statistics and experimental procedures with infants.

Call closes on September 15th, 2017

Earliest starting date will be October 1st, 2017. Interviews will be held in September.

Applications should be sent to [email protected] as a single, appropriately named pdf email attachment, using the code “PhD KITA 10/17”

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences

Readiness to engage in music throughout the life span

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Blame it on the bossanova, transfer from music to touch

„Human“ touch

!"#$%&'$&()*+&!""#$%#&+&,-."/()&-0&123'"#4'/$()&56789-)-:7;&<'/'"()*&& Blame it on the bossanova, transfer from music to touch

Robot touch

!"#$%&'$&()*+&!""#$%#&+&,-."/()&-0&123'"#4'/$()&56789-)-:7;&<'/'"()*&& Sensual touch is key to mating behavior and relates to procreation

Transfer effects from music to touch -> evolutionary significance?

!"#$%&'$&()*+&!""#$%#&+&,-."/()&-0&123'"#4'/$()&56789-)-:7;&<'/'"()*&& Improved second language learning

•! Increased effectivity at learning hungarian when associating sentences with sung melodies (Ludtke et al., 2013):

•! English participants listened to short hungarian sentences, one test group repeated the text verbally •! One test group sang the text •! A third group spoke the sentences rhythmically

•! Singers performed approx. twice as good, could more correctly pronounce the sentences and memorize them for a longer duration.

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Koelsch et al., Nature Neurosci, 2004 [email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Music supported vocabulary learning Procedure N = 26 (17 females)

First learning period (6 min)

40 word pairs Randomized stimulus order (20 congruent vs. 20 incongruent musical pieces)

Second learning period (6 min)

Repetition of stimulus sets from first period Randomized stimulus order

Test period

Forced-Choice Recognition Test (No musical context)

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Perpis Farewell

Farewell

Leubar Tangan

Perpis Santin

Deirom Pargil

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Music supported vocabulary learning

MEAN ERRORS DURING FORCED CHOICE RECOGNITION TEST

A&

@& %"!$ MD = 1.4

?& p = .02

!"#$

>& !! = .20

=& congruentB-/:".'/$& incongruent#/B-/:".'/$& [email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences

Readiness to engage in music throughout the life span

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Investigation of the dopaminergic system with music

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Video

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences PD patients experience a greater temporal de-freezing and otherwise relief of their symptoms during music listening than with visual or tactile stimulation (Lim et al., 2005).

The beneficial effect of music has been shown as a positive influence on gait kinematics (Brown, de Bruin, Doan, Suchowersky, & Hu, 2009; de Bruin et al., 2010; Thaut et al., 1996), but it has remained unclear whether this is due to only rhythm, or also positive emotional response.

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Musical pleasantness modulates dopamine specific gait parameters in Parkinson’s disease

N = 18 (9 female, age range 57 to 75)

Mean valence ratings of the three musical versions by Parkinson’s disease patients

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Musical pleasantness modulates dopamine specific gait parameters in Parkinson’s disease

N = 18 (9 female, age range 57 to 75)

The effect of valence on spatial and kinematic gait parameters in Parkinson’s disease patients

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences

Readiness to engage in music throughout the life span

Alzheimer‘s disease

•! Memory for long known music sustains until a late stage

•! Stimulation with music during therapy. Can mediate, memories associated to music. Sometimes able to sing although talking hardly possible.

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Memory for music in Alzheimer’s disease

•! Experiment 1: 32 healthy participants (16 male, mean age: 28)

•! Functional ultra high field – MRI, 7T

•! Multivariate pattern classification to identify brain regions that code memory for long known music

•! Selection of long known music excerpts from top 10 of the German Media- Control chartlists from 1977-2007, from kids songs, oldies and widely known classical music pieces

Jacobsen, Stelzer, Fritz et al., Brain, 2015

[email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Memory for music in Alzheimer’s disease

Comparison with brain maps of Alzheimer‘s disease biomarkers

The identified brain region coding memory for long-known music

less grey matter atrophy

less hypometabolism

comparable amount of beta-Amyloid burden

Jacobsen, Stelzer, Fritz et al., Brain, 2015 [email protected] IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences • ***mafa flöten

Dr. Thomas Fritz IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Dr. Thomas Fritz IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Dr. Thomas Fritz IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Dr. Thomas Fritz IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Dr. Thomas Fritz IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Mafa flute music

Fritz et al., Current Biology, 2009, Fritz, Music Perception, 2013, Fritz et al., PlosOne, 2013, Thompson, W, Sun, Y, Fritz, T. Foundations in Music Psychology: Theory and Research, in press

Dr. Thomas Fritz IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Fritz et al., Current Biology, 2009

Dr. Thomas Fritz IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Universal recognition of three basic emotions in music music the emotional Intended expression in

happy sad scary/fearful

Mafa listeners Western listeners

Fritz et al., Current Biology, 2009 Investigation of musical valence experience when listening to Western music and its manipulated counterparts Stimulus material

Western music: (1) consonant (2) consonant backward (3) dissonant (4) dissonant backward

Mafa music: (1) consonant (2) consonant backward (3) dissonant (4) dissonant backward

Aufgabetask

- Valence rating immediately after each stimulus presentation (mobile solar facility)

- Rating simultaneously over interface + verbal

Dr. Thomas Fritz IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Universal preference for consonant over continually dissonant music, and for forward over backward music Results

Fritz et al., Current Biology, 2009 Dr. Thomas Fritz IPEM – University of Gent, Max Planck Institute for Human Cognitive and Brain Sciences Video

“RUNNERS HIGH” IN 10 MINUTES

!Enhanced mood after 10 minutes of Jymmin

Information on study: ! N = 52 (27 males) ! Participants: non-athletes, non-musicians ! Multidimensional Mood Questionnaire ! Significance: p < .05

Fritz et al., Frontiers in Psychology, 2013

jammin in the gym REDUCED PERCEIVED EXERTION

!Less exertion !More relaxed muscles !Combines positive effects of isometric and isotonic contraction

Information on study ! N = 63 (42 men) ! Participants: non-athletes, non-musicians ! 6 minute exercise, rhythms and beats at 130 bpm Significance sense of effort: p < 0.001

Fritz et al., PNAS, 2013

jammin in the gym REDUCED ACUTE PAIN

&'($)*+,(-./$012$ endorphin release H& ! =C& p = .028; !" = .299 =D&

=E&

C@&

C>&

CC&

CD& JymminF744#/& 3(66#G'&)#6$'/#/:&

Fritz et al., in revision

jammin in the gym REDUCED EXERTION THROUGH CREATIVITY

)!" main effect exertion: * (!" p = .01; !" = .34 <" <" '!" Information on study: <" ! N = 28 (14 males) &!" ! Participants:'"#!(& non-athletes, non-musicians:01;/./01"#" ',#"!& '+#"'& '(#)*& +"#,$& ++#'$& :01;/./01"$" %!" +$#%)& +%#)"& +$#*%& !"#$%& !'#%%& !$#!+& agency, no beat :01;/./01"%" $!" agency, beat

#!" creativity, beat

!" *+,-./01" 23,456-," 205/./7/.8" 91.,-,5." Fritz et al., in prep.

jammin in the gym PATIENT STUDIES

jammin in the gym

CHRONIC PAIN

Description of a patient with chronic pain:

- 56 years old woman - got divorced recently and moved to another city - started to feel first acute neck and back pain; after several month the pain intensifies - went to several doctors and underwent various medical !! Focus on pain treatments !! Fear of movement - advised by medical staff to be !! Reduced activity level, careful which movements are “good incl. social interactions or bad” ! Depressed mood - after months to years!, without successful treatment she is advised by the doctor to consult a psychotherapist

jammin in the gym

CHRONIC PAIN Anxiety Loop of Pain (vicious cycle)

! How to regain an activity level that corresponds to a higher quality of life?

jammin in the gym CHRONIC PAIN !Decreased anxiety - 17 patients with chronic pain - Anxiety levels were measured before and after each condition of the experiment

* * Main effect of conditions p = .010

Post-hoc comparison baseline vs. Jymmin: p = .008

Post-hoc comparison training vs. Jymmin: p = .012

Fritz et al., in prep.

jammin in the gym DRUG ABUSE REHABILITATION

Prison sentence Polydrug-users (min two main drugs) N = 27

22% 37% no no No 63% yes yes 78%

ADHD comorbidity

52% 48% no yes

jammin in the gym DRUG ABUSE REHABILITATION

N=27 !Increase of self-confidence

Fritz et al., in prep. self-confidence

jammin in the gym DRUG ABUSE REHABILITATION

!Benefits of listening to a recording of euphoric joint music making

N = 22

Fritz et al., Frontiers in Human Neuroscience, 2015 jammin in the gym DRUG ABUSE REHABILITATION

!Benefits of listening to a recording of euphoric joint music making

Fritz et al., Frontiers in Human Neuroscience, 2015 jammin in the gym

! POSITIVITY BIAS

N = 26 5-point Likert-scale, p = .012, r = .49

Fritz et al., Frontiers in Neuroscience, 2016 jammin in the gym POSITIVITY BIAS

N = 26 N = 23 5-point Likert-scale, Visual Analogue Scale, p = .012, r = .49 p = .006, r = .41

Fritz et al., Frontiers in Neuroscience, 2016 jammin in the gym POSITIVITY BIAS

Musical style irrelevant for therapeutic success

N = 26 N = 23 5-point Likert-scale, Visual Analogue Scale, p = .012, r = .49 p = .006, r = .41

Fritz et al., Frontiers in Neuroscience, 2016 jammin in the gym STROKE REHABILITATION

jammin in the gym Jymmin with Alzheimer’s patients – ongoing study

jammin in the gym Jymmin with minimal consciousness patients – ongoing study

jammin in the gym jammin in the gym

jammin in the gym