A KINEMATIC ANALYSIS OF PROSODIC STRUCTURE IN SPEECH AND MANUAL GESTURES Jelena Krivokapic,1, 2 Mark K. Tiede, 2 Martha E. Tyrone 2,3 1University of Michigan, 2Haskins Laboratories, 3Long Island University Brooklyn
[email protected],
[email protected],
[email protected] ABSTRACT and body gesturing is not well understood, however. The first goal of this study is to address some basic Two experiments examining the effects of prosodic questions regarding this relationship. We present structure on the kinematic properties of speech and two experiments. Experiment 1 examines the effect manual gestures are presented. Experiment 1 of prosodic boundaries, stress, and their interaction investigated the effects of prosodic boundaries, on oral, intonation and manual gestures. Experiment stress and their interaction on manual, oral, and 2 examines the effects of varying degrees of intonation gestures (their duration and coordination). prominence (deaccented, narrow focus, broad focus, Experiment 2 investigated the effects of different contrastive focus) on these gestures. Working within types of prominence (deaccented, narrow focus, the framework of Articulatory Phonology ([3 ff.]), broad focus, contrastive focus) on oral constriction, these two experiments allow us to examine 1) the intonation and manual gestures (duration and effect of prosodic structure (boundaries and coordination). We recorded speech audio, vocal tract prominence) on the duration of vocal tract gestures gestures (using electromagnetic articulometry) and and manual gesturing (specifically pointing gestures) manual movements (using motion capture). To the and 2) the coordination of oral gestures, manual best of our knowledge, this is the first study to gestures and intonation gestures, and how prosodic examine kinematic properties of body movement structure affects this coordination.