Indications of Workload Induced Stress in Human Voice

Total Page:16

File Type:pdf, Size:1020Kb

Indications of Workload Induced Stress in Human Voice EUROPEAN ORGANISATION FOR THE SAFETY OF AIR NAVIGATION EUROCONTROL EUROCONTROL EXPERIMENTAL CENTRE EVALUATION OF THE HUMAN VOICE FOR INDICATIONS OF WORKLOAD INDUCED STRESS IN THE AVIATION ENVIRONMENT EEC Note No. 18/06 INO-1 AC STSS Project Published: December 2006 The information in this document is the property of the EUROCONTROL Agency. It may not be reproduced, even in part, in any form whatsoever without the prior agreement of the Agency. This report does not necessarily reflect the ideas or official policy of the Agency. REPORT DOCUMENTATION PAGE Reference: Security Classification: EEC Note No. 18/06 Unclassified Originator: Originator (Corporate Author) Name/Location: EEC - INO EUROCONTROL Experimental Centre (INOvative Research Area) Centre de Bois des Bordes B.P.15 F - 91222 Brétigny-sur-Orge CEDEX FRANCE Telephone: +33 (0)1 69 88 75 00 Sponsor: Sponsor (Contract Authority) Name/Location: EUROCONTROL Experimental Centre EUROCONTROL Experimental Centre Centre de Bois des Bordes B.P.15 F - 91222 Brétigny-sur-Orge CEDEX FRANCE Telephone: +33 (0)1 69 88 75 00 WEB Site: www.eurocontrol.int TITLE: Evaluation of the Human Voice for Indications of Workload Induced Stress in the Aviation Environment Authors Date Pages Figures Tables Annex References M. Hagmueller, 08/2005 81; +VI 17 7 4 100 E.Rank, G. Kubin (Graz University of Technology) Project Task No. Period INO-1 AC STSS Sponsor 2005 Distribution Statement: (a) Controlled by: Vu DUONG Head of INO (b) Special Limitations: None Descriptors (keywords): Stress, workload, air traffic control, speech analysis, voice analysis, contact free, non-intrusive Abstract: This report gives a literature review of stress analysis from the human voice. While a special focus is on workload-induced stress and the special treatment of the avionic environment, a general overview of the analysis of speech under stress using a broader definition of stress is given as well. We discuss definitions of stress and workload and point out the relation between stress and human speech. We provide a summary of useful speech databases for workload induced stress analysis. A discussion on speech signal features commonly used for stress analysis is the main part of this report. Research in the effect of workload-induced stress on speech signals has become a riveting issue recently, while it is still at an early stage. Current problems are the multitude of influence factors and the speaker dependence of the effects of stress on the speech signal. As speech has the advantage of being a medium naturally used in the air traffic control environment it seems to be worthwhile to further explore this approach on a long-term basis. NOTE: The methods discussed in this report are largely based on public available research literature. The ownership of the related intellectual property rights has not been determined in this literature study and should be sought directly from the authors of the publications cited in the ’references’ sections. PAGE INTENTIONALLY LEFT BLANK Evaluation of the Human Voice for Indications of Workload Induced Stress EUROCONTROL Preface Air Traffic Control (ATC) operators on duty have a large responsibility for the life of passengers and crews in the aircraft. High vigilance and performance are continually required. Human’s features vary in time, with health situation and by external events. A scientific principle developed by the psychologists R.M. Yerkes and J.D. Dodson in 1908, known as the Yerkes-Dodson law demonstrates an empirical relation between arousal and performance. Thereafter human performance increases with cognitive arousal until a certain point. After this point further increasing arousal results in a decreasing performance. In the ATC (Air Traffic Control) task good performance can be seen as the absence of unsafe actions caused by the human. Therewith the human part of the global ATC safety becomes proportional to the performance of the ATC operator. So, for an optimal safety of the human ATC task, an operator ideally needs moderate workload. Therefore it is common ATC practice to modulate the size of a control sector during the day, depending of the traffic load. With low traffic two or more sectors may be collapsed into one control unit with one controller, while with increasing traffic this unit is split again into the smaller sectors again, with one controller each. The aim is to hold the workload for the controller continuously at a moderate level to favour due to Yerkes-Dodson’s law ATC safety. Currently a supervisor of the control room decides on the so-called re-sectorisation. His/her decision is subjective. It is based on own experience, own assessment of a moderate workload and administrative constraints. Especially the assessment of a moderate workload for an individual is very difficult as it varies strongly by environmental stimuli and state of health. A real-time tool to evaluate objectively human stress indicators under a given workload, to keep the human at the optimal performance, could help to increase ATC safety. In the medical sense workload can be seen as an external stimuli, which cause physiological stress reactions of the human body. Stress modifies the levels of specific hormones, which in turn alter heart rate, respiration, blood pressure and transpiration. So, measuring these primary or secondary stress reactions could give objective information how this individual sense this workload. This could be an objective base for supervisor’s re-sectoring decisions. Off-line and under laboratory conditions such measurements have been undertaken, but they are not adapted to field studies nor to real working conditions. Hypothetically the human voice could be used as carrier to retrieve most of human secondary stress reactions without any physical contact to the subject. Human vocal folds are directly in touch with respiration and heart activity via the blood. Consequently the voice should be slightly modified thereof and could be used as indicator of human’s stress reaction. Based on recorded ATC speech samples we tried to investigate this hypothesis. In 1998 the EUROCONTROL Experimental Centre (EEC) initiated the ‘Study into the Detection of Stress in Air Traffic Control Speech’. The study was executed by the ‘Speech Research’ group of the British ‘Defence Evaluation Research Agency (DERA) in Malvern. The study was limited to detect higher stress and doesn’t show a strong correlation. Projet INO-1 AC STSS III EUROCONTROL Evaluation of the Human Voice for Indications of Workload Induced Stress Meanwhile speech research progressed and so we revisited the issue in form of a literature study. This note reports on the study ‘Stress and Speech – State of the Art Report 2005’ of the ‘Signal and Speech Processing Laboratory’ of the Graz University of Technology. The documented research results can be seen as promising. But the study shows as well, that especially the detection of decreasing performance under low workload conditions is requiring further basic research. Other visual analysis methods, of eyes and face, are proposed. Horst Hering Innovative Research Unit IV Projet INO-1 AC STSS Evaluation of the Human Voice for Indications of Workload Induced Stress EUROCONTROL TABLE OF CONTENTS 1. Introduction . 1 1.1. Overview . 1 1.2. Air Traffic Control Environment . 1 1.3. Types of Measurement . 3 2. Definitions Concerning Speech and Stress . 4 2.1. Definition of Stress in Relation to Stress . 5 2.2. Model of Speech Production under Stress . 6 2.3. Taxonomy of Stressors . 9 2.4. Emotional Speech . 10 3. Databases with Speech under Stress . 11 3.1. ATC Apprenticeship Database . 11 3.2. SUSC-0 Database . 11 3.3. SUSAS Database . 12 3.4. DCIEM Map Task Corpus . 12 3.5. DERA Numberplate Database . 12 4. Stress Observation in Human Speech . 14 4.1. Human Stress Classification . 14 4.2. Features for Stress Analysis . 15 4.3. Workload . 20 4.4. Work Underload, Boredom, Fatigue, and Sleep Deprivation . 23 4.5. Voice and Heartbeat . 24 5. Speech Processing with Speech under Stress . 25 5.1. Automatic Speech Recognition for Speech under Stress . 25 5.2. Stressed Speech Synthesis . 25 5.3. Stressed Speaker Identification and Verification . 26 6. Summary & Conclusion . 27 6.1. Databases . 27 6.2. Classification of Speech under Workload Induced Stress . 27 6.3. Relation to Research on Emotional Speech . 27 6.4. Discussion and Recommendations . 27 References . 29 Appendix . 37 A. Stress Analysis using Non-Speech Methods . 37 A.1. Visual Analysis . 37 A.2. Cardiovascular Activity . 38 A.3. Brain Activity . 39 A.4. Others . 39 B. Acronyms . 40 C. Overview of Speech Databases . 41 D. Extended Literature References . 42 Projet INO-1 AC STSS V EUROCONTROL Evaluation of the Human Voice for Indications of Workload Induced Stress PAGE INTENTIONALLY LEFT BLANK VI Projet INO-1 AC STSS Evaluation of the Human Voice for Indications of Workload Induced Stress 1. Introduction Stress is the physiological and psychological answer of a human body to a specific workload. Stress influences human organ functions. Measuring these indications of stress is possible under laboratory conditions. Field studies under normal working conditions are not practical and some measures cannot be obtained in real-time. In the avionic domain, optimal safety is directly related to the correct level of workload for the human operator. Underload and overload increase the human error rate. This optimal workload level is different for every human being and may vary with the daily condition. Knowledge about workload induced stress of the human operators could help to keep them at a desirable level of workload for optimal safety. 1.1. Overview This study focuses on stress analysis from the human voice and presents a literature review of recent investigations on this topic. We start in this chapter with a short introduction of the air traffic control environment. In chapter 2 some relevant background knowledge on stress and speech signals is given.
Recommended publications
  • The Physical Significance of Acoustic Parameters and Its Clinical
    www.nature.com/scientificreports OPEN The physical signifcance of acoustic parameters and its clinical signifcance of dysarthria in Parkinson’s disease Shu Yang1,2,6, Fengbo Wang3,6, Liqiong Yang4,6, Fan Xu2,6, Man Luo5, Xiaqing Chen5, Xixi Feng2* & Xianwei Zou5* Dysarthria is universal in Parkinson’s disease (PD) during disease progression; however, the quality of vocalization changes is often ignored. Furthermore, the role of changes in the acoustic parameters of phonation in PD patients remains unclear. We recruited 35 PD patients and 26 healthy controls to perform single, double, and multiple syllable tests. A logistic regression was performed to diferentiate between protective and risk factors among the acoustic parameters. The results indicated that the mean f0, max f0, min f0, jitter, duration of speech and median intensity of speaking for the PD patients were signifcantly diferent from those of the healthy controls. These results reveal some promising indicators of dysarthric symptoms consisting of acoustic parameters, and they strengthen our understanding about the signifcance of changes in phonation by PD patients, which may accelerate the discovery of novel PD biomarkers. Abbreviations PD Parkinson’s disease HKD Hypokinetic dysarthria VHI-30 Voice Handicap Index H&Y Hoehn–Yahr scale UPDRS III Unifed Parkinson’s Disease Rating Scale Motor Score Parkinson’s disease (PD), a chronic, progressive neurodegenerative disorder with an unknown etiology, is asso- ciated with a signifcant burden with regards to cost and use of societal resources 1,2. More than 90% of patients with PD sufer from hypokinetic dysarthria3. Early in 1969, Darley et al. defned dysarthria as a collective term for related speech disorders.
    [Show full text]
  • Separation of Vocal and Non-Vocal Components from Audio Clip Using Correlated Repeated Mask (CRM)
    University of New Orleans ScholarWorks@UNO University of New Orleans Theses and Dissertations Dissertations and Theses Summer 8-9-2017 Separation of Vocal and Non-Vocal Components from Audio Clip Using Correlated Repeated Mask (CRM) Mohan Kumar Kanuri [email protected] Follow this and additional works at: https://scholarworks.uno.edu/td Part of the Signal Processing Commons Recommended Citation Kanuri, Mohan Kumar, "Separation of Vocal and Non-Vocal Components from Audio Clip Using Correlated Repeated Mask (CRM)" (2017). University of New Orleans Theses and Dissertations. 2381. https://scholarworks.uno.edu/td/2381 This Thesis is protected by copyright and/or related rights. It has been brought to you by ScholarWorks@UNO with permission from the rights-holder(s). You are free to use this Thesis in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights- holder(s) directly, unless additional rights are indicated by a Creative Commons license in the record and/or on the work itself. This Thesis has been accepted for inclusion in University of New Orleans Theses and Dissertations by an authorized administrator of ScholarWorks@UNO. For more information, please contact [email protected]. Separation of Vocal and Non-Vocal Components from Audio Clip Using Correlated Repeated Mask (CRM) A Thesis Submitted to the Graduate Faculty of the University of New Orleans in partial fulfillment of the requirements for the degree of Master of Science in Engineering – Electrical By Mohan Kumar Kanuri B.Tech., Jawaharlal Nehru Technological University, 2014 August 2017 This thesis is dedicated to my parents, Mr.
    [Show full text]
  • The Fingerprints of Pain in Human Voice
    1 The Open University of Israel Department of Mathematics and Computer Science The Fingerprints of Pain in Human Voice Thesis submitted in partial fulfillment of the requirements towards an M.Sc. degree in Computer Science The Open University of Israel Computer Science Division By Yaniv Oshrat Prepared under the supervision of Dr. Anat Lerner, Dr. Azaria Cohen, Dr. Mireille Avigal The Open University of Israel July 2014 2 Contents Abstract .......................................................................................................................... 5 1. Introduction ...................................................................................................................... 6 1.1. Related work .......................................................................................................... 6 1.2. The scope and goals of our study .......................................................................... 8 2. Methods ........................................................................................................................... 10 2.1. Participants .......................................................................................................... 10 2.2. Data Collection .................................................................................................... 10 2.3. Sample processing ............................................................................................... 11 2.4. Pain-level analysis ..............................................................................................
    [Show full text]
  • Telmate Biometric Solutions
    TRANSFORMING INMATE COMMUNICATIONS TELMATE BIOMETRIC SOLUTIONS Telmate’s advanced and comprehensive image Telmate’s and voice biometric solutions verify the identity image and voice biometric of every contact, measuring and analyzing unique solutions physical and behavioral characteristics. increase facility security, prevent Image Biometrics: Do You Really Know Who is Visiting? fraudulent calling, Security is a concern with every inmate interaction. When inmates conduct video visits, it is essential to ensure that the inmate that booked the visit is the one that and thwart the conducts the visit, from start to finish. extortion of calling funds. With Telmate, every video visit is comprehensively analyzed for rule violations, including communications from unauthorized inmates. The Telmate system actively analyzes every video visit, comparing every face with a known and verified photo of the approved participants. When a mismatch is identified, the Telmate system instantly compares the unrecognized facial image with other verified inmate photos housed in the same location in an attempt to identify the unauthorized inmate participant. Next, Telmate timestamps any identified violation in the video and flags the live video visit for immediate review by facility investigators, along with a shortcut link that allows staff to quickly jump to and INMATES review the suspicious section of video and see the potential identity of the perpetrator. Telmate has the most comprehensive, and only 100% accurate, unapproved video visit participant detection system in the industry today. Telmate biometric solutions result REVIEW REVIEW in a unique methodology that: TELMATE COMMAND IDENTIFY & FLAG TELMATE • Prevents repeat occurrences of all unapproved inmate video visit BIOMETRICS extortion, or using visitation funds as a participants.
    [Show full text]
  • A Study on Application of Digital Signal Processing in Voice Disorder Diagnosis 1N
    Volume 6, Issue 3, March 2016 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com A Study on Application of Digital Signal Processing in Voice Disorder Diagnosis 1N. A. Sheela Selvakumari*, 2Dr. V. Radha 1 Asst. Prof., Department of Computer Science, PSGR Krishnammal College for Women, Coimbatore, Tamilnadu, India 2 Professor, Department of Computer Science, Avinashiligam Institute for Home Science and Higher Education for Women, Coimbatore, Tamilnadu, India Abstract — The Investigation of the human voice has become an important area of study for its numerous applications in medical as well as industrial disciplines. People suffering from pathologic voices have to face many difficulties in their daily lives. The voice pathologic disorders are associated with respiratory, nasal, neural and larynx diseases. Thus, analysis and diagnosis of vocal disorders have become an important medical procedure. This has inspired a great deal of research in voice analysis measure for developing models to evaluate human verbal communication capabilities. Voice analysis mainly deals with extraction of some parameters from voice signals, which is used to process the voice in appropriate for the particular application by using suitable techniques. The use of these techniques combined with classification methods provides the development of expert aided systems for the detection of voice pathologies. This Study paper states the certain common medical conditions which affect voice patterns of patients and the tests which are used as diagnosis for voice disorder. Keywords— Digital Signal Processing, Voice Disorder, Pattern Classification, Pathological Voices I. INTRODUCTION Digital signal processing (DSP) is the numerical manipulation of signals, usually with the intention to Measure, Filter, Produce or Compress continuous Analog Signals.
    [Show full text]
  • Running Head: ACOUSTIC PARAMETERS of SPEECH 1 Acoustic Parameters of Speech and Attitudes Towards Speech in Childhood Stuttering
    Running Head: ACOUSTIC PARAMETERS OF SPEECH 1 Acoustic Parameters of Speech and Attitudes Towards Speech in Childhood Stuttering: Predicting Persistence and Recovery Rachel Gerald Vanderbilt University This project was completed in partial fulfillment of Honors at Vanderbilt University under the direction of Tedra Walden. ACOUSTIC PARAMETERS OF SPEECH 2 Abstract The relations between the acoustic parameters of jitter and fundamental frequency and children’s experience with stuttering were explored. Sixty-five children belonging to four talker groups will be studied. Children were categorized as stuttering (CWS) or non-stuttering (CWNS), and were grouped based on their diagnosis of stuttering/not stuttering at two time points in a longitudinal study: persistent stutterers (CWSàCWS), recovered stutterers (CWSàCWNS), borderline stutters (CWNSàCWS), and never stuttered (CWNSàCWNS). The children performed a social-communicative stress task during which they were audio-recorded to provide speech samples from which the acoustic parameters were measured. There were no significant relations between talker group and acoustic parameters, nor were children’s attitudes towards their speech different across talker groups. Therefore, acoustic parameters nor children’s attitudes towards their speech did not determining their prognosis with stuttering. ACOUSTIC PARAMETERS OF SPEECH 3 Stuttering is a type of speech disfluency in which words or phrases are repeated or sounds are prolonged. Yairi (1993) reported that stuttering affects about 1% of adults worldwide. The onset of stuttering typically begins in preschool children, with about 5% of children stuttering at some point in their lives. About three-fourths of these children recover, whereas the remaining children become the 1% of adults who stutter.
    [Show full text]
  • Fast, Accurate Pitch Detection Tools for Music Analysis
    Fast, Accurate Pitch Detection Tools for Music Analysis Philip McLeod a thesis submitted for the degree of Doctor of Philosophy at the University of Otago, Dunedin, New Zealand. 30 May 2008 Abstract Precise pitch is important to musicians. We created algorithms for real-time pitch detection that generalise well over a range of single ‘voiced’ musical instruments. A high pitch detection accuracy is achieved whilst maintain- ing a fast response using a special normalisation of the autocorrelation (SNAC) function and its windowed version, WSNAC. Incremental versions of these functions provide pitch values updated at every input sample. A robust octave detection is achieved through a modified cepstrum, utilising properties of human pitch perception and putting the pitch of the current frame within the context of its full note duration. The algorithms have been tested thoroughly both with synthetic waveforms and sounds from real instruments. A method for detecting note changes using only pitch is also presented. Furthermore, we describe a real-time method to determine vibrato param- eters - higher level information of pitch variations, including the envelopes of vibrato speed, height, phase and centre offset. Some novel ways of visu- alising the pitch and vibrato information are presented. Our project ‘Tartini’ provides music students, teachers, performers and researchers with new visual tools to help them learn their art, refine their technique and advance their fields. ii Acknowledgements I would like to thank the following people: Geoff Wyvill for creating an environment for knowledge to thrive. • Don Warrington for your advice and encouragement. • Professional musicians Kevin Lefohn (violin) and Judy Bellingham • (voice) for numerous discussions and providing us with samples of good sound.
    [Show full text]
  • On the Use of Voice Signals for Studying Sclerosis Disease
    computers Article On the Use of Voice Signals for Studying Sclerosis Disease Patrizia Vizza 1,*, Giuseppe Tradigo 2, Domenico Mirarchi 1,* ID , Roberto Bruno Bossio 3 and Pierangelo Veltri 1,* ID 1 Department of Medical and Surgical Sciences, Magna Graecia University, 88100 Catanzaro, Italy 2 Department of Computer Engineering, Modelling, Electronics and Systems (DIMES), University of Calabria, 87036 Rende, Italy; [email protected] 3 Neurological Operative Unit, Center of Multiple Sclerosis, Provincial Health Authority of Cosenza, 87100 Cosenza, Italy; [email protected] * Correspondence: [email protected] (P.V.); [email protected] (D.M.); [email protected] (P.V.) Received: 16 October 2017; Accepted: 23 November 2017; Published: 28 November 2017 Abstract: Multiple sclerosis (MS) is a chronic demyelinating autoimmune disease affecting the central nervous system. One of its manifestations concerns impaired speech, also known as dysarthria. In many cases, a proper speech evaluation can play an important role in the diagnosis of MS. The identification of abnormal voice patterns can provide valid support for a physician in the diagnosing and monitoring of this neurological disease. In this paper, we present a method for vocal signal analysis in patients affected by MS. The goal is to identify the dysarthria in MS patients to perform an early diagnosis of the disease and to monitor its progress. The proposed method provides the acquisition and analysis of vocal signals, aiming to perform feature extraction and to identify relevant patterns useful to impaired speech associated with MS. This method integrates two well-known methodologies, acoustic analysis and vowel metric methodology, to better define pathological compared to healthy voices.
    [Show full text]
  • Dysphonia in Adults with Developmental Stuttering: a Descriptive Study
    South African Journal of Communication Disorders ISSN: (Online) 2225-4765, (Print) 0379-8046 Page 1 of 7 Original Research Dysphonia in adults with developmental stuttering: A descriptive study Authors: Background: Persons with stuttering (PWS) often present with other co-occurring conditions. 1 Anél Botha The World Health Organization’s (WHO) International Classification of Functioning, Disability Elizbé Ras1 Shabnam Abdoola1 and Health (ICF) proposes that it is important to understand the full burden of a health Jeannie van der Linde1 condition. A few studies have explored voice problems among PWS, and the characteristics of voices of PWS are relatively unknown. The importance of conducting future research has been Affiliations: emphasised. 1Department of Speech- Language Pathology and Objectives: This study aimed to describe the vocal characteristics of PWS. Audiology, University of Pretoria, South Africa Method: Acoustic and perceptual data were collected during a comprehensive voice assessment. The severity of stuttering was also determined. Correlations between the stuttering Corresponding author: Shabnam Abdoola, severity instrument (SSI) and the acoustic measurements were evaluated to determine the [email protected] significance. Twenty participants were tested for this study. Dates: Result: Only two participants (10%) obtained a positive Dysphonia Severity Index (DSI) score Received: 10 Nov. 2016 of 1.6 or higher, indicating that no dysphonia was present, while 90% of participants (n = 18) Accepted: 20 Mar. 2017 scored lower than 1.6, indicating that those participants presented with dysphonia. Some Published: 26 June 2017 participants presented with weakness (asthenia) of voice (35%), while 65% presented with a How to cite this article: slightly strained voice quality.
    [Show full text]
  • Machine-Learning Analysis of Voice Samples Recorded Through Smartphones: the Combined Effect of Ageing and Gender
    sensors Article Machine-Learning Analysis of Voice Samples Recorded through Smartphones: The Combined Effect of Ageing and Gender 1, 2, 2 1 Francesco Asci y , Giovanni Costantini y, Pietro Di Leo , Alessandro Zampogna , Giovanni Ruoppolo 3, Alfredo Berardelli 1,4, Giovanni Saggio 2 and Antonio Suppa 1,4,* 1 Department of Human Neurosciences, Sapienza University of Rome, 00185 Rome, Italy; [email protected] (F.A.); [email protected] (A.Z.); [email protected] (A.B.) 2 Department of Electronic Engineering, University of Rome Tor Vergata, 00133 Rome, Italy; [email protected] (G.C.).; [email protected] (P.D.L.); [email protected] (G.S.) 3 Department of Sense Organs, Otorhinolaryngology Section, Sapienza University of Rome, 00185 Rome, Italy; [email protected] 4 IRCCS Neuromed, 86077 Pozzilli (IS), Italy * Correspondence: [email protected]; Tel.: +39-06-49914544 These authors have equally contributed to the manuscript. y Received: 20 July 2020; Accepted: 2 September 2020; Published: 4 September 2020 Abstract: Background: Experimental studies using qualitative or quantitative analysis have demonstrated that the human voice progressively worsens with ageing. These studies, however, have mostly focused on specific voice features without examining their dynamic interaction. To examine the complexity of age-related changes in voice, more advanced techniques based on machine learning have been recently applied to voice recordings but only in a laboratory setting. We here recorded voice samples in a large sample of healthy subjects. To improve the ecological value of our analysis, we collected voice samples directly at home using smartphones. Methods: 138 younger adults (65 males and 73 females, age range: 15–30) and 123 older adults (47 males and 76 females, age range: 40–85) produced a sustained emission of a vowel and a sentence.
    [Show full text]
  • Spectral Processing of the Singing Voice
    SPECTRAL PROCESSING OF THE SINGING VOICE A DISSERTATION SUBMITTED TO THE DEPARTMENT OF INFORMATION AND COMMUNICATION TECHNOLOGIES FROM THE POMPEU FABRA UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR PER LA UNIVERSITAT POMPEU FABRA Alex Loscos 2007 i © Copyright by Alex Loscos 2007 All Rights Reserved ii THESIS DIRECTION Dr. Xavier Serra Department of Information and Communication Technologies Universitat Pompeu Fabra, Barcelona ______________________________________________________________________________________ This research was performed at the Music Technology Group of the Universitat Pompeu Fabra in Barcelona. Primary support was provided by YAMAHA corporation and the EU project FP6-IST-507913 SemanticHIFI http://shf.ircam.fr/ iii Dipòsit legal: B.42903-2007 ISBN: 978-84-691-1201-4 Abstract This dissertation is centered on the digital processing of the singing voice, more concretely on the analysis, transformation and synthesis of this type of voice in the spectral domain, with special emphasis on those techniques relevant for music applications. The digital signal processing of the singing voice became a research topic itself since the middle of last century, when first synthetic singing performances were generated taking advantage of the research that was being carried out in the speech processing field. Even though both topics overlap in some areas, they present significant differentiations because of (a) the special characteristics of the sound source they deal and (b) because of the applications that can be built around them. More concretely, while speech research concentrates mainly on recognition and synthesis; singing voice research, probably due to the consolidation of a forceful music industry, focuses on experimentation and transformation; developing countless tools that along years have assisted and inspired most popular singers, musicians and producers.
    [Show full text]
  • Voice Stress Analysis Technology
    The author(s) shown below used Federal funds provided by the U.S. Department of Justice and prepared the following final report: Document Title: Investigation and Evaluation of Voice Stress Analysis Technology Author(s): Darren Haddad, Sharon Walter, Roy Ratley, Megan Smith Document No.: 193832 Date Received: March 20, 2002 Award Number: 98-LB-VX-A013 This report has not been published by the U.S. Department of Justice. To provide better customer service, NCJRS has made this Federally- funded grant final report available electronically in addition to traditional paper copies. Opinions or points of view expressed are those of the author(s) and do not necessarily reflect the official position or policies of the U.S. Department of Justice. Investigation and Evaluation of Voice Stress Analysis Technology Final Report February 13,2002 Darren Haddad Roy Ratley Sharon Walter Megan Smith AFRUIFEC ACS Defense Rome Research Site Rome, NY This project is supported under Interagency Agreement 98-LB-R-013 from the Office of Justice Programs, National Institute of Justice, Department of Justice. Points of view in this document are those of the author(s) and do not necessarily represent the official position of the U.S. Department of Justice. Points of view or opinions stated in this report are those of the authors and do not necessarily represent the official positions or policies of the United States Department of Justice. Table of Contents 1.0 EXECUTIVE SUMMARY ......................................................... 1 2.0EFFORTOBJECTIVE ............................................................ 1 3.0INTRODUCTION ................................................................ 1 4.0HISTORYOFVSATECHNOLOGY ................................................. 2 5.0 AVAILABLE VSA SYSTEMS ...................................................... 5 5.1 PSYCHOLOGICAL STRESS EVALUATOR (PSE) ..........................................
    [Show full text]