Project Melt
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Expression Control in Singing Voice Synthesis
Expression Control in Singing Voice Synthesis Features, approaches, n the context of singing voice synthesis, expression control manipu- [ lates a set of voice features related to a particular emotion, style, or evaluation, and challenges singer. Also known as performance modeling, it has been ] approached from different perspectives and for different purposes, and different projects have shown a wide extent of applicability. The Iaim of this article is to provide an overview of approaches to expression control in singing voice synthesis. We introduce some musical applica- tions that use singing voice synthesis techniques to justify the need for Martí Umbert, Jordi Bonada, [ an accurate control of expression. Then, expression is defined and Masataka Goto, Tomoyasu Nakano, related to speech and instrument performance modeling. Next, we pres- ent the commonly studied set of voice parameters that can change and Johan Sundberg] Digital Object Identifier 10.1109/MSP.2015.2424572 Date of publication: 13 October 2015 IMAGE LICENSED BY INGRAM PUBLISHING 1053-5888/15©2015IEEE IEEE SIGNAL PROCESSING MAGAZINE [55] noVEMBER 2015 voices that are difficult to produce naturally (e.g., castrati). [TABLE 1] RESEARCH PROJECTS USING SINGING VOICE SYNTHESIS TECHNOLOGIES. More examples can be found with pedagogical purposes or as tools to identify perceptually relevant voice properties [3]. Project WEBSITE These applications of the so-called music information CANTOR HTTP://WWW.VIRSYN.DE research field may have a great impact on the way we inter- CANTOR DIGITALIS HTTPS://CANTORDIGITALIS.LIMSI.FR/ act with music [4]. Examples of research projects using sing- CHANTER HTTPS://CHANTER.LIMSI.FR ing voice synthesis technologies are listed in Table 1. -
Design and Implementation of Text to Speech Conversion for Visually Impaired People
View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Covenant University Repository International Journal of Applied Information Systems (IJAIS) – ISSN : 2249-0868 Foundation of Computer Science FCS, New York, USA Volume 7– No. 2, April 2014 – www.ijais.org Design and Implementation of Text To Speech Conversion for Visually Impaired People Itunuoluwa Isewon* Jelili Oyelade Olufunke Oladipupo Department of Computer and Department of Computer and Department of Computer and Information Sciences Information Sciences Information Sciences Covenant University Covenant University Covenant University PMB 1023, Ota, Nigeria PMB 1023, Ota, Nigeria PMB 1023, Ota, Nigeria * Corresponding Author ABSTRACT A Text-to-speech synthesizer is an application that converts text into spoken word, by analyzing and processing the text using Natural Language Processing (NLP) and then using Digital Signal Processing (DSP) technology to convert this processed text into synthesized speech representation of the text. Here, we developed a useful text-to-speech synthesizer in the form of a simple application that converts inputted text into synthesized speech and reads out to the user which can then be saved as an mp3.file. The development of a text to Figure 1: A simple but general functional diagram of a speech synthesizer will be of great help to people with visual TTS system. [2] impairment and make making through large volume of text easier. 2. OVERVIEW OF SPEECH SYNTHESIS Speech synthesis can be described as artificial production of Keywords human speech [3]. A computer system used for this purpose is Text-to-speech synthesis, Natural Language Processing, called a speech synthesizer, and can be implemented in Digital Signal Processing software or hardware. -
Attuning Speech-Enabled Interfaces to User and Context for Inclusive Design: Technology, Methodology and Practice
CORE Metadata, citation and similar papers at core.ac.uk Provided by Springer - Publisher Connector Univ Access Inf Soc (2009) 8:109–122 DOI 10.1007/s10209-008-0136-x LONG PAPER Attuning speech-enabled interfaces to user and context for inclusive design: technology, methodology and practice Mark A. Neerincx Æ Anita H. M. Cremers Æ Judith M. Kessens Æ David A. van Leeuwen Æ Khiet P. Truong Published online: 7 August 2008 Ó The Author(s) 2008 Abstract This paper presents a methodology to apply 1 Introduction speech technology for compensating sensory, motor, cog- nitive and affective usage difficulties. It distinguishes (1) Speech technology seems to provide new opportunities to an analysis of accessibility and technological issues for the improve the accessibility of electronic services and soft- identification of context-dependent user needs and corre- ware applications, by offering compensation for limitations sponding opportunities to include speech in multimodal of specific user groups. These limitations can be quite user interfaces, and (2) an iterative generate-and-test pro- diverse and originate from specific sensory, physical or cess to refine the interface prototype and its design cognitive disabilities—such as difficulties to see icons, to rationale. Best practices show that such inclusion of speech control a mouse or to read text. Such limitations have both technology, although still imperfect in itself, can enhance functional and emotional aspects that should be addressed both the functional and affective information and com- in the design of user interfaces (cf. [49]). Speech technol- munication technology-experiences of specific user groups, ogy can be an ‘enabler’ for understanding both the content such as persons with reading difficulties, hearing-impaired, and ‘tone’ in user expressions, and for producing the right intellectually disabled, children and older adults. -
Voks: Digital Instruments for Chironomic Control of Voice Samples Grégoire Locqueville, Christophe D’Alessandro, Samuel Delalez, Boris Doval, Xiao Xiao
Voks: Digital instruments for chironomic control of voice samples Grégoire Locqueville, Christophe d’Alessandro, Samuel Delalez, Boris Doval, Xiao Xiao To cite this version: Grégoire Locqueville, Christophe d’Alessandro, Samuel Delalez, Boris Doval, Xiao Xiao. Voks: Digital instruments for chironomic control of voice samples. Speech Communication, Elsevier : North-Holland, 2020, 125, pp.97 - 113. 10.1016/j.specom.2020.10.002. hal-03009712 HAL Id: hal-03009712 https://hal.archives-ouvertes.fr/hal-03009712 Submitted on 2 Dec 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Voks: digital instruments for chironomic control of voice samples Gregoire´ Locquevillea, Christophe d’Alessandroa, Samuel Delalezb, Boris Dovala, Xiao Xiaoa aInstitut Jean le Rond d’Alembert, Sorbonne Universit´e,CNRS, UMR 7190, 4 place Jussieu, 75015, Paris, France bLunii,18 rue Dubrunfaut, 75012 Paris, France Abstract This paper presents Voks, a new family of digital instruments that allow for real-time control and modifica- tion of pre-recorded voice signal samples. An instrument based on Voks is made of Voks itself, the synthe- sis software and a given set of chironomic (hand-driven) interfaces. Rhythm can be accurately controlled thanks to a new methodology, based on syllabic control points. -
Robust Structured Voice Extraction for Flexible Expressive Resynthesis
ROBUST STRUCTURED VOICE EXTRACTION FOR FLEXIBLE EXPRESSIVE RESYNTHESIS A DISSERTATION SUBMITTED TO THE DEPARTMENT OF ELECTRICAL ENGINEERING AND THE COMMITTEE ON GRADUATE STUDIES OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY Pamornpol Jinachitra June 2007 c Copyright by Pamornpol Jinachitra 2007 All Rights Reserved ii I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Julius O. Smith, III Principal Adviser I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Robert M. Gray I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Jonathan S. Abel Approved for the University Committee on Graduate Studies. iii iv Abstract Parametric representation of audio allows for a reduction in the amount of data needed to represent the sound. If chosen carefully, these parameters can capture the expressiveness of the sound, while reflecting the production mechanism of the sound source, and thus allow for an intuitive control in order to modify the original sound in a desirable way. In order to achieve the desired parametric encoding, algorithms which can robustly identify the model parameters even from noisy recordings are needed. As a result, not only do we get an expressive and flexible coding system, we can also obtain a model-based speech enhancement that reconstructs the speech embedded in noise cleanly and free of musical noise usually associated with the filter-based approach. -
D10.1: State of the Art of Accessibility Tools Revision: 1.0 As of 28Th February 2011
DELIVERABLE Project Acronym: EuDML Grant Agreement number: 250503 Project Title: The European Digital Mathematics Library D10.1: State of the Art of Accessibility Tools Revision: 1.0 as of 28th February 2011 Authors: Volker Sorge University of Birmingham Mark Lee University of Birmingham Petr Sojka Masaryk University Alan P. Sexton University of Birmingham Contributors: Martin Jarmar Masaryk University Project co-funded by the European Comission within the ICT Policy Support Programme Dissemination Level P Public X C Confidential, only for members of the consortium and the Commission Services Revision History Revision Date Author Organisation Description 0.1 15th October 2010 Volker Sorge UB Just a content outline. 0.2 28th January 2011 Volker Sorge UB Section 2 completed. 0.3 4th February 2011 Petr Sojka MU MU experience part added. 0.4 13th Feburary 2011 Volker Sorge UB Sections 3,4,5 completed. 0.5 14th February 2011 VS+PS UB+MU Development version. 0.6 14th February 2011 Alan P. Sexton UB Typo corrections and pol- ishing 0.7 19th February 2011 Mark Lee UB Addition of conclusions on language translation 1.0 28th Feburary 2011 Volker Sorge UB Made changes suggested by reviewer and final edit- ing. Statement of originality: This deliverable contains original unpublished work except where clearly indicated otherwise. Acknowledgement of previously published material and of the work of others has been made through appropriate citation, quotation or both. Abstract The purpose of this report is to present a state of the art in accessibility tools that can be used to provide access to mathematical literature to visually impaired users as well as print impaired users (i.e., people with specific learning disabilities like dyslexia) as well as an overview of current automated translation technology. -
Singing Voice Resynthesis Using Concatenative-Based Techniques
Singing Voice Resynthesis using Concatenative-based Techniques Nuno Miguel da Costa Santos Fonseca Faculty of Engineering, University of Porto Department of Informatics Engineering December 2011 FACULDADE DE ENGENHARIA DA UNIVERSIDADE DO PORTO Departamento de Engenharia Informáica Singing Voice Resynthesis using Concatenative-based Techniques Nuno Miguel da Costa Santos Fonseca Dissertação submetida para satisfação parcial dos requisitos do grau de doutor em Engenharia Informática Dissertação realizada sob a orientação do Professor Doutor Aníbal João de Sousa Ferreira do Departamento de Engenharia Electrotécnica e de Computadores da Faculdade de Engenharia da Universidade do Porto e da Professora Doutora Ana Paula Cunha da Rocha do Departamento de Engenharia Informática da Faculdade de Engenharia da Universidade do Porto Porto, Dezembro de 2011 Singing Voice Resynthesis using Concatenative-based Techniques ii This dissertation had the kind support of FCT (Portuguese Foundation for Science and Technology, an agency of the Portuguese Ministry for Science, Technology and Higher Education) under grant SFRH / BD / 30300 / 2006, and has been articulated with research project PTDC/SAU- BEB/104995/2008 (Assistive Real-Time Technology in Singing) whose objectives include the development of interactive technologies helping the teaching and learning of singing. Copyright © 2011 by Nuno Miguel C. S. Fonseca All rights reserved. No parts of the material protected by this copyright notice may be reproduced or utilized in any form or by any means, electronic -
Speech Synthesis
Contents 1 Introduction 3 1.1 Quality of a Speech Synthesizer 3 1.2 The TTS System 3 2 History 4 2.1 Electronic Devices 4 3 Synthesizer Technologies 6 3.1 Waveform/Spectral Coding 6 3.2 Concatenative Synthesis 6 3.2.1 Unit Selection Synthesis 6 3.2.2 Diaphone Synthesis 7 3.2.3 Domain-Specific Synthesis 7 3.3 Formant Synthesis 8 3.4 Articulatory Synthesis 9 3.5 HMM-Based Synthesis 10 3.6 Sine Wave Synthesis 10 4 Challenges 11 4.1 Text Normalization Challenges 11 4.1.1 Homographs 11 4.1.2 Numbers and Abbreviations 11 4.2 Text-to-Phoneme Challenges 11 4.3 Evaluation Challenges 12 5 Speech Synthesis in Operating Systems 13 5.1 Atari 13 5.2 Apple 13 5.3 AmigaOS 13 5.4 Microsoft Windows 13 6 Speech Synthesis Markup Languages 15 7 Applications 16 7.1 Contact Centers 16 7.2 Assistive Technologies 16 1 © Specialty Answering Service. All rights reserved. 7.3 Gaming and Entertainment 16 8 References 17 2 © Specialty Answering Service. All rights reserved. 1 Introduction The word ‘Synthesis’ is defined by the Webster’s Dictionary as ‘the putting together of parts or elements so as to form a whole’. Speech synthesis generally refers to the artificial generation of human voice – either in the form of speech or in other forms such as a song. The computer system used for speech synthesis is known as a speech synthesizer. There are several types of speech synthesizers (both hardware based and software based) with different underlying technologies. -
Singing Synthesis Framework from Neutral Speech: Proof of Concept Marc Freixes* , Francesc Alías and Joan Claudi Socoró
Freixes et al. EURASIP Journal on Audio, Speech, and Music Processing (2019) 2019:22 https://doi.org/10.1186/s13636-019-0163-y RESEARCH Open Access A unit selection text-to-speech-and- singing synthesis framework from neutral speech: proof of concept Marc Freixes* , Francesc Alías and Joan Claudi Socoró Abstract Text-to-speech (TTS) synthesis systems have been widely used in general-purpose applications based on the generation of speech. Nonetheless, there are some domains, such as storytelling or voice output aid devices, which may also require singing. To enable a corpus-based TTS system to sing, a supplementary singing database should be recorded. This solution, however, might be too costly for eventual singing needs, or even unfeasible if the original speaker is unavailable or unable to sing properly. This work introduces a unit selection-based text-to-speech-and-singing (US-TTS&S) synthesis framework, which integrates speech-to-singing (STS) conversion to enable the generation of both speech and singing from an input text and a score, respectively, using the same neutral speech corpus. The viability of the proposal is evaluated considering three vocal ranges and two tempos on a proof-of-concept implementation using a 2.6-h Spanish neutral speech corpus. The experiments show that challenging STS transformation factors are required to sing beyond the corpus vocal range and/or with notes longer than 150 ms. While score-driven US configurations allow the reduction of pitch-scale factors, time-scale factors are not reduced due to the short length of the spoken vowels. Moreover, in the MUSHRA test, text-driven and score-driven US configurations obtain similar naturalness rates of around 40 for all the analysed scenarios. -
Speech Synthesis
6. Text-to-Speech Synthesis (Most Of these slides come from Dan Juray’s course at Stanford) History of Speech Synthesis • In 1779, the Danish scientist Christian Kratzenstein builds models of the human vocal tract that can produce the five long vowel sounds. • In 1791 Wolfgang von Kempelen (the creator of the Turk chess playing game) devises the bellows(fuelle, mancha)-operated “automatic- mechanical speech machine”. It added models of the tongue and lips that allowed it to produce voewls and consonants. • In 1837 Charles Wheatstone produces a "speaking machine" based on von Kempelen's design. • In the 1930s, Bell Labs developed the VOCODER, a keyboard- operated electronic speech analyzer and synthesizer that was said to be clearly intelligible. It was later refined into the VODER, which was exhibited at the 1939 New York World's Fair. Tractament Digital de la Parla 2 Von Kempelen: • Small whistles controlled consonants • Rubber mouth and nose; nose had to be covered with two fingers for non-nasals • Unvoiced sounds: mouth covered, auxiliary bellows driven by string provides puff of air From Traunmüller’s web site Von Kempelen’s speaking machine Bell labs VOCODER machine Homer Dudley 1939 VODER • Synthesizing speech by electrical means • 1939 World’s Fair Homer Dudley’s VODER • Manually controlled through complex keyboard • Operator training was a problem One of the first “talking” computers Closer to a natural vocal tract: Riesz 1937 The UK Speaking Clock • July 24, 1936 • Photographic storage on 4 glass disks • 2 disks for minutes, 1 for hour, one for seconds. • Other words in sentence distributed across 4 disks, so all 4 used at once. -
Production of Greek Singing Voice, the Result Is Clearly Acceptable, but Not Satisfactory Enough to Be 3.1
Proceedings of the Inter. Computer Music Conference (ICMC07), Copenhagen, Denmark, 27-31 August 2007 A SCORE-TO-SINGING VOICE SYNTHESIS SYSTEM FOR THE GREEK LANGUAGE Varvara Kyritsi Anastasia Georgaki Georgios Kouroupetroglou University of Athens, University of Athens, University of Athens, Department of Informatics and Department of Music Studies, Department of Informatics and Telecommunications, Athens, Greece Telecommunications, Athens, Greece [email protected] Athens, Greece [email protected] [email protected] ABSTRACT [15], [11]. Consequently, a SVS system must include control tools for various parameters, as phone duration, In this paper, we examine the possibility of generating vibrato, pitch, volume etc. Greek singing voice with the MBROLA synthesizer, by making use of an already existing diphone database. Our Since 1980, various projects have been carried out all goal is to implement a score-to-singing synthesis system, over the world, through different optical views, languages where the score is written in a score editor and saved in and methodologies, focusing on the mystery of the the midi format. However, MBROLA accepts phonetic synthetic singing voice [10], [11], [13], [14], [17], [18], files as input rather than midi ones and because of this, and [19]. The different optical views extend from the we construct a midi-file to phonetic-file converter, which development of a proper technique for the naturalness of applies irrespective of the underlying language. the sound quality to the design of the rules that determine the adjunction of phonemes or diphones into phrases and The evaluation of the Greek singing voice synthesis their expression. Special studies on the emotion of the system is achieved through a psycho acoustic experiment. -
Using Speech Synthesis to Create Stimuli for Speech Perception Research
Using speech synthesis to create stimuli for speech perception research Prof. Simon King V N I E R The Centre for Speech Technology Research U S University of Edinburgh, UK E I T H www.cstr.ed.ac.uk Y T O H INSPIRE 2013, Sheffield F G E R D I N B U 1 © Copyright Simon King, University of Edinburgh. For personal use only. Re-use or distribution not permitted. Contents • Part I : Motivation • why synthesis might be a useful tool • Part II : Core techniques • formant synthesis • articulatory synthesis • physical modelling • vocoding • concatenation of diphones • concatenation of units from a large inventory • statistical parametric speech synthesis (HMMs) • Part III : The state of the art • controllable HMM synthesis with articulatory and formant controls 2 © Copyright Simon King, University of Edinburgh. For personal use only. Re-use or distribution not permitted. Part I Motivation 3 © Copyright Simon King, University of Edinburgh. For personal use only. Re-use or distribution not permitted. Goal: investigate speech perception • How? • form a hypothesis • design experiment • design the stimuli design is limited by methods available • create the stimuli for creation • play stimuli to listeners • obtain responses • analyse responses • support / refute hypothesis 4 © Copyright Simon King, University of Edinburgh. For personal use only. Re-use or distribution not permitted. Designing stimuli • Usually speech or speech-like sounds • Natural speech • elicited from one or more speakers • Manipulated natural speech • filtered - e.g., delexicalised • edited - e.g., modify temporal structure, remove acoustic cues, splice, ... • Synthetic speech • several methods available • which should we choose? • Other synthetic sounds - e.g, sine wave speech 5 © Copyright Simon King, University of Edinburgh.