Feasibility Study on a Text-To-Speech Synthesizer for Embedded Systems

Total Page:16

File Type:pdf, Size:1020Kb

Feasibility Study on a Text-To-Speech Synthesizer for Embedded Systems 2006:113 CIV MASTER'S THESIS Feasibility Study on a Text-To-Speech Synthesizer for Embedded Systems Linnea Hammarstedt Luleå University of Technology MSc Programmes in Engineering Electrical Engineering Department of Computer Science and Electrical Engineering Division of Signal Processing 2006:113 CIV - ISSN: 1402-1617 - ISRN: LTU-EX--06/113--SE Preface This is a master degree project commissioned by and performed at Teleca Systems GmbH in N¨urnberg at the department of Speech Technology. Teleca is an IT services company focused on developing and integrating advanced software and information technology so- lutions. Today Teleca possesses a speak recognition system including a grapheme-to-phoneme module, i.e., an algorithm converting text into phonetic notation. Their future objective is to develop a Text-To-Speech system including this module. The purpose of this work from Teleca’s point of view is to investigate a possible solution of converting phonetic notation into speech suitable for an embedded implementation platform. I would like to thank Dr. Andreas Kiessling at Teleca for his support and patient discussions during this work, and Dr. Stefan Dobler, the head of department, for giving me the possibility to experience this interesting field of speech technology. Finally, I wish to thank all the other personnel of the department for their consistently practical support. i Abstract A system converting textual information into speech is usually denoted as a TTS (Text-To- Speech) system. The design of this system varies depending on its purpose and platform requirements. In this thesis a TTS synthesizer designed for an embedded system operat- ing on an arbitrary vocabulary has been evaluated and partially implemented in Matlab, constituting a base for further development. The focus of this thesis is on the speech gen- eration part, which involves the conversion from phonetic notation into synthetic speech. The chosen TTS system is the so called Time Domain-PSOLA, which convincingly suits the implementation and platform requirements. It concatenates segments of recorded speech and changes its prosodic characteristics with the Pitch Synchronous Overlap and Add (PSOLA) technique. The segment size is from the mid point of one phone to the mid point of the next, referred to as a diphone. The quality of the generated synthesized speech is rather satisfying for the test sen- tences applied. Some disturbances still occur as a consequence of mismatches, such as different spectral properties of the segments and pitch detection errors, but with further developing a reduction of these can be performed. iii Contents 1 Introduction 1 1.1 IntroductiontoTTSSystems . 1 1.2 Linguistic Analysis Module . ... 2 1.3 SpeechGenerationModule. 3 1.3.1 Rule-BasedSynthesis. .. .. 3 1.3.2 Concatenative-Based Synthesis . .. 4 1.4 ProjectFocus .................................. 4 2 Theory 7 2.1 SegmentDataPreparation . 7 2.1.1 Segment Format and Speech Corpus Selection . ... 7 2.1.2 PreparationProcess .......................... 8 2.1.3 SegmentRepresentation . 9 2.2 SpeechSynthesis ................................ 10 2.2.1 SynthesizingProcess . 10 2.2.2 ProsodicInformation . 12 2.3 PSOLAMethod................................. 13 2.3.1 PSOLAOperationProcess. 13 2.3.2 ModificationofProsody . 15 2.3.3 TD-PSOLA as Speech Synthesizer . 16 2.4 ExtensionofTD-PSOLAintoMBR-PSOLA . 16 2.4.1 Re-synthesisProcess . 17 2.4.2 SpectralEnvelopeInterpolation . ... 18 2.4.3 Multi-BandExcitationModel . 19 2.4.4 Benefits with the respective PSOLA Methods . .. 21 2.5 UtilizedDatafromExternalTTSProjects . ..... 21 2.5.1 FestivalandFestVox . 21 2.5.2 MBROLA................................ 22 3 Implementation 25 3.1 SegmentDataPreparation . 25 3.1.1 Segment Information Modification . .. 25 3.1.2 PitchMarksModification . 27 3.1.3 SpeechCorpusModification . 27 3.1.4 AdditiveModifications . 27 3.2 SpeechSynthesis ................................ 27 v vi CONTENTS 3.2.1 InputFormat .............................. 28 3.2.2 SegmentListGenerator . 28 3.2.3 ProsodyModification. 31 3.2.4 SegmentConcatenation . 32 4 Evaluation 33 4.1 Analysis of the Segment Database and Input Data . ...... 34 4.1.1 PitchMarks............................... 34 4.1.2 SpectralMismatch ........................... 35 4.1.3 Fundamental Frequencies . 35 4.2 SolutionAnalysis ................................ 36 4.2.1 Window Choice for the ST-signal Extraction . .... 36 4.2.2 FrequencyModification. 37 4.2.3 DurationModification . 39 4.2.4 WordBorderInformation . 40 5 Discussion 41 5.1 Conclusions ................................... 41 5.1.1 ComparisonofTD-andMBR-PSOLA . 42 5.2 FurtherWork .................................. 42 5.2.1 ProceedingsforTeleca . 42 5.2.2 Possible Quality Improvements . 43 A SAMPA Notation for British English 47 B MRPA - SAMPA Lexicon for British English 51 C Licence for CSTR’s British Diphone Database 53 List of abbreviations IPA International Phonetic Alphabet MBE Multi-Band Exciter MBR-PSOLA Multi-Band Re-synthesis PSOLA MBROLA short for MBR-PSOLA MOS Mean Opinion Score MRPA Machine Readable Phonetic Alphabet OLA Overlap and Add PSOLA Pitch-Synchronous Overlap and Add SAMPA Speech Assessment Methods Phonetic Alphabet TD-PSOLA Time Domain PSOLA TTS Text-To-Speech V/UV Voiced/Un-Voiced vii Chapter 1 Introduction The possibility of producing synthesized speech from plain textual information, so called Text-To-Speech (TTS) systems, has today aroused an extensive interest in many technical areas. Different methods with varying quality and properties exist, and the development is still continuing. The purpose of this thesis is to define and evaluate a TTS synthesizer suitable for embedded systems. It is performed at Teleca Systems GmbH in N¨urnberg and its focus is established by the requirements of the company. Today, Teleca holds a module able to transform text into phonetic notation, which is originally developed for another speech purpose. This module is assumed able to be used also in a TTS system, and the starting point for this project is hence phonetic notation. The developed system is restricted to British English, but the theoretical descriptions are, though, valid for an arbitrary language. Since the starting level is at phonetic notation, it is not really correct to consider the investigated system as a Text-To-Speech system. However, for simplicity, and since the process of going from phonetic notation to speech is a major part of a TTS system, the term TTS is though used in this thesis describing the evaluated overall process. In this study a TD-PSOLA (Time Domain-Pitch Synchronous Overlap and Add) [Dut97] synthesizer is investigated and implemented in Matlab. The result is evaluated and suggestions of further work will be given for an accomplishment of the system. A possible extension of this method with the Multi-Band Excitation (MBE) [GL88] model is theoretically presented together with information about its benefits and disadvantages. The following sections briefly describe the main principals of a general TTS system as well as some existing classifications and groupings. The ambition of the latter description is to show what choices have been made and to give some explanation why. 1.1 Introduction to TTS Systems A TTS synthesizer is a computer based system that takes a text string as input and converts it into synthetic speech waveforms. The methods and equipment needed for this process varies depending on physical restrictions according to the implementation platform and development costs. Two main hardware restrictions are storage properties, such as its capacity and memory type, and the clock rate of the processor. 1 2 CHAPTER 1. INTRODUCTION The synthesis process can for all methods be divided into the two main modules pre- sented in Figure 1.1. The first step transcribes the input text into a linguistic format, which is usually expressed as phonetic notations (phones) together with additional infor- mation about its prosody. The term prosody refers to properties of each phone such as duration and pitch. The outputs are then used in the second block for construction of the final synthesis speech waves. Text Linguistic Phonemes & Speech Speech Analysis Prosody Info Generation Figure 1.1: Division of a general TTS system into two main modules. 1.2 Linguistic Analysis Module In almost all languages the textual presentation of a word does not directly correspond to its pronunciation. The position of letters within a word and the words appearance within the sentence affect the pronunciation considerably, as well as additive characters such as punctuation marks and the content of the sentence do. An alternative symbolic representation is therefore needed to comprise the hidden information. Usually a lan- guage can be described by 20 to 60 different phonetic characters [Lem99], when excluding the information about its melody. To also be able to describe the pitch characteristics additional prosodic information is needed. Converting text into linguistic representation requires a large set of different rules and exceptions depending on language. This process can be described through three main parts [Dut97]: 1. Text analysis 2. Automatic phonetization 3. Prosody generation The first part functions as a pre-processing phase. It identifies special characters and notations, such as numbers and abbreviations, and converts them into full text when needed. Several words can have different pronunciations depending on their meaning, and hence a contextual analysis is performed for categorization of the words.
Recommended publications
  • UN SYNTHÉTISEUR DE LA VOIX CHANTÉE BASÉ SUR MBROLA POUR LE MANDARIN Liu Ning
    UN SYNTHÉTISEUR DE LA VOIX CHANTÉE BASÉ SUR MBROLA POUR LE MANDARIN Liu Ning To cite this version: Liu Ning. UN SYNTHÉTISEUR DE LA VOIX CHANTÉE BASÉ SUR MBROLA POUR LE MAN- DARIN. Journées d’Informatique Musicale, 2012, Mons, France. hal-03041805 HAL Id: hal-03041805 https://hal.archives-ouvertes.fr/hal-03041805 Submitted on 5 Dec 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Actes des Journées d’Informatique Musicale (JIM 2012), Mons, Belgique, 9-11 mai 2012 UN SYNTHÉTISEUR DE LA VOIX CHANTÉE BASÉ SUR MBROLA POUR LE MANDARIN Liu Ning CICM (Centre de recherche en Informatique et Création Musicale) Université Paris VIII, MSH Paris Nord [email protected] RESUME fonction de la mélodie et des paroles à partir d’un fichier MIDI [7]. Dans cet article, nous présentons le projet de développement d’un synthétiseur de la voix chantée basé Néanmoins, les synthèses de la voix chantée pour la sur MBROLA en mandarin pour la langue chinoise. langue chinoise ont encore des limites techniques. Par Notre objectif vise à développer un synthétiseur qui exemple, le système à partir de la lecture de fichier MIDI puisse fonctionner en temps réel, qui soit capable de se est un système en temps différé.
    [Show full text]
  • Espeak : Speech Synthesis
    Software Requirements Specification for ESpeak : Speech Synthesis Version 1.48.15 Prepared by Dimitrios Koufounakis January 10, 2018 Copyright © 2002 by Karl E. Wiegers. Permission is granted to use, modify, and distribute this document. Software Requirements Specification for <Project> Page ii Table of Contents Table of Contents .......................................................................................................................... ii Revision History ............................................................................................................................ ii 1. Introduction ..............................................................................................................................1 1.1 Purpose ............................................................................................................................................. 1 1.2 Document Conventions .................................................................................................................... 1 1.3 Intended Audience and Reading Suggestions................................................................................... 1 1.4 Project Scope .................................................................................................................................... 1 1.5 References......................................................................................................................................... 1 2. Overall Description ..................................................................................................................2
    [Show full text]
  • Fully Generated Scripted Dialogue for Embodied Agents
    Fully Generated Scripted Dialogue for Embodied Agents Kees van Deemter 1, Brigitte Krenn 2, Paul Piwek 3, Martin Klesen 4, Marc Schröder 5, and Stefan Baumann 6 Abstract : This paper presents the NECA approach to the generation of dialogues between Embodied Conversational Agents (ECAs). This approach consist of the automated constructtion of an abstract script for an entire dialogue (cast in terms of dialogue acts), which is incrementally enhanced by a series of modules and finally ”performed” by means of text, speech and body language, by a cast of ECAs. The approach makes it possible to automatically produce a large variety of highly expressive dialogues, some of whose essential properties are under the control of a user. The paper discusses the advantages and disadvantages of NECA’s approach to Fully Generated Scripted Dialogue (FGSD), and explains the main techniques used in the two demonstrators that were built. The paper can be read as a survey of issues and techniques in the construction of ECAs, focussing on the generation of behaviour (i.e., focussing on information presentation) rather than on interpretation. Keywords : Embodied Conversational Agents, Fully Generated Scripted Dialogue, Multimodal Interfaces, Emotion modelling, Affective Reasoning, Natural Language Generation, Speech Synthesis, Body Language. 1. Introduction A number of scientific disciplines have started, in the last decade or so, to join forces to build Embodied Conversational Agents (ECAs): software agents with a human-like synthetic voice and 1 University of Aberdeen, Scotland, UK (Corresponding author, email [email protected]) 2 Austrian Research Center for Artificial Intelligence (OEFAI), University of Vienna, Austria 3 Centre for Research in Computing, The Open University, UK 4 German Research Center for Artificial Intelligence (DFKI), Saarbruecken, Germany 5 German Research Center for Artificial Intelligence (DFKI), Saarbruecken, Germany 6 University of Koeln, Germany.
    [Show full text]
  • Design and Implementation of Text to Speech Conversion for Visually Impaired People
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Covenant University Repository International Journal of Applied Information Systems (IJAIS) – ISSN : 2249-0868 Foundation of Computer Science FCS, New York, USA Volume 7– No. 2, April 2014 – www.ijais.org Design and Implementation of Text To Speech Conversion for Visually Impaired People Itunuoluwa Isewon* Jelili Oyelade Olufunke Oladipupo Department of Computer and Department of Computer and Department of Computer and Information Sciences Information Sciences Information Sciences Covenant University Covenant University Covenant University PMB 1023, Ota, Nigeria PMB 1023, Ota, Nigeria PMB 1023, Ota, Nigeria * Corresponding Author ABSTRACT A Text-to-speech synthesizer is an application that converts text into spoken word, by analyzing and processing the text using Natural Language Processing (NLP) and then using Digital Signal Processing (DSP) technology to convert this processed text into synthesized speech representation of the text. Here, we developed a useful text-to-speech synthesizer in the form of a simple application that converts inputted text into synthesized speech and reads out to the user which can then be saved as an mp3.file. The development of a text to Figure 1: A simple but general functional diagram of a speech synthesizer will be of great help to people with visual TTS system. [2] impairment and make making through large volume of text easier. 2. OVERVIEW OF SPEECH SYNTHESIS Speech synthesis can be described as artificial production of Keywords human speech [3]. A computer system used for this purpose is Text-to-speech synthesis, Natural Language Processing, called a speech synthesizer, and can be implemented in Digital Signal Processing software or hardware.
    [Show full text]
  • Assisting the Speech Impaired People Using Text-To-Speech Synthesis 1Ledisi G
    International Journal of Emerging Engineering Research and Technology Volume 3, Issue 8, August, 2015, PP 214-224 ISSN 2349-4395 (Print) & ISSN 2349-4409 (Online) Assisting the Speech Impaired People Using Text-to-Speech Synthesis 1Ledisi G. Kabari 2Ledum F. Atu 1,2Department of Computer Science, Rivers State Polytechnic, Bori, Nigeria ABSTRACT Many people have some sort of disability which impairs their ability to communicate, thus with all their intelligence they are not able to participate in conferences or meeting proceedings and consequently inhibit in a way their contributions to development of the nation. Work in alternative and augmentative communication (AAC) devices attempts to address this need. This paper tries to design a system that can be used to read out an input to its user. The system was developed using Visual Basic6.0 for the user interface, and was interfaced with the Lemout & Hauspie True Voice Text-to-Speech Engine (American English) and Microsoft agent. The system will allow the users to input the text to be read out, and also allows the user to open text document of the Rich Text Formant (.rtf) and Text File format (.txt) that have been saved on disk, for reading. Keywords: Text-To-Speech (TTS), Digital Signal Processing (DSP), Natural Language Processing (NLP), Alterative and Augmentative Communication (AAC), Rich Text file Format (RTF), Text File Format (TFF). INTRODUCTION The era has come and it is now here, where the mind and reasoning of all are needed for the development of a nation. Thus people who have some sort of disability which impairs their ability to communicate cannot be left behind.
    [Show full text]
  • Multi-Lingual Screen Reader and Processing of Font-Data in Indian Languages Submitted by A
    MULTI-LINGUAL SCREEN READER AND PROCESSING OF FONT-DATA IN INDIAN LANGUAGES A THESIS submitted by A. ANAND AROKIA RAJ for the award of the degree of Master of Science (by Research) in Computer Science & Engineering LANGUAGE TECHNOLOGIES RESEARCH CENTER INTERNATIONAL INSTITUTE OF INFORMATION TECHNOLOGY HYDERABAD - 500 032, INDIA February 2008 Dedication I dedicate this work to my loving parents ANTONI MUTHU RAYAR and MUTHU MARY who are always behind my growth. i THESIS CERTIFICATE This is to certify that the thesis entitled Multi-Lingual Screen Reader and Processing of Font-Data in Indian Languages submitted by A. Anand Arokia Raj to the International Institute of Information Technology, Hyderabad for the award of the degree of Master of Science (by Research) in Computer Science & Engineering is a bonafide record of research work carried out by him under our supervision. The contents of this thesis, in full or in parts, have not been submitted to any other Institute or University for the award of any degree or diploma. Hyderabad - 500 032 (Mr. S. Kishore Prahallad) Date: ACKNOWLEDGMENTS I thank my adviser Mr.Kishore Prahallad for his guidance during my thesis work. Because of him now I am turned into not only a researcher but also a developer. I thank Prof.Rajeev Sangal and Dr.Vasudeva Varma for their valuable advices and inputs for improving the screen reading software. I am also thankful to my speech lab friends and other IIIT friends who helped me in many ways. They were with me when I needed a help and when I needed a relaxation.
    [Show full text]
  • A Unit Selection Text-To-Speech-And-Singing Synthesis Framework from Neutral Speech: Proof of Concept 39 II.1 Introduction
    Adding expressiveness to unit selection speech synthesis and to numerical voice production 90) - 02 - Marc Freixes Guerreiro http://hdl.handle.net/10803/672066 Generalitat 472 (28 de Catalunya núm. Rgtre. Fund. ADVERTIMENT. L'accés als continguts d'aquesta tesi doctoral i la seva utilització ha de respectar els drets de ió la persona autora. Pot ser utilitzada per a consulta o estudi personal, així com en activitats o materials d'investigació i docència en els termes establerts a l'art. 32 del Text Refós de la Llei de Propietat Intel·lectual undac F (RDL 1/1996). Per altres utilitzacions es requereix l'autorització prèvia i expressa de la persona autora. En qualsevol cas, en la utilització dels seus continguts caldrà indicar de forma clara el nom i cognoms de la persona autora i el títol de la tesi doctoral. No s'autoritza la seva reproducció o altres formes d'explotació efectuades amb finalitats de lucre ni la seva comunicació pública des d'un lloc aliè al servei TDX. Tampoc s'autoritza la presentació del seu contingut en una finestra o marc aliè a TDX (framing). Aquesta reserva de drets afecta tant als continguts de la tesi com als seus resums i índexs. Universitat Ramon Llull Universitat Ramon ADVERTENCIA. El acceso a los contenidos de esta tesis doctoral y su utilización debe respetar los derechos de la persona autora. Puede ser utilizada para consulta o estudio personal, así como en actividades o materiales de investigación y docencia en los términos establecidos en el art. 32 del Texto Refundido de la Ley de Propiedad Intelectual (RDL 1/1996).
    [Show full text]
  • Controlling Synthetic Voices Via Midi- Accordeon
    PHONODEON: CONTROLLING SYNTHETIC VOICES VIA MIDI- ACCORDEON Anastasia Georgaki Ioannis Zannos Nikolaos Valsmakis, Music Department, Audiovisual Arts Technological Institute of University of Athens, Department, Ionian Crete, Department of Music Athens, Greece University, acoustics and Technology, [email protected] Corfu, Greece Rethymnon, Greece [email protected] [email protected] ABSTRACT particularities of the vocal signal, or the refinement of established sound synthesis techniques. For example This paper presents research on controlling synthetic one of the techniques based on estimating the spectral voice via a MIDI accordion. As motivation for this envelope, while allowing the precise extraction of research served the goal of reviving "lost instruments", formants of high frequencies of female voices, poses that is of using existing traditional instruments “lost” to many difficulties at the level of analysis [X. Rodet, new music genres as interfaces to control new types of 1992]. On the other task of automatic generation of sound generation in novel and future genres of music. control parameters is further complicated by the non- We worked with a MIDI-accordion, because it linearity of the vocal signal [P.Cook, 1996]. provides expressive control similar to the human breath While research on the synthesis of the singing through the mechanism of the bellows. The control voice is well established and widely present in interface of the two hands is also suited for computer music and related fields, the aspect of characteristics of the singing voice: The right hand controlling the synthetic voices through real instruments controls the pitch of the voice as traditionally used, is yet understudied.
    [Show full text]
  • Speech Synthesizer Based on the Project MBROLA
    Rajs Arkadiusz, Banaszak-Piechowska Agnieszka, Drzycimski Paweł. Speech synthesizer based on the project MBROLA. Journal of Education, Health and Sport. 2015;5(12):160-164. ISSN 2391-8306. DOI http://dx.doi.org/10.5281/zenodo.35266 http://ojs.ukw.edu.pl/index.php/johs/article/view/2015%3B5%2812%29%3A160-164 http://pbn.nauka.gov.pl/works/678876 Formerly Journal of Health Sciences. ISSN 1429-9623 / 2300-665X. Archives 2011–2014 http://journal.rsw.edu.pl/index.php/JHS/issue/archive Deklaracja. Specyfika i zawartość merytoryczna czasopisma nie ulega zmianie. Zgodnie z informacją MNiSW z dnia 2 czerwca 2014 r., że w roku 2014 nie będzie przeprowadzana ocena czasopism naukowych; czasopismo o zmienionym tytule otrzymuje tyle samo punktów co na wykazie czasopism naukowych z dnia 31 grudnia 2014 r. The journal has had 5 points in Ministry of Science and Higher Education of Poland parametric evaluation. Part B item 1089. (31.12.2014). © The Author (s) 2015; This article is published with open access at Licensee Open Journal Systems of Kazimierz Wielki University in Bydgoszcz, Poland and Radom University in Radom, Poland Open Access. This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited. This is an open access article licensed under the terms of the Creative Commons Attribution Non Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted, non commercial use, distribution and reproduction in any medium, provided the work is properly cited.
    [Show full text]
  • Virtual Storytelling: Emotions for the Narrator
    Virtual Storytelling: Emotions for the narrator Master's thesis, August 2007 H.A. Buurman Committee Faculty of Human Media Interaction, dr. M. Theune Department of Electrical Engineering, dr. ir. H.J.A. op den Akker Mathematics & Computer Science, dr. R.J.F. Ordelman University of Twente ii iii Preface During my time here as a student in the Computer Science department, the ¯eld of language appealed to me more than all the other ¯elds available. For my internship, I worked on an as- signment involving speech recognition, so when a graduation project concerning speech generation became available I applied for it. This seemed like a nice complementation of my experience with speech recognition. Though the project took me in previously unknown ¯elds of psychol- ogy, linguistics, and (unfortunately) statistics, I feel a lot more at home working with- and on Text-to-Speech applications. Along the way, lots of people supported me, motivated me and helped me by participating in experiments. I would like to thank these people, starting with MariÄetTheune, who kept providing me with constructive feedback and never stopped motivating me. Also I would like to thank the rest of my graduation committee: Rieks op den Akker and Roeland Ordelman, who despite their busy schedule found time now and then to provide alternative insights and support. My family also deserves my gratitude for their continued motivation and interest. Lastly I would like to thank all the people who helped me with the experiments. Without you, this would have been a lot more di±cult. Herbert Buurman iv Samenvatting De ontwikkeling van het virtueel vertellen van verhalen staat nooit stil.
    [Show full text]
  • Phonodeon: Controlling Synthetic Voices Via Midi- Accordeon
    PHONODEON: CONTROLLING SYNTHETIC VOICES VIA MIDI- ACCORDEON Anastasia Georgaki Ioannis Zannos Nikolaos Valsamakis, Music Department, Audiovisual Arts Technological Institute of University of Athens, Department, Ionian Crete, Department of Music Athens, Greece University, acoustics and Technology, [email protected] Corfu, Greece Rethymnon, Greece [email protected] [email protected] ABSTRACT particularities of the vocal signal, or the refinement of established sound synthesis techniques. For example This paper presents research on controlling synthetic one of the techniques based on estimating the spectral voice via a MIDI accordion. As motivation for this envelope, while allowing the precise extraction of research served the goal of reviving "lost instruments", formants of high frequencies of female voices, poses that is of using existing traditional instruments “lost” to many difficulties at the level of analysis [13]. On the new music genres as interfaces to control new types of other task of automatic generation of control sound generation in novel and future genres of music. parameters is further complicated by the non-linearity We worked with a MIDI-accordion, because it of the vocal signal [1]. provides expressive control similar to the human breath While research on the synthesis of the singing through the mechanism of the bellows. The control voice is well established and widely present in interface of the two hands is also suited for computer music and related fields, the aspect of characteristics of the singing voice: The right hand controlling the synthetic voices through real instruments controls the pitch of the voice as traditionally used, is yet understudied. Systems like Squeezevox1[2] and while the left hand chooses combinations of timbres, COWE present new ways on controlling synthetic phonemes, longer phonetic units, and different kinds of voices from real instruments with special MIDI vocal expression.
    [Show full text]
  • Implementasi Text to Speech Pada Screen Reader Berbasis Mbrola
    IMPLEMENTASI TEXT TO SPEECH PADA SCREEN READER BERBASIS MBROLA SKRIPSI Oleh : Muchammad Faisol NIM. 06550077 JURUSAN TEKNIK INFORMATIKA FAKULTAS SAINS DAN TEKNOLOGI UNIVERSITAS ISLAM NEGERI MAULANA MALIK IBRAHIM 2013 IMPLEMENTASI TEXT TO SPEECH PADA SCREEN READER BERBASIS MBROLA SKRIPSI Oleh: MUCHAMAD FAISOL NIM. 06550077 JURUSAN TEKNIK INFORMATIKA FAKULTAS SAINS DAN TEKNOLOGI UNIVERSITAS ISLAM NEGERI MAULANA MALIK IBRAHIM MALANG 2013 IMPLEMENTASI TEXT TO SPEECH PADA SCREEN READER BERBASIS MBROLA SKRIPSI Diajukan kepada Universitas Islam Negeri Maulana Malik Ibrahim Malang Untuk Memenuhi Salah Satu Persyaratan Dalam Memperoleh Gelar Sarjana Komputer (S.Kom) Oleh: MUCHAMAD FAISOL NIM. 06550077 JURUSAN TEKNIK INFORMATIKA FAKULTAS SAINS DAN TEKNOLOGI UNIVERSITAS ISLAM NEGERI MAULANA MALIK IBRAHIM 2013 ii LEMBAR PERSETUJUAN IMPLEMENTASI TEXT TO SPEECH PADA SCREEN READER BERBASIS MBROLA SKRIPSI Oleh: Muchamad Faisol NIM: 06550077 Telah disetujui oleh: Pembimbing I Pembimbing II Totok Chamidy, M.Kom Dr. Suhartono, M.Kom NIP. 196912222006041001 NIP. 196805192003121001 22 Juli 2013 Mengetahui, Ketua Jurusan Teknik Informatika Ririen Kusumawati, M. Kom NIP. 197203092005012002 iii LEMBAR PENGESAHAN IMPLEMENTASI TEXT TO SPEECH PADA SCREEN READER BERBASIS MBROLA SKRIPSI Dipersiapkan dan disusun oleh: Muchamad Faisol NIM. 06550077 Telah Dipertahankan Di Depan Dewan Penguji Skripsi Dan Dinyatakan Diterima Sebagai Salah Satu Persyaratan Untuk Memperoleh Gelar Sarjana Komputer (S.Kom) Tanggal 22 Juli 2013 Susunan Dewan Penguji: Tanda Tangan 1. Penguji Utama: Zainal Abidin, M.Kom NIP. 19760613 200501 1 004 ( ) 2. Ketua Penguji: M. Ainul Yaqin, M.Kom NIP.19761013 200604 1 004 ( ) 3. Sekretaris Penguji: Totok Chamidy, M.Kom NIP. 19791222 200604 1 001 ( ) 4. Anggota Penguji: Dr. Suhartono, M.Kom NIP. 19680519 200312 1 001 ( ) Mengetahui dan Mengesahkan Ketua Jurusan Teknik Informatika Universitas Islam Negeri Maulana Malik Ibrahim Malang Ririen Kusumawati, M.Kom NIP.
    [Show full text]