DOCSLIB.ORG

Speech Recognition Will Be Part of the Interface

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Speech Recognition Will Be Part of the Interface Dialog systems Professor Joakim Gustafson CV for Joakim Gustafson 1987-1992 Electrical Engineering program at KTH 1992-1993 Linguistics at Stockholm University 1993-2000 PhD studies at KTH 2000-2007 Senior researcher at Telia Research 2007- Future faculty position at KTH 2013 – Professor 2015 - Head of department Background Todays topic: dialogue systems What is Dialogue? •A sequence of isolated utterances uttered by at least two speakers that together form a discourse. •Dialogue = a connected sequence of information units (with a goal); - provides coherence over the utterances, - provides a context for interpreting utterances, - multiple participants exchange information. General characteristics of dialogues •At least two participants •No external control over the other participants initiative •A structure develops with the dialogue •Some conventions and protocols exist •Dialogues are robust - we seek to understand the other participant •Various features are problematic. Different types of dialogue •Conversations – Informal (spoken) interaction between two individuals – Main Goal: development and maintenance of social relationships •Task-oriented Dialogues – Possibly formal multimodal interaction – Main Goal: perform a given task •Natural Dialogues: – Occur between humans •Artificial Dialogues: – At least one of the participant is a computer Dialogue research at KTH Our research dialogue systems Waxholm: the first Swedish spoken dialogue system (1995) August: a public chatbot agent (1998) • Swedish spoken dialogue system for public use in kulturhuset • Animated agent named after August Strindberg • Speech technology components developed at KTH • Designed to be easily expanded and reconfigured • Used to collect spontaneous speech data video of August 11 - a speech-enabled game (2005) • NICE was a EU project 2002-2005 • Five Partners – Nislab (Den), Telia (Swe), Liquid Media (Swe), Philips (Ger), Limsi (Fra) – Two systems were developed – a Swedish Fairytale game – an English HC Andersen story-teller Video demo Interactive Urban Robot (2012) Research issues - How can a robot: - Build a model of a city using sensory input? - Obtain information by talking with humans? - Talk with several humans at the same time? FurHat – the social robot Commercial dialogue apps Speech used to be a future promise Bill Gates quoutes • 1997: “The PC five years from now — you won’t recognize it, because speech will have come into the interface • 1998: “We’re looking at speech is an add-on today, but we’re looking in this two to three year timeframe, whether we could put it in. • 1999: “Speech recognition will be part of the interface. [..], probably we are four or five years away from that being the typical interface.” • 2000: “..great speech recognition, [..] all of those things undoubtedly will be solved in the next decade.” • 2001: ”speech recognition are becoming mainstream capabilities [..] virtually all PCs should have that right out of the box.” • 2002: “Likewise, in areas like speech recognition [..] common sense for every computer over the next five years.” • 2003: “speech recognition [..] Some people might say it’s three years, some people might say it’s 10 years to solve those things” • 2004: “We believe that speech over the next several years will be ready for primetime.” • 2005: “We totally believe speech recognition will go mainstream somewhere over the next decade.” • 2006: Vista speech recognition released: ”Dear aunt, let's set so double the killer delete select all.“ https://www.youtube.com/watch?v=2Y_Jp6PxsSQ The last decade the spoken dialogue scene changed dramatically Assistants Siri Google Now Cortana Alexa Hound Bixby PersonalAI Merlin DeepVoice Tacotron2 TTS WaveRNN WaveNet Tacotron LPCNet Vision ImageNet AlexNet 300-W MPII COCO OpenFace OpenPose Cloud ASR ASR API NDEV ASR Bluemix Azure Amazon Transcribe Open source KALDI DeepSpeech wav2letter 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 Deep nets solved recogniton of images and speech Switchboard conversation speech recognition Error Rate Human performance 2016: Machines beat humans at transcribing conversations Now spoken dialogue is everywhere Smart phones Wearables Hearables XR headsets Smart speakers In-Car-systems Smart homes Social robots Back to dialogue research EACare: a social robot for the elderly • Supporting Early Diagnoses of Dementia • Supporting Therapeutic Interventions for Mild Dementia Learning by demonstration • Innovative and Accessible Human-Computer Interfaces Work package leaders Professor Hedvig Kjellström (KTH RPL) Professor Joakim Gustafson (KTH TMH) Professor Jonas Beskow (KTH TMH) Professor Miia Kivipelto (KI) Our goal is to make use of new input modalities Current multimodal setup FACT: A collaborative robot for assembly tasks Human-Robot interaction Multimodal language grounding Dual arm robot mounted using augmented reality using eye gaze and gestures on a mobile base Work package leaders Professor Danica Kragic (RPL) Professor Joakim Gustafson (TMH) Professor Patric Jensfelt (RPL) Human-Robot collaboration using augmented reality Real-time attention tracking Developing Spoken Dialogue System 29 Dialogue System Development Lifecycle •Requirement Analysis •Requirement Specification •Design •Implementation •Evaluation [McTear, 2004. Chap. 6] Requirements Analysis •Use case analysis – Role and functions of the system – Users profiles – Usage patterns •Spoken language requirements: – Vocabulary – Grammars – Interaction Patterns • Prompts, verification sub-dialogues, Repair sub-dialogues •Elicitation of requirements: – Analysis of Human-Human Dialogues (corpora); – Simulations (E.g. Wizard-of-Oz experiments) Sources for dialogue corpora •Human-human interactions •Human-computer interactions •Simulated human-computer interactions Simulation (Wizard-of-Oz) The point of WoZ simulation •Data for speech recognition •Typical utterance patterns •Typical dialogue patterns •Click-and-talk behaviour •Hints at important research problems The demands on the Wizard •How much does the wizard, WOZ, take care of – The Complete System – Parts of the system • Recognition • Synthesis • Dialog Handling • Knowledge Base • Which demands on the WOZ – How to handle errors – Should you add information – What is allowed to say •Which support does the WOZ have a robot coach for autistic children Partners MagPuzzle - joint attention robot Hardware • Laptop • Monitor for wizard gaze tracking • Realsense SR300 for user head/gaze tracking • Top camera for fiducial detection • External Microphone • Furhat Robot • Mag-puzzle pieces 38 Task • Visualize a 3D cube structure and reconstruct it in 2-D • Place magPuzzle pieces on the board to complete the task • Form the cube into 3-D when finished • 3 tasks with different restrictions of 4, 3 and 2 pieces “in a line” 39 Semi-autonomous restricted and augmented wizard interface • Built in Unity3D • Communicates with IrisTK • Robust real-time object tracking using ARToolkit • Cloud ASR integration • Gaze estimation integration with GazeSense • Wizard gaze control and logging capabilities with a tobii eye tracker • Enables creation of buttons to select easily authored dialog acts https://github.com/ Andre-pereira/ LimitedProactiveWizard 40 • Choose a dialog act directly by pressing a button on the interface 41 • More contextually relevant options can be found by clicking at a point of interest in the interface. When doing so, more options expand. 42 Why restricted? • The interface shows only what the robot “sees” - No audio or video feed is available - This allows ML models to have the necessary information to decide - More “realistic” behavior given the state of the art in robotics - Detect perception problems early on in the design process 43 The task’s contextual state appears in a central location and is updated in real-time 44 ASR results and hypotheses from a free cloud recognizer are displayed in real-time 45 Subtitles appear after selection of dialog acts is being spoken by the robot 46 The wizard is made aware of user and robot gaze targets by generated gaze lines 47 Why augmented? • The interface should also augment the wizard decision making and option selection with the advantages provided by fast computation - The wizard cognitive load is a problem so only the most relevant options should appear at any given time - The wizard should not have to control all of the robots behavior, especially if only one wizard is involved. Some parts should be automated. - A good response time is important to achieve believable behavior and to train ML models 48 • Gaze behavior is autonomous - The robot decides where to gaze autonomously based on the sensor data and dialog act selection 49 • Gaze tracking on the wizards side - The mouse cursor moves to where the user is looking at for faster selection and the dialog act options pop up automatically 50 • A.I. helps the wizard decisions - Automatically shows correct or incorrect states if any rule is broken and the correct place for hints if available 51 • Only relevant buttons are shown - Once buttons are no longer necessary they are hidden from the interface 52 • Audio cues - After the ASR detects end of utterance, the result is played in text-to-speech for the wizard in case s/he was not paying attention to the text 53 Excerpt from an experiment 54 Requirements Specification •AKA: Functional Specification – Formal Documents on what the system should do (features and constraints). •Volere template [Robertson et al. 1999]: – Project drivers: • purpose and stakeholders – Project constraints:
Load more

Recommended publications
  • A University-Based Smart and Context Aware Solution for People with Disabilities (USCAS-PWD)
    computers Article A University-Based Smart and Context Aware Solution for People with Disabilities (USCAS-PWD) Ghassan Kbar 1,*, Mustufa Haider Abidi 2, Syed Hammad Mian 2, Ahmad A. Al-Daraiseh 3 and Wathiq Mansoor 4 1 Riyadh Techno Valley, King Saud University, P.O. Box 3966, Riyadh 12373-8383, Saudi Arabia 2 FARCAMT CHAIR, Advanced Manufacturing Institute, King Saud University, Riyadh 11421, Saudi Arabia; [email protected] (M.H.A.); [email protected] (S.H.M.) 3 College of Computer and Information Sciences, King Saud University, Riyadh 11421, Saudi Arabia; [email protected] 4 Department of Electrical Engineering, University of Dubai, Dubai 14143, United Arab Emirates; [email protected] * Correspondence: [email protected] or [email protected]; Tel.: +966-114693055 Academic Editor: Subhas Mukhopadhyay Received: 23 May 2016; Accepted: 22 July 2016; Published: 29 July 2016 Abstract: (1) Background: A disabled student or employee in a certain university faces a large number of obstacles in achieving his/her ordinary duties. An interactive smart search and communication application can support the people at the university campus and Science Park in a number of ways. Primarily, it can strengthen their professional network and establish a responsive eco-system. Therefore, the objective of this research work is to design and implement a unified flexible and adaptable interface. This interface supports an intensive search and communication tool across the university. It would benefit everybody on campus, especially the People with Disabilities (PWDs). (2) Methods: In this project, three main contributions are presented: (A) Assistive Technology (AT) software design and implementation (based on user- and technology-centered design); (B) A wireless sensor network employed to track and determine user’s location; and (C) A novel event behavior algorithm and movement direction algorithm used to monitor and predict users’ behavior and intervene with them and their caregivers when required.
    [Show full text]
  • Voicesetting: Voice Authoring Uis for Improved Expressivity in Augmentative Communication Alexander J
    Voicesetting: Voice Authoring UIs for Improved Expressivity in Augmentative Communication Alexander J. Fiannaca, Ann Paradiso, Jon Campbell, Meredith Ringel Morris Microsoft Research, Redmond, WA, USA {alfianna, annpar, joncamp, merrie}@microsoft.com ABSTRACT prosodic features such as the rate of speech, the pitch of the Alternative and augmentative communication (AAC) voice, and cadence/pacing of words. The fact that these systems used by people with speech disabilities rely on text- advances have yet to be incorporated into SGDs in a to-speech (TTS) engines for synthesizing speech. Advances meaningful way is a major issue for AAC. Recent work such in TTS systems allowing for the rendering of speech with a as that of Higginbotham [9], Kane et. al. [11], and Pullin et range of emotions have yet to be incorporated into AAC al. [22] has described the importance of this issue and the systems, leaving AAC users with speech that is mostly need to develop better AAC systems capable of more devoid of emotion and expressivity. In this work, we expressive speech, but to date, there are no research or describe voicesetting as the process of authoring the speech commercially available AAC devices that provide advanced properties of text. We present the design and evaluation of expressive speech capabilities, with a majority only allowing two voicesetting user interfaces: the Expressive Keyboard, for basic modification of speech parameters (overall rate and designed for rapid addition of expressivity to speech, and the volume) that cannot be varied on-the-fly (as utterances are Voicesetting Editor, designed for more careful crafting of the constructed and played), while not leveraging the capabilities way text should be spoken.
    [Show full text]
  • Microsoft Voices Download Windows 10 Use Voice Recognition in Windows 10
    microsoft voices download windows 10 Use voice recognition in Windows 10. Before you set up voice recognition, make sure you have a microphone set up. Select the Start button, then select Settings > Time & Language > Speech . Under Microphone , select the Get started button. Help your PC recognize your voice. You can teach Windows 10 to recognize your voice. Here's how to set it up: In the search box on the taskbar, type Windows Speech Recognition , and then select Windows Speech Recognition in the list of results. If you don't see a dialog box that says "Welcome to Speech Recognition Voice Training," then in the search box on the taskbar, type Control Panel , and select Control Panel in the list of results. Then select Ease of Access > Speech Recognition > Train your computer to understand you better . Appendix A: Supported languages and voices. The following table explains what languages and text-to-speech (TTS) voices are available in the latest version of Windows. Language, country, or region. Female TTS voice. Arabic (Saudi Arabia) Cantonese (Traditional, Hong Kong SAR) Chinese (Traditional, Taiwan) Czech (Czech Republic) English (Great Britain) English (United States) Flemish (Belgian Dutch) Add a TTS voice to your PC. To use one of these voices, add it to your PC: Open Narrator Settings by pressing the Windows logo key + Ctrl + N . Under Personalize Narrator’s voice , select Add more voices . This will take you to the Speech settings page. Under Manage voices , select Add voices. Select the language you would like to install voices for and select Add . The new voices will download and be ready for use in a few minutes, depending on your internet download speed.
    [Show full text]
  • Dialog Systems
    2014-02-13 Dialog systems Professor Joakim Gustafson CV for Joakim Gustafson 1987-1992 Electrical Engineering program at KTH 1992-1993 Linguistics at Stockholm University 1993-2000 PhD studies at KTH 2000-2007 Senior researcher at Telia R&D department 2007- Future faculty position at KTH 2013 – Professor, Head of the Speech Group 1 2014-02-13 What is Dialogue? •A sequence of isolated utterances uttered by at least two speakers that together form a discourse. •Dialogue = a connected sequence of information units (with a goal); - provides coherence over the utterances, - provides a context for interpreting utterances, - multiple participants exchange information. General characteristics of dialogues •At least two participants •No external control over the other participants initiative •A structure develops with the dialogue •Some conventions and protocols exist •Dialogues are robust - we seek to understand the other participant •Various features are problematic. 2 2014-02-13 Different types of dialogue •Conversations – Informal (spoken) interaction between two individuals – Main Goal: development and maintenance of social relationships •Task-oriented Dialogues – Possibly formal multimodal interaction – Main Goal: perform a given task •Natural Dialogues: – Occur between humans •Artificial Dialogues: – At least one of the participant is a computer Vision: artificial dialogues 2001 3 2014-02-13 Did we reach it today? What can be improved? •Speech understanding •Speech synthesis •Dialogue behavior 4 2014-02-13 Improved speech understanding
    [Show full text]
  • RT-Voice PRO Hearing Is Understanding
    RT-Voice PRO Hearing is understanding Documentation Date: 31.08.2021 Version: 2021.3.0 © 2015-2021 crosstales LLC htt s:/!""".crosstales.com #$-Voice PRO 2021.3.0 Table of Contents 1. %&er&ie".........................................................................................................5 2. 'eatures..........................................................................................................( 2.1. Con&ert te)t to &oice.............................................................................................( 2.2. Documentation * control.......................................................................................( 2.3. Com ati+ilit,........................................................................................................( 2.4. .ntegrations........................................................................................................./ 2.5. 0latform-speci1ic 1eatures and limitations.................................................................8 2.5.1. %&er&ie"..................................................................................................................8 2.5.2. 2indo"s..................................................................................................................8 2.5.3. mac%3.....................................................................................................................8 2.5.-. 4ndroid....................................................................................................................5 2.5.5. i%3.........................................................................................................................
    [Show full text]
  • Romanian Minimal Sample Pack
    Romanian Minimal Sample Pack biographically?Partha synthetised tough as fumigatory Trace thigging her pluton savour flipping. Nunzio frisks stately. Sanson reusing The drum and their collection of romanian minimal Eur to minimal. Check the samples which will become widely known about some texts. Ssd is packed crowds, minimal house pack embody the dizi fits the collection of packs you can access. El sonido es creado por. Chandler limited time sale discover new! It as romanian minimal techno pack has a variety of packs that. High quality so exciting new! Download samples pack sizes are nks ready before making hip throw the minimal house, a folder includes tracks now? Dark minimal producers and samples pack for anyone like this? Please fix this sample. Even some delay, minimal techno pack. Deep minimal tech samples and minimalism out! Keyboard shortcuts have used to romanian minimal techno samples are going to. Thank you romanian minimal techno pack fits the paid software. This pack is packed crowds, having a latest professional! Djs from samples pack is packed with minimal techno sample packs, romanian festivals in the. Diva is constantly updating our sample pack produced minimal, samples are virtually unlimited sfx, i could be time when it. This sample packs are categorized for minimal techno samples from the romanian house loops that it is the left before the. None of romanian minimal music production industry experts and minimalism out the pack mixing and download of the kick it is packed with. Setup of handcrafting warm, if not try to get better than this short article is an ancient indian vocals have been recorded sets.
    [Show full text]
  • Texafon 2.0: a Text Processing Tool for the Generation of Expressive Speech in TTS Applications
    TexAFon 2.0: A text processing tool for the generation of expressive speech in TTS applications Juan María Garrido, Yesika Laplaza, Benjamin Kolz, Miquel Cornudella Department of Translation and Language Sciences, Pompeu Fabra University, Barcelona, Spain Roc Boronat 138, 08108 Barcelona, Spain E-mail: [email protected], [email protected], [email protected], [email protected] Abstract This paper presents TexAfon 2.0, an improved version of the text processing tool TexAFon, specially oriented to the generation of synthetic speech with expressive content. TexAFon is a text processing module in Catalan and Spanish for TTS systems, which performs all the typical tasks needed for the generation of synthetic speech from text: sentence detection, pre-processing, phonetic transcription, syllabication, prosodic segmentation and stress prediction. These improvements include a new normalisation module for the standardisation on chat text in Spanish, a module for the detection of the expressed emotions in the input text, and a module for the automatic detection of the intended speech acts, which are briefly described in the paper. The results of the evaluations carried out for each module are also presented. Keywords: emotion detection, speech act detection, text normalisation 1. Introduction This paper describes several improvements introduced in Language and speech technological applications in TexAFon (Garrido et al., 2012) to process correctly text general, and TTS systems in particular, have increasingly with expressive content. TexAFon is a text processing to deal, among many other aspects, with the processing module in Catalan and Spanish for TTS systems which and generation of expressive language (messages coming performs all the typical tasks needed for the generation from speech-based person-machine interfaces, e-mail, of synthetic speech from text.
    [Show full text]
  • THE CEREVOICE SPEECH SYNTHESISER Juan María Garrido
    V Jornadas en Tecnología del Habla THE CEREVOICE SPEECH SYNTHESISER Juan María Garrido1, Eva Bofias1, Yesika Laplaza1, Montserrat Marquina1 Matthew Aylett2, Chris Pidcock2 1Barcelona Media Centre d’Innovació, Barcelona, Spain 2Cereproc Ltd, Edinburgh, Great Britain ABSTRACT Cerevoice), and a TTS Voice. Also, some optional modules, such as user lexicons or user abbreviations This paper describes the CereVoice® text-to-speech tables, can be used to improve the text processing in system developed by Cereproc Ltd, and its use for the particular applications. Figure 1 shows a workflow generation of the test sentences for the Albayzin 2008 scheme of the system. TTS evaluation. Also, the building procedure of a Cerevoice-compatible voice for the Albayzin 2008 evaluation using the provided database and the Cerevoice VCK, a Cereproc tool for fast and fully automated creation of voices, is described. 1. INTRODUCTION CereVoice® is a unit selection speech synthesis software development kit (SDK) produced by CereProc Ltd., a company based in Edinburgh and founded in late 2005 with a focus on creating characterful synthesis and Figure 1. Overview of the architecture of the Cerevoice massively increasing the efficiency of unit selection synthesis system. A key element in the architecture is the separation of text normalization from the selection part of the voice creation [1, 2, 3, 4, 5]. system and the use of an XML API. Cereproc Ltd and Barcelona Media Centre d’Innovació (BM) started in 2006 a collaboration which In the following subsections, a brief description of the led to the development of two text normalization main features of the Cerevoice engine, the text modules, for Spanish and Catalan, the lexicon and the processing module and the voices is given.
    [Show full text]
  • Speech Synthesis
    6. Text-to-Speech Synthesis (Most Of these slides come from Dan Juray’s course at Stanford) History of Speech Synthesis • In 1779, the Danish scientist Christian Kratzenstein builds models of the human vocal tract that can produce the five long vowel sounds. • In 1791 Wolfgang von Kempelen (the creator of the Turk chess playing game) devises the bellows(fuelle, mancha)-operated “automatic- mechanical speech machine”. It added models of the tongue and lips that allowed it to produce voewls and consonants. • In 1837 Charles Wheatstone produces a "speaking machine" based on von Kempelen's design. • In the 1930s, Bell Labs developed the VOCODER, a keyboard- operated electronic speech analyzer and synthesizer that was said to be clearly intelligible. It was later refined into the VODER, which was exhibited at the 1939 New York World's Fair. Tractament Digital de la Parla 2 Von Kempelen: • Small whistles controlled consonants • Rubber mouth and nose; nose had to be covered with two fingers for non-nasals • Unvoiced sounds: mouth covered, auxiliary bellows driven by string provides puff of air From Traunmüller’s web site Von Kempelen’s speaking machine Bell labs VOCODER machine Homer Dudley 1939 VODER • Synthesizing speech by electrical means • 1939 World’s Fair Homer Dudley’s VODER • Manually controlled through complex keyboard • Operator training was a problem One of the first “talking” computers Closer to a natural vocal tract: Riesz 1937 The UK Speaking Clock • July 24, 1936 • Photographic storage on 4 glass disks • 2 disks for minutes, 1 for hour, one for seconds. • Other words in sentence distributed across 4 disks, so all 4 used at once.
    [Show full text]
  • Using Large Corpora and Computational Tools to Describe
    Chapter 1 Using large corpora and computational tools to describe prosody: An exciting challenge for the future with some (important) pending problems to solve Juan María Garrido Almiñana National Distance Education University This chapter presents and discusses the use of corpus-based methods for prosody analysis. Corpus-based methods make use of large corpora and computational tools to extract conclusions from the analysis of copious amounts of data and are being used already in many scientific disciplines. However, they are not yet frequently used in phonetic and phonological studies. Existing computational tools for the au- tomatic processing of prosodic corpora are reviewed, and some examples of studies in which this methodology has been applied to the description of prosody are pre- sented. 1 Introduction The “classical” experimental approach to the analysis of prosody (questions and hypotheses, corpus design and collection, data measurement, statistical analy- sis, and conclusions) has until recently been carried out using mostly manual techniques. However, doing experimental research using manual procedures is a time-consuming process, mainly because of the corpus collection and measure- ment processes. For this reason, usually small corpora, recorded by a few number of speakers, are used, which is a problem if the results are supposed to be con- sidered representative of a given language, for example. Juan María Garrido Almiñana. 2018. Using large corpora and computational tools to describe prosody: An exciting challenge for the future with some (important) pending problems to solve. In Ingo Feldhausen, Jan Fliessbach & Maria del Mar Vanrell (eds.), Methods in prosody: A Romance language perspective, 3–43.
    [Show full text]
  • MILLA – Multimodal Interactive Language Learning Agent
    MILLA – Multimodal Interactive Language Learning Agent João Paulo Cabral1, Nick Campbell1, Shree Ganesh2, Emer Gilmartin1, Fasih Haider1, Eamonn Kenny1, Mina Kheirkhah3, Andrew Murphy1, Neasa Ní Chiaráin1, Thomas Pellegrini4, Odei Rey Orozko5 Trinity College Dublin, Ireland1; GCDH-University of Goettingen, Germany2; Institute for Advanced Studies in Basic Sciences, Zanjan, Iran3; Université de Toulouse ; IRIT, France4; Universidad del País Vasco, Bilbao, Spain5 1 Background 2 MILLA System Components Learning a new language involves the acquisition Tuition Manager: MILLA’s spoken dialogue and integration of a range of skills. A human tu- Tuition Manager (Figure 1) consults a two-level tor aids learners by (i) providing tasks suitable curriculum of language learning tasks, a learner to the learner’s needs, (ii) monitoring progress record and learner state module to greet and en- and adapting task content and delivery style, and roll learners, offer language learning submod- (iii) providing a source of speaking practice and ules, provide feedback, and monitor user state motivation. With the advent of audiovisual tech- with Kinect sensors. All of the tuition manager’s nology and the communicative paradigm in lan- interaction with the user can be performed using guage pedagogy, focus has shifted from written speech through a Cereproc Text-to-Speech (TTS) grammar and translation to developing commu- voice and Cereproc’s Python SDK (Cereproc, nicative competence in listening and spoken pro- 2014), and understanding via CMU’s Sphinx4 duction. The Common European Framework of ASR (Walker et al., 2004) through custom Py- Reference for Language Learning and Teaching thon bindings using W3C compliant Java Speech (CEFR) recently added a more integrative fifth Format Grammars.
    [Show full text]
  • Glissando: a Corpus for Multidisciplinary Prosodic Studies in Spanish and Catalan
    Lang Resources & Evaluation (2013) 47:945–971 DOI 10.1007/s10579-012-9213-0 ORIGINAL PAPER Glissando: a corpus for multidisciplinary prosodic studies in Spanish and Catalan Juan Marı´a Garrido • David Escudero • Lourdes Aguilar • Valentı´n Carden˜oso • Emma Rodero • Carme de-la-Mota • Ce´sar Gonza´lez • Carlos Vivaracho • Sı´lvia Rustullet • Olatz Larrea • Yesika Laplaza • Francisco Vizcaı´no • Eva Estebas • Mercedes Cabrera • Antonio Bonafonte Published online: 12 January 2013 Ó Springer Science+Business Media Dordrecht 2013 Abstract Literature review on prosody reveals the lack of corpora for prosodic studies in Catalan and Spanish. In this paper, we present a corpus intended to fill this gap. The corpus comprises two distinct data-sets, a news subcorpus and a dialogue subcorpus, the latter containing either conversational or task-oriented speech. More than 25 h were recorded by twenty eight speakers per language. Among these speakers, eight were professional (four radio news broadcasters and four advertising actors). The entire material presented here has been transcribed, aligned with the J. M. Garrido Á S. Rustullet Á Y. Laplaza Computational Linguistics Group (GLiCom), Department of Translation and Language Sciences, Universitat Pompeu Fabra, Barcelona, Spain J. M. Garrido e-mail: [email protected] D. Escudero (&) Á V. Carden˜oso Á C. Gonza´lez Á C. Vivaracho Department of Computer Sciences, Universidad de Valladolid, Valladolid, Spain e-mail: [email protected] L. Aguilar Á C. de-la-Mota Department of Spanish Philology, Universitat Auto`noma de Barcelona, Barcelona, Spain E. Rodero Á O. Larrea Department of Communication, Universitat Pompeu Fabra, Barcelona, Spain F.
    [Show full text]