Speech Recognition
Total Page:16
File Type:pdf, Size:1020Kb
Contents Telektronikk Spoken Language Technology in Telecommunications Volume 99 No. 2 – 2003 1 Guest Editorial; Narada Warakagoda and Ingunn Amdal ISSN 0085-7130 3 Introduction; Narada Warakagoda and Ingunn Amdal Editor: Ola Espvik Overview Articles Tel: (+47) 913 14 507 email: [email protected] 6 Speech Technology: Past, Present and Future; Torbjørn Svendsen Status section editor: 19 Computational Linguistics Methods for Machine Translation in Per Hjalmar Lehne Telecommunication Applications?; Torbjørn Nordgård Tel: (+47) 916 94 909 email: [email protected] 23 Speech Recognition – a Tutorial and a Commentary; Frank K Soong and Biing-Hwang Juang Editorial assistant: Gunhild Luke 30 An Overview of Text-to-Speech Synthesis; Per Olav Heggtveit Tel: (+47) 415 14 125 email: [email protected] Automatic Speech Recognition Editorial office: 45 Auditory Based Methods for Robust Speech Feature Extraction; Bojana Gajic Telenor Communication AS Telenor R&D 59 Adaptation Techniques in Automatic Speech Recognition; Tor André Myrvoll NO-1331 Fornebu 70 Pronunciation Variation Modeling in Automatic Speech Recognition; Norway Tel: (+47) 810 77 000 Ingunn Amdal and Eric Fosler-Lussier [email protected] Text-to-Speech Synthesis www.telenor.com/rd/telektronikk 83 The ‘Melody’ in Synthetic Speech: What Kind of Phonetic Knowledge Can Editorial board: Be Used to Improve It?; Jørn Almberg Berit Svendsen, CTO Telenor Ole P. Håkonsen, Professor 94 Prosodic Unit Selection for Text-to-Speech Synthesis; Oddvar Hesjedal, Director Jon Emil Natvig and Per Olav Heggtveit Bjørn Løken, Director Multimodal User Interfaces Graphic design: 104 Speech Centric Multimodal Interfaces for Mobile Communication Systems; Design Consult AS (Odd Andersen), Oslo Knut Kvale, Narada Warakagoda and Jan Eikeset Knudsen Layout and illustrations: Gunhild Luke and Åse Aardal, 119 Multimodal Interaction – Will Users Tap and Speak Simultaneously; Telenor R&D John Rugelbak and Kari Hamnes Prepress and printing: Real World Speech Technology Based Applications Optimal as, Oslo 126 A Norwegian Spoken Dialogue System for Bus Travel Information – Circulation: Alternative Dialogue Structures and Evaluation of a System Driven Version; 3,200 Magne Hallstein Johnsen, Tore Amble and Erik Harborg 132 Terms and Acronyms Guest Editorial NARADA WARAKAGODA AND INGUNN AMDAL Imagine a world without speech and lan- in a technological sense. In the meantime, guage! That cannot be the world you and I however, new scenarios in telecommunication, know. Imagine a world of telecommunications human-to-machine and machine-to-machine without speech and language! That cannot be communications, have made speech and lan- a world meant for humans. guage technologies even more important. Humans invented speech and language to com- A typical example of human-to-machine com- municate with each other. They invented tele- munication would be the scenario where a user communications to use speech and language requests a service from a machine using a com- Narada Warakagoda over larger distances. In fact, the first practical munication device. A fundamental problem in telecommunications system of the world, tele- such a situation is the fast and efficient under- graphy, did not support transmission of speech. standing of each other’s goals, thoughts and It could only transmit text messages using the intentions. Arguably speech is the key to solving Morse code. Invention of telephony in the begin- this problem since it is the most developed and ning of the last century put speech in the centre efficient communication mechanism possessed of telecommunications, something which led to by humans. Using speech for better human- widespread acceptance and use of telecommuni- machine interaction has been a dream for a long cations systems throughout the world. The time. However, the idea was limited to science speech centric nature of telecommunications fiction until the 1970s. But now, the key tech- prevailed for many years, until the late 1990s, nologies that realize this dream, speech recogni- when digital data began to become the focus of tion and speech synthesis, are mature technolo- Ingunn Amdal the industry. gies used in widespread commercial applica- tions. Speech recognition makes it possible for Undoubtedly, the paradigm shift from speech the machine to know the words the user utters to centricity to data centricity, also known as con- express his thoughts and intentions, whereas vergence of speech and data communication sys- speech synthesis converts the information the tems, represents a positive development and has machine gathers, for example by searching a created a lot of new possibilities. However, the database, back to speech. Front cover: most significant consequence of this paradigm Spoken Language Technology in shift is the introduction of machines that possess Even though speech has its strengths in many Telecommunications some kind of intelligence to the telecommunica- situations, there are occasions where speech is A variety of persons, a variety of tion grid. This in turn has resulted in at least two not the most suitable candidate medium for pro- ways of talking – and often a vari- ety of languages. A machine that new basic scenarios in bipartisan telecommuni- viding/acquiring information to/from a machine. responds to a spoken language cations, namely, human-to-machine and However, if speech is combined with other types must have the ability to adopt to machine-to-machine communications. These of input or output channels, this disadvantage all such diversities within the repertoire of instructions/commu- two new scenarios together with the old, but still can be avoided. Multimodal processing makes nications that can be understood. important scenario of human-to-human commu- such combinations possible and hence allows The basic issue is yes or no to nication, make the basis of all imaginable possi- a high quality human-machine interaction. accepting an instruction upon which a desired action takes place. bilities in modern telecommunications. Human-machine interaction can be seen as co- A machine may sense your pres- ence in a certain setting and take Even though the emergence of data centric com- operation between a human and a machine to the responsibility to guide you to munication seems to have pushed the speech perform a certain task. Unless the task is very a number of predefined “destina- technology to a corner in the telecommunica- simple, this cooperation needs to extend over tions” – on the way to which a decision-based communication tions arena, this is actually not the case at all. several steps and in each of these steps either the may take place. A person can We should not forget that speech based human- user or the machine queries the respective coun- choose not to react to the ma- to-human communication is still a major part of terpart to get a response. In other words, there is chine speaking, but the machine must react if it concludes “yes – telecommunications. This is not going to change a dialogue between the user and the machine. understood” to spoken instruc- significantly as long as speech remains to be During the dialogue, the machine should at least tions delivered all through the var- humans’ preferred mode of communication with be able to understand the user’s queries and for- ious segments of a service/ser- vices. The artist Odd Andersen each other. Nevertheless, technologies such as mulate answers, to generate queries for the user, visualises this basic process by a speech coding, which provides the base for to contact the back-end applications such as dynamic Yes as we move through speech based telecommunications, have reached databases and to decide what to do next. Dia- the spectrum of possibilities on our way to fulfilling our service a saturation point and therefore it is difficult to logue control is a technology that allows us to needs. expect a significant growth in this area, at least endow the machine with such an ability. Ola Espvik, Editor in Chief Telektronikk 2.2003 1 While speech recognition, speech synthesis, are less powerful information retrieval or ques- multimodal processing and dialogue control tion answering techniques which are based on are essential for efficient and natural human- shallow, often statistical analysis of texts. If sev- machine communication, another set of tech- eral languages are involved in communication, nologies related more to the written language are then automatic translation technology is needed of paramount importance to the future machine- to match the request, data and response with to-machine communication. each other. In the early era of machine-to-machine commu- Spoken language technology is a vast area which nication, the focus was on transferring a chunk spans from speech recognition and speech syn- of bytes from one machine to another without thesis through multimodal processing to dia- considering the meaning hidden behind these logue processing, and maintains close ties with data. However, this attitude is changing with natural language understanding, information the emergence of new open communication retrieval and automatic translation. This issue paradigms such as XML based web services. In of Telektronikk contains a collection of articles one modern view, the purpose of machine-to- which disclose the internal details of these core machine communication would be to make use technologies as well as how they can be utilized of data (and other resources) in one machine to to create innovative telecommunications applica- provide the information required by another tions. machine. Usually, the information sought is related to the meanings of the available data and The success of telecom applications and services therefore a processing at semantic level is offered to the users depends heavily on whether needed to serve such requests. If the data were they make a real difference in the users’ day-to- available in a structured form such as tables in day lives. Further, everybody in society, irre- relational databases, then this would be rela- spective of their technical capabilities, should be tively easy, at least for restrictive tasks.