Jens Blauert (Editor) Communication Acoustics Jens Blauert (Editor) Communication Acoustics With 146 Figures Prof. em. Dr.-Ing. Dr. techn. h.c. Jens Blauert Institute of Communication Acoustics Ruhr-University Bochum 44780 Bochum Germany ISBN-10 3-540-22162-X Springer Berlin Heidelberg New York ISBN-13 978-3-540-22162-3 Springer Berlin Heidelberg New York Library of Congress Control Number: 2005922819 This work is subject to copyright. All rights are reserved, whether the whole or part of the mate- rial is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilm or in other ways, and storage in data banks. Duplication of this publication or parts thereof is permitted only under the provisions of the German Copyright Law of September 9, 1965, in its current version, and permission for use must always be obtained from Springer. Violations are liable to prosecution under German Copyright Law. Springer is a part of Springer Science+Business Media springeronline.com © Springer-Verlag Berlin Heidelberg 2005 Printed in The Netherlands The use of general descriptive names, registered names, trademarks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. Typesetting: Data conversion by the authors Final processing: PTP-Berlin Protago-TEX-Production GmbH, Germany Cover-Design: deblik, Berlin Printed on acid-free paper 62/3141/Yu-543210 Preface Communication Acoustics deals with those areas of acoustics which relate to the modern communication and information sciences and technologies. Due to the advent of digital signal processing and recording in acous- tics, these areas have encountered an enormous upswing during the last four decades, whereby psychological and physiological knowledge is extensively ex- ploited for technical applications. Communication-acoustical components can be found in various systems in communication technology, as either stand- alone systems or embedded components. Since a comprehensive handbook on Communication Acoustics is not yet available, this volume tries to fill the gap by providing a collection of review articles covering some of the most relevant areas of the field. The articles are written with the goal in mind of providing students with comprehensive introductions and offer numerous references to relevant liter- ature. Besides its usefulness as a textbook, this book will also be a source of valuable information for those who want to improve or refresh their knowl- edge in the field of Communication Acoustics. The team of authors consists of the following scientist and technologists, Jens Blauert, Jonas Braasch, Hugo Fastl, Volkmar Hamacher, Dorte Hammershøi, Ulrich Heute, Inga Holube, Herbert Hudde, Ute Jekosch, Georg Klump, Armin Kohlrausch, Arild Lacroix, Henrik Møller, Sebastian M¨oller, John N. Mourjopoulos, Pedro Novo, and Steven van der Par. Marc Hanisch assisted substantially in compiling the individual manuscripts. Each chapter has been reviewed by three other members of the team plus by at least two external reviewers. Due to its interdisciplinary character, the book is bound to attract readers from many different areas, such as acousticians, audio engineers, audiologists, biologists, cognitive scientists, communication engineers, communication sci- entists, computer scientists, electronic engineers, hearing-aid users, hi-fi en- thusiasts, linguists, musicians, musicologists, oto-laryngologists, physicists, physiologists, psycho-acousticians, psychologists, quality experts, sound de- signers, speech technologists, and tonmeisters. Jens Blauert,editor Contents 1 Analysis and Synthesis of Auditory Scenes Jens Blauert .................................................... 1 1.1 Introduction.............................................. 1 1.1.1 SomeReminiscing .................................. 1 1.1.2 The Classical Paradigm of Communication Technology . 3 1.1.3 SplittingUptheClassicalTransmissionChain.......... 4 1.2 AnalysisofAuditoryScenes ................................ 5 1.2.1 Quality Recognition and Assessment .................. 7 1.2.2 “Cocktail-Party Processing” .......................... 8 1.2.3 ParadigmaticConsequences.......................... 11 1.3 SynthesisofAuditoryScenes................................ 12 1.3.1 BinauralRoomSimulation........................... 14 1.3.2 Virtual-EnvironmentGeneration...................... 15 1.4 DiscussionandConclusions................................. 18 References..................................................... 20 2 Evolutionary Adaptations for Auditory Communication Georg Klump ................................................... 27 2.1 Introduction.............................................. 27 2.2 SenderAdaptations........................................ 28 2.3 CopingwiththePropertiesoftheTransmissionChannel ....... 29 2.4 Receiver Adaptations ...................................... 30 2.4.1 Auditory Non-Linearities and Gain-Control Mechanisms . 30 2.4.2 Frequency Selectivity ................................ 33 2.4.3 SoundLocalization.................................. 35 2.5 AuditorySceneAnalysis ................................... 37 2.6 ConcludingRemarks....................................... 40 References..................................................... 41 3 A Functional View on the Peripheral Human Hearing Organ Herbert Hudde .................................................. 47 3.1 Introduction.............................................. 47 3.2 Cochlea.................................................. 51 3.3 EarCanalandMiddleEar.................................. 56 VIII Contents 3.4 Direct Bone Conduction to the Cochlea ...................... 68 3.5 Conclusions............................................... 72 References..................................................... 73 4 Modelling of Binaural Hearing Jonas Braasch .................................................. 75 4.1 Introduction.............................................. 75 4.2 AnalysisofBinauralCuesbyHumans........................ 76 4.3 ComputationalAnalysisofBinauralCues .................... 80 4.3.1 SimulationofthePeripheralAuditorySystem.......... 80 4.3.2 Inter-AuralTimeDifferences......................... 83 4.3.3 Inter-AuralLevelDifferences......................... 87 4.3.4 MonauralCues..................................... 88 4.4 Decision Process .......................................... 89 4.4.1 LateralizationModels ............................... 89 4.4.2 WeightingFunctions ................................ 91 4.4.3 LocalizationModels................................. 94 4.5 DetectionAlgorithms...................................... 97 4.6 Localization in Multiple-Sound-Source Scenarios............... 100 References..................................................... 103 5 Audio-Visual Interaction in the Context of Multi-Media Applications Armin Kohlrausch, Steven van de Par ............................... 109 5.1 Introduction.............................................. 109 5.2 Basic Observations of Spatio-Temporal Interaction inAudio-VisualStimuli.................................... 111 5.2.1 Interaction Between Stimuli Allowing anAmbiguousInterpretation......................... 111 5.2.2 IllusoryInteractionEffects........................... 113 5.2.3 Temporal-Rate Disparities ........................... 114 5.2.4 SpatialDisparities.................................. 115 5.3 Cross-ModalEffectsinAuditory-VisualAttention............. 118 5.4 AuditoryandVisualSpeechPerception ...................... 120 5.5 PerceivedQualityofAuditory-VisualStimuli ................. 121 5.6 Sensitivity to Temporal Asynchrony in AV Stimuli ............. 125 5.6.1 PerceivedTemporalRelationsinSimpleStimuli ........ 125 5.6.2 Asynchrony Detection and Quality Degradation forVideoReproduction.............................. 130 5.6.3 An Explanation for the Asymmetric Sensitivity toAVDelays?...................................... 132 5.7 ConcludingRemarks.......................................133 References..................................................... 134 Contents IX 6 Psycho-Acoustics and Sound Quality Hugo Fastl ..................................................... 139 6.1 Introduction.............................................. 139 6.2 Methods ................................................. 140 6.2.1 The Ranking Procedure “Random Access” ............. 140 6.2.2 TheSemanticDifferential............................ 141 6.2.3 CategoryScaling.................................... 141 6.2.4 MagnitudeEstimation............................... 142 6.3 Modelling of Psycho-Acoustic Quantities ..................... 143 6.3.1 Loudness .......................................... 143 6.3.2 Sharpness.......................................... 147 6.3.3 Roughness......................................... 148 6.3.4 FluctuationStrength................................ 148 6.3.5 ComposedMetrics.................................. 149 6.4 SoundQuality............................................ 150 6.5 The Meaning of Sounds .................................... 153 6.6 ImageofBrandNames..................................... 155 6.7 Audio–Visual Interactions .................................. 157 6.8 Outlook.................................................. 159 References..................................................... 160 7 Quality of Transmitted Speech for Humans and Machines