Encyclopedia of Multimedia

Encyclopedia of Multimedia 2nd Edition

TABLE OF CONTENTS

NEW ARTICLES (alphabetically by authors):

Harry Agius Long: "MPEG-7 Multimedia Content Description Interface" Short: "The Content-User Gap in MPEG-7" "MPEG-7 Authoring Tools" "MPEG-7 Applications"

Mario Angelides Long: Multimedia Content Personalization on mobile devices using MPEG-7 and MPEG-21, Anastasis A. Sofokleous and Marios C. Angelides Short: Content Modeling using MPEG-7 User Modeling using MPEG-7 Usage Environment Description using MPEG-21 Usage Constraints Description using MPEG-21 Quality of Service Adaptation Description using MPEG-21

Yannis Avrithis Long: "Detection of high-level concepts in multimedia", Vaggelis Spyrou and Yannis Avrithis Short: "Semantic image and video segmentation", Thanos Athanassiadis and Yannis Avrithis "Saliency in computer vision", Konstantinos Rapantzikos and Yannis Avrithis "Person detection in images and video", Petros Kapsalas and Yannis Avrithis "Multimedia personalization", Phivos Mylonas and Yannis Avrithis

Alan Bovik Long: viii Table of Contents

K. Seshadrinathan and A.C. Bovik, "Image and video quality assessment" Short: "Optimization Using Perceptual Measures" "Face Matching Using Structural Similarity "Range Image Quality Assessment" "Video Quality Assessment for Wireless Applications"

Chang Wen Chen TBD

Chabane Djeraba Long: Eye-gaze tracking applied to image indexing*, Jean Martinet, Adel Lablack, Nacim Ihaddadene, Chabane Djeraba

David Gibbon Long: Multimedia Content Adaptation Short: Content Distribution Networks Extensible Stylesheet Language Cascading Style Sheets

Yihong Gong Long: Image and Video Super Resolution Techniques

Ebroul Izquieredo Long: Context-based Arithmetic Coding Adaptive Joint Source-Channel Coding for Scalable Video Visual Information Retrieval

Hari Kalva Long: H.264 Video Compression Standard VC-1 Video Codec VC-6 Video Codec 3D Video Compression Techniques

Harald Kosch Long: Encyclopedia of Multimedia ix

Metadata Standards, Harald Kosch, Mario Döller, Mathias Lux, Werner Bailer, Ralf Klamma and Marc Spaniol. Multimedia Meyadata Lifecycle, Harald Kosch

Kwok-Tung Lo Long: Large Scale Multimedia Streaming in Heterogeneous Network Environments"

Rastislav Lukac Long: Color-Mapped Imaging (authors: Sebastiano Battiato and Rastislav Lukac) Image Quality Evaluation (authors: Rastislav Lukac and Sebastiano Battiato) Video Stabilization (authors: Sebastiano Battiato and Rastislav Lukac) Short: Dithering GIF Format Media Cut Algorithm Reindexing Techniques

Nadia Magnenat-Thalmann Long: Haptics in Virtual Reality and Multimedia

Milind Naphade Long: Ontology for Multimedia

Branko Petljanski Long: Digital Cinema

Balakrishnan Prabhakaran TBD

Milena Radenkovic Long: Mass-Scale Multimedia Networks

Marco Roccetti x Table of Contents

Long: Multimedia and E-learning Platforms

Maria Luisa Sapino Long: Maria Luisa Sapino and K.Selcuk Candan, Multimedia Information Systems" Short: K. Selcuk Candan, Streaming multimedia information processing Yucel Saygin, Spatio-temporal multimedia mining and indexing Alberto Messina and Maurizio Montagnuolo, Multimedia content description and standards Ombretta Gaggi, Interactivity in multimedia documents and systems Antonio Picariello, Image and video information retrieval

Shin'ichi Satoh Long: Video Near Duplicate Detection (Shin'ichi Satoh, NII) Face Detection, Tracking, and Recognition for Broadcast Video, (Duy-Dinh Le, Xiaomeng Wu, and Shin'ichi Satoh, NII) Multimedia Technologies at Broadcast Station, (Nobuyuki Yagi, NHK Science and Technical Research Laboratories) Sports Video Analysis (Noboru Babaguchi, Osaka University) Automated Recording and Video Production for Meeting and Presentation Scenes (Yuichi Nakamura, Kyoto University)

Shervin Shirmohammadi Long: MPEG-21 Based Video Adaptation, by Razib Iqbal and Shervin Shirmohammadi Networking for Massively Multiuser Online Gaming, by Dewan Tanvir Ahmed and Shervin Shirmohammadi

Micahel G. Strintzis Long: 3D Content-Based Search for Mechanical Parts Face and Facial Expression Recognition Using 3D Data Short: 3D Object Watermarking Object Recognition and Pose Estimation from 2.5D Scenes 3D Face Recognition

V.S. Subhramanian Encyclopedia of Multimedia xi

Long: Video Games

Christian Timmerer Long: D. Jannach, C. Timmerer, H. Hellwagner,Knowledge-based Multimedia Adaptation Decision Taking I. Kofler, C. Timmerer, H. Hellwagner, Optimization-based Multimedia Adaptation Decision Taking M. Prangl, H. Hellwagner, Utility Model-based Adaptation of Multimedia Content Timmerer, M. Ransburg, H. Hellwagner, Generic Multimedia Content Adaptation C. Timmerer, A. Vetro, Context Description Standards for Multimedia C. Timmerer, A. Vetro, H. Hellwagner, Overview of MPEG-21 Digital Item Adaptation C. Timmerer, H. Hellwagner, Overview of MPEG-21 Short: Multimedia Adaptation Decision-Taking

Remco Veltkamp Long: 3D Content-Based Search Education in Multimedia

Bharadwaj Veeravalli Bharadwaj Veeravalli and Zeng Zeng, Large-Scale Object-Based Multimedia Storage Systems

Wenjun Zeng Long: Security for Multimedia Applications

Roger Zimmerman TBD xii Table of Contents

Contributors ...... xvii Preface ...... xxv

A ...... 1

ACTIVE BUFFER MANAGEMENT FOR PROVISION OF VCR FUNCTIONALITIES...... 1 ADAPTIVE EDUCATIONAL HYPERMEDIA SYSTEMS...... 2 ANALYZING PERSON INFORMATION IN NEWS VIDEO...... 3 APPLICATIONS OF FACE RECOGNITION And NOVEL TRENDS...... 9 ARCHITECTURE OF COMMERCIAL NEWS SYSTEMS...... 11 AUDIO COMPRESSION AND CODING TECHNIQUES...... 12 AUDIO CONFERENCING...... 21 AUDIO STREAMING...... 22 AUDIO AND VIDEO INFORMATION IN MULTIMEDIA NEWS SYSTEMS...... 28 AUGMENTED REALITY...... 29 AUTHORING AND SPECIFICATION...... 31

B ...... 33

BEHAVIORAL FACILITATION...... 33 BIOMETRICS FOR USER AUTHENTICATION...... 35 BLOCK MATCHING...... 44 BROADCAST ENCRYPTION...... 45

C ...... 47

CASCADING STYLE SHEETS...... 47 CELL PHONES AND E-COMMERCE...... 48 CFA IMAGE ZOOMING...... 49 CLIENT-SERVER ARCHITECTURE...... 51 Encyclopedia of Multimedia xiii

CLIENT-SERVER MULTIMEDIA STREAMING...... 51 CODING OF STEREOSCOPIC AND 3D IMAGES AND VIDEO...... 53 COLLABORATIVE COMPUTING – AREA OVERVIEW...... 60 COLLABORATIVE VIRTUAL ENVIRONMENTS...... 70 COLOR IMAGE FILTERING AND ENHANCEMENT...... 72 COLOR IMAGE NOISE...... 81 COLOR IMAGE ZOOMING...... 83 COMBINING INTRA-IMAGE AND INTER-CLASS SEMANTICS FOR IMAGE MATCHING...... 84 COMPRESSED PROGRESSIVE MESHES...... 85 COMPRESSED VIDEO SPATIO-TEMPORAL SEGMENTATION...... 86 COMPRESSION IN IMAGE SECRET SHARING...... 88 CONTENT BASED 3D SHAPE RETRIEVAL...... 88 CONTENT BASED MUSIC RETRIEVAL...... 96 CONTENT-BASED PHOTO ALBUM MANAGEMENT USING FACES...... 105 CONTENT DISTRIBUTION NETWORK...... 114 CONTENT EXTRACTION AND METADATA...... 115 CONTENT MANAGEMENT IN MULTIMEDIA NEWS SYSTEMS...... 121 CONTENT PROTECTION SOLUTIONS FOR DIGITAL HOME NETWORKS...... 122 CONTEXT AND CURRENT METADATA STANDARDS...... 123 CONTEXT-AWARE MODELING OF MULTIMEDIA CONTENT...... 125 CONTEXT-AWARE MULTIMEDIA...... 126 CONTEXT-AWARE MUSICAL AUDIO...... 133 CONTEXT-AWARE VIDEO PRODUCTION...... 135 CREATING ADAPTIVE COURSE TEXTS WITH AHA!...... 136

D ...... 139

DATA CONFERENCING...... 139 DATA DISCOVERY, ROUTING AND TRAFFIC PATTERNS...... 139 DATA ENCRYPTION STANDARD (DES) AND ADVANCED ENCRYPTION STANDARD (AES)...... 143 DATA MANAGEMENT TECHNIQUES FOR CONTINUOUS MEDIA IN AD-HOC NETWORKS OF WIRELESS DEVICES...... 144 DATA MODELING, MULTIMEDIA...... 150 DEAD RECKONING...... 156 DEMOSAICKED IMAGE POSTPROCESSING...... 157 xiv Table of Contents

DEMOSAICKING...... 158 DESKTOP VIRTUAL REALITY...... 160 DEVICE-DRIVEN PRESENTATION OF MULTIMEDIA CONTENT...... 161 DIAMOND SEARCH FOR BLOCK MOTION ESTIMATION...... 162 DIGITAL BIOMETRICS...... 164 DIGITAL CAMERA IMAGE PROCESSING...... 172 DIGITAL CINEMA...... 181 DIGITAL INPAINTING...... 182 DIGITAL RIGHTS MANAGEMENT...... 190 DIGITAL WATERMARKING...... 196 DISCRETE COSINE TRANSFORM (DCT)...... 203 DISCRETE WAVELET TRANSFORM (DWT)...... 205 DISTANCE AND SIMILARITY MEASURES...... 207 DISTRIBUTED MULTIMEDIA SYSTEMS...... 208 DOCUMENT STANDARDS IN MULTIMEDIA NEWS SYSTEMS...... 215

E ...... 217

EDGE DETECTION...... 217 EDGE-SENSING MECHANISM...... 218 ELEMENTS OF MULTIMEDIA IN EDUCATION...... 219 EMBEDDING MULTIPLE WATERMARKS IN A TRANSFORM DOMAIN.....220 EMERGENT SEMANTICS...... 221 EMOTION AND MULTIMEDIA CONTENT...... 222 ENCRYPTION IN RTP...... 223 EXPERIENTIAL MEDIA SYSTEMS...... 225 EXTENSIBLE STYLESHEET LANGUAGE...... 233

F ...... 235

FACE RECOGNITION...... 235 FACE RECOGNITION EVALUATION AND PILOTS...... 243 FACE RECOGNITION, 3D...... 245 FACIAL ANIMATION AND AFFECTIVE HUMAN-COMPUTER INTERACTION...... 246 FAIRNESS IN ONLINE GAMES...... 252 Encyclopedia of Multimedia xv

FUZZY TECHNIQUES FOR CONTEXT REPRESENTATION...... 253

G ...... 255

GAME ACCESSIBILITY...... 255 GAME EVENT SYNCHRONIZATION...... 256 GEOGRAPHIC VIDEO CONTENT...... 257

H ...... 261

H.263 VIDEO COMPRESSION...... 261 HALFTONING BASED VISUAL SECRET SHARING (VSS)...... 263 HAPTIC DEVICES...... 264 HAPTIC FEEDBACK IN USER INTERFACES...... 265 HAPTICS...... 266 HARMINIC BROADCASTING PROTOCOL...... 267 HIERARCHICAL VOD SYSTEM...... 269 HIGH DEFINITION LIVE STREAMING...... 270 HUFFMAN CODING...... 278 HUMAN COMPUTER INTERACTION...... 281

I ...... 287

IMAGE AND VIDEO CAPTURE...... 287 IMAGE AND VIDEO QUALITY ASSESSMENT...... 288 IMAGE COMPRESSION AND CODING...... 299 IMAGE DATA REPRESENTATIONS...... 306 IMAGE INPAINTING...... 315 IMAGE RETRIEVAL...... 316 IMAGE SEARCH ENGINE...... 323 IMAGE WATERMARKING 335 IMAGE WATERMARKING USING VISUAL CRYPTOGRAPHY...... 337 IMMERSIVE VIRTUAL REALITY...... 338 xvi Table of Contents

IN HOME, IN CAR, IN FLIGHT ENTERTAINMENT...... 339 INDEXING 3D SCENES...... 340 INFRARED FACE RECOGNITION...... 349 INFRASTRUCTURE AND ENGINEERING...... 350 INPAINTING IN VIRTUAL RESTORATION OF ARTWORKS...... 356 INTEGRATION OF COLLABORATIVE COMPUTING WITH MODELLING AND SIMULATION TECHNOLOGIES...... 358 INTEL® XSCALE® MICRO-ARCHITECTURE...... 359 INTERACTIVE STORY TELLING...... 361 INTERLEAVED AUDIO...... 362 IP TELEPHONY...... 363

J ...... 371

JFIF (JPEG FILE INTERCHANGE FORMAT)...... 371 JPEG...... 372 JPEG 2000 IMAGE CODING STANDARD...... 374 JPEG-LS...... 385

K ...... 387

KEY MANAGEMENT...... 387 KNOWLEDGE-ASSISTED IMAGE AND VIDEO ANALYSIS...... 388

L ...... 391

LARGE-SCALE VIDEO-ON-DEMAND SYSTEMS...... 391 LCD DISPLAY INTERFACES...... 399 LEGACY AND CURRENT PRACTICE – THE REALITY OF CONTEMPORARY COLLABORATIVE COMPUTING...... 401 LONG DURATION CONTINUOUS MEDIA RETRIEVAL...... 403

M ...... 405 Encyclopedia of Multimedia xvii

MEDICAL IMAGE SEGMENTATION...... 405 MESH, 3D...... 406 MESSAGE DIGEST (MD5) ALGORITHM AND SECURE HASH ALGORITHM (SHA)...... 407 MIDDLEWARE FOR STREAMING 3D MESHES...... 409 MIME TYPES...... 416 MOTION COMPENSATION FOR VIDEO COMPRESSION...... 417 MOTION ESTIMATION...... 426 MOTION ESTIMATION WITH HALF-PIXEL ACCURACY...... 434 MOTION PICTURE INPAINTING ON AGED FILMS...... 435 MPEG-1 VIDEO COMPRESSION...... 437 MPEG-2 VIDEO COMPRESSION...... 440 MPEG-4 ADVANCED VIDEO COMPRESSION (MPEG-4 AVC)/H.264...... 444 MPEG-4 VIDEO COMPRESSION...... 448 MULTICAST TRUE VoD SERVICE...... 450 MULTICHANNEL DATA ORDERING SCHEMES...... 451 MULTIMEDIA ARCHIVES AND MEDIATORS...... 452 MULTIMEDIA AUTHENTICATION...... 460 MULTIMEDIA AUTHORING...... 468 MULTIMEDIA CONFERENCING...... 477 MULTIMEDIA CONTENT ADAPTION...... 478 MULTIMEDIA CONTENT ADAPTATION IN MPEG-21...... 484 MULTIMEDIA CONTENT MODELING AND PERSONALIZATION...... 485 MULTIMEDIA CONTENT MODELING IN COSMOS-7...... 492 MULTIMEDIA CONTENT REPURPOSING...... 494 MULTIMEDIA DESIGN...... 500 MULTIMEDIA ENCRYPTION...... 502 MULTIMEDIA ENTERTAINMENT APPLICATIONS...... 510 MULTIMEDIA FILE SHARING...... 518 MULTIMEDIA FINGERPRINTING...... 524 MULTIMEDIA IN EDUCATION...... 533 MULTIMEDIA LIBRARIES...... 541 MULTIMEDIA NEWS SYSTEMS...... 547 MULTIMEDIA NEWS SYSTEMS INFRASTRUCTURE...... 557 MULTIMEDIA PRODUCTION...... 558 MULTIMEDIA PROJECT PLANNING...... 559 MULTIMEDIA PROXY CACHING...... 561 MULTIMEDIA SEMANTICS...... 562 xviii Table of Contents

MULTIMEDIA SEMIOTICS...... 567 MULTIMEDIA SENSOR NETWORKS...... 572 MULTIMEDIA SERVERS...... 580 MULTIMEDIA STORAGE ORGANIZATIONS...... 588 MULTIMEDIA STREAMING ON THE INTERNET...... 595 MULTIMEDIA SYNCHRONIZATION – AREA OVERVIEW...... 604 MULTIMEDIA SYNCHRONIZATION – INFRASTRUCTURE AND ENGINEERING...... 613 MULTIMEDIA SYSTEM-ON-A-CHIP...... 619 MULTIMEDIA WEB INFORMATION SYSTEMS...... 627 MULTIMODAL INTERFACES...... 635 MULTI-RESOLUTION IMAGE INPAINTING...... 637 MULTI-VIEW VIDEO CODING...... 638 MULTIPLE SOURCE ALIGNMENT FOR VIDEO ANALYSIS...... 640

N ...... 649

NETWORKING PROTOCOLS FOR AUDIO STREAMING...... 649

O ...... 651

OBJECT BASED STEREOSCOPIC VIDEO CODING...... 651 OCCLUSIONS...... 652 ONLINE GAMING...... 653 ONLINE MULTIMEDIA AND TELEVISION...... 661 ONLINE MULTIMEDIA E-COMMERCE...... 662 OPEN SYSTEMS FOR ONLINE FACE RECOGNITION...... 671 OPTIMIZATION OF VIDEO CONTENT DESCRIPTIONS FOR RETRIEVAL...... 673 OVERLAPPED BLOCK MOTION COMPENSATION...... 681

P ...... 685

PEER-TO-PEER MULTICAST VIDEO...... 685 PEER-TO-PEER STREAMING...... 686 PEER-TO-PEER SYSTEMS...... 696 Encyclopedia of Multimedia xix

PEER-TO-PEER SYSTEMS AND DIGITAL RIGHTS MANAGEMENT...... 697 PERSONALIZED EDUCATIONAL HYPERMEDIA...... 698 PHOTO DEFECT DETECTION...... 704 PLACEMENT OF CONTINUOUS MEDIA IN AD-HOC NETWORKS OF DEVICES...... 705 PORTABLE NETWORK GRAPHICS (PNG)...... 707 PORTALS...... 709 POWER-RATE DISTORTION ANALYSIS FOR WIRELESS VIDEO...... 711 PRIVATE-KEY CRYPTOSYSTEM...... 712 PROGRESSIVE FOREST SPLIT...... 714 PROTECTION OF MULTIMEDIA DATA IN DISTRIBUTION AND STORAGE...... 715 PUBLIC KEY vs. SECRET KEY ENCRYPTION...... 723

Q ...... 727

QOS ASSESSMENT OF VIDEO OVER IP...... 727 QUALITY OF SERVICE IN MULTIMEDIA NETWORKS...... 728 QUANTIZATION...... 736

R ...... 739

REAL TIME MULTIMEDIA...... 739 REAL TIME TRANSPORT PROTOCOL...... 746 REAL-WORLD MULTIMEDIA SYSTEMS...... 748 RECORDING TELECONFERENCING SESSIONS...... 755 ROLE OF SEMANTICS IN MULTIMEDIA APPLICATIONS...... 755 THE RSA PUBLIC-KEY ENCRYPTION ALGORITHM...... 757

S ...... 759

SCALABLE VIDEO CODING...... 759 SCALAR EDGE DETECTORS...... 765 SCHEDULING IN MULTIMEDIA SYSTEMS...... 767 SECURITY ISSUES IN WIRELESS VIDEO...... 775 xx Table of Contents

SEGMENTATION AND CODING...... 777 SEGMENTATION EVALUATION...... 779 SEGMENTATION OF IMAGES AND VIDEO...... 780 SEMANTIC AGENTS ON THE INTERNET...... 788 SEMANTIC CLASS-BASED IMAGE INDEXING...... 789 SEMANTIC CONSUMER IMAGE INDEXING...... 791 SEMANTIC IMAGE REPRESENTATION AND INDEXING...... 792 SEMANTIC MEDICAL IMAGE INDEXING...... 799 SEMANTIC VISUAL QUERY AND RETRIEVAL...... 801 SEMANTIC WEB...... 803 SEMANTIC WEB SERVICES...... 810 SEMANTICS STANDARDS AND RECOMMENDATIONS...... 812 SEMANTICS WEB TOOLS AND TECHNOLOGIES...... 813 SEMIOTICS...... 814 SHARABLE CONTENT OBJECT REFERENCE MODEL (SCORM)...... 816 SIMD (SINGLE INSTRUCTION MULTIPLE DATA) PROCESSING...... 818 SPECTRAL MODEL...... 819 STEREOSCOPIC AND MULTI-VIEW VIDEO CODING STANDARDS...... 821 STREAMING MULTIMEDIA AND ITS APPLICATIONS IN EDUCATION...... 822

T ...... 825

TELECONFERENCING...... 825 TELE-HAPTICS...... 834 TELE-OPERATION...... 842 TELEPRESENCE...... 843 THRESHOLD SCHEMES WITH MINIMUM PIXEL EXPANSION...... 849 TRENDS IN MULTIMEDIA E-COMMERCE...... 850

U ...... 853

UNIVERSAL MULTIMEDIA ACCESS...... 853 Encyclopedia of Multimedia xxi

USER MODELING IN MPEG-7...... 855

V ...... 857

VALENCE-DRIVEN CONQUEST...... 857 VC-1 VIDEO COMPRESSION...... 858 VECTOR EDGE DETECTORS...... 860 VIDEO AUTOMATIC ANNOTATION...... 861 VIDEO-BASED FACE RECOGNITION...... 871 VIDEO CODING TECHNIQUES AND STANDARDS...... 872 VIDEO CONFERENCING...... 881 VIDEO CONTENT ANALYSIS USING MACHINE LEARNING TOOLS...... 883 VIDEO DATABASES...... 892 VIDEO DELIVERY OVER WIRELESS MULTI-HOP NETWORKS...... 900 VIDEO INPAINTING...... 902 VIDEO OVER IP...... 904 VIDEO SEARCH...... 912 VIDEO SUMMARIZATION...... 917 VIDEO TRANSCODING...... 925 VIDEO USAGE MINING...... 928 VIDEO WATERMARKING...... 935 VIRTUAL AND AUGMENTED REALITY...... 938 VIRTUAL PRESENCE...... 946 VIRTUAL REALITY...... 947 VISION-BASED INTERACTION...... 948 VISUAL CRYPTOGRAPHY...... 950

W ...... 953

WATERMARKING, AUDIO...... 953 WATERMARKING, VIDEO...... 955 WIRELESS VIDEO...... 958 WIRELESS VIDEO ADAPTATION...... 967 WMV-9 VIDEO COMPRESSION...... 969 WORKFLOW COMPUTING...... 972

Index ...... 975 xxii Table of Contents