Index

Numeral Additional-copyright-info, 254 3D audio, 59 Additional-identification-info, 314, 315 3D video, 70–80, 366–375 Additional view 3D video, 366–368 3D video displays, 71, 72 Adoption process of MPEG standards, 6, 7 active shutter glasses, 71 ADTS, 340 depth range, 72, 73 Alignment audio frames and PES packets glass-free, 71, 72 LATM, 346 polarized glasses, 71 lossless audio, 346 3D video support, 366–375 Alignment JPEG 2000 access units and PES 3GPP text stream, 66–68 packets, 376 4:1:1 video, 18 Alignment PES packets and transport packets, 4:2:0 video, 18 195, 196 4:2:2 video, 18 Alignment-type, 318 4:4:4 video, 18 Alignment-type assignments, 318 90kHz-flag, 359, 360 ALS audio, 69 ALS audio support, 346–348 A Amendments, see MPEG-2 system amendments AAC (audio) Analogue video, 16, 17 MPEG-2, 55–58 Ancillary stream usage, 259 MPEG-4, 56–58 Applicable-temporal-ID, 374, 375 AAC (audio) support, see MPEG-2 AAC support Application standardization bodies, 6, 403–405 and MPEG-4 AAC support Applications, 10, 168, 169, 403–412 Access procedure ARIB, 6, 404 scrambled transport stream, 222–224 Arrangement-type, 368 transport stream, 203 ASC-flag, 347, 349 Access unit delimiter NAL units, 355–360 ASC-size, 347, 349 Access Unit re-assembly, 361–366, 370–374 Aspect-ratio-information, 319, 320 Adaptation field, 193,COPYRIGHTED 194, 329–331 ATM MATERIAL cells and the size of transport packets, 197, Adaptation-field-control, 193, 194, 329 198 Adaptation-field-extension-flag, 330 ATSC, 6, 404 Adaptation-field-extension-length, 331 AU-cell-data-length, 380, 381 Adaptation-field-length, 330 Audio-bound, 155, 157, 322 Adaptive HTTP streaming, 401, 410, 411 Audio coding, 47–59 Additional-copy-info, 254, 304 Audio frames, 50–53

Fundamentals and Evolution of MPEG-2 Systems: Paving the MPEG Road, First Edition. Jan van der Meer.  2014 John Wiley & Sons, Ltd. Published 2014 by John Wiley & Sons, Ltd. 428 Index

Audio Lossless Coding, see ALS and SLS and CA module, 223–225 DST CA-PID, 221–223, 314, 315 AudioProfileLevelIndication, 347, 349 CA-system-ID, 220–223, 314, 315 Audio sampling, 47 CAT, 205, 220, 221 AudioSpecificConfig(), 347, 349 CAT update requirement, 221 Audio stream descriptor, 338, 339 CCITT, 10 Audio-type, 316, 318, 319 CD, 10, 161, 168, 169 Audio-type assignments, 319 CD-i, 168, 169 Authorization to access content, 218 CD-ROM, 10, 161, 168, 169 Auto-stereoscopic display 71, 72 Cell-fragment-indication, 380, 381 Auxiliary video descriptor, 368–370 Channel coding broadcast, 199 Auxiliary video stream, 368–370 Chroma-format, 337, 338 Aux-video-coded-stream-type, 368, 370 Chrominance sampling frequency, 120 AVC-24-hour-picture-flag, 358, 359 Clock-accuracy-exponent, 311, 312 AVC-compatible-flag, 358, 359, 374, 375 Clock-accuracy-integer, 311, 312 AVC flexibility, 354 Clock References see SCR and PCR AVC-still-present, 358, 359 Closed-gop-flag, 337, 338 AVC support, 354–360 Coded Picture Buffer, see CPB AVC timing, 359 Code stream 0/1 (JPEG 2000 video), 376, 377 AVC timing and HRD descriptor, 359, 360 Coding of audio, see Audio coding AVC video descriptor, 358, 359 Coding of video, see Video coding AVC video support, 297, 298, 354–360 Coding-parameter-indicator, 325, 326 Average-bitrate (MVC, SVC), 366, 367, 374 Color-specification, 377, 378 A/V synchronization, 108–112, 129, 130 Colour sub-carrier accuracy, 124, 125 Common interface, 225 B Common scrambling algorithm, 223–225 Bandwidth extension data usage in MPEG-2 Compact Disc, see CD AAC, 341 Compatibility MPEG-1 and program streams, 193 Base-video-flag, 368, 369 Compliancy of decoders and streams, 113, Base view 3D video, 366–368 116–118 BDA, 6, 404, 405 Compliancy verification, 117, 118 Bitrate, see Definitions Compression factor Blu-ray Disc Association, see BDA audio, 13, 14 Blu-ray disc shipments, 409 lossless audio, 69 Blu-ray player shipments, 408 video, 13, 19, 20, 44 Bound-valid-flag, 312 AVC, 20 B-pictures, 25–29 HEVC, 44 Broadcast and transport packets, 199, 200 MPEG-1, 20 Buffer management, 130, 131 MPEG-2, 20 Buffer adaptations for real-time interface, 396 Conditional access descriptor, 220–225, 314, 315 Bytes-to-read, 325, 326 Conditional access section, 328 Byte stream (AVC) overhead, 355–360 Conditional access systems, 221–223 Byte stream format for NAL unit streams, Conditional Access Table, see CAT 355–360 Consolidation of MPEG-2 system amendments, Byte stream (Systems), 83, 84 182 Byte trajectory through buffers, 102, 103 Constant end-to-end delay, 87, 88 Constrained-parameter-flag, 337, 338 C Constrained parameter (MPEG-1) video stream, CABAC, 42 165 CA descriptor, 220–225, 314, 315 Constrained system parameter stream, see CSPS Index 429

Constraint-set0-flag, 358, 359, 374, 375 D Constraint-set1-flag, 358, 359, 374, 375 Data-alignment-indicator, 250, 304 Constraint-set2-flag, 358, 359, 374, 375 Data stream alignment descriptor, 250, 316–318 Constraint-set3-flag, 358, 359, 374, 375 Data structure system stream, see MPEG-1 system Constraint-set4-flag, 358, 359, 374, 375 stream data structure and Program Constraint-set5-flag, 358, 359, 374, 375 stream data structure and Transport Constraints on program stream scrambling, 225, stream data structure and Section data 226 structure Constraints on transport stream scrambling, 219 DCT, 20–24, 37, 41 Content format specific transport issues, 333, Dead time (splicing), 241 334 Dec-config-identification-length (metadata), 386, Content-ID, 383, 384 387 Content labelling descriptor, 383, 384 Decision process in MPEG, 253 Content-reference-ID-record-flag, 383, 384 Decoded Picture Buffer, see DPB Content-reference-ID-record-length, 383, 384 Decoder-config-flag (metadata), 380, 381, 386, Content-time-base-indicator, 383, 384 387 Content-time-base-value, 383, 384 Decoder-config-metadata-service-ID, 386, 387 Continuity counter, 228, 238, 329 Decoding branches STD, see ‘specific format’ discontinuity-indicator, 228, 238 support, such as AVC support and Continuity counter discontinuity, 238 MPEG-2 AAC support Control words (scrambling), 218–220 Decoding time stamp, see DTS Copy control, 254, 255, 304 Decryption, see Descrambling Copyright (bit), 254, 255, 304 Decryption keys, 218–220 Copyright descriptor, 254, 314, 315 DefaultFlexMuxBufferDescriptor(), 353, 354 Copyright identification, 254, 383, 384 Definitions Copyright-identifier, 182, 254, 314, 315 bitrate (kb/s, Mb/s), 7 CPB, 355–360 memory size (KB, MB), 7 CPB-removal-time, 355–360 De-jitter buffer, 108 CPB-size, 355–360 Delay CRC audio (de)compression, 94, 95 PES header, 229, 304, 305 compensation, 96–97, 101, 102 sections 207, 208, 228, 326 demultiplex, 100–105 CSPS differences for services, 94 MPEG-1, 161–166 end-to-end, 87, 88 buffer size constraint re-ordering, 89–91 audio, 163, 164 VBV, 31–38, 151–154, 287, 288 video, 162–166 video coding total, 94 objective, 161 video (de)compression, 28, 29, 88–93 packet rate constraint, 166 Delivery jitter, 106–108 program stream, 268–270 Delivery time, see Byte delivery time buffer size constraint Demultiplexing, 97–106 audio, 268 Demultiplex buffers, 97–106 video, 269, 270 Demultiplex delay, 100–105 objective, 268 DEN-frame-rate, 377, 378 PES packet rate constraint, 268, 269 Dependency-ID, 360–362, 365, 366 CSPS-flag, 155, 157, 322 Dependency layers, 360–366 Current-next-indicator Dependency Representation, see DR program stream map, 323, 324 Dependency representations in access unit, 361, sections, 207–211, 326 362 Cyclic Redundancy Check, see CRC Depth map, 75–78, 369, 370 430 Index

Depth map support, 369, 370 Elementary-stream-access-point, 249 Descrambling, 217–226 Elementary stream bit / byte stuffing, 246 Descriptors, 203–205, 210, 309–320 Elementary-stream-ID, 324 descriptor-length, 309 Elementary-stream-ID-extension, 324 descriptor-tag, 309 Elementary-stream-info-length extensions, 309, 310, 319 program stream map, 324 general content descriptors, 315–320 sections, 204, 205 general structure, 309 Elementary-stream-map-length, 324 specific content descriptors, see ‘specific Elementary-stream-priority-indicator, 229, 330 format’ support, such as AVC support Elementary stream splicing, 209–245 and MPEG-2 AAC support Elsm header, 376, 377 system oriented descriptors, 311–315 EMM, 217–219 Descriptor-tag assignments, 310, 311 EMM-PID, 221, 223 Digital TV, 11 Encryption, see Scrambling Digital TV shipments, 408 End-to-end delay, 87, 88 Direct stream transfer audio, see DST audio End-to-end coding system, 108, 109 Discontinuity-indicator, 228, 237, 238, 330 End of program stream see MPEG program end Discontinuity in presentation, 110, 111 code Download over IP, 397–402 End of system stream start code, 140 DPB, 355–360 Entitlement control message, see ECM DPB-output-time, 355–360 Entitlement management message, see EMM DPB-removal-time, 355–360 Error correction D-pictures, 25 broadcast, 187, 188, 197–199 DR, 361, 366 Compact Disc, 187 Driving forces, 9–11, 133–136, 173–176 Error correction and packet size, 188 DSM-CC, 255, 341, 342 Error prone environments and MPEG-2 systems, DSM-CC-flag, 386, 387 187, 188 DSM-CC support, see MPEG-2 DSM-CC support Error resiliency, 130, 227–230 DSM Command and Control, see DSM-CC Error signalling, 228 DSM (Digital Storage Media) trick mode, ES-count, 374, 375 see Trick mode ESCR, 260, 304, 299–301 DST audio, 69 ES-ID, 353, 354 DST audio support, 346–348 ES-info-length, 328 DTS, 114, 115, 159, 301, 304 ES-rate, 260, 304 DTS coding requirements in AVC, 356–357 ES-reference, 374, 375 DTS-next-AU, 331 Evolution Duplicate packets, 229, 230, 279 3D video coding, 53–59 DVB, 6, 404 audio coding, 53–59 DVD, 10, 11, 404, 405 video coding, 39–46 DVD disc shipments, 409 MPEG-2 systems, 5, 178–185 DVD Forum, 6, 325, 404, 405 Extension (MPEG-2 BC audio) stream, 55, DVD player shipments, 408 292–295, 338, 339 External-clock-reference-indicator, 312 E External-ES-ID descriptor, 353, 354 ECM, 217–219 ECM-PID, 221–223 F Editing of audio and video (in digital domain), FCR-ES-ID, 353, 354 110, 111 FCRLength, 353, 354 Editions of MPEG-2 system standard, 183 FCRResolution, 353, 354 Elementary-PID, 203–206, 328 FEC codes and transport packets, 199, 200 Index 431

File formats, 400 Horizontal-up-sampling-factor (3D), 368, 369 Fixed-flag, 155, 157, 322 Horizontal-up-sampling-factor (3D) assignments, Fixed-frame-rate-flag, 359, 360 369 FlexMuxBufferDescriptor(),353, 354 HRD, 355–360 FlexMuxChannel, 353, 354 HRD-management-valid-flag, 359, 360 FlexMuxTiming descriptor, 353, 354 Hypothetical Reference Decoder AVC, FMC descriptor, 353, 354 see HRD FmxBufferSize descriptor, 353, 354 Hypothetical system stream decoding FmxRateLength, 353, 354 instantaneous decoding, 115, 116, 148–150 Format-identifier, 253, 254, 314, 315 mathematical accuracy, 115, 116, 144 Forward compatible extensions, 260 physical vs. hypothetical decoder, 116, 117 Forward error correction, 187, 188, 197–199 Hypothetical Text Decoder, see HTD Frame compatible (plano-stereoscopic) 3D video, 73–75, 366–369 I Frame compatible 3D video support, 366–369 IBP descriptor, 337, 338 Frame packing arrangement SEI message, iDCT, see DCT 368 ID (field), 339 Frame-packing-SEI-not-present-flag, 358, Identical-gop-flag, 337, 338 359 IDR-pictures, 355 Frame-rate-code, 337, 338 Initial-cpb-removal-delay, 355–360 Frame-rate-code assignments, 337 Initial-cpb-removal-delay-offset, 355–360 Frame-rate-extension-flag, 337, 338 InitialObjectDescriptor(), 353, 354 Frame-rate (SVC), 366, 367 Instantaneous decoding, 115, 116, 148–150 Framing, see Audio frames Interlace, 15, 16 Free-format-flag, 339 Interlaced-video, 377, 378 Full Motion Video, 10 Inter-view prediction (MVC), 370–374 Future extension, 260, 261 Intra-coded-indicator, 325, 326 Future of MPEG-2 systems, 407, 412 Intra coding; see I-pictures IOD descriptor, 353, 354 G IOD-label, 353, 354 Group of pictures, see GOP IP carriage over transport streams, 400 GOP, 35 I-pictures, 23–29 IPMP-CIT, 205, 343 H IPMP Control Information Table, see IPMP-CIT H.222.1 support, 343, 344 IPR, Intellectual property rights, and licensing, Header-length, 142, 143, 155, 321, 322 134, 135, 352 Hearing threshold, 47–50 IPTV, 400, 401 HD (High Definition), 18 ISAN, 62, 63, 254, 378, 383 Height (SVC), 366, 367 ISDN, 10 HEVC, 45, 46, 79, 80 ISO-639-language-code, 316, 318 Hierarchical coding, 315, 316 ISO 639 language descriptor, 316, 318, 319 Hierarchy-channel, 316 ISO/IEC, 3 Hierarchy descriptor, 315–317, 338, 339 ITU, 10, 41 Hierarchy-embedded-layer-index, 316–317 ITU-R Rec 601, see Rec 601 Hierarchy-layer-index, 316–317 ITU-T Rec. H.222.1 support, see H.222.1 support Hierarchy-type, 316–317 Hierarchy-type assignments, 317 J HTD, 67, 68, 350 J2K access unit, 376 Horizontal-offset, 319, 320 J2K video descriptor, 377, 378 Horizontal-size, 319, 320, 377, 378 Jittered delivery, 106, 108 432 Index

Jitter compensation, 391–396 Maximum-bitrate, 312, 313 Impact on Bn and MBn, 392–394 Maximum bitrate descriptor, 312, 313 Impact on TBn, 392, 396 Maximum-bitrate (MVC, SVC), 366, 367, 374 JPEG 2000 video support, 376, 377 Marker bits, 155 Mathematical accuracy, 115, 116, 144 K MB-buffer-size (MPEG-4 systems), 354 K (AVC), 359, 360 McCann’s law, 44–46 Memory size units, 7 L Memory sizes video, 32 Labelling of content, 378 Metadata, 61–64, 377–387 Last-section-number, 209–211, 326 access unit, 63, 379 LATM, 340, 346, 347 decoding, 379, 382, 383 Layer I, II, 51–54 features, 378, 379 Layer III, 52–54 label(ling), 62, 378 Layer (field), 339 pointers, 378 Leak-valid-flag, 313, 314, 337, 338 service, 62, 63, 379 Left-video-flag, 368, 369 time base association, 384 Lenticular display 71, 72 Metadata-application-format, 254, 383, 384–387 Level-count, 374, 375 Metadata-application-format-identifier, 383, Level-idc, 358, 359, 374, 375 384–387 Local program insertion, 234–239 Metadata AU cells, 379–381 background, 234, 235 Metadata AU wrapper, 379–381 changed program definition, 235, 236 Metadata-buffer-size, 382, 383 same program definition, 236–239 Metadata descriptor, 386, 387 time base discontinuity, 236–239, 276, 277 Metadata-format, 384–387 Locking audio and video clock to STC, 109, 119, Metadata-format-identifier, 384–387 264 Metadata-input-leak-rate, 382, 383 Long section header, 207, 208, 326 Metadata-locator-record-flag, 384–387 Lossless audio, see ALS audio and SLS audio and Metadata-locator-record-length, 384–387 DST audio Metadata loss detection, 381 Lossless audio support, 346–348 Metadata-output-leak-rate, 382, 383 Lost transport packets, 199 Metadata pointer descriptor, 384–387 Low-jitter applications, 391, 392, 396 Metadata section, 381, 382 LTW-flag, 331 Metadata-section-length, 381, 382 LTW-offset, 331 Metadata-service-ID, 380–382, 384–387 LTW-offset-lower-bound, 312 Metadata STD descriptor, 382, 383 LTW-offset-upper-bound, 312 Metadata stream, 63 LTW-valid-flag, 331 Metadata support, 377–387 Luminance sampling frequency, 120 Metadata-time-base-value, 383, 384 Metadata transport M asynchronous, 381, 382 Macroblocks, 20, 21, 41, 43 DSM-CC data carousel, 381 Market volume enabled by MPEG-2 systems, DSM-CC object carousel, 381 407–410 sections, 381, 382 Mapping to transport medium, 131 synchronous, 379–381 Max-bit-rate, 377, 378 DSM-CC synchronized download protocol, Max-buffer-size, 377, 378 379–381 MaxCPB[level] , 355–360 PES packets, 379–381 MaxDPB[level] , 355–360 MHEG support, 344 Max-gop-length, 337, 338 Motion compensation, 24–29 Index 433

Moore’s law, 32, 44 MPEG-4 audio support (except lossless formats) Motion JPEG, 376 £ 8 channels, 292–295, 346–349 MP3, 11, 54 > 8 channels, 293, 346–349 MPEG-1, 3, 4, 11 MPEG-4 lossless audio support, 346–348 MPEG-1 audio layers, see Layer I, II and Layer III MPEG-4 audio support, 346–349 MPEG-1 audio support, 292–295, 334, 335, MPEG-4 systems support, 350–354 338, 339 MPEG-4 systems roadblocks, 351–353 MPEG1-MPEG2-identifier, 259, 306, 307 MPEG-4 text descriptor, 347, 350 MPEG-1-only-flag, 337, 338 MPEG-4 timed text support, see Timed text MPEG-1 stream data structure support pack, 138–143, 155, 156 MPEG-4 video stream descriptor, 345, 347 packets, 138–143, 156, 158–160 MPEG-4 video support, 345–347 system header, 138–143, 155–158 MPEG-4-visual-profile-and-level, 347 MPEG-1 system stream carriage over transport MPEG-7 streams, 63 stream, 258–260 MPEG-carriage-flags, 385, 386 MPEG-1 system support, 334–336 MPEG program end code, 189–192, 319–321 MPEG-1 video support, 334–337 MPEG standards (parts), 179–181 MPEG-2, 3, 4, 11 MPEG surround, 58 MPEG-2-AAC-additional-information, 339, 341 MPEG surround support (embedded in MPEG-2 MPEG-2-AAC-additional-information AAC or MPEG-4 AAC stream), 341, assignments, 341 349 MPEG-2 AAC audio descriptor, 339, 341 MPEG Working Group WG, 3 MPEG-2 AAC support MPEG work items, 178 £ 8 channels, 292–295, 339–341 MPTS, see Multi-program transport stream > 8 channels, 293, 339–341 Multi-channel audio, 54, 55 MPEG-2-AAC-channel-configuration, 339, 341 Multiple-frame-rate-flag, 336, 337 MPEG-2-AAC-profile, 339, 341 Multiplex delay, 100–105 MPEG-2 AAC support MultiplexBuffer (MPEG-4 systems) descriptor, £ 8 channels, 292–295, 339–341 354 > 8 channels, 293, 339–341 Multiplex buffers, 97–106, 151–154, 267, MPEG-2 audio (BC) support, 292–295, 338, 268–274, 279–290 339 Multiplex buffer utilization descriptor, 312 MPEG-2 DSM-CC support, 341, 342 Multiplexing, 83–85, 97–106, 150–154, MPEG-2 IPMP support, 343 245, 246 MPEG-2 system amendments, 5, 176, 181–185 Multiplex issue MVC and SVC, 366 MPEG-2 system standard editions, 183 Multiplex requirements, see Requirements MPEG-2 video stereoscopic video format Multi-program transport stream, 255, 256 descriptor, 368 Multiview video, 69, 70 MPEG-2 video support, 296, 297, 336–338 Multiview video coding, see MVC MPEG-3, 3 Muxcode descriptor, 353, 354 MPEG-4 AAC extension descriptor, 347, 349 MuxCodeTableEntry(),353, 354 MPEG-4 AAC support Mux-rate MPEG-1, 146, 147 £ 8 channels, 292–295, 346–349 MVC, 70, 78, 79, 370–375 > 8 channels, 293, 346–349 MVC extension descriptor, 367, 371–374 MPEG-4-audio-profile-and-level, 347, 348 MVC multiplex issue, 366 MPEG-4-audio-profile-and-level assignments, MVC NAL units, 370–374 347–349 MVC operation point, 375 MPEG-4 audio profile and level signalling MVC operation point descriptor, 374, 375 methods, 349 MVC sub-bitstream, 370–374 MPEG-4 audio stream descriptor, 347- 349 MVC video support, 370–375 434 Index

N Parallax (map), 76, 77, 369, 370 NAL, 355 Parallax map support, 369, 370 NAL unit header, 355–360 Parametric Stereo, 57, 58 NAL units, 355 Parsing packet header example, 160 N (AVC), 359, 360 Partial transport stream, 256–258 Network Abstraction Layer, see NAL PAT, 203, 204 Network Information Table, see NIT Payload-unit-start-indicator, 249, 329, 376 Network-PID, 203, 204, 327 PCR Next-directory-offset, 325 encoding, 299–301 NIT, 205, 279, 327 STC clock reference, 110, 111 Non-seamless splice, 239–241 transport stream, 275–277, 330 Non-VCL NAL units, 355–360 PCR-PID, 203, 204, 250, 328 No-prefix-NAL-unit-present (MVC), 367, 374 PCR accuracy, 234 Normal Play Time concept in DSM-CC, see NPT PCR-flag, 330 No-SEI-NAL-unit-present (MVC, SVC), 366, PCR occurrence, 201 367, 374 PCR re-stamping, 233, 234 NPT, 342 Period of STC, 121, 203 NPT usage in metadata, 384 PES-extension-field-length, 308 NTSC, 17 PES-header-data-length, 303, 304 Null packets, 195 PES-header-extension, 304, 306, 307 Number-of-access-units, 325 PES-header-extension-2, 307, 308 NUM-frame-rate, 377, 378 PES-header-position-offset, 325 Num-of-loops, 347, 349 PES overhead buffering (Boh) Num-target-output-views, 374, 375 for PES header multiplex, 271–274 Num-units-in-tick, 359, 360 for PES header storage (T-STD), 273–274 PES overhead buffer size, 274 O PES-packet-length, 301, 302, 325 Object oriented video, 40 PES-packet-length encoding for JPEG 2000, 376 Occlusion, 78 PES packets OIPF, see Open IPTV Forum carriage in transport packets, 195, 196 OPCR, 257, 258, 299–301, 330 common layer between transport program OPCR-flag, 330 streams, 188, 189 Open IPTV Forum, 6, 404 data structure, 301–309 Operation-points-count, 374, 375 distinction from MPEG-1 packet, 303 Original-or-copy bit, 254, 304 PES-priority, 229, 303, 304 Original Program Clock Reference, see OPCR PES private data, 306, 307 Original-stuff(ing)-length, 259, 306, 307 PES-STD, 270, 271 buffer management, 274 P PES stream, 260, 270, 271 Packet-length field, 142–144, 156, 158, 302 Picture-and-timing-info-present-flag, 359, 360 Packet loss detection, 228 Picture Parameter Sets, see PPS Packet-rate-restriction-flag, 268, 269, 322, 323 Picture re-ordering, see Re-ordering Packet-stream-ID, 325, 326 Picture-to-display-conversion-flag, 359, 360 Pack-header-length, 307 Picture types, see I-, P-, B- and D-pictures Pack-header field, 306, 307 PID, 194, 195, 329 Pack-stuffing-length, 321, 322 PID assignments, 206 Padding in packet header, 141 Piecewise-rate, 331 Padding PES packet, 247 Piecewise-rate-flag, 331 Padding stream, 140 Playback trick mode, see Trick mode PAL, 17 PMT, 203, 204 Index 435

Pointer (field), 214, 248, 329 program stream directory, 303, 324–326 Pointers to content, 378 program stream map, 303, 323, 324 P-pictures, 25–29 system header, 189–190, 321–323 PPS, 355–360 Program-stream-info-length, 324 Prefix NAL units, 361–366 Program-stream-map-length, 323, 324 Presentation discontinuity, 110, 111 Program-stream-map-version, 323, 324 Presentation Time Stamp, see PTS Program stream rate, see System stream rate Prev-directory-offset, 325 Program stream scrambling, 225, 226 Previous-PES-packet-CRC, 304, 305 Program stream vs. transport stream, 187, 188 Private data carriage, 250–254 Program time base, 199–203 adaptation field, 252 Progressive download, 400 descriptor payload, 252 Protocol stack for streaming, 398, 399 elementary stream, 250 Pseudo-descriptor-length, 324 PES header, 252 Pseudo-descriptor-tag, 324 PES packet payload, 251, 306 PSI, 203–209 section payload, 251 P-STD, 264–274 transport packet payload, 250 buffer Bn Private data indicator, 314, 315 byte delivery time, 266 Private data indicator descriptor, 314, 315 constraints, 267, 268 Private data identification, 253, 254 sharing, 266 Private indicator in metadata section, 381 size, 267 Private indicator in private section, 328 size changes, 266 Private section, 328 compliancy requirements, 266–268, 290–292 Profile-and-level, 377, 378 content specific P-STD issues, see ‘specific Profile-and-level-indication, 337, 338 format’ support, such as AVC support Profile-idc, 358, 359, 374, 375 and MPEG-2 AAC support Program Association Table, see PAT parameters, 264, 265 Program association section, 209–211, 327 structure, 265 Program clock reference, see PCR system control data, 264 Program definition, 203–209 time base discontinuity (absence), 266 change in program definition, 235, 236 P-STD-buffer-size, 306, 307 Program element, 199 P-STD-buffer-size-bound, 268–270, 306, 307 Program-info-length, 204, 205, 328 Psycho-acoustic model, 47–50 Program-map-PID, 209, 210, 327 PTS, 109–111, 159, 301, 304 Program map section, 209, 210, 328 PTS coding requirements for AVC, 356, 357 Program Map Table, see PMT PTS coding requirement for JPEG 2000, 376 Program-mux-rate, 266, 321, 322 PTS in program stream directory, 325, 326 Program-number, 202–204, 327, 328, 385, 386 Q Program-packet-sequence-counter, 259, Quality of service issues, see QoS 306, 307 Quality-ID, 360–366 Programs in transport streams, 199–206 Quality-ID-end, 366, 367 PID identification, 203–205 Quality-ID-start, 366, 367 Program Specific Inform,ation, see PSI Quality requirements Program stream carriage over IP, 400, 401 MPEG audio decoder, 128 Program stream carriage within transport stream, MPEG video decoder, 128 258–260, 342, 343 Quality-scalability-flag, 316, 317 Program stream data structure, 319–326 Quantization PES packets, 189–190, 301–309 audio, 49–50 packs, 189–193, 319–322 video, 21–23, 43 436 Index

QoS SA-CD, 69 A/V synchronization, 129, 130 SB-leak-rate, 313 buffer underflow/overflow, 130, 131 SBR, 56–58 error resiliency, 130 SB-size, 313 maximum decoder delay, 129 Scalable lossless audio, see SLS audio random access, 128, 129 Scalable video coding, 39, 40, 43, 44 SchedSelIdx, 355–360 R Scope-of-IOD-label, 353, 354 Random access, 128, 129, 248–250 SCR Random-access-indicator in metadata AU cells STC clock reference, 110, 111 and in metadata sections, 380, 381 encoding, 299–301 Random-access-indicator in transport packet, 249, MPEG-1, 144–147, 155, 156 330 program stream, 266, 267, 321, 322 Rate, see Definitions Scrambling, 217–226 Rate-bound, 155, 157, 322 Scrambling algorithm, 217–219 Rate system stream, see System stream rate Scrambling constraints Real-time interface for transport streams, 108, program stream, 225, 226 391–396 transport stream, 219 buffer adaptations in T-STD model, 396 Scrambling control bits Rec. H.222.1 support, see H.222.1 support PES header, 303, 304 Rec 601, 17, 18, 119, 120 program stream, 226 Reference-offset, 325, 326 transport stream, 219, 223, 329 Registration authority for private data, 253, 254 SD (Standard Definition), 18 Registration descriptor (for private data, 253, 254, SECAM, 17 314, 315 Seamless splice, 241–245 Registration procedure Seamless-splice-flag, 331 copyright identifier, 182 Seamless transport across networks, 199 private data formats, 183 Section carriage in transport packets, 213, 214 Re-multiplex buffer, 231, 232 Section data structure, 207–209, 326 Re-multiplex delay, 232, 233 Section-fragment-indication in metadata section, Re-multiplexing transport streams, 230–234 381, 382 Re-multiplex operations, 230 Section length, 211, 212, 326 maximum room for re-multiplexing, 233 Section-number, 209–211, 326 Re-ordering, 27, 28, 37, 38 Sections for carriage of PSI tables, 206–213, Re-ordering delay, 89–91 326–328 Re-ordering buffer, 91, 92 Section size, 211, 212, 326 Reserved bits, 260 Section-syntax-indicator, 208, 326 Reserved bytes, 260 SEI (Supplemental Enhancement Information) Reserved-data-length, 386, 387 messages, 355–360 Reserved parameter values, 260, 261 Self-contained system streams, 116, 131 Re-stamping of PCR, 232–234 Service compatible 3D video, 366–369 Requirements, 84, 85, 137, 176–178 Service information (ARIB, ATSC, DVB), see SI RGB, 16 Sequence-number, 380, 381 Room for re-multiplexing transport streams, 233 Sequence Parameter Sets, see SPS R/P compensation, 116 Service compatible 3D video support, 366–369 RTP payload formats, 397–399 Si-rbsp(), 368, 370 RTP synchronization mechanism, 398, 399 SI, 251, 252 Short section header, 207, 208, 211, 326 S Simulcrypt, 220, 224, 225 SAOC, 58, 59 Single program transport stream, 255, 256 Index 437

playback by byte delivery time stamp, 257, 258 MPEG-2 systems, 125–127 playback by hand-shake, 258 period, 121, 203 playback by OPCR usage, 257, 258 regeneration in decoder playback issue, 256, 257 pull delivery, 122–124 Slices, 20, 35, 36 push delivery, 121, 122 SL descriptor, 353, 354 slew rate (choice) SLS audio, 69 MPEG-1 systems, 119–120 SLS audio support, 346–348 MPEG-2 systems, 125–127 Smoothing buffer descriptor, 313 tolerance (choice) SMPTE, 183, 254 MPEG-1 systems, 119–120 Smart card usage, 218 MPEG-2 systems, 125–127 Spatial audio object coding, see SAOC STC samples, 299–301 Spatial-scalability-flag, 316, 317 STC base value (90 kHz), 299–301 Spectral Band Replication, see SBR STC extension value (27 MHz), 299–301 Splice-count-down, 228, 243, 330 STC usage by private streams, 250 Splice-type, 331 STD as reference decoder, 114, 117 Splicing in transport streams, 239–245 STD-buffer-bound-scale, 155, 157 non-seamless splice, 239–241 STD-buffer-size, 143, 144, 158, 159 buffer performance, 241 STD-buffer-size-bound, 155, 157, 164, 165 dead time, 241 STD descriptor, 313, 314, 337, 338 seamless splice, 241–245 STD buffer overflow prevention, 241 building blocks content decoder, 263 low delay video, 244, 245 formalism, 144 old and new time base handling, 242 general, 111, 113–118 splice-count-down usage, 243 MPEG-1, 143–154 Splicing-point-flag, 330 buffer size, 158, 159 SPS, 355–360 mux-rate, 155,156 SPTS, see Single program transport stream MPEG-2 foundation, 169, 170 Standardization in MPEG Stereoscopic program info descriptor, 368 need for wide scope, 136 Stereoscopic-service-type, 368, 369 standardization phases, 134 Stereoscopic-service-type assignments, 369 Start codes assignments Stereoscopic video info descriptor, 368, 369 AVC / SVC / MVC video, see Byte stream Stereo-video-arrangement-type-present, 368 format for NAL unit streams Still-mode, 377, 378 system, 140, 141, 192, 303 Still-picture-flag, 337, 338 video, 35, 36 Stream access, see Access procedure Start code emulation in transport packets with Stream-ID, 138–141, 156–158, 302 sections, 214 Stream-ID assignments, 303 Start code prefix, 139 Stream-ID-extension, 308 Start code prefix usage in AVC / SVC / MVC, Stream-ID-extension assignments, 309 355–360 Stream-ID-extension signalling in program stream Statistical multiplexing within transport stream, system header, 322, 322 245, 246 Streaming over IP, 397–400 STB world wide shipments, 408 Stream synchronization STC, 109–111, 200–203 audio, 53 accuracy signalling, 311 systems clock references, see SCR and PCR MPEG-1, 139–142 discontinuity, see Time base discontinuity program streams, 191 frequency (choice) transport streams, 194, 195 MPEG-1 systems, 119–120 video, 35 438 Index

Stream-type, 191, 192, 203–205, 208, 210, 264, Table-ID-extension, 328 302, 324, 328 Table fragmentation, 209–211 Stream-type assignments, 192, 388 Table transitions, 210–213 Stereoscopy, 70 Table versioning, 208, 209, 213 Structure see System stream data structure Target background grid descriptor, 319, 320 Stuffing Target temporal level, 375 MPEG-1 packet header, 158, 159 Target output view, 374 null packets, 247 TB-leak-rate (MPEG-4 systems), 354 PES header, 247 Temporal-ID, 360–366 pack header, 247 Temporal-ID-end, 366, 367, 367, 374 Padding PES packet, 247 Temporal-ID-start, 366, 367, 367, 374 stuffing after section in transport packet, 214, Temporal-poc-flag, 359, 360 248 Temporal scalability and use of TREF, 362–364 transport packet header, 193, 194, 247, 248, Temporal-scalability-flag, 316, 317 330 TextConfigLength, 347, 350 Stuffing-byte, 158, 159, 321, 322, 330 Text modifier, 64 Super audio CD, see SA-CD Text sample, 64 Supplemental Enhancement Information (SEI) Text sample buffer, 68 messages, 355–360 Text sample description, 66–68 Supplemental Information RBSP, 368, 370 Text sample description buffer, 68 SVC base layer, 360–366 Time base association in metadata, 384 SVC data structure, 360, 361 Time-base-association-data-length, 383, 384 SVC extension descriptor, 366, 367 Time base discontinuity, 236–239 SVC multiplex issue, 366 packet positioning, 238, 239 SVC-NAL units, 361–366 separation point, 238 SVC sub-bitstream, 360–366 Timed text, general, 64–68 SVC video support, 360–367 Timed text stream, 66 Sync byte, 194, 195, 329 Timed text unit, see TTU Sync byte emulation in transport packets with Timed text support, 347, 349, 350 sections, 214 Time-scale AVC time base, 359 System-audio-lock-flag, 155, 157, 322 Time stamp coding, 301 System clock descriptor, 311, 312 Time stamps, 109–112, 114, 115, 159 System clock reference, see SCR Timing in AVC, 359 System experts participation, 135, 175 Timing issues, 118–127 System header, see MPEG-1 stream data structure Transmission errors, 199 and Program stream data structure Transport capabilities, 182 System header length, see Header-length Transport-error-indicator, 228, 329 System requirements, see Requirements Transport layer independence, 131, 132 System stream rate Transport packet MPEG-1, 146,147 broadcast, 200 program stream, 190, 191, 266 header, 193, 194, 329, 331 variable rate, 245 size, 197–199 transport stream, 200–203, 275–277 stuffing after section, 214 System Time Clock, see STC sync byte, 194, 195 System target decoder, see STD Transport-priority, 229, 329 System-video-lock-flag, 155, 157, 322 Transport-private-data-flag, 330 Transport-private-data-length, 330 T Transport-scrambling-control, 329 Table-ID, 207, 208, 326 Transport stream access procedure, 203 Table-ID assignments, 208 Transport stream carriage over IP, 400, 401 Index 439

Transport stream data structure, 193, 214, leak method, 285, 286 329–331 vbv delay method, 286–288 Transport stream description section, 210, 213, decoder Dn building blocks, 263 328 duplicate packet handling, 279 Transport Stream Description Table, see TSDT elementary stream buffer EBn Transport-stream-ID, 327, 385, 386 constraints, 290 Transport-stream-location, 385, 386 size, 289 Transport stream program map section see header removal Program map section PES packet headers, 285, 286 Transport stream rate, see System stream rate section headers, 285 Transport streams, 193–214 transport packet headers, 278, 279 Transport stream scrambling, 218–225 multiplex buffer MBn Transport stream usage, 407, 412 constraints, 290 Transport stream vs. Program stream, 187, 188 output rate Rbxn TREF (time stamp), 308, 363, 364 leak method, 285–288 TREF-present-flag, 316–317 vbv delay method, 286–288 Trick mode, 255, 304–306 size, 289 Trick-mode-control, 255, 304–306 parameters, 278, 279 TSDT, 205 structure, 278 T-STD, 275–290 system data processing, 279–284 buffer Bn NIT packets, 279 constraints, 290 time uncertainty PSI table transitions, 283, size, 289 284 buffer Bsys TTU, 66–68 constraints, 284 output rate Rbxsys, 281 U size, 281 Unified Speech and Audio Coding, see USAC buffer components Usable-as-2D, 368, 369 decoding buffer Bdec, 288, 289 USAC, 59 multiplex buffer Bmux, 289 PES overhead buffer Boh, 289 V buffer sharing, 288, 289 Variable bitrate within transport stream, 245, 246 buffer TBn /TBsys Variable length coding, see VLC constraints, 280 Variable-rate-audio-indicator, 339 empty buffer requirement, 280 VBV input (rate), 275–277 buffer, 151–154 PCR-PID packets, 275 delay, 151–154, 287, 288 time base discontinuity, 276, 277 model, 31–38 need for transport buffer, 275 VCL NAL units, 355–360 output transfer rate Rxn /Rxsys, 277 VCL, 355 size, 281 VC, 370–374 usage and behaviour, 277, 279–281 Version-number, 208, 209, 213, 326 compliancy requirements, 290–292 Version of program stream map, see content specific T-STD issues, see ‘specific Program-stream-map-version format’ support, such as AVC support Vertical-offset, 319, 320 and MPEG-2 AAC support Vertical-size, 319, 320, 377, 378 data flow through buffers Vertical-up-sampling-factor (3D), 368, 369 through TBn and Bn, 284–286 Vertical-up-sampling-factor (3D) assignments, through TBsys and Bsys, 282 369 through TBn ,MBn and EBn VHS quality, 18 440 Index

Video-bound, 155, 157, 322 View Component, see VC Video Buffer Verifier, see VBV View-ID, 370–374 Video CD, 11, 161, 168, 169 View order index, 370–374 Video coding, 20–46 View-order-index-max, 367, 374 Video (coding) evolution, 39–46 View-order-index-min, 367, 374 Video Coding Layer, see VCL View Sub-set, see VS Video conferencing, see Applications V-ISAN, 63, 254, 378, 383 Video memory sizes, 32 VLC, 22, 23, 42, 43 Video sequence, 35 VS, 371–373 Video start codes, 35, 36 VUI, 355–360 Video stream descriptor, 336–338 Video stream data structure, 35 W Video positioning and overlay using target Width (SVC), 366, 367 background grid descriptor and video Window-priority, 319, 320 window descriptor, 320 Video Usability Information, see VUI Video window descriptor, 319, 320 Y View components in MVC access unit, 370, 371 YUV, 17–19