A Guide to MPEG Fundamentals and Protocol Analysis > Primer : Tektronix

Total Page:16

File Type:pdf, Size:1020Kb

A Guide to MPEG Fundamentals and Protocol Analysis > Primer : Tektronix A MPEGGuide Fundamentals to and Protocol Analysis Revision 2 Includes Next Generation CODECs, High Definition Video and Mobile RF Digital Modulation A Guide to MPEG Fundamentals and Protocol Analysis Primer Section 1 – Introduction to MPEG................................................................................1 Section 2 – Compression in Video ..................................................................................8 Section 3 – Audio Compression ................................................................................23 3.1 The Hearing Mechanism..........................................................................................................................23 3.2 Subband Coding......................................................................................................................................24 3.3 MPEG Layer 1..........................................................................................................................................25 3.4 MPEG Layer 2 ..............................................................................................................................................26 3.5 Transform Coding....................................................................................................................................26 3.6 MPEG Layer 3 ............................................................................................................................................27 3.7 MPEG-2 Audio ..............................................................................................................................................27 3.8 MPEG-4 Audio ..............................................................................................................................................27 3.9 AC-3 ..........................................................................................................................................................28 Section 4 – The Standards ........................................................................................29 4.1 What is MPEG............................................................................................................................................29 4.2 Who Are ITU............................................................................................................................................29 4.3 Evolution of the Standards..............................................................................................................................29 4.3.1 Video Performance..................................................................................................................................30 4.3.2 Licensing ..........................................................................................................................................................31 4.4 MPEG-1 ......................................................................................................................................................31 4.5 MPEG-2 ..................................................................................................................................................31 4.5.1 Profiles and Levels in MPEG-2 ................................................................................................................32 4.6 MPEG-4 ..................................................................................................................................................34 4.6.1 MPEG-4 Standards Documents ..............................................................................................................35 4.6.2 Object Coding..................................................................................................................................................35 4.6.3 Video and Audio Coding ..........................................................................................................................36 4.6.4 Scalability ..................................................................................................................................................................36 4.6.5 Variable Macroblock Size ................................................................................................................................37 4.6.6 Profiles and Levels in MPEG-4 part 10 (AVC/H.264) ................................................................................37 4.6.7 MP4 Container Format ................................................................................................................................38 4.7 SMPTE VC-1 ..............................................................................................................................................38 4.7.1 Variable Macroblock Size ........................................................................................................................39 4.7.2 Motion Compensation ....................................................................................................................................39 4.7.3 Loop Filtering ..................................................................................................................................................39 4.7.4 Fading Compensation..............................................................................................................................40 4.7.5 Profiles and Levels ......................................................................................................................................40 4.8 MPEG-7 AND MXF ..........................................................................................................................................40 4.9 MPEG-21..........................................................................................................................................................40 Section 5 – Elementary Streams ..........................................................................41 5.1 Video Elementary Stream Syntax................................................................................................................41 5.2 Audio Elementary streams..............................................................................................................................42 Section 6 – Packetized Elementary Streams (PES) ................................................43 6.1 PES Packets ....................................................................................................................................................43 6.2 Time Stamps....................................................................................................................................................43 6.3 PTS/DTS ..........................................................................................................................................................44 Section 7 – Program Streams..............................................................................45 7.1 Recording vs. Transmission ............................................................................................................................45 7.2 Introduction to Program Streams ............................................................................................................45 www.tektronix.com/video_audio i A Guide to MPEG Fundamentals and Protocol Analysis Primer Section 8 – Transport Streams ............................................................................46 8.1 The Job of a Transport Stream ................................................................................................................46 8.2 Packets ............................................................................................................................................................47 8.3 Program Clock Reference (PCR) ....................................................................................................................47 8.4 Packet Identification (PID) ..............................................................................................................................48 8.5 Program Specific Information (PSI) ..........................................................................................................48 Section 9 – Digital Modulation ........................................................................................50 9.1 Principles of Modulation ..............................................................................................................................50 9.2 Analog Modulation........................................................................................................................................50 9.3 Qadrature Modulation..............................................................................................................................50 9.4 Simple Digital Modulation Systems ..........................................................................................................51 9.5 Phase Shift Keying........................................................................................................................................52 9.5.1 Turbo 8PSK ............................................................................................................................................53 9.5.2 DVB S2..........................................................................................................................................................53 9.6 Qadrature Amplitude Modulation
Recommended publications
  • A Multidimensional Companding Scheme for Source Coding Witha Perceptually Relevant Distortion Measure
    A MULTIDIMENSIONAL COMPANDING SCHEME FOR SOURCE CODING WITHA PERCEPTUALLY RELEVANT DISTORTION MEASURE J. Crespo, P. Aguiar R. Heusdens Department of Electrical and Computer Engineering Department of Mediamatics Instituto Superior Técnico Technische Universiteit Delft Lisboa, Portugal Delft, The Netherlands ABSTRACT coding mechanisms based on quantization, where less percep- tually important information is quantized more roughly and In this paper, we develop a multidimensional companding vice-versa, and lossless coding of the symbols emitted by the scheme for the preceptual distortion measure by S. van de Par quantizer to reduce statistical redundancy. In the quantization [1]. The scheme is asymptotically optimal in the sense that process of the (en)coder, it is desirable to quantize the infor- it has a vanishing rate-loss with increasing vector dimension. mation extracted from the signal in a rate-distortion optimal The compressor operates in the frequency domain: in its sim- sense, i.e., in a way that minimizes the perceptual distortion plest form, it pointwise multiplies the Discrete Fourier Trans- experienced by the user subject to the constraint of a certain form (DFT) of the windowed input signal by the square-root available bitrate. of the inverse of the masking threshold, and then goes back into the time domain with the inverse DFT. The expander is Due to its mathematical tractability, the Mean Square based on numerical methods: we do one iteration in a fixed- Error (MSE) is the elected choice for the distortion measure point equation, and then we fine-tune the result using Broy- in many coding applications. In audio coding, however, the den’s method.
    [Show full text]
  • MPEG-21 Overview
    MPEG-21 Overview Xin Wang Dept. Computer Science, University of Southern California Workshop on New Multimedia Technologies and Applications, Xi’An, China October 31, 2009 Agenda ● What is MPEG-21 ● MPEG-21 Standards ● Benefits ● An Example Page 2 Workshop on New Multimedia Technologies and Applications, Oct. 2009, Xin Wang MPEG Standards ● MPEG develops standards for digital representation of audio and visual information ● So far ● MPEG-1: low resolution video/stereo audio ● E.g., Video CD (VCD) and Personal music use (MP3) ● MPEG-2: digital television/multichannel audio ● E.g., Digital recording (DVD) ● MPEG-4: generic video and audio coding ● E.g., MP4, AVC (H.24) ● MPEG-7 : visual, audio and multimedia descriptors MPEG-21: multimedia framework ● MPEG-A: multimedia application format ● MPEG-B, -C, -D: systems, video and audio standards ● MPEG-M: Multimedia Extensible Middleware ● ● MPEG-V: virtual worlds MPEG-U: UI ● (29116): Supplemental Media Technologies ● ● (Much) more to come … Page 3 Workshop on New Multimedia Technologies and Applications, Oct. 2009, Xin Wang What is MPEG-21? ● An open framework for multimedia delivery and consumption ● History: conceived in 1999, first few parts ready early 2002, most parts done by now, some amendment and profiling works ongoing ● Purpose: enable all-electronic creation, trade, delivery, and consumption of digital multimedia content ● Goals: ● “Transparent” usage ● Interoperable systems ● Provides normative methods for: ● Content identification and description Rights management and protection ● Adaptation of content ● Processing on and for the various elements of the content ● ● Evaluation methods for determining the appropriateness of possible persistent association of information ● etc. Page 4 Workshop on New Multimedia Technologies and Applications, Oct.
    [Show full text]
  • Video Basics ---Major Ref
    Video Basics ---major ref. From Ch.5 of textbook 2 ■ Introduction ---- video industry ■ Video Imaging ---- video scan, aspect ratio ■ Color and Composite & component systems ■ From Analog To Digital Video ■ Spatial Conversions ---- video formats ■ Temporal Conversions ■ Mixing And Keying @NTUEE 1 DSP/IC Lab Video Environments Satellite DVB-S downstream(max 90 Mbps) DSS Cable Modem Cable Network DVB-C downstream(max 40 Mbps) OpenCable Home Connection DSTB IEEE 1394 / USB Ethernet 10 Mbps….. Terrestrial DVB-T/ ATSC (Plug&Play , high-data-rate) Interaction Channel DTV set DirecPC/ DirecDuo (1-way / 2-way)1. Satellite( fast PSTN/ ISDN 2. Cable Modem ( QPSK, TCP / IP for PSTN/ ISDN modem 3. SDSL / ADSL / VDSL ….. @NTUEE 2 DSP/IC Lab 1 Video Service Environments Service Provision HFC POTS Wireless Cable DVB-S DVB-C (Full Service (xDSL access) (MMDS) DVB-T (high speed BB) (Cable Modem) Network) TCP / IP Hybrid Services DSTB Residential LAN (IR, RF, Wired) @NTUEE 3 DSP/IC Lab F ãñìµ@ûì > r Gï=.1 *<ÎPU½ÿ½CD *¶1nñG *ÐÍV PC ;^éuu *ñ<uïÚí Internet w7Home SpoppingHome Banking…. *PPV 2âSaDO"H2<_G.(VOD)ÛÚí ö^éGï=. *ö7GïA2Uf÷ ß[1nЯrn1<t *>1ʺ=.²ÁÞ+Gï STBw¯Gï=.1Æ *"Gï=.²2òGï STB Þ1äh¼oZÐõ1"2¤ Gï STB aöÞ^éGï=.> * õ1n<tñ)ËàÁréï=éC 4 *Gï>h Úü¶Êº=.AÓ-I FMMedium Wave ¤µÚí1 / R *Gï>Áä÷1 transm ittersÇt1ä÷ *Gï>r1ñ² ô<Gï=.> *Î BBC aGï=.Ú7ÂbÍÈzéúrp¾câ> DTT > *BDB 2£< 30! DTT nÚí *­~£U>;HÞr> HDTV/SDTV > *BSkyB ~£ 6 ´[uSr> 200 !nGïá#Úí *TCIComcastÛUÀ MSOb 1997 £¦¬[àGï Cable Úí *Flextech $} BBC >Ë1Gïn(å UKFM) ö´^éGï=.> *1994 £¦­Gï DBS I 1996 £¦[JGïá#r> *1997£¦Gï Cable Úír> *1998 £­Î DTT r>ʺ=.²ñhk¶ 12ß 15£1´t Ngñ·ëæJUJT702::9 @NTUEE 4 DSP/IC Lab 2 Applications of Digital Video ¸®ñ *Î]]XÇæ *Internetÿñ *ñ'$7Åg e-mailì½WWW..
    [Show full text]
  • Mpeg-21 Digital Item Adaptation
    ____________________M____________________ MPEG-21 DIGITAL ITEM ADAPTATION Christian Timmerera, Anthony Vetrob, and Hermann Hellwagnera aDepartment of Information Technology, Klagenfurt University, Austria bMitsubishi Electric Research Laboratories (MERL), USA Synonym: Overview of Part 7 of the MPEG-21 Multimedia Framework; Interoperable description formats facilitating the adaptation of multimedia content; ISO standard enabling device and coding format independence; ISO/IEC 21000-7:2007 Definition: MPEG-21 Digital Item Adaptation (DIA) enables interoperable access to (distributed) advanced multimedia content by shielding users from network and terminal installation, management, and implementation issues. Context and Objectives Universal Multimedia Access (UMA) [1] refers to the ability to seamlessly access multimedia content from anywhere, anytime, and with any device. Due to the heterogeneity of terminals and networks and the existence of various coding formats, the adaptation of the multimedia content may be required in order to suit the needs and requirements of the consuming user and his/her environment. For enabling interoperability among different vendors, Part 7 of the MPEG-21 Multimedia Framework [2], referred to as Digital Item Adaptation (DIA) [3], specifies description formats (also known as tools) to assist with the adaptation of Digital Items. Digital Items are defined as structured digital objects, including standard representation, identification and metadata, and are the fundamental units of distribution and transaction
    [Show full text]
  • (A/V Codecs) REDCODE RAW (.R3D) ARRIRAW
    What is a Codec? Codec is a portmanteau of either "Compressor-Decompressor" or "Coder-Decoder," which describes a device or program capable of performing transformations on a data stream or signal. Codecs encode a stream or signal for transmission, storage or encryption and decode it for viewing or editing. Codecs are often used in videoconferencing and streaming media solutions. A video codec converts analog video signals from a video camera into digital signals for transmission. It then converts the digital signals back to analog for display. An audio codec converts analog audio signals from a microphone into digital signals for transmission. It then converts the digital signals back to analog for playing. The raw encoded form of audio and video data is often called essence, to distinguish it from the metadata information that together make up the information content of the stream and any "wrapper" data that is then added to aid access to or improve the robustness of the stream. Most codecs are lossy, in order to get a reasonably small file size. There are lossless codecs as well, but for most purposes the almost imperceptible increase in quality is not worth the considerable increase in data size. The main exception is if the data will undergo more processing in the future, in which case the repeated lossy encoding would damage the eventual quality too much. Many multimedia data streams need to contain both audio and video data, and often some form of metadata that permits synchronization of the audio and video. Each of these three streams may be handled by different programs, processes, or hardware; but for the multimedia data stream to be useful in stored or transmitted form, they must be encapsulated together in a container format.
    [Show full text]
  • MC14SM5567 PCM Codec-Filter
    Product Preview Freescale Semiconductor, Inc. MC14SM5567/D Rev. 0, 4/2002 MC14SM5567 PCM Codec-Filter The MC14SM5567 is a per channel PCM Codec-Filter, designed to operate in both synchronous and asynchronous applications. This device 20 performs the voice digitization and reconstruction as well as the band 1 limiting and smoothing required for (A-Law) PCM systems. DW SUFFIX This device has an input operational amplifier whose output is the input SOG PACKAGE CASE 751D to the encoder section. The encoder section immediately low-pass filters the analog signal with an RC filter to eliminate very-high-frequency noise from being modulated down to the pass band by the switched capacitor filter. From the active R-C filter, the analog signal is converted to a differential signal. From this point, all analog signal processing is done differentially. This allows processing of an analog signal that is twice the amplitude allowed by a single-ended design, which reduces the significance of noise to both the inverted and non-inverted signal paths. Another advantage of this differential design is that noise injected via the power supplies is a common mode signal that is cancelled when the inverted and non-inverted signals are recombined. This dramatically improves the power supply rejection ratio. After the differential converter, a differential switched capacitor filter band passes the analog signal from 200 Hz to 3400 Hz before the signal is digitized by the differential compressing A/D converter. The decoder accepts PCM data and expands it using a differential D/A converter. The output of the D/A is low-pass filtered at 3400 Hz and sinX/X compensated by a differential switched capacitor filter.
    [Show full text]
  • Randomized Lempel-Ziv Compression for Anti-Compression Side-Channel Attacks
    Randomized Lempel-Ziv Compression for Anti-Compression Side-Channel Attacks by Meng Yang A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Applied Science in Electrical and Computer Engineering Waterloo, Ontario, Canada, 2018 c Meng Yang 2018 I hereby declare that I am the sole author of this thesis. This is a true copy of the thesis, including any required final revisions, as accepted by my examiners. I understand that my thesis may be made electronically available to the public. ii Abstract Security experts confront new attacks on TLS/SSL every year. Ever since the compres- sion side-channel attacks CRIME and BREACH were presented during security conferences in 2012 and 2013, online users connecting to HTTP servers that run TLS version 1.2 are susceptible of being impersonated. We set up three Randomized Lempel-Ziv Models, which are built on Lempel-Ziv77, to confront this attack. Our three models change the determin- istic characteristic of the compression algorithm: each compression with the same input gives output of different lengths. We implemented SSL/TLS protocol and the Lempel- Ziv77 compression algorithm, and used them as a base for our simulations of compression side-channel attack. After performing the simulations, all three models successfully pre- vented the attack. However, we demonstrate that our randomized models can still be broken by a stronger version of compression side-channel attack that we created. But this latter attack has a greater time complexity and is easily detectable. Finally, from the results, we conclude that our models couldn't compress as well as Lempel-Ziv77, but they can be used against compression side-channel attacks.
    [Show full text]
  • Security Solutions Y in MPEG Family of MPEG Family of Standards
    1 Security solutions in MPEG family of standards TdjEbhiiTouradj Ebrahimi [email protected] NET working? Broadcast Networks and their security 16-17 June 2004, Geneva, Switzerland MPEG: Moving Picture Experts Group 2 • MPEG-1 (1992): MP3, Video CD, first generation set-top box, … • MPEG-2 (1994): Digital TV, HDTV, DVD, DVB, Professional, … • MPEG-4 (1998, 99, ongoing): Coding of Audiovisual Objects • MPEG-7 (2001, ongo ing ): DitiDescription of Multimedia Content • MPEG-21 (2002, ongoing): Multimedia Framework NET working? Broadcast Networks and their security 16-17 June 2004, Geneva, Switzerland MPEG-1 - ISO/IEC 11172:1992 3 • Coding of moving pictures and associated audio for digital storage media at up to about 1,5 Mbit/s – Part 1 Systems - Program Stream – Part 2 Video – Part 3 Audio – Part 4 Conformance – Part 5 Reference software NET working? Broadcast Networks and their security 16-17 June 2004, Geneva, Switzerland MPEG-2 - ISO/IEC 13818:1994 4 • Generic coding of moving pictures and associated audio – Part 1 Systems - joint with ITU – Part 2 Video - joint with ITU – Part 3 Audio – Part 4 Conformance – Part 5 Reference software – Part 6 DSM CC – Par t 7 AAC - Advance d Au dio Co ding – Part 9 RTI - Real Time Interface – Part 10 Conformance extension - DSM-CC – Part 11 IPMP on MPEG-2 Systems NET working? Broadcast Networks and their security 16-17 June 2004, Geneva, Switzerland MPEG-4 - ISO/IEC 14496:1998 5 • Coding of audio-visual objects – Part 1 Systems – Part 2 Visual – Part 3 Audio – Part 4 Conformance – Part 5 Reference
    [Show full text]
  • Conversion Principles and Circuits
    Interfacing Analog and Digital Worlds: Conversion Principles and Circuits Nimal Skandhakumar Faculty of Technology University of Sri Jayewardenepura 2019 1 From Analog to Digital to Analog 2 Analog Signal ● A continuous signal that contains 1. Continuous time-varying quantities, such as 2. Infinite range of values temperature or speed, with infinite 3. More exact values, but more possible values in between difficult to work with ● Can be used to measure changes in some physical phenomena, such as light, sound, pressure, or temperature. 3 Analog Signal ● Advantages: 1. Major advantages of the analog signal is infinite amount of data. 2. Density is much higher. 3. Easy processing. ● Disadvantages: 1. Unwanted noise in recording. 2. If we transmit data at long distance then unwanted disturbance is there. 3. Generation loss is also a big con of analog signals. 4 Digital Signal ● A type of signal that can take on a 1. Discrete set of discrete values (a quantized 2. Finite range of values signal) 3. Not as exact as analog, but easier ● Can represent a discrete set of to work with values using any discrete set of waveforms; and we can represent it like (0 or 1), (on or off) 5 Difference between analog and digital signals Analog Digital Signalling Continuous signal Discrete time signal Data Subjected to deterioration by noise during Can be noise-immune without deterioration transmissions transmission and write/read cycle. during transmission and write/read cycle. Bandwidth Analog signal processing can be done in There is no guarantee that digital signal real time and consumes less bandwidth. processing can be done in real time and consumes more bandwidth to carry out the same information.
    [Show full text]
  • TMS320C6000 U-Law and A-Law Companding with Software Or The
    Application Report SPRA634 - April 2000 TMS320C6000t µ-Law and A-Law Companding with Software or the McBSP Mark A. Castellano Digital Signal Processing Solutions Todd Hiers Rebecca Ma ABSTRACT This document describes how to perform data companding with the TMS320C6000 digital signal processors (DSP). Companding refers to the compression and expansion of transfer data before and after transmission, respectively. The multichannel buffered serial port (McBSP) in the TMS320C6000 supports two companding formats: µ-Law and A-Law. Both companding formats are specified in the CCITT G.711 recommendation [1]. This application report discusses how to use the McBSP to perform data companding in both the µ-Law and A-Law formats. This document also discusses how to perform companding of data not coming into the device but instead located in a buffer in processor memory. Sample McBSP setup codes are provided for reference. In addition, this application report discusses µ-Law and A-Law companding in software. The appendix provides software companding codes and a brief discussion on the companding theory. Contents 1 Design Problem . 2 2 Overview . 2 3 Companding With the McBSP. 3 3.1 µ-Law Companding . 3 3.1.1 McBSP Register Configuration for µ-Law Companding. 4 3.2 A-Law Companding. 4 3.2.1 McBSP Register Configuration for A-Law Companding. 4 3.3 Companding Internal Data. 5 3.3.1 Non-DLB Mode. 5 3.3.2 DLB Mode . 6 3.4 Sample C Functions. 6 4 Companding With Software. 6 5 Conclusion . 7 6 References . 7 TMS320C6000 is a trademark of Texas Instruments Incorporated.
    [Show full text]
  • 8 Video Compression Codecs
    ARTICLE VIDEO COMPRESSION CODECS: A SURVIVAL GUIDE Iain E. Richardson, Vcodex Ltd., UK 1. Introduction Not another video codec! Since the frst commercially viable video codec formats appeared in the early 1990s, we have seen the emergence of a plethora of compressed digital video formats, from MPEG-1 and MPEG-2 to recent codecs such as HEVC and VP9. Each new format offers certain advantages over its predecessors. However, the increasing variety of codec formats poses many questions for anyone involved in collecting, archiving and delivering digital video content, such as: ■■ Which codec format (if any) is best? ■■ What is a suitable acquisition protocol for digital video? ■■ Is it possible to ensure that early ‘born digital’ material will still be playable in future decades? ■■ What are the advantages and disadvantages of converting (transcoding) older formats into newer standards? ■■ What is the best way to deliver video content to end-users? In this article I explain how a video compression codec works and consider some of the practi- cal concerns relating to choosing and controlling a codec. I discuss the motivations behind the continued development of new codec standards and suggest practical measures to help deal with the questions listed above. 2. Codecs and compression 2.1 What is a video codec? ‘Codec’ is a contraction of ‘encoder and decoder’. A video encoder converts ‘raw’ or uncom- pressed digital video data into a compressed form which is suitable for storage or transmission. A video decoder extracts digital video data from a compressed fle, converting it into a display- able, uncompressed form.
    [Show full text]
  • Resolutions of 98Th Meeting Status
    INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N12254 Geneva, CH – December 2011 Source: Leonardo Chiariglione Title: Resolutions of 98th meeting Status Resolutions of 98th meeting 1 Reports ............................................................................................................................... 3 1.1 Meeting reports ............................................................................................................ 3 2 Resolutions related to MPEG-2........................................................................................... 3 2.1 Part 1 Systems............................................................................................................. 3 2.2 Part 2 Video ................................................................................................................ 3 2.3 Part 4 Conformance testing ......................................................................................... 4 3 Resolutions related to MPEG-4........................................................................................... 4 3.1 Part 4 Conformance testing ......................................................................................... 4 3.2 Part 5 Reference Software ........................................................................................... 4 3.3 Part 10 Advanced Video Coding .................................................................................
    [Show full text]