Introduction 1 Chapter 1: Introduction

Chapter 1 Introduction

A few short years ago, the applications for • MPEG-4.10 (H.264). This codec video were somewhat confined—analog was typically offers a 2–3× improvement in used for broadcast and cable , VCRs, compression ratio over MPEG-2. Addi- set-top boxes, , and camcorders. tional improvements in compression Since then, there has been a tremendous and ratios and quality are expected as the rapid conversion to digital video, mostly based encoders become better and use more on the MPEG-2 video compression standard. of the available tools that MPEG-4.10 Today, in addition to the legacy DV, (H.264) offers. Learning a lesson from MPEG-1, and MPEG-2 audio and video com- MPEG-4, MPEG-4.10 (H.264) is opti- pression standards, there are three new high- mized for implementing on low-cost sin- performance video compression standards. gle-chip solutions and has already been These new video codecs offer much higher adopted by the DVB and ARIB. video compression for a given level of video quality. • SMPTE 421M (VC-1). A competitor to MPEG-4.10 (H.264), this video codec • MPEG-4.2. This video codec typically also typically offers a 2–3× improvement offers a 1.5–2× improvement in com- in compression ratios over MPEG-2. pression ratio over MPEG-2. Able to Again, additional improvements in com- address a wide variety of markets, pression ratios and quality are expected MPEG-4.2 never really achieved wide- as the encoders become better. spread acceptance due to its complexity. Also, many simply decided to wait for the new MPEG-4.10 (H.264) video codec to become available.

1 2 Chapter 1: Introduction

Many more audio codecs are also available • Digital Set-Top Boxes. Cable and satellite as a result of the interest in 6.1- and 7.1-chan- set-top boxes are now including digital nel audio, multi-channel lossless compression, video recorder (DVR) capabilities, lower bit-rates for the same level of audio qual- allowing viewers to enjoy content at ity, and finally, higher bit-rates for applications their convenience. Use of MPEG-4.10 needing the highest audio quality at a reason- (H.264) and SMPTE 421M (VC-1) now able bit-rate. enables more channels of content and In addition to decoding audio, real-time reduces the chance of early product high-quality audio encoding is needed for obsolescence. DVD, HD DVD and Blu-ray recorders and digi- tal video recorders (DVRs). Combining all • Digital Televisions (DTV). In addition to these audio requirements mandates that any the tuners and decoders being incorpo- single-chip solution for the consumer market rated inside the television, some also incorporate a DSP for audio processing. include the digital media adapter capa- Equipment for the consumer has also bility. Support for viewing on-line video become more sophisticated, supporting a content is also growing. much wider variety of content and interconnec- • IPTV Set-Top Boxes. These low-cost set- tivity. Today we have: top boxes are gaining popularity in • HD DVD and Blu-ray Players and regions that have high-speed DSL and Recorders. In addition to playing CDs FTTH (fiber to the home) available. Use and DVDs, these advanced HD players of MPEG-4.10 (H.264) and SMPTE also support the playback of MPEG-4.10 421M (VC-1) reduces the chance of (H.264), and SMPTE 421M (VC-1) con- early product obsolescence. tent. Some include an Ethernet connec- • Portable Media Players. Using an inter- tion to enable content from a PC or nal hard disc drive (HDD), these play- media server to be easily enjoyed on the ers connect to the PC via USB or 802.11 television. network for downloading a wide variety • Digital Media Adapters. These small, of content. Playback of MPEG-2, MPEG- low-cost boxes use an Ethernet or 4.10 (H.264), SMPTE 421M (VC-1). and 802.11 connection to enable content JPEG content is typically supported. from a PC or media server to be easily • Mobile Video Receivers. Being incorpo- enjoyed on any television. Playback of rated into cell phones, MPEG-4.10 MPEG-2, MPEG-4.10 (H.264), SMPTE (H.264) and SMPTE 421M (VC-1) is 421M (VC-1), and JPEG content is typi- used to transmit a high-quality video sig- cally supported. nal. Example applications are the DMB, DVB-H and DVB-SH standards. Introduction 3

Of course, to make these advanced con- This book can be used by engineers who sumer products requires more than just sup- need or desire to learn about video, VLSI porting an audio and video codec. There is also design engineers working on new video prod- the need to support: ucts, or anyone who wants to evaluate or sim- ply know more about video systems. • , Subtitles, , and V-Chip. These standards were updated to support digital broadcasts. Contents • Advanced . Due to the wide range of resolutions for both con- The book is organized as follows: tent and displays, sophisticated high- Chapter 2, an Introduction to Video, dis- quality scaling and motion adaptive cusses the various video formats and signals, deinterlacing are usually required. where they are used, and the differences Since the standard-definition (SD) and between interlaced and progressive video. high-definition (HD) standards use dif- Block diagrams of DVD players and digital set- ferent colorimetry standards, this also top boxes are provided. needs to be corrected when viewing SD Chapter 3 reviews the common Color content on an HDTV or HD content on Spaces, how they are mathematically related, an SDTV. and when a specific color space is used. Color spaces reviewed include RGB, YUV, YIQ, • Sophisticated Image Composition. The YCbCr, xvYCC, HSI, HSV, and HLS. Consider- ability to render a sophisticated image ations for converting from a non-RGB to an composed of a variety of video, OSD RGB color space and gamma correction are (on-screen display), subtitle/caption- also discussed. ing/subpicture, text, and graphics ele- Chapter 4 is a Video Signals Overview that ments. reviews the video timing and the analog and • ARIB and DVB over IP. The complexity digital representations of various video for- of supporting IP video is increasing, mats, including , , , , , with deployments now incorporating , and . ARIB and DVB over IP. Chapter 5 discusses the Analog Video Interfaces, including the analog RGB, YPbPr, S- • Digital Rights Management (DRM). The Video, and SCART interfaces for consumer protection of content from unauthorized and pro-video applications. copying or viewing. Chapter 6 discusses the various Digital Video Interfaces for semiconductors, pro-video This fifth edition of Video Demystified has equipment, and consumer equipment. It been updated to reflect these changing times. reviews the BT.601 and BT.656 semiconductor Implementing real-world solutions is not easy, interfaces; the SDI, SDTI, and HD-SDTI pro- and many engineers have little knowledge or video interfaces; and the DVI, HDMI, and experience in this area. This book is a guide IEEE 1394 consumer interfaces. for those engineers charged with the task of Chapter 7 covers several Digital Video Pro- understanding and implementing video fea- cessing requirements such as 4:4:4 to 4:2:2 tures into next-generation designs. YCbCr, YCbCr digital filter templates, scaling, 4 Chapter 1: Introduction interlaced/noninterlaced conversion, frame Chapter 12 reviews the MPEG-1 video rate conversion, alpha mixing, flicker filtering, compression standard. and chroma keying. Brightness, contrast, satu- Chapter 13 discusses the MPEG-2 video ration, hue, and sharpness controls are also compression standard. discussed. Chapter 14 discusses the MPEG-4 video Chapter 8 provides an NTSC, PAL, and compression standard, including MPEG-4.10 SECAM Overview. The various composite ana- (H.264). log video signal formats are reviewed, along Chapter 15 discusses the ATSC Digital with video test signals. VBI data discussed Television standard used in the United States. includes timecode, closed captioning and Chapter 16 discusses the OpenCable™ Digi- (XDS), sig- tal Television standard used in the United naling and teletext. In addition, PALplus, RF States. modulation, BTSC, and Zweiton analog stereo Chapter 17 discusses the DVB Digital Tele- audio and NICAM 728 digital stereo audio are vision standard used in Europe and Asia. reviewed. Chapter 18 discusses the ISDB Digital Chapter 9 covers digital techniques used Television standard used in Japan. for the Encoding and Decoding of NTSC and Chapter 19 discusses IPTV. This technol- PAL color video signals. Also reviewed are var- ogy sends compressed video over broadband ious /chroma (Y/C) separation tech- networks such as Internet, DSL, FTTH (Fiber niques and their trade-offs. To The Home), etc. Chapter 10 discusses the H.261 and H.263 Finally, Chapter 20 is a glossary of over video compression standards used for video 400 video terms. If you encounter an unfamiliar teleconferencing. term, it likely will be defined in the glossary. Chapter 11 discusses the Consumer DV video compression standards used by digital camcorders. Introduction 5

Standards Organizations International Electrotechnical Commission (IEC) Many standards organizations, some of www.iec.ch which are listed below, are involved in specify- ing video standards. Institute of Electrical and Electronics Engineers (IEEE) Advanced Television Systems www.ieee.org Committee (ATSC) www.atsc.org International Organization for Standardization (ISO) Association of Radio Industries and www.iso.org Businesses (ARIB) www.arib.or.jp International Telecommunication Union (ITU) Cable Television Laboratories www.itu.int www.cablelabs.com Society of Cable Telecommunications Consumer Electronics Associations Engineers (SCTE) (CEA) www.scte.org www.ce.org Society of Motion Picture and Television Digital Video (DVB) Engineers (SMPTE) www.dvb.org www.smpte.org

Electronic Industries Alliance (EIA) Video Electronics Standards Association www.eia.org (VESA) www.vesa.org European Broadcasting Union (EBU) www.ebu.ch

European Telecommunications Standards Institute (ETSI) www.etsi.org