HEVC – Driving Disruption in Multiscreen Converged Service Delivery Architectures
Total Page:16
File Type:pdf, Size:1020Kb
HEVC – Driving Disruption in Multiscreen Converged Service Delivery Architectures Ken Morse, Arturo A. Rodriguez Cisco Systems Lawrenceville, GA Abstract – It has only been a handful of years since MPEG-2 Transport, according to the 19.4 Mbit/s limit AVC/H.264 ran riot through the video delivery chain and specified by ATSC A/53. However, MPEG-2 Video enabled a range of cross-device and cross-network services encoding technology progressed significantly through time to bloom and flourish. With the imminent publication of the resulting in bit-rate reductions to increase channel count – a HEVC/H.265 video coding standard from ITU-T VCEG and necessity given the limited spectrum availability. ISO/IEC MPEG enabling a similar breakthrough in relative bit-rate reduction, we are poised for potentially the fastest In response to the rise of HDTV content, H.264/MPEG-4 embraced codec ever seen. As an industry we need to be Part 10, commonly known as AVC (Advanced Video prepared to evolve our architectures to support and exploit Coding) was developed and first released as a standard in the full promise of HEVC. This paper evaluates how the 2003. The motivation for its adoption in the broadcast existing multiscreen video delivery architectures must evolve industry was to once again make better use of the limited to embrace HEVC and the challenges that must be overcome spectrum by reducing the bitrate for the bandwidth to provide cost-effective, scalable next generation HEVC- consuming MPEG-2 HDTV by a factor of two. The based services to consumers. This includes not only its use in introduction of AVC hit a sweet spot in the marketplace that services such as 4K or UltraHD video but also addressing enabled a range of new high quality video services across a the implications in the area of Cloud DVR. range of consumer devices. DSL providers were now able to offer HDTV services over their lower bandwidth lines and INTRODUCTION extend reach to subscribers farther out, and some satellite Video encoding technology has come a long way in terms of operators (notably DirecTV in the US) switched their entire compression performance, picture quality for a given bit- HDTV channel lineup to utilize AVC (requiring the mass rate, over the last twenty years. It is hard to believe that upgrade of installed receivers to AVC-capable ones) in order MPEG-1 was first ratified in August 1993 heralding the start to support a larger channel line-up of HDTV programming. of digital video distribution with target bitrates in the 1.5Mbit/s range. In addition to being the first worldwide A range of new devices, in addition to existing PCs, embraced standard for video encoding it should be noted that leveraging the H.264/MPEG standard have subsequently the same standards body delivered the MP3 audio codec come to market including Blu-ray (2006), XBOX 360 specification that is prevalent today across the delivery (2005), Playstation 3 (2006), AVCHD for digital camcorders environment for digital music. (2006), iPod/iPod Touch/iPhone (2007) and start of tablet devices with the iPad in 2010. Whilst MPEG-1 was primarily focused on the delivery of digital video on physical medium, e.g., CD-ROM, With the combined increase in broadband penetration and subsequent standards work in MPEG yielded the MPEG-2 access bandwidth, a large number of OTT (Over The Top) Video specification first ratified in 1995, published by broadband video services have leveraged this installed base MPEG as ISO/IEC 13818-2 and by ITU as ITU-T and the use of AVC for video distribution including iTunes Recommendation H.262. Although similar to MPEG-1, (2005) and Netflix (2007). In the case of Netflix, and many MPEG-2 Video included extensions to address a wider range other OTT providers, content is delivered using adaptive bit- of applications, in particular support for compression of rate schemes that segment the stream into fixed chunks and interlaced analog video, which at the time was ubiquitous the client requests content from a preset number of bit-rate throughout the broadcast industry. Consequently, the profiles based on a combination of current network primary application targeted during the MPEG-2 definition bandwidth availability and client performance. phase was the all-digital transmission of broadcast television quality video coded at bitrates between 4 and 9 Mbit/s. At the time of writing, MPEG-2 and AVC are the However, the MPEG-2 Video syntax has been found to be predominant video compression formats used in the delivery efficient for other applications such as those at higher bit- of broadcast HDTV with AVC being predominant in the rates and sample rates such as HDTV. Initial HDTV delivery of broadband video content. broadcast channels using MPEG-2 Video along with associated captions and audio were delivered multiplexed in HIGH EFFICIENCY VIDEO CODING (HEVC) Prediction Units 16x16 to 4x4 Better: 64x64 to 4x4 (4x4 only in (PUs) Intra) Adds asymmetrical To date there has been very limited embracement on rectangular PUs for non-Intra extending the predominant HDTV picture format from Intra Prediction 9 - 8 Angular 35 - 33 Angular Modes 1280x720p at 60 Hz and 1920x1080i at 60 Hz to Inter Prediction Uni-, Bi- Uni-, Bi-prediction. Better sub-pixel 1920x1080p at 60Hz for broadcast delivery. This is due to Modes prediction interpolation filters. Better Merge its high bandwidth requirements as a result of at least Mode doubling the samples per second, and that a 50% bit-rate Motion Vector Basic Advanced MVP – Comprehensive Prediction (spatial/temporal) 1-bit switch reduction was seen as pre-requisite if that or any higher Transform Units 8x8 or 4x4 32x32 to 4x4 – Adaptable via format was to be embraced. (TUs) Quadtree splitting Post Filters (In- One: De- Two: De-blocking & SAO (sample In 2004, the ITU-T VCEG (Video Coding Experts Group) Loop) blocking adaptive offset) began investigations into advances that could enable the Entropy Coding CAVLC, CABAC (Simplified) creation of a new video compression standard or, CABAC alternatively, offer substantial enhancements to the Profiles Several Main, H.264/MPEG-4 AVC standard. Main 10 Main Still Picture (JPEG-like) The ISO/IEC Moving Picture Experts Group (MPEG) began a similar project in 2007, initially named High Performance TABLE 1 COMPARISON OF CODING TOOLS FOR HEVC AND AVC Video Coding with a target of reducing the bit-rate by 50% over H.264/MPEG-4 AVC High Profile. By mid-2009 efforts in this group had shown an average bit-rate reduction Coding Performance of around 20% and a decision was made to initiate its With the coding tools available today in HEVC it has been standardization effort in collaboration with VCEG. demonstrated that for the same subjective image quality the bit-rate can be reduced by 50% versus AVC. As was seen In January 2010 a formal joint Call for Proposals (CfP) on with the introduction of prior compression standards, we can video compression technology was issued by VCEG and expect improvements as more optimizations are carried out MPEG. A total of 27 full proposals were submitted and through the vendor encoding community. This reduction in evaluated at the first meeting of the MPEG and VCEG Joint bit-rate can be utilized in two ways; reducing the bit-rate for Collaborative Team on Video Coding (JCT-VC), which took existing services (including the delivery of services over place in April 2010. Evaluations showed that some of the constrained bandwidth links) or enabling higher quality proposals could reach the same subjective image quality as services such as 4K. H.264/MPEG-4 AVC at half the bit-rate at a cost of 2x to 10x increase in computational complexity. At this meeting, It is important to acknowledge the impact on encode and the name High Efficiency Video Coding (HEVC) was decode complexity associated with HEVC. adopted for the joint project. Moving forward the JCT-VC integrated elements of some of the best proposals into a Encode Complexity single software codebase and performed further experiments The encode complexity has increased over AVC with a to evaluate a range of proposed features. projected factor that ranges between 10x and 12x. The first working draft specification of HEVC was produced The continued technology progression of GPU and multi- in October 2010 at the third JCT-VC meeting. Subsequently core processors in general computing devices found many changes have been made to the specification and the previously only in powerful workstations have begun a committee draft specification was released in February 2012. migration to both general purpose servers and CE devices, At the time of writing the specification freeze is anticipated such as tablets and handheld devices, mainly as a result of at the January 2013 meeting with final publication of the smaller silicon geometries that consume considerably less HEVC standard in the May to June 2013 timeframe under power. Multi-core processors with respective hardware the specification titles ISO/IEC 23008-2 MPEG-H Part 2 acceleration units for media processing are finding wide use and ITU-T Rec. H-265. in CE devices as a result of a the counterpart progression of the software application development tools that provision Table 1 illustrates the primary encoding features of AVC acceleration capabilities of these architectures, such as and the relative improvements offered by HEVC. multi-threading of numerical intensive computation in media processing operations. Consequently, these devices now Coding Tools AVC HEVC Picture Grid Macroblock 64x64, 32x32, 16x16 Coding Tree extend parallel processing capabilities and just in time for (MB) 16x16 Units (CTUs) HEVC to exploit such parallel media processing Coding Mode Largest = Finer, size adaptable: 64x64 to 8x8 capabilities.