Signals and Communication Technology More Information About This Series at Mathias Wien

Signals and Communication Technology More information about this series at http://www.springer.com/series/4748 Mathias Wien

High Efﬁciency Video Coding Coding Tools and Speciﬁcation

123 Mathias Wien Institut für Nachrichtentechnik RWTH Aachen University Aachen Germany

ISSN 1860-4862 ISSN 1860-4870 (electronic) ISBN 978-3-662-44275-3 ISBN 978-3-662-44276-0 (eBook) DOI 10.1007/978-3-662-44276-0

Library of Congress Control Number: 2014944714

Springer Heidelberg New York Dordrecht London

Ó Springer-Verlag Berlin Heidelberg 2015 This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Exempted from this legal reservation are brief excerpts in connection with reviews or scholarly analysis or material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Duplication of this publication or parts thereof is permitted only under the provisions of the Copyright Law of the Publisher’s location, in its current version, and permission for use must always be obtained from Springer. Permissions for use may be obtained through RightsLink at the Copyright Clearance Center. Violations are liable to prosecution under the respective Copyright Law. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. While the advice and information in this book are believed to be true and accurate at the date of publication, neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. The publisher makes no warranty, express or implied, with respect to the material contained herein.

Printed on acid-free paper

Springer is part of Springer Science+Business Media (www.springer.com) Preface

Since the first publication of the video coding standard H.264 | AVC in 2003, the video world has changed. Video content has become a major fraction of digital network traffic worldwide and is still growing. The demand for HD and Ultra HD video (with picture resolutions of 4K Â 2K and more) increases, inducing even higher bandwidth needs. The established standard H.264 | AVC is used for HD content while having been developed mainly for resolutions around standard definition television. The standardization effort for ‘‘High Efficiency Video Coding’’ (HEVC) answers the demand for improved compression performance at resolutions of HD and beyond. The design of the included coding tools enables video compression to the desired degree in conjunction with implementation friendliness and options for parallelization at multiple levels. It is expected to be widely adopted for video services at HD and Ultra HD quality, providing Ultra HD video at similar bitrates as used for HD video today. Based on the known concepts of the well-established hybrid coding scheme, new coding structures and better coding tools have been developed and specified for HEVC. The new standard is expected to be taken up easily by established industry as well as new endeavors, answering the needs of today’s connected and ever-evolving online world. This book presents the standard and strives to explain it in a clear and coherent language. It provides a comprehensive and consistently written description of the applied concepts and coding tools. For synchronization of beginners in the field, a chapter on the fundamentals of video coding is included. It provides a general overview on the elements of video coding systems, the representation of color video, and an introduction of the building blocks of the hybrid coding scheme. Another chapter is dedicated to the topic of specification by itself; it deals with requirements on specification text and with imposed fundamental technological guidelines. The understanding of these principles is utile for assessment of the

v vi Preface algorithmic design at present as well as for future development of extensions and potential additional coding tools. The following chapters follow the structure of the HEVC specification, giving insight to the design and concepts of the coding tools in the specification. The book shall help readers to understand the state-of-the-art concepts of video coding with HEVC as their latest instantiation. It shall contribute to the promul- gation of the HEVC standard and provide support in adopting it for new and fascinating applications. Examples in the chapters make use of bitstreams and test sequences according to the common testing conditions of the Joint Collaborative Team on Video Coding (JCT-VC). Bitstreams according to these conditions were frequently made public on the JCT-VC experts mailing list by the reference software coordinators. Different versions of these bitstreams have been used as anchors in numerous tests and extensive experiments throughout the HEVC development. Coding examples in this book are given for the test sequence BasketballDrive, provided courtesy of NTT DOCOMO, Inc., Japan, and ParkScene, provided courtesy of Tokyo Institute of Technology, Nakajima Laboratory, Japan. Examples for the sequences of the JCT-VC common testing conditions further include BlowingBubbles and RaceHorses, provided courtesy of NTT DOCOMO, Inc., Japan; ChinaSpeed, provided courtesy of Shanghai Shulong Computer Technology Co., Ltd., China; FourPeople, provided courtesy of Vidyo Inc., USA; and PeopleOnStreet, provided courtesy of Samsung Electronics Co., Ltd., Korea. Hundreds of experts in the JCT-VC have worked hard, spending time in never- ending meetings with tremendous numbers of input contributions to achieve the goal of a stable high-quality high-performance specification. Their contribution and commitment are highly appreciated. The standardization work has been car- ried out under the prudent and stimulating lead of the JCT-VC chairs Gary J. Sullivan and Jens-Rainer Ohm. Their thoughtful and precise guidance is specifically appreciated. It formed and coined this collaborative team. This book would have not been possible without help and support from several people. I want to thank an uncounted number of JCT-VC experts for numerous conversations and debates on various aspects of the specification. Special thanks go to T. K. Tan and Andrew Segall for manifold and insight-full discussions over the years; and to Benjamin Bross who knew all answers to questions on the specification. Very special thanks go to Rickard Sjöberg for his expertise and helpful comments on picture types and reference picture management; and specifically to Peter Amon for his comprehensive and remarkably careful text review. Peter, I owe you more than a beer. Special thanks for review and support also go to people at Institut für Nachrichtentechnik of RWTH Aachen University: Julian Becker, Max Bläser, Christopher Bulla, Olena Chubach, Christian Feldmann, Iris Preface vii

Heisterklaus, Cordula Heithausen, Fabian Jäger, Ningqing Qian, Inge Reissel, Christian Rohlﬁng, and Uday Thakur; very special thanks to Bastian Cellarius who helped generating the example ﬁgures. Most special thanks go to Prof. Jens-Rainer Ohm for providing distinct leadership, kind mentoring, and encouraging guidance. Thank you for providing me room to write this book. It is an outstanding experience and honor to work in your team. The warmest thanks go to my wonderful family: Sabine and our children Frederic, Leonard, and Marlene.

Aachen, May 2014 Mathias Wien Contents

1 Introduction ...... 1 1.1 How to Read This Book ...... 1 1.2 A Brief Walk Through the History of Video Coding Standards...... 2 1.2.1 Advanced Video Coding ...... 5 1.2.2 High Efficiency Video Coding ...... 5 1.3 Evolution of a Specification...... 6 1.3.1 Formal Procedure for a Standard in ISO/IEC ...... 8 1.3.2 Formal Procedure for a Recommendation intheITU-T...... 10 1.4 The Joint Collaborative Team on Video Coding...... 12 1.4.1 Approval Process ...... 13 1.4.2 Method of Working ...... 14 1.4.3 Deliverables...... 15 1.4.4 Structure of the JCT-VC ...... 16 References ...... 19

2 Video Coding Fundamentals ...... 23 2.1 Video Coding Systems ...... 23 2.1.1 Video Acquisition...... 24 2.1.2 Pre-processing ...... 25 2.1.3 Encoding ...... 25 2.1.4 Transmission ...... 26 2.1.5 Decoding...... 26 2.1.6 Post-processing ...... 27 2.1.7 Display ...... 27 2.2 Structure of a Video Sequence ...... 28 2.2.1 Pictures, Frames, and Fields...... 28 2.2.2 Sample Shape ...... 29 2.3 Representation of Color...... 30

ix x Contents

2.3.1 The CIE Standard Observer ...... 31 2.3.2 Color Primaries ...... 32 2.3.3 Display Transfer Characteristics ...... 32 2.3.4 Color Conversion ...... 33 2.3.5 Chroma Sub-sampling...... 35 2.4 The Hybrid Video Coding Scheme ...... 37 2.4.1 Picture Partitioning ...... 39 2.4.2 Intra Prediction ...... 40 2.4.3 Inter Prediction ...... 41 2.4.4 Motion Estimation ...... 43 2.4.5 Residual Coding...... 43 2.4.6 In-loop Filtering ...... 53 2.4.7 The Decoded Picture Buffer ...... 55 2.4.8 Entropy Coding ...... 55 2.5 Encoder Control ...... 62 2.5.1 Distortion Measures ...... 63 2.5.2 Rate-Distortion Optimization ...... 65 2.6 Compression Artifacts ...... 66 References ...... 69

3 Design and Speciﬁcation ...... 73 3.1 Specification Fundamentals ...... 74 3.1.1 Interoperability...... 74 3.1.2 Specification Scope ...... 75 3.1.3 Text Classification ...... 75 3.1.4 Editing Perspective ...... 76 3.2 Specification Elements ...... 77 3.2.1 Syntax and Semantics ...... 77 3.2.2 Decoding Process ...... 78 3.2.3 Parsing Process ...... 78 3.3 Specification Principles ...... 79 3.3.1 Loss Robustness ...... 79 3.3.2 Independent Parsing ...... 80 3.3.3 Bit-Exact Specification ...... 81 3.3.4 Parallelization ...... 81 3.3.5 Dynamic Range ...... 82 3.3.6 Timing ...... 83 3.4 Conformance ...... 83 3.5 How to Read the Specification Text ...... 84 3.5.1 Terminology ...... 86 3.5.2 Conventions and Geometric Relations...... 88 Contents xi

3.6 Drafting Methodology ...... 91 3.6.1 Measuring the Compression Performance ...... 92 3.6.2 Proposal Assessment...... 97 References ...... 99

4 Coding Structures ...... 101 4.1 Temporal Coding Structures...... 102 4.1.1 Temporal Layers ...... 105 4.1.2 Picture Types...... 106 4.1.3 Splicing of Video Sequences ...... 112 4.1.4 Comparison to H.264 j AVC...... 113 4.2 Spatial Coding Structures ...... 114 4.2.1 Blocks and Units ...... 114 4.2.2 Slices and Slice Segments ...... 115 4.2.3 Tiles ...... 118 4.2.4 Coding Tree Block and Coding Block...... 120 4.2.5 Prediction Block...... 121 4.2.6 Transform Tree and Transform Block ...... 122 4.2.7 Comparison to H.264 j AVC...... 123 4.3 Reference Pictures ...... 124 4.3.1 Reference Picture Sets ...... 125 4.3.2 Reference Picture Lists ...... 128 4.3.3 Short-Term Reference Picture Set Signaling ...... 130 4.3.4 Long-Term Reference Picture Set Signaling ...... 130 4.3.5 Comparison to H.264 j AVC...... 131 References ...... 132

5 High-Level Syntax ...... 133 5.1 Byte Stream Format ...... 133 5.2 Network Abstraction Layer ...... 134 5.2.1 NAL Unit Structure ...... 134 5.2.2 NAL Unit Types ...... 136 5.2.3 Access Units ...... 139 5.2.4 Decoding Units ...... 140 5.3 Parameter Sets ...... 140 5.3.1 Video Parameter Set ...... 143 5.3.2 Sequence Parameter Set ...... 144 5.3.3 Picture Parameter Set ...... 144 5.4 Slice Segment Header ...... 145 5.4.1 Picture Order Count ...... 145 5.5 Supplemental Enhancement Information ...... 147 xii Contents

5.6 Hypothetical Reference Decoder...... 149 5.6.1 Coded Picture Buffer ...... 150 5.6.2 Decoded Picture Buffer ...... 152 5.6.3 Sub-picture Operation ...... 152 5.6.4 Operation Points...... 153 5.6.5 Conformance Points ...... 153 5.6.6 Signaling HRD Parameters in the VPS and SPS. . . . . 154 5.7 Video Usability Information...... 154 5.7.1 Geometrical Relations ...... 154 5.7.2 Video Signal Type and Color Information ...... 155 5.7.3 Frame/Field Indication ...... 155 5.7.4 Default Display Window ...... 156 5.7.5 Timing Information ...... 156 5.7.6 Bitstream Restrictions ...... 157 5.8 Comparison to H.264 j AVC...... 158 References ...... 159

6 Intra Prediction ...... 161 6.1 Prediction Mode and Prediction Block ...... 162 6.2 Reference Samples for Intra Prediction ...... 163 6.2.1 Reference Construction ...... 163 6.2.2 Lowpass Smoothing ...... 165 6.2.3 Strong Smoothing for 32 Â 32 Luma Reference Samples ...... 166 6.3 Planar Intra Prediction...... 166 6.4 DC Intra Prediction...... 167 6.5 Angular Intra Prediction ...... 168 6.5.1 One-Dimensional Prediction Reference ...... 168 6.5.2 Interpolated Prediction ...... 169 6.5.3 Horizontal and Vertical Intra Prediction ...... 170 6.6 Signaling and Predictive Coding of Intra Prediction Modes . . . 172 6.6.1 Luma Intra Prediction Mode ...... 172 6.6.2 Derivation of the Chroma Intra Prediction Mode . . . . 174 6.7 Intra Coding Example ...... 175 6.8 Comparison to H.264 j AVC...... 176 References ...... 177

7 Inter Prediction ...... 179 7.1 Motion Compensated Prediction ...... 179 7.1.1 Uni-prediction and Bi-prediction ...... 180 7.1.2 Coding Block Partitioning into Prediction Blocks. . . . 181 7.1.3 Weighted Prediction ...... 183 Contents xiii

7.2 Motion Vector Representation ...... 184 7.2.1 Motion Data Storage Reduction ...... 184 7.2.2 Merging Motion Vectors ...... 185 7.2.3 Predictive Motion Vector Coding ...... 188 7.2.4 Signaling ...... 190 7.3 Sub-Sample Interpolation...... 191 7.3.1 Luma Sub-Sample Interpolation Filtering ...... 191 7.3.2 Chroma Sub-Sample Interpolation Filtering ...... 192 7.3.3 Derivation of the Interpolation Filter Coefficients. . . . 194 7.4 Inter Coding Examples ...... 197 7.5 Comparison to H.264 j AVC...... 198 7.5.1 Motion Vector Representation ...... 198 7.5.2 Sub-Sample Interpolation ...... 200 References ...... 202

8 Residual Coding ...... 205 8.1 Transforms and Quantization ...... 206 8.1.1 Integer DCTs ...... 206 8.1.2 Integer 4 Â 4DST...... 210 8.1.3 Dynamic Range and Transform Normalization...... 211 8.1.4 Quantizer Design ...... 213 8.1.5 Quantizer Weighting Matrix ...... 216 8.1.6 Decoder-Side Weighting and Level Scaling Operation ...... 218 8.1.7 Signaling of the Quantization Parameter ...... 218 8.2 Coded Representation of Transform Blocks ...... 219 8.2.1 Transform Sub-Blocks...... 219 8.2.2 Last Significant Coefficient Position ...... 220 8.2.3 Transform Block Coefficient Coding ...... 221 8.2.4 Sign Data Hiding ...... 223 8.3 Transform Skip ...... 224 8.4 Transform and Quantization Bypass ...... 224 8.5 PCMCoding...... 225 8.6 Comparison to H.264 j AVC...... 225 References ...... 226

9 In-Loop Filtering ...... 229 9.1 Deblocking Filter ...... 229 9.1.1 Determination of Edges...... 230 9.1.2 Determination of the Deblocking Filter Strength Parameter ...... 231 9.1.3 Deblocking Filtering ...... 233 9.1.4 Deblocking Filter Example ...... 240 xiv Contents

9.2 Sample Adaptive Offset ...... 241 9.2.1 Edge Offset ...... 242 9.2.2 Band Offset ...... 243 9.2.3 Signaling of SAO Parameters...... 244 9.2.4 SAO Filter Example ...... 245 9.2.5 Encoder-Side Derivation of Sample Adaptive Offset Parameters ...... 245 9.3 Comparison to H.264 j AVC...... 249 References ...... 250

10 Entropy Coding ...... 251 10.1 Fixed- and Variable-Length Coding ...... 252 10.1.1 Fixed-Length Codes ...... 252 10.1.2 Exp-Golomb Codes...... 253 10.2 CABAC—Context-Based Adaptive Binary Arithmetic Coding ...... 253 10.2.1 Process Overview ...... 254 10.2.2 Binary Arithmetic Coding ...... 255 10.2.3 Binarization ...... 266 10.2.4 Context Initialization...... 274 10.2.5 Context Selection ...... 275 10.3 Comparison to H.264 j AVC...... 281 References ...... 282

11 Proﬁles, Tiers, and Levels...... 283 11.1 Profiles ...... 284 11.1.1 Main Profile ...... 285 11.1.2 Main 10 Profile ...... 285 11.1.3 Main Still Picture Profile...... 286 11.2 Tiers and Levels...... 286 11.3 Syntax Structure ...... 287 References ...... 289

12 Extensions to HEVC...... 291 12.1 Range Extensions ...... 292 12.1.1 Proposed RExt Profiles ...... 292 12.1.2 Proposed RExt Tools ...... 293 12.1.3 Comparison to H.264 j AVC...... 295 12.2 Common Specification Structure for Multi-Layer Video Coding Extensions ...... 295 12.2.1 Definition of Layers ...... 296 12.2.2 Proposed Joint Tools...... 297 Contents xv

12.3 Multiview Coding...... 299 12.3.1 Proposed Multiview Profile ...... 300 12.3.2 Comparison to H.264 j AVC...... 300 12.4 Scalable Extension ...... 301 12.4.1 Proposed SHVC Profile...... 301 12.4.2 Proposed SHVC Tools ...... 301 12.4.3 Comparison to H.264 j AVC...... 304 12.5 3D Video Coding ...... 305 References ...... 306

Index ...... 309 Symbols and Operators

Mathematical Functions and Operators jjÁ Absolute value bÁc Round to lower integer value dÁe Round8 to higher integer value < a; if v\a Clip{a,b,v} ¼ : v; if a v b b; if b\v mod Modulo operatorÄÅ round{v} 1 ¼ 8sgnðvÞ jjv þ 2 < 1; if v [ 0 sgn(v) ¼ : 0; if v ¼ 0 À1ifv\0

Bit-Wise Operators

& Bit-wise ‘and’ operation | Bit-wise ‘or’ operation x y Bit-shift to the right of binary representation of x by y bits. Integer division by 2y, y C 0 x y Bit-shift to the left of binary representation of x by y bits. Integer multiplication with 2y,yC 0

Variables

Bd Bit depth 1id Layer identiﬁer in the NAL unit header

xvii xviii Symbols and Operators

NL Number of lines in picture NP Number of pixels (samples) per line in picture tid Temporal sub-layer identiﬁer in the NAL unit header

Codes and Binarization

Btp;nðvÞ Binarization of value v with type ‘tp’ and parameter n Ctp;nðvÞ VLC for value v of type ‘tp’ and parameter n i Ctp;nðcÞ Return symbol value for code word c of VLC type ‘tp’ and parameter n Acronyms

This list collects the acronyms used in this book. It further includes some acronyms which have been established during the work of the JCT-VC on HEVC, and others which are commonly used in the context of video coding. Marked acronyms (*) indicate deprecated naming conventions or refer to tools which have not been adopted into the HEVC speciﬁcation. If acronyms relate to the H.264 | AVC speciﬁcation, a corresponding indication is given. For acronyms that are used in this book, a reference to the relevant chapter or section is provided to facilitate access.

3D-HEVC 3D high efficiency video coding (Sect. 12.5) AAC Advanced audio coding AAP Alternative Approval Process (Sect. 1.3.2) AhG Ad hoc group AI All intra (JCT-VC CTC, Sect. 3.6.1.1) AIF* Adaptive interpolation filter ALF* Adaptive loop filter AMP Asymmetric motion partitioning (Sect. 7.1.2) AMVP Advanced motion vector prediction (Sect. 7.2.3) ANG* Angular intra prediction (see Sect. 6.5) APS Adaptation parameter set (Sect. 5.3.1) ASO Arbitrary slice ordering (H.264 | AVC, Sect. 4.2.7) AU Access unit (Sect. 5.2.3) AUD Access unit delimiter (Sect. 5.2.2) AVC Advanced video coding BLA Broken link access [picture] (Sect. 4.1.2.1) BD Bjøntegaard delta measurement (Sect. 3.6.1.3) BL Base layer (Sect. 12.4) BO SAO band offset (Sect. 9.2) BoG Break-out group (Sect. 1.4.4) BP Bandpass [filter]

xix xx Acronyms

BPB Bitstream partition buffer (Sect. 12.2) CABAC Context-based adaptive binary arithmetic coding (Sect. 10.2) CAVLC Context adaptive variable length coding (Sect. 2.4.8) CB Coding block (Sect. 4.2.4) CBF* Coded block flag (see Sect. 8.2.1) CBP Coded block pattern (H.264 | AVC, Sect. 4.2.7) CBR Constant bitrate (Sect. 5.6.1) CD Committee draft (Sect. 1.3.1) CD Compact disk CE Core experiment (Sect. 1.4.4) CfE Call for evidence (Sect. 1.3.1) CfP Call for proposals (Sect. 1.3.1) CIE Commission internationale de l’éclairage (Sect. 2.3.1) CIF Common interchange format 352 9 288 (Sect. 11.2) CPB Coded picture buffer (Sect. 5.6.1) CRA Clean random access point (Sect. 4.1.2.1) CRFB* Compressed reference frame buffer (see Sect. 7.2.1) CRT Cathode ray tube CS Constraint set (in CfP) CSS Coded slice segment (Sect. 5.2.3) CT Collaborative team (Sect. 1.4.1) CTB Coding tree block (Sect. 4.2.4) CTC Common testing conditions (Sect. 3.6.1) CTU Coding tree unit (Sect. 4.2.4) CTX CABAC context (Sect. 10.2) CU Coding unit (Sect. 4.2.4) CVS Coded video sequence (Sect. 4.1) DAM Draft amendment (Sect. 1.3.1) DC Direct current DCT Discrete cosine transform (Sect. 2.4.5.2) DCTIF DCT interpolation filter (Sect. 7.3.3) DIF* DCT interpolation filter, syn. DCTIF (Sect. 7.3.3) DIF* Directional interpolation filter DIS Draft international standard (Sect. 1.3.1) DLP* Decodable leading picture, syn. RADL (Sect. 4.1.2.2) DMVD Decoder side motion vector derivation DPB Decoded picture buffer (Sect. 5.6.2) DPCM Differential pulse code modulation DST Discrete sine transform (Sect. 2.4.5.3) DU Decoding unit (Sect. 5.2.4) DUT* Directional unified transform (see Sect. 8.1.2) DVD Digital versatile disk EG Exp-Golomb code (Sect. 2.4.8.4) EL Enhancement layer (Sect. 12.4) EO SAO edge offset (Sect. 9.2) Acronyms xxi

EOB End of bitstream (Sect. 5.2.2) EOS End of sequence (Sect. 5.2.2) EOTF Electro-optical transfer function (Sect. 2.3.3) FCD Final committee draft (Sect. 1.3.1) FD Filler data (Sect. 5.2.2) FDAM Final draft amendment (Sect. 1.3.1) FDIS Final draft international standard (Sect. 1.3.1) FLC Fixed length code (Sects. 2.4.8.2 and 10.1) FMO Flexible macroblock ordering (H.264 | AVC, Sect. 4.2.7) fps Frames per second FRExt Fidelity range extensions (of H.264 | AVC, Sect. 12.1) GRD Gradual decoder refresh (H.264 | AVC) GOP Group of pictures (Sect. 4.1) HD High definition (Sect. 11.2) HDTV High definition television HEVC High efficiency video coding HM HEVC test model (Sect. 1.2.2) HP Highpass [filter] HRD Hypothetical reference decoder (Sect. 5.6) HSS Hypothetical stream scheduler (Sect. 5.6) HTM 3D-HEVC test model (Sect. 12.5) HVC* High performance video coding (name of HEVC pre-project in MPEG) HVS Human visual system (Sect. 2.1.7) IBDI* Internal bit-depth increase (see Sect. 3.3.5) IDCT Inverse discrete cosine transform (Sect. 2.4.5.2) IDR Instantaneous decoder refresh (Sect. 4.1.2.1) IEC International Electrotechnical Commission IEEE Institute of electrical and electronics engineers IRAP Intra random access point (Sect. 4.1.2.1), see also RAP IS International standard (Sect. 1.3.1) ISDN Integrated services digital network ISO International organization for standardization ITU International telecommunication union JCT Joint collaborative team (of ISO and ITU) JCT-VC Joint collaborative team on video coding JCT-3V Joint collaborative team on 3D video coding extension development JM Joint model (AVC test model) JPEG Joint photographic experts group JTC Joint technical committee (Sect. 1.3.1) JVT Joint video team (Sect. 1.2.1) KLT Karhunen–Loéve transform (Sect. 2.4.5) KTA Key technical areas (H.264 based exploration software of VCEG) LCTB* Largest coded tree block, syn. CTB LCTB* Largest coded tree unit, syn. CTU xxii Acronyms

LCU* Larges coding unit, syn. CTU LD Low delay (JCT-VC CTC, Sect. 3.6.1.1) LP Lowpass [filter] LPS Least probably symbol (Sect. 2.4.8.5) LSB Least significant bit MAC Multiplexed analog components (Sect. 5.7.2) MANE Media aware network element MB Macroblock (H.264 | AVC, Sect. 4.2.7) MBAFF Macroblock adaptive frame/field coding (H.264 | AVC, Sect. 4.2.7) MC Motion compensation (Sect. 2.4.3) MDDT* Mode dependent directional transform (see Sect. 8.1.2) ME Motion estimation (Sect. 2.4.4) MMCO Memory management control operation (H.264 | AVC, Sect. 5.8) MP3 MPEG-2 audio layer III MPEG Moving picture experts group (Sect. 1.3.1) MPM Most probable mode (Sect. 6.6) MPS Most probably symbol (Sect. 2.4.8.5) MSB Most significant bit MSE Mean squared error MV Motion vector (Chap. 7) MVC Multiview video coding (H.264 | AVC, Chap. 12) MVD Motion vector difference (Sect. 7.2.3) MV-HEVC Multiview high efficiency video coding (Sect. 12.3) NAL Network abstraction layer (Sect. 5.2) NALU NAL unit (Sect. 5.2.1) NB National body (in ISO) NGVC* Next generation video coding (name of HEVC pre-project in VCEG) NTSC National television systems committee (Sect. 5.7.2) NUH NAL unit header (Sect. 5.2) NUT NAL unit type (Sect. 5.2) PAL Phase alternating line (Sect. 5.7.2) PAFF Picture adaptive frame/field coding (H.264 | AVC, Sect. 4.2.7) PB Prediction block (Sect. 4.2.5) PCM Pulse code modulation (Chap. 8) PDAM Proposed draft amendment (Sect. 1.3.1) PPS Picture parameter set (Sect. 5.3.1) PSNR Peak signal to noise ratio (Sect. 2.5.1.4) POC Picture order count (Sect. 5.4.1) PU Prediction unit (Sect. 4.2.5) QCIF Quarter common intermediate format 176 9 144 (Sect. 11.2) QHD Quarter high definition 960 9 540 (Sect. 11.2) QP Quantization parameter (Sect. 2.4.5.6) RA Random access (JCT-VC CTC, Sect. 3.6.1.1) RADL Random access decodable leading picture (Sect. 4.1.2.2) Acronyms xxiii

RAP Random access point (Sect. 4.1.2.1) RASL Random access decodable skipped picture (Sect. 4.1.2.2) RBSP Raw byte sequence payload (Sects. 5.2.1 and 10.1.1) RD Rate-distortion (Sect. 2.5.2) RDO Rate-distortion optimization (Sect. 2.5.2) RDOQ Rate-distortion optimized quantization (Sect. 8.1.7) RExt HEVC Range extensions (Sect. 12.1) RGB Red green blue, color format (Sect. 2.3.4) RPL Reference picture list (Sect. 4.3.2) RPS Reference picture set (Sect. 4.3.1) RQT Residual quadtree (Sect. 8.2) RTP Real-time transport protocol (Sect. 5.1) SAD Sum of absolute differences (Sect. 2.5.1.2) SAO Sample adaptive offset (Sect. 9.2) SAR Sample aspect ration (Sect. 5.7) SATD Sum of absolute transformed differences (Sect. 2.5.1.3) SC Sub-committee (Sect. 1.3.1) SD Standard definition (TV) SDH Sign data hiding (Sect. 8.2.4) SECAM Séquentiel couleur á mémoire (Sect. 5.7.2) SEI Supplemental enhancement information (Sect. 5.5) SG Study group (Sect. 1.3.2) SHVC Scalable high efficiency video coding (Sect. 12.4) SODB String of data bits (Sect. 5.2.1) SOP Structure of pictures (Sect. 5.5), see also GOP SPS Sequence parameter set (Sect. 5.3.2) SSD Sum of squared differences (Sect. 2.5.1.1) SSE Sum of squared error (Sect. 2.5.1.1) STSA Stepwise temporal sub-layer access (Sect. 4.1.2.3) SVC Scalable video coding (H.264 | AVC, Chap. 12) TB Transform block (Sect. 4.2.6) TE Tool experiment (Sect. 3.6.2.2) TFD* Tagged for discard [picture], syn. RASL (Sect. 4.1.2.2) TMuC Test model under consideration (Sect. 3.6.2.2) TMVP Temporal motion vector predictor (Sect. 7.2.2.2) TR Truncated Rice [binarization] (Sect. 10.2.3) TSA Temporal sub-layer access (Sect. 4.1.2.3) TSB Transform sub-block (Sect. 8.2.1) TSB Telecommunication standardization bureau (Sect. 1.3.2) TU Transform unit (Sect. 4.2.6) TV Television UHD Ultra high definition (Sect. 11.2) VBR Variable bitrate (Sect. 5.6.1) VCEG Visual coding experts group (Sect. 1.3.2) VCL Video coding layer (Chap. 5) xxiv Acronyms

VGA Video graphics array 640 9 480 (Sect. 11.2) VLC Variable length code (Sects. 2.4.8.2 and 10.1) VPS Video parameter set (Sect. 5.3.1) VUI Video usability information (Sect. 5.7) WD Working draft (Sect. 1.3.1) WG Working group (Sect. 1.3.1) WPP Wavefront parallel processing (Sect. 4.2.2.4) XGA Extended Graphics Array 1024 9 768 (Sect. 11.2) XYZ XYZ color space (Sect. 2.3.1) YCbCr Color format with luma and two chroma components (Sect. 2.3) YUV Color format with luma and two chroma components (Sect. 2.3)