) International Patent Classification: 05 July 2019 (05.07.2019) H04N /33

Total Page:16

File Type:pdf, Size:1020Kb

) International Patent Classification: 05 July 2019 (05.07.2019) H04N /33 ) ( 2 International Patent Classification: 1909701.3 05 July 2019 (05.07.2019) GB H04N /33 (2014.01) H04N 19/136 (2014.01) 1909724.5 06 July 2019 (06.07.2019) GB H04N 19/107 2014.01) H04N 19/18 (2014.01) 1909997.7 11 July 2019 ( 11.07.2019) GB H04N 19/109 (2014.01) H04N 19/48 (2014.01) 1910674.9 25 July 2019 (25.07.2019) GB H04N / 70 (2014.01) H04N 19/503 (2014.01) 191 1467.7 09 August 2019 (09.08.2019) GB 191 1546.8 13 August 2019 (13.08.2019) GB (21) International Application Number: 1914215.7 02 October 2019 (02. 10.2019) GB PCT/GB2020/050695 1914414.6 06 October 2019 (06. 10.2019) GB (22) International Filing Date: 1914634.9 10 October 2019 (10. 10.2019) GB 18 March 2020 (18.03.2020) 1915553.0 25 October 2019 (25. 10.2019) GB 1916090.2 05 November 2019 (05. 11.2019) GB (25) Filing Language: English 1918099. 1 10 December 2019 (10. 12.2019) GB (26) Publication Language: English 2000430.5 12 January 2020 (12.01.2020) GB 2000483.4 13 January 2020 (13.01.2020) GB (30) Priority Data: 2000600.3 15 January 2020 (15.01.2020) GB 1903844.7 20 March 2019 (20.03.2019) GB 2000668.0 16 January 2020 (16.01.2020) GB 1904014.6 23 March 2019 (23.03.2019) GB 2001408.0 31 January 2020 (3 1.01.2020) GB 1904492.4 29 March 2019 (29.03.2019) GB 62/984,261 02 March 2020 (02.03.2020) US 1905325.5 15 April 2019 (15.04.2019) GB (54) Title: LOW COMPLEXITY ENHANCEMENT VIDEO CODING (57) Abstract: Examples of a low complexity enhancement video coding are described. Encoding and decoding methods are described, as well as corresponding encoders and decoders. The enhancement coding may operate on top of a base layer, which may provide base encoding and decoding. Spatial scaling may be applied across different layers. Only the base layer encodes full video, which may be at a lower resolution. The enhancement coding instead operates on computed sets of residuals. The sets of residuals are computed for a plurality of layers, which may represent different levels of scaling in one or more dimensions. A number of encoding and decoding components or tools are described, which may involve the application of transformations, quantization, entropy encoding and temporal buffering. At an example decoder, an encoded base stream and one or more encoded enhancement streams may be independently decoded and combined to reconstruct an original video. [Continued on nextpage] (71) Applicant: V-NOVA INTERNATIONAL LIMITED [GB/GB]; 8thFloor 1 Sheldon Square, Paddington, London W2 6TT (GB). (72) Inventors: MEARDI, Guido; V-Nova International Lim¬ ited, 8th Floor 1 Sheldon Square, Paddington, London W2 6TT (GB). FERRARA, Simone; V-Nova International Limited, 8th Floor 1 Sheldon Square, Paddington, London W2 6TT (GB). CICCARELLI, Lorenzo; V-Nova Inter¬ national Limited, 8th Floor 1 Sheldon Square, Paddington, London W2 6TT (GB). DAMNJANOVIC, Ivan; V-Nova International Limited, 8thFloor 1 Sheldon Square, Padding¬ ton, London W2 6TT (GB). CLUCAS, Richard; V-Nova International Limited, 8thFloor 1 Sheldon Square, Padding¬ ton, London W2 6TT (GB). LITTLEWOOD, Sam; V- Nova International Limited, 8th Floor 1 Sheldon Square, Paddington, London W2 6TT (GB). (74) Agent: GILL JENNINGS & EVERY LLP; The Broadgate Tower, 20 Primrose Street, London EC2A 2ES (GB). (81) Designated States (unless otherwise indicated, for every kind of national protection available) : AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, WS, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available) : ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, Cl, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: LOW COMPLEXITY ENHANCEMENT VIDEO CODING TECHNICAL FIELD The present invention relates to a video coding technology. In particular, the present invention relates to methods and systems for encoding and decoding video data. In certain examples, the methods and systems may be used to generate a compressed representation for streaming and/or storage. BACKGROUND Typical comparative video codecs operate using a single-layer, block-based approach, whereby an original signal is processed using a number of coding tools in order to produce an encoded signal which can then be reconstructed by a corresponding decoding process. For simplicity, coding and decoding algorithms or processes are often referred to as “codecs”; the term “codec” being used to cover one or more of encoding and decoding processes that are designed according to a common framework. Such typical codecs include, but are not limited, to MPEG-2, AVC/H.264, HEVC/H.265, VP8, VP9, AVI. There are also other codecs that are currently under development by international standards organizations, such as MPEG/ISO/ITU as well as industry consortia such as Alliance for Open Media (AoM). In recent years, adaptations to the single-layer, block-based approach have been suggested. For example, there exists a class of codecs that operate using a multi-layer, block-based approach. These codecs are often known as “scalable” codecs within the video coding industry. They typically replicate operations performed by a single-layer, block- based approach over a number of layers, where a set of layers are obtained by down- sampling an original signal. In certain cases, efficiencies in the single-layer, block-based approach may be achieved by re-using information from a lower layer to encode (and decode) an upper layer. These scalable codecs are meant to provide scalability features to operators, in the sense that they need to guarantee that the quality of the scaled-down decoded signal (e.g., the lower resolution signal) satisfies the quality requirements for existing services, as well as ensuring that the quality of the non-scaled decoded signal (e.g., higher resolution signal) is comparable with that produced by a corresponding single-layer codec. An example of a “scalable” codec is Scalable Video Coding - SVC (see for example “The Scalable Video Coding Extension of the H.264/AVC Standard”, H . Schwarz and M . Wien, IEEE Signal Processing Magazine, March 2008, which is incorporated herein by reference). SVC is the scalable version of the Advanced Video Coding standard - AVC (AVC also being known as H.264). In SVC, each scalable layer is processed using the same AVC-based single-layer process, and upper layers receive information from lower layers (e.g., interlayer predictions including residual information and motion information) which is used in the encoding of the upper layer to reduce encoded information at the upper layer. Conversely, in order to decode, an SVC decoder needs to receive various overhead information as well as decode the lower layer in order to be able to decode the upper layer. Another example of a scalable codec is the Scalable Extension of the High Efficiency Video Coding Standard (HEVC) - SHVC (see for example “Overview of SHVC: Scalable Extensions of the High Efficiency Video Coding Standard”, J . Boyce, Y. Ye, J . Chen and A . Ramasubramonian, IEEE Trans. On Circuits and Systems for Video Technology, Vol. 26, No. 1, Jan 2016, which is incorporated by reference herein). Similar to SVC, SHVC also uses the same HEVC-based process for each scalable layer, but it allows for the lower layer to use either AVC or HEVC. In SHVC, the upper layer also receives information from the lower layer (e.g., inter layer processing including motion information and/or the up-sampled lower layer as an additional reference picture for the upper layer coding) in the encoding of the upper layer to reduce encoded information at the upper layer. Again, similarly to SVC, an SHVC decoder needs to receive various overhead information as well as decode the lower layer in order to be able to decode the upper layer. Both SVC and SHVC may be used to encode data in multiple streams at different levels of quality. For example, SVC and SHVC may be used to encode e.g. a SD (standard definition) and an HD (high definition) stream or an HD and a UHD (ultra-high-definition) stream. The base stream (at the lowest level of quality) is typically encoded so that the quality of the base stream is the same as if the base stream were encoded as a single stream, separately from any higher-level streams. Both SVC and SHVC may be thought of primarily as a set of parallel copies of a common encoder and decoder structure, where the outputs of these parallel copies are respectively multiplexed and demultiplexed. In more detail, within an example SVC encoding, a UHD stream (e.g.
Recommended publications
  • Press Release of 132Nd MPEG Meeting
    ISO/IEC JTC 1/SC 29/AG 03 N00007 ISO/IEC JTC 1/SC 29/AG 03 MPEG Liaison and Communication Convenorship: KATS (Korea, Republic of) Document type: Press Release Title: Press Release of 132nd MPEG Meeting Status: Approved Date of document: 2020-10-16 Source: Convenor Expected action: INFO No. of pages: 8 (incl. cover page) Email of convenor: [email protected] Committee URL: https://isotc.iso.org/livelink/livelink/open/jtc1sc29ag3 INTERNATIONAL ORGANIZATION FOR STANDARDIZATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/AG 03 MPEG LIAISON AND COMMUNICATION ISO/IEC JTC 1/SC 29/AG 03 N00007 Online Meeting – October 2020 Source: Convenor of ISO/IEC JTC 1/SC 29/AG 03 Status: Approved by AG 03 Subject: Press Release of 132nd MPEG Meeting Date: 16 October 2020 Serial Number 19862 MPEG Continues to Progress – First Meeting with the New Structure The 132nd MPEG meeting was held online, 12 – 16 October 2020 Table of Contents: MPEG CONTINUES TO PROGRESS – FIRST MEETING WITH THE NEW STRUCTURE .......................................... 3 VERSATILE VIDEO CODING (VVC) ULTRA-HD VERIFICATION TEST COMPLETED AND CONFORMANCE AND REFERENCE SOFTWARE STANDARDS REACH THEIR FIRST MILESTONE ........................................................... 3 MPEG COMPLETES GEOMETRY-BASED POINT CLOUD COMPRESSION STANDARD ......................................... 4 MPEG EVALUATES EXTENSIONS AND IMPROVEMENTS TO MPEG-G AND ANNOUNCES A CALL FOR EVIDENCE ON NEW ADVANCED GENOMICS FEATURES AND TECHNOLOGIES ................................................................ 4 MPEG ISSUES DRAFT CALL FOR PROPOSALS ON THE CODED REPRESENTATION OF HAPTICS .......................... 5 MPEG EVALUATES RESPONSES TO MPEG IPR SMART CONTRACTS CFP ......................................................... 6 MPEG COMPLETES STANDARD ON HARMONIZATION OF DASH AND CMAF .................................................. 6 MPEG COMPLETES 2ND EDITION OF THE OMNIDIRECTIONAL MEDIA FORMAT ..............................................
    [Show full text]
  • Why “Not- Compressing” Simply Doesn't Make Sens ?
    WHY “NOT- COMPRESSING” SIMPLY DOESN’T MAKE SENS ? Confidential IMAGES AND VIDEOS ARE LIKE SPONGES It seems to be a solid. But what happens when you squeeze it? It gets smaller! Why? If you look closely at the sponge, you will see that it has lots of holes in it. The sponge is made up of a mixture of solid and gas. When you squeeze it, the solid part changes it shape, but stays the same size. The gas in the holes gets smaller, so the entire sponge takes up less space. Confidential 2 IMAGES AND VIDEOS ARE LIKE SPONGES There is a lot of data that are not bringing any information to our human eyes, and we can remove it. It does not make sense to transport, store uncompressed images/videos. It is adding data that have an undeniable cost and that are not bringing any additional valuable information to the viewers. Confidential 3 A 4K TV SHOW WITHOUT ANY CODEC ▪ 60 MINUTES STORAGE: 4478.85 GB ▪ STREAMING: 9.953 Gbit per sec Confidential 4 IMAGES AND VIDEOS ARE LIKE SPONGES Remove Remove Remove Remove Temporal redundancy Spatial redundancy Visual redundancy Coding redundancy (interframe prediction,..) (transforms,..) (quantization,…) (entropy coding,…) Confidential 5 WHAT IS A CODEC? Short for COder & DECoder “A codec is a device or computer program for encoding or decoding a digital data stream or signal.” Note : ▪ It does not (necessarily) define quality ▪ It does not define transport / container format method. Confidential 6 WHAT IS A CODEC? Quality, Latency, Complexity, Bandwidth depend on how the actual algorithms are processing the content.
    [Show full text]
  • A/300, "ATSC 3.0 System Standard"
    ATSC A/300:2017 ATSC 3.0 System 19 October 2017 ATSC Standard: ATSC 3.0 System (A/300) Doc. A/300:2017 19 October 2017 Advanced Television Systems Committee 1776 K Street, N.W. Washington, DC 20006 202-872-9160 i ATSC A/300:2017 ATSC 3.0 System 19 October 2017 The Advanced Television Systems Committee, Inc., is an international, non-profit organization developing voluntary standards for digital television. The ATSC member organizations represent the broadcast, broadcast equipment, motion picture, consumer electronics, computer, cable, satellite, and semiconductor industries. Specifically, ATSC is working to coordinate television standards among different communications media focusing on digital television, interactive systems, and broadband multimedia communications. ATSC is also developing digital television implementation strategies and presenting educational seminars on the ATSC standards. ATSC was formed in 1982 by the member organizations of the Joint Committee on InterSociety Coordination (JCIC): the Electronic Industries Association (EIA), the Institute of Electrical and Electronic Engineers (IEEE), the National Association of Broadcasters (NAB), the National Cable Telecommunications Association (NCTA), and the Society of Motion Picture and Television Engineers (SMPTE). Currently, there are approximately 120 members representing the broadcast, broadcast equipment, motion picture, consumer electronics, computer, cable, satellite, and semiconductor industries. ATSC Digital TV Standards include digital high definition television (HDTV), standard definition television (SDTV), data broadcasting, multichannel surround-sound audio, and satellite direct-to-home broadcasting. Note: The user’s attention is called to the possibility that compliance with this standard may require use of an invention covered by patent rights. By publication of this standard, no position is taken with respect to the validity of this claim or of any patent rights in connection therewith.
    [Show full text]
  • Video Compression Optimized for Racing Drones
    Video compression optimized for racing drones Henrik Theolin Computer Science and Engineering, master's level 2018 Luleå University of Technology Department of Computer Science, Electrical and Space Engineering Video compression optimized for racing drones November 10, 2018 Preface To my wife and son always! Without you I'd never try to become smarter. Thanks to my supervisor Staffan Johansson at Neava for providing room, tools and the guidance needed to perform this thesis. To my examiner Rickard Nilsson for helping me focus on the task and reminding me of the time-limit to complete the report. i of ii Video compression optimized for racing drones November 10, 2018 Abstract This thesis is a report on the findings of different video coding tech- niques and their suitability for a low powered lightweight system mounted on a racing drone. Low latency, high consistency and a robust video stream is of the utmost importance. The literature consists of multiple comparisons and reports on the efficiency for the most commonly used video compression algorithms. These reports and findings are mainly not used on a low latency system but are testing in a laboratory environment with settings unusable for a real-time system. The literature that deals with low latency video streaming and network instability shows that only a limited set of each compression algorithms are available to ensure low complexity and no added delay to the coding process. The findings re- sulted in that AVC/H.264 was the most suited compression algorithm and more precise the x264 implementation was the most optimized to be able to perform well on the low powered system.
    [Show full text]
  • MEDIA KIT • Lead Generation – See Page 19 • US and European Events
    Unrivalled access to online audio and video markets around the world. • print – see page 4 • online – see page 11 MEDIA KIT • lead generation – see page 19 • US and European events www.streamingmediaglobal.com media kit BUSINESS TECHNOLOGY CONTENT Streaming Media has long been the number one global destination for professionals seeking breaking news, in-depth features, reviews, analysis, and directories for the online audio and video market – whether in print, online or in person. Whether you’re a startup, a scaleup or an established business, you want to ensure that your marcomms shine through the fog of white noise. Our print magazines represent status, pedigree and profile. Our extensive online presence delivers brand awareness, name recognition and traction. Bringing these vehicles together gives you benchmark-beating lead generation packages that will drive your business where you want it to go. In 2021, in both Europe and North America, Streaming Media’s print publications, online properties and in person and virtual events continue to bring together the entire rich media ecosystem. Taken together, Streaming Media’s global content and global community gives you unrivalled access to online audio and video markets around the world PAGE 2 www.streamingmediaglobal.com media kit BUSINESS TECHNOLOGY CONTENT at a glance – 2021 lead generation programmes EUROPE EDITION US EDITION COLLABORATIVE WEB EVENTS MAGAZINE ISSUE PUBLICATION INNOVATION SERIES PARTNER SECTION MAGAZINE ISSUE PUBLICATION INNOVATION SERIES PARTNER SECTION MONTH & DEADLINES DATE & DEADLINES DATE 1. JANUARY/FEBRUARY 18 Jan 2021 MEDIA & EXECUTIVE SUMMIT—THE STATE OF JAN Sponsored content: 16 Dec 2020 ENTERTAINMENT PREDICTIONS MEDIA & ENTERTAINMENT Ad materials: 18 Dec 2020 1.
    [Show full text]
  • Recommendation Itu-R Bt.1833-2*, **
    Recommendation ITU-R BT.1833-2 (08/2012) Broadcasting of multimedia and data applications for mobile reception by handheld receivers BT Series Broadcasting service (television) ii Rec. ITU-R BT.1833-2 Foreword The role of the Radiocommunication Sector is to ensure the rational, equitable, efficient and economical use of the radio-frequency spectrum by all radiocommunication services, including satellite services, and carry out studies without limit of frequency range on the basis of which Recommendations are adopted. The regulatory and policy functions of the Radiocommunication Sector are performed by World and Regional Radiocommunication Conferences and Radiocommunication Assemblies supported by Study Groups. Policy on Intellectual Property Right (IPR) ITU-R policy on IPR is described in the Common Patent Policy for ITU-T/ITU-R/ISO/IEC referenced in Annex 1 of Resolution ITU-R 1. Forms to be used for the submission of patent statements and licensing declarations by patent holders are available from http://www.itu.int/ITU-R/go/patents/en where the Guidelines for Implementation of the Common Patent Policy for ITU-T/ITU-R/ISO/IEC and the ITU-R patent information database can also be found. Series of ITU-R Recommendations (Also available online at http://www.itu.int/publ/R-REC/en) Series Title BO Satellite delivery BR Recording for production, archival and play-out; film for television BS Broadcasting service (sound) BT Broadcasting service (television) F Fixed service M Mobile, radiodetermination, amateur and related satellite services P Radiowave propagation RA Radio astronomy RS Remote sensing systems S Fixed-satellite service SA Space applications and meteorology SF Frequency sharing and coordination between fixed-satellite and fixed service systems SM Spectrum management SNG Satellite news gathering TF Time signals and frequency standards emissions V Vocabulary and related subjects Note: This ITU-R Recommendation was approved in English under the procedure detailed in Resolution ITU-R 1.
    [Show full text]
  • The H.264/MPEG4 Advanced Video Coding Standard and Its Applications
    SULLIVAN LAYOUT 7/19/06 10:38 AM Page 134 STANDARDS REPORT The H.264/MPEG4 Advanced Video Coding Standard and its Applications Detlev Marpe and Thomas Wiegand, Heinrich Hertz Institute (HHI), Gary J. Sullivan, Microsoft Corporation ABSTRACT Regarding these challenges, H.264/MPEG4 Advanced Video Coding (AVC) [4], as the latest H.264/MPEG4-AVC is the latest video cod- entry of international video coding standards, ing standard of the ITU-T Video Coding Experts has demonstrated significantly improved coding Group (VCEG) and the ISO/IEC Moving Pic- efficiency, substantially enhanced error robust- ture Experts Group (MPEG). H.264/MPEG4- ness, and increased flexibility and scope of appli- AVC has recently become the most widely cability relative to its predecessors [5]. A recently accepted video coding standard since the deploy- added amendment to H.264/MPEG4-AVC, the ment of MPEG2 at the dawn of digital televi- so-called fidelity range extensions (FRExt) [6], sion, and it may soon overtake MPEG2 in further broaden the application domain of the common use. It covers all common video appli- new standard toward areas like professional con- cations ranging from mobile services and video- tribution, distribution, or studio/post production. conferencing to IPTV, HDTV, and HD video Another set of extensions for scalable video cod- storage. This article discusses the technology ing (SVC) is currently being designed [7, 8], aim- behind the new H.264/MPEG4-AVC standard, ing at a functionality that allows the focusing on the main distinct features of its core reconstruction of video signals with lower spatio- coding technology and its first set of extensions, temporal resolution or lower quality from parts known as the fidelity range extensions (FRExt).
    [Show full text]
  • RULING CODECS of VIDEO COMPRESSION and ITS FUTURE 1Dr.Manju.V.C, 2Apsara and 3Annapoorna
    International Journal of Application or Innovation in Engineering & Management (IJAIEM) Web Site: www.ijaiem.org Email: [email protected] Volume 8, Issue 7, July 2019 ISSN 2319 - 4847 RULING CODECS OF VIDEO COMPRESSION AND ITS FUTURE 1Dr.Manju.v.C, 2Apsara and 3Annapoorna 1Professor,KSIT 2Under-Gradute, Telecommunication Engineering, KSIT 3Under-Gradute, Telecommunication Engineering, KSIT Abstract Development of economical video codecs for low bitrate video transmission with higher compression potency has been a vigorous space of analysis over past years and varied techniques are projected to fulfill this need. Video Compression is a term accustomed outline a technique for reducing the information accustomed cipher digital video content. This reduction in knowledge interprets to edges like smaller storage needs and lower transmission information measure needs, for a clip of video content. In this paper, we survey different video codec standards and also discuss about the challenges in VP9 codec Keywords: Codecs, HEVC, VP9, AV1 1. INTRODUCTION Storing video requires a lot of storage space. To make this task manageable, video compression technology was developed to compress video, also known as a codec. Video coding techniques provide economic solutions to represent video data in a more compact and stout way so that the storage and transmission of video will be completed in less value in less cost in terms of bandwidth, size and power consumption. This technology (video compression) reduces redundancies in spatial and temporal directions. Spatial reduction physically reduces the size of the video data by selectively discarding up to a fourth or more of unneeded parts of the original data in a frame [1].
    [Show full text]
  • An Efficient Spatial Scalable Video Encoder Based on DWT
    An Efficient Spatial Scalable Video Encoder Based on DWT Saoussen Cheikhrouhou1, Yousra Ben Jemaa2, Mohamed Ali Ben Ayed1, and Nouri Masmoudi1 1 Laboratory of Electronics and Information Technology Sfax National School of Engineering, BP W 3038, Sfax, Tunisia 2 Signal and System Unit, ENIT, Tunisia [email protected] Abstract. Multimedia applications reach a dramatic increase in nowadays life. Therefore, video coding scalability is more and more desirable. Spatial scalability allows the adaptation of the bit-stream to end users as well as varying terminal capabilities. This paper presents a new Discrete Wavelet Transform (DWT) based coding scheme, which offers spatial scalability from one hand and ensures a simple hardware implementation compared to the other predictive scalable compression techniques from the other. Experimental results have shown that our new compression scheme offers also good compression efficiency. Indeed, it achieves up to 61\% of bit-rate saving for Common Intermediate Format (CIF) sequences using lossy compression and up to 57\% using lossless compression compared with the Motion JPEG2000 standard and 64\% compared with a DWT- coder based on Embedded Zero tree Wavelet (EZW) entropy encoder. Keywords: video conference, temporal redundancy, spatial scalability, discrete wavelet transform dwt, tier1 and tier2 entropy coding. 1 Introduction Advances in video coding technology are enabling an increasing number of video applications ranging from multimedia messaging, and video conferencing to standard and high-definition TV broadcasting. Furthermore, video content is delivered to a variety of decoding devices with heterogeneous display and computational capabilities [1]. In these heterogeneous environments, flexible adaptation of once- encoded content is desirable.
    [Show full text]
  • An Analysis of VP8, a New Video Codec for the Web Sean Cassidy
    Rochester Institute of Technology RIT Scholar Works Theses Thesis/Dissertation Collections 11-1-2011 An Analysis of VP8, a new video codec for the web Sean Cassidy Follow this and additional works at: http://scholarworks.rit.edu/theses Recommended Citation Cassidy, Sean, "An Analysis of VP8, a new video codec for the web" (2011). Thesis. Rochester Institute of Technology. Accessed from This Thesis is brought to you for free and open access by the Thesis/Dissertation Collections at RIT Scholar Works. It has been accepted for inclusion in Theses by an authorized administrator of RIT Scholar Works. For more information, please contact [email protected]. An Analysis of VP8, a New Video Codec for the Web by Sean A. Cassidy A Thesis Submitted in Partial Fulfillment of the Requirements for the Degree of Master of Science in Computer Engineering Supervised by Professor Dr. Andres Kwasinski Department of Computer Engineering Rochester Institute of Technology Rochester, NY November, 2011 Approved by: Dr. Andres Kwasinski R.I.T. Dept. of Computer Engineering Dr. Marcin Łukowiak R.I.T. Dept. of Computer Engineering Dr. Muhammad Shaaban R.I.T. Dept. of Computer Engineering Thesis Release Permission Form Rochester Institute of Technology Kate Gleason College of Engineering Title: An Analysis of VP8, a New Video Codec for the Web I, Sean A. Cassidy, hereby grant permission to the Wallace Memorial Library to repro- duce my thesis in whole or part. Sean A. Cassidy Date i Acknowledgements I would like to thank my thesis advisors, Dr. Andres Kwasinski, Dr. Marcin Łukowiak, and Dr. Muhammad Shaaban for their suggestions, advice, and support.
    [Show full text]
  • Overview of Mpeg-5 Part 2 – Low Complexity
    ITU Journal: ICT Discoveries, Vol. 3(1), 8 June 2020 OVERVIEW OF MPEG-5 PART 2 – LOW COMPLEXITY ENHANCEMENT VIDEO CODING (LCEVC) Florian Maurer1, Stefano Battista2, Lorenzo Ciccarelli3, Guido Meardi3, Simone Ferrara3 1RWTH Aachen University, Germany, 2Università Politecnica delle Marche (UNIVPM), Italy, 3V-Nova, UK Abstract – This paper provides an overview of MPEG-5 Part 2 Low Complexity Enhancement Video Coding (LCEVC), a novel video coding standard from the MPEG ISO Working Group. The codec is designed for use in conjunction with existing video codecs, leveraging specific tools for encoding "residuals", i.e. the difference between the original video and its compressed representation. LCEVC can improve compression efficiency and reduce the overall computational complexity using a small number of specialized enhancement tools. This paper provides an outline of the coding structure of encoder and decoder, coding tools, and an overview of the performance of LCEVC with regard to both compression efficiency and processing complexity. Keywords – Low Complexity Enhancement Video Coding (LCEVC), MPEG-5 Part 2, multi-resolution video coding, video compression. 1. INTRODUCTION is the case, changing codecs cannot be done without relevant up-front investments and large amounts of This paper provides an overview of MPEG-5 Part 2 time. Accordingly, having the possibility to upgrade Low Complexity Enhancement Video Coding an ecosystem without the need to replace it (LCEVC), a new video coding standard developed by completely and still having the freedom to select a MPEG that is scheduled to be published as base codec of their choice is an important option ISO/IEC 23094-2 [1]. that operators need to have.
    [Show full text]
  • (LCEVC) for Gaming Video Streaming Applications
    Evaluation of MPEG-5 Part 2 (LCEVC) for Gaming Video Streaming Applications Nabajeet Barman↥, Saman Zadtootaghaj, Maria G Martini↥ and Sebastian Möller ↥School of Computer Science and Mathematics, Kingston University, London, UK Quality and Usability Lab, Technische Universität Berlin, Germany [email protected], [email protected], [email protected] VQEG_CGI_2021_131 1 Objectives Evaluation of the new MPEG-5 Low Complexity Enhancement Video Coding (LCEVC) standard on Gaming Content Comparison of compression efficiency of LCEVC with existing practical implementation of video codec standards H.264/AVC and H.265/HEVC 2 High level LCEVC decoding workflow Image Source: https://docs.v-nova.com/v-nova/lcevc/lcevc-sdk-overview 3 LCEVC: Two sublayers of residual data Image Source: https://docs.v-nova.com/v-nova/lcevc/lcevc-sdk-overview 4 LCEVC Advantages Improved video compression efficiency (compared to base codec used at full resolution) Reduced overall encoding complexity Backwards compatible with existing ecosystem of device (no new chipsets needed) 5 Source Sequences Cloud Gaming Video Dataset (CGDVS) ● 14 reference gaming videos ● 1920x1080 ● 60 fps ● 30 seconds 6 Screenshots of six sample games used in this work (d) FIFA 2017 (a) Bejeweled (b) Worms (c) Fortnite (d) LoL (e) Maplestory (f) Overwatch 7 Spatial Information (SI) vs Temporal Information (TI) 8 Encoding Settings Summary 9 Results 10 Quality-BR curves 11 X264 vs LCEVC-x264 12 X265 vs LCEVC-x265 13 BD-BR 14 x264 vs LCEVC_x264 (medium preset) 15 x265 vs LCEVC_x265 (veryfast preset) 16 BD-BR Savings (VMAF) 17 High Complexity Games - Fortnite 18 High Complexity Games - Tekken 19 Low Complexity Games - LoL 20 Low Complexity Games - Worms 21 LCEVC demo: search ‘V-Nova’ in app stores Credentials: User name: LCEVC_Gaming Pwd: Gaming2021 22 Encoding Speed x264 (medium) --> LCEVC x264 (medium) is 1.7-2x faster x265 (veryfast) --> LCEVC x265 (veryfast) is 1.2-1.3x faster Note: This is a rough estimate based on few sample videos encoding on a Laptop.
    [Show full text]