Computational Complexity Optimization on H.264 Scalable/Multiview Video Coding
Total Page:16
File Type:pdf, Size:1020Kb
Computational Complexity Optimization on H.264 Scalable/Multiview Video Coding By Guangyao Zhang A thesis submitted in partial fulfilment for the requirements for the degree of PhD, at the University of Central Lancashire April 2014 Student Declaration Concurrent registration for two or more academic awards I declare that while registered as a candidate for the research degree, I have not been a registered candidate or enrolled student for another award of the University or other academic or professional institution. Material submitted for another award I declare that no material contained in the thesis has been used in any other submission for an academic award and is solely my own work. Collaboration This work presented in this thesis was carried out at the ADSIP (Applied Digital Signal and Image Processing) Research Centre, University of Central Lancashire. The work described in the thesis is entirely the candidate’s own work. Signature of Candidate ________________________________________ Type of Award Doctor of Philosophy School School of Computing, Engineering and Physical Sciences Abstract Abstract The H.264/MPEG-4 Advanced Video Coding (AVC) standard is a high efficiency and flexible video coding standard compared to previous standards. The high efficiency is achieved by utilizing a comprehensive full search motion estimation method. Although the H.264 standard improves the visual quality at low bitrates, it enormously increases the computational complexity. The research described in this thesis focuses on optimization of the computational complexity on H.264 scalable and multiview video coding. Nowadays, video application areas range from multimedia messaging and mobile to high definition television, and they use different type of transmission systems. The Scalable Video Coding (SVC) extension of the H.264/AVC standard is able to scale the video stream in order to adapt to a variety of devices with different capabilities. Furthermore, a rate control scheme is utilized to improve the visual quality under the constraints of capability and channel bandwidth. However, the computational complexity is increased. A simplified rate control scheme is proposed to reduce the computational complexity. In the proposed scheme, the quantisation parameter can be computed directly instead of using the exhaustive Rate-Quantization model. The linear Mean Absolute Distortion (MAD) prediction model is used to predict the scene change, and the quantisation parameter will be increased directly by a threshold when the scene changes abruptly; otherwise, the comprehensive Rate-Quantisation model will be used. Results show that the optimized rate control scheme is efficient on time saving. Multiview Video Coding (MVC) is efficient on reducing the huge amount of data in multiple-view video coding. The inter-view reference frames from the adjacent views are exploited for prediction in addition to the temporal prediction. However, due to the increase in the number of reference frames, the computational complexity is also increased. In order to manage the reference frame efficiently, a phase correlation algorithm is utilized to remove the inefficient inter-view reference frame from the reference list. The dependency between the inter-view reference frame and current frame is decided based on the phase correlation coefficients. If the inter-view reference frame is highly related to the current frame, it is still enabled in the reference list; otherwise, it will be disabled. The experimental results show that the proposed scheme is efficient on time saving and without loss in visual quality and increase in bitrate. Abstract The proposed optimization algorithms are efficient in reducing the computational complexity on H.264/AVC extension. The low computational complexity algorithm is useful in the design of future video coding standards, especially on low power handheld devices. CONTENTS CONTENTS Abstract .............................................................................................................................. I CONTENTS ....................................................................................................................... I List of Figures .................................................................................................................. V List of Tables................................................................................................................. VII Acknowledgements ...................................................................................................... VIII List of Abbreviations....................................................................................................... IX CHAPTER 1 ..................................................................................................................... 1 INTRODUCTION ............................................................................................................ 1 1.1 Motivation ............................................................................................................... 1 1.2 History of Video Compression ................................................................................ 2 1.3 Concepts and Definitions ........................................................................................ 5 1.4 Research Objectives ................................................................................................ 6 1.5 Research Outline and Contributions ........................................................................ 7 1.6 Organisation of the Thesis ....................................................................................... 8 CHAPTER 2 ..................................................................................................................... 9 AN OVERVIEW OF VIDEO CODING........................................................................... 9 2.1 Introduction ............................................................................................................. 9 2.2 Overview of Video Compression .......................................................................... 10 2.3 H.264/MPEG Part 10 Standard ............................................................................. 12 2.3.1 Introduction ..................................................................................................... 12 2.3.2 Concept and Definition ................................................................................... 12 2.3.3 Inter Prediction ............................................................................................... 16 2.3.4 Intra Prediction ............................................................................................... 18 2.3.5 Transform Coding ........................................................................................... 20 2.3.6 Quantisation Stage .......................................................................................... 21 2.3.7 Entropy Coding ............................................................................................... 22 2.4 Summary ............................................................................................................... 23 CHAPTER 3 ................................................................................................................... 24 MOTION ESTIMATION STUDY ON H.264/AVC ...................................................... 24 3.1 Introduction ........................................................................................................... 24 I CONTENTS 3.2 Motion Estimation in H.264/AVC ........................................................................ 25 3.2.1 Criterion for Best Match ................................................................................. 25 3.2.2 Image Quality ................................................................................................. 26 3.3 Fast Search Algorithms ......................................................................................... 27 3.3.1 Four-step Search Method ................................................................................ 28 3.3.2 Diamond Search Method ................................................................................ 29 3.3.3 Phase Correlation Method .............................................................................. 30 3.4 Experimental Results ............................................................................................. 31 3.5 Summary ............................................................................................................... 35 CHAPTER 4 ................................................................................................................... 36 A SIMPLIFIED RATE CONTROL ALGORITHM FOR H.264/SVC .......................... 36 4.1 Introduction ........................................................................................................... 36 4.2 H.264/ Scalable Video Coding .............................................................................. 37 4.2.1 The Requirements for Scalable Video Coding ............................................... 37 4.2.2 The Scalability in Scalable Video Coding ...................................................... 37 4.2.2.1 Temporal Scalability ............................................................... 38 4.2.2.2 Spatial Scalability.................................................................... 38 4.2.2.3 Quality Scalability ..................................................................