Video Compression and Communications: from Basics to H.261, H.263, H.264, MPEG2, MPEG4 for DVB and HSDPA-Style Adaptive Turbo-Transceivers

Total Page:16

File Type:pdf, Size:1020Kb

Video Compression and Communications: from Basics to H.261, H.263, H.264, MPEG2, MPEG4 for DVB and HSDPA-Style Adaptive Turbo-Transceivers Video Compression and Communications: From Basics to H.261, H.263, H.264, MPEG2, MPEG4 for DVB and HSDPA-Style Adaptive Turbo-Transceivers by c L. Hanzo, P.J. Cherriman, J. Streit Department of Electronics and Computer Science, University of Southampton, UK About the Authors Lajos Hanzo (http://www-mobile.ecs.soton.ac.uk) FREng, FIEEE, FIET, DSc received his degree in electronics in 1976 and his doctorate in 1983. During his 30-year career in telecommunications he has held various research and academic posts in Hungary, Germany and the UK. Since 1986 he has been with the School of Electronics and Computer Science, University of Southampton, UK, where he holds the chair in telecom- munications. He has co-authored 15 books on mobile radio communica- tions totalling in excess of 10 000, published about 700 research papers, acted as TPC Chair of IEEE conferences, presented keynote lectures and been awarded a number of distinctions. Currently he is directing an academic research team, working on a range of research projects in the field of wireless multimedia communications sponsored by industry, the Engineering and Physical Sciences Research Council (EPSRC) UK, the European IST Programme and the Mobile Virtual Centre of Excellence (VCE), UK. He is an enthusiastic supporter of industrial and academic liaison and he offers a range of industrial courses. He is also an IEEE Distinguished Lecturer of both the Communications Society and the Vehicular Technology Society (VTS). Since 2005 he has been a Governer of the VTS. For further information on research in progress and associated publications please refer to http://www-mobile.ecs.soton.ac.uk Peter J. Cherriman graduated in 1994 with an M.Eng. degree in In- formation Engineering from the University of Southampton, UK. Since 1994 he has been with the Department of Electronics and Computer Sci- ence at the University of Southampton, UK, working towards a Ph.D. in mobile video networking which was completed in 1999. Currently he is working on projects for the Mobile Virtual Centre of Excellence, UK. His current areas of research include robust video coding, microcellular radio systems, power control, dynamic channel allocation and multiple access protocols. He has published about two dozen conference and journal papers, and holds several patents. Jurgen¨ Streit received his Dipl.-Ing. Degree in electronic engineering from the Aachen University of Technology in 1993 and his Ph.D. in image coding from the Department of Electronics and Computer Sci- ence, University of Southampton, UK, in 1995. From 1992 to 1996 Dr. Streit had been with the Department of Electronics and Computer Sci- ence working in the Communications Research Group. His work led to numerous publications. Since then he has joined a management consul- tancy working as an information technology consultant. i Other Wiley and IEEE Press Books on Related Topics 1 • R. Steele, L. Hanzo (Ed): Mobile Radio Communications: Second and Third Gener- ation Cellular and WATM Systems, John Wiley and IEEE Press, 2nd edition, 1999, ISBN 07 273-1406-8, 1064 pages • L. Hanzo, F.C.A. Somerville, J.P. Woodard: Voice Compression and Communications: Principles and Applications for Fixed and Wireless Channels; IEEE Press and John Wiley, 2001, 642 pages • L. Hanzo, P. Cherriman, J. Streit: Wireless Video Communications: Second to Third Generation and Beyond, IEEE Press and John Wiley, 2001, 1093 pages • L. Hanzo, T.H. Liew, B.L. Yeap: Turbo Coding, Turbo Equalisation and Space-Time Coding, John Wiley and IEEE Press, 2002, 751 pages • J.S. Blogh, L. Hanzo: Third-Generation Systems and Intelligent Wireless Networking: Smart Antennas and Adaptive Modulation, John Wiley and IEEE Press, 2002, 408 pages • L. Hanzo, C.H. Wong, M.S. Yee: Adaptive Wireless Transceivers: Turbo-Coded, Turbo- Equalised and Space-Time Coded TDMA, CDMA and OFDM Systems, John Wiley and IEEE Press, 2002, 737 pages • L. Hanzo, L-L. Yang, E-L. Kuan, K. Yen: Single- and Multi-Carrier CDMA: Multi- User Detection, Space-Time Spreading, Synchronisation, Networking and Standards, John Wiley and IEEE Press, June 2003, 1060 pages • L. Hanzo, M. Munster,¨ T. Keller, B-J. Choi, OFDM and MC-CDMA for Broadband Multi-User Communications, WLANs and Broadcasting, John-Wiley and IEEE Press, 2003, 978 pages • L. Hanzo, S-X. Ng, T. Keller and W.T. Webb, Quadrature Amplitude Modulation: From Basics to Adaptive Trellis-Coded, Turbo-Equalised and Space-Time Coded OFDM, CDMA and MC-CDMA Systems, John Wiley and IEEE Press, 2004, 1105 pages 1For detailed contents and sample chapters please refer to http://www-mobile.ecs.soton.ac.uk iii iv • L. Hanzo, T. Keller: An OFDM and MC-CDMA Primer, John Wiley and IEEE Press, 2006, 430 pages • L. Hanzo, F.C.A. Somerville, J.P. Woodard: Voice and Audio Compression for Wireless Communications, John Wiley and IEEE Press, 2007, 858 pages • L. Hanzo, P.J. Cherriman, J. Streit: Video Compression and Communications: H.261, H.263, H.264, MPEG4 and HSDPA-Style Adaptive Turbo-Transceivers John Wiley and IEEE Press, 2007, 680 pages • L. Hanzo, J. Blogh and S. Ni: HSDPA-Style FDD Versus TDD Networking: Smart Antennas and Adaptive Modulation John Wiley and IEEE Press, 2007, 650 pages Contents About the Authors i Other Wiley and IEEE Press Books on Related Topics i Preface v Acknowledgments vii I Video Codecs for HSDPA-Style Adaptive Videophones 1 2 Fractal Image Codecs 23 2.1 FractalPrinciples ............................... 23 2.2 One-Dimensional Fractal Coding . 26 2.2.1 FractalCodecDesign. 29 2.2.2 Fractal Codec Performance . 31 2.3 ErrorSensitivityandComplexity . ..... 35 2.4 SummaryandConclusions . 36 3 Low Bit-Rate DCT Codecs and HSDPA-Style Videophones 39 3.1 VideoCodecOutline .............................. 39 3.2 The Principle of Motion Compensation . 41 3.2.1 DistanceMeasures .. ..... ..... ..... ..... ..... 44 3.2.2 MotionSearchAlgorithms . 46 3.2.2.1 Full or Exhaustive Motion Search . 46 3.2.2.2 Gradient-Based Motion Estimation . 47 3.2.2.3 Hierarchical or Tree Search . 48 3.2.2.4 Subsampling Search . 49 3.2.2.5 Post-Processing of Motion Vectors . 50 3.2.2.6 Gain-Cost-Controlled Motion Compensation . 51 3.2.3 Other Motion Estimation Techniques . 52 3.2.3.1 Pel-Recursive Displacement Estimation . 52 ix x CONTENTS 3.2.3.2 Grid Interpolation Techniques . 53 3.2.3.3 MC Using Higher Order Transformations . 54 3.2.3.4 MCintheTransformDomain . 54 3.2.4 Conclusion ............................... 55 3.3 TransformCoding................................ 55 3.3.1 One-Dimensional Transform Coding . 55 3.3.2 Two-Dimensional Transform Coding . 56 3.3.3 Quantizer Training for Single-Class DCT . 60 3.3.4 Quantizer Training for Multiclass DCT . 61 3.4 TheCodecOutline ............................... 64 3.5 InitialIntra-FrameCoding . 64 3.6 Gain-Controlled Motion Compensation . ..... 64 3.7 The MCER Active/Passive Concept . 66 3.8 Partial Forced Update of the Reconstructed Frame Buffers .......... 67 3.9 The Gain/Cost-Controlled Inter-Frame Codec . ........ 69 3.9.1 Complexity Considerations and Reduction Techniques ........ 70 3.10 TheBit-AllocationStrategy. ..... 71 3.11Results...................................... 73 3.12 DCT Codec Performance under Erroneous Conditions . ......... 74 3.12.1 BitSensitivity.............................. 75 3.12.2 BitSensitivityofCodecIandII . 78 3.13 DCT-Based Low-Rate Video Transceivers . ...... 79 3.13.1 ChoiceofModem ........................... 79 3.13.2 Source-Matched Transceiver . 79 3.13.2.1 System1........................... 79 3.13.2.1.1 System Concept . 79 3.13.2.1.2 Sensitivity-Matched Modulation . 80 3.13.2.1.3 Source Sensitivity . 80 3.13.2.1.4 Forward Error Correction . 81 3.13.2.1.5 Transmission Format . 82 3.13.2.2 System2........................... 84 3.13.2.2.1 Automatic Repeat Request . 84 3.13.2.3 Systems3–5 ......................... 85 3.14 SystemPerformance .............................. 86 3.14.1 PerformanceofSystem1. 86 3.14.2 PerformanceofSystem2. 89 3.14.2.1 FERPerformance . 89 3.14.2.2 Slot Occupancy Performance . 90 3.14.2.3 PSNR Performance . 92 3.14.3 Performance of Systems 3–5 . 93 3.15 SummaryandConclusions . 97 CONTENTS xi 4 Low Bit-Rate VQ Codecs and HSDPA-Style Videophones 99 4.1 Introduction................................... 99 4.2 TheCodebookDesign ............................. 99 4.3 TheVectorQuantizerDesign . 101 4.3.1 Mean and Shape Gain Vector Quantization . 106 4.3.2 Adaptive Vector Quantization . 107 4.3.3 Classified Vector Quantization . 109 4.3.4 AlgorithmicComplexity . 110 4.4 Performance under Erroneous Conditions . 112 4.4.1 Bit-AllocationStrategy. 112 4.4.2 BitSensitivity..............................113 4.5 VQ-Based Low-Rate Video Transceivers . 115 4.5.1 ChoiceofModulation . 115 4.5.2 ForwardErrorCorrection . 116 4.5.3 ArchitectureofSystem1 . 118 4.5.4 ArchitectureofSystem2 . 119 4.5.5 ArchitectureofSystems3–6 . 120 4.6 SystemPerformance ..............................120 4.6.1 SimulationEnvironment . 120 4.6.2 PerformanceofSystems1and3 . 121 4.6.3 PerformanceofSystems4and5 . 123 4.6.4 PerformanceofSystems2and6 . 125 4.7 Joint Iterative Decoding of Trellis-Based VQ-Video and TCM . 126 4.7.1 Introduction...............................126 4.7.2 SystemOverview. .127 4.7.3 Compression ..............................127 4.7.4 Vector quantization decomposition . 128 4.7.5 Serial concatenation and iterative decoding . .......128 4.7.6 TransmissionFrameStructure . 130 4.7.7 Frame difference decomposition . 130 4.7.8 VQcodebook..............................132 4.7.9 VQ-induced code constraints . 133 4.7.10 VQtrellisstructure . 134 4.7.11 VQEncoding..............................137 4.7.12 VQDecoding..............................138 4.7.13 Results .................................140 4.8 SummaryandConclusions . 143 5 Low Bit-Rate Quad-Tree-Based Codecs and HSDPA-Style Videophones 147 5.1 Introduction...................................147 5.2 Quad-TreeDecomposition . 147 5.3 Quad-TreeIntensityMatch . 150 5.3.1 Zero-OrderIntensityMatch . 150 5.3.2 First-OrderIntensityMatch . 152 5.3.3 Decomposition Algorithmic Issues . 153 5.4 Model-Based Parametric Enhancement . 156 xii CONTENTS 5.4.1 EyeandMouthDetection . 157 5.4.2 Parametric Codebook Training .
Recommended publications
  • Proceedings National Committees on Intellectual
    LEAGUE OF NATIONS PROCEEDINGS OF THE SECOND GENERAL CONFERENCE OF NATIONAL COMMITTEES ON INTELLECTUAL CO OPERATION Paris, Juiy 5th-9lh, 1937 HANDBOOK OF INTERNATIONAL ORGANISATIONS (Ser. L.o.M P. 1937.XII.B4.) 491 pages ................................................................................................................... Price : 12/6 $3.00 This new and entirely revised edition contains information concerning the organisation and activities of about 650 international organisations, associations, bureaux, committees, most of which are of a private character. The Handbook, although not complete as far as the enumeration of existing international organisations goes, covers, with its sixteen different groups {e.g., Politics and International Relations ; Work for Peace ; Religion and Morals ; Humanitarian Activities ; Education ; Feminism ; Economics and Finance, etc.), every field of human activity. * * * BULLETIN OF LEAGUE OF NATIONS TEACHING An annual publication containing a detailed documentary study of the efforts made by the League to encourage those responsible for systems of national education in various countries to emphasise in their teaching the political, economic and social interdependence of the modem world. Up to January 1938, 4 numbers were is s u e d ..............................................Price : 2/6 S0.65 eaci. BULLETIN OF INFORMATION ON THE WORK OF INTERNATIONAL ORGANISATIONS This Bulletin gives a summary of the discussions at the meetings of international organisations established either under general Conventions concluded between Governments or by private initiative. It also contains a report of all international congresses or conferences, together with the text of the most important resolutions adopted. First series {1922-1928) : Annual subscription (4 num bers).............................................................. 5/- Si.1-- Second series : Vol. I-IV (1929-1932) (4 numbers)............................................................. 5/- $1.
    [Show full text]
  • Baltic Rim Economies – a List of Writers
    Baltic Rim Economies – a list of writers The following expert articles have been published in the previous reviews: Review Author(s) Position Title of article 2/2021 Dmytro Kuleba Minister for Foreign Affairs, Ukraine: Reflect on 2020 to Ukraine move forward in 2021 2/2021 Pekka Haavisto A democratic, stable and prosperous Ukraine Minister for Foreign Affairs, is also of Finland’s interest Finland 2/2021 Witold Member of the European Parliament for Stop Russia and defend Eastern Waszczykowski Poland, ECR Group Europe 1st Vice-Chairman of the EP’s Committee on Foreign Affairs (AFET) 2/2021 Valentyn MP, Secretary of the Parliamentary Sanctions as economic weapon Nalyvaichenko Committee for Ukraine’s integration into the to protect territorial integrity EU, and sovereignty Co-Chair, Group for Interparliamentary Relations with the Republic of Finland, Parliament of Ukraine 2/2021 Peter Östman Member of the Parliament of Finland International relations in the (Christian Democrats) Age of Pandemic Chair, Ukraine Friendship Group in the Parliament of Finland 2/2021 Matti Maasikas EU Ambassador to Ukraine Reforms in Ukraine – A second act or a second wave? 2/2021 Antti Hartikainen Head of Mission, Justice in Ukraine: EU Advisory Mission Ukraine (EUAM) Prosecutorial reform is Zelensky’s biggest test 2/2021 Kristina Kvien Chargé d’Affaires a.i., The steadfast partnership U.S. Embassy, between the United States and Kyiv, Ukraine Ukraine 2/2021 Olga Dibrova Ambassador of Ukraine to Finland Ukraine – Finland cooperation: The prospects 1 2/2021 Mykhaylo Ph.D. (Political Science), Associate Professor, Ukrainian public diplomacy in Komarnytskyy Department of International Relations and the XXI Century: Evolution and Diplomacy, Ivan Franko National University practice of Lviv, Ukraine Director, Center for American Studies, Ivan Franko National University of Lviv, Ukraine 2/2021 Andy Hunder President, Why Ukraine’s business The American Chamber of Commerce in community has high hopes for Ukraine the Biden presidency 2/2021 Martti J.
    [Show full text]
  • Harri Holma's Diplomatic Career in France
    Suffering what they must? Harri Holma’s diplomatic carrier in France (1927- 1943) as a case study in small states’ relations with Great Powers Paper presented during the 21st Conference on Baltic Studies: Baltic Crossroads: Examining Cultural, Social and Historical Diversity, Indiana University, Bloomington, May 29-31, 2008 Louis Clerc Department of Contemporary History University of Turku [email protected] This paper is a draft, meant for oral presentation, and as such unfit for publication. It should not be quoted or used without the author’s permission. For comments or critics on the content of the paper, please direct correspondence to Louis Clerc, Department of Contemporary History, Arwindssoninkatu 1, rak, 11, 20014 TURUN YLIOPISTO, Finland, or to [email protected]. Abstract When considering the international position of the Baltic region’s smallest states, the most striking feature is their dependency on Great powers’ politics. From Estonia to Norway, the 20th century brings enough examples of small Northern and Baltic nations being trampled upon. If might dictates right, and the international position of small states depends solely on Great Powers’ politics and geostrategic situations, why to study the foreign policies of small states at all? Building on that, the starting point of this presentation will be that, while limited and depending on the broader international context, there exists a real capacity of small states to influence the policies of Great Powers through diplomatic action. We aim here at illustrating this point through the study of Harri Holma’s diplomatic carrier. The Finnish ambassador to France from 1927 to 1943, Holma will be used in order to exemplify the possibilities open to a small state from the Baltic Sea Region to influence the policies of a Great Power.
    [Show full text]
  • The Wartime Experience of the League of Nations, 1939-47
    THE WARTIME EXPERIENCE OF THE LEAGUE OF NATIONS, 1939-47 by Emma Mary Edwards THESIS FOR THE DEGREE OF PhD DEPARTMENT OF HISTORY NATIONAL UNIVERSITY OF IRELAND MAYNOOTH Supervisors of research: Professor Filipe Ribeiro de Meneses and Dr. Denise Dunne September 2013 Table of Contents Declaration ................................................................................................................... ii Abstract ...................................................................................................................... iii Acknowledgements .................................................................................................... iiv List of Abbreviations.................................................................................................... v List of figures ........................................................................................................... vii Introduction ................................................................................................................ 1 Chapter one: The League’s place in the international system upon the outbreak of war: its political identity and technical role. .............................................................. 23 Chapter two: The impact of war on the Secretariat and technical organisations of the League, 1939-40 ................................................................................................... 78 Chapter three: Wartime challenges for a nascent international civil service: the League as a barometer of declining
    [Show full text]
  • Spectrum for Mobile Communications in the World
    1 CONFIDENTIAL DRAFT OCTOBER 2003 SPECTRUM FOR MOBILE1 COMMUNICATIONS IN THE WORLD GUSTAVE BARTH [email protected] 1 TERRESTRIAL 2 EXECUTIVE SUMMARY Terrestrial wireless is evolving very rapidly around the globe. Despite efforts of regulators, especially those who allocate radio spectrum, different approaches continue to appear and to grow in ways that are not converging toward an « everybody’s worldwide phone ». Many of the developments interact in ways that cannot be understood except by looking at the whole picture. This paper will provide a working global overview of the currents in mobile telephone technology, business growth and regulation, with special emphasis on spectrum aspects. Since the origins of radiocommunication, in the early years of the 20th century, government has played a key role in managing radio spectrum ; and international coordination – through what was already called ITU, or otherwise – was an early preoccupation, mainly because radio was the only practical way to communicate while extensively mobile, be it on a ship or a plane. In the last two decades, public cellular radio enjoyed such an exponential development, virtually everywhere, that the frequency harmonization which would have been advisable in a global mobility perspective could not follow pace. Also, technical conception took place « bottoms up », fairly independently within each leading geographic domains such as the U.S., Europe and Japan, giving birth to otherwise incompatible « air-interface » standards. This has not subsequently prevented the dozen key manufacturers from addressing the world market, at least in appearance, as if they were selling PC’s or digital cameras ; the operators’ camp, for its part, remaining extremely fragmented along geographic lines, even though consolidation looms.
    [Show full text]
  • Akkadian Laban Appi in the Light of Art and Literature MAYER I
    Akkadian laban appi in the Light of Art and Literature MAYER I. GRUBER Spertus College of Judaica Such authorities as E. Ebeling,! W. G. Lambert,2 and W. von Soden 3 have asserted un­ equivocally that the Akkadian expression appa labiinu refers to prostration. CAD L, 12 a, however, departs radically from the usual rendering of appa labanu: As the Sum. shows, the phrase appa labanu denotes a gesture involving both nose and hand, meant to express humility toward gods, kings and hu­ man beings. Though listed among the synonyms for praying, appa lablinu seems to denote the gesture accompanying a supplication, a prayer for mercy, the expression of complete obedience, etc. For a possible repre­ sentation of the gesture on a relief, see Jacobsen, OIP 24 p. 38 n. 46 and ZA 52 110 n. 38, Nougayrol, Syria 33 159 n. 3. A perusal of the literature dealing with appa labiinu reveals a long-standing controversy as to the identity of the gesture described by the expression appa labiinu and as to the sig­ nificance of the gesture in question. The editors of CAD, however, have presented their view of appa labiillu as if von Soden's dictionary and Lambert's Babylonian Wisdom Literature were either non-existent or of insufficient authority to bear mention. An examination of the basis of the widely-held identification of appa labiinu with prostration justifies both CAD's rejection of it and CAD's failure to call attention to such a view. The equation of appa labanu with prostration goes back to Harri Holma's monumental Die Namen der Korperteile im Assyrisch-babylonischen (Leipzig, 1911).
    [Show full text]
  • Assyriological Studies in Finland
    ASSYRIOLOGICAL STUDIES IN FINLAND SANNA ARO & RAIJA MATTILA PROCEEDING S OF THE FOUNDATION OF THE FINNI S H IN S TITUTE IN THE MIDDLE EA S T 1 / 2007 PROCEEDING S OF THE FOUNDATION OF THE FINNI S H IN S TITUTE IN THE MIDDLE EA S T 1 / 2007 Editor: Sanna Aro Layout: Maija Holappa Print: Picaset, Helsinki ISSN 1796-1521 ISBN 978-952-5393-09-5 Front cover: Simo Parpola contemplating fragments of cuneiform tablets at Ziyaret Tepe, Turkey. Photo: Courtesy of Simo Parpola CONTENT S PREFACE 5 KARL FREDRI K ENEBERG , FINNI S H PIONEER 7 KNUT TALLQVI S T 9 DI S CI P LE S OF TALLQVI S T : HARRI HOL M A AND AR M A S SALONEN 11 SE M ITI S T JU ss I ARO 14 IL M ARI KÄR K I AND ER kk I SALONEN 17 SI M O PAR P OLA 17 CUNEIFOR M AND CO mp UTER S 17 THE STATE ARCHIVE S OF Ass YRIA 19 MELA mm U 20 Ass YRIA NOW 20 DI S CI P LE S OF PAR P OLA 21 AUTHOR S 22 FURTHER READING 22 PREFACE The purpose of this brief account of the history of Assyriological studies in Fin- land is to give a glimpse of the unbroken tradition of the discipline in this coun- try. This is not intended as a survey of the intellectual impact of Assyriology and Assyriologists on the research fields in Finland and abroad. The versatile spirit of the Assyrio logists has influenced academic and cultural echelons of Finland and their interesting personalities certainly deserve a more profound study in the future.
    [Show full text]