DOCSLIB.ORG

Computational Complexity Reduction of Intra−Frame Prediction in Mpeg−2

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Computational Complexity Reduction of Intra−Frame Prediction in Mpeg−2 COMPUTATIONAL COMPLEXITY REDUCTION OF INTRA-FRAME PREDICTION IN MPEG-2/H.264 VIDEO TRANSCODERS Gerardo Fern ndez-Escribano, Pedro Cuenca, Luis Orozco-Barbosa and Antonio Garrido Instituto de Investigacin en Infor tica Universidad de Castilla-La Mancha, Ca pus Universitario, 02071 Albacete, SPAIN ,gerardo,pcuenca,lorozco,antonio-.info-ab.ucl .es ABSTRACT 1 :ualit1 video at about 1/3 to 1/2 of the bitrates offered b1 the MPEG-2 is the most widely digital video-encoding standard in MPEG-2 for at. 2hese significant band0idth savings open the use nowadays. It is being widely used in the development and ar5et to ne0 products and services, including 6423 services deployment of digital T services, D D and video-on-demand at lo0er bitrates. Further ore, given the relativel1 earl1 stage of services. However, recent developments have given birth to the video services in obile phones, obile phones 0ill be one of H.264/A C, offering better bandwidth to video )uality ratios the first ar5et seg ents to adopt 6.278 video. 6o0ever, these than MPEG2. It is expected that the H.264/A C will take over gains co e 0ith a significant increase in encoding and decoding the digital video market, replacing the use of MPEG-2 in most co pleAit1 ,3-. digital video applications. The complete migration to the new Bhile the 6.278 video standard is eApected to replace video-coding algorithm will take several years given the wide MPEG-2 video over the neAt several 1ears, a significant a ount scale use of MPEG-2 in the market place today. This creates an of research needs to be done in developing efficient encoding important need for transcoding technologies for converting the and transcoding technologies. 2he transcoding of MPEG-2 video large volume of existent video material from the MPEG-2 into to 6.278 for at is particularl1 interesting given the 0ide the H.264 format and vice versa. However, given the significant availabilit1 and use of MPEG-2 video no0ada1s. Further ore, differences between the MPEG-2 and the H.264 encoding there is a clear industr1 interest in technologies facilitating the algorithms, the transcoding process of such systems is much igration fro MPEG-2 to 6.278. 2he coeAistence of these more complex to other heterogeneous video transcoding technologies until the co plete adoption of 6.278 creates a need processes. In this paper, we introduce and evaluate a novel for technologies to transcode fro the MPEG-2 into the 6.278 intra-frame prediction algorithm to be used as part of a high- for at and vice versa. 6o0ever, given the significant differences efficient MPEG-2 to H.264 transcoder. ,ur evaluation results bet0een the MPEG-2 and the 6.278 coding algorith s, show that the proposed algorithm considerable reduces the transcoding is a uch ore co pleA tas5 co pared to the tas5 complexity involved in the intra-frame prediction- a key involved in other heterogeneous video transcoding architectures operation in the transcoding process. ,8-8-. 2he 6.278 e plo1s a h1brid coding approach si ilar to that of MPEG-2 but differs significantl1 fro MPEG-2 in ter s of 1. INTRODUCTION the actual coding tools used. 2he ain differences areC 1D use of an integer transfor 0ith energ1 co paction propertiesE 2D an No0ada1s, the MPEG-2 video coding for at ,1- is being 0idel1 in-loop debloc5ing filter to reduce bloc5 artifactsE 3D ulti-fra e used in a nu ber of applications fro digital 23 s1ste s to references for inter-fra e predictionE and 8D intra-fra e video-on-de and services. 2he use of MPEG-2 technolog1 prediction. 2he 6.278 standard introduces several other ne0 represents billions of dollars of invest ent in the MPEG-2 coding tools ai ing to i prove the coding efficienc1. infrastructure alread1 or currentl1 being deplo1ed. In this paper, 0e focus our attention on the intra-fra e 4uring the last fe0 1ears, technological develop ents, such predictionC one of the ost stringent tas5s involved in the as novel video coding algorith s, lo0er e or1 costs, and encoding process. A co plete overvie0 of the 6.278 can be faster processors, are facilitating the design and develop ent of found in ,9-. 2he rest of the paper is organized as follo0s. highl1 efficient video encoding standards. A ong the recent Section 2 provides a brief overvie0 of the intra-fra e prediction 0or5s in this area, the 6.278 video encoding standard, also process used b1 the 6.278 encoding standard. In Section 3, 0e 5no0n as MPEG-8 A3C occupies a central place ,2-. 2he 6.278 introduce a fast intra-fra e prediction algorith suitable for the standard, 9ointl1 developed b1 the I2U-2 and the MPEG transcoding of MPEG-2 into 6.278. In Section 8, 0e carr1 out a co ittees, is highl1 efficient offering perceptuall1 e:uivalent perfor ance evaluation of the proposed algorith in ter s of its co putational co pleAit1 and rate-distortion results. Finall1, 2his 0or5 0as supported b1 the Ministr1 of Science and 2echnolog1 of Spain under Section 5 concludes the paper. CICY2 pro9ect 2IC2003-08158-C07-02, the Council of Science and 2echnolog1 of Castilla-La Mancha under pro9ect PBC-03-001 and FE4ER. 0-7803-9332-5/05/$20.00 ©2005 IEEE 2. INTRA -FRAME PREDICTION IN H.264 3. SPEEDING -UP THE INTRA -FRAME PREDICTION 6.278 incorporates into its coding process, an intra -picture prediction (defined 0ithin the piAel do ainD 0hose ain ai is to i prove the co pression efficienc1 of the intra -coded Our approach si plifies the intra -fra e prediction b1 a5ing pictures and intra -MBs. Intra prediction can result in significant use of the 4C coefficients available fro the decoding process savings 0hen the otion present in the video se:uence is of the MPEG -2. 6o0ever, due to the presence of t0o different ini al and the spatial correlations are significant. 2hroughout sizes of bloc5 s used b1 the 6.278, na el1 8 x8 and 17 x17, and the paper, 0e 0ill illustrate the principle of ope ration of the that the MPEG -2 standards use bloc5s of 8 x8, the evaluation of intra -fra e prediction odes as applied to the lu inance bloc5s. the prediction ode involves and inter ediate scaling process. It is understood that a si ilar procedure has to be applied to the In the follo0ing, 0e describe one b1 one the ain steps of our chro inance bloc5s. algorith . Bhile acro bloc5s (MBD of 17 x17 piAels are still used, St p 1: predicting a MB fro the previou sl1 encoded MBs in the sa e picture is ne0 in 6.278. An MB a1 a5e use of 8 x8 and 17 x17 In an MPEG -2/6.278 video transcoder, once having decoded the bloc5 prediction odes, referred to as Intra_8 x8 and MPEG -2 video, besides the unco pr essed video, the 4C Intra_17 x17, respectivel1. 2here are nine 8 x8 possible bloc5 coefficient of the 8A8 bloc5s is readil1 available to the 6.278 prediction directions and four 17 x17 bloc5 prediction directions. video encoder. Since the MPEG -2 a5es use of onl1 8 x8 bloc5 s, Figure 1 depicts the nine and four prediction directions for the 0e need to devis e a echanis allo0ing us to properl1 co pute 8A8 and 17A17 prediction odes, respectivel1 . 2hese intra the 4C coefficients of the 8x8 and 17 x17 bloc5s. Figures 1a and prediction odes include a directional prediction greatl1 1b depict the procedure for co puting the 4C coefficients of the i proving the prediction in the presence of directional four 8 x8 bloc5s and the one associated to the 17 x17 bloc5. structures. Bith the intra -fra e prediction, th e I -pictures can be encoded ore efficientl1 than in MPEG -2, 0hich does not support intra -fra e prediction. Inverse I age space 4C2 4C2 do ain 8A8 8A8 bloc5 8 8A8 bloc5 (aD 8A8 bloc5 8A8 bloc5 Inverse I age space 4C2 4C2 do ain 17A17 17A17 bloc5 8A8 bloc5 8A8 bloc5 (bD (aD Figure 2. Straightfor0ard ethod. (aD 8 x8. (bD 17 x17. As seen fro Figure 2 a, the process to obtain the four 8 x8 bloc5s involves first appl1ing the inverse 4C2 to each 8 x8 bloc5 of the decoded MPEG -2 picture. 2his step regenerates the 8 x8 bloc5 in the spa ce do ain. 2hen, the 4C2 has to be applied to each 8A8 bloc5 in order to obtain the 4C coefficients of each (bD one of the . 2his process has to be applied to each and ever1 Figure 1. Prediction Modes. (aD 8 x8 bD 17 x17. 8x8 bloc5. In order to speed -up this process, 0e propose using the follo0ing resoluti on conversion ethod introduced in ,10-C For each MB, one prediction ode and one prediction T direction is 5ept. 2he 6.278 encode r selects the best /0 1 2 A / 1A (1D co bination ode/direction b1 using the .um of Absolute Errors (SAED. 2his i plies, that for each eAisting direction of each ode, the predictor 0ithin the piAel -do ain is created fro 0.71 0.78 0 0.22 0 0.15 0 − 0.13 the boundar1 piAels of the current partition and the SAE costs 0 0.29 0.71 0.56 0 − 0.25 0 − 0.20 are evaluated. 2he best co bination of ode/direction is 0 − 0.05 0 0.36 0.71 0.54 0 − 0.27 deter ined corresponding to the one eAhibiting the ini u 0 0.02 0 − 0.07 0 0.35 0.71 0.61 A = SAE cost.
Load more

Recommended publications
  • Efficient Multi-Codec Support for OTT Services: HEVC/H.265 And/Or AV1?
    Efficient Multi-Codec Support for OTT Services: HEVC/H.265 and/or AV1? Christian Timmerer†,‡, Martin Smole‡, and Christopher Mueller‡ ‡Bitmovin Inc., †Alpen-Adria-Universität San Francisco, CA, USA and Klagenfurt, Austria, EU ‡{firstname.lastname}@bitmovin.com, †{firstname.lastname}@itec.aau.at Abstract – The success of HTTP adaptive streaming is un- multiple versions (e.g., different resolutions and bitrates) and disputed and technical standards begin to converge to com- each version is divided into predefined pieces of a few sec- mon formats reducing market fragmentation. However, other onds (typically 2-10s). A client first receives a manifest de- obstacles appear in form of multiple video codecs to be sup- scribing the available content on a server, and then, the client ported in the future, which calls for an efficient multi-codec requests pieces based on its context (e.g., observed available support for over-the-top services. In this paper, we review the bandwidth, buffer status, decoding capabilities). Thus, it is state of the art of HTTP adaptive streaming formats with re- able to adapt the media presentation in a dynamic, adaptive spect to new services and video codecs from a deployment way. perspective. Our findings reveal that multi-codec support is The existing different formats use slightly different ter- inevitable for a successful deployment of today's and future minology. Adopting DASH terminology, the versions are re- services and applications. ferred to as representations and pieces are called segments, which we will use henceforth. The major differences between INTRODUCTION these formats are shown in Table 1. We note a strong differ- entiation in the manifest format and it is expected that both Today's over-the-top (OTT) services account for more than MPEG's media presentation description (MPD) and HLS's 70 percent of the internet traffic and this number is expected playlist (m3u8) will coexist at least for some time.
    [Show full text]
  • CALIFORNIA STATE UNIVERSITY, NORTHRIDGE Optimized AV1 Inter
    CALIFORNIA STATE UNIVERSITY, NORTHRIDGE Optimized AV1 Inter Prediction using Binary classification techniques A graduate project submitted in partial fulfillment of the requirements for the degree of Master of Science in Software Engineering by Alex Kit Romero May 2020 The graduate project of Alex Kit Romero is approved: ____________________________________ ____________ Dr. Katya Mkrtchyan Date ____________________________________ ____________ Dr. Kyle Dewey Date ____________________________________ ____________ Dr. John J. Noga, Chair Date California State University, Northridge ii Dedication This project is dedicated to all of the Computer Science professors that I have come in contact with other the years who have inspired and encouraged me to pursue a career in computer science. The words and wisdom of these professors are what pushed me to try harder and accomplish more than I ever thought possible. I would like to give a big thanks to the open source community and my fellow cohort of computer science co-workers for always being there with answers to my numerous questions and inquiries. Without their guidance and expertise, I could not have been successful. Lastly, I would like to thank my friends and family who have supported and uplifted me throughout the years. Thank you for believing in me and always telling me to never give up. iii Table of Contents Signature Page ................................................................................................................................ ii Dedication .....................................................................................................................................
    [Show full text]
  • RULING CODECS of VIDEO COMPRESSION and ITS FUTURE 1Dr.Manju.V.C, 2Apsara and 3Annapoorna
    International Journal of Application or Innovation in Engineering & Management (IJAIEM) Web Site: www.ijaiem.org Email: [email protected] Volume 8, Issue 7, July 2019 ISSN 2319 - 4847 RULING CODECS OF VIDEO COMPRESSION AND ITS FUTURE 1Dr.Manju.v.C, 2Apsara and 3Annapoorna 1Professor,KSIT 2Under-Gradute, Telecommunication Engineering, KSIT 3Under-Gradute, Telecommunication Engineering, KSIT Abstract Development of economical video codecs for low bitrate video transmission with higher compression potency has been a vigorous space of analysis over past years and varied techniques are projected to fulfill this need. Video Compression is a term accustomed outline a technique for reducing the information accustomed cipher digital video content. This reduction in knowledge interprets to edges like smaller storage needs and lower transmission information measure needs, for a clip of video content. In this paper, we survey different video codec standards and also discuss about the challenges in VP9 codec Keywords: Codecs, HEVC, VP9, AV1 1. INTRODUCTION Storing video requires a lot of storage space. To make this task manageable, video compression technology was developed to compress video, also known as a codec. Video coding techniques provide economic solutions to represent video data in a more compact and stout way so that the storage and transmission of video will be completed in less value in less cost in terms of bandwidth, size and power consumption. This technology (video compression) reduces redundancies in spatial and temporal directions. Spatial reduction physically reduces the size of the video data by selectively discarding up to a fourth or more of unneeded parts of the original data in a frame [1].
    [Show full text]
  • Platforms for Handling and Development of Audiovisual Data
    Faculdade de Engenharia da Universidade do Porto Platforms for Handling and Development of Audiovisual Data José Pedro Sousa Horta Project/Dissertation concerning Mestrado Integrado em Engenharia Informática Advisor: Professor Eurico Carrapatoso July 2008 © José Pedro Sousa Horta, 2008 Platforms for Handling and Development of Audiovisual Data José Pedro Sousa Horta Project/Dissertation concerning Mestrado Integrado em Engenharia Informática Approved in public display by the jury: President: Prof. Doutor António Fernando Coelho _________________________________________________ Examiner: Prof. Doutor Nuno Magalhães Ribeiro Vowel: Prof. Doutor Eurico Manuel Carrapatoso July 17th 2008 Abstract Everywhere around us, digital is replacing analogue. Such is especially true in the audiovisual: be it in consumer or professional market, the advantages of computer-based media have quickly persuaded investors. To choose in which technologies, software should be based, proper understanding of the major aspects behind digital media is essential. An overview of the state of the art regarding the compression of digital video, the existing container formats and the multimedia frameworks (that enable easier playback and editing of audiovisual content) will be given, preceded by an introduction of the main topics. The professional video market is particularly focused on this document, due to the context of its elaboration, predominantly MPEG-2, MXF and DirectShow. In order to obtain more accurate results, fruit of the practical contact with the technology, a hands-on programming project was accomplished using DirectShow to playback both local and remote WMV files. Compression algorithms are continuously being improved and new ones invented, the designers of container formats are paying increased attention to metadata and some serious alternatives to DirectShow are emerging.
    [Show full text]
  • Implementation of H.264/Mpeg-4 Advanced Video Coding Standard
    Indian Journal of Emerging Electronics in Computer Communications, Volume.3, Issue.1, 2016, Page.538-541 www.scientistlink.com/ijeecc Implementation of H.264/Mpeg-4 Advanced Video Coding Standard A.Princy1, C.Sridhar2 1PG Scholar, 2Assistant Professor Electronics and Communication Engineering S.K.R Engineering college, Chennai, India. [email protected],2 [email protected] Abstract: H.264/AVC is newest video coding standard of the ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group. The main goals of the H.264/AVC standardization effort have been enhanced compression performance and provision of a “network-friendly” video representation addressing “conversational” (video telephony) and “nonconversational” (storage, broadcast, or streaming) applications.mH.264/AVC has achieved a significant improvement in rate-distortion efficiency relative to existing standards. This article provides an overview of the technical features of H.264/AVC, describes profiles and applications for the standard, and outlines the history of the standardization process. It covers all common video applications ranging from mobile services and videoconferencing to IPTV, HDTV, and HD video storage. This article discusses the technology behind the new H.264/MPEG4-AVC standard, focusing on the main distinct features of its core coding technology and its first set of extensions, known as the fidelity range extensions. In addition, this article also discusses the current status of adoption and deployment of the new standard in various application areas. Keywords- Advanced video codec, H.264, High Definition,MPEG-4,Standard Definition. I. INTRODUCTION Video processing systems require high performance processing elements and an efficient memory hierarchy design to reach real –time performance in the decoding of high definition video sequences.
    [Show full text]
  • H.265 (Hevc) Bitstream to H.264 (Mpeg 4 Avc)
    H.265 (HEVC) BITSTREAM TO H.264 (MPEG 4 AVC) BITSTREAM TRANSCODER by DEEPAK HINGOLE Presented to the Faculty of the Graduate School of The University of Texas at Arlington in Partial Fulfillment of the Requirements for the Degree of MASTER OF SCIENCE IN ELECTRICAL ENGINEERING THE UNIVERSITY OF TEXAS AT ARLINGTON December 2015 Copyright © by Deepak Hingole 2015 All Rights Reserved ACKNOWLEDGEMENTS I would like to express my heartfelt gratitude to my advisor Dr. K. R. Rao for his unwavering support, encouragement, supervision and valuable inputs throughout this research work. He has been a constant source of inspiration for me to pursue this research work. I would also like to extend my gratitude to my colleagues in Adobe Systems Incorporated for their invaluable industrial insight and experience to help me understand and grow in the field of digital video processing. Additionally I would like to thank Dr. Schizas and Dr. Dillon for serving as members of my graduate committee. A big thank you to Vasavee, Rohith, Maitri, Shwetha, Srikanth and Uma, my Multimedia Processing Lab mates for providing valuable suggestions during the course of my research work. Last but not the least; I would like to thank my parents, my siblings and my close friends for believing in me and supporting me in this undertaking. I wish for your continued support in future. November 25, 2015 ABSTRACT H.265 (HEVC) BITSTREAM TO H.264 (MPEG 4 AVC) BITSTREAM TRANSCODER Deepak Hingole, MS The University of Texas at Arlington, 2015 Supervising Professor: K. R. Rao With every new video coding standard the general rule of thumb has been to maintain same video quality at a reduced bit rate of about 50% as compared to the previous standard.
    [Show full text]
  • Multimedia Production
    Multimedia Production Lecture 4 Digital Video Dr. Somsak Phattarasukol Faculty of Management Science UDON THANI RAJABHAT UNIVERSITY Digital Video ● Digital video is a representation of moving visual images in the form of encoded digital data. – the images being displayed are called frames – the rate at which frames are displayed in is called frame rate – the number of bits used to indicate a pixel's color is called color depth Sources: Wikipedia.org, dpbestflow.org, Mediacollege.com and Videomaker.com Digital Video ● An example video has – a duration of 1 hour (3600 sec), – a frame size of 640 x 480 pixels, – a color depth of 24 bits and – a frame rate of 25 frames per second would have a file size of 3600 x 640 x 480 x 24 x 25 = 82.8 Gbytes Sources: Wikipedia.org, dpbestflow.org, Mediacollege.com and Videomaker.com Digital Video Files ● Digital video file is a file for storing digital video and other data on a computer system. – It normally consists of a container containing encoded video data alongside encoded audio data as well as other data such as synchronization information and subtitles. – A program (or hardware) that encodes and decodes video or audio is called a codec Sources: Wikipedia.org, dpbestflow.org, Mediacollege.com and Videomaker.com Container ● A container is a metafile describing how different elements of data and metadata coexist in a computer file. – an example of image containers: TIFF – an example of audio containers: WAV – examples of multimedia containers: AVI, MP4, Ogg Sources: Wikipedia.org, dpbestflow.org, Mediacollege.com and Videomaker.com Codec ● A codec is a device or computer program capable of encoding or decoding a digital data stream or signal.
    [Show full text]
  • Analysis of Video Compression Technique IR.Mahalakshmi, Iidr.S.K.Mahendran Idept
    International Journal of Advanced Research in ISSN : 2347 - 8446 (Online) Computer Science & Technology (IJARCST 2017) Vol. 5, Issue 1 (Jan. - Mar. 2017) ISSN : 2347 - 9817 (Print) Analysis of Video Compression Technique IR.Mahalakshmi, IIDr.S.K.Mahendran IDept. of Computer Science, Madurai Kamaraj University College, India IIDept. of Computer Science, Bharathiar University, India Abstract Video compression has been the object of intensive research in the last thirty years. Video compression technique is now mature as is proven by the large number of applications that make use of this technology. This paper gives the idea about different techniques available for video compression. H.264/AVC exhibits superior coding performance improvement over its predecessors. The next generation standards are being generated by both VCEG and MPEG. In this paper, we also summarized the progress of those next generation video coding standard projects and existing new video coding techniques. In this paper is organized as describes the various basic techniques available for the video compression; the implementation strategies of video compression techniques; various generations ; latest trend in video compression; different issues related to emerging technologies. Keywords H.264/AVC, JVT, Video Codec, Issues, KTA, MPEG, VCEG. using the DWT . 2 The second one is to use a full 3-D wavelet Introduction decomposition. These approaches have reported coding effi- Video coding techniques provide efficient solutions to represent ciency improvements with respect to the hybrid schemes. These video data in a more compact and robust way so that the storage schemes are intended to provide further functionalities such as and transmission of video can be realized in less cost in terms scalability and progressive transmission.
    [Show full text]
  • An Overview of Core Coding Tools in the AV1 Video Codec
    An Overview of Core Coding Tools in the AV1 Video Codec Yue Chen∗, Debargha Murherjee∗, Jingning Han∗, Adrian Grange∗, Yaowu Xu∗, Zoe Liu∗, Sarah Parker∗, Cheng Chen∗, Hui Su∗, Urvang Joshi∗, Ching-Han Chiang∗, Yunqing Wang∗, Paul Wilkins∗, Jim Bankoski∗, Luc Trudeauy, Nathan Eggey, Jean-Marc Valiny, Thomas Daviesz, Steinar Midtskogenz, Andrey Norkinx and Peter de Rivaz{ ∗Google, USA yMozilla, USA zCisco, UK and Norway xNetflix, USA {Argon Design, UK VP9 Abstract—AV1 is an emerging open-source and royalty-free video R: Recursive compression format, which is jointly developed and finalized in early 64x64 2018 by the Alliance for Open Media (AOMedia) industry consortium. The main goal of AV1 development is to achieve substantial compression R R gain over state-of-the-art codecs while maintaining practical decoding R R complexity and hardware feasibility. This paper provides a brief technical overview of key coding techniques in AV1 along with preliminary 128x128 compression performance comparison against VP9 and HEVC. Index Terms—Video Compression, AV1, Alliance for Open Media, Open-source Video Coding AV1 I. INTRODUCTION R R Video applications have become ubiquitous on the internet over R R the last decade, with modern devices driving a high growth in Fig. 1. Partition tree in VP9 and AV1 the consumption of high resolution, high quality content. Services II. AV1 CODING TECHNIQUES such as video-on-demand and conversational video are predominant A. Coding Block Partition bandwidth consumers, that impose severe challenges on delivery infrastructures and hence create even stronger need for high efficiency VP9 uses a 4-way partition tree starting from the 64×64 level video compression technology.
    [Show full text]
  • 11-755— Spring 2021 Large Scale Multimedia Processing
    11-755— Spring 2021 Large Scale Multimedia Processing 1 Lecture 5/6 Multimedia capture and storage Rita Singh Carnegie Mellon University In this lecture • Digital multimedia: Recording and devices – Audio – Images – Video – Text • Digital multimedia: Processing – Audio processing – Two generic processing techniques 3 The first video: 1877 • https://www.telegraph.co.uk/culture/culturevideo/8035681/The-worlds-first-films.html • The footage was shot from 1877, and projected by Muybridge's 'Zoopraxiscope' invented two years later in 1879. The dates mean that he was able to make and show films 16 years before the Lumiere Brothers used the more commercially successful cinematograph to popularise the art form. • The dozen films are only a few seconds long and were commissioned to illustrate Victorian experiments in animal and human motion. Instead of using celluloid passed across a lens for a fraction of a second, Muybridge spaced out still cameras triggered by tripwires broken when the animals ran along, then projected the resulting sequence. 4 Video cameras • Analog video/movie cameras: – Mechanical devices that captured images on moving film (multiple photographs per second on a continuous film) Movie Camera 35mm Mitchell Film Original, circa 1940s 5 Video cameras • Digital video/movie cameras: – Just like still image cameras – Take multiple shots automatically at a fixed rate per second – The rate is decided based on persistence of vision – Usually 30 photos/second 6 Video cameras • What happens to the sound? – Sound is recorded alongside and time synchronized with the photo frames https://zaxcom.com/the-hobbit-a-production-sound- perspective/ 7 What happens to the sound? shotgun microphones - boom mics for movies • Each film created its own set of challenges, but Johnson and his two boom operators, Corrin Ellingford and Steven Harris, consistently took the time to wire all the actors each day.
    [Show full text]
  • Evaluation of 4D Light Field Compression Methods
    Evaluation of 4D Light Field Compression Methods David Barina Tomas Chlubna Marek Solony Drahomir Dlabaja Pavel Zemcik Centre of Excellence IT4Innovations Faculty of Information Technology Brno University of Technology Bozetechova 1/2, Brno Czech Republic {ibarina,ichlubna,isolony,zemcik}@fit.vutbr.cz Abstract Light field data records the amount of light at multiple points in space, captured e.g. by an array of cameras or by a light-field camera that uses microlenses. Since the storage and transmission requirements for such data are tremendous, compression techniques for light fields are gaining momentum in recent years. Although plenty of efficient compression formats do exist for still and moving images, only a little research on the impact of these methods on light field imagery is performed. In this paper, we evaluate the impact of state-of-the-art image and video compression methods on quality of images rendered from light field data. The methods include recent video compression standards, especially AV1 and XVC finalised in 2018. To fully exploit the potential of common image compression methods on four-dimensional light field imagery, we have extended these methods into three and four dimensions. In this paper, we show that the four-dimensional light field data can be compressed much more than independent still images while maintaining the same visual quality of a perceived picture. We gradually compare the compression performance of all image and video compression methods, and eventually answer the question, "What is the best compression method for light field data?". Keywords Light field, Plenoptic imaging, Lossy compression, Image refocusing 1 INTRODUCTION To describe a three-dimensional scene from any possible (x;y;z) viewing position at any viewing angle, one could define f a plenoptic function P(x;y;z;f;y), where the (x;y;z) is the position and (f;y) is a viewing angle (in spherical coordinates) of a camera.
    [Show full text]
  • A Framework for Video Coding Analyzer
    A Framework for Video Coding Analyzer Sakshi Jain ECE IIIT-Delhi Under the Supervision of Dr.Alexander Fell A thesis submitted for the degree of Master of Technology 2016 June ii 1. Reviewer: Name 2. Reviewer: Day of the defense: Signature from head committee: iii Abstract A video analyzer is a comprehensive bitstream analysis tool which acceler- ates development and debugging of video bitstreams while ensuring com- pliance with industry standards. There are many conventional analyzers present for different video standards like H.264, HEVC which are compliant only with the respective video sequence format. In this work, a general- ized analyzer is proposed which is flexible enough to incorporate any video codec, as it is video syntax independent. It also integrates encoder which helps in the development and analysis of video encoder. In a case study, the analyzer is tested for VP9 bitstreams which is the latest video coding format. Acknowledgements I express my sincere gratitude to my thesis supervisor Dr. Alexander Fell and Mr. Ajit Singh Motra for their valuable guidance and inspiration throughout my thesis work. I appreciate the way they helped me at each step of my work and the unwavering faith they showed in my abilities. I would like to thank Mr. Mahesh Narain Shukla for his guidance and help in all matters without which this work couldnt have been turned into reality. I would like to thank all my friends, and would remain indebted to them for the way they rejoiced in my happiness and backed me in difficult times. I would also like to thank every person who has directly or indirectly helped me in the completion of my work.
    [Show full text]