Thesis Title

Total Page:16

File Type:pdf, Size:1020Kb

Thesis Title DEGREE PROJECT IN COMPUTER SCIENCE AND ENGINEERING, SECOND CYCLE, 30 CREDITS STOCKHOLM, SWEDEN 2018 Towards network based media processing using cloud technologies ROBERTO RAMOS CHAVEZ KTH ROYAL INSTITUTE OF TECHNOLOGY SCHOOL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE Abstract Media delivery based on HTTP adaptive bitrate streaming protocol has become one of the most popular methods for streaming video and audio over the Internet. These services are commonly built on top of centralized infrastructures that rely on network conditions or computing resources, which may reduce performance applications on the client side. Massive increases in cloud technologies, such as infrastructure as a service (IaaS), container as a service (CaaS), and new deployment paradigms like function as a service (FaaS) provide accessible deployment of virtual functions in multiple locations, which reduces various streaming performance constraints. However, there is no clear understanding of whether all cloud deployments are suitable for media delivery. This thesis develops a proof of concept for the deployment of media processing functions in the cloud. Three media processing use cases and a media streaming prototype for video on- demand (VOD) ad insertion are designed, implemented, and evaluated. Each of the three media processing use cases is evaluated in a specific deployment architecture to obtain key performance indicators (KPIs) for use in future networks, such as 5G and network-based media processing (NBMP). Acknowledgment First, I would like to express my enormous gratitude towards my supervisor Dr. Rufael Mekuria at Unified Streaming. For his guidance and strong patience during this work. I would also like to thank Dirk Griffioen and Mark Ogle for our endless discussions and support during the past six months. I have learned a lot from them, my perception as a researcher, technology, and teamwork has changed dramatically. Their extensive knowledge in the field of media delivery inspired me every day that I was present at Unified Streaming. I would also like to stretch my thanks to Prof. Markus Flierl, for his continuous advice during his academic courses and the thesis. But mostly I would like to thank my parents and family for supporting me through the years. Amsterdam, October 10th, 2018 Sammanfattning Medieleverans baserad p HTTP-adaptivt bitrate-streamingprotokoll har blivit en av de mest populra metoderna fr streaming av video och ljud ver Internet. Dessa tjnster r vanligtvis byggda utver centraliserad infrastruktur som bygger p ntverksfrhllanden eller datafrbrukning, vilket kan minska prestandatillmpningar p kundsidan. Massiva kningar i moln teknik, ssom infrastruktur som en tjnst (IaaS), behllare som en tjnst (CAA) och nya distributions paradigm som fungerar som en tjnst (FAAS) tillhandahlla lttillgnglig utbyggnaden av virtuella funktioner p flera platser, som du minskar flera streaming prestanda begrnsningar. Det finns emellertid ingen klar frstelse fr huruvida molnutlggningar r lmpliga fr medialeverans. Denna avhandling utvecklar ett bevis p konceptet fr distribuering av mediabehandlingsfunk- tioner i molnet. bearbetning anvndningsfall och en prototyp fr media streaming video on-demand (VOD) ad insttning r utformade, genomfrs och utvrderas tre medierna. Var och en av de tre me- diebearbetningsanvndningsfall utvrderas i ett visst utplacering arkitektur Ska↵a nyckeltal (KPI) fr anvndning i framtida ntverk, och 5G: ssom ntverksbaserad media bearbetning (NBMP). Contents 1 Introduction 1 1.1 Background Information . 1 1.2 ResearchPurpose.................................... 1 1.3 Motivation ....................................... 1 1.4 Challenges........................................ 2 1.5 Researchquestions ................................... 2 1.6 Thesisoutline...................................... 3 2 Technical Background and Related Work 4 2.1 Media Delivery .................................... 4 2.1.1 HTTP adaptive bitrate streaming . 4 2.1.2 Live and on-demand streaming models . 4 2.1.3 Multimedia container formats and media descriptor languages . 5 2.1.4 Mediaprocessingsoftware. 7 2.2 Cloud Computing .................................. 8 2.2.1 Computing Virtualization . 8 2.2.2 Network Virtualization . 9 2.2.3 Container orchestration engine . 9 2.2.4 Functionasaservice.............................. 10 2.2.5 Edge computing . 11 2.3 Related Work ..................................... 12 2.3.1 Media processing operations in the network ............. 12 2.3.2 Clouddeploymentarchitectures. 14 2.3.3 Mediaprocessingfunctions . 14 2.4 Our Contribution .................................. 15 3 Media processing Function Use cases 16 3.1 Content packaging . 16 3.2 VideoTranscoding ................................... 18 3.3 ContentAdInsertion.................................. 19 4MediaProcessingDeploymentDesign 20 4.1 Software Components . 21 4.2 Cloud Technology Components . 22 4.2.1 Hypervisor-based virtualization deployment technology . 22 4.2.2 Container orchestration deployment technology . 23 4.2.3 Serverless deployment technology . 25 4.3 DesignDecisions .................................... 26 4.3.1 Cloud deployment technology decisions . 27 4.3.2 Ad insertion prototype design using Container Orchestration . 29 5 MediaProcessingDeploymentImplementation 32 5.1 Introduction....................................... 32 5.2 VMDeploymentImplementation . 34 5.2.1 Mediaprocessingimplementationprocedure . 34 5.3 Container Orchestration Deployment Implementation . 35 5.3.1 MediaprocessingImplementationprocedure. 35 5.4 ServerlessDeploymentImplementation . 36 5.4.1 Serverless cloud provider implementation overview . 36 5.4.2 MediaprocessingImplementationprocedure. 36 5.5 Ad Insertion Prototype Deployment Implementation . 38 5.5.1 Mediaprocessingimplementationprocedure . 38 6 Media Processing Deployment Evaluation 40 6.1 Load Generator Tools and Measurement Specifications . 40 6.1.1 MediaprocessingwithCGIexecution . 41 6.2 Use case (A) : Content packaging results . 43 6.2.1 VMs in content packaging . 43 6.2.2 Serverless in content packaging . 44 6.3 Use case (B) VideoTranscodingresults . 47 6.3.1 VMs in Video Transcoding . 47 6.3.2 ServerlessinVideoTranscoding. 48 6.4 Use case (C) Contentstitchingresults . 48 6.4.1 VMincontentstitching ............................ 50 6.4.2 Serverlessincontentstitching. 51 6.5 Use case (D):ContentAdInsertionresults . 53 6.5.1 Container orchestration setups . 53 6.5.2 Measurement procedure for Ad insertion prototype . 54 6.5.3 Container orchestration for Ad insertion results . 54 7 Conclusion and Future work 58 7.1 Conclusions....................................... 58 7.2 Limitations and Future work . 59 7.2.1 Implementation constraints . 59 7.2.2 Futurework................................... 59 Appendices 65 A Serverless Cloud Provider Evaluation 66 A.0.1 Serverless provider performance evaluation . 66 A.0.2 Serverlessproviderperformanceresults. 67 i Chapter 1 Introduction 1.1 Background Information This project was carried out at Unified Streaming, which is a leading company in streaming services located in the Netherlands. Unified Streaming provides streaming software for o✏ine and on-the-fly packaging content video and audio. Its software is based on C/C++ module and also possible to use on most common web server plugins. 1.2 Research Purpose We are in a new era of media entertainment which o↵ers viewers endless choices for media consumption, from watching our favorite TV shows, to live streaming sporting events, to following camera feeds on social media in real-time. Consequently, the increase of data traffic through the networks has escalated dramatically, and network operators and service providers are struggling to serve the fast-growing media traffic over existing infrastructure. By 2020 Video traffic is expected to increase up to 80% from all Internet traffic [23]. HTTP Adaptive Bitrate Streaming (ABS) has converged as the primary transport protocol for delivering video over the Internet. The Cloud Services have evolved exponentially by providing ease of access to powerful computing resources in multiple locations. They have developed other novel technologies to improve the provisioning of resources such as Function as a Service(FaaS) and microservices based technologies. These allow to develop, run, and deploy code with specific functionality without controlling the back-end infrastructure. This thesis looks into the performance evaluation of di↵erent cloud technologies available to deploy media processing functions, which can help to achieve target KPI’s for 5G networks and improve the efficiency of media distribution. Cloud technologies such as hypervisor virtu- alization, containers, micro-service, and cloud functions will be used in this research. Chosen media processing functions are based on a di↵erent level of computing complexity in streaming services: content packaging, video transcoding, and content stitching. 1.3 Motivation There are several motivations to carry out this work. First, the Future networks such as 5G, which can provide distributed cloud computing at the edge. For media delivery, it is attractive because it allows to run specific media processing functions at any point of the network. 1 For instance, a late-transmuxing seen in [46], provides higher performance than a CDN when delivering content, and a server-side ad insertion, which increases level of user personalization. This last one can be achieved by the deployment at strategic geo-locations/edges. 1.4 Challenges The bottom line of this work it is
Recommended publications
  • Freeware-List.Pdf
    FreeWare List A list free software from www.neowin.net a great forum with high amount of members! Full of information and questions posted are normally answered very quickly 3D Graphics: 3DVia http://www.3dvia.com...re/3dvia-shape/ Anim8or - http://www.anim8or.com/ Art Of Illusion - http://www.artofillusion.org/ Blender - http://www.blender3d.org/ CreaToon http://www.creatoon.com/index.php DAZ Studio - http://www.daz3d.com/program/studio/ Freestyle - http://freestyle.sourceforge.net/ Gelato - http://www.nvidia.co...ge/gz_home.html K-3D http://www.k-3d.org/wiki/Main_Page Kerkythea http://www.kerkythea...oomla/index.php Now3D - http://digilander.li...ng/homepage.htm OpenFX - http://www.openfx.org OpenStages http://www.openstages.co.uk/ Pointshop 3D - http://graphics.ethz...loadPS3D20.html POV-Ray - http://www.povray.org/ SketchUp - http://sketchup.google.com/ Sweet Home 3D http://sweethome3d.sourceforge.net/ Toxic - http://www.toxicengine.org/ Wings 3D - http://www.wings3d.com/ Anti-Virus: a-squared - http://www.emsisoft..../software/free/ Avast - http://www.avast.com...ast_4_home.html AVG - http://free.grisoft.com/ Avira AntiVir - http://www.free-av.com/ BitDefender - http://www.softpedia...e-Edition.shtml ClamWin - http://www.clamwin.com/ Microsoft Security Essentials http://www.microsoft...ity_essentials/ Anti-Spyware: Ad-aware SE Personal - http://www.lavasoft....se_personal.php GeSWall http://www.gentlesec...m/download.html Hijackthis - http://www.softpedia...ijackThis.shtml IObit Security 360 http://www.iobit.com/beta.html Malwarebytes'
    [Show full text]
  • Free and Open Source Software
    Free and open source software Copyleft ·Events and Awards ·Free software ·Free Software Definition ·Gratis versus General Libre ·List of free and open source software packages ·Open-source software Operating system AROS ·BSD ·Darwin ·FreeDOS ·GNU ·Haiku ·Inferno ·Linux ·Mach ·MINIX ·OpenSolaris ·Sym families bian ·Plan 9 ·ReactOS Eclipse ·Free Development Pascal ·GCC ·Java ·LLVM ·Lua ·NetBeans ·Open64 ·Perl ·PHP ·Python ·ROSE ·Ruby ·Tcl History GNU ·Haiku ·Linux ·Mozilla (Application Suite ·Firefox ·Thunderbird ) Apache Software Foundation ·Blender Foundation ·Eclipse Foundation ·freedesktop.org ·Free Software Foundation (Europe ·India ·Latin America ) ·FSMI ·GNOME Foundation ·GNU Project ·Google Code ·KDE e.V. ·Linux Organizations Foundation ·Mozilla Foundation ·Open Source Geospatial Foundation ·Open Source Initiative ·SourceForge ·Symbian Foundation ·Xiph.Org Foundation ·XMPP Standards Foundation ·X.Org Foundation Apache ·Artistic ·BSD ·GNU GPL ·GNU LGPL ·ISC ·MIT ·MPL ·Ms-PL/RL ·zlib ·FSF approved Licences licenses License standards Open Source Definition ·The Free Software Definition ·Debian Free Software Guidelines Binary blob ·Digital rights management ·Graphics hardware compatibility ·License proliferation ·Mozilla software rebranding ·Proprietary software ·SCO-Linux Challenges controversies ·Security ·Software patents ·Hardware restrictions ·Trusted Computing ·Viral license Alternative terms ·Community ·Linux distribution ·Forking ·Movement ·Microsoft Open Other topics Specification Promise ·Revolution OS ·Comparison with closed
    [Show full text]
  • Making Dvds Using MPEG Streamclip and DVD Styler
    Making DVDs using MPEG Streamclip and DVD Styler Version 1.3 Author: Chris Playll This guide provides step by step instructions for making a DVD copy of a Topfield recording using a Windows PC. There are several methods of doing this, so this guide begins by describing some of the basic principles and then some of the options available. This is then followed by the detailed step by step guide for one method. A. INTRODUCTION Why Use a Computer? The first question that you may ask is why not just copy the programme directly from the Topfield to a DVD recorder. You may feel that this is a simpler solution and may be more convenient if your DVD recorder is permanently connected to your Topfield PVR. This method gives predictable results, if you are not bothered about removing commercial breaks from your DVD copy, and don't mind any unwanted extra material after the programme. There are some disadvantages. The programme has to be copied at normal speed, during which time the Topfield cannot be used for anything else. You need to manually start and stop the DVD recorder at the correct time which means being available when the programme finishes, possibly by setting an alarm on your watch or phone to remind you. If you are recording several programmes on one disc this means starting and stopping the recording after each programme. There will be some loss of quality since you will be decoding the Topfield files to analogue vision and sound and then re-encoding them in the DVD recorder.
    [Show full text]
  • Digitale Video Titelpagina Ontbreekt Met Dank Aan Wim Tilkin (
    Digitale video titelpagina ontbreekt Met dank aan Wim Tilkin (www.creativeskills.be/user/wimpos) Meer informatie en downloadbestanden bij dit boek vindt u op www.computerkit.be en www.myhacks.be Copyright © 2009 Easy Computing 1e druk 2009 Uitgever Easy Computing Publishing N.V. Horzelstraat 100 1180 Brussel Easy Computing B.V. Jansweg 40 2011 KN Haarlem E-mail [email protected] Web www.easycomputing.com Auteur Kris Merckx Eindredactie Joost Devriesere | zin redactie&copy Vormgeving Phaedra creative communications Cover Sari Vandermeeren ISBN 978-90-456-4777-7 NUR 985 Wettelijk Depot D/2009/6786/53 Alle rechten voorbehouden. Zonder voorafgaande schriftelijke toestemming van Easy Computing mag niets van deze uitgave worden verveelvoudigd, be- werkt en/of openbaar gemaakt door middel van druk, fotokopie, microfilm, magnetische media of op welke andere wijze ook. Belangrijke opmerking Wanneer in dit boek methodes en programma’s worden vermeld, gebeurt dit zonder inachtneming van patenten, aangezien ze voor amateur- en studiedoeleinden dienen. Alle informatie in dit boek werd door de auteur met de grootste zorgvuldigheid verzameld respectievelijk samengesteld. Toch zijn fouten niet helemaal uit te sluiten. Easy Computing neemt daarom noch garantie, noch juridische verantwoordelijkheid of enige andere vorm van aansprakelijkheid op zich voor de gevolgen van onjuiste of onvolledige informatie. Wanneer u eventuele fouten tegenkomt, zijn de auteur en de uitgever dankbaar wanneer u deze aan hen doorgeeft. Wij wijzen er verder op dat de in
    [Show full text]
  • Introduction to Computational Techniques
    Chapter 2 Introduction to Computational Techniques Computational techniques are fast, easier, reliable and efficient way or method for solving mathematical, scientific, engineering, geometrical, geographical and statis- tical problems via the aid of computers. Hence, the processes of resolving problems in computational technique are most time step-wise. The step-wise procedure may entail the use of iterative, looping, stereotyped or modified processes which are incomparably less stressful than solving problems-manually. Sometimes, compu- tational techniques may also focus on resolving computation challenges or issues through the use of algorithm, codes or command-line. Computational technique may contain several parameters or variables that characterize the system or model being studied. The inter-dependency of the variables is tested with the system in form of simulation or animation to observe how the changes in one or more parameters affect the outcomes. The results of the simulations, animation or arrays of numbers are used to make predictions about what will happen in the real system that is being studied in response to changing conditions. Due to the adoption of computers into everyday task, computational techniques are redefined in various disciplines to accommodate specific challenges and how they can be resolved. Fortunately, computational technique encourages multi-tasking and interdisciplinary research. Since computational technique is used to study a wide range of complex systems, its importance in environmental disciplines is to aid the interpretation of field measurements with the main focus of protecting life, prop- erty, and crops. Also, power-generating companies that rely on solar, wind or hydro sources make use of computational techniques to optimize energy production when extreme climate shifts are expected.
    [Show full text]
  • Free Dvd Editor for Mac
    Free dvd editor for mac Free DVD Ripper, the first-rank free DVD Ripping App, rips/converts homemade DVD to any popular video format like MP4, MOV, MKV, AVI. How to burn movies to DVD? Use this best free DVD maker! The main MP4, WMV, AVI, MKV, and MOV to DVD burning is highly supported. So you need to look for other free video editing software for Mac as alternative Users can also write it on a DVD using its simple menu. Ever try editing content off a dvd? Tutorial: Edit DVD Files On Mac . I've been trying to find a free. Since iMovie is no longer free, decent Mac video editors are hard to come by. but there's no proper H, MP4, or even DVD export options. DVD ripper guide for Mac OS X. Included guide "How to edit (trim, crop, join) DVD What you need is Aimersoft DVD Ripper for Mac; you can free download it. Looking for the best free & cheap Mac video editing software? or outputting to DVD or Blu-ray discs (something which cannot be done in. This is a tutorial on how to import DVD to iMovie, or edit DVD in iMovie, with this free DVD to iMovie converter for Mac (macOS Sierra included) you can easily. All I have is a DVD the production guys made me that has multiple stories I've It's free and it's available on Windows XP and Mac OS X. Depending on the. You may purchased a vast collection of DVD disks, and want to copy DVD movie to iMoive, a pre-install application on Mac which allows you to edit the films.
    [Show full text]
  • Veritas Information Map User Guide
    Veritas Information Map User Guide November 2017 Veritas Information Map User Guide Last updated: 2017-11-21 Legal Notice Copyright © 2017 Veritas Technologies LLC. All rights reserved. Veritas and the Veritas Logo are trademarks or registered trademarks of Veritas Technologies LLC or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. This product may contain third party software for which Veritas is required to provide attribution to the third party (“Third Party Programs”). Some of the Third Party Programs are available under open source or free software licenses. The License Agreement accompanying the Software does not alter any rights or obligations you may have under those open source or free software licenses. Refer to the third party legal notices document accompanying this Veritas product or available at: https://www.veritas.com/about/legal/license-agreements The product described in this document is distributed under licenses restricting its use, copying, distribution, and decompilation/reverse engineering. No part of this document may be reproduced in any form by any means without prior written authorization of Veritas Technologies LLC and its licensors, if any. THE DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID. VERITAS TECHNOLOGIES LLC SHALL NOT BE LIABLE FOR INCIDENTAL OR CONSEQUENTIAL DAMAGES IN CONNECTION WITH THE FURNISHING, PERFORMANCE, OR USE OF THIS DOCUMENTATION. THE INFORMATION CONTAINED IN THIS DOCUMENTATION IS SUBJECT TO CHANGE WITHOUT NOTICE.
    [Show full text]
  • Introduction to Environmental Data Analysis and Modeling Lecture Notes in Networks and Systems
    Lecture Notes in Networks and Systems 58 Moses Eterigho Emetere Esther Titilayo Akinlabi Introduction to Environmental Data Analysis and Modeling Lecture Notes in Networks and Systems Volume 58 Series Editor Janusz Kacprzyk, Systems Research Institute, Polish Academy of Sciences, Warsaw, Poland Advisory Editors Fernando Gomide, Department of Computer Engineering and Automation—DCA, School of Electrical and Computer Engineering—FEEC, University of Campinas— UNICAMP, São Paulo, Brazil Okyay Kaynak, Department of Electrical and Electronic Engineering, Bogazici University, Istanbul, Turkey Derong Liu, Department of Electrical and Computer Engineering, University of Illinois at Chicago, Chicago, USA; Institute of Automation, Chinese Academy of Sciences, Beijing, China Witold Pedrycz, Department of Electrical and Computer Engineering, University of Alberta, Alberta, Canada; Systems Research Institute, Polish Academy of Sciences, Warsaw, Poland Marios M. Polycarpou, Department of Electrical and Computer Engineering, KIOS Research Center for Intelligent Systems and Networks, University of Cyprus, Nicosia, Cyprus Imre J. Rudas, Óbuda University, Budapest, Hungary Jun Wang, Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong The series “Lecture Notes in Networks and Systems” publishes the latest developments in Networks and Systems—quickly, informally and with high quality. Original research reported in proceedings and post-proceedings represents the core of LNNS. Volumes published in LNNS embrace all aspects and subfields of, as well as new challenges in, Networks and Systems. The series contains proceedings and edited volumes in systems and networks, spanning the areas of Cyber-Physical Systems, Autonomous Systems, Sensor Networks, Control Systems, Energy Systems, Automotive Systems, Biological Systems, Vehicular Networking and Connected Vehicles, Aerospace Systems, Automation, Manufacturing, Smart Grids, Nonlinear Systems, Power Systems, Robotics, Social Systems, Economic Systems and other.
    [Show full text]