Qoe-Centric Control and Management of Multimedia Services in Software Defined and Virtualized Networks

Total Page:16

File Type:pdf, Size:1020Kb

Qoe-Centric Control and Management of Multimedia Services in Software Defined and Virtualized Networks QoE-Centric Control and Management of Multimedia Services in Software Defined and Virtualized Networks by ALCARDO ALEX BARAKABITZE A thesis submitted to the University of Plymouth in partial fulfilment for the degree of DOCTOR OF PHILOSOPHY School of Engineering, Computing and Mathematics March 2020 Copyright Statement This copy of the thesis has been supplied on condition that anyone who consults it is understood to recognise that its copyright rests with its author and that no quotation from the thesis and no information derived from it may be published without the author’s prior consent. Abstract Multimedia services consumption has increased tremendously since the deploy- ment of 4G/LTE networks. Mobile video services (e.g., YouTube and Mobile TV) on smart devices are expected to continue to grow with the emergence and evolution of future networks such as 5G. The end user’s demand for services with better quality from service providers has triggered a trend towards Quality of Experience (QoE) - centric network management through efficient utilization of network resources. However, existing network technologies are either unable to adapt to diverse changing network conditions, or limited in available resources. This has posed challenges to service providers for provisioning of QoE-centric multimedia services. New networking solutions such as Software Defined Networking (SDN) and Network Function Virtualization (NFV) can provide better solutions in terms of QoE control and management of multimedia services in emerging and future networks. The features of SDN, such as adaptability, programmability and cost effectiveness make it suitable for bandwidth intensive multimedia applications such as live video streaming, 3D/HD video and video gaming. However, the delivery of multimedia services over SDN/NFV networks to achieve optimized QoE, and the overall QoE-centric network resource management remain an open question especially in the advent development of future softwarized networks. The work in this thesis intends to investigate, design and develop novel ap- proaches for QoE-centric control and management of multimedia services (with a focus on video streaming services) over software defined and virtualized networks. First, a video quality management scheme based on the traffic intensity under Dynamic Adaptive Video Streaming over HTTP (DASH) using SDN is developed. The proposed scheme can mitigate virtual port queue congestion which may cause buffering or stalling events during video streaming, thus, reducing the video quality. A QoE-driven resource allocation mechanism is designed and developed for improving the end user’s QoE for video streaming services. The aim of this approach is to find the best combination of network node functions that can provide an optimized QoE level to end-users through network node cooperation. Furthermore, a novel QoE-centric management scheme is proposed and developed, which utilizes Multipath TCP (MPTCP) and Segment Routing (SR) to enhance QoE for video streaming services over SDN/NFV-based networks. The goal of this strategy is to enable service providers to route network traffic through multiple disjointed bandwidth-satisfying paths and meet specific service QoE guarantees to the end-users. Extensive experiments demonstrated that the proposed schemes in this work improve the video quality significantly compared with the state-of- the-art approaches. The thesis further proposes the path protections and link- failure free MPTCP/SR-based architecture that increases Survivability , resilience, i availability and robustness of future networks. The proposed path protection and dynamic link recovery scheme achieves a minimum time to recover from a failed link and avoids link congestion in softwarized networks. ii Contents Abstract i Table of Contents ii List of Figures ix List of Tables xi Acknowledgements xii Author’s declaration xv 1 Introduction 1 1.1 Research Challenges and Motivations . .2 1.2 Research Aims and Objectives . .4 1.3 Summary of Thesis Contributions . .5 1.3.1 QoE-based Multimedia Flow Routing Mechanisms using SDN/NFV . .6 1.3.2 A QoE-Driven SDN based Resource Allocation Algorithm in Future Networks . .6 1.3.3 A Novel QoE-Centric Multipath Routing Algorithm for Video Streaming using SDN . .7 1.3.4 QoE Control and Management of Video Streaming Services in Softwarized Networks . .7 1.3.5 Multipath Protections and Dynamic Link Recovery in Soft- warized 5G Networks using Segment Routing . .8 1.4 Overview of Publications and Author Contributions . .8 1.4.1 Journal Papers . .9 1.5 Thesis Outline . 10 2 Literature Review 13 2.1 Introduction . 13 2.2 QoE Management for Multimedia Streaming Services . 14 iii 2.2.1 Quality of Exeprience (QoE): Definition . 14 2.2.2 QoE Monitoring and Measurement . 14 2.2.3 QoE Optimization and Control of Multimedia Services . 15 2.3 Multimedia Streaming Services over the Internet . 16 2.3.1 HTTP Adaptive Streaming (HAS) Solutions . 16 2.3.2 Server and Network assisted DASH (SAND) . 19 2.3.3 Issues and Challenges of HTTP Adaptive Video Streaming . 21 2.4 Network Softwarization and Virtualization: The Promise of SDN and NFV in Future Networks . 22 2.4.1 Software Defined Networking (SDN) . 22 2.4.2 OpenFlow Standard . 25 2.4.3 Network Function Virtualization (NFV) . 27 2.4.4 Network Hypervisors, Containers and Virtual Machines . 29 2.5 QoE Management for HTTP Adaptive Video Streaming using SDN/NFV: State-of-the-Art . 30 2.5.1 Server and Network-Assisted Optimization Approaches us- ing SDN . 31 2.5.2 QoE-Fairness and Personalized QoE-centric control in SDN 33 2.5.3 QoE-Centric Routing Mechanisms using SDN/NFV . 36 2.6 Summary . 38 3 Video Quality Management based on Queueing Mechanisms and QoE/QoS Policy in SDN 40 3.1 Introduction . 40 3.2 Related Work . 43 3.3 The Proposed Video Quality Management Algorithm over SDN . 44 3.3.1 Video Clips/Sequences . 46 3.3.2 Experimental Testbed based on SDN . 48 3.4 Performance Analysis and Evaluation of the Video Quality Man- agement Scheme. 49 3.4.1 Implementation of DASH without the Proposed Quality Management Scheme . 50 3.4.2 Implementation of DASH with the Proposed Quality Man- agement Scheme . 53 3.5 Summary . 55 4 QoE-Driven SDN based Resource Allocation Mechanism using Network Softwarization 56 4.1 Related Work . 57 4.2 System Architecture Overview and Task Assignment Model . 58 iv 4.3 Network Model and the Overall Utility Function . 60 4.4 QoE-driven Resource Allocation Mechanisms in SDN . 63 4.4.1 The proposed QoE-driven Resource Allocation and Task Assignment Algorithm . 64 4.4.2 Video Clips/Sequence used for Implementations . 64 4.4.3 Experimental Testbed using SDN . 65 4.5 Performance Evaluation and Results . 67 4.5.1 Bandwidth and End-to-End Delay Variations . 68 4.5.2 Effects of Packet Loss Variations on Video Quality . 69 4.5.3 Transmitted Video QoE with the Normalized QoS Values . 70 4.6 Summary . 71 5 QoE-Centric Multipath Routing for Multimedia Services using SDN/NFV 72 5.1 Related Work . 73 5.2 Principles and Basic Operation of MPTCP . 74 5.2.1 MPTCP Connection establishment between End-points . 76 5.2.2 Path Management and Scheduling . 77 5.2.3 Congestion Control and Avoidance in MPTCP . 79 5.3 A MPTCP over SDN-based Networks: Concepts and Descriptions . 80 5.4 Traffic Engineering with Segment Routing in SDN . 82 5.4.1 Mapping of Subflows Paths to SR Paths . 84 5.5 QoE-aware MPTCP SDN-based SR Adaptation Framework . 84 5.5.1 SDN Controller . 84 5.5.2 MPTCP-Flow Manager . 85 5.5.3 Segment Routing Module . 86 5.5.4 QoE-Management Module . 87 5.6 QoE-Centric Multipath Routing Algorithm (QoMRA) over SDN . 87 5.6.1 Video Clips/Sequence used for Experiments . 89 5.6.2 Experiemental Testbed based on SDN . 90 5.7 Experimental Evaluation and Results . 91 5.7.1 System Throughput . 91 5.7.2 Link Utilization . 92 5.7.3 The Impact of Segment Length on Throughput . 92 5.7.4 Video Quality Switches and Startup Delays in Video Streaming 93 5.8 Summary . 96 6 QoE Management of Video Streaming Services using MPTCP and SR in Softwarized Networks 97 v 6.1 Related Work . 98 6.2 QoE- Softwarization in Future Networks using SDN and NFV . 100 6.2.1 Application Scenario and Use Cases . 102 6.3 MPTCP Implementations over Software Defined and Virtualized Networks . 103 6.4 Path Protection and Traffic Recovery Mechanisms with Segment Routing in Softwarized Networks . 104 6.5 Service Chaining for OTT Service Providers using SR in Softwarized Networks . 106 6.6 The QoE-Control and Management Architecture of Video Streaming Services in Softwarized Networks . 108 6.6.1 Data Plane . 109 6.6.2 QoE Control and Management Plane (QoCoMa) . 109 6.6.3 Network Information Collector (NIC) . 109 6.6.4 MPTCP Module . 109 6.6.5 TE-Segment Routing Module . 110 6.6.6 QoE-Management Module for Softwarized Networks . 110 6.6.7 NFV Management and Orchestration (NFV MANO) . 110 6.6.8 Configuration Module . 111 6.6.9 Database Storage Module . 111 6.6.10 The SDN Controller . 112 6.7 System Model and QoE-based Multipath Source Routing Algorithm in Softwarized Networks . 112 6.7.1 QoE-Driven Multipath Routing and Quality Optimization in Softwarized Networks . 115 6.7.2 MPTCP Congestion Window Adaptation in Softwarized Networks . 118 6.7.3 Experimental Testbed & Setup . 121 6.7.4 Video Clips/Sequences Used for Experiments . 122 6.8 Experimental Results and Discussion . 123 6.8.1 System Throughput . 123 6.8.2 Video Reception Quality Measurements . 125 6.8.3 Measurements of Failure Recovery and Localization Time . 125 6.9 Summary . 132 7 Discussions, Future Work and Conclusions 135 7.1 Introduction .
Recommended publications
  • Mobile Video Optimization: Market Evolution and Operator Implications
    Mobile Video Optimization: Market Evolution and Operator Implications The popularity of mobile video is evident all around us – in people watching YouTube, Netflix and other content on their smartphones and tablets and communicating via real-time, two-way video. This phenomenon is booming as a result of broad support across the mobile ecosystem, including among devices, networks and services. It shows no signs of slowing, and it has crucial implications for how mobile operators direct their infrastructure investments and strategies. In this paper, we examine some of the technologies and approaches important to operators as they address the challenges attending mobile video growth – as well as some key considerations to help navigate expected future trends. The State of Video in the Mobile Network The growth of mobile video has multiple drivers in a variety of areas. An understanding of these drivers can help illuminate both its history and current trajectory. Ecosystem Support Drivers The rise of mobile video adoption has been fueled by many sources – perhaps none more dramatically than the spread of smartphones, whose screens unleashed a new wave of video consumption and whose cameras supplied torrential volumes of video content. Mobile video use continues to expand with the spread of tablets, whose larger screen size improves the video-watching experience and encourages new forms of consumption, including long-form content such as movies. Research has indicated that tablet users are nearly three times more likely to watch video on their
    [Show full text]
  • Katara Uta 2502M 13290.Pdf (2.594Mb)
    EVALUATION OF ADAPTIVE VIDEO OPTIMIZATION FOR STALL MINIMIZATION IN WIRELESS NETWORKS by KARISHMA KATARA Presented to the Faculty of the Graduate School of The University of Texas at Arlington in Partial Fulfillment of the Requirements for the Degree of MASTER OF SCIENCE IN ELECTRICAL ENGINEERING THE UNIVERSITY OF TEXAS AT ARLINGTON August 2015 Copyright © by Karishma Katara 2015 All Rights Reserved ii To my family, friends and colleagues iii Acknowledgements I would like to express my sincere gratitude to Professor Dr.Qilian Liang, for supervising me and continuous support for the thesis and helping me in every step of my work. Thank you for giving me all these opportunities and a chance to work on something that I truly enjoy. I can truly say that working in your lab has been an once-in-a-lifetime experience. I would like to thank my thesis committee Dr. Alan Davis and Dr. William Dillon for supporting me in this work. I would also like to thank Lisa Parkin Director QA and Nitin Bhandari Senior Wireless Quality Engineer for guiding me during my Internship at Jasper Wireless U.S which helped in collecting real-world data used for this piece of work. Scott Staples Director- Policy Architect, thank you for offering advice on my project, laying the foundation as well as helping in my presentation. Mark Montz Senior Wireless Network Architect, thank you for everything from basic concepts, mathematical analysis and advice on how to present. I would also like to thank Venugopal Velcheru for his valuable suggestions and guiding me during my course work at the University of Texas at Arlington.
    [Show full text]
  • Measuring and Improving the Quality of Experience of Adaptive Rate Video
    Measuring and Improving the Quality of Experience of Adaptive Rate Video Hyunwoo Nam Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate School of Arts and Sciences COLUMBIA UNIVERSITY 2016 c 2016 Hyunwoo Nam All Rights Reserved ABSTRACT Measuring and Improving the Quality of Experience of Adaptive Rate Video Hyunwoo Nam Today’s popular over-the-top (OTT) video streaming services such as YouTube, Netflix and Hulu deliver video contents to viewers using adaptive bitrate (ABR) technologies. In ABR streaming, a video player running on a viewer’s device adaptively changes bitrates to match given network conditions. However, providing reliable streaming is challenging. First, an ABR player may select an inappropriate bitrate during playback due to the lack of direct knowledge of access networks, frequent user mobility and rapidly changing channel conditions. Second, OTT content is delivered to viewers without any cooperation with Internet service providers (ISPs). Last, there are no appropriate tools that evaluate the performance of ABR streaming along with video quality of experience (QoE). This thesis describes how to improve the video QoE of OTT video streaming services using ABR technologies. Our analysis starts from understanding ABR heuristics. How does ABR streaming work? What factors does an ABR player consider when switching bitrates during a download? Then, we propose our solutions to improve existing ABR streaming from the perspective of network operators who deliver video content through their networks and video service providers who build ABR players running on viewers’ devices. From the network operators’ point of view, we propose to find a better video content server based on round trip times (RTTs) between an edge node of a wireless network and available video content servers when a viewer requests a video.
    [Show full text]
  • The Genius Issue Insights for Summer Contemplation from Our Genius Contributors
    ottexec.com/magazine Summer 2019 The Genius Issue Insights for Summer Contemplation from Our Genius Contributors Is it Time for One-Stop OTT Platform Shopping? Weighing the Benefits of DIY vs Integrated Solutions Localizing Content for a Global Audience Can your CMS help? Can OTT Tech Help Traditional OTA Distribution? Using New Technology to Improve Traditional Processes Does OTT Need the Blockchain? Executive Q&A Application Considerations Tim Armstrong, General Manager, AdEase Switch Media David Longaker, SVP & General Manager, Americas Synamedia Joe Fregoso, Director of Business Development, Americas MediaGeniX LAUNCH YOUR OTT PLATFORM INSTANTLY LIVE VIDEO AUDIO [email protected] PAY AS YOU GO END-TO-END SOLUTION MULTI-LINGUAL www.dcafe.io Inside this Issue Case Studies 5 The Country Network: Leveraging OTT Tech For Improved OTA Distribution by Scott McCloud 35 OTT and Generation X by Nichole Janowsky 46 Engaging OTT’s Global Village: An Asian Initiative by Chris Lo Executive Q&A 10 MediaGeniX’s Joe Fregoso, Director of Business Development for the Americas 28 Switch Media’s Tim Armstrong, General Manager, AdEase 36 Synamedia’s David Longaker, SVP and General Manager, Americas Trends & Analysis 8 Yes, Blockchain Technology is Coming to OTT by Barbara Bellafiore 12 Programmatic Advertising is The Future of TV by Benjamin Antier 16 AVOD: An Excellent Opportunity for Local TV Broadcasters to Regain Viewing Time Lost to SVOD by Colin Dixon 18 Reducing Bandwidth Cost with OTT Video Optimization by Raymond Westwater 32 How Can Broadcasters
    [Show full text]
  • M B Le Vi E R
    Mble Vie Rpr Video a Key Driver of Mobile Market Value Research Methodology: Huawei and its related partners conduct regular observations on market maturity and drivers for mobile video contents. These observations aim to support the strategy making and external market communication of the mobile video industry. All data in this report comes from historical records and future projections, and is verified against internal data from Huawei. User data is collected anonymously before transferred to Huawei engineers. Main sources of data include Strategy Analytics (on macroeconomics, traffic trend, and business model), Huawei mLAB (on consumer behavior survey, service and terminal behavior, user experience research, and actual network capability), as well as other public third-party materials. Huawei MBB engineers are qualified with long-term research experiences. They strive to present the current situation of the drivers for mobile videos both comprehensively and impartially. They try to identify the development trend, and point out latent problems facing the industry. Note that data involved in this analytical report is bound to factors including time period, sample quantity, and level of research. All information provided is for reference only. A Huawei Mobile Video Partner with Insight Report Series June 2016 Executive Summary 02 Mobile Video Dominates Data Traffic 04 2.1 Mature Markets Drive Mobile Video to Dominate Worldwide 05 Mobile Data Traffic 2.2 Mobile Video Evolution: Social, Live Streaming & Immersive 09 Mobile Video as a Basic
    [Show full text]
  • Mobile Video Optimization and Impact of Encryption
    TABLE OF CONTENTS Executive Summary ...................................................................................................................................... 4 Introduction ................................................................................................................................................... 4 Mobile Video Optimization Techniques ......................................................................................................... 6 Source Optimization ...................................................................................................................................... 7 Adaptive Bit Rate Techniques and Challenges............................................................................................. 7 Video Compression Techniques ................................................................................................................... 8 Network Optimization .................................................................................................................................... 9 TCP Optimization .......................................................................................................................................... 9 Mobile Network-Aware Congestion Control Algorithms .............................................................................. 10 Data Caching .............................................................................................................................................. 10 Radio-Friendly Video Pacing......................................................................................................................
    [Show full text]
  • 4G Americas Whit Paper
    TABLE OF CONTENTS Executive Summary ...................................................................................................................................... 4 1. Introduction .............................................................................................................................................. 4 1.1 Overview of whitepaper ....................................................................................................................... 4 1.2 Market trends in video delivery/market analysis ................................................................................. 5 1.2.1 Usecases for video content delivery ............................................................................................. 6 1.2.2 Factors contributing towards growing demand for mobile video .................................................. 7 1.2.3 Trends for streamed video consumption ...................................................................................... 8 1.2.4 Ecosystem support for the growth in mobile video ..................................................................... 11 2. Types of video ........................................................................................................................................ 12 2.1 Elements of video content and summary of video delivery technologies .......................................... 12 2.2 Short form content, Long form content .............................................................................................. 13 2.3 Operator
    [Show full text]
  • Multipurpose Video Platform About Us
    Bradbury Lab Multipurpose Video Platform About us Bradbury Lab is a pioneering technology Russian leader in creating and implementation interactive TV solutions and services of telecom providers level. The company is called in honor of the great writer Ray Bradbury, a classic of fantastic literature of the XX century and our contemporary whose books inspire the team to develop absolutely new, innovative digital products for the better world. Bradbury Lab was founded in 2000, when graduates of the leading universities of Russia started their collaboration in optimization of the x264 codec, which was using for video stream coding. Future employees of the company made decision to improve the existing algorithm and level out shortcomings. There were various solutions in the market at that time, but in respect of investments they weren’t attractive. Since that time in 2009 the company began its journey as a software development provider and system integrator. Initially, having its own transcoder, the company’s experts focused on embedding their components into third-party solutions. But over time, own components have been designed to provide customers with end-to- end solution that seamlessly integrated into customer infrastructure. In addition, federal level’s providers have strict requirements to SLA for support and development of the solution, what excludes the usage of external software providers due to difficulty of control the time and quality KPI-s for them. Unlike competitors working in the Russian interactive TV market, Bradbury Lab pays special attention to the development of user interfaces and has been doing this from the very beginning of the company’s existence, along with the development of server solutions.
    [Show full text]