Qoe of Video Streaming Over LTE Network
Total Page：16
File Type：pdf, Size：1020Kb
Master Thesis Electrical Engineering October 2013 QoE of Video Streaming over LTE Network Pradeep Uppu, Sushanth Kadimpati School of Computing Blekinge Institute of Technology 37179 Karlskrona Sweden This thesis is submitted to the School of Computing at Blekinge Institute of Technology in partial fulfilment of the requirements for the degree of Master of Science in Electrical Engineering. The thesis is equivalent to 20 weeks of full time studies. This Master Thesis is typeset using LATEX Contact Information Author(s): Pradeep Uppu Address: Karlskrona, Sweden E-mail: [email protected] Sushanth Kadimpati Address: Karlskrona, Sweden E-mail: [email protected] University advisor(s): Dr. Adrian Popescu, Prof. COM/BTH School of Computing Internet: www.bth.se/com Blekinge Institute of Technology Phone: +46 455 385000 371 79 KARLSKRONA SWEDEN SWEDEN Abstract In recent years, the mobile Internet has increased dramatically with the development of 3G and 4G technologies. Especially the usage of mobile broadband internet on the devices like cellular mobiles, Tablets and Laptops has skyrocketed. Among the multimedia applications video streaming is the most popular mobile application. But, making these services available to users in a cost effective way without compromising quality is a big challenge. The development of Long Term Evolution (LTE) technology in the mobile world made this task achievable. The features of LTE technology provide effective services in multimedia applications with high data rates and low latency. In this paper, we study and analyze the Quality of Experience (QoE) at the end user for Video on Demand (VoD) over the LTE network. To achieve this, we streamed High Definition (HD) videos based on H.264/AVC and these videos are delivered from source to destination using Transport Control Protocol (TCP) and User Datagram Protocol (UDP). Specifically, our study is about QoE evaluation in terms of delay variation, packet loss metrics and provides performance evaluation to characterize the impact of transport layer protocol in video streaming over radio networks like LTE. In order to know the performance of video streaming over LTE network, we also evaluate the LTE performance in terms of one-way delay, packet loss and inter packet delay for the generated UDP and TCP packets. Keywords: QoE, Video Streaming, H.264/AVC, LTE, One-way Delay, Packet loss. i Acknowledgements It gives us great immense joy in acknowledging Prof Adrian Popescu for his diligent support and extending the opportunity to pursue our master thesis under his immaculate supervision. We would like to thank Dr. Patrik Arlos for providing the experimental test bed and valuable suggestions in the evolution of this thesis. We would also like to thank Wowza Media Systems for providing the software. A word of thanks to Mr. Tahir Minhas Nawaz for his valuable suggestions and tips. We are indebted to our friends and family for their constant support and prayers that helped us complete the thesis. This thesis is dedicated to our parents who stood beside us through thick and thin in making this thesis substantial. Pradeep Uppu Sushanth Kadimpati ii Contents Abstracti Acknowledgements ii Contents ii List of Figures vi List of Tables viii Acronyms ix 1 Introduction2 1.1 Motivation............................3 1.2 Related Works..........................4 1.3 Contribution...........................6 1.4 Aims and Objectives.......................6 1.5 Research Questions........................7 1.6 Thesis Outline..........................7 2 Technical Background9 2.1 Quality of Experience......................9 2.2 Video Streaming.........................9 2.3 Video Compression........................ 10 2.4 Video Format........................... 11 2.4.1 Video Codec....................... 11 2.4.2 Video Container..................... 11 2.4.3 H.264/AVC Codec.................... 11 2.5 Types of Video Streaming.................... 12 2.6 Supported Protocols for Video Streaming........... 12 2.7 Assessment of Videos....................... 12 iii 2.8 Overview of 3GPP Releases................... 13 2.9 Technical Overview of LTE................... 15 2.10 Architecture of LTE....................... 16 2.10.1 Core Network....................... 16 2.10.2 Radio Access Network.................. 17 3 Design and Implementation 20 3.1 LTE Network Performance Evaluation with Generated Traffic 20 3.1.1 Experimental Procedure................. 21 3.1.2 Gateway.......................... 22 3.1.3 Sender........................... 22 3.1.4 Receiver.......................... 22 3.1.5 Measurement Point (MP)................ 22 3.1.6 Consumer......................... 22 3.2 Measurements........................... 23 3.2.1 One Way Delay (OWD)................. 23 3.2.2 Packet Loss (PL)..................... 23 3.2.3 Inter Packet Delay (IPD)................ 23 3.3 Video Quality Assessment using Subjective Analysis.............................. 24 3.3.1 Experimental Setup and Procedure........... 24 3.3.2 WOWZA Media Server................. 25 3.3.3 Test Video Parameters.................. 25 3.3.4 NetEm........................... 26 3.3.5 Delay........................... 27 3.3.6 Packet Loss........................ 27 3.3.7 Assessment of Videos.................. 27 4 Results and Analysis 30 4.1 Analysis of LTE Network Performance with Generated Traffic 30 4.1.1 One Way Delay for UDP packets in Uplink...... 30 4.1.1.1 Minimum One Way Delay........... 30 4.1.1.2 Maximum One Way Delay.......... 31 4.1.1.3 Mean One Way Delay............. 31 4.1.2 Inter Packet Delay for UDP packets in Uplink..... 32 4.1.2.1 Minimum Inter Packet Delay......... 32 4.1.2.2 Maximum Inter Packet Delay......... 33 4.1.2.3 Mean Inter Packet Delay........... 34 4.1.3 Packet Loss for UDP in Uplink............. 34 4.1.4 One Way Delay for TCP packets in Uplink...... 35 4.1.4.1 Minimum One Way Delay........... 35 4.1.4.2 Maximum One Way Delay.......... 35 4.1.4.3 Mean One Way Delay............. 36 4.1.5 Inter Packet Delay for TCP packets in Uplink..... 37 iv 4.1.5.1 Minimum Inter Packet Delay......... 37 4.1.5.2 Maximum Inter Packet Delay......... 38 4.1.5.3 Mean Inter Packet Delay........... 38 4.1.6 Packet Loss for TCP in Uplink............. 39 4.2 Gateway Evaluation....................... 39 4.3 One Way Delay Comparison in TCP and UDP........ 40 4.4 One Way Delay for Video Streaming Over LTE........ 40 4.5 QoE Analysis of Video Streaming................ 41 4.5.1 Packet Delay Variation................. 42 4.5.1.1 Packet Delay Variation for TCP....... 42 4.5.1.2 Packet Delay Variation for UDP....... 44 4.5.1.3 Standard Deviation for Delay Variation... 45 4.5.1.4 Confidence Interval for Delay Variation... 45 4.5.2 Packet Loss........................ 46 4.5.2.1 Packet Loss for TCP............. 46 4.5.2.2 Packet Loss for UDP............. 47 4.5.2.3 Standard Deviation for Packet Loss..... 48 4.5.2.4 Confidence Interval for Packet Loss..... 49 5 Conclusion and Future Work 51 5.1 Conclusion............................ 51 5.2 Future Work........................... 52 Bibliography 53 v List of Figures 2.1 Quality of Experience Measurement.............. 10 2.2 Evolution of LTE........................ 15 2.3 LTE Radio Access Network................... 18 3.1 Detailed Experimental Set up.................. 21 3.2 Experimental Set up for Video Streaming........... 25 3.3 Screen Shot of QoE Evaluation Tool.............. 27 4.1 Minimum One way Delay for Generated UDP Packets for Uplink............................... 30 4.2 Maximum One way Delay for Generated UDP Packets for Uplink............................... 31 4.3 Mean One way Delay for Generated UDP Packets for Uplink 32 4.4 Minimum Inter Packet Delay for Generated UDP Packets for Uplink............................... 33 4.5 Maximum Inter Packet Delay for Generated UDP Packets for Uplink............................... 33 4.6 Mean Inter Packet Delay for Generated UDP Packets for Uplink 34 4.7 Packet Loss for Generated UDP Packets for Uplink...... 34 4.8 Minimum One way Delay for Generated TCP Packets for Uplink 35 4.9 Maximum One way Delay for Generated TCP Packets for Uplink............................... 36 4.10 Mean One way Delay for Generated TCP Packets for Uplink 36 4.11 Minimum Inter Packet Delay for Generated TCP Packets for Uplink............................... 37 4.12 Maximum Inter Packet Delay for Generated TCP Packets for Uplink............................... 38 4.13 Mean Inter Packet Delay for Generated TCP Packets for Uplink 38 4.14 Packet Loss for Generated TCP Packets for Uplink...... 39 4.15 Minimum One Way Delay for Generated TCP and UDP pack- ets for Uplink........................... 40 4.16 Minimum One Way Delay for Generated TCP and UDP packet size of 1500 bytes for Uplink................... 41 4.17 MOS for TCP videos subjected to Delay Variation...... 43 vi 4.18 MOS for UDP videos subjected to Delay Variation...... 44 4.19 Standard Deviation for Delay Variation............ 45 4.20 Confidence Interval for Delay Variation............ 46 4.21 MOS for TCP videos subjected to Packet loss......... 47 4.22 MOS for UDP videos subjected to Packet Loss........ 47 4.23 Standard Deviation for Packet Loss............... 48 4.24 Confidence Interval for Packet Loss............... 49 vii List of Tables 2.1 Five-level scale for rating overall quality of video....... 13 3.1 Test Video Parameters...................... 26 4.1 MOS for Delay Variation.................... 43 4.2 MOS for Packet Loss....................... 46 viii Acronyms 1 G 1st Generation 2 G 2nd Generation 3 G 3rd Generation