Evaluating Quality of Experience and Real- Time Performance of Industrial Internet of Things

Total Page:16

File Type:pdf, Size:1020Kb

Evaluating Quality of Experience and Real- Time Performance of Industrial Internet of Things Evaluating Quality of Experience and real- time performance of Industrial Internet of Things Roman Zhohov Computer Science and Engineering, master's level (120 credits) 2018 Luleå University of Technology Department of Computer Science, Electrical and Space Engineering Lappeenranta University of Technology School of Engineering Science Degree Program in Computer Science Roman Zhohov EVALUATING QUALITY OF EXPERIENCE AND REAL-TIME PERFORMANCE OF INDUSTRIAL INTERNET OF THINGS Examiners: Professor Eric Rondeau, University of Lorraine Professor Jari Porras, Lappeenranta University of Technology Professor Karl Andersson, Lulea University of Technology Supervisors: Professor Karl Andersson, Lulea University of Technology Per Johansson, InfoVista AB, Skelleftea, Sweden Dimitar Minovski, Lulea University of Technology ABSTRACT Lappeenranta University of Technology School of Engineering Science Degree Program in Computer Science Roman Zhohov Evaluating Quality of Experience and real-time performance of Industrial Internet of Things Master’s Thesis 46 pages, 16 figures, 3 tables Examiners: Professor Eric Rondeau, University of Lorraine Professor Jari Porras, Lappeenranta University of Technology Professor Karl Andersson, Lulea University of Technology Keywords: QoE, Industry 4.0, QoS, real-time communications, IIoT, CPS. The Industrial Internet of Things (IIoT) is one of the key technologies of Industry 4.0 that will be an integral part of future smart and sustainable production. The current constituted models for estimating Quality of Experience (QoE) are mainly targeting the multimedia systems. Present models for evaluating QoE, specifically leveraged by the expensive subjective tests, are not applicable for IIoT applications. This work triggers the discussion on defining the QoE domain for IIoT services and applications. Industry-specific KPIs are proposed to assure QoE by linking business and technology domains. Tele-remote mining machines are considered as a case study for developing the QoE model by taking into account key challenges in QoE domain. As a result, QoE layered model is proposed, which as an outcome predicts the QoE of IIoT services and applications in a form of pre-defined Industrial KPIs. Moreover, software tool and analytical model is proposed to be used as an evaluation method for certain traffic types in the developed model. ii ACKNOWLEDGEMENTS I would like to thank my thesis advisor prof. Karl Andersson at Lulea University of Technology for providing a fantastic opportunity to work in such good environment and made my second year of PERCCOM master program less stressful. I must express gratitude to my supervisor Per Johansson, this work would be impossible without him. Without doubt, it was his work that inspired me to do my research. I am glad that he could always find the time for our endless discussions. Special thanks to Niklas Ögren whose comments have shaped this work. His expertise in the fields of wireless communications and protocols always made me to look at the problem from the different angle. I thank Dimitar Minovski who combined roles of colleague, co-author, flat-mate and advisor. It was a wonderful time that we shared, and I appreciate his help and support. I would also like to acknowledge TEMS team (Ulf Marklund, Magnus Furstenborg, Anna Lindberg and others) that provided me with great tools and vital help to create prototypes and develop ideas. Thanks to all my colleagues from InfoVista, it was a pure pleasure to work with them. I also thank prof. Sergey Bunin who was my supervisor during bachelor studies. My research work started under his supervision and I cannot overestimate how much I have learnt during my work with him. Finally, I thank my mother Olena Zhohova. Her endless love, support and care helped me to achieve everything that I have now. iii TABLE OF CONTENTS 1 INTRODUCTION ............................................................................................. 4 1.1 BACKGROUND......................................................................................................... 4 1.2 INDUSTRIAL CASE STUDY ........................................................................................ 5 1.3 MOTIVATION .......................................................................................................... 7 1.4 RESEARCH QUESTIONS ............................................................................................ 7 2 LITERATURE REVIEW ................................................................................... 8 3 METHODOLOGY .......................................................................................... 10 4 DEFINING QUALITY OF EXPERIENCE IN INDUSTRIAL INTERNET OF THINGS ................................................................................................................ 13 5 EVALUATING QUALITY OF EXPERIENCE IN INDUSTRIAL INTERNET OF THINGS ................................................................................................................ 18 5.1 QOE LAYERED-MODEL PROPOSAL ......................................................................... 18 5.1.1 Physical Layer ................................................................................................. 19 5.1.2 Network Layer .................................................................................................. 19 5.1.3 Service Layer ................................................................................................... 20 5.2 SYSTEM’S ARCHITECTURE AND TYPES OF TRAFFIC ................................................ 21 5.3 REAL-TIME SENSOR STREAM................................................................................ 21 5.4 REAL-TIME PERFORMANCE EVALUATION AND PREDICTION ................................... 23 5.4.1 Background and network architecture ............................................................ 23 5.4.2 Time synchronization ....................................................................................... 25 5.4.3 Experimental setup .......................................................................................... 28 5.4.4 Latency prediction ........................................................................................... 30 6 SUSTAINABILITY ASPECTS ....................................................................... 35 7 FUTURE WORK ............................................................................................ 39 8 CONCLUSION ............................................................................................... 40 9 REFERENCES .............................................................................................. 41 1 LIST OF SYMBOLS AND ABBREVIATIONS ADB Android Debug Bridge BER Bit error rate BLER Block error rate CPS Cyber-Physical System D2D Device-to-device EPC Evolved Packet Core EPS Evolved Packet System ICT Information and communication technology IIoT Industrial IoT IoT Internet of Things KPI Key performance indicator LTE Long Term Evolution M2M Machine-to-machine MIoT Multimedia IoT ML Machine Learning MOS Mean opinion score NTP Network time protocol OEE Overall equipment efficiency PEVQ Perceptual Evaluation of Video Quality POLQA Perceptual Objective Listening Quality Analysis PTP Precision time protocol QoC Quality of Context QoD Quality of Data QoE Quality of Experience QoN Quality of Network QoS Quality of Service RAN Radio Access Network RFID Radio-frequency identification RSRP Reference signal received power RSRQ Reference signal received quality 2 RSSI Received signal strength indicator RTOOL Real-time Tool RTT Round-trip time SINR Signal to interference plus noise ratio SLA Service-level Agreement SNR Signal to noise ratio UX User eXperience 3 1 INTRODUCTION The fourth industrial revolution is predicted a-priori and manifested as Industry 4.0. Smart Factories, Industrial Internet of Things (IIoT) and Cyber-Physical Systems (CPS) are main enabling components of Industry 4.0 that have tremendous effect on industrial application scenarios and automation [1]. Digitalizing of industrial processes will deliver an important boost in productivity and trigger economic growth [2]. Industry 4.0 transformations have attracted significant attention from academia and industry, it is reflected in the vast number of global projects and initiatives that are addressing IIoT concept. For instance, Industrie 4.0 project was accepted in “Action Plan High-tech strategy 2020” by German Federal Government in July 2010 [3]. Another example is the Industrial Internet Consortium (IIC) which is enabling and accelerating adoption of the Industrial Internet as an essential step to increase competitiveness in key industry sectors. According to the predictions implementation of IIoT will have a tremendous effect on the global economy, PwC’s 2016 Global Industry 4.0 survey respondents expect to see US$421 billion in cost reductions and US$493 billion in increased annual revenues p.a [4]. 1.1 Background The core of IIoT and CPS is essentially the robust exchange of information. Originally, conventional telecom networks could not cope with the industry-specific requirements for reliable, predictable and efficient communication. Industrial networks were mainly based on diverse deterministic bus technologies (controller area network – CAN, PROFIBUS, INTERBUS, etc.) to satisfy strict requirements of hard real-time automation systems. Development of industrial communication systems and networks is shown in Fig. 1, as one may notice industrial communication system move
Recommended publications
  • Why Is Multimedia Quality of Experience Assessment a Challenging Problem?
    Received August 5, 2019, accepted August 18, 2019, date of publication August 21, 2019, date of current version September 5, 2019. Digital Object Identifier 10.1109/ACCESS.2019.2936470 Why Is Multimedia Quality of Experience Assessment a Challenging Problem? ZAHID AKHTAR 1, (Senior Member, IEEE), KAMRAN SIDDIQUE2, (Member, IEEE), AJITA RATTANI3, (Member, IEEE), SYAHEERAH LEBAI LUTFI4, AND TIAGO H. FALK 5, (Senior Member, IEEE) 1Department of Computer Science, University of Memphis, Memphis, TN 38152, USA 2Department of Information and Communication Technology, Xiamen University Malaysia, Sepang 43900, Malaysia 3Department of Electrical Engineering and Computer Science, Wichita State University, Wichita, KS 67260, USA 4School of Computer Science, Universiti Sains Malaysia, Penang 11800, Malaysia 5INRS-EMT, University of Quebec, Montreal, QC H5A 1K6, Canada Corresponding authors: Zahid Akhtar ([email protected]) and Kamran Siddique ([email protected]) This work was supported by the Office of Research and Innovation, Xiamen University Malaysia under the XMUM Research Program Cycle 3, under Grant XMUMRF/2019-C3/IECE/0006. ABSTRACT Quality of experience (QoE) assessment occupies a key role in various multimedia networks and applications. Recently, large efforts have been devoted to devise objective QoE metrics that correlate with perceived subjective measurements. Despite recent progress, limited success has been attained. In this paper, we provide some insights on why QoE assessment is so difficult by presenting few major issues as well as a general summary of quality/QoE formation and conception including human auditory and vision systems. Also, potential future research directions are described to discern the path forward. This is an academic and perspective article, which is hoped to complement existing studies and prompt interdisciplinary research.
    [Show full text]
  • Quality Parameters and Standards for Telecommunications and Broadcasting Networks (Study of Specifications and Recommendations)
    Quality parameters and standards for Telecommunications and Broadcasting networks (Study of Specifications and Recommendations) Executive summary This document is the study report for the ‘Quality parameters and standards for Telecommunication networks’ for the Bureau Telecommunications and Post St. Maarten. This study is to analyze and describe Quality of Service (QoS) and Quality of Experience (QoE) parameters that are relevant for the St. Maarten Telecommunication Industry. As part of the study existing standards and recommendation (such as ITU, GSMA etc.) have been inventoried. The parameters and standards will be consistent with International recommendations and specifications from institutions such as ITU, GSMA, 3GPP, ETSI, and also will be in line with international best practice of how to define such quality parameters. The set of parameters for inspection purposes have been described in a separate document (‘Inspection Guide’). Page 2 Cannegieter Street 15 – Unit 5.1 I Philipsburg I St. Maarten I Dutch Caribbean I +1(721) 542.4699 [email protected] I www.sxmregulator.sx Table of Contents 1 Introduction ................................................................................................................................................ 4 1.1 Background and current situation ....................................................................................................... 4 1.2 Purpose of the project ........................................................................................................................
    [Show full text]
  • An Overview of Quality of Experience Measurement Challenges for Video Applications in IP Networks?
    An Overview of Quality of Experience Measurement Challenges for Video Applications in IP Networks? R. Serral-Gracia`1, E. Cerqueira2;3, M. Curado3, M. Yannuzzi1, E. Monteiro3, X. Masip-Bruin1 frserral,yannuzzi,[email protected] [email protected] fmarilia, [email protected] 1 Advanced Network Architectures Lab, Technical University of Catalunya (UPC), Jordi Girona 1-3, 08028 Barcelona - Spain 2 Faculty of Computer Engineering, Federal University of Para, Rua Augusto Correa,ˆ 01, CEP 66075-110, Belem´ - Brazil 3 Department of Informatics Engineering, University of Coimbra, Polo II, Pinhal de Marrocos, 3030-290 Coimbra - Portugal Abstract. The increase in multimedia content on the Internet has created a re- newed interest in quality assessment. There is however a main difference from the traditional quality assessment approaches, as now, the focus relies on the user per- ceived quality, opposed to the network centered approach classically proposed. In this paper we overview the most relevant challenges to perform Quality of Experi- ence (QoE) assessment in IP networks and highlight the particular considerations necessary when compared to alternative mechanisms, already deployed, such as Quality of Service (QoS). To assist on the handling of such challenges we first discuss the different approaches to Quality of Experience assessment along with the most relevant QoE metrics, and then we discuss how they are used to provide objective results about user satisfaction. Key words: QoE, Measurements, Challenges 1 Introduction In the past years Traffic Monitoring and Measurement has been the focus of active research within the networking community. In particular, one important topic in the area has been the network performance analysis [1, 2], which is centered in develop- ing mechanisms for efficient Quality of Service (QoS) and Service Level Agreement (SLA) assessment in the network [3, 4].
    [Show full text]
  • Statistical Error Propagation Affecting the Quality of Experience Evaluation in Video on Demand Applications
    applied sciences Article Statistical Error Propagation Affecting the Quality of Experience Evaluation in Video on Demand Applications Abdul Wahab *, Nafi Ahmad and John Schormans School of Electronic Engineering and Computer Science, Queen Mary University of London, Mile End Rd, London E1 4NS, UK; nafi[email protected] (N.A.); [email protected] (J.S.) * Correspondence: [email protected] Received: 24 April 2020; Accepted: 21 May 2020; Published: 25 May 2020 Abstract: In addition to the traditional Quality of Service (QoS) metrics of latency, jitter and Packet Loss Ratio (PLR), Quality of Experience (QoE) is now widely accepted as a numerical proxy for the actual user experience. The literature has reported many mathematical mappings between QoE and QoS, where the QoS parameters are measured by the network providers using sampling. Previous research has focussed on sampling errors in QoS measurements. However, the propagation of these sampling errors in QoS through to the QoE values has not been evaluated before. This is important: without knowing how sampling errors propagate through to QoE estimates there is no understanding of the precision of the estimates of QoE, only of the average QoE value. In this paper, we used industrially acquired measurements of PLR and jitter to evaluate the sampling errors. Additionally, we evaluated the correlation between these QoS measurements, as this correlation affects errors propagating to the estimated QoE. Focusing on Video-on-Demand (VoD) applications, we use subjective testing and regression to map QoE metrics onto PLR and jitter. The resulting mathematical functions, and the theory of error propagation, were used to evaluate the error propagated to QoE.
    [Show full text]
  • Net Neutrality Principles and Its Impact on Quality of Experience Based Service Differentiation in Mobile Networks
    A Service of Leibniz-Informationszentrum econstor Wirtschaft Leibniz Information Centre Make Your Publications Visible. zbw for Economics Martínez, Luis; Álvarez San-Jaime, Oscar; Markendahl, Jan Conference Paper Net neutrality principles and its impact on quality of experience based service differentiation in mobile networks 2015 Regional Conference of the International Telecommunications Society (ITS): "The Intelligent World: Realizing Hopes, Overcoming Challenges", Los Angeles, USA, 25th-28th October, 2015 Provided in Cooperation with: International Telecommunications Society (ITS) Suggested Citation: Martínez, Luis; Álvarez San-Jaime, Oscar; Markendahl, Jan (2015) : Net neutrality principles and its impact on quality of experience based service differentiation in mobile networks, 2015 Regional Conference of the International Telecommunications Society (ITS): "The Intelligent World: Realizing Hopes, Overcoming Challenges", Los Angeles, USA, 25th-28th October, 2015, International Telecommunications Society (ITS), Calgary This Version is available at: http://hdl.handle.net/10419/146319 Standard-Nutzungsbedingungen: Terms of use: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Documents in EconStor may be saved and copied for your Zwecken und zum Privatgebrauch gespeichert und kopiert werden. personal and scholarly purposes. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle You are not to copy documents for public or commercial Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich purposes,
    [Show full text]
  • Qoe) of Data Services on the Mobile Network
    Modeling and optimization of the quality of customer experience (QoE) of data services on the mobile network. Application to video streaming Mohamed Bouzian To cite this version: Mohamed Bouzian. Modeling and optimization of the quality of customer experience (QoE) of data services on the mobile network. Application to video streaming. Other [cs.OH]. Université Côte d’Azur, 2017. English. NNT : 2017AZUR4061. tel-01622348 HAL Id: tel-01622348 https://tel.archives-ouvertes.fr/tel-01622348 Submitted on 24 Oct 2017 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. École doctorale Sciences & Technologies de l’information et de la Communication Unité de recherche : I3S Thèse de doctorat Présentée en vue de l’obtention du grade de docteur en Informatique de l’UNIVERSITE COTE D’AZUR par Mohamed Bouzian Modeling and optimization of the quality of customer experience (QoE) of data services on the mobile network. Application to video streaming Dirigée par Guillaume Urvoy-Keller Soutenue le 20 Juillet 2017 Devant le jury composé de : André-Luc Beylot Professeur, IRIT/ ENSEEIHT Rapporteur Tijani Chahed Professeur, Telecom SudParis Rapporteur Lin Chen Maître de conférence, LRI/ Paris Sud Examinateur Mustapha Bouhtou Directeur scientifique, Orange Labs Superviseur Taoufik En-Najjary Ingénieur de recherche, Orange Labs Superviseur Modeling and optimization of the quality of customer experience (QoE) of data services on the mobile network.
    [Show full text]
  • The Economics of Net Neutrality
    THE ECONOMICS OF NET NEUTRALITY IMPLICATIONS OF PRIORITY PRICING IN ACCESS NETWORKS Zur Erlangung des akademischen Grades eines Doktors der Wirtschaftswissenschaften (Dr. rer. pol.) von der Fakultät für Wirtschaftswissenschaften des Karlsruher Institut für Technologie (KIT) genehmigte DISSERTATION von Dipl. Volksw. Lukas Wiewiorra Tag der mündlichen Prüfung: 10.07.2012 Referent: Prof. Dr. Christof Weinhardt Korreferent: Prof. Dr. Karl-Martin Ehrhart Karlsruhe, 2012 Acknowledgements Foremost I would like to thank Prof. Dr. Christof Weinhardt, who gave me the great chance to start my work at the Institute of Information Systems and Management (IISM) and who sup- ported my studies at the DFG Graduate School Information Management and Market Engi- neering (IME) at the Karlsruhe Institute of Technology (KIT). He offered me the opportunity and freedom to pursue this research. I am also indebted to my co-advisor Prof. Dr. Karl- Martin Ehrhart for his encouragement and his constructive comments throughout my studies at the IME. I would particularly like to thank the other members of the committee, Prof. Dr. Rudi Studer for the interesting discussions on practical implications of my thesis and Prof. Dr. Kay Mitusch for having been so kind to chair the board of examiners. Moreover, I would like to thank the team of IISM and the professors and students of the IME who have helped to improve this work through constructive feedback and who have created an excellent working atmosphere and ensured a vivid social life over the last years. I would also like to thank Sascha Schweitzer and Philip Köhler, who have been my roommates within the last years and both helped to make the process of creating this work an unforgettable journey.
    [Show full text]
  • Predicting the Effect of Home Wi-Fi Quality Onqoe Diego Da Hora, Karel Van Doorselaer, Koen Van Oost, Renata Teixeira
    Predicting the effect of home Wi-Fi quality onQoE Diego da Hora, Karel van Doorselaer, Koen van Oost, Renata Teixeira To cite this version: Diego da Hora, Karel van Doorselaer, Koen van Oost, Renata Teixeira. Predicting the effect of home Wi-Fi quality on QoE. INFOCOM 2018 - IEEE International Conference on Computer Communica- tions, Apr 2018, Honolulu, United States. pp.1-10. hal-01677214 HAL Id: hal-01677214 https://hal.inria.fr/hal-01677214 Submitted on 8 Jan 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Predicting the effect of home Wi-Fi quality on QoE Diego da Hora Karel van Doorselaer, Koen van Oost Renata Teixeira Telecom Paristech Technicolor INRIA Paris, France Edegem, Belgium Paris, France Abstract—Poor Wi-Fi quality can disrupt home users’ internet turn would help reduce operational costs. In many cases, the experience, or the Quality of Experience (QoE). Detecting when ISP provides and controls the home AP, so we leverage the Wi-Fi degrades QoE is extremely valuable for residential Internet home AP as monitoring point within the home. For such Service Providers (ISPs) as home users often hold the ISP responsible whenever QoE degrades.
    [Show full text]
  • Quality of Experience in Relation to Wearables
    Quality of Experience in Relation to Wearables A thesis submitted for the degree of Doctor of Philosophy By Nadia Hussain Department of Information Systems and Computing, Brunel University January 2020 ABSTRACT The purpose of this study is to apply the concept of Quality of Experience (QoE) to wearables. QoE is inextricably linked to the user experience of multimedia computing and, although QoE has been explored in relation to other types of multimedia devices, thus far its applicability to wearables has remained largely ignored. Given the proliferation of wearable devices and their growing use to augment and complement the multimedia user experience, the need for a set of QoE guidelines becomes imperative. The study which forms the focus of this PhD meets that need and puts forward a set of guidelines tailored exclusively towards wearables’ QoE. Accordingly, an extensive experimental investigation has been undertaken to see how wearables impact users’ QoE in both multimedia and multiple sensorial media (mulsemedia) contexts. Based on two exploratory studies, the findings have shown that the haptic vest (KOR-FX) enhanced user QoE to a certain extent. In terms of adoption, participants reported they would generally incorporate the heart rate (HR) monitor wristband (Mio Go) into their daily lives as opposed to the haptic vest. Other findings revealed that human factors play a part in user’s attitudes towards wearables and predominantly age was the major influencing factor across both of the studies. Moreover, the participants’ HR varied throughout the experiments, suggesting an enhanced level of engagement whilst viewing the multimedia video clips. Furthermore, the results suggest that there is a potential future for wearables, if the QoE is a positive one and also if the design of such devices are appealing as well as unobtrusive.
    [Show full text]
  • Quality of Experience in Relation to Personal Informatics Tools: the Analysis and Modelling of Quality of Experience for Iot
    A Service of Leibniz-Informationszentrum econstor Wirtschaft Leibniz Information Centre Make Your Publications Visible. zbw for Economics Shin, Dong-Hee Conference Paper Quality of Experience in Relation to Personal Informatics Tools: The Analysis and Modelling of Quality of Experience for IoT 14th Asia-Pacific Regional Conference of the International Telecommunications Society (ITS): "Mapping ICT into Transformation for the Next Information Society", Kyoto, Japan, 24th-27th June, 2017 Provided in Cooperation with: International Telecommunications Society (ITS) Suggested Citation: Shin, Dong-Hee (2017) : Quality of Experience in Relation to Personal Informatics Tools: The Analysis and Modelling of Quality of Experience for IoT, 14th Asia-Pacific Regional Conference of the International Telecommunications Society (ITS): "Mapping ICT into Transformation for the Next Information Society", Kyoto, Japan, 24th-27th June, 2017, International Telecommunications Society (ITS), Calgary This Version is available at: http://hdl.handle.net/10419/168540 Standard-Nutzungsbedingungen: Terms of use: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Documents in EconStor may be saved and copied for your Zwecken und zum Privatgebrauch gespeichert und kopiert werden. personal and scholarly purposes. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle You are not to copy documents for public or commercial Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich purposes, to exhibit the documents publicly, to make them machen, vertreiben oder anderweitig nutzen. publicly available on the internet, or to distribute or otherwise use the documents in public. Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, If the documents have been made available under an Open gelten abweichend von diesen Nutzungsbedingungen die in der dort Content Licence (especially Creative Commons Licences), you genannten Lizenz gewährten Nutzungsrechte.
    [Show full text]
  • Video and Audio Quality Assurance
    Video and Audio Quality Assurance For Next-generation Video Networks Abstract In the context of video and audio programming, Quality of Experience (QoE) is assuring that operators deliver pictures and sound that will keep their viewers happy. For many years, operators have focused on monitoring the Quality of Service (QoS) of their video networks. But video and audio quality issues still remain among the top complaints from subscribers. Indeed, independent research conducted with Video Service Providers found that the top customer issues reported were content related: macroblocking; video blackouts; frozen video and silence. While this challenge is well-recognized in the industry, until recently solving it has proven difficult. The solution begins with choosing and using Tektronix’ Sentry, which uses innovative technology to allow operators to monitor video networks based on actual customer experience with video and audio services. Standards like ETSI TR 101 290 (measurement guidelines for DVB Systems) traditionally were the cornerstone of network diagnostics, but effective monitoring of a video service requires much more than these measurements alone. In this paper we discuss standards-based measurements, and the new role they play in today's monitoring technology and products. We then investigate Sentry’s advanced technology, which enables operators to continuously, automatically, and objectively monitor and measure video and audio quality based on viewers’ Quality of Experience (QoE). We will see how Sentry reliably represents viewer experience while eliminating the individual's subjectivity. Instead of measuring only network health, Sentry also analyses the actual content of hundreds of video and audio streams for impairments in parallel and in real time.
    [Show full text]
  • Quality of Experience (Qoe) Requirements for Real-Time Communication Services
    ETSI TR 102 643 V1.0.1 (2009-12) Technical Report Human Factors (HF); Quality of Experience (QoE) requirements for real-time communication services 2 ETSI TR 102 643 V1.0.1 (2009-12) Reference RTR/HF-00129 Keywords interaction, quality, service ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N° 348 623 562 00017 - NAF 742 C Association à but non lucratif enregistrée à la Sous-Préfecture de Grasse (06) N° 7803/88 Important notice Individual copies of the present document can be downloaded from: http://www.etsi.org The present document may be made available in more than one electronic version or in print. In any case of existing or perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http://portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: http://portal.etsi.org/chaircor/ETSI_support.asp Copyright Notification No part may be reproduced except as authorized by written permission. The copyright and the foregoing restriction extend to reproduction in all media.
    [Show full text]