DOCSLIB.ORG

Why Is Multimedia Quality of Experience Assessment a Challenging Problem?

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Why Is Multimedia Quality of Experience Assessment a Challenging Problem? Received August 5, 2019, accepted August 18, 2019, date of publication August 21, 2019, date of current version September 5, 2019. Digital Object Identifier 10.1109/ACCESS.2019.2936470 Why Is Multimedia Quality of Experience Assessment a Challenging Problem? ZAHID AKHTAR 1, (Senior Member, IEEE), KAMRAN SIDDIQUE2, (Member, IEEE), AJITA RATTANI3, (Member, IEEE), SYAHEERAH LEBAI LUTFI4, AND TIAGO H. FALK 5, (Senior Member, IEEE) 1Department of Computer Science, University of Memphis, Memphis, TN 38152, USA 2Department of Information and Communication Technology, Xiamen University Malaysia, Sepang 43900, Malaysia 3Department of Electrical Engineering and Computer Science, Wichita State University, Wichita, KS 67260, USA 4School of Computer Science, Universiti Sains Malaysia, Penang 11800, Malaysia 5INRS-EMT, University of Quebec, Montreal, QC H5A 1K6, Canada Corresponding authors: Zahid Akhtar ([email protected]) and Kamran Siddique ([email protected]) This work was supported by the Office of Research and Innovation, Xiamen University Malaysia under the XMUM Research Program Cycle 3, under Grant XMUMRF/2019-C3/IECE/0006. ABSTRACT Quality of experience (QoE) assessment occupies a key role in various multimedia networks and applications. Recently, large efforts have been devoted to devise objective QoE metrics that correlate with perceived subjective measurements. Despite recent progress, limited success has been attained. In this paper, we provide some insights on why QoE assessment is so difficult by presenting few major issues as well as a general summary of quality/QoE formation and conception including human auditory and vision systems. Also, potential future research directions are described to discern the path forward. This is an academic and perspective article, which is hoped to complement existing studies and prompt interdisciplinary research. INDEX TERMS Audiovisual perception, data-driven analysis, multimedia quality, objective quality metric, quality of experience, quality of services (QoS). I. INTRODUCTION becoming a paramount and demanding issue in multimedia Multimedia services (e.g., Internet Protocol TeleVision, signal processing and practices. social networks, immersive and virtual reality games, multi- Majority of existing studies on QoE are based on quality media conferencing, etc.) not only have gained importance in assessment (QA) of audio, video or audio-visual modalities this wireless era but also are expected to grow exponentially. that may deteriorate under different processes such as acquisi- Such services and applications may provide poor experience tion, preprocessing, transmission, etc. There exist subjective to a user due to multiple reasons, e.g., network (network and objective QA techniques. In subjective QA schemes, overload) and terminal devices known as quality elements [1]. a bunch of trained/naïve end-users are asked to provide Thus, research and industry communities are devising differ- quality grades [4]–[6]. Whereas, signal fidelity measures ent schemes to understand how users perceive and experience (e.g., packet loss proportions) are utilized in objective meth- degradations, and to subsequently provide them with a better ods to estimate quality. Though objective schemes are fast quality of experience (QoE) [64], [65]. and simple, they are poor indicator of perceived QoE owing to Majority of the multimedia applications are comprised of the fact that they overlook human's multi-media perception as two main elements, i.e., audio and video signals. In spite of well as viewing circumstances [7]. It has been widely agreed latest technical advances, core elements of multimedia are upon that signal fidelity measures alone do not register well still impaired usually by lossy signal encoding (decoding) with human QoE gradings of multimedia contents [7]–[11]. and/or fallible transmission channels, which may lead to poor The QoE decided by humans' perception and contentment quality and user experiences [2], [3]. Accurately estimat- is much more compounded than the statistics that may be ing QoE of the communicated audio-visual modalities will obtained using a typical signal QA method and network help service providers to further ameliorate their networks management system. Since the human auditory and visual and services. In fact, digital signals' QoE assessment is systems are the ultimate receivers and the human evaluator observes the transmitted multimedia contents, user-oriented The associate editor coordinating the review of this article and approving perceptual and cognitive correlates of QoE perception are it for publication was Jinsong Wu. needed that is still a long way odyssey owing to various VOLUME 7, 2019 This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see http://creativecommons.org/licenses/by/4.0/ 117897 Z. Akhtar et al.: Why Is Multimedia QoE Assessment a Challenging Problem? FIGURE 1. Illustration of the different factors furnishing user's QoS and QoE. covariates such as user-, context-, and system factors as also feature' or `a property' or `a degree of excellence' [13], which depicted in Fig.1. Nonetheless, current trends in user-centric nowadays may be called ``character'' of an entity [12]. While experiences and burgeoning of wearables have allowed such few philosophers state that quality could not be elucidated, models to be developed [12] and opening door to future the notion of quality remains controversial in modern phi- innovations. losophy. In multimedia domain, quality is usually utilized QoE is a multidisciplinary domain that needs input from with the engineering objectives, since it is a dominant gauge human science (e.g., psychology, physiology, sociology, neu- for assessing systems, applications or services throughout roscience and cognitive science) and information technology both development and operational stages [12]. All in all, (e.g., digital signal processing, machine learning, computer quality could be contemplated as an umbrella term, as many vision and signal synthesis). There are many issues still open elements play a part in constructing quality's cognizance. in the QoE field. Therefore, this article first presents an For example, covariates like loudness, tone, listening effort, synopsis of various interpretations of quality, QoE formation and intelligibility are critical for audio quality. While, factors and perception including human auditory and vision systems, like image size, packet loss, frame rate, level of audio-visual quality of service (QoS), QoE, quality of perception (QoP), synchronization are pivotal for visual or audiovisual quality. and main issues and research opportunities in this field. All The concepts related to quality have been slowly evolving in all, it is an academic and position paper that is expected and continuously refined leading to several definitions, which to complement prior studies and prod interdisciplinary contrast moderately with one another subject to usage's con- research. text [14]. It is imperative to revisit common expressions from this vantage point, since quality has varying overtones deter- II. WHAT ARE QUALITY, QUALITY OF SERVICE, QUALITY mined by the context where it is utilized and some meanings OF PERCEPTION AND QUALITY OF EXPERIENCE? of those concepts have been progressively lost and deserve A. WHAT IS QUALITY? clarification. Therefore, in the following various interpreta- Quality is a metaphysical notion and viewed as a construct of tions of quality throughout literature are presented: the mind that is simple to comprehend but hard to expound. Definition 1 (Dictionary/Lexical View): ``Measure of excel- According to Merriam Webster dictionary, the term quality lence or state of being free from defects, deficiencies, and comes from Latin word qualitas that refers to `an inherent significant variations'' [15]. 117898 VOLUME 7, 2019 Z. Akhtar et al.: Why Is Multimedia QoE Assessment a Challenging Problem? Definition 2 (Transcendental/Metaphysical View): This product/object's features like ergonomics, efficiency, depend- view reckons quality to be synonymous with innate excel- ability and that are assessed through user's perspective, lence, which can be recognized but not defined. The tran- thereby equating customer/user satisfaction with the qual- scendental view of quality is described as ``::: even though ity. According to it, quality is ``Attribute, characteris- Quality cannot be defined, you know what it is. ::: Quality tic, or property of a thing or phenomenon that can be is neither a part of mind, nor is it a part of matter. It is a observed and interpreted, and may be approximated (quan- third entity, which is independent of the two. ::: Quality isn't tified) but cannot be measured, such as beauty, feel, flavor, a substance. Neither is it a method. It's outside of both. ::: It's taste'' [24]. the goal toward which method is aimed'' [16]. But, suchlike Definition 9 (ISO 9000 View): ISO 9000 is a group of perspective of quality has small empirical use, since it cannot quality management techniques standards, which interprets be computed by professionals and can solely be discerned by quality as ``something that can be determined by comparing virtue of experience. a set of inherent characteristics with a set of requirements Definition 3 (ISO 8402-1986 View): According to ISO of customers and other interested parties [25]. The quality is (International Organization for Standardization) 8402-1986 considered high if attributes meet prerequisites, while it's low standard
Load more

Recommended publications
  • Quality Parameters and Standards for Telecommunications and Broadcasting Networks (Study of Specifications and Recommendations)
    Quality parameters and standards for Telecommunications and Broadcasting networks (Study of Specifications and Recommendations) Executive summary This document is the study report for the ‘Quality parameters and standards for Telecommunication networks’ for the Bureau Telecommunications and Post St. Maarten. This study is to analyze and describe Quality of Service (QoS) and Quality of Experience (QoE) parameters that are relevant for the St. Maarten Telecommunication Industry. As part of the study existing standards and recommendation (such as ITU, GSMA etc.) have been inventoried. The parameters and standards will be consistent with International recommendations and specifications from institutions such as ITU, GSMA, 3GPP, ETSI, and also will be in line with international best practice of how to define such quality parameters. The set of parameters for inspection purposes have been described in a separate document (‘Inspection Guide’). Page 2 Cannegieter Street 15 – Unit 5.1 I Philipsburg I St. Maarten I Dutch Caribbean I +1(721) 542.4699 [email protected] I www.sxmregulator.sx Table of Contents 1 Introduction ................................................................................................................................................ 4 1.1 Background and current situation ....................................................................................................... 4 1.2 Purpose of the project ........................................................................................................................
    [Show full text]
  • An Overview of Quality of Experience Measurement Challenges for Video Applications in IP Networks?
    An Overview of Quality of Experience Measurement Challenges for Video Applications in IP Networks? R. Serral-Gracia`1, E. Cerqueira2;3, M. Curado3, M. Yannuzzi1, E. Monteiro3, X. Masip-Bruin1 frserral,yannuzzi,[email protected] [email protected] fmarilia, [email protected] 1 Advanced Network Architectures Lab, Technical University of Catalunya (UPC), Jordi Girona 1-3, 08028 Barcelona - Spain 2 Faculty of Computer Engineering, Federal University of Para, Rua Augusto Correa,ˆ 01, CEP 66075-110, Belem´ - Brazil 3 Department of Informatics Engineering, University of Coimbra, Polo II, Pinhal de Marrocos, 3030-290 Coimbra - Portugal Abstract. The increase in multimedia content on the Internet has created a re- newed interest in quality assessment. There is however a main difference from the traditional quality assessment approaches, as now, the focus relies on the user per- ceived quality, opposed to the network centered approach classically proposed. In this paper we overview the most relevant challenges to perform Quality of Experi- ence (QoE) assessment in IP networks and highlight the particular considerations necessary when compared to alternative mechanisms, already deployed, such as Quality of Service (QoS). To assist on the handling of such challenges we first discuss the different approaches to Quality of Experience assessment along with the most relevant QoE metrics, and then we discuss how they are used to provide objective results about user satisfaction. Key words: QoE, Measurements, Challenges 1 Introduction In the past years Traffic Monitoring and Measurement has been the focus of active research within the networking community. In particular, one important topic in the area has been the network performance analysis [1, 2], which is centered in develop- ing mechanisms for efficient Quality of Service (QoS) and Service Level Agreement (SLA) assessment in the network [3, 4].
    [Show full text]
  • Statistical Error Propagation Affecting the Quality of Experience Evaluation in Video on Demand Applications
    applied sciences Article Statistical Error Propagation Affecting the Quality of Experience Evaluation in Video on Demand Applications Abdul Wahab *, Nafi Ahmad and John Schormans School of Electronic Engineering and Computer Science, Queen Mary University of London, Mile End Rd, London E1 4NS, UK; nafi[email protected] (N.A.); [email protected] (J.S.) * Correspondence: [email protected] Received: 24 April 2020; Accepted: 21 May 2020; Published: 25 May 2020 Abstract: In addition to the traditional Quality of Service (QoS) metrics of latency, jitter and Packet Loss Ratio (PLR), Quality of Experience (QoE) is now widely accepted as a numerical proxy for the actual user experience. The literature has reported many mathematical mappings between QoE and QoS, where the QoS parameters are measured by the network providers using sampling. Previous research has focussed on sampling errors in QoS measurements. However, the propagation of these sampling errors in QoS through to the QoE values has not been evaluated before. This is important: without knowing how sampling errors propagate through to QoE estimates there is no understanding of the precision of the estimates of QoE, only of the average QoE value. In this paper, we used industrially acquired measurements of PLR and jitter to evaluate the sampling errors. Additionally, we evaluated the correlation between these QoS measurements, as this correlation affects errors propagating to the estimated QoE. Focusing on Video-on-Demand (VoD) applications, we use subjective testing and regression to map QoE metrics onto PLR and jitter. The resulting mathematical functions, and the theory of error propagation, were used to evaluate the error propagated to QoE.
    [Show full text]
  • Net Neutrality Principles and Its Impact on Quality of Experience Based Service Differentiation in Mobile Networks
    A Service of Leibniz-Informationszentrum econstor Wirtschaft Leibniz Information Centre Make Your Publications Visible. zbw for Economics Martínez, Luis; Álvarez San-Jaime, Oscar; Markendahl, Jan Conference Paper Net neutrality principles and its impact on quality of experience based service differentiation in mobile networks 2015 Regional Conference of the International Telecommunications Society (ITS): "The Intelligent World: Realizing Hopes, Overcoming Challenges", Los Angeles, USA, 25th-28th October, 2015 Provided in Cooperation with: International Telecommunications Society (ITS) Suggested Citation: Martínez, Luis; Álvarez San-Jaime, Oscar; Markendahl, Jan (2015) : Net neutrality principles and its impact on quality of experience based service differentiation in mobile networks, 2015 Regional Conference of the International Telecommunications Society (ITS): "The Intelligent World: Realizing Hopes, Overcoming Challenges", Los Angeles, USA, 25th-28th October, 2015, International Telecommunications Society (ITS), Calgary This Version is available at: http://hdl.handle.net/10419/146319 Standard-Nutzungsbedingungen: Terms of use: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Documents in EconStor may be saved and copied for your Zwecken und zum Privatgebrauch gespeichert und kopiert werden. personal and scholarly purposes. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle You are not to copy documents for public or commercial Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich purposes,
    [Show full text]
  • Qoe) of Data Services on the Mobile Network
    Modeling and optimization of the quality of customer experience (QoE) of data services on the mobile network. Application to video streaming Mohamed Bouzian To cite this version: Mohamed Bouzian. Modeling and optimization of the quality of customer experience (QoE) of data services on the mobile network. Application to video streaming. Other [cs.OH]. Université Côte d’Azur, 2017. English. NNT : 2017AZUR4061. tel-01622348 HAL Id: tel-01622348 https://tel.archives-ouvertes.fr/tel-01622348 Submitted on 24 Oct 2017 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. École doctorale Sciences & Technologies de l’information et de la Communication Unité de recherche : I3S Thèse de doctorat Présentée en vue de l’obtention du grade de docteur en Informatique de l’UNIVERSITE COTE D’AZUR par Mohamed Bouzian Modeling and optimization of the quality of customer experience (QoE) of data services on the mobile network. Application to video streaming Dirigée par Guillaume Urvoy-Keller Soutenue le 20 Juillet 2017 Devant le jury composé de : André-Luc Beylot Professeur, IRIT/ ENSEEIHT Rapporteur Tijani Chahed Professeur, Telecom SudParis Rapporteur Lin Chen Maître de conférence, LRI/ Paris Sud Examinateur Mustapha Bouhtou Directeur scientifique, Orange Labs Superviseur Taoufik En-Najjary Ingénieur de recherche, Orange Labs Superviseur Modeling and optimization of the quality of customer experience (QoE) of data services on the mobile network.
    [Show full text]
  • The Economics of Net Neutrality
    THE ECONOMICS OF NET NEUTRALITY IMPLICATIONS OF PRIORITY PRICING IN ACCESS NETWORKS Zur Erlangung des akademischen Grades eines Doktors der Wirtschaftswissenschaften (Dr. rer. pol.) von der Fakultät für Wirtschaftswissenschaften des Karlsruher Institut für Technologie (KIT) genehmigte DISSERTATION von Dipl. Volksw. Lukas Wiewiorra Tag der mündlichen Prüfung: 10.07.2012 Referent: Prof. Dr. Christof Weinhardt Korreferent: Prof. Dr. Karl-Martin Ehrhart Karlsruhe, 2012 Acknowledgements Foremost I would like to thank Prof. Dr. Christof Weinhardt, who gave me the great chance to start my work at the Institute of Information Systems and Management (IISM) and who sup- ported my studies at the DFG Graduate School Information Management and Market Engi- neering (IME) at the Karlsruhe Institute of Technology (KIT). He offered me the opportunity and freedom to pursue this research. I am also indebted to my co-advisor Prof. Dr. Karl- Martin Ehrhart for his encouragement and his constructive comments throughout my studies at the IME. I would particularly like to thank the other members of the committee, Prof. Dr. Rudi Studer for the interesting discussions on practical implications of my thesis and Prof. Dr. Kay Mitusch for having been so kind to chair the board of examiners. Moreover, I would like to thank the team of IISM and the professors and students of the IME who have helped to improve this work through constructive feedback and who have created an excellent working atmosphere and ensured a vivid social life over the last years. I would also like to thank Sascha Schweitzer and Philip Köhler, who have been my roommates within the last years and both helped to make the process of creating this work an unforgettable journey.
    [Show full text]
  • Predicting the Effect of Home Wi-Fi Quality Onqoe Diego Da Hora, Karel Van Doorselaer, Koen Van Oost, Renata Teixeira
    Predicting the effect of home Wi-Fi quality onQoE Diego da Hora, Karel van Doorselaer, Koen van Oost, Renata Teixeira To cite this version: Diego da Hora, Karel van Doorselaer, Koen van Oost, Renata Teixeira. Predicting the effect of home Wi-Fi quality on QoE. INFOCOM 2018 - IEEE International Conference on Computer Communica- tions, Apr 2018, Honolulu, United States. pp.1-10. hal-01677214 HAL Id: hal-01677214 https://hal.inria.fr/hal-01677214 Submitted on 8 Jan 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Predicting the effect of home Wi-Fi quality on QoE Diego da Hora Karel van Doorselaer, Koen van Oost Renata Teixeira Telecom Paristech Technicolor INRIA Paris, France Edegem, Belgium Paris, France Abstract—Poor Wi-Fi quality can disrupt home users’ internet turn would help reduce operational costs. In many cases, the experience, or the Quality of Experience (QoE). Detecting when ISP provides and controls the home AP, so we leverage the Wi-Fi degrades QoE is extremely valuable for residential Internet home AP as monitoring point within the home. For such Service Providers (ISPs) as home users often hold the ISP responsible whenever QoE degrades.
    [Show full text]
  • Quality of Experience in Relation to Wearables
    Quality of Experience in Relation to Wearables A thesis submitted for the degree of Doctor of Philosophy By Nadia Hussain Department of Information Systems and Computing, Brunel University January 2020 ABSTRACT The purpose of this study is to apply the concept of Quality of Experience (QoE) to wearables. QoE is inextricably linked to the user experience of multimedia computing and, although QoE has been explored in relation to other types of multimedia devices, thus far its applicability to wearables has remained largely ignored. Given the proliferation of wearable devices and their growing use to augment and complement the multimedia user experience, the need for a set of QoE guidelines becomes imperative. The study which forms the focus of this PhD meets that need and puts forward a set of guidelines tailored exclusively towards wearables’ QoE. Accordingly, an extensive experimental investigation has been undertaken to see how wearables impact users’ QoE in both multimedia and multiple sensorial media (mulsemedia) contexts. Based on two exploratory studies, the findings have shown that the haptic vest (KOR-FX) enhanced user QoE to a certain extent. In terms of adoption, participants reported they would generally incorporate the heart rate (HR) monitor wristband (Mio Go) into their daily lives as opposed to the haptic vest. Other findings revealed that human factors play a part in user’s attitudes towards wearables and predominantly age was the major influencing factor across both of the studies. Moreover, the participants’ HR varied throughout the experiments, suggesting an enhanced level of engagement whilst viewing the multimedia video clips. Furthermore, the results suggest that there is a potential future for wearables, if the QoE is a positive one and also if the design of such devices are appealing as well as unobtrusive.
    [Show full text]
  • Quality of Experience in Relation to Personal Informatics Tools: the Analysis and Modelling of Quality of Experience for Iot
    A Service of Leibniz-Informationszentrum econstor Wirtschaft Leibniz Information Centre Make Your Publications Visible. zbw for Economics Shin, Dong-Hee Conference Paper Quality of Experience in Relation to Personal Informatics Tools: The Analysis and Modelling of Quality of Experience for IoT 14th Asia-Pacific Regional Conference of the International Telecommunications Society (ITS): "Mapping ICT into Transformation for the Next Information Society", Kyoto, Japan, 24th-27th June, 2017 Provided in Cooperation with: International Telecommunications Society (ITS) Suggested Citation: Shin, Dong-Hee (2017) : Quality of Experience in Relation to Personal Informatics Tools: The Analysis and Modelling of Quality of Experience for IoT, 14th Asia-Pacific Regional Conference of the International Telecommunications Society (ITS): "Mapping ICT into Transformation for the Next Information Society", Kyoto, Japan, 24th-27th June, 2017, International Telecommunications Society (ITS), Calgary This Version is available at: http://hdl.handle.net/10419/168540 Standard-Nutzungsbedingungen: Terms of use: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Documents in EconStor may be saved and copied for your Zwecken und zum Privatgebrauch gespeichert und kopiert werden. personal and scholarly purposes. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle You are not to copy documents for public or commercial Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich purposes, to exhibit the documents publicly, to make them machen, vertreiben oder anderweitig nutzen. publicly available on the internet, or to distribute or otherwise use the documents in public. Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, If the documents have been made available under an Open gelten abweichend von diesen Nutzungsbedingungen die in der dort Content Licence (especially Creative Commons Licences), you genannten Lizenz gewährten Nutzungsrechte.
    [Show full text]
  • Evaluating Quality of Experience and Real- Time Performance of Industrial Internet of Things
    Evaluating Quality of Experience and real- time performance of Industrial Internet of Things Roman Zhohov Computer Science and Engineering, master's level (120 credits) 2018 Luleå University of Technology Department of Computer Science, Electrical and Space Engineering Lappeenranta University of Technology School of Engineering Science Degree Program in Computer Science Roman Zhohov EVALUATING QUALITY OF EXPERIENCE AND REAL-TIME PERFORMANCE OF INDUSTRIAL INTERNET OF THINGS Examiners: Professor Eric Rondeau, University of Lorraine Professor Jari Porras, Lappeenranta University of Technology Professor Karl Andersson, Lulea University of Technology Supervisors: Professor Karl Andersson, Lulea University of Technology Per Johansson, InfoVista AB, Skelleftea, Sweden Dimitar Minovski, Lulea University of Technology ABSTRACT Lappeenranta University of Technology School of Engineering Science Degree Program in Computer Science Roman Zhohov Evaluating Quality of Experience and real-time performance of Industrial Internet of Things Master’s Thesis 46 pages, 16 figures, 3 tables Examiners: Professor Eric Rondeau, University of Lorraine Professor Jari Porras, Lappeenranta University of Technology Professor Karl Andersson, Lulea University of Technology Keywords: QoE, Industry 4.0, QoS, real-time communications, IIoT, CPS. The Industrial Internet of Things (IIoT) is one of the key technologies of Industry 4.0 that will be an integral part of future smart and sustainable production. The current constituted models for estimating Quality of Experience (QoE) are mainly targeting the multimedia systems. Present models for evaluating QoE, specifically leveraged by the expensive subjective tests, are not applicable for IIoT applications. This work triggers the discussion on defining the QoE domain for IIoT services and applications. Industry-specific KPIs are proposed to assure QoE by linking business and technology domains.
    [Show full text]
  • Video and Audio Quality Assurance
    Video and Audio Quality Assurance For Next-generation Video Networks Abstract In the context of video and audio programming, Quality of Experience (QoE) is assuring that operators deliver pictures and sound that will keep their viewers happy. For many years, operators have focused on monitoring the Quality of Service (QoS) of their video networks. But video and audio quality issues still remain among the top complaints from subscribers. Indeed, independent research conducted with Video Service Providers found that the top customer issues reported were content related: macroblocking; video blackouts; frozen video and silence. While this challenge is well-recognized in the industry, until recently solving it has proven difficult. The solution begins with choosing and using Tektronix’ Sentry, which uses innovative technology to allow operators to monitor video networks based on actual customer experience with video and audio services. Standards like ETSI TR 101 290 (measurement guidelines for DVB Systems) traditionally were the cornerstone of network diagnostics, but effective monitoring of a video service requires much more than these measurements alone. In this paper we discuss standards-based measurements, and the new role they play in today's monitoring technology and products. We then investigate Sentry’s advanced technology, which enables operators to continuously, automatically, and objectively monitor and measure video and audio quality based on viewers’ Quality of Experience (QoE). We will see how Sentry reliably represents viewer experience while eliminating the individual's subjectivity. Instead of measuring only network health, Sentry also analyses the actual content of hundreds of video and audio streams for impairments in parallel and in real time.
    [Show full text]
  • Quality of Experience (Qoe) Requirements for Real-Time Communication Services
    ETSI TR 102 643 V1.0.1 (2009-12) Technical Report Human Factors (HF); Quality of Experience (QoE) requirements for real-time communication services 2 ETSI TR 102 643 V1.0.1 (2009-12) Reference RTR/HF-00129 Keywords interaction, quality, service ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N° 348 623 562 00017 - NAF 742 C Association à but non lucratif enregistrée à la Sous-Préfecture de Grasse (06) N° 7803/88 Important notice Individual copies of the present document can be downloaded from: http://www.etsi.org The present document may be made available in more than one electronic version or in print. In any case of existing or perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http://portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: http://portal.etsi.org/chaircor/ETSI_support.asp Copyright Notification No part may be reproduced except as authorized by written permission. The copyright and the foregoing restriction extend to reproduction in all media.
    [Show full text]