Pytheas: Enabling Data-Driven Quality of Experience Optimization Using Group-Based Exploration-Exploitation † † †? Junchen Jiang , Shijie Sun◦, Vyas Sekar , Hui Zhang † ? CMU, ◦Tsinghua University, Conviva Inc. Abstract Prior%work:%Prediction.oriented%design Measurement* Prediction1 Content providers are increasingly using data-driven collection based*control mechanisms to optimize quality of experience (QoE). Periodical*Update Measurement* Prediction1 Many existing approaches formulate this process as a Data$driven+ collection … based*control control+platform Time prediction problem of learning optimal decisions (e.g., QoE server, bitrate, relay) based on observed QoE of re- measurement Decision Pytheas:%Real.time%Exploration%and%Exploitation (Real.time%E2) cent sessions. While prediction-based mechanisms have Sessions … Measurement* Decision* shown promising QoE improvements, they are necessar- collection making ily incomplete as they: (1) suffer from many known bi- Potential* decisions ases (e.g., incomplete visibility) and (2) cannot respond to sudden changes (e.g., load changes). Drawing a par- Figure 1: Prediction-oriented designs vs. Real-time E2. allel from machine learning, we argue that data-driven QoE optimization should instead be cast as a real-time Existing frameworks typically formulate data-driven exploration and exploitation (E2) process rather than as optimization as a prediction problem (e.g., [25, 39]). a prediction problem. Adopting E2 in network applica- As depicted in Figure 1, they use passive measurements tions, however, introduces key architectural (e.g., how from application sessions to periodically update a predic- to update decisions in real time with fresh data) and al- tion model, which captures the interaction between pos- gorithmic (e.g., capturing complex interactions between sible “decisions” (e.g., server, relay, CDN, or bitrate), session features vs. QoE) challenges. We present Pyth- different network- and application-layer features (e.g., eas, a framework which addresses these challenges using client AS, content type), and QoE metrics. The predic- a group-based E2 mechanism. The insight is that appli- tion model is then used to make decisions for future ses- cation sessions sharing the same features (e.g., IP pre- sions that yield the best (predicted) QoE. fix, location) can be grouped so that we can run E2 al- While previous work has shown considerable QoE im- gorithms at a per-group granularity. This naturally cap- provement using this prediction-based workflow, it has tures the complex interactions and is amenable to real- key limitations. First, QoE measurements are collected time control with fresh measurements. Using an end- passively by a process independently of the prediction to-end implementation and a proof-of-concept deploy- process. As a result, quality predictions could easily be ment in CloudLab, we show that Pytheas improves video biased if the measurement collection does not present QoE over a state-of-the-art prediction-based system by the representative view across sessions. Furthermore, up to 31% on average and 78% on 90th percentile of per- predictions could be inaccurate if quality measurements session QoE. have high variance [39]. Second, the predictions and decisions are updated periodically on coarse timescales 1 Introduction of minutes or even hours. This means that they cannot We observe an increasing trend toward the adoption detect and adapt to sudden events such as load-induced of data-driven approaches to optimize application-level quality degradation. quality of experience (QoE) (e.g., [26, 19, 36]). At a high To address these concerns, we argue that data-driven level, these approaches use the observed QoE of recent optimization should instead be viewed through the lens application sessions to proactively improve the QoE for of real-time exploration and exploitation (E2) frame- future sessions. Many previous and ongoing efforts have works [43] from the machine learning community rather demonstrated the potential of such data-driven optimiza- than as prediction problems. At a high level (Fig- tion for applications such as video streaming [25, 19], ure 1), E2 formulates measurement collection and deci- Internet telephony [24] and web performance [30, 39]. sion making as a joint process with real-time QoE mea- surements. The intuition is to continuously strike a dy- QoE over a state-of-the-art prediction-based baseline by namic balance between exploring suboptimal decisions 6-31% on average, and 24-78% on 90th percentile, and and exploiting currently optimal decisions, thus funda- (2) Pytheas is horizontally scalable and resilient to vari- mentally addressing the aforementioned shortcomings of ous failure modes. prediction-based approaches. While E2 is arguably the right abstraction for data- 2 Background driven QoE optimization, realizing it in practice in a net- Drawing on prior work, we discuss several applications working context is challenging on two fronts: that have benefited (and could benefit) from data-driven Challenge 1: How to run real-time E2 over mil- QoE optimization ( 2.1). Then, we highlight key limita- • § lions of globally distributed sessions with fresh data? tions of existing prediction-based approaches ( 2.2). § E2 techniques require a fresh and global view of QoE measurements. Unfortunately, existing solutions 2.1 Use cases pose fundamental tradeoffs between data freshness We begin by describing several application settings to and global views. While some (e.g., [19, 25]) only highlight the types of “decisions” and the improvements update the global view on timescales of minutes, oth- that data-driven QoE optimization can provide. ers (e.g., [16]) assume that a fresh global view can be Video on demand and live streaming: VoD providers maintained by a single cluster in a centralized man- (e.g., YouTube, Vevo) have the flexibility to stream con- ner, which may not be possible for geo-distributed ser- tent from multiple servers or CDNs [41] and in dif- vices [34, 33]. ferent bitrates [23], and already have real-time visibil- Challenge 2: How to capture complex relations be- ity into video quality through client-side instrumenta- • tween sessions in E2? Traditional E2 techniques as- tion [17]. Prior work has shown that compared with tra- sume that the outcome of using some decision fol- ditional approaches that operate on a single-session ba- lows a static (but unknown) distribution, but applica- sis, data-driven approaches for bitrate and CDN selec- tion QoE often varies across sessions, depending on tion could improve video quality (e.g., 50% less buffer- complex network- and application-specific “contexts” ing time) [19, 25, 40]. Similarly, the QoE of live stream- (e.g., last-mile link, client devices) and over time. ing (e.g., ESPN, twitch.tv) depends on the overlay path We observe an opportunity to address them in a net- between source and edge servers [27]. There could be working context by leveraging the notion of group- room for improvement when these overlay paths are dy- based E2. This is driven by the domain-specific in- namically chosen to cope with workload and quality fluc- sight that network sessions sharing the same network- tuation [32]. and application-level features intuitively will exhibit Internet telephony: Today, VoIP applications (e.g., the same QoE behavior across different possible deci- Hangouts and Skype) use managed relays to optimize sions [25, 24, 19]. This enables us to: (1) decompose the network performance between clients [24]. Prior work global E2 process into separate per-group E2 processes, shows that compared with Anycast-based relay selection, which can then be independently run in geo-distributed a data-driven relay selection algorithm can reduce the clusters (offered by many application providers [33]); number of poor-quality calls (e.g., 42% fewer calls with and (2) reuse well-known E2 algorithms (e.g., [14]) and over 1.2% packet loss) [24, 21]. run them at a coarser per-group granularity. File sharing: File sharing applications (e.g., Dropbox) Building on this insight, we have designed and im- have the flexibility to allow each client to fetch files [18] plemented Pytheas1, a framework for enabling E2- from a chosen server or data center. By using data-driven based data-driven QoE optimization of networked ap- approaches to predict the throughput between a client plications. Our implementation [9] synthesizes and ex- and a server [40, 39, 44], we could potentially improve tends industry-standard data processing platforms (e.g., the QoE for these applications. Spark [10], Kafka [2]). It provides interfaces through Social, search, and web services: Social network ap- which application sessions can send QoE measurement plications try to optimize server selection, so that rele- to update the real-time global view and receive con- vant information (e.g., friends’ feeds) is co-located. Prior trol decisions (e.g., CDN and bitrate selection) made by work shows that optimal caching and server selection Pytheas. We demonstrate the practical benefit of Pytheas can reduce Facebook query time by 50% [37]. Online by using video streaming as a concrete use case. We ex- services (e.g., search) can also benefit from data-driven tended an open source video player [5], and used a trace- techniques. For instance, data-driven edge sever selec- driven evaluation methodology in a CloudLab-based de- tion can reduce search latency by 60% compared to Any- ployment [4]. We show that (1) Pytheas improves video cast, while serving 2 more queries [30]. ⇥ 1Pytheas was an early explorer who is claimed to be the first person Drawing on these use cases, we see that data-driven to record seeing the Midnight Sun. QoE optimization can be applied to a broad class of net- 4000 ther let too many sessions use suboptimal decisions when 3500 3000 quality is stable, or collect insufficient data in presence of 2500 higher variance. 2000 1500 1000 Random data collection Example A: Figure 2a shows a trace-driven evaluation to JoinTime (ms) 500 Optimal highlight such prediction biases.