Network Analysis of the System

G. Quadrio, A. Bujari, C. E. Palazzi, D. Ronzani D. Maggiorini, L. A. Ripamonti Dipartimento di Matematica Dipartimento di Informatica Università degli Studi di Padova Università degli Studi di Milano Padova, Italy Milano, Italy {abujari, cpalazzi, dronzani}@math.unipd.it {dario, ripamonti}@di.unimi.it

Abstract—The market penetration of in-home entertainment Remote Play for PlayStation 4 in order to answer the systems is playing a crucial role in the diffusion of interactive following questions: multimedia services. In this context, thin-client game systems have received a lot of attention, shifting the computational  What are the network characteristics for Sony Remote burden of the game play toward the server while the client Play ? A first important step is to analyze the packet renders a fat video stream. This paper proposes an analysis of the size, the bitrate and the total amount of the stream to network characteristics of the Remote Play for PlayStation 4 and understand how these services work. PlayStation Vita, providing some insights on the network dynamics of this system under different game types. The  Do the networks characteristics for different games measurements involve video games of different genres, analyzing genres differ from each other ? This information can be the bitrates, the packet size, capturing the dynamics of the whole useful to understand how to eventually manage streaming session. Results indicate that the service generates a different types of games: intuitively, a less eventful large quantity of big packets downstream and smaller and lesser game needs less bandwidth than an action game. packets upstream. Gathered data can help to understand if this type of service could be offered through the today’s normal  Could the quality of the domestic streaming be reached Internet connections. by similar services that operate through the Internet ? Analyze the network characteristics could be Keywords—; Remote play, Network traffic interesting to evaluate if the quality reached by domestic streaming can be replicated through a normal Internet connection. Indeed, not all the countries have I. INTRODUCTION an Internet infrastructure able to handle a large Content producers and providers are rapidly adapting, bandwidth. offering new and interactive service provisioning methods, in order to match the consumer demand. In this context, thin The rest of the paper is organized as follow. In Section II client game systems are attracting much attention [1, 2, 3, 4]. we describe our testbed creation and configuration. Section III This technology enables the user to play with his favorite is dedicated to analyze the outcome of our tests. Finally, in games using only a thin multiplatform client. Such examples Section IV conclusions are drawn. include with its In-Home Streaming for PCs, Sony with its two services, Remote Play for PlayStation 4 and II. EXPERIMENTAL METHODOLOGY AND CONFIGURATION PlayStation Vita and PlayStation Now, OnLive [5, 6]. What commons this services is the underlying idea of shifting the A. Application Selection computational burden of the game play toward a remote In order to provide a thorough analysis, we select four machine, either local inside the WLAN or somewhere in the different games available in the Remote Play platform. The Internet, while the client receives and renders a video stream classification of the games used for the experiments is back to the user. described in [10] and they have been chosen among some of Despite their attractiveness, these types of services did not the most famous genres of the industry: first or third person have a great success when they were launched due to the high shooters, puzzle games, racing games and action games. This costs of the subscriptions and the difficulties caused by the choice is intentional because we wanted to observe the low bandwidth of the Internet connection of the various different behavior of the systems in various conditions. Table I countries [7]. In order to better understand the problems that describes the selected games, indicating the genres and the these companies have encountered, similar services have been graphic complexity. analyzed to classify network traffic and realize what kind of infrastructure is required in order to guarantee a good B. Measurement Testbed experience that could match the one offered by a dedicated Figure 1 describes the measurement testbed for the Sony game machine [8, 9]. Remote Play. The Netgear access point is connected to the Using dedicated tools to measure the network traffic, this Mikrotik access point that is used as a switch. paper tries to understand the network characteristics of Sony TABLE I. PLAYSTATION 4 GAMES FOR SONY REMOTE PLAY It is worth mentioning that the service uses the H.264 General info video codec, which nowadays, is one of the most common PC Games Graphic codec used to transmit video through a network as it provides Abbreviation Game genre complexity a very efficient compression without sacrificing too much The Order: Third Person Very high The Order quality [11]. 1886 Shooter Titan Titan Puzzle Very low Attacks B. Network traffic Driveclub Driveclub Racing High Our measurements show that the Sony Remote Play uses InFamous: UDP transport for both downstream and upstream traffic. This Infamous Action High Second Son is an intuitive choice because a streaming service needs a fast

transmission protocol without the overhead of reliable transmission protocols such as TCP [12, 13, 14, 15]. Table II depicts a comparison of the downstream and upstream bitrate for the four games under consideration. All the titles use similar amount of average bandwidth but we can still observe some differences.

TABLE II. NETWORK TRAFFIC CHARACTERISTICS Games PS4 Collected Data The Order Titan Driveclub Infamous DOWN (Mbps) 7.67 6.88 7.64 8.62 UP (Mbps) 0.044 0.046 0.045 0.044 DOWN (Packets/s) 1055 1013 1058 1160 UP (Packets/s) 72 75 71 72

DOWN AVG. Packet size 909 848 903 930 (Byte) UP AVG. Packet Size 77 78 79 77 (Byte) Fig. 1. Measurement testbed for Sony Remote Play: PlayStation 4 - Firmware v2.04, PlayStation Vita - Firmware v3.36. The trend could be attributed to the streaming technology that Sony Remote Play uses, compressing the video stream for In order to monitor the packet exchange, the whole traffic each game and genre. As an example, Driveclub uses more between PlayStation 4 and PlayStation Vita was replicated to bandwidth than Titan with smaller variations during the one of the Mikrotik ports and a Laptop with Wireshark measurements (Fig. 2 and Fig. 3). Indeed the former has less installed was put into listening. The PlayStation 4 and Laptop static and more complex areas than the later one because the were connected to Mikrotik through a wired connection background of the scenario is constantly moving. Regarding (, 1000 Mbps), the Mikrotik was connected to Netgear the downstream, Driveclub has bigger and more numerous packets as it can be observed in the entries “DOWN through a wired connection (Ethernet, 100 Mbps) and Packets/s” and “DOWN AVG. Packet size (Byte)” in Table II. PlayStation Vita was connected to Netgear with a wireless The other two games indorse the above sentences because they connection (Wi-Fi 802.11n, 300 Mbps). exhibit a more static scene play.

Different considerations come into play in the upstream III. ANALYSIS traffic. All the considered games use very similar small bandwidth to transmit the input commands from PSVita to A. Streaming services characteristics PS4, denoting a regular behavior despite the different genres. The console was configured with a native rendering The confirmation is given by the number and size of the resolution of a maximum of 1920×1080 pixels, and a packets that are similar for each game. A realistic hypothesis streaming rendering resolution fixed at 960×544 pixels, which that could explain this is that the upstream packets are sent depends on the Playstation Vita. No streaming quality settings with certain regularity despite whether there was a real input were applied although we set a capture frame rate limit of 30 or not. fps. IV. CONCLUSIONS Multimedia interactive services have evolved to become a potential key player in the game market. In our work, we analyzed the Sony Remote Play in-home entertainment system where the game play is enjoyed through a thin, multiplatform console with a video stream fed from a local controller. From the measurements we saw that the service exhibits slightly different behavior in downstream depending on the game genre under consideration. The use of the H.264 video codec plays an important role in this regard. Concerning the upstream traffic, fewer variations occur between the games, evidence that the game system transmits a constant stream of packets despite the fact that there is no real input entered by the user.

Considering the average bandwidth that an enjoyable Fig. 2. Downstream and Upstream flow for the game Titan gaming experience requires, providing a similar service through the Internet seems a challenge. This is due to the low average home access bandwidth and, of course, to the high costs of the infrastructure required. It follows that, for the moment, the game streaming services could not be a sustainable solution that can substitute the dedicated game devices as consoles and PCs.

ACKNOWLEDGMENT This work has been partially funded by the Università degli Studi di Padova, through the projects PRAT CPDA137314 and PRAT CPDA151221.

REFERENCES [1] F. Biscotti, B. Blau, J.-D. Lovelock, T. H. Nguyen, J. Erensen, S. Verma, and V. Liu, “Market trends: Gaming ecosystem,” Gartner, Inc., 2011 [2] A. Bujari, M. Massaro, C. E. Palazzi, “Vegas over Access Point: Making Room for Thin Client Game Systems in a Wireless Home”, IEEE Fig. 3. Downstream and Upstream flow for the game Driveclub Transactions on Circuits and Systems for Video Technology, 99, Jun 2015. [3] M.Furini, “Mobile Games: What to Expect in the Near Future”, in Proc. C. Considerations on the service replication on the Internet of GAMEON Conference on Simulation and AI in Computer Games, After providing some evidence regarding the traffic Bologna, Italy. Nov 2007. patterns exhibited by the different game genres, we question [4] M.Furini, “An Architecture to Easily Produce Adventure and Movie whether it is feasible to replicate these services in the Internet, Games for the Mobile Scenario'', ACM Computers in Entertainment 6(2), Jul 2008. while guaranteeing the same gaming experience. From the [5] PlayStation support – PS4 Remote Play - measurements it is shown that on average 6Mbps are required. https://www.playstation.com/en-gb/explore/ps4/features/remote-play/ While these services are capable of adapting the video bitrate [6] "November: One Sales on the Rise" - . Retrieved 12 to the perceived network conditions, gaming quality could November 2014 deteriorate. [7] Martyn Williams, “OnLive crushed by high infrastructure bills” – 2012, Indeed, considering the study realized by Akamai [16] the Computerworld average broadband access speed is about 3.9 Mbps, with a [8] M. Claypool, D. Finkel, A. Grant, M. Solano, “Thin to Win? Network Performance Analysis of the OnLive Thin Client Game System”, in maximum value of 25.3 Mbps for South Korea. Moreover, Proc. of the ACM Annual Workshop on Network Games (NetGames), another problem arises and it concerns the network congestion Venice, Italy, Nov 2012 [17, 18, 19, 20]. Dedicated and specialized infrastructure is [9] Y.-C. Chang, P.-H. Tseng, K.-T. Chen, and C.-L. Lei, “Understanding required to address this; however it comes at a cost. An the Performance of Thin-Client Gaming,” in Proc. of IEEE CQR, May important example in this regard comes from the OnLive 2011. service where the company encountered a very difficult [10] Wendy Despain, “Writing for video games genres: from FPS to RPG” - moment due to the high cost of the server infrastructure [7]. 2009, A K Peters/CRC Press [11] ITU – Telecommunication standardization sector, “Advanced video coding for generic audiovisual services” – 02/2014 [12] M. Suznjevic, J. Saldaña, M. Matijasevic, J. Fernández-Navajas, J. Ruíz- [16] Akamai, “State of the Internet” – 2014, Akamai, Mas, “Analyzing the Effect of TCP and Server Population on Massively http://www.akamai.com/stateoftheinternet/ Multiplayer Games”, Int. J. Computer Games Technology, Jan 2014. [17] M. Gerla, D. Maggiorini, C. E. Palazzi, A. Bujari, “A Survey on [13] J. M. Saldaña, G. Marfia, M. Roccetti, “Satisfying the Hunger for Interactive Games over Mobile Networks”, Wireless Communications Mobile Online Games: Providing Quality Time in Vehicular Scenarios”, and Mobile Computing 13 (3), Feb 2013, pp. 212-229. in Proc. of ACM NetGames 2012, Venice, Ital, Nov 2012. [18] D. Maggiorini, C. Quadri, L.A. Ripamonti, “Opportunistic Mobile [14] J. Saldaña, G. Marfia, M. Roccetti, “Everything You Always Wanted to Games Using Public Transportation Systems: A Deployability Study”, Know about Playing a FPS Game on a Car”, in Proc. IEEE Multimedia Systems 20 (5), Oct 2014, pp. 545-562. BlackSeaCom 2014, Odessa, Ukraine, May 2014. [19] G. Marfia, M. Roccetti, “TCP at Last: Reconsidering TCP's Role for [15] C. E. Palazzi, S. Ferretti, M. Roccetti, G. Pau, M. Gerla, “What’s in that Wireless Entertainment Centers at Home”, IEEE Transactions on Magic Box? The Home Entertainment Center's Special Protocol Potion, Consumer Electronics 56 (4), Nov 2010, pp. 2233-2240. Revealed”, IEEE Transactions on Consumer Electronics, 52 (4), Nov [20] C. E. Palazzi, A. Bujari, S. Mirri, “Reducing Queuing Delays Through 2006, pp. 1280-1288. VoAP”, in Proc. of ICNC 2016, Kauai, HI, USA, Feb 2016. [21] A. Bujari, S. Gaito, D. Maggiorini, C. E. Palazzi, C. Quadri, “Delay [36] C. E. Palazzi, S. Ferretti, M. Roccetti, “Communities on the Road: Fast Tolerant Networking over the Metropolitan Public Transportation”, Triggering of Interactive Multimedia Services”, Multimedia Tools and Mobile Information Systems, Vol. 2016, May 2016. Applications, Springer, vol. 44, no. 2, settembre 2009, 229-247. [22] W. B. Jaballah, M. Conti, M. Mosbah, C. E. Palazzi, “A Secure Alert [37] C. E. Palazzi, S. Ferretti, M. Roccetti “Smart Access Points on the Road Messaging System for Safe Driving”, Elsevier Computer for Online Gaming in Vehicular Networks”, Entertainment Computing, Communications, vol. 46, no. 15, Jun 2014 29–42. Elsevier, vol. 1, no. 1, gennaio 2009, 17-26. [23] W. Ben Jaballah, M. Conti, M. Mosbah, C. E. Palazzi, “Fast and Secure [38] S. Ferretti, M. Roccetti, C. E. Palazzi, “Web Content Search and Multi-hop Broadcast Solutions for Inter-Vehicular Communication”, Adaptation for IDTV: One Step Forward in the Mediamorphosis Process IEEE Transactions on Intelligent Transportation Systems, vol. 15, no. 1, toward Personal-TV”, Advances in Multimedia, Hindawi Publishing gennaio 2014, 433-450. Corporation, aprile 2007. [24] L. De Giovanni, C. E. Palazzi, “Optimal Client-Server Configuration of [39] C. E. Palazzi, S. Ferretti, S. Cacciaguerra, M. Roccetti, “Interactivity- Mobile Ad-Hoc Networks”, Elsevier Electronic Notes in Discrete Loss Avoidance in Event Delivery Synchronization for Mirrored Game Mathematics, vol. 41, no. 5, giugno 2013, 495-502. Architectures”, IEEE Transactions on Multimedia, vol. 8, no. 4, agosto [25] M. Gerla, D. Maggiorini, C. E. Palazzi, “Mobile communications and 2006, 874-879. computing in challenged environments: Models, protocols, [40] C. E. Palazzi, S. Ferretti, S. Cacciaguerra, M. Roccetti, “A RIO-like applications”, Wiley Wireless Communications and Mobile Computing, Technique for Interactivity Loss Avoidance in Fast-Paced Multiplayer vol. 13 no. 3, febbraio 2013, 211. Online Games”, ACM Computers in Entertainment, vol.3, no.2, aprile [26] A. Bujari, C. E. Palazzi, M. Roccetti, G. Marfia, “DTN Content Sharing 2005. among Commuters”, International Journal of Satellite Communications [41] S. Mirri, P. Salomoni, A. Pizzinelli, M. Roccetti, C. E. Palazzi, “di Piazza Policy and Management, Inderscience Pub., vol. 1, no. 2/3, ottobre 2012. in Piazza: Reimagining Cultural Specific Interactions for People- [27] C. E. Palazzi, A. Bujari, “Social-Aware Delay Tolerant Networking for Centered Exhibitions”, in Proc. of IEEE International Conference on Mobile-to-Mobile File Sharing”, Wiley International Journal of Computing, Networking and Communications (ICNC 2016), Kauai, HI, Communication Systems (IJCS) - Special Issue on Interdisciplinary and USA, Feb 2016. Cross-layer Design of Mobile Social Networks and Wireless Networks, [42] D. Maggiorini, L. A. Ripamonti, E. Zanon, C. E. Palazzi, A. Bujari vol. 25, no 10, (versione online DOI: 10.1002/dac.1324, agosto 2011), “SMASH: A Distributed Game Engine Architecture”, in Proc. of the ottobre 2012. 21st IEEE Symposium on Computers and Communication (ISCC 2016), [28] C. E. Palazzi, G. Marfia, M. Roccetti, “From Fun Technology to Serious Messina, Italy, Jun 2016. Applications: Lessons from a Few Exemplar Cases”, ACM Computers [43] G. Quadrio, A. Bujari, C. E. Palazzi, D. Ronzani, D. Maggiorini, L. A. in Entertainment interactive, ACM, maggio 2012. Ripamonti, “Network Analysis of the Sony Remote Play System”, in [29] C. E. Palazzi, F. Pezzoni, P. M. Ruiz, “Delay-Bounded Data Gathering in Proc. of the 21st IEEE Symposium on Computers and Communication Urban Vehicular Sensor Networks”, Elsevier Journal of Pervasive and (ISCC 2016), Messina, Italy, Jun 2016. Mobile Computing, - Special Issue on Vehicular Sensor Networks and [44] A. Marin, S. Rossi, A. Bujari, C. E. Palazzi, “Performance Evaluation of Mobile Sensing over Wide-Scale Deployment Environments, Elsevier, AQM Techniques with Heterogeneous Traffic” in Proc. of 13th IEEE vol. 8, no. 2, aprile 2012, 180-193. Consumer Communications & Networking Conference (CCNC 2016), [30] A. Amoroso, G. Marfia, M. Roccetti, C. E. Palazzi, “On the Comparison Las Vegas, NV, USA, Jan 2016. of Two Vehicular Safety Systems in Realistic Highway Scenarios”, [45] C. E. Palazzi, A. Bujari, “Fostering Accessible Urban Mobility through Journal of Transportation Technologies, Scientific Research Publishing, Smart Mobile Applications”, in Proc. of 13th IEEE Consumer vol. 1, no. 3, luglio 2011, 58-65. Communications & Networking Conference (CCNC 2016), Las Vegas, [31] M. Roccetti, G. Marfia, C. E. Palazzi, “Entertainment beyond NV, USA, Jan 2016. Divertissement: Using Computer Games for City Roads Accessibility”, [46] M. Pozza, C. E. Palazzi, A. Bujari, “Mobile Data Offloading: An ACM Computers in Entertainment, ACM, vol. 9 no. 2, luglio 2011. Experimental Evaluation”, in Proc. of the 10th ACM Workshop on [32] C. E. Palazzi, M. Roccetti, G. Marfia, “Realizing the Unexploited Mobility in the Evolving Internet Architecture (MobiArch 2015), ACM Potential of Games on Serious Challenges”, ACM Computers in MobiCom 2015, Parigi, Francia, Sep 2015. Entertainment, ACM, vol. 8, no. 4, dicembre 2010. [47] M. Pozza, C. E. Palazzi, A. Bujari, “Mobile Data Offloading Testbed”, in [33] G. Marfia, C. E. Palazzi, G. Pau, M. Gerla, M. Roccetti, “TCP Libra: Proc. of the 21st ACM Annual International Conference on Mobile Derivation, Analysis and Comparison with Other RTT-Fair TCPs”, Computing and Networking (MobiCom 2015), Parigi, Francia, Sep Computer Networks, Elsevier, Vol. 54, N. 14, ottobre 2010, 2327-2344. 2015. [34] S. Ferretti, M. Furini, C. E. Palazzi, M. Roccetti, P. Salomoni, “WWW [48] A. Bujari, M. Ciman, O. Gaggi, G. Marfia, C. E. Palazzi, “PathS: Recycling for a Better World”, Communications of the ACM, ACM, Enhancing Geographical Maps with Environmental Sensed Data”, in vol. 53, no. 4, aprile 2010. Proc. of ACM MobileHealth 2015/MobiHoc 2015, Hangzhou, China, Jun 2015. [35] C. E. Palazzi, M. Roccetti, S. Ferretti, “An Inter-Vehicular Communication Architecture for Safety and Entertainment”, IEEE [49] M. Pozza, C. E. Palazzi, A. Bujari, “BlueFall: Testing Swarming Transactions on Intelligent Transportation Systems, vol.11, no. 11, Protocols through Mobile Phones”, in Proc. of International Conference marzo 2010. on Computing, Networking and Communications (ICNC 2015), Anaheim, CA, USA, Feb 2015.