bëst in test. For adding something on top in Ireland and reaching an overall score of 884 dots in mobile network benchmarking survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480 in Data Services Score 167 out of 200 in Crowdsourced Quality 02 20 Hakan Ekmen Chief Executive Officer Telecommunication Mobile Benchmark Ireland umlaut certifi cate umlaut certifi cate Measurement Overview Measurement setup Drivetest Voice Data Device Samsung Galaxy S9 Samsung Galaxy S9 umlaut tested and measured the performance of its voice and data services on smartphones in comparison to other Test Cases Mobile-to-Mobile (M2M) Data 4G preferred CA Channel1: Side1 (VoLTE) to Side2 (VoLTE) HTTP DL datastream 7s LTE/UMTS/GSM mobile radio networks in metropolitan Channel2: Side1 (VoLTE) to Side2 (VoLTE) HTTP UL datastream 7s and rural areas of Ireland. 115 sec call window HTTP 5MB DL fi xed fi le transfer 70 sec call duration HTTP 2.5MB UL fi xed fi le transfer The audit was done as a performance benchmark performed 15 sec call setup timeout Web Browsing - Kepler ETSI Ref. Page by umlaut between 07.02.2020 – 21.02.2020 in cities and Multi-RAB traff ic injection on both sides 10 Live web pages 3 YouTube HD video ~ 45s towns as well as on connection roads. Dedicated measurements have been executed as drive Mobility and 100% Drivetest tests outdoors using a Samsung Galaxy S9 cat16 Smart- In addition crowdsourced performance data has been Route Types 54% in Cities, 20% in Towns and 26% on Roads phone 1000 Mbit/s Download / 105 Mbit/s Upload. collected and evaluated between CW35 2019 and CW06 Samples ~ 12606 ~ 64572 All data measurements have been performed in 4G 2020. Dates 13 measurement days preferred mode. Voice measurements have been done in The following pages provide a comparative overview 07.02.2020 – 21.02.2020 4G/4G preferred mode on both sides, while call origin has about the performance results observed for the Crowd Data 24 weeks been alternated. different tested service types. Assessment CW35 2019 – CW06 2020 2 3 umlaut certifi cate umlaut certifi cate Testing areas Testing areas Drive route Crowdsourcing based test area Dundalk Drogheda Navah Swords Galway Dublin Limerick 90.0 % of populated areas Non-Urban Waterford 42 % 99.5 % of population measured Cork of populated areas Urban 3100 km 54.166 km2 measuring distance size of tested area 4 5 umlaut certifi cate umlaut certifi cate Claims Best in test Methodology Vodafone Ireland Best in data Vodafone Ireland The leader in mobile benchmarking, umlaut, has analy- zed the mobile networks of Ireland with regards to mobile Best in voice network performance. We measure smartphone voice and data performance based on extensive drivetests – from Vodafone Ireland major metropolitan areas to smaller cities and connection roads. We objectively define the routes and test methodology and publish the results through certificates or public benchmark reports. cedented in its level of detail and enables comparisons As the de-facto industry standard, our benchmarking between the network performance and capability of each Best in crowd- methodology focuses on customer-perceived network mobile network. Our public benchmarks as well as the sourced quality quality and covers a wide range of mobile services. certificate benchmarks help network operators to demon- Today, more than 200 mobile networks in more than strate how well they are delivering wireless connections to Vodafone Ireland 120 countries are being evaluated by our unique scoring consumers, business users and enterprises and reveals the methodology. It allows a technical analysis that is unpre- areas of improvement. 6 7 umlaut certifi cate umlaut certifi cate Score and breakdown Vodafone achieved the highest overall score among competitors with 884 dots out of 1000. Total score Total Score Vodafone Operator 2 Operator 3 1000 Dots Voice max. 320 290 190 147 884 Cities Drivetest 192 90% 60% 42% Towns Drivetest 64 96% 63% 57% Crowd Roads Drivetest 64 86% 53% 49% max. 200 167 691 Data max. 480 427 341 321 614 Cities Drivetest 288 92% 72% 69% 160 Towns Drivetest 96 84% 67% 62% 146 Roads Drivetest 96 84% 70% 65% Data max. 480 Crowdsourced Quality max. 200 167 160 146 Crowd 200 84% 80% 73% 427 Total 1000 884 691 614 341 Shown scores are rounded. Voice 321 max. 320 290 190 147 Shown total scores are rounded. Operator Vodafone Operator 2 Operator 3 Overall score considering Voice, Data and Crowdsourcing. 8 9 umlaut certifi cate umlaut certifi cate Achieved percentage of the maximum score in each of the diff erent data services. Achieved percentage of the maximum score in each of the diff erent crowdsourcing services. Data Service Group max Vodafone Operator 2 Operator 3 Crowd Service Group max Vodafone Operator 2 Operator 3 Web Browsing 64,0 99% 87% 86% Country Operational Excellence 60 100% 97% 100% File Download 80,0 87% 71% 66% Voice Coverage 13 93% 98% 89% Cities File Upload 80,0 93% 80% 73% Data Coverage 17 99% 95% 88% YouTube 64,0 92% 50% 51% Urban 4G Coverage 29 58% 48% 27% Web Browsing 21,3 97% 86% 81% DL Data Speed 17 72% 66% 59% File Download 26,7 79% 66% 63% UL Data Speed 8 58% 64% 52% Towns File Upload 26,7 82% 70% 65% Voice Coverage 7 100% 100% 100% YouTube 21,3 81% 47% 40% Data Coverage 9 100% 100% 99% Non-urban Web Browsing 21,3 95% 83% 82% 4G Coverage 15 87% 79% 58% (Benchmark view) File Download 26,7 85% 72% 69% DL Data Speed 9 64% 64% 46% Roads File Upload 26,7 76% 66% 59% UL Data Speed 4 35% 39% 33% YouTube 21,3 81% 60% 51% Voice Coverage 2 100% 99% 99% Data Coverage 2 100% 100% 99% Non-urban 4G Coverage 4 78% 76% 57% (Own network view) DL Data Speed 2 45% 49% 37% UL Data Speed 1 21% 25% 26% 10 11 umlaut certifi cate umlaut certifi cate Voice KPI overview Data Services KPI overview Achieved values of all networks under test in each of the relevant Voice Key Performance Indicators (KPIs) for the Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical categories “Cities”, “Towns” and “Roads”. geographical category “Cities”. Voice Service Group Unit Vodafone Operator 2 Operator 3 Data Cities KPI Name Unit Vodafone Operator 2 Operator 3 Qualifi er [%] 98,6 97,6 95,2 HTTP Live Page DL Qualifi er [%] 99,9 98,2 97,8 Call Setup Time [s] 2,3 8,3 9,0 Smartphone Overall Session Time [s] 0,9 1,2 1,2 Call Setup Time (P90) [s] 3,0 9,5 11,1 HTTP Static Page DL Qualifi er [%] 100,0 97,9 98,2 Cities Speech Quality (AVG) [MOS-LQO] 3,9 3,6 3,4 Smartphone Overall Session Time [s] 1,0 1,2 1,2 Speech Quality (P10) [MOS-LQO] 3,4 3,2 2,6 Qualifi er [%] 100,0 99,3 99,0 Multirab connectivity [%] 99,7 31,1 73,5 HTTP 5MB DL Average Session Time [s] 1,9 5,6 5,6 Qualifi er [%] 99,7 97,7 97,7 Smartphone 90% faster than [Mbit/s] 12,4 3,1 3,5 Call Setup Time [s] 2,3 7,8 8,8 10% faster than [Mbit/s] 78,9 59,5 50,2 Call Setup Time (P90) [s] 2,8 8,8 10,5 Qualifi er [%] 99,8 99,0 99,0 Towns Speech Quality (AVG) [MOS-LQO] 3,8 3,7 3,5 HTTP 2500KB UL Average Session Time [s] 1,5 2,3 2,8 Speech Quality (P10) [MOS-LQO] 3,3 3,2 2,6 Smartphone 90% faster than [Mbit/s] 8,4 5,3 3,4 Multirab connectivity [%] 100,0 29,8 72,9 10% faster than [Mbit/s] 39,0 26,7 25,8 Qualifi er [%] 97,0 93,3 94,3 Qualifi er [%] 99,8 98,8 97,4 Call Setup Time [s] 2,4 8,0 8,6 Average Data Rate [Mbit/s] 50,5 29,0 27,5 HTTP DL FDTT Call Setup Time (P90) [s] 3,1 9,0 10,4 90% faster than [Mbit/s] 11,7 3,0 3,8 Roads Speech Quality (AVG) [MOS-LQO] 3,7 3,6 3,4 10% faster than [Mbit/s] 100,7 67,2 57,4 Speech Quality (P10) [MOS-LQO] 3,0 3,2 2,3 Qualifi er [%] 99,9 98,8 97,9 Multirab connectivity [%] 99,3 30,4 60,4 Average Data Rate [Mbit/s] 29,9 22,9 17,8 HTTP UL FDTT 90% faster than [Mbit/s] 9,6 5,0 3,4 10% faster than [Mbit/s] 52,2 44,5 29,0 Qualifi er [%] 99,2 91,9 92,6 YouTube Start Time [s] 1,1 1,3 1,3 AVG Resolution [p] 911 880 882 Qualifi er [%] 99,3 93,4 92,8 YouTube Live Start Time [s] 1,1 1,4 1,5 Smartphone AVG Resolution [p] 1030 1005 990 12 13 umlaut certifi cate umlaut certifi cate Data Services KPI Overview Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geo- Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geo- graphical category “Towns”. graphical category “Roads”. Data Towns KPI Name Unit Vodafone Operator 2 Operator 3 Data Roads KPI Name Unit Vodafone Operator 2 Operator 3 HTTP Live Page DL Qualifi er [%] 99,8 98,1 97,7 HTTP Live Page DL Qualifi er [%] 99,3 96,1 96,5 Smartphone Overall Session Time [s] 1,1 1,2 1,4 Smartphone Overall Session Time [s] 1,2 1,3 1,5 HTTP Static Page DL Qualifi er [%] 99,8 97,6 97,4 HTTP Static Page DL Qualifi er [%] 99,2 95,6 96,2 Smartphone Overall Session Time [s] 1,2 1,2 1,5 Smartphone Overall Session Time [s] 1,3 1,4 1,7 Qualifi er [%] 100,0 98,2 98,9 Qualifi er [%] 100,0 96,7 97,7 HTTP 5MB DL Average Session Time [s] 3,2 4,9 8,2 HTTP 5MB DL Average Session Time [s] 4,7 5,7 8,6 Smartphone 90% faster than [Mbit/s] 6,0 3,3 2,0 Smartphone 90% faster than [Mbit/s] 3,9 2,9 1,9 10% faster than [Mbit/s] 61,2 59,6 46,8 10% faster than [Mbit/s] 58,4 59,3 45,4 Qualifi er [%] 99,6 98,2 98,5 Qualifi er [%] 97,5 96,2 95,3 HTTP 2500KB UL Average Session Time [s] 2,7 3,3 3,9 HTTP 2500KB UL Average Session Time [s] 4,0 4,7 5,8 Smartphone 90% faster than [Mbit/s] 3,7 3,3 3,1 Smartphone 90% faster than [Mbit/s] 2,3 1,8 1,3 10% faster than [Mbit/s] 27,7 24,9 23,7 10% faster than [Mbit/s]