<<

bëst in test.

For adding something on top in and reaching an overall score of 859 dots in mobile network benchmarking survey we proudly award this certificate to

Vodafone Ireland

Score 859 out of 1000 in Total Score 276 out of 320 in Voice Services Score 423 out of 480 in Data Services Score 160 out of 200 in Crowdsourced Quality

Hakan Ekmen Chief Executive Officer umlaut certifi cate umlaut certifi cate

Measurement Overview Measurement setup

Drivetest Voice Data

Samsung Galaxy S10 (Car 1) and Device Samsung Galaxy S20+ umlaut tested and measured the performance of its voice Samsung Galaxy S20+ 5G (Car 2 + WT) and data services on smartphones in comparison to other Test Cases Mobile-to-Mobile (M2M) Data 4G (Car 1) & 5G preferred CA (Car 2 & WT) Side1 (VoLTE) to Side2 (VoLTE) HTTP DL datastream 7s LTE/UMTS/GSM mobile radio networks in metropolitan 115 sec call window HTTP UL datastream 7s and rural areas of Ireland. 70 sec call duration HTTP 5MB DL fi xed fi le transfer 15 sec call setup timeout HTTP 2.5MB UL fi xed fi le transfer The audit was done as a performance benchmark performed Multi-RAB traff ic injection on both sides Web Browsing - Kepler ETSI Ref. Page by umlaut between 02.03.2021 and 16.03.2021 in cities and 10 Live web pages 3 YouTube HD video ~ 45s towns as well as on connection roads. Mobility and Drivetest & Walktest Dedicated measurements have been executed as drive Route Types 58% in Cities, 16% in Towns and 26% on Roads tests outdoors using a Samsung Galaxy S10 4G and a In addition crowdsourced performance data has been Samples ~ 13560 ~ 129,994 Samsung Galaxy S20+ 5G Smartphone. collected and evaluated between CW39 2020 and CW09 Dates 13 measurement days All data measurements have been performed in 5G 2021. 02.03.2021 – 16.03.2021 preferred mode. Voice measurements have been done in The following pages provide a comparative overview Crowd Data 24 weeks 4G/4G preferred mode on both sides, while call origin has about the performance results observed for the Assessment CW39 2020 – CW09 2021 been alternated. different tested service types.

2 3 umlaut certifi cate umlaut certifi cate

Testing areas Drive route Crowdsourcing based test area

Swords Galway Malahide

94.6 % of the ‘build-up area’ covered

3102 km 97.6 % measuring distance of the ‘Population area’ covered Cork Drivetest 2 41 % Walktest 56.315 km of population measured Roads size of tested area

4 5 umlaut certifi cate umlaut certifi cate

Claims Best in test Methodology Ireland

Best in data

The leader in mobile benchmarking, umlaut, has analy- zed the mobile networks of Ireland with regards to mobile network performance. We measure smartphone voice and data performance based on extensive drivetests – from major metropolitan areas to smaller cities and connection Best in voice roads. We measure smartphone voice and data performance Vodafone Ireland based on extensive drive-tests – from major metropoli- tan areas to smaller cities and roads, complemented by Today, more than 200 mobile networks in more than walk-tests in big cities with special focus on busy areas, 120 countries are being evaluated by our unique scoring on public transport and in frequently visited buildings, like methodology. It allows a technical analysis that is unpre- shopping malls, main station, etc. cedented in its level of detail and enables comparisons We objectively define the routes and test methodology between the network performance and capability of each Best in crowd- and publish the results through certificates or public mobile network. Our public benchmarks as well as the sourced quality benchmark reports. certificate benchmarks help network operators to demon- As the de-facto industry standard, our benchmarking strate how well they are delivering wireless connections to Vodafone Ireland methodology focuses on customer-perceived network consumers, business users and enterprises and reveals the quality and covers a wide range of mobile services. areas of improvement.

6 7 umlaut certifi cate umlaut certifi cate

Score and breakdown

Vodafone achieved the highest overall score among competitors with 859 dots out of 1000.

Total score

Total Score Vodafone Three 1000 Dots Voice max. 320 276 159 168 859 Cities Drivetest 144 90% 43% 56% Cities Walktest 48 97% 57% 85% Crowd max. 200 704 699 Towns Drivetest 64 78% 51% 42% 160 Roads Drivetest 64 77% 58% 31% Data max. 480 423 393 380 152 151 Cities Drivetest 216 89% 84% 82%

Data Cities Walktest 72 95% 88% 85% max. 480 Towns Drivetest 96 90% 83% 78% Roads Drivetest 96 80% 70% 69% 423 Crowdsourced Quality max. 200 160 152 151 Broadband Coverage 100 83% 81% 76% Voice 393 380 max. 320 Download Speed 60 71% 69% 67% Latency 40 87% 73% 87% 276 159 168 Total 1000 859 704 699 Shown total scores are rounded. Operator Vodafone Three Eir Shown scores are rounded.

Overall score considering Voice, Data and Crowdsourcing.

8 9 umlaut certifi cate umlaut certifi cate

Achieved percentage of the maximum score in each of the different data services. Achieved percentage of the maximum score in each of the different crowdsourcing services.

Data Service Group max Vodafone Three Eir Crowd Service Group max Vodafone Three Eir Web Browsing 54,0 97% 94% 92% Broadband Coverage 100 83% 81% 76% Crowdsourced File Download 54,0 85% 86% 85% DL Speed 60 71% 69% 67% Cities Quality Drivetest File Upload 54,0 86% 77% 78% Latency 40 87% 73% 87% YouTube 54,0 87% 80% 74% Web Browsing 18,0 96% 96% 92%

Cities File Download 18,0 95% 92% 82% Walktest File Upload 18,0 94% 84% 75% YouTube 18,0 95% 81% 91% Web Browsing 24,0 97% 95% 91%

Towns File Download 24,0 82% 82% 78% Drivetest File Upload 24,0 88% 77% 79% YouTube 24,0 93% 77% 62% Web Browsing 24,0 94% 87% 83%

Roads File Download 24,0 78% 75% 70% Drivetest File Upload 24,0 77% 64% 71% YouTube 24,0 70% 55% 51%

10 11 umlaut certifi cate umlaut certifi cate

Voice KPI overview Data Services KPI overview Achieved values of all networks under test in each of the relevant Voice Key Performance Indicators (KPIs) for the Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical categories “Cities”, “Towns” and “Roads”. geographical category “Cities”.

Voice Service Group Unit Vodafone Three Eir Data Cities Drivetest KPI Name Unit Vodafone Three Eir

Qualifi er [%] 98,7 94,9 93,6 HTTP Live Page DL Qualifi er [%] 99,8 99,3 99,0 Call Setup Time [s] 2,5 7,0 2,2 Smartphone Overall Session Time [s] 1,0 1,0 1,1

Cities Call Setup Time (P90) [s] 3,0 8,5 2,9 HTTP Static Page DL Qualifi er [%] 99,9 99,7 99,4 Drivetest Speech Quality (AVG) [MOS-LQO] 4,6 3,9 3,8 Smartphone Overall Session Time [s] 1,2 1,2 1,2 Speech Quality (P10) [MOS-LQO] 4,4 3,5 2,9 Qualifi er [%] 99,9 100,0 99,6

Multirab connectivity [%] 99,9 63,3 98,0 HTTP 5MB DL Average Session Time [s] 2,3 2,8 2,5 Qualifi er [%] 99,8 97,2 98,1 Smartphone 90% faster than [Mbit/s] 11,7 7,8 8,1 Call Setup Time [s] 2,5 6,7 2,1 10% faster than [Mbit/s] 95,5 138,6 148,4

Cities Call Setup Time (P90) [s] 2,8 7,9 2,8 Qualifi er [%] 100,0 99,7 99,3 Walktest Speech Quality (AVG) [MOS-LQO] 4,7 3,9 4,0 HTTP 2500KB UL Average Session Time [s] 1,7 3,2 2,5 Speech Quality (P10) [MOS-LQO] 4,7 3,6 3,4 Smartphone 90% faster than [Mbit/s] 6,6 2,9 4,6 Multirab connectivity [%] 100,0 43,2 99,8 10% faster than [Mbit/s] 36,5 29,2 33,2 Qualifi er [%] 97,8 96,4 88,7 Qualifi er [%] 100,0 99,5 99,7 Call Setup Time [s] 2,9 6,8 2,0 Average Data Rate [Mbit/s] 75,8 159,1 129,6 HTTP DL FDTT Towns Call Setup Time (P90) [s] 5,0 7,8 2,8 90% faster than [Mbit/s] 13,1 8,8 9,5 Drivetest Speech Quality (AVG) [MOS-LQO] 4,5 3,9 3,8 10% faster than [Mbit/s] 144,6 447,2 360,8 Speech Quality (P10) [MOS-LQO] 3,8 3,4 2,9 Qualifi er [%] 99,7 99,1 98,8 Multirab connectivity [%] 99,6 58,0 98,8 Average Data Rate [Mbit/s] 30,0 25,8 26,4 HTTP UL FDTT Qualifi er [%] 96,4 95,8 84,0 90% faster than [Mbit/s] 7,5 4,3 5,6 Call Setup Time [s] 3,1 7,0 2,5 10% faster than [Mbit/s] 51,9 53,7 51,8

Roads Call Setup Time (P90) [s] 5,4 8,4 4,3 Qualifi er [%] 98,6 97,7 96,3 Drivetest Speech Quality (AVG) [MOS-LQO] 4,4 3,9 3,6 YouTube Start Time [s] 1,1 1,1 1,2 Speech Quality (P10) [MOS-LQO] 3,6 3,4 2,5 AVG Resolution [p] 918 907 911 Multirab connectivity [%] 99,5 66,5 89,4 Qualifi er [%] 97,8 96,5 96,0 YouTube Live Start Time [s] 1,1 1,1 1,2 Smartphone AVG Resolution [p] 1036 1024 1020

12 13 umlaut certifi cate umlaut certifi cate

Data Services KPI Overview Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geo- Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geo- graphical category “Cities”. graphical category “Towns”.

Data Cities Walktest KPI Name Unit Vodafone Three Eir Data Towns Drivetest KPI Name Unit Vodafone Three Eir

HTTP Live Page DL Qualifi er [%] 99,8 99,5 99,0 HTTP Live Page DL Qualifi er [%] 99,9 99,6 98,9 Smartphone Overall Session Time [s] 0,9 0,9 1,2 Smartphone Overall Session Time [s] 0,9 1,1 1,1

HTTP Static Page DL Qualifi er [%] 99,6 100,0 99,6 HTTP Static Page DL Qualifi er [%] 99,6 99,8 99,1 Smartphone Overall Session Time [s] 1,2 1,0 1,1 Smartphone Overall Session Time [s] 1,2 1,2 1,2 Qualifi er [%] 100,0 99,2 99,2 Qualifi er [%] 99,6 99,6 99,6

HTTP 5MB DL Average Session Time [s] 1,2 1,9 2,7 HTTP 5MB DL Average Session Time [s] 2,1 3,5 3,9 Smartphone 90% faster than [Mbit/s] 24,3 15,2 7,4 Smartphone 90% faster than [Mbit/s] 12,3 5,9 3,8 10% faster than [Mbit/s] 178,4 185,2 195,5 10% faster than [Mbit/s] 79,5 103,1 138,8 Qualifi er [%] 100,0 100,0 100,0 Qualifi er [%] 100,0 100,0 99,6

HTTP 2500KB UL Average Session Time [s] 1,9 2,3 6,0 HTTP 2500KB UL Average Session Time [s] 1,5 3,1 2,1 Smartphone 90% faster than [Mbit/s] 12,9 5,1 1,0 Smartphone 90% faster than [Mbit/s] 9,7 4,1 5,7 10% faster than [Mbit/s] 50,1 32,9 42,0 10% faster than [Mbit/s] 33,8 27,5 33,3 Qualifi er [%] 100,0 100,0 99,2 Qualifi er [%] 99,6 100,0 98,9 Average Data Rate [Mbit/s] 192,9 319,6 249,8 Average Data Rate [Mbit/s] 61,6 97,6 112,2 HTTP DL FDTT HTTP DL FDTT 90% faster than [Mbit/s] 20,6 23,9 6,8 90% faster than [Mbit/s] 12,2 7,1 4,7 10% faster than [Mbit/s] 579,9 649,1 631,4 10% faster than [Mbit/s] 108,3 224,7 271,1 Qualifi er [%] 99,6 99,2 98,8 Qualifi er [%] 99,6 98,9 98,5 Average Data Rate [Mbit/s] 51,5 43,5 36,0 Average Data Rate [Mbit/s] 28,2 22,4 26,2 HTTP UL FDTT HTTP UL FDTT 90% faster than [Mbit/s] 14,8 5,7 3,0 90% faster than [Mbit/s] 10,8 4,6 6,5 10% faster than [Mbit/s] 111,6 94,1 72,7 10% faster than [Mbit/s] 48,1 42,3 52,1 Qualifi er [%] 100,0 97,1 99,2 Qualifi er [%] 99,3 96,7 93,7 YouTube Start Time [s] 1,0 1,0 1,1 YouTube Start Time [s] 1,1 1,3 1,3 AVG Resolution [p] 890 916 920 AVG Resolution [p] 919 908 892 Qualifi er [%] 100,0 97,3 99,1 Qualifi er [%] 100,0 97,1 95,3 YouTube Live YouTube Live Start Time [s] 1,1 1,0 1,5 Start Time [s] 1,1 1,3 1,3 Smartphone Smartphone AVG Resolution [p] 1005 1040 1033 AVG Resolution [p] 1037 1029 1011

14 15 umlaut certifi cate umlaut certifi cate

Data Services KPI Overview Crowd KPI overview Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geo- Achieved values of all networks under test in each of the relevant Crowd Key Performance Indicators (KPIs) for the graphical category “Roads”. categories “Broadband Coverage”, “Download Speed” and “Latency”.

Data Roads Drivetest KPI Name Unit Vodafone Three Eir Crowdsourced Quality KPI name Unit Vodafone Three Eir

HTTP Live Page DL Qualifi er [%] 99,5 97,7 96,8 Coverage Excellence [%] 68,8 63,4 45,8 Broadband Coverage Smartphone Overall Session Time [s] 1,3 1,5 1,7 Time on broadband [%] 82,7 81,0 82,8

HTTP Static Page DL Qualifi er [%] 99,0 97,6 98,1 Basic class [%] 88,3 86,9 86,9 Smartphone Overall Session Time [s] 1,5 1,7 1,7 Download Speed HD video class [%] 59,3 59,1 57,6 Qualifi er [%] 99,6 98,8 98,6 UHD video class [%] 13,1 12,8 10,5

HTTP 5MB DL Average Session Time [s] 5,3 7,3 8,7 Gaming class [%] 81,8 52,2 90,1 Latency Smartphone 90% faster than [Mbit/s] 3,3 2,0 1,7 OTT voice class [%] 95,5 93,1 94,7 10% faster than [Mbit/s] 66,9 88,5 79,0 Qualifi er [%] 99,6 97,2 97,7

HTTP 2500KB UL Average Session Time [s] 3,8 6,3 4,5 Smartphone 90% faster than [Mbit/s] 2,3 1,2 2,3 10% faster than [Mbit/s] 26,6 21,9 24,4 Qualifi er [%] 99,6 98,7 98,5 Average Data Rate [Mbit/s] 36,0 60,0 41,8 HTTP DL FDTT 90% faster than [Mbit/s] 3,4 2,7 1,9 10% faster than [Mbit/s] 87,0 149,6 125,6 Qualifi er [%] 97,5 94,1 96,5 Average Data Rate [Mbit/s] 15,5 14,1 14,7 HTTP UL FDTT 90% faster than [Mbit/s] 2,7 1,4 2,2 10% faster than [Mbit/s] 34,0 35,8 30,9 Qualifi er [%] 92,5 88,4 87,0 YouTube Start Time [s] 1,5 1,5 1,8 AVG Resolution [p] 894 887 868 Qualifi er [%] 92,3 86,5 86,7 YouTube Live Start Time [s] 1,5 1,6 1,8 Smartphone AVG Resolution [p] 1007 993 957

16 17 umlaut SE Am Kraftversorgungsturm 3 · 52070 Aachen · Germany

Hakan Ekmen · Chief Executive Officer Telecommunication cell +49 151 571 33 235 · [email protected] www.umlaut.com