IPTV and Web-TV

IN foCus | REVIEW: IPTV And Web-TV

treaming is all the rage. Offers Vimeo or social media giant Facebook We focused not only on picture and from Netflix, Amazon Prime are also using video content to try to sound quality, but also on other Sor Zattoo compete on at least woo viewers. practical aspects such as startup, res an equal footing with classic TV and ponse and switching times. video content to attract users. Conven Quality under Cable-based offers such as Giga TV tional, linear TV broadcasts can also the microscope from Vodafone or the comparable ser be received via a DSL or cable internet What video is particularly interested vices from Unitymedia were not inclu connection, and thus constitutes a in is the quality of these offerings – in ded in the test. This was due to a tech fourth option alongside cable, satellite terms of both content and technology. nical reason; TV reception for these and antenna. Combined formats such Therefore, we have once again joined products is based on DVB-C, not on as pay television streaming as part of a forces with the network test specialist the internet protocol (IP), which is “Sky Ticket” or watching classic zafaco this year and put the relevant what the measurement method used TV channels using services like services under the microscope. Over a here concentrates on. Zattoo play with the new possibilities four-week period, zafaco’s measure But now it’s time to draw the cur and are breaking down old bounda ment systems recorded and analysed tains and reveal our extensive compa ries. And as if all this weren’t enough, more than 1.1 million measurements rative test of IPTV and web TV offers. internet services such as YouTube, for the 14 products covered by the test. Some of the results may surprise you.

Telekom EntertainTV Test rating: very good Price/performance: very good 89% IPTV EntertainTV is already Telekom’s se provided the copyright holder allows Excellent picture quality; Germany- cond IPTV platform – this current this). The “Media Receiver MR401” user-friendly features; wide version has been available since May has a clear interface and allows remote extensive range of content 2016. It can be added as an optional programming of recordings via the Additional functions only service to DSL and VDSL lines for an app as well as access to YouTube and available with more expensive EntertainTV Plus additional price starting at 5 euros/ Netflix. An additional MR200 re month. The basic package comes with ceiver can be used in a second room. more than 100 TV channels, around The measurements taken from the 20 of which are in HD. If you pay Telekom service are also impressive. In

another 5 euros/month, you get additio addition to excellent picture quality, WINNER TEST nal HD channels and useful functions the Telekom receiver boasts very good such as “Restart” (restarting a running starting and zapping times in all the programme from the beginning) or tested scenarios: with and without “Replay” (playing back a missed pro additional load on the line or receiving EntertainTV uses IPTV options – such as the gramme within a 7-day window, two IPTV streams. restart of programmes that are already running.

Vodafone TV Test rating: very good Price/performance: good 83% IPTV STREAMING Currently Vodafone only offers the already configured to receive 4K in Germany- Excellent picture quality, power- technically more modern “Giga TV” the future. It also provides access to ful set-top box with additional wide to its cable customers. For receiving many broadcasters’ media centres, as satellite reception and ready for 4K per (V)DSL, “Vodafone TV” has been well as video-on-demand services. UHD not activated yet; available since 2011. But even this If you wish, you can even run two slightly higher error rates in the test PROVIDERS service still has a lot to offer: For an TV Center 2000s on two televisions additional 8.99 euros/month, it allows simultaneously. Thanks to video streaming via IP data packets, the amount of available entertainment content is viewing of more than 90 TV channels, The test showed that Vodafone TV up to 37 of which are in HD. also has excellent picture quality and continuously on the rise. Classic TV broadcasters using IPTV and network-based services like Netflix, Other pay TV, HD and foreign very short starting and zapping times language packages are available as – although additional downloads, Amazon Prime Video or Sky Ticket are competing with video content on YouTube, Vimeo, Facebook etc. to optional extras. The “TV Center calls or two IPTV streams place a load 2000” IPTV receiver provides so on the line. A small fly in the oint attract viewers. We put the quality of the providers’ technology and content to the test. By Hannes Ruegheimer mething out of the ordinary: It can ment, however, is the slightly higher The Düsseldorf-based company offers the slightly also receive digital satellite TV and is error rates measured in the test. outdated “Vodafone TV” for DSL from 16 MBit/s up.

40 Pictures: zafaco; Screenshots: Hannes Ruegheimer www.technite.video | 12_2018 41 IN foCus | REVIEW: IPTV And Web-TV

1&1 Digital TV Test rating: satisfactory M-net TV Plus Test rating: satisfactory Price/performance: satisfactory 64% Price/performance: satisfactory 64% IPTV IPTV Germany- 1&1 provides new customers with a possible to use a parallel Sky subscrip Very good picture quality overall; The Munich-based provider opera are also available. This offering is Very good picture quality overall; ex- regional wide completely new IPTV offering based tion via IPTV. state-of-the-art service; tes in the Bavarian state capital, in also based on the B2B platform tensive HD offering; numerous func- on the B2B platform from Swiss The measurement results show that can be used on many devices and around Ulm, in other regions of from Zattoo and can be received tions; can be used on many devices streaming specialist Zattoo. Existing the new platform has room for Worse picture quality than Bavaria and the Main/Kinzig via the “TVplus-Box”, AppleTV, Long startup times on the set-top customers can switch, but must improvement – in picture quality, predecessor; slow zapping district in the state of Hesse. The FireTV as well as on a tablet or box; slow zapping times; higher times; high error rates error rates then book a new VDSL tariff. switching and response times as well “TV plus” service can be added to the smartphone. 50 Mbit/s are a prerequisite. Then as error rates. As zafaco still has con provider’s VDSL and fibre-optic lines The results here are also mixed: you can get “Digital TV” for nections for the old “1&1 Digital TV for 9.90 euros/month. The basic The picture quality is rated 9.99 euros/month with around – provided by Telekom” we also package comes with around “very good” and achieves the same 90 TV channels, about 20 of which evaluated these outside the competi 100 channels, about 40 of which are level as the other Zattoo B2B-based are in HD. In addition to the tion framework. As the table on the provided in HD. An additional HD candidates 1&1, NetCologne and “1&1 TV-Box”, it is also possible to page opposite shows, the old product package for 4.90 euros/month EWE. But similarly, the startup receive via AppleTV, FireTV, tablet or performs better in almost all cate adds a further 18 private and and zapping times on the set-top smartphone. Compared to the old gories – 1&1 needs to iron out a few The new IPTV offering from 1&1 is more state- pay television stations in HD. A box leave something to be desired, Even the “M-net TV plus” basic package offers platform, however, it is no longer problems in the new offering. of-the-art, but the measurements are worse. number of foreign-language packages and we also saw higher error rates. a large choice of 40 HD stations.

Test WINNER Test WINNER regional IPTV TEST RESULTS GERMANY-WIDE NetCologne Net TV Test rating: satisfactory Provider Telekom Vodafone 1&1 NetCologne EWE M-net 1&1 Price/performance: satisfactory Product EntertainTV Vodafone TV Digital-TV NetTV TV Home TV plus Digital TV prov. by Telekom * IPTV 67% Info on the internet www.entertaintv.de www.vodafone.de dsl.1und1.de/fernsehen www.netcologne.de www.ewe.de/zuhause/tv www.M-net.de/tvplus dsl.1und1.de regional New to the test this year are regional product above, “Net TV” is also PICTURE QUALITY (max. 99 points) excellent (91%) 90 excellent (91%) 90 very good (82%) 81 very good (82%) 81 very good (82%) 81 very good (82%) 81 excellent (91%) 90 Very good picture quality overall; IP-TV without/with addit. load (33/33) 30 / 30 30 / 30 27 / 27 27 / 27 27 / 27 27 / 27 30 / 30 providers (products with a market based on the B2B platform from numerous functions; can be IP-TV with load and 2 streams (33) 30 30 27 27 27 27 30 share of less than two percent). Zattoo. The Cologne-based company used on many devices SOUND (max. 40 points) very good (80%) 32 very good (80%) 32 very good (80%) 32 very good (80%) 32 very good (80%) 32 very good (80%) 32 very good (80%) 32 PC (20) / TV/home cinema (20) 16 / 16 16 / 16 16 / 16 16 / 16 16 / 16 16 / 16 16 / 16 “Net TV” is therefore an add-on offers a separate set-top box, but Long startup times on the OFFERING (max. 32 points) excellent (94%) 30 very good (84%) 27 very good (81%) 26 good (78%) 25 very good (84%) 27 very good (88%) 28 very good (88%) 28 option for VDSL connections of the content can additionally or set-top box; slow zapping times; TV channel (20) / VoD (12) 20 / 10 18 / 9 17 / 9 16 / 9 18 / 9 19 / 9 18 / 10 the provider NetCologne, which alternatively be watched on higher error rates operation (max. 41 points) very good (85%) 35 good (68%) 28 good (76%) 31 good (76%) 31 good (76%) 31 good (76%) 31 good (78%) 32 On-screen menus (10) 9 6 7 7 7 7 8 operates in the Cologne/Bonn AppleTV or FireTV and via a Remote control (10) / Control on device (7) 9 / 4 7 / 5 8 / 4 8 / 4 8 / 4 8 /4 8 / 5 region. For 9.99 euros/month, this smartphone app. Installation (7) / Manual/help (7) 6 / 7 5 / 5 6 / 6 6 / 6 6 / 6 6 / 6 5 / 6 TRANSMISSION (max. 180 points) very good (89%) 160 very good (83%) 150 adequate (44%) 80 satisfactory (51%) 92 adequate (48%) 87 adequate (43%) 77 very good (81%) 145 service comes with around The test results are similar IP-TV without/with addit. load (30/30) 35 / 35 33 / 33 17 / 19 20 / 21 17 / 18 19 / 16 32 / 30 IP-TV with load and 2 streams (40) 35 33 18 23 19 12 33

TEST WINNER TEST 80 TV channels, around 20 of to those for 1&1: The picture Advanced zapping (60) 55 51 26 28 33 30 50 which are in HD. For an additional quality is rated “very good”, but overall score (max. 392 points) 347 327 250 261 258 249 327 6.99 euros/month, you also get lags behind Telekom and Test rating: very good (89%) very good (83%) satisf. (64%) satisf. (67%) satisf. (66%) satisf. (64%) very good (83%) the private stations and a few Vodafone. The starting and Price/performance: very good good satisfactory satisfactory satisfactory satisfactory very good * additional pay television channels in zapping times and error rates could DATA AND MEASUREMENTS The IPTV product from NetCologne is also IPTV MEASUREMENTS WITHOUT LOAD HD quality. Like the new 1&1 also be better. based on the B2B platform from Zattoo. Samples: VideoQ./Box start/zapping 41,709/2,187/8,741 40,341/2,183/8,713 47,224/1,070/4,371 30,618/1,074/4,432 30,716/1,074/4,365 30,758/1,066/4,411 20,669/1,082/4,324 Video quality IPTV (MOS)/of which < 4,0 (%) 4.30/0.00 4.26/0.00 4.59/0.91 4.59/0.93 4.59/0.98 4.59/0.86 4.30/0.00 Start set-top box from standby (s)/ of which > 6 s (%) 1.27/0.05 0.81/0.05 4.96/15.33 4.45/8.91 5.15/15.52 4.95/10.61 5.03/0.09 Unsuccessful set top box start up (%) 0.59 1.05 1.21 0.74 1.02 0.94 0.65 Test rating: satisfactory Zapping switching times (ms)/of which > 2500 ms (%) 279/0.08 813/0.55 1,383/4.80 1,236/3.87 1,383/6.15 1,286/4.96 561/0.58 EWE TV Home Unsuccessful switching when zapping (%) 0.21 0.68 3.29 3.18 2.11 3.60 0.19 Price/performance: satisfactory 66% MEASUREMENTS FOR IPTV WITH LOAD (DOWNLOAD. UPLOAD. TELEPHONY) IPTV Samples: VideoQ,/Box start/zapping 30,705/2,183/8,728 29,961/2,179/8,707 44,445/1,110/4,415 28,742/1,120/4,471 30,519/1,108/4,433 30,659/1,114/4,451 13,645/1,080/4,311 regional EWE (Energieversorgung Weser-Ems; nels. AppleTV and FireTV can be used Very good picture quality overall; Video quality IPTV (MOS)/of which < 4,0 (%) 4.30/0.00 4.26/0.00 4.59/0.87 4.59/0.96 4.59/0.88 4.59/0.92 4.30/0.00 Energy Supplier Weser-Ems) offers in addition to the set-top box provided numerous functions and channels; Start set-top box from standby (s)/ of which > 6 s (%) 1.18/0.05 0.82/0.05 5.86/31.06 5.01/15.43 7.08/98.73 5.86/27.07 5.01/0.00 can be used on many devices Unsuccessful set top box start up (%) 0.23 1.01 1.08 1.07 0.63 1.53 1.20 VDSL and fibre-optic lines between by EWE. A basic programme package Zapping switching times (ms)/of which > 2500 ms (%) 278/0.08 813/0.57 1,827/8.37 1,391/5.01 2,151/17.56 1,659/12.69 538/0.26 the Ems and Elbe rivers, in Branden can even be received free of charge via Long startup times on the Unsuccessful switching when zapping (%) 0.08 0.70 0.36 0.09 0.59 1.55 0.09 burg and on the island of Rügen. a smartphone app in a home network. set-top box; slow zapping times; MEASUREMENTS FOR IPTV WITH LOAD (DOWNLOAD. UPLOAD. TELEPHONY) AND 2 STREAMS higher error rates Samples: VideoQ,/Box start/zapping 18,165/2,183/8,724 4,458/2,179/8,709 26,105/1,095/4,392 28,546/1,118/4,440 30,729/1,108/4,413 28,040/1,105/4,434 5,013/1,080/4,320 Customers can purchase the “TV The results are similar to those of Video quality IPTV (MOS)/of which < 4,0 (%) 4.30/0.00 4.25/0.00 4.59/0.71 4.59/0.63 4.59/0.63 4.60/0.57 4.29/0.00 Home” option for 9.99 euros/month. the other services based on the Zattoo Start set-top box from standby (s)/ of which > 6 s (%) 1.15/0.00 0.61/0.05 6.11/40.09 4.95/14.78 6.98/88.97 6.02/29.41 4.99/0.09 Unsuccessful set top box start up (%) 0.37 1.06 0.91 1.34 0.99 2.44 0.56 EWE also uses the B2B platform from B2B platform: Picture quality is at the Zapping switching times (ms)/of which > 2500 ms (%) 279/0.03 652/0.38 1,855/9.04 1,396/4.83 2,105/16.21 1,730/14.66 525/0.21 Swiss provider Zattoo for this. Inclu same level as 1&1, NetCologne and Unsuccessful switching when zapping (%) 0.19 0.78 1.30 0.18 0.59 2.91 0.12 ded are around 100 TV channels, of M-net, startup on the set-top box ADVANCED ZAPPING Samples: Fast/number/EPG zapping 2,182/2,181/2,181 2,175/2,178/2,178 1,075/1,101/1,102 1,108/1,111/1,111 1,095/1,110/1,110 1,097/1,113/1,113 1,078/1,081/1,081 which 20 are in HD. For another takes a very long time and the hard Fast-zapping switching times (ms)/of which > 2500 ms (%) (%) 262/0.00 812/0.41 1,512/9.12 1,412/9.59 1,457/8.31 1,399/7.67 611/3.44 5.99 euros/month, you can book the ware and the service take too much of Unsuccessful switching when fast zapping (%) 0.00 0.23 1.02 0.27 0.00 0.18 0.09 Number-zapping switching times (ms)/of which > 2500 ms (%) 490/0.05 902/0.42 1,913/8.55 1,879/8.94 2,011/11.17 1,907/9.79 526/0.19 “HD plus” option, which increases the their time with zapping. These Unsuccessful switching when number-zapping (%) 0.18 0.69 0.09 0.27 0.00 0.00 0.00 number of private and pay television problems are exacerbated when broad EWE “TV Home” based on Zattoo B2B offers EPG-zapping switching times (ms)/of which > 2500 ms (%) 699/0.09 819/0.42 1,158/5.10 1,027/4.61 1,106/4.12 1,020/3.68 851/1.21 programmes to a total of 68 HD chan band lines are under load. around 100 channels even in the basic package. Unsuccessful switching when EPG-zapping (%) 0.78 0.64 3.90 4.23 3.87 4.85 0.37 * for existing customers only, product can no longer be booked 42 www.technite.video | 12_2018 43 IN foCus | REVIEW: IPTV And Web-TV

Zattoo Test rating: very good Vimeo Test rating: good Price/performance: very good 89% Price/performance: very good 79% Web TV Web TV The Swiss provider has adopted a package for 9.99 euros/month (up to Excellent picture quality, Vimeo resembles the more well- consists of – well worth watching – High picture quality, very good multi-track strategy: First, it offers end 30 recordings in the online video recor excellent transmission known YouTube in terms of techno independent productions and docu transmission performance, some customers various web streaming der, two simultaneous streams) and performance; good basic offer logy and operation. However, this US mentaries. The purchase and rental high-quality content options – from an advertising-funded “Ultimate” for 19.99 euros/month (up Free offer funded by additional service is primarily targeted at pro prices for these are on the low side Limited offer range, content provi- free service through to subscriptions to 100 recordings in the online video advertising during switching; fessional content creators. It aims to when compared to others. ders usually have to pay, sometimes expensive premium options lack of response on playback start with more than 100 channels, recorder, four simultaneous streams). provide them with a powerful plat The measurements show that by 50 of which in HD, online video In our web TV tests, we looked at the form for showcasing their content – and large, Vimeo lives up its promise: recorder and restart/replay. It also free basic product for end customers. and as they pay to use Vimeo (with the The picture quality is higher than that markets its content platform as a Even this variant impressed us with exception of a limited basic product), on YouTube, and the two providers are TEST WINNER TEST “B2B” service. The IPTV test candi excellent picture quality, excellent they retain their usage rights to their neck and neck when it comes to trans dates 1&1, EWE, NetCologne and results for the transmission values productions, which is not the case mission performance. The fact that M-net have chosen to use this service. and good marks in the other categories. with YouTube. Viewers can access Vimeo lands just behind YouTube in Private customers who purchase a The Swiss company was there- content for free – but Vimeo also the final standings is due to the more subscription directly from Zattoo can fore the test winner in the Web TV Zattoo’s offering for end customers offers a lot of TV offers “Video on Demand” for which limited choice of content and the less It is clear that video is the lifeblood of this web choose between the “Premium” category. channels – free with advertising or as a subscription. users must pay. This content usually widespread support on devices. video platform designed for professionals.

Amazon Prime Video Test rating: very good Sky Ticket Test rating: good Price/performance: very good 86% Price/performance: good 77% Web TV Web TV While “Amazon Prime Video” was Apps that can be used to receive Excellent range of content; very The pay television provider responded for the first months. Overall, the offer Good picture quality overall; previously a freebie included in the this content can be found on many good operation; excellent to new user habits in TV and video is geared towards those who only want attractive range of content; shipping charge flat-rate offered by smart TVs and streaming boxes from transmission performance consumption with “Sky Ticket”. to use Sky occasionally and are not many devices supported the online giant, many customers AppleTV or FireTV through to Play Merely average picture quality; Programme packages from the Sky interested in concluding a 24-month Constantly high video response now pay the annual fee of 69 euros or station or Xbox. Mobile use on a visible shortcomings on range can be streamed on the PC or contract. times; slightly higher error rates playback start over the entire test period the monthly rate of 7.99 euros for the smartphone or tablet is also possible. Mac, tablet or smartphone, or received The measurements show that the content alone. The basic package The measured quality parameters on boxes such as AppleTV, Play- streamed content has a good picture contains movies, series and high- for video streaming could be im station, Xbox or a special Sky TV quality overall, but cannot keep up quality “made for Amazon Prime” proved upon – the picture quality (HDMI) stick. The packages, which with candidates such as Zattoo, productions. The latest blockbuster just barely achieves a rating of “good”. can be cancelled each month, start at Vimeo or YouTube. The content or series highlights can also be However, Amazon makes up for this 9.99 euros (“Entertainment” series infrastructure seems to be already purchased or rented. With “Amazon deficit with full marks for trans package), while the “Cinema” package running at its limits – slightly higher Channels”, viewers can also subscribe mission performance, very good is available for 14.99 euros/month. Web TV error rates over the entire test to individual pay television special- operation and not least its excellent The range of content offered by Amazon is among As is common practice for Sky, new period and slow response times would The “Sky Ticket” packages are aimed at interest channels. range of content. the widest on the entire streaming market. customers are enticed with discounts at least suggest so. occasional users of the pay television offer.

YouTube Test rating: very good Netflix Test rating: good Price/performance: very good 80% Price/performance: satisfactory 74% Web TV Web TV The web video platform, which is experimenting with paid subscrip Very good picture quality; very The name Netflix is already syno 7.99 euros/month with SD reception Good picture quality overall; now owned by Google, began life in tions. However, many users post good transmission performance; nymous with a new way of watching on one device, the standard rate for high-quality content; can be 2005 as a place for users to show content that is in a legal grey area. extensive choice of content TV – and the streaming service has 10.99 euros/month with HD on two watched on many devices their self-produced video clips. Today, If you are looking for a particular vi Often in-stream advertising in also been available in Germany since devices, and “Premium” for 13.99 Heavily utilised content platform; YouTube is the place to go for web deo, looking for it on YouTube is the the free content; sometimes the summer of 2014. In addition to its euros/month with UHD on up to four only satisfactory transmission long preloading periods performance videos. Following the agreement best way to go in practice. YouTube broad and growing range of high- devices. reached with copyright holders in the can be played on many smart TVs, quality films and series, Netflix is The provider’s huge success, how music industry, the website now set-top boxes and gaming consoles as increasingly offering exclusive ever, is reflected in a content platform contains legal music videos as well as well as via an app on a tablet or content and its own productions. tangibly operating at maximum capa corporate videos, video blogs or smartphone. At the same time, the provider is city: For transmission, Netflix only special YouTube magazine formats. The success of the platform and the generally staying true to its flat-rate achieves a “satisfactory” rating. The free content is financed through high investments by Google are model, even if there are speculations Picture quality is good as a whole, but in-stream advertising and through reflected by very good picture quality about forthcoming price increases. trails behind Zattoo, Vimeo, YouTube Google search engine marketing. and very good transmission per As a global video archive, YouTube offers both trea- At the time of the test, the following or Sky Ticket. However, it does better Netflix is increasingly seeking to attract users with ex- YouTube is also increasingly formance in the test. sures from the past and up-to-the-minute content. were available: The basic rate for than the powerful rival Amazon. clusive content and its own high-quality productions.

44 www.technite.video | 12_2018 45 IN foCus | REVIEW: IPTV And Web-TV

Facebook Test rating: good ZDF Mediathek Test rating: good Price/performance: very good 72% Price/performance: good 69% Web TV Web TV The social media giant makes no video – right through to virtual Excellent video quality, powerful Classic TV broadcasters are also accessed on AppleTV and FireTV, Very good picture quality, secret of its primary aim, which is reality content – plays a central role content platform, plans for adapting to new viewing habits as via a web browser on a PC, smart high-quality content; access on for users to spend as much time as in the future plans of the Zuckerberg virtual reality far as their possibilities allow. phone or tablet. numerous devices and via app possible on their Facebook company. Relatively small amount of enter- More and more viewers tend to Content is free or, to be more Very crowded content platform: “timeline” and so consume as For this, Facebook has a powerful tainment content; not found often access programmes from the accurate, is covered by the TV licence long response times (especially on smart TVs or set-top boxes evenings), slightly higher error rates much paid content as possible content platform that also made a broadcaster’s media centre rather fee. It is possibly due to this generated by the actual Facebook clear impact in our measurements: than watch the linear live broadcast. financing model that our measure customers – namely companies and Video quality is fantastic and can To take account of this trend in ments revealed long response times, organisations. In view of this, it is keep pace with the number one in our test, we included the particularly in the evenings, and obvious that the provider will also this category, Zattoo. Transmission ZDF Mediathek in our comparison. slightly higher error rates. rely heavily on video. However, performance is also rated as good. This can be accessed using the red However, the picture quality is entertainment content is very thin A limited range of content and the button on HbbTV-compatible rated “very good”. Overall, there- on the ground – with the exception fact that it appears less frequently on TV sets and is also found in the fore, this public broadcaster of movie trailers or film or series re smart TVs etc. are the reasons You can also find video’s TechNite on Facebook – menus of streaming boxes and content is certainly worth taking a The ZDF Mediathek can be accessed easily views in video format. However, Facebook did not fare better. along with the editorial team’s contact details. gaming consoles, and can be look. from the computer, among other options.

test WINNER TEST RESULTS FOR WEB TV TEST RESULTS FOR WEB TV Provider/service zattoo Amazon Prime Video YouTube Vimeo Sky Ticket Provider/service Netflix Facebook ZDF Mediathek What I think Access/info on the internet www.zattoo.com/de www.amazon.de/prime-video www.youtube.com www.vimeo.com skyticket.sky.de Access/info on the internet www.netflix.com/de www.facebook.de www.zdf.de PICTURE QUALITY (max. 99 points) excellent (91%) 90 good (65%) 64 very good (87%) 86 excellent (91%) 90 very good (83%) 82 PICTURE QUALITY (max. 99 points) good (75%) 74 excellent (91%) 90 very good (83%) 82 Picture quality web TV (99) 90 64 86 90 82 Picture quality web TV (99) 74 90 82 SOUND (max. 40 points) very good (80%) 32 very good (80%) 32 good (70%) 28 good (70%) 28 very good (80%) 32 SOUND (max. 40 points) very good (85%) 34 good (70%) 28 good (70%) 28 Hannes RUEgheimer, Sound quality on PC (20) 16 16 14 14 16 Sound quality on PC (20) 16 14 14 video AutHor Sound quality on TV/home cinema (20) 16 16 14 14 16 Sound quality on TV/home cinema (20) 18 14 14 OFFERING (max. 32 points) very good (81%) 26 excellent (91%) 29 satisfactory (59%) 19 satisfactory (50%) 16 excellent (94%) 30 OFFERING (max. 32 points) excellent (94%) 30 adequate (31%) 10 good (66%) 21 Entertainment content (32) 26 29 19 16 30 Entertainment content (32) 30 10 21 OPERATION (max. 41 points) good (68%) 28 very good (80%) 33 satisfactory (61%) 25 satisfactory (51%) 21 good (78%) 32 OPERATION (max. 41 points) excellent (93%) 38 satisfactory (51%) 21 good (78%) 32 Telekom was the clear overall winner Operation on PC (11) 9 9 9 8 9 Operation on PC (11) 10 8 8 among the IPTV providers, but Operation on mobile devices (10) 7 6 7 7 7 Operation on mobile devices (10) 9 8 6 Vodafone also deserves a ranking of Operation on TV/home cinema (20) 12 18 9 6 16 Operation on TV/home cinema (20) 19 5 18 “very good”. The move by 1&1, switching TRANSMISSION (max. 180 points) excellent (96%) 172 excellent (100%) 180 very good (87%) 156 very good (87%) 156 good (69%) 124 TRANSMISSION (max. 180 points) satisfactory (64%) 116 good (73%) 132 satisfactory (60%) 108 from the old “Digital-TV provided Web TV transmission (180) 172 180 156 156 124 Web TV transmission (180) 116 132 108 OVERALL SCORE (max. 392 points) 348 338 314 311 300 OVERALL SCORE (max. 392 points) 292 281 271 by Telekom” to the new platform based on the business-to-business service Test rating: very good (89%) very good(86%) very good (80%) good (79%) good (77%) Test rating: good (74%) good (72%) good (69%) from Zattoo, clearly cost points. Price/performance: very good very good very good very good good Price/performance: satisfactory very good good However, because the new service is far more state-of-the-art in terms of DATA AND MEASUREMENTS DATA AND MEASUREMENTS functions, devices and content, we can TOTAL NUMBER OF SAMPLES (PCTURE QUALITY AND TRANSMISSION) TOTAL NUMBER OF SAMPLES (PCTURE QUALITY AND TRANSMISSION) Number of samples 50,452 52,351 52,313 51,573 49,489 Number of samples 51,772 51,266 40,744 hope that the technology will soon MEASUREMENTS FOR WEB TV PICTURE QUALITY MEASUREMENTS FOR WEB TV PICTURE QUALITY be on a par with the predecessor Video Quality Score initial (MOS) 4.62 2.68 3.72 4.14 3.25 Video Quality Score initial (MOS) 2.50 4.46 3.14 product. The regional providers Video Quality Score stable (MOS) 4.62 3.68 4.01 4.14 4.28 Video Quality Score stable (MOS) 4.10 4.70 4.03 NetCologne, EWE and M-net included MOS deterioration > 2.0 (%) 0.00 0.84 0.00 0.00 0.00 MOS deterioration > 2.0 (%) 0.33 0.00 0.00 in this year’s test would also profit MEASUREMENTS FOR WEB TV TRANSMISSION MEASUREMENTS FOR WEB TV TRANSMISSION from this. Network response time (ms) 29 17 17 16 131 Network response time (ms) 16 16 125 In our web TV test, Zattoo’s offering Network response time > 160 ms (%) 0.02 0.09 0.32 0.08 30.85 Network response time > 160 ms (%) 0.02 0.03 29.74 Buffering time before playback (s) 1.03 0.60 1.98 1.76 1.02 Buffering time before playback (s) 2.63 0.42 0.69 to end customers is above all others, Buffering time before playback > 3,4 s (%) 0.03 0.19 0.63 1.94 1.31 Buffering time before playback > 3,4 s (%) 11.43 0.03 0.07 making it the clear test winner in this Unsuccessful web TV playback (%) 0.03 0.00 0.00 0.00 0.25 Unsuccessful web TV playback (%) 0.12 0.95 0.72 category. Amazon Prime Video is also HARDWARE/SOFTWARE SUPPORT HARDWARE/SOFTWARE SUPPORT very persuasive. As the test shows, the PC: own client / access via web – / • – / • – / • – / • • (Win, Mac) / – PC: own client / access via web – / • – / • – / • content platforms of YouTube and Vimeo Smartphone: App for iOS • • • • • Smartphone: App for iOS • • • are powerful. From a technical per Smartphone: App for Android • • • • • Smartphone: App for Android • • • spective, Sky Ticket and Netflix are Clients on smart TVs • • • – • Clients on smart TVs • • • Other devices AppleTV, FireTV, AppleTV, FireTV, FireTV Stick, AppleTV, FireTV, FireTV Stick, AppleTV, FireTV, FireTV Stick, AppleTV, Other devices AppleTV, FireTV, FireTV Stick, Apple TV, Fire TV, Apple TV, Fire TV, somewhat the victim of their own FireTV Stick, FireTV Tablet, FireTV Tablet, Playstation 3/4, FireTV Tablet, Playstation 3/4, FireTV Tablet, Roku Playstation 3/4 FireTV Tablet, Playstation 3/4 FireTV Stick FireTV Stick, success, but provide decent picture Xbox One, NVidia Shield Echo Show, Xbox One/360, Wii Echo Show, Xbox One/360, Wii Sky TV Stick, Xbox One Xbox 360, Wii Xbox One Xbox One/360 quality and excellent content.

46 www.technite.video | 12_2018 47 IN foCus | REVIEW: IPTV And Web-TV

Our test methods From 17th September to 14th October period, automated measurement were performed with simultaneous 2018, zafaco conducted a comprehen systems took around 770,000 mea- downloads, uploads and IP calls Fully automatic zapping: The original sive test of IPTV and web TV services surements for IPTV and around (“with load”). In a third scenario, two set-top boxes of on behalf of video. zafaco GmbH, 360,000 measurements for web TV. IPTV streams were received simul the IPTV providers with headquarters in Ismaning, To enable providers to perform essen taneously. This happens in practice are controlled fully automatically. Germany, operates test connections in tial maintenance without any adverse when a user is watching one TV Specialised test 48 cities – although not every provider effects on their test results, we pro programme while recording another systems analyse the video quality or every connection technology is vided a maintenance window: measu in the background, or when a family they provide. available in each city. In the test rements were suspended from 2 am to is using two IPTV boxes on two 6 am. TV sets. New this year is the inclusion of IPTV test “advanced zapping” in the test For the IPTV test, the test systems catalogue. Here, the test systems remotely controlled the set-top boxes record the switching times for supplied for respective services, normal channel changing recording the startup, response, and (fast zapping), directly accessing switching times. To assess the picture a channel in the set-top box (number and sound quality of TV signals zapping) and selecting a programme received via IPTV, zafaco analysed using the set-top box EPG (EPG the incoming video data streams. zapping). A quality test method developed by the data network research group Web TV test at the Technical University in zafaco also put the quality of the Cologne in collaboration with zafaco web TV offerings to the test. The was one method used. This measures video quality and transmission both the objective and the subjective parameters measured here represent (as perceived by human viewers) the average across all internet connec picture and sound quality on the basis tions used. They therefore provide of network parameters such as delay, information about the capability of jitter, packet loss, quality of service the streaming platforms and their and error correction mechanisms, as network connections. The test used an well as through analysis of the video “over-the-top” approach – mimicking codec layer with deep packet a user using the services via a inspection. web browser. For providers with adaptive The streaming providers adopt streaming (IPTV services based on different approaches to manage the the B2B platform from Zattoo), the constantly growing volumes of data. quality analysis was carried out using To improve quality and optimise the “Perceptual Evaluation of costs, they aim for direct connections Streaming Video Quality” (PEVQ-S) to internet providers or place as many method from Opticom. This method servers as possible in their networks. provides results in the form of This is also reflected in the results and MOS values (“Mean Opinion Score” analyses. – the average calculated from indivi Quality is analysed here using the dual scores from 1 to 5). PEVQ-S method from Opticom. The scenarios covered by the The response times for video viewing measurements were based on everyday (“network response time”), the use. The pure IPTV performance buffering times before playback and without the use of additional services the percentage of unsuccessful is reflected in the “IPTV without playback attempts were also recorded. load” scenario. A further scenario Detailed documentation of the assumed that the user is also simul- comprehensive test procedure is taneously making a call and/or available to download at www.zafaco. surfing the net. These measurements de/de/whitepaper.