Smartphone-Based Connectivity on AGL Agustin Almansi Technology Consultant 01 June 2017

Smartphone-based Connectivity on AGL Agustin Almansi Technology Consultant 01 June 2017

• About RealVNC & VNC Automotive • Why connect the smartphone to the car? • Smartphone-based connectivity review • Connected Car with MirrorLink • Integration on AGL

VNC & RFB RealVNC RFB3.8 VNC VNC RFB4.1 RealVNC RealVNC First VNC VNC invented in founded by published as Automotive MirrorLink released achieves delivers MirrorLink available for Connect Olivetti / inventors an open launched released Core world’s first 1.1 in Raspberry Pi launched Available to AT&T Labs internet Member MirrorLink production License Corporate Research standard, Status of 1.1 server Rebranding Project RFC 6143 CCC certification

1994 2002 2007 2009 2010 2011 2012 2013 2014 2015 2016 2017

membership VNC Automotive supports membership VNC release support for iPod Telematics solution Out Partnerships VNC Automotive, 2017 Telematics solution Contract with First contract with Major head unit contract for VW Group 15 Auto OEMs Major Chinese OEM Partnerships First MirrorLink 1.1 50+ Vehicle Models First contract with major Handsets OEM Tier 1 in production 10+ Million Cars First MirrorLink in cars (customer option) Major contract for Sony phone contract Member 100+ Million Phones First Automotive partners First contract head units signed direct with Auto First volume line-fit Volume line-fit production OEM MirrorLink

Copyright © 2002-2017 RealVNC Limited. All rights reserved. RealVNC®, VNC® and RFB® are trademarks of RealVNC Limited. Other trademarks and logos are the property of their respective owners. VNC Automotive is a division of RealVNC. Collaborating with Volkswagen to deliver a market- defining user experience to MirrorLink connected cars

RealVNC work very closely with Volkswagen and all major mobile phone OEMs providing a mature, high-performance MirrorLink implementation. This close cooperation has brought many new major mobile phone vendors to the ecosystem. Using our VNC Automotive™ MirrorLink Certified™ solution in their handsets provides fast time-to- market and guaranteed MirrorLink Certification. As part of our continuous improvement process, we are pleased to declare our commitment to Volkswagen to refine and perfect the overall end-to-end user experience for MirrorLink enabled devices.

Using our unique position in the industry as a vendor of full MirrorLink software stack technology, for both ends of the connection (in the car and mobile devices), RealVNC are able to realise a highly optimised MirrorLink solution where both ends are designed and guaranteed to work well together. Thus ensuring fast response times and a smooth driver experience. As the industry strives to ensure a high level of interoperability and consistent user experience, knowing the mobile devices have the same underlying software stack is a significant assurance to Volkswagen.

For driver For IVI Developer (Car OEM, Tier 1/2) Familiar / Consistent user-experience Simplify development Continue using favourite Apps Easy to extend and update Large app ecosystem Increased security, sandboxing No need to sync content Reduced hardware / software cost

Mobile Centric Open Standard OEM Centric

• Mobile ecosystem • Community driven • Preserve the traditional OEM ecosystem • Mobile brand • Brand neutral • OEM brand

It is very likely that the trend to support multiple standards in one HU will grow.

Mobile Centric Open Standard OEM Centric

− Closed standard − Closed standard − Closed standard − Open standard − Open standard − Open or closed − Closed standard − Limited Apps − Not available globally − Limited to Baidu − Driven by Auto OEMs − Open to any App standard − Auto OEM in full controlled by Apple (e.g. China) Services & Handset Vendors developer − Extendable providing control − Siri voice mandated − OEM liability − OEM liability − Open to any App − Capabilities limited greater flexibility − Supports iOS and − OEM liability concerns* concerns* developer by templates − Supports rear- seats, Android concerns* − Most modern − Works well in China − Auto OEMs in full − Auto OEMs in full multiple handsets − Pre-installed on iOS Android devices − Supports iOS and control control etc. devices supported Android − Car OEM need to create Mobile App

* Auto OEMs have expressed serious liability concerns as both Apple and Google accept no liability, e.g. Driver distraction, yet provide no way for the OEMs to influence what is displayed

Application Library • Apple-centric Ecosystem, iPhone 5+ • Media and Messaging Only • Proprietary Protocol • No Maps, No Parking • 3rd party Apps as services (media, text) • OEM Apps supported • Driver Distraction Policy: Templates • Siri for voice control • Projected Virtual Display

Application Library • Google-centric Ecosystem, Lollipop+ • Media and Messaging Only • Proprietary Protocol • No Maps, No Parking • 3rd party Apps as services (media, text) • OEM Apps supported • Driver Distraction Policy: Templates • Google Now • Projected Virtual Display

Application Library • Baidu-centric Ecosystem • Proprietary Protocol • 3rd party Apps as services, China focus. • Baidu Services in the Car • Projected Baidu Application Display • Supports both iOS and Android devices

Application Library • OEM-centric Ecosystem • Open Protocol • Open-source Application Developer SDK • Driver Distraction Policy: Whitelist • Template based remote rendering

SCOUT Life360 AccuWeather

• Open Ecosystem, controlled by consortium of car OEMs and smartphone OEMS • Open Protocol • Driver Distraction Policy: Certification program • Projected Application Display

• Global consortium to develop connected-car solutions, Some of CCC Members are: including smartphone based connectivity − Membership open to any interested company − Solutions are not owned or governed by a single corporation − OS agnostic - No platform limitations − Assure device and application interoperability − Future proof – not reliant on a single vendor • Bringing car, mobile and head-unit industries together − Established in February, 2011. Now 100 member companies − Automotive, Smartphone, Tier 1 and Ecosystem-enablers

Copyright © 2002-2017 RealVNC Limited. All rights reserved. RealVNC®, VNC® and RFB® are trademarks of RealVNC Limited. Other trademarks and logos are the property of their respective owners. VNC Automotive is a division of RealVNC. MirrorLink is the only cross-industry collaboration in developing an open standard for car-smartphone connectivity

• v1.0 • v1.3 • Initial release • being published to members • a.k.a. Terminal Mode • Adds H.264 encoding for the RFB protocol, supporting HD resolutions • v1.1 • More features for App developers • In production since 2014 • Provided foundation for 3rd party Apps • Will be published as an ETSI (European Telecommunications • v1.2 Standards Institute) standard • expanded technology portfolio with wireless MirrorLink (WFD) • In production since 2016

Volkswagen + Samsung Showcase at CES 2016 Skoda + Samsung PR in 2016

No obstruction from dash or

window mounted device Stored

Car optimized Audio No holding Input & Output No touching Car optimized No looking Display & Input Control No glancing

Source: Car Connectivity Consortium

No SDK  MirrorLink API

Connectivity

Source: Car Connectivity Consortium

• Certification program built to help offset risk • Device certification • Conformance with specification • Interoperability with reference devices • Application certification • Driver Distraction testing • Region-based following local regulations • Conducted by approved Test Labs

Copyright © 2002-2017 RealVNC Limited. All rights reserved. RealVNC®, VNC® and RFB® are trademarks of RealVNC Limited. Other trademarks and logos are the property of their respective owners. VNC Automotive is a division of RealVNC. MirrorLink Copyright © 2002 Copyright Shell - 2017 RealVNC Limited. All rights reserved. RealVNC®, VNC® and RFB® are trademarks of RealVNC Limited. Limited. Other t RFB® VNC® of and are RealVNC®, rights RealVNC trademarksreserved. All Limited. RealVNC 2017 Device & App

Discovery Architecture and Control VC CDC/NCM MirrorLink MirrorLink Common API (Platform Specific) Call Screen

HSML Replication Messaging IP Secure

Connectivity Device Attestation Productivity X.509 MirrorLink rademarks and logos are the property of their respective owners. VNC Automotive is a division of RealVNC. Automotive division a is owners. VNC are the of respective property their logos rademarks and Application OCSP Certificates TCP/UDP Search ™ uses VNC (RFB 3.8) for(RFB 3.8) uses VNC remote ™ control RTP Phone/Media

DHCP Audio &

Voice Control Nav

Access to Music Car Data Source : Car Connectivity ConsortiumConnectivity Car : Integration on AGL

using VNC API

Touch / Pixel Data

VNC Viewer Services

CarLife

VNC VNC

CarPlay Enhanced

AGL Architecture: MirrorLink

Baidu Baidu Android Auto Android

Audio I/O

VNC Viewer Services

h.264 Decoding

Source: AGL / Linux Foundation

Custom Viewer using VNC API RealVNC component Application Application Window Input events Home WiFi … / HMI UX Management Management Screen AGL component

VNC Viewer Services Automotive VNC Android Baidu Audio Speech Services MirrorLink CarPlay … Enhanced Auto CarLife Services Services

CODECS CDC NCM WFD GPS BT profiles Apple Auth iAP2 AAP AOAP Platform (H.264, …) Services + Audio Video OS Layer USB BT Wi-Fi UART CANBUS I/O I/O

IVI System

Source: AGL / Linux Foundation

Copyright © 2002-2017 RealVNC Limited. All rights reserved. RealVNC®, VNC® and RFB® are trademarks of RealVNC Limited. Other trademarks and logos are the property of their respective owners. VNC Automotive is a division of RealVNC. VNC Mobile: supports MirrorLink, Apple CarPlay, Android Auto and Baidu CarLife on any combination of OS and CPU platform

VNC Mobile Components

VNC Enhanced

Copyright © 2002-2017 RealVNC Limited. All rights reserved. RealVNC®, VNC® and RFB® are trademarks of RealVNC Limited. Other trademarks and logos are the property of their respective owners. VNC Automotive is a division of RealVNC. VNC Automotive is a division of RealVNC. Other trademarks and logos are the property of their respective owners. Copyright © 2002-2017 RealVNC Limited. All rights reserved.

https://automotive.realvnc.com/

https://www.realvnc.com/