Interfacing with Humans in the Iot Era

Interfacing with Humans in the IoT Era

Huibert Verhoeven SVP & GM IoT SYNAPTICS LEADS THE HUMAN INTERFACE REVOLUTION

PIONEERING THE RELATIONSHIP BETWEEN PEOPLE AND INTELLIGENT DEVICES

NEURAL NETWORKS

SYNAPSE Action potential

Pre-synaptic (“sending”) cell Post-synaptic (“receiving”) cell

1986 - Synaptics was founded to commercialize analog neural network chips for ultra-low power pattern matching

Founded in 1986 20 Locations Worldwide NASDAQ: SYNA 2300+ Employees

FY17 Revenue: $1.72B +70% in Engineering

• First with touchpads for notebook PCs (TouchPad™)

• First with capacitive touch on mobile phones (ClearPad®)

• First with capacitive touchscreen technology for mobile phones (ClearPad®)

• First with pressure sensitive touchscreen solution (ForcePad®)

• First with touch & display driver integration (TDDI) for smartphones & auto • First with Match-in-Sensor™ fingerprint authentication (Natural ID™) st • First with optical-based fingerprint sensors for smartphones (Clear ID™)

1® • First to meet Amazon’s far-field qualification with only 2 microphones (AudioSmart )

• First multimedia processor to power Android TV on service provider STB (VideoSmart™)

Display Driver and Far-field Voice and Integrated Sensing Speech Capture

Video and Image Acoustics and Audio Processing Output Processing

Optical Imaging

2000 2010 2020

Consumer IoT Notebook PC Smartphone Automotive

User struggles with User learns fixed device Ambient AI adapts to user

multiple devices DEVICE INTELLIGENCEDEVICE

PAST PRESENT FUTURE

Do you want me to take Sure that care of dinner? I found a sounds good. 2 for 1 offer from Chronic Tacos I think you would like

Ordering dinner for two. Expected to arrive in 30 min

AI identifies users, location and context

It’s too cold outside. I think I’ll “Hi John, would you like me stay in and watch to set the temperature to 80°?” a movie.

“I’ll turn off lights in the living room.”

“Here are your favorite movies on Netflix.”

“Should I make some popcorn?”

PRIVACY RESPONSE AVAILABILITY

Vast amounts of cameras & sensors gathering massive volumes of data

CONCERNS • Security & Privacy • Performance & Latency • Availability

Ambient computing requires Intelligence at the Edge

2013 2018 Single Core Processor Quad Core Processor at 2000 DMIPS at 43,000 DMIPS

SoC Cloud Services

ADC Security NPU

Local Context Home ASR/NLU Awareness Shopping RF Control

Smart Amp Biometrics Speech Media Recognition Content

FFV Trigger Voice Speaker Processing NLU Amp Calling

Android Applications with ML (apk)

TensorFlow Lite

Android NN Runtime

Scheduling NN Operations on the best possible core

Extension GPU HAL NPU HAL VS-6xx and later HAL CPU Fallback App OpenCL NPU LLD Developers

Google GPU Linux Drivers Synaptics / IP Providers

*SyNAP: Synaptics Neural Network Accelerator and Processor

Our HMI vision requires low active power, ultra-low standby power, significant computation, and dedicated neural network hardware

3.5

2.5

1.5

0.5

0 28nm IoT focus FinFet Active Power Unit Cost Investment

Small form-factor and highly integrated solutions for ubiquitous use in homes

Extremely low power during idle periods but high- performance during active periods

Fast time-to-market through near turn key systems

TODAY TOMORROW

SMART DEVICES SMART CLOUD

TODAY INTELLIGENCE PRIVACY RESPONSE AVAILABILITY Commands mostly processed in cloud

TOMORROW INTELLIGENCE PRIVACY RESPONSE AVAILABILITY Commands mostly processed locally