Challenges in Iot

實現智慧物聯的必要條件

JULY, 06, 2017

Traffic Monitoring Metro Cells Base Stations Small Cells

Advanced Safety Security

Networked Printers Infotainment Radar + Vision Enterprise Gateways, Cloud Data Switchers, Routers Computing Center

Home Health Monitors + Fitness

Energy Management, Wind + Solar Telehealth Industrial Smart Energy Connected Networking Connected Grid Farms Appliances

Digital Power Conversion

Energy Human – Machine Meters Interface Home Hubs Machine – Machine Security 1 Challenges in IoT

Inconsistent Developer Security Getting to Production Experience

2 NXP IoT Offerings

BAN/PAN/ & Layers of Wired/Wireless, Remote Edge Wired/Wireless, Aggregation / Power Line Cloud-based Product Power Line LAN Hubs / Gateways WAN Processing Xtrinsic Sensing Connectivity Intelligent Contextual Sensing. BAN/ PAN/ LAN S P C C The right combination of Fully integrated Short Range intelligent integration, logic radios with best in class P C C P C C P and customizable software on power performance, and the platform to deliver Powerline Communications smarter, more differentiated S P C applications. For IoT it provides Context: Identity, Activity, Location, & Time Software in All Nodes

Edge products: •Very small •Low cost •Low power Digital Network •Low complexity Kinetis & LPC Vybrid Controller i.MX Applications Processors built on •Industrial grade & robust Microcontrollers Solutions Processors Layerscape Architecture Design Potential. Rich Apps in Real Your Interface to the Accelerating the Network’s Realized Time. World. IQ

Sensing S Industry’s most scalable Real-time, highly integrated Industry’s most versatile Industry’s first software- ultra-low-power, mixed-signal solutions with best-in-class 2D solutions for multimedia and aware, core-agnostic Embedded Processing P MCU solutions based on the graphics to enable display applications, with networking system ARM® Cortex™-M and your system to control, interface, multicore scalability and architecture for the smarter, C Communications Cortex™-M0+ architectures. connect, secure and scale. market-leading power, more capable networks of performance & integration. tomorrow – end to end.

Scalable Industry Standard Solutions, Software and Development Ecosystem

3 NXP Products & Enablement for IoT

Simplified Device Interoperable Wireless Voice Triggering Commissioning Connectivity Kits, Reference Designs, Solutions KEY KEY Security Sound/Audio Detection FEATURES ENABLEMENT

WIRELESS CONNECTIVITY & NFC PROCESSING & SECURITY

NFC Microcontrollers Secure Element

FOR Bluetooth Smart Application Mesh Processors PRODUCTS PRODUCTS

4 ► NXP (both NXP LPC and former Freescale) have longstanding track records of providing long-term production support for our products

► NXP has a formal product longevity program for the market segments we serve

• For the automotive and medical segments, NXP will make a broad range of solutions available for a minimum of 15 years

• For all other market segments in which NXP participates, NXP will make a broad range of solutions available for a minimum of 10 years

• Life cycles begin at the time of launch

• Includes NXP’s standard end-of-life notification policy

► For a complete list of participating products, visit, nxp.com/productlongevity

5 SMART CONNECTIVITY

6 Connectivity Landscape

Remote Home Smart Nest Light Link Application Layer/ Controls Automation Energy HomeKit M2M AllJoyn IoTivity IPSO MQTT ZCAL (ZLL) Profiles Weave (ZRC) (HA1.2) (SE1.x)

TCP / UDP Network Layer/ Bluetooth IPv4 / IPv6 RF4CE ZigBee PRO Transport Layer Host Stack 6LoWPAN

Physical / Link Layer Bluetooth IEEE 802.11n 1x1 IEEE 802.15.4g IEEE 802.15.4 (low power networking) (PHY/MAC) Link Layer

Wearables & Edge Node Sub-1 GHz 2.4 GHz Home Automation & Home Automation to Gateway Industrial Wireless Building Automation

7 NXP Connectivity Product Portfolio

Zigbee Thread Multi-protocol BLE standalone

HomeKit ready Border router, Target 15.4 Multi Zigbee, & HW Cost optimized Router, REED, Cost optimized wearables Protocol compatible with SED Thread,BLE market 15.4

JN516x KW21Z KW21Z KW41Z QN902x QN908x KW31Z

Planning under Available, MP Available, MP Available, MP Available, MP End of June Available, MP definition

8 Target Development Systems: Gateways/Border Routers/End Nodes

i.MX6UL K64F KW2x Linux Gateway/Border Router RTOS Border Router FRDM-KW24D512

i.MX6Ul EVK K64F Freedom Board • 528MHz Cortex-A7 CPU • 120 MHz Cortex-M4F MCU • 4 GB DDR3L DRAM memory • Up to 1 MB Flash, UP to 258 KB RAM • 256 MB Quad SPI Flash • Integrated Ethernet USB-KW24D512 • Arduino/Freedom connector • Thread and ZigBee • Launching Oct 6th • Launching Oct 6th

9 Three Phase Power Meter

• Low cost NXP ARM Cortex™ M0+ SoC KM14 for metering • Conforms to China National Grid Standard • High performance of 0.5% accuracy for Active and Reactive energy under full temperature range • ESD performance up to +/- 12KV • High accuracy RTC clocking with 5ppm resolution

10 Smart Plug

• NXP Kinetis MKM14Z64 MCU (ARM® Cortex™-M0+ core) • NXP Kinetis MK22FN512 MCU (ARM® Cortex™-M4 core) for WiFi connection • (or add KW41Z by BLE/Thread/Zigbee) • 220V input voltage, 10A max current • 24-bit SD ADC for current sampling with 25ppm 5m ohm current sampler • 24-bit SD ADC for voltage sampling with 25ppm resistor voltage divider • 5ppm RTC solution with external 32.768KHz crystal • External 64Mb SPI Flash Storage • Low-power mode including the use of built-in RTC • 3 channel LED pulse outputs for calibration (kWh, kVarh) • Cost-effective bill of materials • 60th harmonic analysis with THD calculation and display in FFT version.

11 HUMAN MACHINE INTERRACTION

12 Touching Sensing Interface FRDM (TSI) Demo - TOUCH • FRDM-TOUCH is a shield board connected to the FRDM-KE15Z board which integrates new generation touch sensing interface

− supporting both self capacitance and mutual capacitance mode

− 16-bit conversion resolution and configurable sensitivity to handle different overlay material, thickness TSI − IEC61000-4-6 certified (both 3V/10V), immunity - to a wide range of noise EVB • Demo touch keys, touch slider, rotary & touch key matrix • When you touch the keys on FRDM-TOUCH board, the RGB LED is turned on. When you touch the slider, the blue LED will gradually illuminate based on the distance your finger moved on the touch slider

13 . NXP‘s deliverables for industrial wearables Start your wearable design now

HEXIWEAR WARP 7 SCM Kinetis Low Power Microcontroller i.MX 7 Microprocessor open source i.MX 6 Quad Microprocessor high open source solution with 7 NXP solution with 8 NXP Components integrated System in Module , with products including MCUs, BLE including NFC, External Memory, Wifi power management , 16MB NOR Connectivity, Sensors… 200 add-on module… 200 add-on boards Flash, +100 discrete components in a boards available with example code available with example code 14mm x 17mm package …

14 Hexiwear Next Gen IoT Solution for Innovators Value Proposition Key Components

Fastest Time to Market Total NXP BOM Versatile solution created to reduce development $16 - 7 NXP components: MCUs, connectivity, sensors and and design time for IoT applications battery charger - Kinetis K64 MCU based on ARM Cortex-M4 core Path to Manufacturing Designed to accelerate the customer’s time to manufacturing. The BOM is readily available in the market and the design Kinetis KW40Z multimode BLE and 802.15.4 radio SoC files/schematic is open source. Color OLED Display, Rechargeable battery, External flash Optimized Hardware Design The hardware design is optimized and includes several best practices suggested for designing low power IoT applications Design Resources Available Robust Software The software includes everything from the embedded drivers to the Software cloud connectivity - all open source, easy to use and optimized Schematic, Design Files, Bill of Material (BOM) Community Supported iOS and Android App Hexiwear is a true community based solution and enables customers to access the rich pool of resources created by community Software Development Environment Target Applications Kinetis SDK (Open-source and Free) IoT end nodes & Wearables Kinetis Design Studio (Open-source and Free) FreeRTOS (Open-source and Free)

15 WaRP7 Block Diagram

KINGSTON 08EMCP04-EL3AV100-C50U CAMERA 8GB NAND Flash 512 MB LP-DDR3 MIPI CSI NXP Micro-B USB PART OTG NXP NON-NXP BC3770 I2C NXP MURATA PART BATTERY SDIO, UART 1DX CHARGER i.MX7Solo 802.11/b/g/n WIFI INTERFACE Cortex-A7 MPU & BT 4.1 NXP I2C + PF3001 Cortex-M4 MCU PMIC I/O board Board to board CONNECTOR

UART, I2C, SPI, GPIO, PWM, Analog MIPI DSI MIPI

NXP NXP NXP NXP NXP FT2232 Battery FXOS8700CQ MPL3115A2 SGTL5000 MikroBus FXAS21002 NT3H1101 Touch Screen JTAG Connector Combo Acc. / Barometer & Audio CODEC Switches Expansion Gyroscope NFC LCD DISPLAY USB Mag. Temp 180 mAh Socket SENSOR Tag HEAD MICRO SENSOR Battery 16 SENSOR PHONE PHONE DEBUG 3 Things about Android Things

What YOU need to know:

• Android Things is Android for the IoT market

• A certified module is needed to run Android Things • NXP is one of three companies that currently have certified modules

• The Google Voice Assistant & Chromecast Built-in are applications that run on Android Things

17 Android Things is ideal for powerful, intelligent devices on the edge that need to be secure

18 19. Android Things Certified Platforms Roadmap

19 Key Audio Trend

• Voice Control − Key growth market in the consumer space − 4 Key Smart-Home ecosystems to follow: . Amazon Alexa . Google Assistant (Google Home) . Apple Siri/HomeKit . Microsoft Cortana

20 Voice System with Software Front End Beamforming, Dereverberation, AEC Trigger Phrase Detection Voice Recognition/Control

Microphone Voice Assistant Array i.MX 7D System

Advantages: Audio • More flexible and upgradeable Out • Reduced system cost

21 Google Assistant Built In Voice System

1st Pass “Okay Google” Hot Word Detection Beamforming Dereverberation Voice AEC Assistant Audio (Cloud Neural Net) One or two Buffer Information Digital and/or Microphones Action

Accessory Google Cloud Processing i.MX 6UL/7D

AEC = Acoustic Echo Cancellation; Important distinction: Far field (across the room) vs Near field (ie. on a headset) 22 Optimized Voice Control

Beamforming Trigger Phrase/ Embedded Voice Cloud Voice Dereverberation Hot Word Control (ASR) Assistant AEC Detection Optional

Digital Information Microphone and/or array, one or Action more Front End Back End Processing i.MX S/W in Development e.g. Sensory In the Cloud (for “far-field”) (“Ecosystem Play”) MPU with software

AEC = Acoustic Echo Cancellation; Important distinction: Far field (across the room) vs Near field (ie. on a headset) 23 Embedded Voice Control Audio A/D and Voice D/A conversion Processing

Microphone for voice input

• Voice processing by 3rd parties; Sensory specializes on ARM Cortex-M4 support • Typically supports 10 to 20 control commands • Speaker independent, with several languages available • Does not need a network connection, typically fast to respond • May be combined with cloud based voice assistant(s)

24 Amazon Alexa Developer Options Early Access Developer Program Developer Program

Required Components: https://developer.amazon.com/alexa-voice-service/dev-kits/amazon-7-mic/ Hardware • Conexant 2/4 Mic or MicroSemi 2 Mic • i.MX6UL/7D Pico development board Software • Alexa Voice Services (AVS)

25 Amazon Alexa & Google Assistant Reference Platform

26 Amazon Alexa ”Echo” Reference Design

Hardware Beamforming “Alexa” Trigger Phrase/ Audio Voice Dereverberation Hot Word Detection Codec/ Assistant AEC (ASR) ADC 7 Information Microphone and/or array Action

Front End (for “far-field”) Back End Processing In the Cloud Codec and DSP NXP i.MX 6UL

AEC = Acoustic Echo Cancellation; Important distinction: Far field (across the room) vs Near field (ie. on a headset) 27 Voice System with Hardware Front End Beamforming, AEC Dereverberation Trigger Phrase Detection Trigger Phrase Detection Voice Recognition/Control

Microphone Audio Codec Voice Assistant Array with DSP i.MX 7D System

Advantages: • Available now Audio • Does not require additional i.MX Out throughput

28 Suggested Voice and Audio Solutions

Voice and Audio Functionality Solution

Alexa only Front end + i.MX 6ULL (800-900 MHz)

Google Assistant only i.MX 6ULL (800-900 MHz)

Google Assistant and Google Cast i.MX 7D (1.2 GHz)

Combo Alexa and Google Assistant Front end + i.MX 6ULL (800-900 MHz)

Combo Alexa, Google Assistant and Google Front end + i.MX 7D (1.2 GHz) Cast

29 Today: Voice Solutions Demo System

Supported NXP Processor Voice Front End Supported OS Availability Assistants

7 microphones Now

Conexant Alexa Now 2 microphones Linux Pico-i.MX6UL/7D Android Things Knowles Coming Soon 1 microphone

Not Needed Google Now

30 DIGITAL TO PHYSICAL CONVERSION

31 . Collaborative Robots need to see Increased need of graphic computing and vision GPU can do these things Which gives you really really fast… this… • Dense Linear Algebra • Gesture Recognition • Sparse Linear Algebra • Motion Processing • Spectral Methods • Computer Vision • N-Body Methods • Terrain Generation • Structured Grids • Augmented Reality • Unstructured Grids • Speech Recognition • Map-Reduce & Monte Carlo • Cryptography • Combinational Logic • much more…bounded • Graph Traversal only by imagination • Dynamic Programming • Backtracking • Probabilistic Graphical Models • Finite State Machines • more… 32 Multi-Domain Applications

• Automotive eCockpit

• Supervised education tablets for children

• Connected and protected medical devices

• Safeguarded Point-Of-Sale terminals

• Autonomous robotic and industrial devices

• Multiple domain security systems

33 eCockpit Design as example

55 MPH

0.4 mi Turn ►► Infotainment Display De-serializer Cluster Display De-serializer HUD Eliminated: RSE ECU housing and design NRE 10-12 Layer PCB Serializer Serializer Serializer Ethernet 10 layer cluster PCB Additional e-Cockpit ECU 5-6 power supplies / circuit protection requirements: CAN DDR Vehicle i.MX 8Q/QP/QM Applications Processor & Software Advanced Applications Processor MCU Processor (Delta from Infotainment SoC) 256MB DDR / 128MB NOR I/O NAND/ eMMC ASIL B ARM Hypervisor Cluster VMCU + ASIL B OS Additional DDR / Additional program NVM Speaker AM/FM NOR Power WiFi TV DAB/HD Cluster plus optional HUD LVDS Serializers CAN Tx/Rx and harness Cluster plus optional HUD Deserializers Debug ports and hardware Discrete components and connectors

34 DATA AS AN ASSET

35 Functional Security in Embedded Microcontroller

Trusted Execution Crypto Acceleration

• Code I/P Protection • Symmetric Encryption − Internal Memory Protection (SRAM/Flash) − DES/DES3, AES, ARC4 − External Memory Protection (BEE/HAB) • Asymmetric Encryption − Trusted Execution Environment (TEE) − RSA, ECC − Resource Domain Controller (RDC) • Hashing • Debug Port Protection − CRC, MD5, SHA • Authentication • True Random Number Generation − Secure Software Updates • Security Protocols − Device Verification & Authentication − SSL, HomeKit, Thread • Secure Boot Tamper Resistance

• Tamper Detection

Physical: Environmental: . Enclosure Intrusion . Voltage . Drilling . Temperature . Probing . Frequency

36 • Zeroizable Secure Storage Kinetis KL8x to K8x World’s most secure ARM® Cortex®-M based MCUs

Kinetis KL8x MCU Kinetis K8x MCU 72MHz ARM Cortex-M0+ 150MHz ARM Cortex-M4

Advanced Security Advanced Security Secure RAM & Boot, + Performance + Memory Protection Unit, Crypto. Acceleration Unit, Low Power Trusted Crypto. + Memory On-the-Fly Decryption for Engine (DES/3DES/AES/RSA), external memories Tamper Detection, + Crypto ISO7816-3 EMVSIM, throughput Random Number Generator 256/256/16KB + Ext. memory Flash/SRAM/Cache, 128/96KB Flash/SRAM, expansion & USB, FlexIO, QuadSPI (XIP), USB, FlexIO, QuadSPI (XIP), protection SDRAM, SD/eMMC, FlexBus, 121 MBGA / 80 LQFP 121 XFBGA / 100 LQFP Hardware and software compatibility with PCI-certified enablement

37 Reference Design – QR Decoder

QR decoder can quickly scan and decode both 1D and 2D barcode information. It is based on the NXP tower system, utilizes the Kinetis SDK FlexIO camera driver to bring in image data and display the decode result on TWR-LCD and/or a terminal.

Supported Symbologies: • QR(Quick Response Code) • UPC-A UPC-E • EAN8 EAN13 EAN128 • ITF-6 ITF-14 Interleaved 2 to 5 • CODE39 CODE128 • CodaBar

38 LPC800 MCU Series

Industrial RFID Smart Home • Low-power Cortex-M0+ based solution Tag & Reader Remote Control • LPC800 provides − ADC for analog battery monitor functionality − SCTimer/PWM handles IR/RF signal generation without CPU intervention − UART and SPI peripherals for interface to external RF frontends LPC800 − GPIO for interface to

. LED and LCD control Cortex-M0+ GPIO LED . core Pushbuttons/switches pushbuttons GPIO switches battery monitor ADC SCTimer/ IR/RF TX/RX PWM

LCD GPIO UART/SPI RF receiver

39 SECURE IOT GAEWAY & EDGE

40 Integrated Development Experience (IDEx) for General Purpose IoT Systems

• Includes Pre-Configured Modular IoT Gateway and Modular Edge Node Platform

Modular IoT Gateway Modular Edge Node Platform (MENP) • Modular IoT Gateway Base board • Simple Edge Node Base board • i.MX6UL SOM • ZigBee Radio • Wi-Fi/BT/BLE 4.1 • Thread/BLE Radio • Thread/BLE Radio • NFC Tag • ZigBee Radio • RGB Click Module • NFC Reader • A7x Secure Element

• Includes Connectivity and Security Software Modular IoT Gateway Modular Edge Node Platform (MENP) • Linux OS and component drivers (BSP) • FreeRTOS with SDK peripheral drivers • Connectivity and Cloud Protocols • Connectivity Stacks (ZigBee, Thread) • NFC Connectivity and Cloud commissioning • NFC Connectivity commissioning • Secure Over-The-Air Programming • Application software

Shipping TODAY as NXP Part-Number: SLN-IOT-GPI 41 Modular IoT Framework: Software Architecture

MCU/MPU Eval/Dev Board Software Cloud Services Modular IoT Framework specific Software AWS, Azure, Watson, Enterprice, etc

Real-Time Data Management NXP IoT Gateway Device Management Fog Application Analytics Gateway Framework

Protocol Stacks NXP IoT Edge-node

Security Application Device Drivers Management Zigbee Thread BLE Protocol Stacks Operating System WIFI Sigfox Security Device Drivers etc Management Operating System

Complete Security, Connectivity, Management, Cloud and Application Software 42 to create compatible IoT Gateway and Edge-nodes Modular IoT Gateway: Overview Hardware Modules

Ethernet / 2*USB ports / Wifi SMA antenna USB debug / uSD card slot / 5VDC-3A

Wifi module KW2xD KW41Z JN5169 JN5179-001-M1x Radio Modules Kinetis KW41Z Thread Thread Zigbee Zigbee Module on PN7120 Mezzanine (Thread) Explorer Board JN5169 (NFC) Module on Mezzanine (ZigBee)

i.MX6UL SOM on App

NFC Module NFC PN7120 specific base board i.MX6UL SOM Processor ModuleProcessor

43 Modular Edge Node Platform and Modules : Overview Hardware Modules

Add-on Module Socket

TAG NFC/I2C

Power Supply KW2xD KW41Z JN5169 JN5179-001-M1x Radio Modules Programming Thread Thread ZigBee ZigBee and Debug

Radio Module Socket on Modules on

NTAG - Connector Sensor/Actuator Add

44 IDEx for General Purpose IoT System Use Case: Lighting Control

8x8 Animated Thread/ZigBee Edge Node Lighting Grid

HTTP Rest Cloud API Cloud IoT EC2

32* Thread Amazon Mobile Gateway 32* ZigBee Alexa App Edge Node