The Growing Use of Sensors and the Challenges of Always-On Sensor Processing
Total Page:16
File Type:pdf, Size:1020Kb
The Growing Use of Sensors and the Challenges of Always-on Sensor Processing Carmelo Sansone NXP Semiconductors ARM TechCon November 11, 2015 COVER PAGE SUBTITLE PLACEHOLDER COMPANY CONFIDENTIAL Agenda • Sensor basics • Target applications • Sensor processor architectures • Low power MCUs for always-on sensor processing • Sensor processing use cases • Challenges of including sensors in your applications • Sensor framework and sensor fusion • Power optimization consideration • Demos 2 November 10, 2015 COMPANY PUBLIC Sensor target applications Gaming / Mobile Health & Fitness Entertainment Industrial In products used for • indoor navigation • biometric data • console orientation • environment • intelligent sensing • context awareness monitoring and • user motion monitoring • building automation • position • fleet management • mobile gestures communication In products such as: • positional accuracy, • asset tracking • 3D mouse In products such as: In products used for: stability or balance • robotics & drones • head-worn • mobile handsets • portable fitness • dead reckoning • assembly line robots glasses/terminals • tablets • health monitoring • gloves with sensors 3 November 10, 2015 COMPANY PUBLIC Type of sensors Sensor Usage Accelerometer (3-axis) Acceleration. Measure change in velocity Sensor fusion software is used Gyroscope (3-axis) Angular velocity to integrate data from these 3 Magnetometer (3-axis) Strength or direction of magnetic fields sensors (9-axis) and generate an Pressure Environment air pressure, altitude accurate position in space. Humidity Relative humidity in the air Temperature Environmental temperature Heartbeat Heart rate Poison gas Detect presence of poisonous gases (Ex. CO, smoke) 4 November 10, 2015 COMPANY PUBLIC Target applications Sensors Product Application Accelerometer Gyroscope magnetometer Pressure Temperature Humidity Proximity Biometrics Smartphone ● ● ● ● ● ● ● ● navigation, context awareness, altitude dead reckoning, fleet management, Asset tracking ● ● ● ● ● ● product location IoT nodes ● ● ● ● ● ● building automation Robot & unmanned navigation, positioning, stability and vehicles ● ● ● ● control pedestrian navigation, head worn terminal, Wearable sensors ● ● ● ● ● smart glasses, patient monitoring Gaming ● ● ● enhanced user interface Pointing devices ● ● ● 3D mouse, remote controls calorie counter, remote patient activity Health and fitness ● ● ● ● ● ● monitoring 5 November 10, 2015 COMPANY PUBLIC Sensor processor architectures AP + sensor hub MCU: Sensor hub MCU: 1-3 days battery life, ASP $200 3-7+ days battery life, ASP $100-$150 NTAG Application NTAG Display Processor BTLE Display BTLE Wi-Fi USB MCU Wi-Fi USB MCU GPS GPS LG G Watch R Qualcomm Toq Apple Watch Shine (Misfit) Nike+ FuelBand Fitbit Jawbone Apple iPhone 5s Samsung Galaxy S5 6 November 10, 2015 COMPANY PUBLIC LOW-POWER MCUS FOR ALWAYS-ON SENSOR-PROCESSING NXP LPC5410x MCUs: Ultra-low power for always-on sensor-processing applications • Scalable power/performance • 100 MHz Cortex-M0+ core: 55 µA/MHz for listening, data aggregation, management, and data communication • 100 MHz Cortex-M4F core: 100 µA/MHz for sensor fusion and other complex algorithms • Down to 3 µA for sensor listening (power down mode with RAM retention) • Power-efficient ADC: full spec performance (12-bit, 4.8 Msps), any voltage (1.62 to 3.6 V) • Tiny form factors for space-constrained designs, down to 3.28 x 3.28 mm WLCSP 8 November 10, 2015 COMPANY PUBLIC Example: 20% power savings in typical portable fitness device Typical Application Configuration 1 Listen 2 Read sensor data 3 Process LPC54102 SPI ADC MCU LPC54102 Other MCU I2C Power Time Task LPC54102 Other MCU* Listen 1 (power down mode; 3 µA 9 µA LPC54102 is no CPU processing) 20% more power Read (I2C & ADC) 55 µA/MHz 112 µA/MHz efficient than 2 (10 sps @ 12 MHz CPU) (Cortex-M0+) (Cortex-M4F) closest competitor 3 Algorithm Processing 100 µA/MHz 112 µA/MHz (Once per sec @ 84 MHz CPU) (Cortex-M4F) (Cortex-M4F) Competitor LPC54102 *datasheet spec 9 November 10, 2015 COMPANY PUBLIC Low-power peripherals • Low-power analog 40% power savings (at 4.8 Msps • ADC: 4.8 Msps across same sampling rate) LPC5410x entire operating spec MCU ‘S’ • 40% power savings by MCU ‘S’ LPC5410x operating at lower voltage 1.62 V 3.6 V CPU 0-100MHz Reduce peripherals • Low-power interfaces Sync power consumption bridge Flash • Separate system clock (5) Clock 0-100 MHz impact sources • Peripheral active in power down USART I2C bridge ASync SPI ZZZ Clock USART CPUs I2C DMA SPI Flash RAM OFF ON 10 November 10, 2015 COMPANY PUBLIC SENSOR PROCESSING USE CASES LPC5410x application Mobile phones, tablets & laptops • Saves power by offloading sensor processing from AP; wakes up AP only when required Application Processor • Wake-up on SPI/I2C activities from AP • Hs-mode I2C (3.4 Mbps) Slave interface to AP LPC5410x • Large RAM supports SPI/I2C • Sensor data batching • More simultaneous use cases: context awareness, voice Cortex-M0+ Cortex-M4F detection, indoor navigation Sample core core Sensor data rate Accelerometer 100 Hz RAM SPI/I2C AP interrupts f > 200Hz Magnetometer 25 Hz Gyroscope 100 Hz Example of a batching data burst Rotation vector 50 Hz Acc Mag Acc Lin. Acc. Rotation Reduce AP interruptions, extend AP and sensor hub power down time reduce AP interrupts f > 0.1 Hz power consumption 12 November 10, 2015 COMPANY PUBLIC LPC5410x application Industrial asset monitoring & tracking • Eliminates need for separate MCUs for listening and communication Bluetooth, GPS • Cortex-M4 with FPU for sensor processing ZigBee® and communication • 100 MHz Cortext-M0+ for sensor data aggregation LPC5410x • 12-bit, 4.8 Mbps ADC for high-precision analog sensor SPI/USART interface Cortex-M4F Cortex-M0+ core core • Free motion sensor fusion software 2 • 3.28 x 3.28 mm WLCSP package SPI/SPI/I2ICC ADC POWER 3 µA low power mode with RAM retention for listening Full-spec 4.8 Msps 12-bit ADC over full voltage range: 1.62 to 3.6V 13 November 10, 2015 COMPANY PUBLIC LPC5410x application Health & fitness / portable devices • Extends battery run-time with full spec ADC down to 1.62V LPC5410x Wi-Fi, 3G, • ARM Cortex-M4 with FPU for sensor Cortex-M4F GPRS processing and communication core SPI/I2C Bluetooth, • 100 MHz ARM Cortex-M0+ for sensor data Cortex-M0+ ZigBee® aggregation core Segment or • 12-bit, 4.8 Mbps ADC for high-precision GPIO/SPI graphic display analog sensor interface, full spec over ADC voltage range: 1.62 to 3.6V SPI/I2C POWER Low power mode with RAM retention 100 nA lowest power mode Low voltage down to 1.62 V 14 November 10, 2015 COMPANY PUBLIC CHALLENGES OF INCLUDING SENSORS IN YOUR APPLICATIONS Challenges of including sensors in your applications Need to add 6- or 9 -axis motion to your application, Integrating a sensor fusion library is too complex Low power I do not want to system pay for 3’ party optimization as license fees. Most well as tools to of these vendors measure power will not support consumption all in me anyway one place 16 November 10, 2015 COMPANY PUBLIC LPC54201 Sensor Processing/Motion Solution NOT ACTUAL PICTURE • Includes • LPCXpresso54102 development board • Built-in high-speed USB debug probe • Power measurement tool • Sensor shield board with • Bosch Sensortec sensors: magnetometer, accelerometer, gyroscope, pressure • Maxim ambient light and proximity sensor • ACKme Bluetooth LE module • Optimized for expansion • Stackable hardware supports more sensors or adding plug-in modules • A large set of pinouts for measurement and prototyping • Choice of onboard or external debug probes 17 November 10, 2015 COMPANY PUBLIC LPC54201 Sensor Processing/Motion Solution Flexible board architecture Sensor shield board 3-axis accel 3-axis accel Proximity/ IR remote control 3-axis mag 3-axis mag 3-axis gyro Pressure/temp light sensor/driver BTLE module BMC150 BMM150 BMI055 BMP280 MAX44000 VSOP98260 AMS002 I2C/SPI SPI/timer USART Prototype Expansion connector Header LPCXpresso54102 Expansion connector USB UART, SPI, Link2 debug 2 current probe I C, GPIO, probe ADC inputs I2C, SPI, UART User buttons SWD debug LPC54102 Reset Tri-color User LED Wake ™ 2 I C, SPI ISP Pmod 18 November 10, 2015 COMPANY PUBLIC LPC54201 Sensor Processing/Motion Solution Integrated software & middleware User application (or examples) • LPC sensor framework • Modular and integrated sensor drivers and LPC Sensor Framework sensor fusion library to accelerate product host interface time to market Fusion library adapter • Power management for low power operations BSX Lite SensorHub Kernel • Bosch BSXLite sensor fusion library sensor library API scheduler (RTOS) • Combines sensor data to get more accurate calibration power manager sensor signal or derived sensory information • Supports 6-axis & 9-axis motion vectors data process • Quaternions, heading, pitch and roll data output Bosch sensor drivers driver libraries • Android 4.x support • Commercial and development license I2C/SPI ADC included • Drivers • Bosch sensors Digital Sensors Analog Sensors • LPCOpen driver library 19 November 10, 2015 COMPANY PUBLIC Software Stack BSXlite Library Algorithm Adapter Enter_PowerPLL/IRC- Algorithm_EnableSensor() Hostif_QueueBuffer() Algorithm_Process() Mode() Hostif_SleepOk() Main() Sensor_Process() Sensor_Enable() Sensor_SetDelay() Enter_PowerDownMode() Timer/Power Host I/F Handler Generic Sensor Driver Management init/read/activate/setDelay() Command Tx Ringbuffer getCurrentTime() Kernel Timer Power Handler Management (WDT) Manager Sensor Drivers SensorSensor