Hands-On Workshop: Kinetis MCU-Based M2M and Voip

Kinetis MCU-Based M2M and VoIP Solution for Consumer and Commercial Applications FTF-CON-F0129

David Steele | Arcturus Product Manager Rudan Bettelheim | Business Development Manager

A P R . 2 0 1 4

External Use Agenda

• Introduction to Freescale Audio Solutions • M2M Introduction • Voice Communication Crash Course • Live Demo • Freescale and Arcturus K60 Based Voice IoT Solution • Q & A • Hands on Lab

TM External Use 1 Introduction to Freescale Audio Solutions

TM External Use 2 Freescale Audio Solution Overview

Focus on Mono and Stereo audio with digital interconnect and processing, and multi-channel audio accessories

• Optimized for ARM Cortex-M4 core and Kinetis K family • Wide range of available MCUs with a rich selection of memory, peripheral, and connectivity options • Will support ARM Cortex-Ax (Vybrid and i.MX) families later, primarily for multi-channel applications

• Flexible solution framework for easy configuration and customization

• Basic audio software is free for use on Freescale MCUs • Premium Audio Functions are subject to a software royalty and possibly to licensing from IP owners

• Tower System support for development and rapid prototyping

TM External Use 3 Freescale Audio Solution

Value Added Stereo Dolby DTS/SRS VoIP Others

Audio Widening

Standard Volume Tone Graphic Loudness Sample Rate Audio Control Control Equalizer Control Converter

MP3 AAC HE AAC APE FLAC OGG Vorbis WAV WMA SW Codecs en., de. de. de. de. de. de. en., de. de.

No RTOS (“Bare Metal”) MQX Linux RTOS Kinetis L, Kinetis K Kinetis K, Vybrid Vybrid, i.MX

USB TCP/IP SD I/O Serial Audio

Low Level Stack Stack Driver Drivers Drivers Drivers Audio SoftwareSolutionAudio

MCU CPU DSP DMA Memory HW Codec/Class-D/FM Modulator T Hardware M USB Ethernet SD UART I2S I2S Analog Audio

TM External Use 4 Freescale Audio Solution (FAS) Framework

• Freescale Audio Solution (FAS) Framework is being developed for Kinetis, Vybrid, and i.MX processors • The framework includes functional blocks to deliver media player functionality: − Multimedia Framework with Radio Tuner and CD Support. − CE Device Connectivity supporting MFi, USB, SD and AOAP − External device management and control. − Input management and control for touch screen, buttons and knobs. − HMI Framework − Bluetooth Stack and Profiles with AEC/NS (HFP, A2DP, AVRCP) • Using an OS Abstraction provides platform support on MQX and Linux* and can be modified to work with any modern operating system

TM External Use 5 AA Solutions Framework and Components

Accessory Speaker Value Added Stereo iOS App EKG Altimeter MCU Firmware Others Dolby DTS/SRS VoIP Others Dock Audio Widening (Examples) Update Accessory Accessory Sensor Actuator Digital Audio

GUI EKG Altimeter MCU Firmware System System Processing e Update

Software r

Standard Volume Tone Graphic Loudness Sample Rate e

r a

Control Control Equalizer Control Converter a Lightning

w Audio 30-pin

f o

o MFi Interface

MP3 AAC HE AAC APE FLAC OGG Vorbis WAV WMA SW Codecs e Software

n en., de. de. de. de. de. de. en., de. de.

t l

No RTOS (“Bare Metal”) MQX Linux n

I o

RTOS No RTOS (“Bare Metal”) MQX Linux

Kinetis L, Kinetis K Kinetis K, Vybrid Vybrid, i.MX i

S RTOS Kinetis L, Kinetis K Kinetis K, Vybrid Vybrid, i.MX

M i

d USB TCP/IP SD Serial Audio I2C USB TCP/IP SD I/O Serial Audio I/O Drivers Low Level

u Low Level Stack Stack Driver Drivers Drivers Driver Stack Stack Driver Drivers Drivers Drivers A CPU DSP DMA Memory HW Codec/Class-D/ MCU T FM Modulator Hardware M MCU CPU DSP DMA Memory HW Codec/Class-D/FM Modulator I2C USB Ethernet SD UART I2S I2S Analog Audio T Hardware M USB Ethernet SD UART I2S I2S Analog Audio Dock Connector

Freescale Audio Solution (FAS) Framework Architecture

Customer Applications

Common Audio Framework API f

Playlist / Media r

i e

Media Media Media e Accessory g

t Speaker g Android App e Play Device MCU Firmware FAS a EKG Altimeter Others

O Dock

a r

u Player Browser Indexing (Examples)

n Update l

Queue Support n a

a Framework

a o

Accessory M

/ Accessory Sensor Actuator Digital Audio

e M

GUI EKG Altimeter MCU Firmware S

t r

OS Abstraction Layer e System System Processing

f Update a Software

i o

i t

rd r

f e Additional 3 Party OS n

I d OS Linux o Audio Decoder* MP3 AAC HE AAC APE FLAC OGG Vorbis WAV WMA

MQX i D

Support (uItron) S u (for USB MSC only)

r A p Android Open Accessory Protocol (AOAP) USB TCP/IP SD I/O Serial Audio o USB Mass Storage Class p Accessory • Device and AOA Detect USB Host s (requires audio decoder) Driver s mode Stack s • Audio Streaming (does not support device Low Level Stack Drivers Drivers Drivers Interface e • HID playback support based playback control) streaming

c Software • HID App and Accessory communication

c A HW Codec/Class-D/FM Modulator

MCU /MPU d No RTOS (“Bare Metal”) MQX Linux TM DSP DMA Memory i RTOS Kinetis L, Kinetis K Kinetis K, Vybrid Vybrid, i.MX Hardware o

USB Ethernet SD UART I2S I2S Analog Audio r d

n I2C USB TCP/IP SD I/O Serial Audio

A Low Level Driver Stack Stack Driver Drivers Drivers Drivers

Platform CPU DSP DMA Memory HW Codec/Class-D/ rd MCU T FM Modulator AA Team 3 Party Hardware M Teams Other I2C USB Ethernet SD UART I2S I2S Analog Audio USB/MHL Connector

TM External Use 6 Accessories and Digital Audio MCUs and MPUs

ARM Cortex A9 Media Library Browsing, i.MX6 Complex Audio Processing, family

Multi-channels Audio ARM ARM9 OS Linux i.MX2 Cortex-A5 family and Cortex-M4 Vybrid 2 channel Audio Processing, family USB, Ethernet, Wireless ARM

Connectivity RTOS MQX Cortex- M4 Kinetis K

Basic Audio family Processing

ARM RTOS

Cortex- OS No USB Digital M0+ Audio Streaming Kinetis L Lite MQX family

TM External Use 7 Target Audio Applications

Mono and Stereo audio with digital interconnect and processing, and multi-channel audio accessories • MFi Speaker Docks • MFi Accessories • Android Speaker Docks • Android Accessories • SoundBars • Portable audio recorders • Gaming Headsets • Networked audio endpoints • USB microphones • USB speakers • XBOX Accessories • Musical effects equipment • Professional audio equipment • VoIP Intercom systems • VoIP Public Address (PA) systems • VoIP telephony • Automotive after market audio • And many more, let your imagination run wild

TM External Use 8 Target VoIP Application Areas

• Digital Intercom Systems • Digital Public Address (PA) Systems • IP Telephony • Voice Control Systems

TM External Use 9 VoIP System Overview

Hardware Software Hardware

RTOS

(MQX)

Protocol

Vocoders Stacks Ethernet Microphone Audio Call Control G.711 and MAC & PHY

CODEC and Signaling Internet

G.722 Low Level (wired or

Analog (AEC) (SIP)

OPUS Drivers Wireless)

API API API SSI

(TCP/IP)

Ethernet Speaker Analog to Digital Voice Call Setup Packet Handling Bit Transmission and Compression and Control and Streaming and Reception Digital to Analog and Conversion Decompression

Freescale Kinetis based VoIP Solutions

CODEC MCU/MPU PHY

TM External Use 10 VoIP System Software Overview

RTOS/OS: MQX or Linux Management MiddleWare from Arcturus including web user interface, remote provisioning, voice response

Hardware Software Device Management Hardware Analog to Digital Voice RTOS (MQX) and Compression Digital to Analog and Call Setup Packet Handling Bit Transmission Conversion Decompression and Control and Streaming and Reception Microphone Protocol Stacks Ethernet Call Control and

MAC & PHY

Audio CODEC Vocoders and Signaling Low Level

(wired or Internet

Analog (SIP) Drivers

API API API SSI Wireless)

(TCP/IP)

Speaker Ethernet

Partner: Consilient Technologies Partner: Arcturus Supplied as binary, with some OpenSIP based telephony/media MiddleWare parameters (such as echo solution from with proprietary components. cancelation) tunable. Suitable for 1 or Open source portions supplied as source code, Part numbers include software 2 Audio channel applications. proprietary portions as binary. licenses and technical support Algorithms supported: Telephony application includes support for: G.168 LEC, AEC, DTMF, CPT, AGC, Caller-ID, Call Waiting, Hold/Retrieve, Call G.711, G.722 Transfers, Conference, Hotline, Push-to-Call, Speed Dials, CID Privacy, Outgoing Call Blocking, Call Back on Busy…

Software solution is supplied as a fully integrated and tested package

TM External Use 11 Freescale VoIP Solutions History and Roadmap

Kinetis (ARM Cortex-M4) MCU Intercom Analog Telephone PA, IP Telephony Adaptor (ATA) Kinetis K60 120 Kinetis K60 100

MHz RTOS MQX MHz

ARM Cortex-Ax MPU

Proposed

Intercom Linux OS Linux ColdFire V3 MPU PA, IP Telephony MCF53281 MCF5301x MCF53271

Analog Telephone

ColdFire V2 MCU Adaptor (ATA) MCF52268 MCF5227x OS No

TM External Use 12 Kinetis K60 VoIP and IoT System

Hardware K60 MCU Software Hardware

Bit Transmission Application Framework (future) and Reception Designed for: Discovery M2M Agent Device Virtualization •

Public Address Systems

g M2M

. Management .

o Ethernet

l S a Audio VoIP\SIP Stack Middleware

2 MAC & PHY

n Vocoders I

Network A Subsystem ASIC , Subsystem I (wired or

A • Intercom Systems

S Wireless) MQX Voice 1011011 Inputs / Output Digital I/O File system • Controls Protocols, Drivers IP Telephony Interrupts Services Processes Interfaces M2M 1011011 Sensors/SCADA Peripherals Scheduler, Timers Serial − Includes optional IoT 1101101 Wired/Wireless (I2C, UART, SPI) Host Firmware and Database remote monitoring and control

MQX MCU Middleware Software solution is preloaded − Developed and supported and provided as binary by Freescale partner

Connector Console I/O Isolation Arcturus Networks SDcard Network Spark Gap + Component TVS +12VDC Slot PoE − Module and development GPIO – Output Network LEDs system is available at: Transformer Network − http://www.freescale.com/ Transceiver GPIO – Input Push Buttons Reset / webapp/sps/site/prod_su Watchdog mmary.jsp?code=ARCT- Kinetis K60 I/O Connectors VoIP MCU K60VOIP-

Expansion Connectors RTC BATT KT&fsrch=1&sr=4 Holder Reset Button

Audio Head- Line Line Mic L Mic R Speaker 15W ASIC phones Out In Outputs Class-D Amp

TM External Use 13 Professional Services Focus UI & Software Services Applications • Linux, Android, MQX BSP’s, Middleware Audio Framework − Customization

− Integration

− Development FSL BSP − Porting

Drivers − Testing Software OS Kernel − Optimization

− Issue analysis, Debug & Fix • Long-term support on Customer Board

Hardware Services

Hardware MSS Primary Area Primary Focus MSS • Schematic and layout optimization & review Kinetis Vybrid i.MX • Simulation Solutions Solutions Solutions • On-site board bring-up MSS Architecture Focus Area

TM External Use 14 Services Development Methodologies & Quality: Engineering Discipline

integration define design develop and test deploy

• Requirements • Design • Custom • Testing • Knowledge Gathering Consulting Development Transfer • Documentation • Project • System • Porting / • Project • Performance Assessments Consulting Migration Specific Testing Support • IP Selection • Architecture • Integration • Performance (3rd Level) Optimization • Maintenance

• Performance Tuning

Quality Assurance (ISO, CMMI & SPICE Level III)

TM External Use 15 M2M Introduction

TM External Use 16 M2M Introduction

What is M2M? • Machine to Machine communications • Autonomous – no human interaction • Targets networks of connected sensors, actuators and end-points (IoT) • Application layer protocol • Device-to-host or device-to-device interaction • Various wired or wireless networks • Consumer and industrial applications • M2M is to IoT what html is to the web

What does it do? • Provides centralized method to interact with devices via common host • Provides personalization, presentation via host • Enables subscription based services • Enables device collaborations and connected intelligence • Eliminates the need for “expensive” http GUI on device • Results in a disruptive technology that creates desire and value

TM External Use 17 Why is M2M the MTV of Technology?

TM External Use 18 MTV

The birth of the music generation… • In 1981 music was music and television was television • Virtually no music videos existed • No legitimate cable network would host them • No TV executive believed the consumer would pay a premium for a music television service • Had virtually no network coverage

• Record companies saw it as a threat

How did it become so successful? • Confluence of factors: • Gross underestimation of consumer desire • Cable companies saw a spike in second jack installation in rec- rooms and bedrooms. • Record sales spiked in areas serviced by MTV • Bands realized videos led to exposure

• Record labels began providing videos for free to MTV

TM External Use 19

M2M and IoT

The birth of the IoT generation…. • In 2011 was limited to industrial applications, cellular backhaul, satellite, SCADA • in 2011 the web was for websites - apps were for services, not device interaction • Virtually no cloud services suitable for telemetry data • No executives believed the consumer would pay a premium for a thermostat controlled by a phone • Traditional device manufacturers were not in the business to provide backend services • No wide spread solution to control devices on a remote network

Why will it be successful? • Confluence of factors: $300 and “sexy” • Gross underestimation of consumer desire • Ubiquity of the $500+ free user interface • Carriers saw it as a great way to expand data usage • Equipment manufactures saw it as way to enable back end services • Cloud service provides saw this as a great way to utilize capacity by aggregating connectivity and data – even free (to start)!

TM External Use 20 There is Value in Adaptation…

1 1 1

1 1

1 1 1

1Source: 10 Great Companies That Lost Their Edge - US News.com

TM External Use 21 The Capabilities of M2M

Connection

Telemetry Configuration

Maintenance Control

TM External Use 22 Markets and Applications

Industrial Consumer

• SCADA systems • Home control / HVAC • Building systems • Fitness and wellness • Smart metering /energy • Home security • Digital signage/ PoS • Wearables • Environmental monitoring

Transportation Healthcare

• OnStar • Biometrics • Fleet and asset tracking • Assisted living • DBS-II reporting • Nurse call • ACARS • Telehealth

TM External Use 23 M2M / IoT Connectivity Overview

Technology Spectrum / Data Manufacturers Benefit Challenge

Satellite 1(min)-8Kbyte (max) Orbcomm, Tecom •Truly global •Line of sight 5-60 seconds latency Skywave, Inmarsat, Hughes, •Low earth orbit (LEO) •Low data payload MHz to Ku-band 12-18GHz Irridium , Globalstar •Geostationary •Expensive •Modems only Cellular CDMA/GSM (2G/3G), EDGE, Telit, Moxa, Sierra, Motorola, •Global deployment •Compatibility across LTE, up to megabits/s 1.4, 3, 5, Siemens, Qualcomm, Cinterion networks - VNOC (such as 10, 20MHz Kore) •Certification / cost Wireless LAN 802.11bgn, 2.4GHz – 5GHz Qualcomm, Redpine, Gainspan Ubiquity , No on-going Configuration , certification up to megabits/s cost, high data rate, Low-power, indoor secure Wired LAN N/A Various •Ubiquity, no on going •Security, fixed Up to gigabit/s cost, reliability BT / BLE 2.4GHz, BLE up to 50m, Stonestreetone, CSR, •Security •BLE not suitable for audio 0.27Mbit/s, BT up to 100m, Panasonic, STmicro, •Low power modes •Indoor, Pairing 0.7-2.1Mbit/s ConnectBlue, Microchip, Atmel, Muli-Tech Power line Powerline PLC 9-500KHz up to Qualcomm / Atheros, ST micro, •Security •Fixed, certification , setup 576Kbps Homeplug - 28,30, Sigma Designs, Broadcom, 86MHz 500Mbps Mstar ISM 260-470, 860-960MHz, 2.4- Digi, Linx, Silicon Labs, •Easy to integrate •Security 2.5GHz, 10Kbps up to 900m Microchip, Micrel •Does not require •Roll your own stack product cert Zigbee / 868MHz, 915MHz, 2.4 Freescale, CEL, Panasonic, Low power, mesh •Low data rate, latency , not 802.15.4 20kbps-250kbps Digi, Silicon Labs, Atmel protocol, low cost, suitable for audio 10-20m security

Other DECT, MESH…TM 900MHz, 1.9GHz 2.4GHz, •Good for specific Various External Use 24 applications M2M Public Network Model

Cloud Service Application & Aggregator Business Logic

salesforce.com 2lemetrey Hosts

Mobile

M2M HTML or JSON Internet TCP/IP or UDP Fixed

Devices Clients

TM External Use 25 M2M Private Network Model

Aggregator Application & Edge Node Business Logic (services)

Hosts Internet

Mobile

M2M LAN or HTML or JSON Carrier / Fixed TCP/IP, UDP, PPP Metro

Devices Clients

TM External Use 26 Kinetis Secure System Overview Leading edge security technology on general purpose MCU

Flash Security: chip Protected Wire • Protected against X-ray data reads Vcc GND • User backdoor access disable • Factory access disable B A B A • Mass erase disable • Multiple transfers from Flash to config register PCB

Memory Protection Unit (MPU): • 16 areas, supervisor/user (config registers are fully accessible) Enablement: Tamper Detection (with battery backup): • High Assurance Boot (HAB) with tools • Integrated sensors • Crypto stacks • Frequency • Voltage Secure storage: • Temperature • 256 bit user area, erased by tamper event • 4x passive external tamper sources (inputs) • 128 bit unique chip identifier • 2x active external tamper sources (2x output and input) Secure Real Time Clock (RTC): Cryptographic Acceleration Unit (CAU): • Monotonic • Symmetrical crypto • Overflow and reprogram protection • Hashing functions • Random Number Generator (RNG) Hardware Cyclic Redundancy Check (CRC)

TM External Use 27 Integrated Tamper Detection

Tamper Detection (with battery backup): • Integrated sensors – − Frequency − Voltage − Temperature • 4x passive external tamper sources (inputs) − For use with external sensors (e.g. micro switch, pressure sensor) • 2x active external tamper sources (2x output and input) − Generates pseudo random test signal, and monitors for corruption • 256-bit secure user storage (key), erased on tamper • Secure monotonic real time clock chip Protected Wire Vcc GND

B A B A

PCB

TM External Use 28 Software IP Protection

• MPU Security Systems (e.g. i.MX25) − Offers protection for all data in system Integrated Peripherals FLASH −

Prevents data and software U

A CPU C

corruption/manipulation

− Prevents system impersonation t

e S − Does not – Protect software from being copied SRAM

• MCU Security Systems (Security Bit): − Protects software from being copied − Offers protection of all data in system − Systems with Block Erase Disable (e.g. Kinetis) prevent impersonation

TM External Use 29 i.MX Trust Architecture – Overview

GPIO External Alarm Memory

i.MX

Tamper Erase Secure Secure Peripheral Detect RAM Clock Slave

HW Firewall HW Firewall HW Firewall HW Firewall

HW Firewall SW Alarm ARM Accelerator ROM CPU (Cipher, Hash, DMA (High Assurance RNG) Master Boot)

Debug Alarm Secure Electrical Fuses Debug (Keys, Security Levels)

JTAG

TM External Use 30 Trusted Execution – Hardware Features

• HW system partitioning Non-Secure World Secure World • ARM TrustZone General Trusted − Secure & non-secure worlds Application Service User − Multicore support Mode • Memory isolation Rich OS Trusted OS Privileged − Virtual & physical Mode • Peripheral isolation − Master & slave General General Protected Trusted • Interrupt separation Hardware Peripheral DMA Peripheral DMA

• Watchdog protection General RAM Protected RAM

TM External Use 31 Trusted Execution – Physical Memory Isolation

HW Firewall • Monitors internal bus to external memory controller − Secure world access only vs shared access • Programmed by secure world

General Trusted SW SW

HW Firewall

General RAM Protected RAM

TM External Use 32 Trusted Execution – Peripheral Isolation

HW Firewall • Monitors peripheral access − Secure world access only vs shared access • Monitors DMA transactions − Secure vs non-secure privileges • Programmed by secure world

General Trusted SW SW

HW Firewall

General General Protected Trusted Peripheral DMA Peripheral DMA

TM External Use 33 High Assurance Boot – Operation

Secured Environment Run OS SW Image Compare Reload Image X Hash

Public Verify Hash Fuse Key (RSA) SRK Sign Private (RSA) Key

Device Boot SW Image + SW Image + Signature Signature

TM External Use 34 High Assurance Boot – Encrypted

Build Environment Decrypted SW Image SW Image

Secret Key Decrypt OTP (AES) Secret OTP Key Key Encrypt Key Decrypt AES

(AES) (AES) Key Key Blob

Manufacturing

Key Blob Key Encrypted Encrypted SW Image SW Image Device Boot

TM External Use 35 Arcturus empower embedded.

Voice Communication Crash Course

Presented by: David Steele, Product Manager Proprietary and confidential - subject to change [email protected]

Three Modes of Voice Communication

Application Control Media S.Rate Data Vocoder Benefit Challenge kHz VoIP Two-way voice SIP, RTP 8/16 8-64Kbps, G.711a/u, Call Audio intelligibility, Handsets Legacy: (unicast) 20mS G.726, G721, distribution Latency Speakerphones H.323, packets G.722, G.729 Intercoms MGCP Speex, iLBC, OPUS Audio One-to-many voice Proprietary RTP 8/16 8-64Kbps, G.711a/u, One stream to Traversal, TTL, Distribution Mass notification control (multicast) 20mS G.726, G721, many Latency, Background Music packets G.722, G.729 receivers with Synchronization PA Announcement Speex, iLBC, one stream Baby monitors OPUS

Pre-recorded Progress and status MTP or simple filesystem 44.1 - MP3 or other Audio Changing files information access intelligibility

TM External Use 37 SIP Stack Overview

SIP - Session Initiation Protocol Mary Proxy Server Steve • UDP based control protocol for VoIP INVITE INVITE 180 Ringing RING • Human readable / text based similar to html 180 Ringing • Starts / stops and changes media session ANSWER • Includes media negotiation (SDP) 200 OK 200 OK ACK • Relies on RTP for media transport ACK • Client / Server (CAS/UAS) Conversation BYE HANG • SIP METHODS are like “extensions” to the signaling 200 OK UP − – INVITE, ACK, REGISTER, BYE, INFO, OPTIONS, REFER, SUBSCRIBE/NOTIFY • Uses port 5060 or port 5061(TLS) • Can be TCP

TM External Use 38 SIP Invite

TM External Use 39 Media Stack Overview

RTP – Real Time Transport Protocol for media • UDP RTCP – Real Time Control Protocol for media sessions • Exchanges data between two end-points (or server and end-point) • Latency / dropped packets DTMF • SIP INFO, RFC2833, in-band STUN / TURN / ICE • NAT traversal and firewall port keep-alives Security • SIP TLS

− 128bit AES

− Cert required at server • sRTP – Negotiated as part of the SDP by SIP

− 128bit AES

− SHA1-80 hash on each outbound packet including sequence number • zRTP – Negotiated as part of the RTP itself

Signaling and media are totally separate

TM External Use 40 SDP–Media Negotiation

offer/answer – first matched pair

TM External Use 41 Relation Between Peer-to-Peer and Infrastructure

Mode Services Application Benefits Challenges

Infrastructure •Authentication •LAN Networks •Flexibility •Signaling compatibility •Location •WAN Networks •Leverage existing VoIP •Single point of failure •Availability/Presence •Building Systems equip •Requires expertise to set up •Transcoding/Compatibility •Nurse call •LAN or WAN service •Call Distribution •Transportation •Voice mail •Service kiosks •Termination to other networks Peer-to-Peer Calling only •Small installs •No additional equipment •Limited to “hard coded” •Home Intercoms required installs •Door phones •No single point of failure •No authentication •Baby monitors •No central reporting •Auto config or discovery •LAN only •One call at a time Hybrid All services •Intercom with •Can provide failover Vulnerable emergency call out •Can offer local vs function outbound calling with no server

TM External Use 42 Private VoIP Network

Remote Site

VoIP VPN End Point PBX

SIP

LAN SIP VoIP VoIP End Point End Point

TM External Use 43 VoIP Cloud Service Model

PBX Gateways or Softswitch PSTN, IMS,3GPP

VoIP MSO Carrier

PSTN Fixed SIP

TCP/IP, UDP Cable/DSL Internet Mobile Mobile SIP SIP VoIP Residential End Point Network

TM External Use 44 Multicast RTP

Page: 45

Packet Field Description sig Packet signature callid Call ID to display callname Call Name to display group Broadcast group ID pgtype Message Type codectype RTP vocoder used codecptime Vocoder packet length in ms codecsrate Codec sample rate in Hz IP Multicast IP address of RTP media transmission port Multicast port number of RTP media transmission priority broadcast message priority type answtype auto-answer priority entype encryption algorithm encparm encryption parameters waitlen time to delay before alert tone tonelen Alert tone length tonetype Alert tone type tonecadence Alert tone cadence tonefreq DTMF Alert tone frequencies tonemodfreq Alert tone modulation frequency tonegain Alert tone gain

TM External Use 45 Arcturus empower embedded.

Live Demo

Presented by: David Steele, Product Manager Proprietary and confidential - subject to change [email protected]

Arcturus empower embedded.

Freescale and Arcturus K60 Based Voice IoT Solution

Presented by: David Steele, Product Manager Proprietary and confidential - subject to change [email protected]

Kinetis K60 | VoIP MCU

Features and Benefits  VoIP Intercom (PIP) firmware – using SIP / RTP  Public Address (PAS) firmware – Using multicast RTP  Kinetis ARM Cortex-M4 120MHz MCU  Boot and ready to call in under 10 seconds  No external flash or RAM required  Narrow and wide-band vocoder support  Dedicated I/O for control, status and event reporting  Mbarx-M2M protocol for supervision and remote operation  Mbarx-M2M host, slave and peripheral on-boarding  Mbarx site-wide configuration and maintenance tools  No upfront NRE, no complex BSP, no expensive tools  No MCU firmware development required  Modules, development kit and reference design available  Suitable for operation in harsh environments (-40 to +85C)

TM External Use 48 Proprietary and confidential uCMK60 System

Hardware K60 MCU Software Hardware Bit Transmission Application Framework (future) and Reception

M2M Discovery

M2M Audio VoIP\SIP Stack M2M Agent Ethernet Subsystem Vocoders MAC & PHY

Analog Networ ASIC M2M Middleware (wired or k SAI, I2S... SAI, MQX Wireless) Voice 1011011 Inputs / Output Digital I/O File system Controls Protocols, Drivers Interrupts Services Processes Peripherals Interfaces Scheduler, 1011011 Sensors/SCADA M2M (I2C, UART, Timers Serial Wired/Wireless Host 1101101 SPI) Firmware and Database

M2M Slave MQX Operating System VoIP Middleware Peripheral Device Mbarx Middleware External Host or Peripheral

Software solution is preloaded and provided as binary

TM External Use 49 uCMK60 Block Diagram

Features EXPANSION I/O SDCARD SERIAL DEBUG Core Processor • Freescale Kinetis K60 MCU • 120MHz ARM Cortex M4 with DSP instructions • 1MByte internal Flash / 128K SRAM SUPERV I/O 802.11BGN BLE RS232 CLOCKS WDOG ISOLATION WLAN (BT4) System • RS232 • PoE - 802.af Power over Ethernet USB I/O UART(6) SDHC CAN • 10/100 BaseT Network Transceiver • Optional 802.bgn WLAN or BLE (Q1 2014) DMA • 15W Class-D Amplifier / Audio Subsystem ASIC SRAM RTC WDOG • External Watchdog Controllers and Reset Monitor ARM® 1MBYTE External Connections: CORTEX TIMERS FLASH • Power input M4 INT NAND DAC/ADC • RJ45 Network Connector (802.3af PoE) CACHE JTAG • DB9 Serial Connector (RS232 or RS485) • Up to 8 digital inputs and 8 outputs (isolated) FEC SPI(3) SAI (3) I2C (2) • SDHC card slot connector Kinetis K60 MCU • Realtime Clock – Battery Holder • Leds / Status / Push Buttons SI3050 10/100 RTC AUDIO CLASS-D POWER / Expansion Terminations POE PHY BATT ASIC AMP RESET • Up to 5 UARTS, SPI, I2C, SAI, CAN, DAC / ADC, uCMK60- Module Touch Sense, USB, SDHC, JTAG • Additional dedicated I/O for control and events 802.3AF POE NETWORK AUDIO +12VDC

uCMK60 System Solutions Board and Dev Kit

TM External Use 50 uCMK60 | System Solutions Board

Connector Console I/O Isolation SDcard Network Spark Gap + +12VDC Component Slot PoE TVS

GPIO – Output Network LEDs Transformer

Network Transceiver GPIO – Input Push Buttons Reset / Watchdog

Kinetis K60 I/O Connectors VoIP MCU

Expansion Connectors RTC BATT Holder Reset Button

Audio Head- Line Line Mic L Mic R Speaker 15W ASIC phones Out In Outputs Class-D Amp

TM External Use 51 VoIP Firmware (PIP Mode)

VoIP / PIP Firmware Features Features •Call originate • Suitable for intercoms, handsets, speakerphones •Accept or reject call •Terminate • SIP based VoIP end-point with two-way, low-latency, real-time voice •Call ID • SIP infrastructure (SIP server) and Peer to Peer (P2P) modes •Call transfer •Call forward • Call progress announcements •Call hold / Retrieve •Do not disturb • G.711ulaw, G711alaw and G.722 vocoders •Auto answer • 16bit, 16KHz PCM audio Interface •Auto hang up •Input source select • Acoustic Echo Cancelation (AEC), Noise Reduction (NR) •G711, G.722 speech codec • RFC2833 DTMF via RTP event presentation •20mS packetization periods •Mute and volume controls • 10 PTC (push-to-call) numbers assigned to dedicated I/O •Jitter buffer •Acoustic Echo Cancellation • Dedicated I/O for status and call control (stateless) •Noise Reduction • Optional MIC Beam Forming, far-field microphone pickup, auto gain control (AGC), •Auto Gain Control Range Compression, Loudness Adaptation •RFC2833 DTMF Presentation SIP Methods • Optional HARC – background acoustic sensor and event detection •INVITE, ACK, BYE, OPTIONS, NOTIFY, REFER, REPLACES • Mic In, Line In, Line Out, Headset Out, Powered Speaker Output Signalling and Media Transport • Autonomous, Supervised or Controlled Operating Modes •SIP / RTP •UDP transport

SIP / RTP SIP / RTP SIP / RTP SIP Server

SIP P2P (Peer-to-Peer) SIP Infrastructure

TM External Use 52 Push Buttons and LEDs

O8 – Spare IN8 – Spare

O7 - Spare IN7 – Spare

O6 – Supervised IN6 – Reset

O5 – External AMP IN5 – Mic Mute

O4 – Alarm IN4 – Volume Down

O3 – Network Ready IN3 – Volume Up

O2 – Ringing / Call IN2 – Terminate

O1 – Reg/Ready IN1 – Push to Call 1 (PTC) Outputs I/O interface provides stateless operation Inputs

TM External UsePIP 53 / VoIP mode firmware Dedicated MCU I/O Signals

Push-to-Call (PTC) Input 1 / Answer Registered / Ready Terminate Call-in-Progress / Ringing Speaker Volume Up Network Ready Speaker Volume Down Alarm MIC Mute toggle External Amp Enable SW Reset Application Connected Connected to isolation & Spare (user) Spare (user) Connected to LEDs on push buttons on System Spare (user) Spare (user) System Solutions Board Solutions Board Hook State (off hook) Additional Additional DND toggle RING (dedicated) MCU Signals MCU Signals Call forward enable toggle MIC mute enabled Speaker mute toggle DND enabled Answer call (dedicated) Speaker mute enabled Factory reset (dedicated) Call forward enabled PTC Input 2 PTC Output 2 PTC Input 3 External Door Lock Signal (DTMF) PTC Output 3 PTC Input 4 Message Waiting Indicator (MWI) PTC Output 4 PTC Input 5 Unassigned / Future Use PTC Output 5 PTC Input 6 Unassigned / Future Use PTC Output 6 PTC Input 7 Unassigned / Future Use PTC Output 7 PTC Input 8 Unassigned / Future Use PTC Output 8 Inputs PTC Input 9 Unassigned / Future Use PTC Output 9 Outputs PTC Input 10 PTC Output 10

TM External UsePIP 54 / VoIP mode firmware Audio Distribution (PAS) Firmware

Multicast Audio Distribution / Public Address (PAS) Features • Suitable for IP speakers, mass-notification, background music • Supports one-to-many audio distribution • One way real-time audio via multicast RTP • Light-weight, out-of-band multicast signaling protocol • Protocol supports unique messages per channel/group • Up to 100 unique groups with concurrent paging support • Receivers can subscribe to any combination of groups • Last-in-wins arbitration • Auto disconnect on lost keep-alive messages (stuck mic protection) • Auto pick-up on lost start messages (late arrival protection) • 16bit, 16KHz PCM audio Interface • G.711ulaw optional G.722 and Opus (coming soon) • 10 paging groups assigned to dedicated inputs • 10 dedicated outputs for status and control (stateless) • Mic In, Line In, Line Out, Headset Out, Powered Speaker Output • Autonomous, Supervised or Controlled Operating Modes

TM External Use 55 Push Buttons and LEDs

O8 – Spare IN8 – Spare

O7 - Spare IN7 – Spare

O6 – Supervised IN6 – Reset

O5 – External AMP IN5 – Mute / DND

O4 – Alarm IN4 – Volume Down

O3 – Network Ready IN3 – Volume Up

O2 –PA in Progress IN2 – Terminate

O1 –Group 1 Listen IN1 – Group 1 Listen

Outputs I/O interface provides stateless operation Inputs

TM PASExternal / Audio Use 56 Distribution mode firmware Dedicated MCU I/O Signals

Group 1 Listen Group 1 Listening Terminate PA In Progress / Active Speaker Volume Up Network Ready Speaker Volume Down Alarm DND/Mute External Amp Enable SW Reset Application Connected Connected to isolation & Spare (user) Spare (user) Connected to LEDs on push buttons on System Spare (user) Spare (user) System Solutions Board Solutions Board - Additional Additional - - MCU Signals MCU Signals - - - - DND enabled - - Factory reset (dedicated) - Group 2 Listen Input Group 2 Listening Output Group 3 Listen Input External Door Lock Signal (DTMF) Group 3 Listening Output Group 4 Listen Input - Group 4 Listening Output Group 5 Listen Input Unassigned / Future Use Group 5 Listening Output Group 6 Listen Input Unassigned / Future Use Group 6 Listening Output Group 7 Listen Input Unassigned / Future Use Group 7 Listening Output Group 8 Listen Input Unassigned / Future Use Group 8 Listening Output Inputs Group 9 Listen Input Unassigned / Future Use Group 9 Listening Output Outputs Group 0 Listen Input Group 0 Listening Output

TM PASExternal / UseAudio 57 Distribution mode firmware Mbarx-M2M End-Point Software

MDNS Service Discovery ASD Protocol Announcement get status> …Device name… I/O notification …Device location… Event notification …MAC address… set output> …IP address… M2M Discovery UART2Net … Firmware version… display message … Operating mode… M2M Agent set configuration Other… update firmware M2M Middleware

Provides OS abstraction File system Protocols, Interrupts Supports TCP/IP and Drivers Processes UART Communication Services Scheduler, Supports , envars / Interfaces objects, license keys Timers firmware sector management / auto Firmware and Database failover

TM External Use 58 Proprietary and confidential Mbarx Autonomous Mode

Autonomous (unsupervised) Mode • For standalone applications • Ideal for simple handsets, service kiosks, intercoms, door intercoms • Uses I/O call control interface (dedicated MCU signals) • Inputs can be used for device operation, place/receive calls, volume controls, basic features • Outputs can be used as status indicators or for external equipment • Requires limited external integration (mic /speaker / push button..) • Suitable for supervision or operation by I/O block /PLC

SIP / RTP Autonomous (supervised) Mode • Report events through M2M End-point End-point • Does not rely on M2M for command and control • M2M may override

I/O Event SIP / RTP

Call Connected

End-point M2M Host End-point

TM External Use 59 Proprietary and confidential Mbarx Controlled Mode

Controlled Operating Mode: • For applications that require integration into a workflow system • Nurse call, security alarm, building systems, public safety, transit communications, aviation, military, RoIP • Uses an M2M interface (Mbarx) connected to a host system • Digital inputs are reported as events over M2M • Digital outputs can be controlled by M2M • Call control over M2M includes originate, answer, progress events, volume controls... • M2M is suitable to control connected devices such as visual indicators, door locks, horns/bells, strobes, external equipment… • Supports work-flow integration and persistent or ad-hoc supervision

I/O Event Startcall SIP / RTP Call Connected

End-point M2M Host End-point

TM External Use 60 Mbarx–ASD Protocol

+ ------+ | asd: Arcturus Socket Daemon 1.0 | + ------+ date: 1970-01-01 00:04:40

State/Status – Call (SC) Executing from Program Flash Block 0 SC State/Status – Registration (SR) SC[NOT_CONNECTED] SR SR[REGISTERED sphone.vopr.vonage.net 14168487156 Call Start (CS) "14168487156"] CS 14166210125 CS[OK] Notification Call Status (NC) NC[OUTGOING_CALL 14166210125] NC[EARLY_MEDIA] Notification GPIO (NG) NC[CONNECTED 14166210125] NG[GPIO: O 2 ON] State/Status – Call (SC) NG[GPIO: O 5 ON] SC Call End (CE) SC[CONNECTED 14166210125] CE Notification GPIO (NG) CE[OK] NG[GPIO: O 5 OFF] Notification Call Status (NC) NG[GPIO: O 2 OFF] State/Status Check (SC) NC[NOT_CONNECTED] SC SC[NOT_CONNECTED]

TM External Use 61 Mbarx–System Manager

Mbarx End-Points

Mbarx-M2M

Configuration / Firmware Device/Service Discovery Consolidated system wide view of all devices: Firmware version, operation modes, availability Site wide configuration and maintenance

Available for Windows® and Mac®

FREE Eval. – Available from support site Click through workflow for upgrades, configuration status checks , logging

TM External Use 62 Mbarx–Virtual Control Panel (VCP)

Connection information and setup Remote M2M Console for debug and status

Click-to-call and call control interface

FREE – I/O Status and control Interface Available from Reference for Windows or Mac Host Integration support site Source Code Provided (QT + Python)

TM External Use 63 Mbarx–Operations Controller

3rd Party IP Devices/Data

IP Data

Mbarx-M2M Command / Control Events and Notifications HTML5 Central, Fixed or Mobile Operations

Available for Windows and LinuxTM Wireless or Wired

Mbarx End-Points

Mobile Operations Clients Central (fixed) Operations Clients (HTML5) (HTML5)

TM External Use 64 Mbarx–Operations Controller

As displayed on an iPad®

VoIP and call status

SIP Account (extension) M2M interface status

VoIP operation Device info, name location, MAC/IP Integrated mJPEG 3rd party IP camera

Digital I/O controls

Developer

Integrated camera PTZ camera controls

TM External Use 65 Kits and Boards uCMK60-VoIP Development Kit includes: • uCMK60 System Solutions Board • Power supply, cable kit and headset • Getting Started Guide • Out-of-the-box demos • Access to dedicated support site (1 year) • Schematics and documentation • Mbarx-M2M QT Example implementation (FREE) • Mbarx-M2M System Manager tool (FREE eval) • Tutorial videos • Installation support (email) uCMK60-VoIP System Solutions Board • Available as production ready alternative to RYO • Available in low and medium volume • Fits standard 100mm wide enclosures including Hammond Manufacturing 1455 series extruded aluminum • Pads for direct solder-to-board or header connectivity

TM External Use 66 Modules and Daughtercards

Module Development kit add-ons

\\\\\\\\\\\\\\\\\\\

Atheros 3x4+2 I/O inputs uCMK60-VoIP-MOD QCA4002 802.11bgn 15 LED outputs Production Module WiFi Module

TM External Use 67 Proprietary and confidential Physical and Connectivity

Physical connection options: 61m

114mm

mm mm

155mm 155mm

Dev Kit Board / Full up System Solutions Board (SSB) System Solutions Board / Extended Module (PoE + AMP) 100m Module (MCU + Network + Audio) m

TM External Use 68 Pricing and Availability

Business Model and Support • No upfront NRE / No complex BSP / No expensive tools • uCMK60 VoIP Development kit available from – Arcturus/Freescale/Distribution • uCMK60 VoIP System solutions boards available in QTY from – Arcturus • K60 VoIP MCU available from – Freescale / Distribution • Product Support and dedicated support site – Arcturus • VoIP MCU and Kinetis support – Freescale • Software and hardware customization – Arcturus

Pricing and Availability • uCMK60-VoIP Dev kit - pricing $495 • uCMK60-VoIP Modules - $69-150 in QTY. • uCMK60-VoIP System Solutions Board – $100-240 • VoIP MCU – Pricing Freescale - Freescale

Buy Now! - From Freescale Buy Now! – From Arcturus

TM External Use 69 uCMK60 Combined Roadmap

uCMK60-MOD- uCMK60-MOD Freescale K64 256Kbyte SRAM WIFI GPS/GPRS/GSM PAS Mode 4x3 Keypad I/O 2 Line LCD Mulitcast Rx Bluetooth LE (ASR) Voice PAT QCA4002 WiFi Control G.722 WB Mulitcast Tx Keypad + uCMK60-VoIP LCD rev3 Door Lock Signal Crypto App Framework 16KHz AEC Audio Sensing Config Announce Opus

RFC2833 DTMF 802.11n WiFi Beam Forming

UART-to-Net Far Field Mic iBeacon

P2P Operations System AEC Tuning Dynamic Audio Controller + App Builder Manager v3 Tool Routing WebRTC

2013 Fall Release Execution Planning

Firmware Mbarx Tools Board/Module Daughter Card Mode General SW MK60 SW

TM External Use 70 uCP1020 System

Hardware P1020 Software Hardware

HTML5 HTML Configuration Operation Bit Transmission

Mbarx and Reception

VPN, Operations Secure Audio/Analog TDM/I2S IP PBX Controller Network Public

Analog Edge, / VoIP Data Mbarx 1011011 Inputs / Output Logging Services Digital I/O Framework Controls Network Private Sensors/SCAD Peripherals Middleware 1011011 A (I2C, UART, 1101101 Linux Wired/Wireless SPI) File system Network Protocols, Interrupts Fallback Mass Storage SDIO/USB Drivers Services Processes Interfaces Scheduler, 1011011 Specialized/Hig Timers PCIe Firmware and Database 1101101 h Data Rate Bootloader and HAL

Operating System Optional Applications Packages/Solutions

Middleware External Network

TM External Use 71 uCMK60 Block Diagram

uCMK60 System Solutions Board and Dev Kit

TM External Use 72 uCP1020 Edge Node Application

Mbarx Devices VoIP Trunks PSTN Other

uCP1020

IPsec VPN to Remote site

3rd Party IP Devices & Data

M2M Cloud Service Local Presentation Fixed / Mobile Operation and Control Connected Intelligence / Device Collaboration

Mobile Apps & Push Notification Mobile Clients (WiFi) Central Operations

TM External Use 73 Q & A

TM External Use 74 Arcturus empower embedded.

Part-3 - Hands on Lab

Presented by: David Steele, Product Manager [email protected] Proprietary and confidential uCMK60 | System Solutions Board

Connector Console I/O Isolation SDcard Network Spark Gap + +12VDC Component Slot PoE TVS

GPIO – Output Network LEDs Transformer

Network Transceiver GPIO – Input Push Buttons Reset / Watchdog

Kinetis K60 I/O Connectors VoIP MCU

Expansion Connectors RTC BATT Holder Reset Button

Audio Head- Line Line Mic L Mic R Speaker 15W ASIC phones Out In Outputs Class-D Amp

TM External Use 76 Push Buttons and LEDs

O8 – Spare IN8 – Spare

O7 - Spare IN7 – Spare

O6 – Supervised IN6 – Reset

O5 – External AMP IN5 – Mic Mute

O4 – Alarm IN4 – Volume Down

O3 – Network Ready IN3 – Volume Up

O2 – Ringing / Call IN2 – Terminate

O1 – Reg/Ready IN1 – Push to Call 1 (PTC)

TM External UsePIP 77 / VoIP mode firmware Dedicated MCU I/O Signals

TM External UsePIP 78 / VoIP mode firmware Before We Begin

You will need: 1. Windows PC 2. uCMK60-SSB-DEV (Rev2.0) Board 3. Network switch with DHCP Server

You will need to download and install the following on your Windows PC: − Mbarx-System Manager Tool (for configuring uCMK60 devices) . Mbarx-System Manager (Zip file with Windows and Mac versions) (log in and download from support site) − Teksip Free SIP Proxy (required for demo) . Windows version . www.teksip.com − Zoiper Classic Free VoIP Softphone (required for demo) . Windows version . www.zoiper.com

The links above are clickable only in presenter mode A list of the links is included at the end of the presentation

TM External Use 79 uCMK60–VoIP Board Connections

Connect Connect Power Network 12VDC NOTE: Board also supports 802.3af PoE

Power LED

Network Link LED

Connect Connect Headset Speaker Headset Mic (HP) (MIC-L)

TM External Use 80 Network Setup

Windows PC Running: Mbarx System Manager uCMK60 Device TekSIP, Zoiper Network Switch (with DHCP Server)

Mic (MIC L)

Ethernet Ethernet

Speaker (HP)

Example IP : 192.168.0.101 Make sure both devices are Example IP : 192.168.0.102 (DHCP client enabled) on the same subnet! (Connect Mic –> MIC L) (wireless disabled) (Connect Speaker – >HP) Network Configuration

NOTE: For simplicity during first time setup it is recommended to setup a private, isolated network.

TM External Use 81 Step 1 – Install and Start TekSIP

Start TekSIP service by clicking on SERVICE and selecting START IP address Teksip is running on

NOTE: TekSIP requires exclusive access to port TekSIP service 5060. If another application is bound to port 5060 status bar TekSIP will not start.

NOTE: TekSIP runs as a service, to exit TekSIP stop the service, then exit the application, otherwise TekSIP will continue to run in the background.

TM External Use 82 Step 2 – Setup Two VoIP Accounts

1. Click on ENDPOINTS tab

3. Confirm added accounts appear here

2. Enter 1000, 1000 then click ADD/UPDATE repeat for 1001, 1001

TM External Use 83 Step 3 – Install and Start Zoiper

Page: 84 2. Select SIP and click on NEXT

1. Click on SETTINGS and select CREATE NEW ACCOUNT

3. Enter the following: USER/USER@HOST: 1000 PASSWORD :1000 DOMAIN/OUTBOUND PROXY: 192.168.0.101 Then click NEXT

NOTE: Zoiper runs as a service, exit properly or it will continue to run in the background.

TM External Use 84 Step 4 – Install and Start Mbarx System Manager

1. uCMK60 is detected automatically

2. Double click on uCMK60 device uCMK60 entry or select and Configuration press CONFIGURE pop up window to open uCMK60 configuration pop up window System Manager Home Panel

TM External Use 85 Configure VoIP Account

1. Click on VoIP tab

2. Setup account USERNAME: 1001 PASSWORD: 1001 4. Enter Zoiper CALLER ID: SIP Extension in uCMK60 Demo PTC (push-to-call)

3. Enter TekSIP server IP address 5. Apply Settings

TM External Use 86 Step 5 – Confirm Setup

1. View TekSIP Registrations panel to confirm that both devices appear REGISTERED with TekSIP

2. uCMK60 LEDs: O1 – REGISTERED ON O3 - NETWORK READY ON

TM External Use 87 Step 6 – Confirm Setup (cont.)

3. Click on 4. Confirm green SETTINGS and checkmark beside select account and PREFERENCES REGISTERED status

TM External Use 88 Demo: Calling uCMK60 from Zoiper

1. Enter SIP Extension 2. LED O2 – BLINKS on of uCMK60 Device (1001), Indicating RINGING CALL then click CALL button

Press SW1 to ANSWER CALL Press SW2 to HANGUP

TM External Use 89 Calling Zoiper from uCMK60

2. LED O2 – BLINKS on ringing/SOLID on active call state

1. Press SW1 to CALL Zoiper using PTC1 Click ANSWER to accept ringing Press SW2 to hangup call on Zoiper

TM External Use 90 Arcturus empower embedded.

Additional Information: www.arcturusnetworks.com [email protected] 416.621.0125 x 233