Kinetis MCU-Based M2M and VoIP Solution for Consumer and Commercial Applications FTF-CON-F0129 David Steele | Arcturus Product Manager Rudan Bettelheim | Business Development Manager A P R . 2 0 1 4 TM External Use Agenda • Introduction to Freescale Audio Solutions • M2M Introduction • Voice Communication Crash Course • Live Demo • Freescale and Arcturus K60 Based Voice IoT Solution • Q & A • Hands on Lab TM External Use 1 Introduction to Freescale Audio Solutions TM External Use 2 Freescale Audio Solution Overview Focus on Mono and Stereo audio with digital interconnect and processing, and multi-channel audio accessories • Optimized for ARM Cortex-M4 core and Kinetis K family • Wide range of available MCUs with a rich selection of memory, peripheral, and connectivity options • Will support ARM Cortex-Ax (Vybrid and i.MX) families later, primarily for multi-channel applications • Flexible solution framework for easy configuration and customization • Basic audio software is free for use on Freescale MCUs • Premium Audio Functions are subject to a software royalty and possibly to licensing from IP owners • Tower System support for development and rapid prototyping TM External Use 3 Freescale Audio Solution Value Added Stereo Dolby DTS/SRS VoIP Others Audio Widening Standard Volume Tone Graphic Loudness Sample Rate Audio Control Control Equalizer Control Converter MP3 AAC HE AAC APE FLAC OGG Vorbis WAV WMA SW Codecs en., de. de. de. de. de. de. en., de. de. No RTOS (“Bare Metal”) MQX Linux RTOS Kinetis L, Kinetis K Kinetis K, Vybrid Vybrid, i.MX USB TCP/IP SD I/O Serial Audio Low Level Stack Stack Driver Drivers Drivers Drivers Audio SoftwareSolutionAudio MCU CPU DSP DMA Memory HW Codec/Class-D/FM Modulator T Hardware M USB Ethernet SD UART I2S I2S Analog Audio TM External Use 4 Freescale Audio Solution (FAS) Framework • Freescale Audio Solution (FAS) Framework is being developed for Kinetis, Vybrid, and i.MX processors • The framework includes functional blocks to deliver media player functionality: − Multimedia Framework with Radio Tuner and CD Support. − CE Device Connectivity supporting MFi, USB, SD and AOAP − External device management and control. − Input management and control for touch screen, buttons and knobs. − HMI Framework − Bluetooth Stack and Profiles with AEC/NS (HFP, A2DP, AVRCP) • Using an OS Abstraction provides platform support on MQX and Linux* and can be modified to work with any modern operating system TM External Use 5 AA Solutions Framework and Components Accessory Speaker Value Added Stereo iOS App EKG Altimeter MCU Firmware Others Dolby DTS/SRS VoIP Others Dock Audio Widening (Examples) Update Accessory Accessory Sensor Actuator Digital Audio GUI EKG Altimeter MCU Firmware System System Processing e Update Software r Standard Volume Tone Graphic Loudness Sample Rate e r a Control Control Equalizer Control Converter a Lightning w Audio 30-pin w t t f f o o MFi Interface S S MP3 AAC HE AAC APE FLAC OGG Vorbis WAV WMA SW Codecs e Software n en., de. de. de. de. de. de. en., de. de. c o a i f r t e u t l No RTOS (“Bare Metal”) MQX Linux n I o RTOS No RTOS (“Bare Metal”) MQX Linux Kinetis L, Kinetis K Kinetis K, Vybrid Vybrid, i.MX i S RTOS Kinetis L, Kinetis K Kinetis K, Vybrid Vybrid, i.MX F o M i d USB TCP/IP SD Serial Audio I2C USB TCP/IP SD I/O Serial Audio I/O Drivers Low Level u Low Level Stack Stack Driver Drivers Drivers Driver Stack Stack Driver Drivers Drivers Drivers A CPU DSP DMA Memory HW Codec/Class-D/ MCU T FM Modulator Hardware M MCU CPU DSP DMA Memory HW Codec/Class-D/FM Modulator I2C USB Ethernet SD UART I2S I2S Analog Audio T Hardware M USB Ethernet SD UART I2S I2S Analog Audio Dock Connector Freescale Audio Solution (FAS) Framework Architecture Customer Applications R e Common Audio Framework API f e r e n n r Playlist / Media r c o e i e Media Media Media e Accessory g t Speaker g Android App e Play Device MCU Firmware FAS a EKG Altimeter Others i O Dock a r u Player Browser Indexing (Examples) n Update l Queue Support n a S a Framework a o Accessory M / Accessory Sensor Actuator Digital Audio w e M GUI EKG Altimeter MCU Firmware S A t r OS Abstraction Layer e System System Processing t f Update a Software n c u i o d w o v p i t rd r f e Additional 3 Party OS n o S I d OS Linux o Audio Decoder* MP3 AAC HE AAC APE FLAC OGG Vorbis WAV WMA MQX i D d Support (uItron) S u (for USB MSC only) A y r A p Android Open Accessory Protocol (AOAP) USB TCP/IP SD I/O Serial Audio o USB Mass Storage Class p Accessory • Device and AOA Detect USB Host s (requires audio decoder) Driver s mode Stack s • Audio Streaming (does not support device Low Level Stack Drivers Drivers Drivers Interface e • HID playback support based playback control) streaming c Software • HID App and Accessory communication c A HW Codec/Class-D/FM Modulator MCU /MPU d No RTOS (“Bare Metal”) MQX Linux TM DSP DMA Memory i RTOS Kinetis L, Kinetis K Kinetis K, Vybrid Vybrid, i.MX Hardware o USB Ethernet SD UART I2S I2S Analog Audio r d n I2C USB TCP/IP SD I/O Serial Audio A Low Level Driver Stack Stack Driver Drivers Drivers Drivers Platform CPU DSP DMA Memory HW Codec/Class-D/ rd MCU T FM Modulator AA Team 3 Party Hardware M Teams Other I2C USB Ethernet SD UART I2S I2S Analog Audio USB/MHL Connector TM External Use 6 Accessories and Digital Audio MCUs and MPUs ARM Cortex A9 Media Library Browsing, i.MX6 Complex Audio Processing, family Multi-channels Audio ARM ARM9 OS Linux i.MX2 Cortex-A5 family and Cortex-M4 Vybrid 2 channel Audio Processing, family USB, Ethernet, Wireless ARM Connectivity MQX RTOS Cortex- M4 Kinetis K Basic Audio family Processing ARM RTOS Cortex- OS No USB Digital M0+ Audio Streaming Kinetis L Lite MQX family TM External Use 7 Target Audio Applications Mono and Stereo audio with digital interconnect and processing, and multi-channel audio accessories • MFi Speaker Docks • MFi Accessories • Android Speaker Docks • Android Accessories • SoundBars • Portable audio recorders • Gaming Headsets • Networked audio endpoints • USB microphones • USB speakers • XBOX Accessories • Musical effects equipment • Professional audio equipment • VoIP Intercom systems • VoIP Public Address (PA) systems • VoIP telephony • Automotive after market audio • And many more, let your imagination run wild TM External Use 8 Target VoIP Application Areas • Digital Intercom Systems • Digital Public Address (PA) Systems • IP Telephony • Voice Control Systems TM External Use 9 VoIP System Overview Hardware Software Hardware RTOS (MQX) Protocol Vocoders Stacks Ethernet Microphone Audio Call Control G.711 and MAC & PHY CODEC and Signaling Internet G.722 Low Level (wired or Analog (AEC) (SIP) OPUS Drivers Wireless) API API API SSI (TCP/IP) Ethernet Speaker Analog to Digital Voice Call Setup Packet Handling Bit Transmission and Compression and Control and Streaming and Reception Digital to Analog and Conversion Decompression Freescale Kinetis based VoIP Solutions CODEC MCU/MPU PHY TM External Use 10 VoIP System Software Overview RTOS/OS: MQX or Linux Management MiddleWare from Arcturus including web user interface, remote provisioning, voice response Hardware Software Device Management Hardware Analog to Digital Voice RTOS (MQX) and Compression Digital to Analog and Call Setup Packet Handling Bit Transmission Conversion Decompression and Control and Streaming and Reception Microphone Protocol Stacks Ethernet Call Control and MAC & PHY Audio CODEC Vocoders and Signaling Low Level (wired or Internet Analog (SIP) Drivers API API API SSI Wireless) (TCP/IP) Speaker Ethernet Partner: Consilient Technologies Partner: Arcturus Supplied as binary, with some OpenSIP based telephony/media MiddleWare parameters (such as echo solution from with proprietary components. cancelation) tunable. Suitable for 1 or Open source portions supplied as source code, Part numbers include software 2 Audio channel applications. proprietary portions as binary. licenses and technical support Algorithms supported: Telephony application includes support for: G.168 LEC, AEC, DTMF, CPT, AGC, Caller-ID, Call Waiting, Hold/Retrieve, Call G.711, G.722 Transfers, Conference, Hotline, Push-to-Call, Speed Dials, CID Privacy, Outgoing Call Blocking, Call Back on Busy… Software solution is supplied as a fully integrated and tested package TM External Use 11 Freescale VoIP Solutions History and Roadmap Kinetis (ARM Cortex-M4) MCU Intercom Analog Telephone PA, IP Telephony Adaptor (ATA) Kinetis K60 120 Kinetis K60 100 MHz RTOS MQX MHz ARM Cortex-Ax MPU Proposed Intercom Linux OS Linux ColdFire V3 MPU PA, IP Telephony MCF53281 MCF5301x MCF53271 Analog Telephone ColdFire V2 MCU Adaptor (ATA) MCF52268 MCF5227x OS No TM External Use 12 Kinetis K60 VoIP and IoT System Hardware K60 MCU Software Hardware Bit Transmission Application Framework (future) and Reception Designed for: Discovery M2M Agent Device Virtualization • Public Address Systems g M2M . Management . o Ethernet . l S a Audio VoIP\SIP Stack Middleware 2 MAC & PHY n Vocoders I Network A Subsystem ASIC , Subsystem I (wired or A • Intercom Systems S Wireless) MQX Voice 1011011 Inputs / Output Digital I/O File system • Controls Protocols, Drivers IP Telephony Interrupts Services Processes Interfaces M2M 1011011 Sensors/SCADA Peripherals Scheduler, Timers Serial − Includes optional IoT 1101101 Wired/Wireless (I2C, UART, SPI) Host Firmware and Database remote monitoring and control MQX MCU Middleware Software solution is preloaded − Developed and supported and provided as binary by Freescale partner Connector Console I/O Isolation Arcturus