EMBEDDED TECHNOLOGY FOR MOBILE MULTIMEDIA
19 June 2008
김철우 이사 / 마케팅 / 공학박사 QUALCOMM CDMA TECHNOLOGIES KOREA MOBILE MARKET UPDATE Source : SA, Jul07 1400 14.63 CDMA WCDMA HSPA 10.45 1200 GSM/GPRS EDGE Others 8.98 17.37
1000 594.41 25.78 617.36 365.29 552.31 188.88 800 33.61 79.97
56.64 48.55 Millions 600 11.54 110.99 403.57 224.54 532.35 286.84 521.98 185.04 400 458.27 66.52 23.90 170.61 151.45 157.26 2.57 141.83 89.07 200 41.980.00 17.570.00 201.23 203.53 132.58 155.58 159.79 170.58 187.76 0 2004 2005 2006 2007 2008 2009 2010 By Interface (Mil) 2004 2005 2006 2007 2008 2009 2010 CDMA 132.58 155.58 159.79 170.58 187.76 201.23 203.53 WCDMA 17.57 41.98 89.07 141.83 170.61 151.45 157.26 HSPA 0.00 0.00 2.57 23.90 66.52 185.04 286.84 GSM/GPRS 458.27 521.98 532.35 403.57 224.54 110.99 48.55 EDGE 11.54 79.97 188.88 365.29 552.31 617.36 594.41 Others 56.64 33.61 25.78 17.37 8.98 10.45 14.63 Total 676.61 833.12 998.45 1122.55 1210.72 1276.53 1305.23
2 QUALCOMM MOBILE PLATFORM
• Background of Multimedia Integration • Qualcomm Platform Overview • Comparison with other Platforms • Qualcomm Implementation of Features
3 INTEGRATED MULTIMEDIA SOLULTION
Non-IntegratedNon-Integrated SolutionSolution IntegratedIntegrated QCTQCT SolutionSolution
GPS
Video ASIC Camera Module with DSP Ringer ASIC
Video ASIC Camera Module Apps Ringer Co- Processor Chip Processor 3D Gaming ASIC 3D Gaming ASIC GPS • Complete / Integrated Solution • Lower Device Costs • Proven Interoperability
4 INCREASING MIPS FOR MOBILE MULTIMEDIA
2400 Paging, Messaging, Voice Mail Personal 2000 Information Manager Convergence Dual-Core Snapdragon CPU + 1600 ARM 9 MSM6500 Up to 2370 Multimedia PlatformMSM6550 MIPS* ARM9 (1GHz)
MIPS 1200 Enhanced MSM3000 Up to 160 MIPS* Platform ARM9 MSM2300 ARM7TDMI (146 MHz) Up to 250 MIPS* MSM7200 800 MSM2 Convergence Intel 80186 ARM MCU 23 MIPS* (27 (225 MHz) < 20 MIPS MHz) Dual-Core 10 MIPS ARM9 + ARM11 400 (~2.5 MHz) Up to 740 MIPS* (400 MHz) 0 Processing Power 1996 1998 2000 2002 2004 2006 2008
GB Desktop PCs 10 (3.5 inch HDD form factor) Mobile Phones (1 inch HDD form factor) 5 Toshiba W41T - cell 4 phone with a 4 GB 1 Hard Drive
.1 Memory .01
1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006
Source: Gartner Dataquest and 3G Today (www.3gtoday.com), 2006
5 QUALCOMM UMTS LINE-UP
TECHNOLOGY Wireless & Consumer - INDUSTRY LEADER IN MODEM TECHNOLOGY QSD Convergence - BEST-IN-CLASS RF & PMIC - HIGHEST LEVEL OF SYSTEM INTEGRATION - Modem, Multimedia, RF, PMIC, Software - LEADING-EDGE PROCESS & PACKAGING MSM HLOS Phones HSUPA / MBMS 7K VGA/WVGA
Mainstream MM MSM Broadcast 6K QVGA/WQVGA CUSTOMERS z Over 30 customers z Over 250 devices in design & production Single Chip QSC UMTS / HSDPA Entry Level
6 QSD 8250 ARCHITECTURE Stereo Speakers RF Touch Key- IrDA CE-ATA Broad- Aux Screen board cast Display Stereo USIM 802.11 Earphones UBM SD Microphone NOR (2) NAND Stereo BT Headphone
SD SDSD SSBI Touch GPIO Fast I2C SDSDCtlr TS FastFast Aux Aux Aux UART CtlrCtlr EBI2 I2S Ctlr Ctlr Ctlr UART Ctlr CtlrCtlr Ctlr UARTUART Out In PCM Peripheral Bus
MODEM CPU DSP Multimedia Accelerators Data Subsystem Subsystem Subsystem Display Video Video Graphics Audio Mover Crypto IMEM Core CPU QDSP6 DSP Proc FE Proc Proc Proc ARM9 QDSP4 L2 Cache/TCM L2 Cache/TCM GPS VIC & Timers Timers
Cross-bar Bus Memory Subsystem LP- TV LCD MDDIMDDI MDDI USB USB EBI1 SMI1 DDR DAC Ctlr HostHost Client 2.0 2.0HS QSD8x50
LPDDR TV Primary Camera Display
7 SNAPDRAGON MICROPROCESSOR
z Snapdragon Core – low power, high performance superscalar CPU developed by QCT
z First to develop 1GHz CPU for battery powered wireless applications
z Low power, low leakage, 65-nm process Snapdragon Core z Specifically designed and optimized for MSM solutions
z ARM v7 compliant; QCT is an ARM architecture licensee
z VeNum 128 bit SIMD – low power, high performance multimedia coprocessor
z Up to 2X performance boost for multimedia applications CPU Delivers Up To 16x Performance Over Previous QCT Generations Marvel XScale Cortex-A8 Snapdragon Collaboration Between QCT and ARM on v7 Architecture Feature PXA320 (Tiger) Core 20 < 600MHz Frequency Up to 800MHz TI OMAP 3 is up to 1GHz 15 550MHz V5 V7 V7 Instruction set 10 WMMX 64 bit Neon 128 bit VeNum 5 Performance 1000 DMIPS 1200 DMIPS 2100 DMIPS Relative Performance Relative 0 Power ARM9 ARM11 SD Core SD Core + VeNum 480 mWatts 300 mWatts 200 mWatts @ 600 MHz NOTE: SD Core is based on ARM v7 architecture. VeNum is based on ARM SIMD Neon architecture
8 MSM 7000 / QSD 8000 ARCHITECTURE DUAL CORE SYSTEM
Applications / BREW etc Comm Protocol Stack
IPC L4 / WM / Linux / Symbian L4 / Iguana SOFTWARE Drivers Drivers
ARM 1136 ARM 926 HARDWARE Application Processor Communication Processor
QDSP QDSP Application DSP Communication DSP
HARDWARE ACCELERATOR
9 MULTIMEDIA IMPLEMENTATION
ARM 11 (400 MHz) or Qualcomm Implementation Scorpion (1GHz) ARM + DSP + HW • Video Processor (HD support) • Other Applications •Low Power • Easy IPC
Application DSP (250/600 MHz) • Video Processor (HD support) • Speech / Audio codec • 3D Graphics ARM 11 (860 MHz) • Camera processing
Hardware Accelerator • Video Processor (HD support) WMMX • 3D Graphics (Imageon, Yamato) • Camera ISP • Mobile Display Processor • Stereo DAC etc MONAHAN Implementation
10 PERFORMANCE COMPARISON SIMPLIFIED DESCRIPTION Performance
App A App B App C App D
Monahan Hardware or Software? MSM 7200
11 QTV DECODER EXAMPLE (6260/45/55A)
• Audio codecs optimized on DSP Ping Pong Buffer Audio Previously Speaker Codec 76 K Byte Reconstructed • Video Decode Data RAM VOP Functions split between ARM & DSP
Bitstream Unpack &Demultiplex Unpack Bitstream Bitstream Variable Motion Motion VOP (Motion) Length Decoding Compensation Reconstruction • Support for QCIF Decoding resolutions
EFS QCT Post Bitstream Processing Video (Texture) Variable Inverse Engine Length DS Scan Decoding Sockets
Color Conversion Prediction Inverse Inverse Inverse AC/DC Quantization DCT Off-screen (Intral Blocks) Legend LCD Buffers ARM Processing Texture Decoding QDSP Blocks Video Core External Memory
12 QTV DECODER EXAMPLE (6275/6280)
• More dedicated VOP Buffers hardware blocks to 465K Bytes Previously support higher bit rate Data RAM Reconstructed and larger image size (3 CIF buffers) VOP decoding Bitstream
isra UnpackDemultiplex & Bitstream (Motion) Variable Motion Motion VOP • MDP (Mobile Display Length Decoding Compensation Reconstruction Processing) hardware Decoding based assist for post processing, color based conversion & Bitstream display Variable (Texture) Inverse Length Scan Decoding De-blocking • Support for QVGA resolutions
Prediction Inverse Inverse Inverse AC/DC Quantization DCT Legend (Intral Blocks) Data RAM ARM Processing QDSP Blocks Texture Decoding Video Core External Memory
13 VIDEO CODEC FUNCITONALITY IMPLEMENTATION
아래 그림은 MSM 6245와 MSM 6280이 각 비디오 코덱의 부분들을 어떻게 처리하는가 하는 점을 도식화하여 나타내고자 한 것입니다. 아래 그림에서 보듯이 6245에서는 ARM에서 처리되던 Motion Vector Decoder가 6280에서는 QDSP에서 구현 되어있습니다. 그리고 6245에서는 QDSP에서 구현되던 일부 기능들이 6280에서는 HW core로 구현되어 있습니다.
ARM QDSP Inverse Inverse Q VLC Prediction decoding Inverse DCT MSM Inverse Scan VOP reconstruct Motion Deblocking F 6245 Vector MSM 6245에서 QDSP에 decoding Motion 의해 처리되던 일부 기능 Compenstation 들이 MSM 6280에서는 HW CORE로 구현됨! MV decoder block은 QDSP로이동
Inverse Q VLC Inverse Motion decoding Prediction Vector Inverse DCT MSM decoding VOP reconstruct Inverse Scan 6280 Deblocking F Motion Compenstation
ARM QDSP HW CORE 이러한 이유로 6280에서는 6245에 비해서 ARM 및 DSP의 load가더적게되고, 이는 MSM 6280이 QVGA의 resolution을 지원할 수 있는 여지를 마련해줍니다
14 INTEGRATED MULTIMEDIA FEATURES
• Migration to Integrated Solution • Advantage & Disadvantage Analysis
15 INTEGRATION OF FUNCTIONALITIES
Single-Chip to accommodate the sweet- spot (volume-zone) Video Video Graphics Audio Graphics Audio Camera Modem Bluetooth etc
Bluetooth Camera Migration is likely to happen when target product/market is proven with discrete components The first Single chip usually covers only a portion of what is required! Target Product Varies!
16 MODEM ENHANCEMENT & INTEGRATION
Multimedia Component Enhancement
6 months for Modem Tech Phase 2 multimedia Shaded e.g. MSM evolution e.g. HSUPA Area 7000
Modem Technology Phase 1 e.g. MSM e.g. HSDPA 1.8 6000
2 Years for modem tech update / Feature integration
17 INTEGRATED SOLUTION
ADVANTAGES DISADVANTAGES
• Reduced Size • Long Development Period
• Power Saving • Increased code size
• Lower Cost • Difficulty in test & analysis
• Easy IPC • Redundant features
The importance lies in that total software solution must be accompanied to fortify the advantage of integrated solution!
18 IMPORTANCE OF OPEN OS
• Open OS Market Update • Migration to Open Platform
19 OPEN OS HANDSET MARKET
Source : Informa Telecoms & Media, 9th Edition 450 35
400 30 350 Unit Sales(Million)
25 Market Share(%) 300
250 20
200 15
150 10 100 5 50
0 0 2006 2007 2008 2009 2010 2011 2012
Open OS Proprietary OS Share (%)
20 OPEN OS MARKET STATUS Source : Informa Telecoms & Media, 9th Edition 250
200 Unit Sales(Million)
150
100
50
0 2006 2007 2008 2009 2010 2011 2012
Symbian Microsoft Linux Palm & Others Proprietary OS
* Recent movement by Google Android should be considered
21 IMPORTANCE OF OPEN OS
A B … N A B N Q … Z OS or Middleware (Rex)
OPEN OS Hardware Platform (MSM)
Various Hardware Platforms
z Growth of diversified multimedia applications z Reuse of existing software resources z Compatibility with wired Internet environment
22 CONCLUSION
23 CONSIDERATIONS
WHEN to Launch? • Target release date is critical
Mobile WHICH market to aim? Multimedia • Target customer • Chipset Features
HOW much the price is?
• Feasibility of penetration
24