DSP Ringer ASIC
Total Page:16
File Type:pdf, Size:1020Kb
EMBEDDED TECHNOLOGY FOR MOBILE MULTIMEDIA 19 June 2008 김철우 이사 / 마케팅 / 공학박사 QUALCOMM CDMA TECHNOLOGIES KOREA MOBILE MARKET UPDATE Source : SA, Jul07 1400 14.63 CDMA WCDMA HSPA 10.45 1200 GSM/GPRS EDGE Others 8.98 17.37 1000 594.41 25.78 617.36 365.29 552.31 188.88 800 33.61 79.97 56.64 48.55 Millions 600 11.54 110.99 403.57 224.54 532.35 286.84 521.98 185.04 400 458.27 66.52 23.90 170.61 151.45 157.26 2.57 141.83 89.07 200 41.980.00 17.570.00 201.23 203.53 132.58 155.58 159.79 170.58 187.76 0 2004 2005 2006 2007 2008 2009 2010 By Interface (Mil) 2004 2005 2006 2007 2008 2009 2010 CDMA 132.58 155.58 159.79 170.58 187.76 201.23 203.53 WCDMA 17.57 41.98 89.07 141.83 170.61 151.45 157.26 HSPA 0.00 0.00 2.57 23.90 66.52 185.04 286.84 GSM/GPRS 458.27 521.98 532.35 403.57 224.54 110.99 48.55 EDGE 11.54 79.97 188.88 365.29 552.31 617.36 594.41 Others 56.64 33.61 25.78 17.37 8.98 10.45 14.63 Total 676.61 833.12 998.45 1122.55 1210.72 1276.53 1305.23 2 QUALCOMM MOBILE PLATFORM • Background of Multimedia Integration • Qualcomm Platform Overview • Comparison with other Platforms • Qualcomm Implementation of Features 3 INTEGRATED MULTIMEDIA SOLULTION Non-IntegratedNon-Integrated SolutionSolution IntegratedIntegrated QCTQCT SolutionSolution GPS Video ASIC Camera Module with DSP Ringer ASIC Video ASIC Camera Module Apps Ringer Co- Processor Chip Processor 3D Gaming ASIC 3D Gaming ASIC GPS • Complete / Integrated Solution • Lower Device Costs • Proven Interoperability 4 INCREASING MIPS FOR MOBILE MULTIMEDIA 2400 Paging, Messaging, Voice Mail Personal 2000 Information Manager Convergence Dual-Core Snapdragon CPU + 1600 ARM 9 MSM6500 Up to 2370 Multimedia PlatformMSM6550 MIPS* ARM9 (1GHz) MIPS 1200 Enhanced MSM3000 Up to 160 MIPS* Platform ARM9 MSM2300 ARM7TDMI (146 MHz) Up to 250 MIPS* MSM7200 800 MSM2 Convergence Intel 80186 ARM MCU 23 MIPS* (27 (225 MHz) < 20 MIPS MHz) Dual-Core 10 MIPS ARM9 + ARM11 400 (~2.5 MHz) Up to 740 MIPS* (400 MHz) 0 Processing Power 1996 1998 2000 2002 2004 2006 2008 GB Desktop PCs 10 (3.5 inch HDD form factor) Mobile Phones (1 inch HDD form factor) 5 Toshiba W41T - cell 4 phone with a 4 GB 1 Hard Drive .1 Memory .01 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 Source: Gartner Dataquest and 3G Today (www.3gtoday.com), 2006 5 QUALCOMM UMTS LINE-UP TECHNOLOGY Wireless & Consumer - INDUSTRY LEADER IN MODEM TECHNOLOGY QSD Convergence - BEST-IN-CLASS RF & PMIC - HIGHEST LEVEL OF SYSTEM INTEGRATION - Modem, Multimedia, RF, PMIC, Software - LEADING-EDGE PROCESS & PACKAGING MSM HLOS Phones HSUPA / MBMS 7K VGA/WVGA Mainstream MM MSM Broadcast 6K QVGA/WQVGA CUSTOMERS z Over 30 customers z Over 250 devices in design & production Single Chip QSC UMTS / HSDPA Entry Level 6 QSD 8250 ARCHITECTURE Stereo Speakers RF Touch Key- IrDA CE-ATA Broad- Aux Screen board cast Display Stereo USIM 802.11 Earphones UBM SD Microphone NOR (2) NAND Stereo BT Headphone SD SDSD SSBI Touch GPIO Fast I2C SDSDCtlr TS FastFast Aux Aux Aux UART CtlrCtlr EBI2 I2S Ctlr Ctlr Ctlr UART Ctlr CtlrCtlr Ctlr UARTUART Out In PCM Peripheral Bus MODEM CPU DSP Multimedia Accelerators Data Subsystem Subsystem Subsystem Display Video Video Graphics Audio Mover Crypto IMEM Core CPU QDSP6 DSP Proc FE Proc Proc Proc ARM9 QDSP4 L2 Cache/TCM L2 Cache/TCM GPS VIC & Timers Timers Cross-bar Bus Memory Subsystem LP- TV LCD MDDIMDDI MDDI USB USB EBI1 SMI1 DDR DAC Ctlr HostHost Client 2.0 2.0HS QSD8x50 LPDDR TV Primary Camera Display 7 SNAPDRAGON MICROPROCESSOR z Snapdragon Core – low power, high performance superscalar CPU developed by QCT z First to develop 1GHz CPU for battery powered wireless applications z Low power, low leakage, 65-nm process Snapdragon Core z Specifically designed and optimized for MSM solutions z ARM v7 compliant; QCT is an ARM architecture licensee z VeNum 128 bit SIMD – low power, high performance multimedia coprocessor z Up to 2X performance boost for multimedia applications CPU Delivers Up To 16x Performance Over Previous QCT Generations Marvel XScale Cortex-A8 Snapdragon Collaboration Between QCT and ARM on v7 Architecture Feature PXA320 (Tiger) Core 20 < 600MHz Frequency Up to 800MHz TI OMAP 3 is up to 1GHz 15 550MHz V5 V7 V7 Instruction set 10 WMMX 64 bit Neon 128 bit VeNum 5 Performance 1000 DMIPS 1200 DMIPS 2100 DMIPS Relative Performance Relative 0 Power ARM9 ARM11 SD Core SD Core + VeNum 480 mWatts 300 mWatts 200 mWatts @ 600 MHz NOTE: SD Core is based on ARM v7 architecture. VeNum is based on ARM SIMD Neon architecture 8 MSM 7000 / QSD 8000 ARCHITECTURE DUAL CORE SYSTEM Applications / BREW etc Comm Protocol Stack IPC L4 / WM / Linux / Symbian L4 / Iguana SOFTWARE Drivers Drivers ARM 1136 ARM 926 HARDWARE Application Processor Communication Processor QDSP QDSP Application DSP Communication DSP HARDWARE ACCELERATOR 9 MULTIMEDIA IMPLEMENTATION ARM 11 (400 MHz) or Qualcomm Implementation Scorpion (1GHz) ARM + DSP + HW • Video Processor (HD support) • Other Applications •Low Power • Easy IPC Application DSP (250/600 MHz) • Video Processor (HD support) • Speech / Audio codec • 3D Graphics ARM 11 (860 MHz) • Camera processing Hardware Accelerator • Video Processor (HD support) WMMX • 3D Graphics (Imageon, Yamato) • Camera ISP • Mobile Display Processor • Stereo DAC etc MONAHAN Implementation 10 PERFORMANCE COMPARISON SIMPLIFIED DESCRIPTION Performance App A App B App C App D Monahan Hardware or Software? MSM 7200 11 QTV DECODER EXAMPLE (6260/45/55A) • Audio codecs optimized on DSP Ping Pong Buffer Audio Previously Speaker Codec 76 K Byte Reconstructed • Video Decode Data RAM VOP Functions split between ARM & DSP Bitstream Unpack &Demultiplex Bitstream Variable Motion Motion VOP (Motion) Length Decoding Compensation Reconstruction • Support for QCIF Decoding resolutions EFS QCT Post Bitstream Processing Video (Texture) Variable Inverse Engine Length DS Scan Decoding Sockets Color Conversion Prediction Inverse Inverse Inverse AC/DC Quantization DCT Off-screen (Intral Blocks) Legend LCD Buffers ARM Processing Texture Decoding QDSP Blocks Video Core External Memory 12 QTV DECODER EXAMPLE (6275/6280) • More dedicated VOP Buffers hardware blocks to 465K Bytes Previously support higher bit rate Data RAM Reconstructed and larger image size (3 CIF buffers) VOP decoding Bitstream Bitstream & Demultiplex Unpack (Motion) Variable Motion Motion VOP • MDP (Mobile Display Length Decoding Compensation Reconstruction Processing) hardware Decoding based assist for post processing, color based conversion & Bitstream display Variable (Texture) Inverse Length Scan Decoding De-blocking • Support for QVGA resolutions Prediction Inverse Inverse Inverse AC/DC Quantization DCT Legend (Intral Blocks) Data RAM ARM Processing QDSP Blocks Texture Decoding Video Core External Memory 13 VIDEO CODEC FUNCITONALITY IMPLEMENTATION 아래 그림은 MSM 6245와 MSM 6280이 각 비디오 코덱의 부분들을 어떻게 처리하는가 하는 점을 도식화하여 나타내고자 한 것입니다. 아래 그림에서 보듯이 6245에서는 ARM에서 처리되던 Motion Vector Decoder가 6280에서는 QDSP에서 구현 되어있습니다. 그리고 6245에서는 QDSP에서 구현되던 일부 기능들이 6280에서는 HW core로 구현되어 있습니다. ARM QDSP Inverse Inverse Q VLC Prediction decoding Inverse DCT MSM Inverse Scan VOP reconstruct Motion Deblocking F 6245 Vector MSM 6245에서 QDSP에 decoding Motion 의해 처리되던 일부 기능 Compenstation 들이 MSM 6280에서는 HW CORE로 구현됨! MV decoder block은 QDSP로이동 Inverse Q VLC Inverse Motion decoding Prediction Vector Inverse DCT MSM decoding VOP reconstruct Inverse Scan 6280 Deblocking F Motion Compenstation ARM QDSP HW CORE 이러한 이유로 6280에서는 6245에 비해서 ARM 및 DSP의 load가더적게되고, 이는 MSM 6280이 QVGA의 resolution을 지원할 수 있는 여지를 마련해줍니다 14 INTEGRATED MULTIMEDIA FEATURES • Migration to Integrated Solution • Advantage & Disadvantage Analysis 15 INTEGRATION OF FUNCTIONALITIES Single-Chip to accommodate the sweet- spot (volume-zone) Video Video Graphics Audio Graphics Audio Camera Modem Bluetooth etc Bluetooth Camera Migration is likely to happen when target product/market is proven with discrete components The first Single chip usually covers only a portion of what is required! Target Product Varies! 16 MODEM ENHANCEMENT & INTEGRATION Multimedia Component Enhancement 6 months for Modem Tech Phase 2 multimedia Shaded e.g. MSM evolution e.g. HSUPA Area 7000 Modem Technology Phase 1 e.g. MSM e.g. HSDPA 1.8 6000 2 Years for modem tech update / Feature integration 17 INTEGRATED SOLUTION ADVANTAGES DISADVANTAGES • Reduced Size • Long Development Period • Power Saving • Increased code size • Lower Cost • Difficulty in test & analysis • Easy IPC • Redundant features The importance lies in that total software solution must be accompanied to fortify the advantage of integrated solution! 18 IMPORTANCE OF OPEN OS • Open OS Market Update • Migration to Open Platform 19 OPEN OS HANDSET MARKET Source : Informa Telecoms & Media, 9th Edition 450 35 400 30 350 Unit Sales(Million) 25 Market Share(%) 300 250 20 200 15 150 10 100 5 50 0 0 2006 2007 2008 2009 2010 2011 2012 Open OS Proprietary OS Share (%) 20 OPEN OS MARKET STATUS Source : Informa Telecoms & Media, 9th Edition 250 200 Unit Sales(Million) 150 100 50 0 2006 2007 2008 2009 2010 2011 2012 Symbian Microsoft Linux Palm & Others Proprietary OS * Recent movement by Google Android should be considered 21 IMPORTANCE OF OPEN OS A B … N A B N Q … Z OS or Middleware (Rex) OPEN OS Hardware Platform (MSM) Various Hardware Platforms z Growth of diversified multimedia applications z Reuse of existing software resources z Compatibility with wired Internet environment 22 CONCLUSION 23 CONSIDERATIONS WHEN to Launch? • Target release date is critical Mobile WHICH market to aim? Multimedia • Target customer • Chipset Features HOW much the price is? • Feasibility of penetration 24.