Driving Better Mobile Experiences A Holistic Approach to Hardware & Software LIAT BEN-ZUR Sr. Director, Software Strategy & Business Development
@LiatBenZur Snapdragon System Spans Hardware, Software, Services, and Ecosystem Tools
ECOSYSTEM Developer Developer Developer Ecosystem Carrier-Friendly SUPPORT Hardware Software Tools Events and Community Services
ADVANCED Computer Augmented Entertainment Connectivity Camera Web AllJoyn™ SOFTWARE Vision Reality TECHNOLOGY
BROAD SUPPORT FOR HLOS
LEADING HARDWARE CPUs GPUs 3G/4G MEMORY DSPs VIDEO/ LOCATION WiFi BT FM POWER RF MODEMS AUDIO AND MGMT SENSORS
2 Snapdragon System Spans Hardware, Software, Services, and Ecosystem Tools
ECOSYSTEM Developer Developer Developer Ecosystem Carrier-Friendly SUPPORT Hardware Software Tools Events and Community Services
ADVANCED Computer Augmented Entertainment Connectivity Camera Web AllJoyn™ SOFTWARE Vision Reality TECHNOLOGY
BROAD SUPPORT FOR HLOS
LEADING HARDWARE CPUs GPUs 3G/4G MEMORY DSPs VIDEO/ LOCATION WiFi BT FM POWER RF MODEMS AUDIO AND MGMT SENSORS
3 Growth of Smartphones is Challenging Networks
GLOBAL HANDSET DATA TRAFFIC 9,000.0
8,000.0
7,000.0
6,000.0
5,000.0 Music Messaging 4,000.0 Video 3,000.0 Browsing Network Traffic (PB) Traffic Network 2,000.0
1,000.0
0.0 2008 2009 2010 2011 2012 2013 2014 2015 2016
. Ever growing number of Smartphones driving increased data loads . Thousands of “chatty” apps running background updates, push, status, etc. driving signaling load
4 Source: Strategy Analytics, Mar 2011 Growth of Smartphones is Challenging Networks
. Real need for intelligent system selection and effective use of Wi-Fi offload . Real need to efficiently manage data applications . Real need to improve performance reduce power consumption
OEMS AND CARRIERS WANT MORE INTELLIGENT PHONES THAT ARE MORE NETWORK AND CONSUMER FRIENDLY
5 Qualcomm’s Intelligent Connectivity Engine PROVIDING REAL SOLUTIONS TO REAL PROBLEMS
WHAT HOW
. Better Wi-Fi Experience . Real time, dynamic Wi-Fi . Reduced Wi-Fi failures Throughput & Quality Estimation . Advanced 3G vs. Wi-Fi System Selection . Longer Battery Life . Intelligent aggregation of . Reduced signaling traffic background app data . Reduced data traffic requests (Network Socket Request Manager)
. More carrier control of data . Carrier Profiles with offloading OMA-DM OTA provisioning
6 Qualcomm’s Intelligent Connectivity Engine PROVIDING REAL SOLUTIONS TO REAL PROBLEMS
Connection Manager Intelligent Algorithms that manage all aspects of device connectivity HLOS
. Run below the HLOS Connectivity Engine . Policy based radio management Other Carrier Policy Intelligent Subsystems . Intelligent network selection Database Algorithms (GPS, Sensors, Memory, Battery . Tight coupling with other etc.) subsystems
Qualcomm Chipset
CONNECTIVITY ENGINE IS NOT A CONNECTION MANAGER APPLICATION
7 Snapdragon System Spans Hardware, Software, Services, and Ecosystem Tools
ECOSYSTEM Developer Developer Developer Ecosystem Carrier-Friendly SUPPORT Hardware Software Tools Events and Community Services
ADVANCED Computer Augmented Entertainment Connectivity Camera Web AllJoyn™ SOFTWARE Vision Reality TECHNOLOGY
BROAD SUPPORT FOR HLOS
LEADING HARDWARE CPUs GPUs 3G/4G MEMORY DSPs VIDEO/ LOCATION WiFi BT FM POWER RF MODEMS AUDIO AND MGMT SENSORS
8 Accelerating and Enabling a Better Web Experience
PAGE USER MULTIMEDIA POWER ENHANCED DOWNLOAD SNAPPINESS STREAMING OPTIMIZATION CAPABILITIES
9 Browser Performance Optimizations
FASTER FASTER AVERAGE FASTER FASTER AVERAGE AVERAGE ON V8 AVERAGE DOWNLOAD2 PAGE BENCHMARK1 PAGE RELOAD1 DOWNLOAD1
Speed in seconds (Lower # is better)
Source: Tests performed by Qualcomm Innovation Center, Inc. 1Tested with 26 sites on both UMTS and Wi-Fi networks on 1.2Ghz Qualcomm MDP8660 between optimized and stock Android 2.3. 10 2Tested with 30 sites on Wi-Fi and consistent environment on Android 2.3 using HTC Sensation and production OEM device with Dual-CPU A9. Browser Performance Optimizations
SMOOTH AS GLASS FASTER AVERAGE POWER SCROLL, PAN, ZOOM1 HTML
Snapdragon 8260 80-90
Competitor Dual-CPU A9 60-65
0 25 50 75 100
(Higher # is better)
Source: Tests performed by Qualcomm Innovation Center, Inc. 1Tested with 26 sites on both UMTS and Wi-Fi networks on 1.2Ghz Qualcomm MDP8660 between optimized and stock Android 2.3. 2Tested with 30 sites on Wi-Fi and consistent environment on Android 2.3 using HTC Sensation and production OEM device with Dual-CPU A9.
11 Enabling Rich Web App Device APIs
Location Sensors Camera
. Single location . Pitch . Zoom . Interval location . Direction . Filter effects . Proximity alert . Speed . Image recognition
Audio Augmented Reality Proximity P2P
. Capture . Image targets . Discovery . Pitch . Frame markers . Secure connections . Rate
12 Snapdragon System Spans Hardware, Software, Services, and Ecosystem Tools
ECOSYSTEM Developer Developer Developer Ecosystem Carrier-Friendly SUPPORT Hardware Software Tools Events and Community Services
ADVANCED Computer Augmented Entertainment Connectivity Camera Web AllJoyn™ SOFTWARE Vision Reality TECHNOLOGY
BROAD SUPPORT FOR HLOS
LEADING HARDWARE CPUs GPUs 3G/4G MEMORY DSPs VIDEO/ LOCATION WiFi BT FM POWER RF MODEMS AUDIO AND MGMT SENSORS
13 Computer Vision: Fast CV Accelerates These Use-Cases on Mobile Devices
Augmented Reality Gestures
Face Text Recognition Recognition
Depth Image Mapping Stabilization
14 What is Augmented Reality (AR)?
REAL WORLD VIRTUAL VIEW CONTENT Live camera view Information about points of interest Content placement inaccurate due to compass error
GPS and Compass-based Augmented Reality Experience Good for rough location of items outside our field of view
15 Augmented Reality Use Case Scenario
REAL WORLD VIRTUAL VIEW CONTENT Vision-based AR recognizes Live camera view objects in field of view and aligns graphics tightly to target object
Vision-based Augmented Reality Experience Enables a more immersive and interactive experience
16 The core LAN technologies are already ubiquitous and in all our phones (Bluetooth, Wi-Fi)
But… Can your phone find me?
Why Can’t All Smartphones Discover and Connect in this Conference Room?
Can you share the music or pictures currently on your phone with me? Why not? Peer-to-Peer (P2P) is Complicated P2P FRICTION DEVELOPERS FACE TODAY
DEVICE DISCOVERY SERVICE DISCOVERY
PAIRING PLATFORMS
SECURITY RADIOS
AD HOC TRANSIENT NETWORKING DEVICES
18 What Is AllJoyn? OPEN SOURCE FRAMEWORK TO ENABLE AD HOC, PROXIMITY-BASED, P2P NETWORKING
AllJoyn unleashes a whole new set of user experiences that span across mobile, tablets, PCs, TVs, and more by abstracting all the complexity of P2P networking from developers
19 What AllJoyn is Not…
Radio Hardware OS Transport Wireless Technology Based Dependent Dependent Protocol
20 The AllJoyn P2P Framework
MAKES PROXIMITY P2P EASY www.Alljoyn.org
Free. Open Source Apache 2.0 Mobile Applications P2P apps made up of 2 parts: (1) the App, (2) AllJoyn Daemon
Application Layer Discovery. HLOS What Services Are Running on Nearby Devices That Are Reachable
CHIPSET
Tablets Mobiles Televisions Laptop/PC
21 Proximal P2P Has Huge Untapped Potential WWW.ALLJOYN.ORG
Entertainment Multiscreen Collaborative Experiences Experiences Experiences
Low Latency, Head-to-Head Smartphone and Tablet as Seamless Discovery, Chat, Multi-Player Gaming Companion to Television and Interaction with People Nearby
AllJoyn is an open source project for mobile software being driven out of Qualcomm Innovation Center, Inc (QuIC), a subsidiary of Qualcomm Incorporated that focuses on open source development
22 AllJoyn Ushers in New and Exciting User Experiences for Mobile, Tablets, & TVs
Race games Office apps add Social Imaging apps Developers add head-2- p2p sync and networking seamlessly easily build head interact across apps easily discover who to phone apps competition devices discover who is send pictures to that can work nearby with TV
Great Opportunity to help OEMs & Developers Differentiate with New, Custom Experiences
23 Snapdragon System Spans Hardware, Software, Services, and Ecosystem Tools
ECOSYSTEM Developer Developer Developer Ecosystem Carrier-Friendly SUPPORT Hardware Software Tools Events and Community Services
ADVANCED Computer Augmented Entertainment Connectivity Camera Web AllJoyn™ SOFTWARE Vision Reality TECHNOLOGY
BROAD SUPPORT FOR HLOS
LEADING HARDWARE CPUs GPUs 3G/4G MEMORY DSPs VIDEO/ LOCATION WiFi BT FM POWER RF MODEMS AUDIO AND MGMT SENSORS
24 Snapdragon Developer Program: Delivering Experiences PRELOAD APP OPPORTUNITIES FOR OEM CONSUMER CAMPAIGNS
Enable developers Introduce developers to build and optimize to our OEM and carrier differentiated customers for preload user experiences and other collaboration for Snapdragon opportunities enabled devices
Developers Are Creating the Next Generation User Experiences
25 We Deliver Enhanced Experiences…
Video and Premium Communications Audio Peer-to-Peer Content (Security)
26 …And Compelling Games
Snapdragon Game Demos Snapdragon Exclusive Games Optimized and Enhanced Games for Royalty-Free Pre-Install for Pre-Install Opportunities
gaming.qualcomm.com
27 Optimized Apps That Take Advantage of Snapdragon GREAT FOR PROMOTIONAL CAMPAIGNS TO SELL MORE DEVICES!
. We work with developers to offer leading edge experiences . Leveraging advanced capabilities in the chip
Video Content Protection Graphics Optimization Power
Facial Processing Camera Peer-to-Peer Multi-Mic and Audio
28 Follow us on: @LiatBenZur
Thank You
For more information on Qualcomm, visit us at: www.qualcomm.com www.qualcomm.com/blog Americas Summit San Diego, December 1, 2011 KANWALINDER SINGH SENIOR VICE PRESIDENT, QCT NEW MARKETS Dedicated Focus for IoE
QCT PRODUCT CATEGORIES
New IoE CPG CCP QCA Business
Phones WOS Atheros Automotive AP MDM Computing WCP Consumer Gobi Tablets GPS Smart Modem CSM Home Energy FSM Home Automation Connectivity Tablets Enterprise Technologies & Industrial Software and more…
31 IoE Segments
Consumer Devices Smart Energy and Automotive, Enterprise, Home Automation Transportation & Industrial Logistics
With WWAN Connectivity With WWAN Connectivity With WWAN Connectivity With WWAN Connectivity • Person, Pet Tracking • Smart Energy, Utilities • Telematics, Emergency • ATM, Vending • Health, Medical • Security, Surveillance • Fleet Management • POS, Digital Signage • eReaders, Frames, • Automation & Control • Insurance, Tracking • Enterprise Tracking Gaming consoles • Appliances • Infotainment Head Unit • Hand Held Terminals • Routers, Gateways • Retail Kiosks, PoS • Intelligent Digital Signage
32 Strong Projected Growth for IoE Segments
70
Telematics 60 Energy/Utility Security & Tracking 50 Retail Industrial & Mfg (RMAC) 40 Healthcare Other 30
20
10 3G & LTE Module 3G Shipments& (millions) LTE
- 2010 2011 2012 2013 2014 2015
Source: Average of ABI Research (Sep 2011) and IMS Research (Jan. 2011) forecasts 33 Note: Excludes connected CE devices; “Other” includes non-vertical specific gateways Chipset Mapping to Segmentation
4G CONNECTED HOME ENERGY DIGITAL CAR GATEWAY SIGNAGE
3G Multi Mode FLEET POINT OF KIOSK MANAGEMENT SALE
COMMUNICATION 3G NODE 1x, DO TELEMATICS SMART UMTS METER SECURITY INSURANCE
Increasing Processing Power operating on many platforms 34 Qualcomm Provides Technology Innovation and Leadership to the Value Chain
SECURITY POWER MGMT
GPS RF
GPU DEVICE SOFTWARE/ HLOS
CPU QUALCOMM DESIGNS, MEMORY INTEGRATES AND DELIVERS ALL THE PIECES VERTICAL
DSP CONNECTIVITY CELLULAR MODULE MODEM
CHIPSET
CARRIER
35 The In-Car Experience is Transforming + NAVIGATION SAFETY AND APPLICATION CONTENT MOBILE REAR-SEAT SERVICES SECURITY DOWNLOADS STREAMING HOTSPOT ENTERTAINMENT
36 Qualcomm Technologies in the Connected Car
3G/LTE
WLAN GPS
BLUETOOTH PEER-TO-PEER
37 New Drivers for Automotive Connectivity
QTL QCT QWI
Infotainment Telematics PAYD Insurance and Road Use Traffic information for in-car Vehicle diagnostics for navigation system maintenance Road pricing, traffic augmentation Roadside assistance and management Internet radio services concierge services Driver behavior based rates Web access Automatic crash response and stolen vehicle recovery Off-board navigation assistance services (e.g. Google maps)
38 PAYD - Pay As You Drive AUTOMOTIVE TIES INTO SMART ENERGY
39 How Qualcomm Addresses Smart Energy
. 3G provides superior performance, reliability, security & scale . QC connectivity solution portfolio addresses a broad range of smart energy applications both inside and outside the home
Equipment Grid Routers Concentrators Communication Smart Energy EV EVs & DA gear Nodes Meters Mgmt. Charging Appliances Gateways Stations
Apps Remote AMR Fault Transformer AMR Home Trans- EV battery SOC Monitoring & Detection, Mgmt. Volt/VAR DR Energy former HEM Warranty Control Voltage Control Control HEM Prepaid Mgmt. Load Mgmt. TOU Virtual Control Pricing PP Vehicle to Grid
Substation Distribution Network Home Electric Vehicle
40 New Smart Energy Contracts Are Going Cellular
SMART METER
CELLULAR TRANSFORMER Consumers Energy SMART Duke APPLIANCE Energy
CHARGING STATION
EV Project CPS Energy
41 Cellular Wi-Fi HomePlug Green PHY Smart Energy in the Home Enabled by Qualcomm INTERNET OF EVERYTHING TODAY ENABLES INTELLIGENT CONTROL OF ENERGY USAGE
PROGRAMMABLE SMART THERMOSTAT METER
HVAC
APPLIANCES SMARTPHONE
CELLULAR ELECTRIC CHARGING NETWORK VEHICLE STATION
42 Qualcomm’s Strong Cellular Ecosystem Helps Engage the Various New IoE Opportunities
. Online searchable database of Qualcomm-enabled M2M modules . Contains 85+ modules from 13 commercial OEMs . Includes specs and module vendor contact details . www.m2msearch.com
Connectorized Surface Mount
43 Follow us on:
Thank You
For more information on Qualcomm, visit us at: www.qualcomm.com www.qualcomm.com/blog Qualcomm Driving Innovation in Wireless Matt Grob EVP & Chief Technology Officer Innovating to Drive the Future of Wireless
Nuremberg, Germany
Cambridge, UK Seoul, S. Korea Santa Clara, CA Vienna, Austria Beijing, China San Diego, CA Bridgewater, NJ
Bangalore, India
INVESTING FOR GLOBAL R&D THE RIGHT PEOPLE THE FUTURE PRESENCE
OF ENGINEERS CUMULATIVE TOTAL R&D WITH PhDs R&D INVESTMENTS LOCATIONS 2005–2010 WITH MASTERS
46 Innovation Across Entire Wireless Value Chain
Standardization Productization Commercialization
Innovative Technologies
Market Introduction and Optimization
End-to-End Prototyping, Technology Transfer Proof of Concept Demos
HOLISTIC APPROACH FOR EXCELLENT OVERALL SYSTEM PERFORMANCE
47 Success of DC-HSPA+
STANDARDS INDUSTRY-FIRST INDUSTRY-FIRST LEADERSHIP DEMOS CHIPSETS
. Major 3GPP contributor . MWC 2008: dual-carrier MDM MDM . Recognized expertise . MWC 2009: dual-carrier 8200 8220 42 Mbps HSPA+ DC-HSPA+
Launched Launched February 2009 August 2010
49 COMMERCIAL,41 cOMMITMENTS
48 Source : www.gsacom.com Enabling New Mobile Experiences
Connecting Mobile Computing Everything Everywhere Supporting More Users, Leveraging Computing at More Places, Power and Sensors to Enable with More Capacity New User Experiences
Evolve 3G/4G/WiFi Context Awareness
Small Cells/HetNets Computer Vision
Peer to Peer Indoor Location
Intelligent Connectivity Improving Web Experience
49 Continuously Improving Wireless Performance
LTE ADVANCED 2.2x HSPA+ ADVANCED Realizing the Full Maximizing the Performance Benefits of Hetnets of HSPA+
1X ADVANCED WIFI 3G/4G/ Up to 4x Voice Capacity Next-Generation WLAN to Free Up Resources WiFi for Data
DO ADVANCED WCDMA+ Increasing Capacity Increased Voice Efficiency to Where and When Needed Free Up Resources for Data
50 The Next Leap in Performance: Small Cells
OPTIMIZATIONS MAKES THE LEAP EVEN BIGGER—SMART HETNETS Adding Small Cells Like Picocells, Femtocells, and LTE ADVANCED Remote Radioheads HSPA+ ADVANCED DO ADVANCED
SMALL CELLS Bring Network Closer to User
BETTER MORE SPECTRUM TECHNIQUES New Bands/Refarming Higher Order MIMO, Smart Networks How Do We Get More Capacity?
Radio Link Approaching Theoretical Limit
Note: Other improvements, such as higher order modulation will also help, but 64QAM is already commonly used. 51 Other options are to use the available capacity better and reduce, e.g., power or signaling overhead to get more usable capacity. UltraSON™ Enables Expanding Role of Small Cells
LARGER SCALE ENTERPRISE/RESIDENTIAL
SMALL ENTERPRISE RESIDENTIAL
Next: Denser Indoor and Initially: Indoor Femto Hot Spots Outdoor Deployments
. Unplanned . Open . Restricted . Seamless handoff . User’s broadband connection . Interference coordination
52 New Femto-based Deployment Model OPEN-ACCESS INDOOR FEMTOS PROVIDING OUTDOOR COVERAGE
FEMTOS ON DEDICATED SPECTRUM
MACRO NETWORK
SIMPLE AND HIGHER CAPACITY ENABLED BY COST-EFFECTIVE THAN MACRO DEPLOYMENT UltraSON
53 Femto OTA Test Network
54 Intelligent Connectivity
PEER TO PEER WIFI
3G/4G BLUETOOTH ?
CONNECTION . Coverage . Internet connectivity . Operator policies BASED ON: . Data speed . Type of app . Per link decision
55 Enabling New Mobile Experiences
Connecting Mobile Computing Everything Everywhere Supporting More Users, Leveraging Computing at More Places, Power and Sensors to Enable with More Capacity New User Experiences
Evolve 3G/4G/WiFi Context Awareness
Small Cells/HetNets Computer Vision
Peer to Peer Indoor Location
Intelligent Connectivity Improving Web Experience
56 Context Awareness Enables New User Experiences
ANTICIPATES, PREDICTS AND ALERTS
PERSONALIZATION Based on User Actions and Preferences INFERS CONTEXT AND UNDERSTANDS LIFE SITUATION OPTIMIZATIONS e.g., Battery and ENVIRONMENT Bandwidth GATHERS LOCATION RAW DATA SENSORS NEW (Motion, Location, Networks, Proximity) ACTIONS APPLICATIONS APPLICATIONS USAGE (Email, Phone, 57 Apps, Calendar, Social Networks) Augmented Reality - Market Traction
REGISTERED MODELS OF APPS AVAILABLE ON DEVELOPERS FROM SMARTPHONES AND ANDROID AND iOS 130 COUNTRIES TABLETS
2011 Future Mobile Entertainment Award for Mobile Augmented Reality
58 Accurate Indoor Positioning
AP/ Map Server
Indoor Positioning Discovery Server
High Accuracy (<5m) Integrated into Scalable Across . Leverages existing WLAN Qualcomm Chipsets Commercial Venues AP and infrastructure . Highly efficient . Airport, train stations, mobile based solution malls, museums, hospitals, sports venues etc.
59 Web Browser Acceleration EXPLOITING CONCURRENCY FOR HTML AND JAVASCRIPT
MOBILE COMPUTING DEVELOPING FOR WEB PAGE INCREASINGLY MULTI-CORE FORMATTING SNAPDRAGON SOC
LAYOUT
RENDERING
Multi-Core CPU/GPU, DSPs, . Concurrently use all CPU cores and Hardware Accelerators . Designed to exploit Adreno HW GPU, Hexagon DSP, and DSP ACCL other hardware accelerators
SIGNIFICANTLY FASTER BROWSING EXPERIENCE
60 Leading the Way in Connectivity and Mobile Computing
. Strong track record of leadership in connectivity and mobile computing . Broad R&D initiatives to drive innovation in wireless . Well positioned to bring next generations of user experiences
61 Follow us on:
Thank You
For more information on Qualcomm, visit us at: www.qualcomm.com/research www.qualcomm.com/technology