The Mobile Future of eXtended Reality (XR)

Hugo Swart Senior Director, Product Management Technologies, Inc. June 27, 2017 XR is the future

Industrial & manufacturing Engineering

Healthcare VR Retail

Education M XR Marketing & advertising AR RMilitary Emergency response

Entertainment 2 Will the become an XR headset?

3 XR is here today, but it is still in its infancy Analogy to : XR evolution will take years…opportunity will be immense

Technology Phase: Infancy Market: Mostly early adopter “Prosumers”

Technology Phase: Rapid evolution Market: Surging consumer adoption

XR is here Technology Phase: Maturity today Market: Worldwide, ubiquitous use XR by ~2020

XR will follow a similar ~30 year cycle of sleeker designs, with tremendously increasing functionality

4 5 6 Power and thermal efficiency is essential for XR The XR headset needs to be appropriate to wear and use all day

The challenge of Constrained mobile, XR workloads wearable environment Must be thermally efficient for Very compute intensive sleek, ultra-light designs Complex concurrencies Requires long battery life for Always-on all-day use Real-time Able to be quickly recharged at least 1,000 times 7 Immersive virtual reality has extreme requirements Achieving full immersion at low power to enable a comfortable, sleek form factor

Extreme quantity and quality High resolution audio Screen is very close to the eyes Up to human hearing capabilities Spherical view 3D audio Look anywhere with Realistic 3D, positional, surround a full 360° spherical view Visual Sound audio that is accurate to the real world quality Immersion quality Stereoscopic display Crystal clear voice Humans see in 3D clear voice that is enhanced with noise cancellation technology

Minimal latency Precise motion tracking Minimized system latency Intuitive Accurate on-device motion tracking to remove perceptible lag interactions

Natural user interfaces Seamlessly interact with VR using natural movements, free from wires

8 Immersive visuals with Snapdragon 835 25% Up to faster 60x graphics more display rendering colors

9 A heterogeneous computing approach for immersive visuals Efficient processing by running Qualcomm® Snapdragon™ 835 the appropriate task on the appropriate engine ™ 540 Snapdragon™ X16 LTE modem (GPU)

Display Video Wi-Fi Processing Processing Immersive visuals Unit (DPU) Unit (VPU)

• GPU – Efficient rendering Hexagon™ DSP Qualcomm® ™ of advanced 3D visuals for DX12, OpenGL Qualcomm ® Spectra 180 HVX All-Ways ES & Vulkan applications Aware Qualcomm® • DPU – 10-bit 4K@60fps display, Q-Sync, Aqstic Kryo™ 280 CPU and wide color gamut Qualcomm® IZat™ Location • VPU – 4K HEVC 10-bit playback, Haven™ foveated video support * Not to scale

Qualcomm Adreno, Qualcomm Hexagon, Qualcomm All-Ways Aware, Qualcomm Spectra, Qualcomm Aqstic, Qualcomm Kryo, Qualcomm IZat, and Qualcomm Haven are products of Qualcomm Technologies, Inc. 10 Snapdragon 835 immersive audio experiences

11 A heterogeneous computing approach for immersive audio Efficient processing by Qualcomm® Snapdragon™ 835 running the appropriate task on the appropriate engine Adreno™ 540 Snapdragon™ Graphics Processing Unit X16 LTE modem (GPU)

Display Video Wi-Fi Processing Processing Heightened sounds Unit (DPU) Unit (VPU)

• Support for object and scene-based audio Hexagon™ DSP Qualcomm® Qualcomm ® Spectra™ 180 HVX All-Ways • Hi-Fi grade DSD format and SNR & THD+N Aware

Qualcomm® • Crystal Clear voice Aqstic Kryo™ 280 CPU

Qualcomm® IZat™ Location Haven™

* Not to scale

Qualcomm Adreno, Qualcomm Hexagon, Qualcomm All-Ways Aware, Qualcomm Spectra, Qualcomm Aqstic, Qualcomm Kryo, Qualcomm IZat, and Qualcomm Haven are products of Qualcomm Technologies, Inc. 12 Computer vision for XR

• 6 DoF head tracking • Eye tracking • Hand tracking • Object detection and recognition

13 A heterogeneous computing approach ™ for immersive Qualcomm® Snapdragon 835 interactions Adreno™ 540 Snapdragon™ Graphics Processing Unit X16 LTE modem (GPU)

Display Video Wi-Fi Processing Processing Immersive Interactions Unit (DPU) Unit (VPU)

• VIO for precise, low latency 6-DOF Hexagon™ DSP Qualcomm®

Qualcomm ® Spectra™ 180 HVX All-Ways • Computer vision for gesture Aware

recognition and eye tracking Qualcomm® Aqstic Kryo™ 280 CPU • Machine learning for eye movement prediction and gesture recognition Qualcomm® IZat™ Location Haven™ • Hexagon DSP is a crucial differentiator for real-time and low * Not to scale power experiences

Qualcomm Adreno, Qualcomm Hexagon, Qualcomm All-Ways Aware, Qualcomm Spectra, Qualcomm Aqstic, Qualcomm Kryo, Qualcomm IZat, and Qualcomm Haven are products of Qualcomm Technologies, Inc. 14 AR has additional requirements beyond immersion Providing an always-on experience that intelligently enhances our lives

Immersive Cognitive Connected The visuals, sounds, and interactions It understands the real world, learns personal An always-on, low power wearable with are so realistic that they are true to life preferences, and provides security & privacy fast wireless cloud connectivity anywhere

15 Significant progress in VR and AR this year Improving experiences with Snapdragon 835

Snapdragon Snapdragon VR HMD Accelerator Ecosystem 835 SDK Program support Purpose built silicon Easy developer access to Commercialize VR HMDs quickly Collaboration with multiple for superior mobile Snapdragon accelerated with fewer resource restraints content, technology, and VR & AR VR libraries that simplify platform companies application development

16 Snapdragon 835 processor is taking us closer to the vision Designed to meet the VR processing demands within the thermal and power constraints

Extreme25% Faster pixel Graphics quantity andRendering quality HighSupport resolution for object audio and scene-based audio Screen is very close to the eyes Up to human hearing capabilities HDR10/4K UHD Premium Spherical view Audiophile-grade3D audio DSD audio Look anywhere with Foveated graphics and video Realistic 3D, positional, surround a full 360° spherical view ImmersiveVisual HeightenedSound audio that is accurate to the real world Visualsquality Immersion Soundsquality QSYNC/JitterStereoscopic free displaydisplay Crystal clear voice Humans see in 3D clear voice that is enhanced with noise cancellation technology

15ms motion toMinimal photon latency PreciseSensor fusion-basedmotion tracking 6-DOF motion tracking Minimized system latency Intuitive Accurate on-device motion tracking to remove perceptible lag interactions

NaturalAcceleration user interfaces of eye Seamlesslyand handinteract tracking with VR using natural movements, free from wires

17 Qualcomm® Snapdragon™ VR SDK Access to advanced VR features to optimize applications and simplify development

DSP sensor fusion Access to the latest and predictive Stereoscopic rendering head pose Generate left and right eye view Asynchronous time warp Single buffer rendering Warp image based on the latest Render directly to the display buffer head pose just prior to scan out for immediate display scan out

Chromatic aberration correction Correct color distortion based on lens VR layering characteristics APIs optimized Generate UI menus and text so that for VR they render correctly in a virtual world Lens distortion correction Power & thermal management Barrel warp image based on lens Qualcomm® Symphony System Manager provides CPU, GPU, characteristics and DSP power, thermal, and performance management

Benefits

Simplified development | Optimized VR performance | Power and thermal efficiency

18 Qualcomm Symphony System Manager and are products of Qualcomm Technologies, Inc. A comprehensive, robust VR reference design Reference design based on the Snapdragon 835 SoC

Snapdragon 835 VR SW Services and SDK (6DoF, Sensor Fusion, ATW, Single-Buffer Rendering, Unity plug-in, etc.)

Key components selection (camera, sensors, display)

Product/HW Design Files (schematics, BOM, layout files, VR HMD Sample Units thermal design guidelines) (availability in July)

19 MSM8998 is a product of Qualcomm Technologies, Inc. HMD Accelerator Program – Pillars Commercialize VR HMDs quickly with fewer resource restraints

1 2 3 4 5

Product ODM Component/ Performance Marketing Reference Partners Peripherals/ and Quality Support Design Technology Metrics/Testing Partners

20 Accelerating the development of standalone HMDs HMD Accelerator Program cutting edge components

Eye Sensors Tracking Controllers

21 Actively working with XR device manufacturers XR products based on Snapdragon Mobile VR Platform

VR HMD VR HMD VR HMD and Daydream Daydream Daydream Tango

Baofeng Matrix Coocaa Wondergate G1 iQiyi Adventure ASUS Zenfone AR Google Pixel XL Phab 2 Pro

VR HMD VR HMD AR Glasses Daydream Daydream Gear VR Gear VR

Pico Neo WhaleyVR ODG R8/R9 ZTE Axon Samsung Galaxy S8 Edge 20+ 20+ Devices launched In development 22 Google Daydream and Qualcomm collaboration

• Jointly fostering the ecosystem of standalone mobile VR • Google IO accountment: 835 standalone reference design

23 Jointly fostering the ecosystem of standalone mobile VR

24 Developer Network Snapdragon Mobile VR Development Kit

v Snapdragon VR SDK v Snapdragon VR HMD

developer.qualcomm.com Thank you

Follow us on: For more information, visit us at: www.qualcomm.com & www.qualcomm.com/blog

Nothing in these materials is an offer to sell any of the components or devices referenced herein. ©2017 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved. Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other countries. Other products and brand names may be trademarks or registered trademarks of their respective owners. References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm’s engineering, research and development functions, and substantially all of its product and services businesses, including its semiconductor business, QCT.