Khronos Overview Tokyo Dec10

10th Anniversary Update

Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group Tokyo, December 2010 © Copyright Khronos Group, 2010 - Page 1 Welcome!

• In its first 10 years Khronos has created standards that are now shipping in 100‟s of millions of devices

• Today we will give you update on Khronos and our news over the last year - Hwanyong Lee, CTO Huone – OpenVG Overview - Erik Noreke, OpenSL ES Chair – OpenSL ES and OpenMAX IL Overview

• … hear from Japanese members using and shipping Khronos APIs - Takumi, Hi, Imagination, DMP

• … and discuss about how we will start out the next 10 years

Billions of devices increasing graphics, compute, video, imaging and audio capabilities

Standard APIs define Market growth silicon capabilities driven by rich and provide reliable user developer access experiences

Developers creating user experiences need efficient silicon accelerator access

“The best way to predict the future is to invent it.” Alan Kay

• Rich end-user experiences need significant processing - Parallel Computing - GPU Computing - 3D Graphics - 2D Graphics - Camera control - Image processing - Video encode - Video decode - Audio encode - Audio decode • All this silicon needs to be programmed

APIs enable software developers to turn silicon functionality into Khronos APIs are low-level – just rich end user above raw silicon - to create the “foundation” functionality needed on experiences every platform

Open International Membership Any company is welcome to join to suggest working groups and technology directions

Industry Cooperation Hundreds of man years invested by industry experts to create state-of-the APIs

Open Standards Royalty Free Publicly available on No per-device royalty web-site to be used to ship API by anyone implementations

Opportunity to compete to create chips, software and systems that deliver amazing end user experiences in international markets International Market Growth= ¥ $ € !

3D Digital Asset Plugin-free Mobile OS

accessibility Exchange format 3D Web Content Abstraction Authoring and and Authoring

A coordinated ecosystem of compute, graphics and media Cross platform Parallel Context, Sync and Embedded 3D

desktop 3D Computing Surface Management standards and APIs

Application Application Acceleration Acceleration

Safety Critical 3D Streaming Media Advanced Audio Vector 2D

Video, Audio and Window System System System Codec Creation

Image Acceleration Acceleration Integration Integration

WebGL 1.0 Provisional OpenCL 1.1 Specification Specification Released Released Mar10 Jul10

Nov09 Jun10 OpenGL 4.0 OpenGL 4.1 Released Released

Tessellation and Compute „Shape 4.X realism‟

Geometry Shaders 3.X

Vertex and Fragment Shaders 2.X Fixed Function 1.X „Surface realism‟

2004 2005 2006 2007 2008 2009 2010 2011

DirectX 11 DirectX 9.0c DirectX 10.0 DirectX 10.1 OpenGL 3.1 OpenGL 3.3 + OpenGL 2.0 OpenGL 2.1 OpenGL 3.0 OpenGL 3.2 OpenGL 4.0

• OpenGL increasing pace of innovation OpenGL 4.1 - Six new spec versions in two years - Actual implementations following specifications closely • OpenGL 4.1 and GLSL 4.10 specifications available June 2010 - Support for the latest generation of programmable hardware • OpenGL 4.1 is now superset of DX11 functionality

CPUs GPUs Multiple cores driving Emerging Increasingly general performance increases Intersection purpose data-parallel computing

Multi- Heterogeneous Graphics processor Computing APIs and programming Shading – e.g. OpenMP Languages

OpenCL is a programming framework for heterogeneous compute resources

• Language Specification - C-based cross-platform programming interface - Subset of ISO C99 with language extensions - familiar to developers - Defined numerical accuracy - IEEE 754 rounding with specified maximum error - Online or offline compilation and build of compute kernel executables - Rich set of built-in functions • Platform Layer API - A hardware abstraction layer over diverse computational resources - Query, select and initialize compute devices - Create compute contexts and work-queues • Runtime API - Execute compute kernels - Manage scheduling, compute, and memory resources

• Six months from proposal to released OpenCL 1.0 specification - Due to a strong initial proposal and a shared commercial incentive • Multiple conformant implementations shipping - For CPUs and GPUs on multiple OS • 18 month cadence between OpenCL 1.0 and OpenCL 1.1 - Many new API and language features – responding to developer feedback - Backwards compatibility protect software investment

Khronos publicly Multiple conformant releases OpenCL 1.0 as implementations ship royalty-free across diverse OS specification and platforms Jun08 May09 Jun10 Dec08 2H09 Apple proposes OpenCL Khronos releases OpenCL OpenCL 1.1 working group and 1.0 conformance tests to Specification released and contributes draft specification ensure high-quality first implementations ship to Khronos implementations © Copyright Khronos Group, 2010 - Page 16 OpenCL Desktop Implementations

• http://www.amd.com/us/products/technologies/stream- technology/opencl/Pages/opencl.aspx • http://software.intel.com/en-us/articles/intel-opencl-sdk/ • http://www.nvidia.com/object/cuda_opencl_new.html

• http://maps.google.com/maps/ms?ie=UTF8&oe=UTF8&msa=0&msid=11 0337952595184289080.000491695f76aaf121c0d

Games and TV and Video Compositing Games and Flash Players TV and Video Game Engines Flash Players Stacks Browsers User Interfaces GameGames Engines and Flash and SVG TVStacks and Video Game Engines Players Stacks

Applications are portable to Khronos-enabled platforms

Silicon and platform independent OS resource graphics, media abstraction and compute acceleration

Surface Flinger EGL and OpenSL ES now supported in Android 2.3 NDK

Plug-in Native support

Buffers, textures and video streams flow efficiently Inter-API Synchronization between any combination of events enable efficient client APIs resource sharing

EGL Interoperability Enabling the Khronos Conformance Tests being individual APIs to created to ensure that client interoperate as a APIs can cleanly communicate coherent ecosystem

Desktop Visual Computing OpenGL and OpenCL have direct interoperability. OpenCL objects can be created from OpenGL Textures, Buffer Objects and Renderbuffers

Mobile Visual Computing Compute, graphics and AV APIs interoperate through EGL

• Historic opportunity to bring accelerated 3D graphics to web - WebGL defines JavaScript binding to OpenGL ES 2.0 • Leveraging HTML 5 and uses

JavaScript binding to OpenGL ES 2.0 Availability of OpenGL ES 2.0 Increasing JavaScript on almost every performance. web-capable device HTML 5 Canvas Tag

• Working group launched March 2009 - Mozilla, Apple, Google and Opera working with OpenGL GPU vendors - Provisional spec – November 2009 Plug-in Production support expected in 1Q11 - Implementations in public daily builds - WebGL 1.0 expected spring 2011 - WebGL on Windows uses Google Angle Content Download From Web to create ES2 over DX9 JavaScript, HTML, CSS, ... • WebGL JS middleware already - GLGE, SpiderGL, X3DOM, EnergizeGL, WebGL HTML5 Browser SceneJS, O3D, CopperLicht, CubicVR Provided • WebGL Extension Registry Online JavaScript CSS - http://www.khronos.org/registry/webgl OpenGL ES 2.0 OS /doc/spec/extensions/ OpenGL DX9/Angle Provided

• WebGL is HTML - fully participates in canvas/browser compositing - Overlay and underlay HTML content - including SVG - Easy to make HUDs or user interfaces • WebGL TexImage2D accepts - Raw buffer - HTML image element - HTML video element (takes current frame) - HTML canvas element

E.g. draw text to 2D canvas, use as bump-map texture in WebGL then composite 3D model over HTML text

Leading-edge functionality developed first on desktop OpenGL ES 2.0 on desktop as subset of OpenGL 4.1 for mobile content flexibility – including native support for WebGL

WebGL will drive new- generation security into OpenGL family

Mobile functionality subset that is deployed on billions of devices Pervasive OpenGL ES 2.0 availability enables Browser vendors to build 3D directly into HTML5

• New working groups for ray-tracing and computer vision? • EGL extensions for rich graphics/video interop? • 3D Convergence - does OpenGL ES become an OpenGL profile over time? • Need EGL and OpenMAX IL on desktop – increased application portability? • OpenVG Express – for bring essential OpenVG onto every GPU? • Bringing vector graphics to OpenGL / OpenGL ES? • W3C liaison for web-based augmented reality?

• Hwanyong Lee, CTO, HUONE - OpenVG – Khronos Overview • Erik Noreke, OpenSL ES Work Group Chairperson - OpenSL ES and OpenMAX – Khronos Overview

• Tommy Asano, Executive Director, Advanced Technologies, TAKUMI - Graphics IP core enabling Khronos API for embedded solutions • Shige Matsue, President, Imagination Tech KK - OpenGL ES, OpenVG, OpenCL - Bringing All Khronos APIs Together • Tomotaka Watanabe, Marketing Manager, HI Corp - Middleware product development using Khronos APIs • Tatsuo Yamamoto, CEO, DMP - Khronos API training programs