DOCSLIB.ORG

Khronos Cross-Platform Standards Update Vulkan, Anari, Openxr, Gltf and Opencl

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text

Load more

KHRONOS CROSS-PLATFORM STANDARDS UPDATE VULKAN, ANARI, OPENXR, GLTF AND OPENCL Neil Trevett, GTC, March 2020 VP NVIDIA, Khronos President AGENDA Latest updates on key Khronos open standards That are of most interest to the GTC audience Vulkan, ANARI, SPIR-V, OpenXR, glTF and OpenCL On Khronos format slides NVIDIA and Khronos Standards How NVIDIA is supporting and deploying Khronos Open Standards On NVIDIA format slides 2 Khronos Connects Software to Silicon Open interoperability standards to enable software to effectively harness the power of multiprocessors and accelerator silicon 3D graphics, XR, parallel programming, vision acceleration and machine learning Non-profit, member-driven standards-defining industry consortium Open to any interested company All Khronos standards are royalty-free Well-defined IP Framework protects participant’s intellectual property >150 Members ~ 40% US, 30% Europe, 30% Asia © The Khronos® Group Inc. 2020 - Page 3 Khronos Active Initiatives 3D Graphics 3D Assets Portable XR Parallel Computation Desktop, Mobile, Web Authoring Augmented and Vision, Inferencing, Machine Embedded and Safety Critical and Delivery Virtual Reality Learning Guidelines for creating APIs to streamline system safety certification NVIDIA is fully committed to continuing to support OpenGL Exploring expanded interop with Vulkan New functionality is primarily Vulkan-focused © The Khronos® Group Inc. 2020 - Page 4 Pervasive Vulkan Desktop and Mobile GPUs http://vulkan.gpuinfo.org/ Platforms Apple Desktop Android (via porting Media Players Consoles (Android 7.0+) layers) (Vulkan 1.1 required on Android Q) Virtual Reality Cloud Services Game Streaming Embedded Engines Croteam Serious Engine Note: The version of Vulkan available will depend on platform and vendor © The Khronos® Group Inc. 2020 - Page 5 Vulkan AAA Content © The Khronos® Group Inc. 2020 - Page 6 Vulkan Roadmap Vulkan 1.1 Extensions Maintenance updates plus additional functionality Roadmap Discussions Timeline semaphores Ray Tracing DX/HLSL compatibility Variable Rate Shading Bindless resources Reduced precision arithmetic Accelerated Video Encode/Decode Formal memory model Machine Learning Primitives Buffer references Mesh Shaders SPIR-V 1.5 January 2020 DLSS 2.0 smart scaling can be used with Vulkan applications Does not need per application training © The Khronos® Group Inc. 2020 - Page 7 Vulkan Ray Tracing Set of Extensions to Vulkan, GLSL and SPIR-V Seamlessly integrates ray tracing into Vulkan 1.X Familiar Ray Tracing Pipeline Architecture The industry’s first open, cross- Straightforward porting between Vulkan Ray Tracing and DXR vendor, cross-platform standard for - including re-use of ray tracing shaders written in HLSL ray tracing acceleration Can be accelerated on existing Vulkan Ray GPU compute and dedicated ray DX12 / DXR Tracing tracing cores Extensions are Provisional Ray Tracing Pipelines Yes Yes Launched 17th March 2020 DXR 1.1 Open to developer feedback Ray Queries Optional Inline raytracing before finalization https://khr.io/vkrayprovfeedback Language for GLSL or HLSL HLSL Ray Tracing Shaders Pipeline Libraries Yes Yes Build Acceleration Structure Optional No on Host Straightforward port from NVIDIA VKRay Deferred Host Operations Optional No vendor extension to KHR extensions Shipping beta drivers today Capture/Replay Support for Example code coming soon Optional No Tools (e.g. RenderDoc) https://www.khronos.org/registry/vulkan/ © The Khronos® Group Inc. 2020 - Page 8 Vulkan Ray Tracing and Shading Languages HLSL HLSL and Vulkan with DXC DXC Microsoft’s DXC HLSL compiler was open sourced in Jan 2017 Front-end Parsing Google and others have added SPIR-V code generation to DXC and Validation with Microsoft’s knowledge and approval Vulkan developers can now choose between GLSL and HLSL! AST Abstract Syntax Tree Vulkan Ray Tracing includes GLSL and SPIR-V Extensions Enabling compiled GLSL/SPIR-V shaders to operate in a Ray Tracing Pipeline – similar to HLSL features used in Direct3D’s DXR SPIR-V DXIL Backend Backend HLSL for Vulkan Ray Tracing NVIDIA added code generation to DXC to generate SPIR-V for the NVIDIA VKRay ray tracing vendor extension from HLSL SPIR-V DXIL Vulkan Ray Tracing Extensions supported in HLSL soon Developers can port HLSL shaders SPIR-V Tools DXIL Tools with minimal changes between Vulkan Ray Tracing and DXR © The Khronos® Group Inc. 2020 - Page 9 NVIDIA AND VULKAN NVIDIA deeply engaged in Vulkan and driving extend/consolidate cycle NVIDIA shipped Vulkan 1.0, 1.1 and 1.2 on day of spec releases Shipped beta Vulkan Ray Tracing extensions on day of spec release Increased Vulkan support in NSIGHT 2020.2 development tool – close parity now with DX12 NVIDIA chairing multiple Vulkan initiatives at Khronos Ray Tracing: contributed NVIDIA VKRay to catalyze Vulkan Ray Tracing KHR extensions Vulkan Portability: bringing layered Vulkan to Apple, WebGPU, silicon without native drivers etc. Machine Learning: low-level inferencing primitives Cloud – Windows and Linux Desktop – Kepler and later Nintendo Switch Shield Android TV Jetson 10 Open Source Layering Projects Fighting Platform Fragmentation Layers Vulkan OpenGL OpenCL OpenGL ES DX12 DX9-11 Over Vulkan is effective clspv GLOVE DXVK porting layer for API Vulkan Zink clvk Angle vkd3d WineD3D portability and stack simplification gfx-rs OpenGL Ashes Angle WineD3D Microsoft Microsoft Microsoft DX12 gfx-rs ‘GLOn12’ ‘CLOn12’ D3D11On12 gfx-rs DX9-11 Ashes Angle MoltenVK MoltenGL Metal gfx-rs Angle ‘Vulkan everywhere’! Working towards Even if no native ‘OpenCL drivers on platform Everywhere’! © The Khronos® Group Inc. 2020 - Page 11 Vulkan Portability on macOS and iOS Applications Vulkan Portability Extension provides query for available functionality Vulkan Open source SDK on macOS All present functionality must be macOS SDK Build, run, and debug apps conformant to use logo with validation layer support https://vulkan.lunarg.com/ SPIRV-Cross macOS / iOS Open source Convert SPIR-V shaders to Run-time For MacOS/iOS Metal Shading Language Maps Vulkan to Metal Beta open source For MacOS/iOS Vulkan applications shipping today on macOS or iOS using MoltenVK © The Khronos® Group Inc. 2020 - Page 12 ANARI – Analytic Rendering API Scientific Visualization Portability APIs to describe objects in a scene - the renderer does the rest Ray tracing was key motivation – but can drive any renderer SciViz Apps Scene Graphs and Engines Renderers: Intel OSPRAY, AMD ProRender, NVIDIA VisRTX etc. Acceleration APIs: Embree, Optix, Radeon Rays, CUDA, OpenCL, Vulkan etc. Hardware: CPUs, GPUs etc. Industry Support © The Khronos® Group Inc. 2020 - Page 13 OpenXR – Cross-Platform Portable AR/VR Working Group Participants Games Engines Desktop/Console VR AR Mobile VR GPUs OpenXR is a collaborative design UI Devices Integrating many lessons from proprietary ‘first-generation’ XR API designs * OpenXR 1.0 is focused on enabling cross-platform applications. Optional device plugin interface will be supported post V1.0 © Copyright Khronos® Group Inc. 2020 Page 14 OpenXR 1.0 Availability Significant Community Feedback Finalize Conformance Test Suite Enable Officially Conformant Implementations Improved Input subsystem, game engine editor support, loader … Provisional OpenXR for Windows Mixed Reality headsets Specification and HoloLens 2 GDC, March 2019 PLUS extensions to support HoloLens 2 hand tracking, eye tracking, spatial mapping and spatial anchors Many more coming! Ratify and Release OpenXR support for Oculus Rift and Oculus Quest OpenXR 1.0 Oculus PC (for Rift) and Android SDK (for Quest) SIGGRAPH, July 2019 include OpenXR for native C/C++ development ‘Monado’ OpenXR open source implementation Support OpenHMD hardware and Nova Northstar AR HMD OpenXR 1.0 plugin for Unreal Engine v4.2.4 © The Khronos® Group Inc. 2019 - Page 15 OpenXR is used with a 3D API Application or Engine Display, High-performance, low-latency composition and Cross-platform access to XR 3D rendering and composition* optical correction HMDs and sensors Multiview parameters XR application lifecycle Context priority Input device discovery and events Front buffer rendering Sensor tracking and pose calculation Tiled rendering (beam racing) Frame timing and display composition Variable rate rendering Haptics Control * OpenXR can be used with other 3D APIs such as Direct3D, OpenGL and OpenGL ES © The Khronos® Group Inc. 2019 - Page 16 OPENXR AND EDGE SERVER APPS Low latency Sensor Data Location–aware Content Requests OpenXR APIs hide the 5G round trip from applications MEC (Multi-access Edge Sensor handling Computing) Server 1. Processes sensor data, including machine learning for environmental lighting, occlusion, Needed assets Display composition scene semantics, object loaded to reconstruction and UI edge server 2. Generates imagery from 3D Wireless mobile device with models, including stereo, foveal rendering, ray-tracing, optics pre- display and sensors distortion, varifocal processing Apps and 3D Assets NVIDIA EGX Generated Augmentations & Scenes 17 Modo Paint 3D Titania Discover Repositories Game Engines 3D Authoring Tools Web Engines 3D Builder Oculus Create Experience 3D printing Tools Apps / Engines 3D Asset Format for Efficient VR / AR Authoring Tools Transmission and Processing Sony 3D Creator Drive Demand Apps and Engines Users 3D Live Object 3D Scanning Tools gltfpack Mixed Reality Viewer Collada2gltf OBJ2GLTF FBX2glTF Windows Mixed Convertors and Optimizers Reality Home glTF Reference Viewer VR / AR Apps and Engines gltf-vscode glTF-asset-generator
Recommended publications
  • Introduction to the Vulkan Computer Graphics API

    Introduction to the Vulkan Computer Graphics API

    1 Introduction to the Vulkan Computer Graphics API Mike Bailey mjb – July 24, 2020 2 Computer Graphics Introduction to the Vulkan Computer Graphics API Mike Bailey [email protected] SIGGRAPH 2020 Abridged Version This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License http://cs.oregonstate.edu/~mjb/vulkan ABRIDGED.pptx mjb – July 24, 2020 3 Course Goals • Give a sense of how Vulkan is different from OpenGL • Show how to do basic drawing in Vulkan • Leave you with working, documented, understandable sample code http://cs.oregonstate.edu/~mjb/vulkan mjb – July 24, 2020 4 Mike Bailey • Professor of Computer Science, Oregon State University • Has been in computer graphics for over 30 years • Has had over 8,000 students in his university classes • [email protected] Welcome! I’m happy to be here. I hope you are too ! http://cs.oregonstate.edu/~mjb/vulkan mjb – July 24, 2020 5 Sections 13.Swap Chain 1. Introduction 14.Push Constants 2. Sample Code 15.Physical Devices 3. Drawing 16.Logical Devices 4. Shaders and SPIR-V 17.Dynamic State Variables 5. Data Buffers 18.Getting Information Back 6. GLFW 19.Compute Shaders 7. GLM 20.Specialization Constants 8. Instancing 21.Synchronization 9. Graphics Pipeline Data Structure 22.Pipeline Barriers 10.Descriptor Sets 23.Multisampling 11.Textures 24.Multipass 12.Queues and Command Buffers 25.Ray Tracing Section titles that have been greyed-out have not been included in the ABRIDGED noteset, i.e., the one that has been made to fit in SIGGRAPH’s reduced time slot.
  • Standards for Vision Processing and Neural Networks

    Standards for Vision Processing and Neural Networks

    Standards for Vision Processing and Neural Networks Radhakrishna Giduthuri, AMD [email protected] © Copyright Khronos Group 2017 - Page 1 Agenda • Why we need a standard? • Khronos NNEF • Khronos OpenVX dog Network Architecture Pre-trained Network Model (weights, …) © Copyright Khronos Group 2017 - Page 2 Neural Network End-to-End Workflow Neural Network Third Vision/AI Party Applications Training Frameworks Tools Datasets Trained Vision and Neural Network Network Inferencing Runtime Network Model Architecture Desktop and Cloud Hardware Embedded/Mobile Embedded/MobileEmbedded/Mobile Embedded/Mobile/Desktop/CloudVision/InferencingVision/Inferencing Hardware Hardware cuDNN MIOpen MKL-DNN Vision/InferencingVision/Inferencing Hardware Hardware GPU DSP CPU Custom FPGA © Copyright Khronos Group 2017 - Page 3 Problem: Neural Network Fragmentation Neural Network Training and Inferencing Fragmentation NN Authoring Framework 1 Inference Engine 1 NN Authoring Framework 2 Inference Engine 2 NN Authoring Framework 3 Inference Engine 3 Every Tool Needs an Exporter to Every Accelerator Neural Network Inferencing Fragmentation toll on Applications Inference Engine 1 Hardware 1 Vision/AI Inference Engine 2 Hardware 2 Application Inference Engine 3 Hardware 3 Every Application Needs know about Every Accelerator API © Copyright Khronos Group 2017 - Page 4 Khronos APIs Connect Software to Silicon Software Silicon Khronos is an International Industry Consortium of over 100 companies creating royalty-free, open standard APIs to enable software to access
  • CREANDO: Tool for Creating Pervasive Games to Increase the Learning Motivation in Higher Education Students

    CREANDO: Tool for Creating Pervasive Games to Increase the Learning Motivation in Higher Education Students

    CREANDO: Tool for creating pervasive games to increase the learning motivation in higher education students Jeferson Arango-López a,b,⁎, Carlos C. Cerón Valdivieso a, Cesar A. Collazos a, b c,d Francisco Luis Gutiérrez Vela , Fernando Moreira a University of Cauca – FIET, Street 5 N° 4-70, Popayán, Colombia b University of Granada, ETSIIT, Department of Languages and Informatics Systems, Street Periodista Daniel Saucedo Aranda, s/n, 18071 Granada, Spain c Univ Portucalense, REMIT, IJP, Rua Dr. António Bernardino Almeida 541-619, 4200-072 Porto, Portugal d IEETA, Univ Aveiro, Aveiro, Portugal A R T I C L E I N F O A B S T R A C T Keywords: The pervasive games (PG) have had a great reception in recent years. This kind of games com- bines the Pervasive game virtual world with the real world to generate extensions of reality in terms of time, space and social Narrative interaction. These extensions have involved users in experiences as varied as those exposed by Learning motivation augmented reality and the location of the player or mixed reality scenarios. In the educational context, Digital transformation games have been integrated little by little into learning processes. Speci fically, PG have shown to have a higher level of immersion in people's daily activities. Therefore, a greater impact is generated when integrating the technologies of the PG and the narrative of a story that is told through the gaming experience. In order to explore some fields, we focus the study on the narrative and geolocation applied to close spaces, it is a way of giving an enriched experience to the player through a digital transformation perspective.
  • Performance in an Alternate Reality Game

    Performance in an Alternate Reality Game

    The Malthusian Paradox: Performance in an Alternate Reality Game ELIZABETH EVANS, MARTIN FLINTHAM, SARAH MARTINDALE University of Nottingham Nottingham NG81BB, UK { elizabeth.evans, martin.flintham, sarah.martindale }@nottingham.ac.uk Tel: +44 115 748 4041 Fax: +44 115 823 2551 URL: www.nottingham.ac.uk Abstract. The Malthusian Paradox is a transmedia alternate reality game (ARG) created by artists Dominic Shaw and Adam Sporne played by 300 participants over three months. We explore the design of the game, which cast players as agents of a radical organisation attempting to uncover the truth behind a kidnapping and a sinister biotech corporation, and highlight how it redefined performative frames by blurring conventional performer and spectator roles in sometimes discomforting ways. Players participated in the game via a broad spectrum of interaction channels, including performative group spectacles and 1-to-1 engagements with game characters in public settings, making use of low- and high-tech physical and online artefacts including bespoke and third party websites. Players and game characters communicated via telephony and social media in both a designed and an ad-hoc manner. We reflect on the production and orchestration of the game, including the dynamic nature of the strong episodic narrative driven by professionally produced short films that attempted to respond to the actions of players; and the difficulty of designing for engagement across hybrid and temporally expansive performance space. We suggest that an ARG whose boundaries
  • Khronos Template 2015

    Khronos Template 2015

    Ecosystem Overview Neil Trevett | Khronos President NVIDIA Vice President Developer Ecosystem [email protected] | @neilt3d © Copyright Khronos Group 2016 - Page 1 Khronos Mission Software Silicon Khronos is an Industry Consortium of over 100 companies creating royalty-free, open standard APIs to enable software to access hardware acceleration for graphics, parallel compute and vision © Copyright Khronos Group 2016 - Page 2 http://accelerateyourworld.org/ © Copyright Khronos Group 2016 - Page 3 Vision Pipeline Challenges and Opportunities Growing Camera Diversity Diverse Vision Processors Sensor Proliferation 22 Flexible sensor and camera Use efficient acceleration to Combine vision output control to GENERATE PROCESS with other sensor data an image stream the image stream on device © Copyright Khronos Group 2016 - Page 4 OpenVX – Low Power Vision Acceleration • Higher level abstraction API - Targeted at real-time mobile and embedded platforms • Performance portability across diverse architectures - Multi-core CPUs, GPUs, DSPs and DSP arrays, ISPs, Dedicated hardware… • Extends portable vision acceleration to very low power domains - Doesn’t require high-power CPU/GPU Complex - Lower precision requirements than OpenCL - Low-power host can setup and manage frame-rate graph Vision Engine Middleware Application X100 Dedicated Vision Processing Hardware Efficiency Vision DSPs X10 GPU Compute Accelerator Multi-core Accelerator Power Efficiency Power X1 CPU Accelerator Computation Flexibility © Copyright Khronos Group 2016 - Page 5 OpenVX Graphs
  • Migrating from Opengl to Vulkan Mark Kilgard, January 19, 2016 About the Speaker Who Is This Guy?

    Migrating from Opengl to Vulkan Mark Kilgard, January 19, 2016 About the Speaker Who Is This Guy?

    Migrating from OpenGL to Vulkan Mark Kilgard, January 19, 2016 About the Speaker Who is this guy? Mark Kilgard Principal Graphics Software Engineer in Austin, Texas Long-time OpenGL driver developer at NVIDIA Author and implementer of many OpenGL extensions Collaborated on the development of Cg First commercial GPU shading language Recently working on GPU-accelerated vector graphics (Yes, and wrote GLUT in ages past) 2 Motivation for Talk Coming from OpenGL, Preparing for Vulkan What kinds of apps benefit from Vulkan? How to prepare your OpenGL code base to transition to Vulkan How various common OpenGL usage scenarios are re-thought in Vulkan Re-thinking your application structure for Vulkan 3 Analogy Different Valid Approaches 4 Analogy Fixed-function OpenGL Pre-assembled toy car fun out of the box, not much room for customization 5 AZDO = Approaching Zero Driver Overhead Analogy Modern AZDO OpenGL with Programmable Shaders LEGO Kit you build it yourself, comes with plenty of useful, pre-shaped pieces 6 Analogy Vulkan Pine Wood Derby Kit you build it yourself to race from raw materials power tools used to assemble, adult supervision highly recommended 7 Analogy Different Valid Approaches Fixed-function OpenGL Modern AZDO OpenGL with Vulkan Programmable Shaders 8 Beneficial Vulkan Scenarios Has Parallelizable CPU-bound Graphics Work yes Can your graphics Is your graphics work start work creation be CPU bound? parallelized? yes Vulkan friendly 9 Beneficial Vulkan Scenarios Maximizing a Graphics Platform Budget You’ll yes do whatever Your graphics start it takes to squeeze platform is fixed out max perf. yes Vulkan friendly 10 Beneficial Vulkan Scenarios Managing Predictable Performance, Free of Hitching You put yes You can a premium on manage your start avoiding graphics resource hitches allocations yes Vulkan friendly 11 Unlikely to Benefit Scenarios to Reconsider Coding to Vulkan 1.
  • Augmented Reality and Its Aspects: a Case Study for Heating Systems

    Augmented Reality and Its Aspects: a Case Study for Heating Systems

    Augmented Reality and its aspects: a case study for heating systems. Lucas Cavalcanti Viveiros Dissertation presented to the School of Technology and Management of Bragança to obtain a Master’s Degree in Information Systems. Under the double diploma course with the Federal Technological University of Paraná Work oriented by: Prof. Paulo Jorge Teixeira Matos Prof. Jorge Aikes Junior Bragança 2018-2019 ii Augmented Reality and its aspects: a case study for heating systems. Lucas Cavalcanti Viveiros Dissertation presented to the School of Technology and Management of Bragança to obtain a Master’s Degree in Information Systems. Under the double diploma course with the Federal Technological University of Paraná Work oriented by: Prof. Paulo Jorge Teixeira Matos Prof. Jorge Aikes Junior Bragança 2018-2019 iv Dedication I dedicate this work to my friends and my family, especially to my parents Tadeu José Viveiros and Vera Neide Cavalcanti, who have always supported me to continue my stud- ies, despite the physical distance has been a demand factor from the beginning of the studies by the change of state and country. v Acknowledgment First of all, I thank God for the opportunity. All the teachers who helped me throughout my journey. Especially, the mentors Paulo Matos and Jorge Aikes Junior, who not only provided the necessary support but also the opportunity to explore a recent area that is still under development. Moreover, the professors Paulo Leitão and Leonel Deusdado from CeDRI’s laboratory for allowing me to make use of the HoloLens device from Microsoft. vi Abstract Thanks to the advances of technology in various domains, and the mixing between real and virtual worlds.
  • Extreme-Right Gamification

    Extreme-Right Gamification

    By Ben Lee Only Playing: Extreme-Right Gamification WHILE EXTREMIST IDEAS The game offers purchasers the chance to kill demons, INSPIRE VIOLENCE IN A FEW, vegans, and socialists. FOR THE MANY, PARTICIPATION INCREASINGLY RESEMBLES A As with Jihadist propaganda, video games have also been CONSEQUENCE-FREE GAME incorporated into extreme-right propaganda, often as a SEPARATE FROM REALITY. source of memes or, in some cases, used to re-stage terror attacks at an elaborate level of detail, right down to the Video games and right-wing extremism (RWE) seem choice of weapons and music. These developments are inseparable. commonly subsumed under the heading of gamification. Examples of previous mixed-reality or related pervasive elaborate pervasive game and are often distant from the Multiple links have been documented between extreme- games include Pokémon GO, which for a time brought violent consequences of the subcultures they participate Although the concept of gamification has a specific right violence and video-game cultures. These include together large numbers of smartphone-wielding players in. meaning, it has come to be used often as a catch-all term the appearance of terrorist manifestos with references in physical spaces attempting to catch virtual Pokémon, for references to video game culture within extremist to video games, modifications to popular games to bring often not without consequences. The consequences of this sort of gamification are circles and the incorporation of video-game-like them into line with extreme-right values, the presence of uncertain at this point. elements into participatory systems. extremists on gaming platforms, and a misogyny-laced Within the extreme-right, much has been made of the mass migration to and fusion of digital platforms around Probably the most concerning from the point of view of controversy in video gaming that did much to politicise However, gamification is also a way into a deeper extremist participation.
  • Building the Metaverse One Open Standard at a Time

    Building the Metaverse One Open Standard at a Time

    Building the Metaverse One Open Standard at a Time Khronos APIs and 3D Asset Formats for XR Neil Trevett Khronos President NVIDIA VP Developer Ecosystems [email protected]| @neilt3d April 2020 © Khronos® Group 2020 This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 1 Khronos Connects Software to Silicon Open interoperability standards to enable software to effectively harness the power of multiprocessors and accelerator silicon 3D graphics, XR, parallel programming, vision acceleration and machine learning Non-profit, member-driven standards-defining industry consortium Open to any interested company All Khronos standards are royalty-free Well-defined IP Framework protects participant’s intellectual property >150 Members ~ 40% US, 30% Europe, 30% Asia This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 2 Khronos Active Initiatives 3D Graphics 3D Assets Portable XR Parallel Computation Desktop, Mobile, Web Authoring Augmented and Vision, Inferencing, Machine Embedded and Safety Critical and Delivery Virtual Reality Learning Guidelines for creating APIs to streamline system safety certification This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 3 Pervasive Vulkan Desktop and Mobile GPUs http://vulkan.gpuinfo.org/ Platforms Apple Desktop Android (via porting Media Players Consoles (Android 7.0+) layers) (Vulkan 1.1 required on Android Q) Virtual Reality Cloud Services Game Streaming Embedded Engines Croteam Serious Engine Note: The version of Vulkan available will depend on platform and vendor This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc.
  • Openxr 1.0 Reference Guide Page 1

    Openxr 1.0 Reference Guide Page 1

    OpenXR 1.0 Reference Guide Page 1 OpenXR™ is a cross-platform API that enables a continuum of real-and-virtual combined environments generated by computers through human-machine interaction and is inclusive of the technologies associated with virtual reality, augmented reality, and mixed reality. It is the interface between an application and an in-process or out-of-process XR runtime that may handle frame composition, peripheral management, and more. Color-coded names as follows: function names and structure names. [n.n.n] Indicates sections and text in the OpenXR 1.0 specification. Specification and additional resources at khronos.org/openxr £ Indicates content that pertains to an extension. OpenXR API Overview A high level overview of a typical OpenXR application including the order of function calls, creation of objects, session state changes, and the rendering loop. OpenXR Action System Concepts [11.1] Create action and action spaces Set up interaction profile bindings Sync and get action states xrCreateActionSet xrSetInteractionProfileSuggestedBindings xrSyncActions name = "gameplay" /interaction_profiles/oculus/touch_controller session activeActionSets = { "gameplay", ...} xrCreateAction "teleport": /user/hand/right/input/a/click actionSet="gameplay" "teleport_ray": /user/hand/right/input/aim/pose xrGetActionStateBoolean ("teleport_ray") name = “teleport” if (state.currentState) // button is pressed /interaction_profiles/htc/vive_controller type = XR_INPUT_ACTION_TYPE_BOOLEAN { actionSet="gameplay" "teleport": /user/hand/right/input/trackpad/click
  • Being Virtual: Embodiment and Experience in Interactive Computer Game Play

    Being Virtual: Embodiment and Experience in Interactive Computer Game Play

    Being Virtual: Embodiment and Experience in Interactive Computer Game Play Hanna Mathilde Sommerseth PhD The University of Edinburgh January 2010 1 Declaration My signature certifies that this thesis represents my own original work, the results of my own original research, and that I have clearly cited all sources and that this work has not been submitted for any other degree or professional qualification except as specified. Hanna Mathilde Sommerseth 2 Acknowledgements I am grateful to my supervisor Ella Chmielewska for her continued support throughout the past four years. I could not have gotten to where I am today without her encouragement and belief in my ability to do well. I am also deeply thankful also to a number of other mentors, official and unofficial for their advice and help: Richard Coyne, John Frow, Brian McNair, Jane Sillars, and most especially thank you to Nick Prior for his continued friendship and support. I am thankful for the Higher Education Funding Council in Scotland and the University of Edinburgh for the granting of an Overseas Research Student award allowing me to undertake this thesis in the first place, as well as to the Norwegian State Educational Loan Fund for maintenance grants allowing me to live while doing it. In the category of financial gratefulness, I must also thank my parents for their continued help over these four years when times have been difficult. Rumour has it that the process of writing a thesis of this kind can be a lonely endeavour. But in the years I have spent writing I have found a great community of emerging scholars and friends at the university and beyond that have supported and challenged me in ways too many to mention.
  • The State of Vulkan on Apple 03June 2021

    The State of Vulkan on Apple 03June 2021

    The State of Vulkan on Apple Devices Why you should be developing for the Apple ecosystem with Vulkan, and how to do it. Richard S. Wright Jr., LunarG June 3, 2021 If you are reading this, you likely already know what Vulkan is -- a low-overhead, high-performance, cross-platform, graphics and compute API designed to take maximum advantage of today's highly parallel and scalable graphics and compute hardware. To be sure, there are other APIs with this goal such as Microsoft’s DirectX and Apple’s Metal API. For a long time OpenGL matured to meet the needs of rapidly evolving hardware and met well the challenges of cross-platform development of high-performance graphics applications. OpenGL will remain viable for a very long time for many applications (and can actually be layered on top of Vulkan), but to take maximum advantage of modern hardware, a new and somewhat reinvented approach is called for. Everyone does not need the level of control that Vulkan provides, but if you do, you can think of Vulkan as a lower-level successor to OpenGL in that it attempts to enable highly portable, yet high-performance, application development across desktop and mobile device platforms. Writing platform specific code does have its advantages, and vendors such as Microsoft and Apple certainly adore having best of breed titles available exclusively for their customers as it adds value to their ecosystem. For developers though, it is often in our best interests to make our products available as widely as possible. Aside from gaming consoles with their mostly closed development environments, Windows, Linux, Apple, and Android combined represent most of the market for developers of end user software and games today.