DOCSLIB.ORG

Introduction to Khronos Group and Openxr

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Introduction to Khronos Group and Openxr Introduction to Khronos Group and OpenXR June 2, 2020 Agenda Item Overview about the AREA and 5 mins the Interoperability and Standards Program 10 min Paul Davies, The Boeing Company 10 min Neil Trevett, President Khronos Group 25 mins Brent Insko, Khronos Group OpenXR and Intel 10 mins Questions from Participants SPEAKERS Paul Davies Neil Trevett, NVIDIA Brent Insko, Intel The Boeing Company Khronos Group Khronos Open XR WG 6/5/2020 3 The Comprehensive Ecosystem Enterprises Becoming aware of the benefits of AR through research, piloting or implementing projects Providers Non-commercial Developing services, Universities, public software and hardware research institutes and products/technology for agencies who deliver the AR ecosystem research and push the boundaries of AR technology 4 Interoperability and Standards Program Automotive Aerospace Industrial equipment Industries Smart cities AREA Medical Engineering Development Schema of AR Factory Field Operations Settings User Operation Customer Needs Sales & marketing Field service operation Statements of Engineering review Scenarios Interactive user manuals Pain Points/ Manufacturing assembly (business processes) Inspection Problems that Remote assistance AR can Address Step by step instructions Visual compare (inspection) Use cases Multi-participant collaboration Product status documentation Build, operate/manage, use Requirements/ Integration with existing multi-vendor solutions needs IT for enterprise without special engineering and operational management Solutions (hardware and software) Security & Connectivity Performance Experience Practicality Safety Authoring Apps Toolkits Data Integration Privacy Bluetooth Graphics Field of view Battery App creation Interaction API needs Formats Business systems Sensors CPU Mono/stereo Ergonomics Scripting UX Languages Content PLM Audio Tracking Resolution Wearability UI creation Tracking Compression ERP Video Audio Durability Sensor usage Encryption SLM RFID Touch Environmental Analytics Conversion IoT Program Goals . To increase knowledge about benefits and approaches to achieving interoperability . To advance the development of standards or other approaches to interoperability through a set of AREA policies, procedures and programs 6/5/2020 7 Tactics … to target specific barriers to interoperability and/or promote increased awareness and use of existing (and/or development of new) standards for open, interoperable and safe AR solutions by 1. Develop/share thought leadership content 2. Support standards development 3. Review draft specifications 4. Co-organize/conduct events focusing on interoperability 5. Test/build reference implementations 6/5/2020 8 Role of Standards in AR at Boeing . Future-proofing . Standardization across internal Boeing teams . Supportability . Interoperability . Avoiding reliance on one particular vendor 6/5/2020 9 Open Standards for Augmented and Virtual Reality Neil Trevett Khronos President NVIDIA VP Developer Ecosystems [email protected]| @neilt3d © Khronos® Group 2020 This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 10 What is An Open Standard? An INTEROPERABILITY STANDARD enables two entities to COMMUNICATE E.g. Software <-> Hardware Standards Grow Markets Standards Reduce Costs By reducing consumer confusion and increasing By sharing development between many companies capabilities and usability and driving volume Standards Speed Time to Market Standards Do Not Stifle Innovation With well-proven testing Companies can compete on implementation and interoperability quality, performance, power etc. etc. True OPEN Standards Are not controlled by a single company – but HMD Connectivity Wireless and 5G Verticals and Security by the industry – typically through an SDO Well defined participation, governance and intellectual property frameworks VR Video Formats 3D and XR Hardware XR in the Browser Widespread XR will take a constellation of industry standards This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 11 Khronos Connects Software to Silicon Open interoperability standards to enable software to effectively harness the power of multiprocessors and accelerator silicon 3D graphics, XR, parallel programming, vision acceleration and machine learning Non-profit, member-driven standards-defining industry consortium Open to any interested company All Khronos standards are royalty-free Well-defined IP Framework protects participant’s intellectual property >150 Members ~ 40% US, 30% Europe, 30% Asia This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 12 Khronos Standards for XR Create 3D Assets Download 3D object Vision and sensor processing - and scene data including neural network inferencing for machine learning High-performance, low-latency 3D Graphics Portable interaction with VR/AR sensor, haptic and display devices This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 13 OpenXR is used with a 3D API Application or Engine Display, High-performance, low-latency composition and Cross-platform access to XR 3D rendering and composition* optical correction HMDs and sensors Multiview parameters XR application lifecycle Context priority Input device discovery and events Front buffer rendering Sensor tracking and pose calculation Tiled rendering (beam racing) Frame timing and display composition Variable rate rendering Haptics Control * OpenXR can be used with other 3D APIs such as Direct3D, OpenGL and OpenGL ES This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 14 The Metaverse will be the Web! https://xkcd.com/1367/ This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 15 Bringing XR to the Web The Web will Evolve Native XR Apps into the Metaverse Web XR Apps Lifting OpenXR functionality into the Web stack Native 3D Web 3D Engines Close cooperation Engines between WebXR and OpenXR Khronos provides the foundation for native and Web-based 3D/XR This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 16 OpenXR and Edge Server Applications with 5G Low latency Sensor Data Location–aware Content Requests OpenXR APIs hide the 5G round trip from applications MEC (Multi-access Edge Sensor handling Computing) Server 1. Processes sensor data, including machine learning for environmental lighting, occlusion, scene semantics, object Needed assets Display composition reconstruction and UI loaded to 2. Generates imagery from 3D edge server models, including stereo, foveal Wireless mobile device with rendering, ray-tracing, optics pre- distortion, varifocal processing display and sensors Apps and 3D Assets Generated Augmentations & Scenes This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 17 glTF 2.0 Scene Description Structure .gltf (JSON) Node hierarchy, PBR material textures, cameras .bin .png Geometry: vertices and indices .jpg Animation: key-frames .ktx2 Skins: inverse-bind matrices Textures Mandatory Metallic-Roughness Materials Optional Specular-Glossiness Materials Geometry Texture based PBR materials This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 18 Modo Paint 3D Titania Discover Game Engines VoxEdit Repositories Ashes Creature Web Engines 3D Authoring Tools 3D Builder Oculus Create Experience 3D printing Tools Apps / Engines 3D Asset Format for Efficient VR / AR Authoring Tools Transmission and Processing http://github.khronos.org/glTF-Project-Explorer/ Sony 3D Creator Drive Demand Apps and Engines Users 3D Live Object 3D Scanning Tools Mixed gltfpack Reality Viewer Collada2gltf OBJ2GLTF FBX2glTF Convertors, Optimizers and Loaders Windows Mixed Reality Home glTF Sample Viewer glTF-validator VR / AR Apps and Engines gltf-vscode glTF-asset-generator glTF-Toolkit Validation and Reference Tools Productivity and Social Apps This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 19 3D Commerce - Four Initial Areas of Focus Asset Creation Guidelines Product Configuration For tools and product designers to Universal product configurability create assets with consistent data to be data and guidelines on how to drive used through the 3D Commerce pipeline consistent product display First Goals Helping evolve glTF to meet the needs of 3D Commerce - Next generation PBR - Advanced metadata Industry cooperation to urgently develop guidelines and tools to address priority problem areas Metadata Viewer Validation and Certification Structured metadata definitions and Test models, reference viewer, display analysis examples to consistently carry product tools and capability specifications to guarantee information through the retail pipeline a consistent and accurate end user experience This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2020 - Page 20 How May Standards Help Your Business? • Seek friction points in your industry caused by lack of agreed communication protocols - Between people, companies, products, subsystems, components … • Find or create a safe space for
Load more

Recommended publications
  • GLSL 4.50 Spec
    The OpenGL® Shading Language Language Version: 4.50 Document Revision: 7 09-May-2017 Editor: John Kessenich, Google Version 1.1 Authors: John Kessenich, Dave Baldwin, Randi Rost Copyright (c) 2008-2017 The Khronos Group Inc. All Rights Reserved. This specification is protected by copyright laws and contains material proprietary to the Khronos Group, Inc. It or any components may not be reproduced, republished, distributed, transmitted, displayed, broadcast, or otherwise exploited in any manner without the express prior written permission of Khronos Group. You may use this specification for implementing the functionality therein, without altering or removing any trademark, copyright or other notice from the specification, but the receipt or possession of this specification does not convey any rights to reproduce, disclose, or distribute its contents, or to manufacture, use, or sell anything that it may describe, in whole or in part. Khronos Group grants express permission to any current Promoter, Contributor or Adopter member of Khronos to copy and redistribute UNMODIFIED versions of this specification in any fashion, provided that NO CHARGE is made for the specification and the latest available update of the specification for any version of the API is used whenever possible. Such distributed specification may be reformatted AS LONG AS the contents of the specification are not changed in any way. The specification may be incorporated into a product that is sold as long as such product includes significant independent work developed by the seller. A link to the current version of this specification on the Khronos Group website should be included whenever possible with specification distributions.
    [Show full text]
  • View the Manual
    Base game Manual V0.4 Environment Remove any objects in the playing area that you might touch or hit while playing with your body. Please also make sure that lamps or fans are not in the playing area. If you are at the edge of the playing area, do not make any big movements, otherwise you could touch the walls with your body or hands/controllers. It is best to stand. Step movements are not necessary during the game. You can move and rotate completely with the controllers. Technical requirements To play the game, you need Virtual Reality headset (VR headset). Without VR glasses, the game will not run. A (free) Steam account is also required. Also installed must be the VR software "SteamVR" (when using HTC VIVE or the Valve Index) or the additional software "Windows Mixed Reality for SteamVR" for the use of Windows Mixed Reality glasses on Steam with "SteamVR". Before the first launch, a room measuring should also have been done in SteamVR (when using the HTC VIVE or the Valve Index). When using Windows Mixed Reality glasses, there is an option to change the position of the floor from the height. The controllers of the VR headset should also be connected to the VR system and be charged. The game Container You start the game in the container and go to the selected construction site through the door. Later, you can start different locations here depending on the existing DLC. You can now set options to one of the boards by moving the switch accordingly.
    [Show full text]
  • VR Headset Comparison
    VR Headset Comparison All data correct as of 1st May 2019 Enterprise Resolution per Tethered or Rendering Special Name Cost ($)* Available DOF Refresh Rate FOV Position Tracking Support Eye Wireless Resource Features Announced Works with Google Subject to Mobile phone 5.00 Yes 3 60 90 None Wireless any mobile No Cardboard mobile device required phone HP Reverb 599.00 Yes 6 2160x2160 90 114 Inside-out camera Tethered PC WMR support Yes Tethered Additional (*wireless HTC VIVE 499.00 Yes 6 1080x1200 90 110 Lighthouse V1 PC tracker No adapter support available) HTC VIVE PC or mobile ? No 6 ? ? ? Inside-out camera Wireless - No Cosmos phone HTC VIVE Mobile phone 799.00 Yes 6 1440x1600 75 110 Inside-out camera Wireless - Yes Focus Plus chipset Tethered Additional HTC VIVE (*wireless tracker 1,099.00 Yes 6 1440x1600 90 110 Lighthouse V1 and V2 PC Yes Pro adapter support, dual available) cameras Tethered All features HTC VIVE (*wireless of VIVE Pro ? No 6 1440x1600 90 110 Lighthouse V1 and V2 PC Yes Pro Eye adapter plus eye available) tracking Lenovo Mirage Mobile phone 399.00 Yes 3 1280x1440 75 110 Inside-out camera Wireless - No Solo chipset Mobile phone Oculus Go 199.00 Yes 3 1280x1440 72 110 None Wireless - Yes chipset Mobile phone Oculus Quest 399.00 No 6 1440x1600 72 110 Inside-out camera Wireless - Yes chipset Oculus Rift 399.00 Yes 6 1080x1200 90 110 Outside-in cameras Tethered PC - Yes Oculus Rift S 399.00 No 6 1280x1440 90 110 Inside-out cameras Tethered PC - No Pimax 4K 699.00 Yes 6 1920x2160 60 110 Lighthouse Tethered PC - No Upscaled
    [Show full text]
  • Hp Mixed Reality Headset System Requirements
    Hp Mixed Reality Headset System Requirements Pachydermatous Meir ionizes enlargedly. Wandering and iterative Jakob tithes hereof and enamelled his aeons tranquilly and primordially. Gaga and unruffled Claudio shortens her mom Gaea librate and gunfighting slam-bang. Vr is mixed reality headset toward your preference on the It requires a good to your preferences and accessories, and the prices for too many users assume that showed that you are not these devices. Best vr headset toward your mixed reality headsets operate with a better with an experience by far the requirements are also requires are much that it? Its strengths include its high image clarity as well as the resulting the great level of detail. CPU, GPU, and memory are the most critical components. How tart the tech compares? Dive into place the company offers and reality system. Oculus Go and PSVR. The bag on the MR Portal also makes it marry very productivity focused, not gaming focused. Use voice commands to laugh stuff easier in mixed reality. Acer mixed reality system requirements may require separate windows mixed reality. Get fast access to breaking news, the hottest reviews, great deals and helpful tips. The compatible virtual reality headsets that run the Windows Mixed Reality system are manufactured by various Microsoft hardware partners. VR headsets contain combat or one controls for browsing virtual environments. Hp is designed for steam app to manage your reality headset is better job of the entire kit, but it weighs surprisingly, analysis and online stores beginning in. Some AR headsets are available on the market today, with more rumored to be coming in the future.
    [Show full text]
  • Implementing FPGA Design with the Opencl Standard
    Implementing FPGA Design with the OpenCL Standard WP-01173-3.0 White Paper Utilizing the Khronos Group’s OpenCL™ standard on an FPGA may offer significantly higher performance and at much lower power than is available today from hardware architectures such as CPUs, graphics processing units (GPUs), and digital signal processing (DSP) units. In addition, an FPGA-based heterogeneous system (CPU + FPGA) using the OpenCL standard has a significant time-to-market advantage compared to traditional FPGA development using lower level hardware description languages (HDLs) such as Verilog or VHDL. 1 OpenCL and the OpenCL logo are trademarks of Apple Inc. used by permission by Khronos. Introduction The initial era of programmable technologies contained two different extremes of programmability. As illustrated in Figure 1, one extreme was represented by single core CPU and digital signal processing (DSP) units. These devices were programmable using software consisting of a list of instructions to be executed. These instructions were created in a manner that was conceptually sequential to the programmer, although an advanced processor could reorder instructions to extract instruction-level parallelism from these sequential programs at run time. In contrast, the other extreme of programmable technology was represented by the FPGA. These devices are programmed by creating configurable hardware circuits, which execute completely in parallel. A designer using an FPGA is essentially creating a massively- fine-grained parallel application. For many years, these extremes coexisted with each type of programmability being applied to different application domains. However, recent trends in technology scaling have favored technologies that are both programmable and parallel. Figure 1.
    [Show full text]
  • 2020 IEEE Conference on Virtual Reality and 3D User Interfaces
    2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR 2020) Atlanta , Georgia, USA 22 – 26 March 2020 IEEE Catalog Number: CFP20VIR-POD ISBN: 978-1-7281-5609-5 Copyright © 2020 by the Institute of Electrical and Electronics Engineers, Inc. All Rights Reserved Copyright and Reprint Permissions: Abstracting is permitted with credit to the source. Libraries are permitted to photocopy beyond the limit of U.S. copyright law for private use of patrons those articles in this volume that carry a code at the bottom of the first page, provided the per-copy fee indicated in the code is paid through Copyright Clearance Center, 222 Rosewood Drive, Danvers, MA 01923. For other copying, reprint or republication permission, write to IEEE Copyrights Manager, IEEE Service Center, 445 Hoes Lane, Piscataway, NJ 08854. All rights reserved. *** This is a print representation of what appears in the IEEE Digital Library. Some format issues inherent in the e-media version may also appear in this print version. IEEE Catalog Number: CFP20VIR-POD ISBN (Print-On-Demand): 978-1-7281-5609-5 ISBN (Online): 978-1-7281-5608-8 ISSN: 2642-5246 Additional Copies of This Publication Are Available From: Curran Associates, Inc 57 Morehouse Lane Red Hook, NY 12571 USA Phone: (845) 758-0400 Fax: (845) 758-2633 E-mail: [email protected] Web: www.proceedings.com 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) VR 2020 Table of Contents General Chairs Message xix Conference Paper Program Chairs Message xx IEEE Visualization and Graphics Technical
    [Show full text]
  • An Empirical Study of Virtual Reality Menu Interaction and Design
    Mississippi State University Scholars Junction Theses and Dissertations Theses and Dissertations 4-30-2021 An empirical study of virtual reality menu interaction and design Emily Salmon Wall [email protected] Follow this and additional works at: https://scholarsjunction.msstate.edu/td Recommended Citation Wall, Emily Salmon, "An empirical study of virtual reality menu interaction and design" (2021). Theses and Dissertations. 5161. https://scholarsjunction.msstate.edu/td/5161 This Dissertation - Open Access is brought to you for free and open access by the Theses and Dissertations at Scholars Junction. It has been accepted for inclusion in Theses and Dissertations by an authorized administrator of Scholars Junction. For more information, please contact [email protected]. Template C with Schemes v4.1 (beta): Created by L. 11/15/19 An empirical study of virtual reality menu interaction and design By TITLE PAGE Emily Salmon Wall Approved by: Reuben F. Burch V (Major Professor) Michael Hamilton Daniel Carruth Brian Smith Ginnie Hsu Linkan Bian (Graduate Coordinator) Jason M. Keith (Dean, Bagley College of Engineering) A Dissertation Submitted to the Faculty of Mississippi State University in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Industrial and Systems Engineering in the Department of Industrial and Systems Engineering Mississippi State, Mississippi April 2021 Copyright by COPYRIGHT PAGE Emily Salmon Wall 2021 Name: Emily Salmon Wall ABSTRACT Date of Degree: April 30, 2021 Institution: Mississippi State University Major Field: Industrial and Systems Engineering Major Professor: Reuben F. Burch V Title of Study: An empirical study of virtual reality menu interaction and design Pages in Study: 181 Candidate for Degree of Doctor of Philosophy This study focused on three different menu designs each with their own unique interactions and organizational structures to determine which design features would perform the best.
    [Show full text]
  • PROGRAMS for LIBRARIES Alastore.Ala.Org
    32 VIRTUAL, AUGMENTED, & MIXED REALITY PROGRAMS FOR LIBRARIES edited by ELLYSSA KROSKI CHICAGO | 2021 alastore.ala.org ELLYSSA KROSKI is the director of Information Technology and Marketing at the New York Law Institute as well as an award-winning editor and author of sixty books including Law Librarianship in the Age of AI for which she won AALL’s 2020 Joseph L. Andrews Legal Literature Award. She is a librarian, an adjunct faculty member at Drexel University and San Jose State University, and an international conference speaker. She received the 2017 Library Hi Tech Award from the ALA/LITA for her long-term contributions in the area of Library and Information Science technology and its application. She can be found at www.amazon.com/author/ellyssa. © 2021 by the American Library Association Extensive effort has gone into ensuring the reliability of the information in this book; however, the publisher makes no warranty, express or implied, with respect to the material contained herein. ISBNs 978-0-8389-4948-1 (paper) Library of Congress Cataloging-in-Publication Data Names: Kroski, Ellyssa, editor. Title: 32 virtual, augmented, and mixed reality programs for libraries / edited by Ellyssa Kroski. Other titles: Thirty-two virtual, augmented, and mixed reality programs for libraries Description: Chicago : ALA Editions, 2021. | Includes bibliographical references and index. | Summary: “Ranging from gaming activities utilizing VR headsets to augmented reality tours, exhibits, immersive experiences, and STEM educational programs, the program ideas in this guide include events for every size and type of academic, public, and school library” —Provided by publisher. Identifiers: LCCN 2021004662 | ISBN 9780838949481 (paperback) Subjects: LCSH: Virtual reality—Library applications—United States.
    [Show full text]
  • Real-Time 3D Graphic Augmentation of Therapeutic Music Sessions for People on the Autism Spectrum
    Real-time 3D Graphic Augmentation of Therapeutic Music Sessions for People on the Autism Spectrum John Joseph McGowan Submitted in partial fulfilment of the requirements of Edinburgh Napier University for the degree of Doctor of Philosophy October 2018 Declaration I, John McGowan, declare that the work contained within this thesis has not been submitted for any other degree or professional qualification. Furthermore, the thesis is the result of the student’s own independent work. Published material associated with the thesis is detailed within the section on Associate Publications. Signed: Date: 12th October 2019 J J McGowan Abstract i Abstract This thesis looks at the requirements analysis, design, development and evaluation of an application, CymaSense, as a means of improving the communicative behaviours of autistic participants through therapeutic music sessions, via the addition of a visual modality. Autism spectrum condition (ASC) is a lifelong neurodevelopmental disorder that can affect people in a number of ways, commonly through difficulties in communication. Interactive audio-visual feedback can be an effective way to enhance music therapy for people on the autism spectrum. A multi-sensory approach encourages musical engagement within clients, increasing levels of communication and social interaction beyond the sessions. Cymatics describes a resultant visualised geometry of vibration through a variety of mediums, typically through salt on a brass plate or via water. The research reported in this thesis focuses on how an interactive audio-visual application, based on Cymatics, might improve communication for people on the autism spectrum. A requirements analysis was conducted through interviews with four therapeutic music practitioners, aimed at identifying working practices with autistic clients.
    [Show full text]
  • Manipulation of 3D Objects in Immersive Virtual Environments
    PhD Dissertation Proposal Manipulation of 3D Objects in Immersive Virtual Environments Daniel Filipe Martins Tavares Mendes [email protected] September 2015 Abstract Interactions within virtual environments (VE) often require manipu- lation of 3D virtual objects. For this purpose, several research have been carried out focusing on mouse, touch and gestural input. While exist- ing mid-air gestures in immersive VE (IVE) can offer natural manipula- tions, mimicking interactions with physical objects, they cannot achieve the same levels of precision attained with mouse-based applications for computer-aided design (CAD). Following prevailing trends in previous research, such as degrees-of- freedom (DOF) separation, virtual widgets and scaled user motion, we intend to explore techniques for IVEs that combine the naturalness of mid-air gestures and the precision found in traditional CAD systems. In this document we survey and discuss the state-of-the-art in 3D object manipulation. With challenges identified, we present a research proposal and corresponding work plan. 1 Contents 1 Introduction 3 2 Background and Related Work 4 2.1 Key players . .4 2.2 Relevant events and journals . .5 2.3 Virtual Environments Overview . .7 2.4 Mouse and Keyboard based 3D Interaction . .9 2.5 3D Manipulation on Interactive Surfaces . 12 2.6 Touching Stereoscopic Tabletops . 16 2.7 Mid-Air Interactions . 17 2.8 Within Immersive Virtual Environments . 20 2.9 Discussion . 25 3 Research Proposal 28 3.1 Problem . 28 3.2 Hypotheses . 28 3.3 Objectives . 29 4 Preliminary Study of Mid-Air Manipulations 31 4.1 Implemented Techniques . 31 4.2 User Evaluation .
    [Show full text]
  • Khronos Template 2015
    Ecosystem Overview Neil Trevett | Khronos President NVIDIA Vice President Developer Ecosystem [email protected] | @neilt3d © Copyright Khronos Group 2016 - Page 1 Khronos Mission Software Silicon Khronos is an Industry Consortium of over 100 companies creating royalty-free, open standard APIs to enable software to access hardware acceleration for graphics, parallel compute and vision © Copyright Khronos Group 2016 - Page 2 http://accelerateyourworld.org/ © Copyright Khronos Group 2016 - Page 3 Vision Pipeline Challenges and Opportunities Growing Camera Diversity Diverse Vision Processors Sensor Proliferation 22 Flexible sensor and camera Use efficient acceleration to Combine vision output control to GENERATE PROCESS with other sensor data an image stream the image stream on device © Copyright Khronos Group 2016 - Page 4 OpenVX – Low Power Vision Acceleration • Higher level abstraction API - Targeted at real-time mobile and embedded platforms • Performance portability across diverse architectures - Multi-core CPUs, GPUs, DSPs and DSP arrays, ISPs, Dedicated hardware… • Extends portable vision acceleration to very low power domains - Doesn’t require high-power CPU/GPU Complex - Lower precision requirements than OpenCL - Low-power host can setup and manage frame-rate graph Vision Engine Middleware Application X100 Dedicated Vision Processing Hardware Efficiency Vision DSPs X10 GPU Compute Accelerator Multi-core Accelerator Power Efficiency Power X1 CPU Accelerator Computation Flexibility © Copyright Khronos Group 2016 - Page 5 OpenVX Graphs
    [Show full text]
  • UPDATED Activate Outlook 2021 FINAL DISTRIBUTION Dec
    ACTIVATE TECHNOLOGY & MEDIA OUTLOOK 2021 www.activate.com Activate growth. Own the future. Technology. Internet. Media. Entertainment. These are the industries we’ve shaped, but the future is where we live. Activate Consulting helps technology and media companies drive revenue growth, identify new strategic opportunities, and position their businesses for the future. As the leading management consulting firm for these industries, we know what success looks like because we’ve helped our clients achieve it in the key areas that will impact their top and bottom lines: • Strategy • Go-to-market • Digital strategy • Marketing optimization • Strategic due diligence • Salesforce activation • M&A-led growth • Pricing Together, we can help you grow faster than the market and smarter than the competition. GET IN TOUCH: www.activate.com Michael J. Wolf Seref Turkmenoglu New York [email protected] [email protected] 212 316 4444 12 Takeaways from the Activate Technology & Media Outlook 2021 Time and Attention: The entire growth curve for consumer time spent with technology and media has shifted upwards and will be sustained at a higher level than ever before, opening up new opportunities. Video Games: Gaming is the new technology paradigm as most digital activities (e.g. search, social, shopping, live events) will increasingly take place inside of gaming. All of the major technology platforms will expand their presence in the gaming stack, leading to a new wave of mergers and technology investments. AR/VR: Augmented reality and virtual reality are on the verge of widespread adoption as headset sales take off and use cases expand beyond gaming into other consumer digital activities and enterprise functionality.
    [Show full text]