DOCSLIB.ORG

22012021 Pleniere French Gaia

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
22012021 Pleniere French Gaia P l é n i è r e 1 22 JANVIER 2021 P l é n i è r e 2 Par Henri d’Agrain Délégué général du Cigref P l é n i è r e 3 22 JANVIER 2021 P l é n i è r e 4 Par Cédric O Secrétaire d’État chargé de la Transition numérique et des Communications électroniques P l é n i è r e 5 22 JANVIER 2021 P l é n i è r e 6 Par Bernard Duverneuil, Président du Cigref Gérard Roucairol, Président honoraire de l’Académie des technologies Jean-Luc Beylat, Président du pôle de compétitivité Systematic Paris-Région Mathieu Weill, Chef du service de l’économie numérique à la Direction Générale des Entreprises P l é n i è r e 7 22 JANVIER 2021 P l é n i è r e 8 Par Hubert Tardieu CEO AISBL GAIA-X Agenda 01 Introduction GAIA-X 02 Data Space Facilitation and the role of National Hubs 03 The AISBL Status and Organization 04 Outlook – 100 Days ahead 05 Summary 9 Overview: GAIA-X provides a user-friendly and homogenous ecosystem Joint Development of a user friendly and homogenous European ecosystem. Bringing together data spaces and their specific requirements with the provider side. 10 The GAIA-X objectives Objectives 11 The GAIA-X objectives Objectives Policy Rules Application portability Data & Software Infrastructure portability Infrastructure 12 The GAIA-X objectives Objectives Policy Rules Architecture of Standards Application portability Data Ontology Data Information API PaaS Data & Software By Industry vertical X-CSP Infrastructure portability IAM IaaS Self Description Network & Interconnects Infrastructure 13 The GAIA-X objectives Objectives Policy Rules Architecture of Standards GAIA-X Federation services Application portability Identity & Trust Data Ontology Data Information API PaaS Federated Catalogue Data & Software By Industry vertical X-CSP Infrastructure portability Data Sovereignty Services IAM IaaS Self Description Compliance Network & Interconnects Infrastructure 14 GAIA-X Federation Services – The Core Data Ecosystem …the implementation of secure Federated Identity …Sovereign Data Services which ensure the identity and trust mechanisms (security and privacy by design). of source and receiver of data and the access and usage rights towards the data. …easy access to the available providers, nodes and …the establishment of a Compliance framework and services. Data will be provided through a Federated Certification and Accreditation services. Catalogue. Infrastructure Ecosystem GAIA-X identifies the minimum technical requirements and services necessary to operate the Federated GAIA-X Ecosystem. The development of these services will follow the principles of Security-by-Design and also include the concept of Privacy-by-Design. 15 GAIA-X AISBL Core Deliverables 1. Standard 2. Fundamental Services • Architecture of Standard • Digital Tokens/Certificate • Test Criteria • Service Catalog 3. Software Communities • Open Source Federated Services • Interaction with other 4. Data Spaces Facilitation Communities 16 GAIA-X AISBL Organizational Structure 17 Data Spaces: Sharing data to advance science, society and economies Mobility Health Financial Industrial Green Deal Agriculture Energy Skills 18 Data Spaces No physical data integration, leave Mobility Ecosystem Connectivity data where it is (→ Federated data architecture) No common schema required General (→ Integration foremost on semantic Design level through vocabularies) Principles Data Space Mobility Data networking, data visiting and (Shared Digital Twin) Data Object data co-existence Nesting and overlaps possible (→ Ecosystem of data spaces) 00010010010 Additional Data sovereignty and traceability IDS1 Design Federated Software GAIA-X Trusted participants Infrastructure Infrastructure Principles Broker Service Clearing House 1IDS – International Data Spaces Source: acatech, Fraunhofer ISST (2020) 19 How to Build Data Spaces The »Onion Model« of Data Spaces Design Cooperation ▪ Business and Mobility Ecosystem ▪ Information Governance Model Models Use Cases ▪ ODRL1 based Use ▪ Use-case policies case 1 specific apps Data Space ▪ Generic and services software Commonalities infrastructure components ▪ Standardized communication ▪ Domain- Federated Software protocol specific ▪ Certification Use vocabulary Infrastructure ▪ … ▪ Codex and case n contracts ▪ Brokers and common data platforms ▪ Data usage templates ▪ … Use case 2 1ODRL - Open Digital Rights Language 20 National Hubs Set up and establish a well-functioning sovereign data infrastructure following GAIA-X policy rules and standards and the required federation services. GAIA-X User Hubs GAIA-X-Association Supporting its endeavour Participants engage in the GAIA-X-Association and its work processes will prioritize certain domains where → Has the exclusive responsibility for → Focus on bundling user interest intense cooperation with the Hub is envisaged the policy rules and standards across Europe to facilitate the → Defines overall Data Space scaling up of GAIA-X use case structure in line with EU Data and data spaces Not acting as subsidiaries of the GAIA-X-Association Strategy to ensure technical and semantic interoperability MoUs1 underline the cooperation in the intended network 1MoU - Memorandum of Understanding 21 xyz Create a flourish Data Ecosystem Mobility Health Financial Create Value from Data Industrial Green Deal Agriculture Energy Skills Drive Technology Data Sovereignty & Federated Services Base on Operational Excellence Inter- HPC connectivity CSP Edge Create value from data Data Ecosystems European Data Business Models Spaces Use Cases Demonstrators Implementations Alliance on Industrial Raise requirements, adopt and further develop GAIA-X concepts Data & Cloud GAIA-X Hubs European Strategy for Data Grow the User Ecosystem GAIA-X AISBL Regulators Expand the Core Improve framing conditions Drive technology for next generation data economy Minimal Federated Services Viable GAIA-X User Provider IAM & Trust Framework Federated Catalog Work User Packages Data Sovereignty Requirements Compliance Portal & Integration Specify and implement federated services Architecture of Standards Base GAIA-X on proven and established standards Architectural Concept Detail out technical requirements and specification overall architecture Base GAIA-X on operational excellence General Assembly Board of Directors Advisory Boards Policy & Rules Management & Intellectual Property Regulation Office Open Source Process Communication Strategy Committees Community Process Onboarding Process Working Groups Events WorkingWorking Groups Groups Timeline Q4 End of 2020 Q1 Q2 Mid June Q3 Beginning Jan Architecture of Technical Architecture Day 2 Re-Opening Standards Rel. 03.21 Document Rel. 06.21 Federation Services Early Q1 Technical Architecture 1st General Assembly alpha 18. - 19.11.2020 Prefiguration of Document Rel. 03.21 European Alliance on GAIA-X Summit Demonstrator Industrial Data and Cloud on verticals GAIA-X Policy Technical Deep Dive Rules Rel. 03.21 By June GAIA-X Sessions 1st Data Spaces Additional national hubs Policy Rules Webinar “Policy and to expand coverage Rules” Rel. 6 national Federation 09.21 Services GAIA-X hubs Webinar “Economy Specification of Data” End June Election of the 1st Webinar “Edge Board of Directors Cloud” November December January February March April May June July August September 2020 2021 GAIA-X AISBL GAIA-X AISBL Open, community-based 22 Founding members implementation Creation of data spaces and Open to all Industry Platforms Policy Rules Architecture of Standards Multiparty Governance Federation Services Data- and Infrastructure Define Enable Open Ecosystems Overview Memberships by Type Countries by Registration # of Organizations * Austria 2 Belgium 13 Finland 3 16 Large Tech and Cloud Service France 33 Providers 42 Germany 49 Large User Ireland 4 Italy 29 NPO Luxembourg 3 38 Netherlands 4 SME / Startup Norway 1 P.R. China 1 Medium Sized Users and tech Portugal 1 23 Companies Singapore 1 Spain 5 Sweden 2 40 Switzerland 1 United Kingdom 2 USA 5 Total 159 * Including SME, Large Corporation and Academic Institutions Limited Cloud adaption Challenges GAIA-X // ▪ ▪ Portability of Data // Policy Rules ▪ Interoperability // ▪ Architecture of ▪ Common commercial // Standards and legal framework ▪ Federation Services // Limited Cloud adaption Compliance Challenges GAIA-X // ▪ ▪ Portability of Data // Policy Rules ▪ Interoperability // ▪ Architecture of ▪ Common commercial // Standards and legal framework ▪ Federation Services // Data Spaces facilitation Mobility Health Financial Industrial Green Deal Agriculture Energy Skills Sharing of data to advance science, society and economies Data Spaces facilitation Economics of Data Mobility Health Financial Industrial Green Deal Agriculture Energy Skills Sharing of data to advance science, society and economies Architecture of Standards & Federation Services • Definition of Ontologies, specific APIs (and their semantic), required technology standards and compliance defined by (existing) standard bodies • Federated trust and sovereignty services across consumers and providers • Alignment of technical standards and set of technologies/products across providers for • Interoperability • Portability Interoperability,Portability & Sovereignty supported by open source A European Momentum towards a… Digital for Business • by addressing jointly data sharing by domains and cloud policy has created a European momentum which defines a global approach of Digital for Business …global “Digital for Business” approach xyz P l é n i è r e 36 22 JANVIER 2021 P l é n i è r e 37 Par Pierre Chastanet
Load more

Recommended publications
  • Opera Acquires Yoyo Games, Launches Opera Gaming
    Opera Acquires YoYo Games, Launches Opera Gaming January 20, 2021 - [Tuck-In] Acquisition forms the basis for Opera Gaming, a new division focused on expanding Opera's capabilities and monetization opportunities in the gaming space - Deal unites Opera GX, world's first gaming browser and popular game development engine, GameMaker - Opera GX hit 7 million MAUs in December 2020, up nearly 350% year-over-year DUNDEE, Scotland and OSLO, Norway, Jan. 20, 2021 /PRNewswire/ -- Opera (NASDAQ: OPRA), the browser developer and consumer internet brand, today announced its acquisition of YoYo Games, creator of the world's leading 2D game engine, GameMaker Studio 2, for approximately $10 million. The tuck-in acquisition represents the second building block in the foundation of Opera Gaming, a new division within Opera with global ambitions and follows the creation and rapid growth of Opera's innovative Opera GX browser, the world's first browser built specifically for gamers. Krystian Kolondra, EVP Browsers at Opera, said: "With Opera GX, Opera had adapted its proven, innovative browser tech platform to dramatically expand its footprint in gaming. We're at the brink of a shift, when more and more people start not only playing, but also creating and publishing games. GameMaker Studio2 is best-in-class game development software, and lowers the barrier to entry for anyone to start making their games and offer them across a wide range of web-supported platforms, from PCs, to, mobile iOS/Android devices, to consoles." Annette De Freitas, Head of Business Development & Strategic Partnerships, Opera Gaming, added: "Gaming is a growth area for Opera and the acquisition of YoYo Games reflects significant, sustained momentum across both of our businesses over the past year.
    [Show full text]
  • Middleware and European Standardisation” Köln, 17.8.2011
    ” Middleware and European Standardisation” Köln, 17.8.2011 Event supported by NEM initative Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu THROUGH more than in that employ over EGDF 12 17000 YOU CAN 600 game studios European game industry REACH countries professionals UK, AT, DE, FR, DK, FI, NO, BE, NL, LU, ES, IT Policy EGDF IS A development Dissemination Elaboration TRADE- participates proc- disseminates elaborates game ASSOCIATION esses developing the best developers’ policy recommen- practices, new mutual positions (SME) THAT dations that sup- standards, (technology, FOCUSES ON port game devel- new tools etc. content) opers Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu Source: © IHS Screen Digest, 2011 Consumer spending on entertainment media (€m) Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu Source: © IHS Screen Digest, 2011 European consumer spending on games (€m) Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu Value chains of video game industry Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu Viral innovation process Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu www.GameMiddleware.org Game Middleware Platform Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu Standardization and Middelware Examples of European Standardization: Metric system, GSM Game Development uses increasingly specific middleware technologies. Developers tend less and less to reinvent the wheel. Europe is more and more the home of middleware of global relevance. Different aspects of the value chain are represented and the healthy competition shows also the commercial relevance.
    [Show full text]
  • NETENT ANNUAL REPORT 2016 Driving the Digital Casino Market Through Better Gaming Solutions ANNUAL REPORT 2016
    ANNUAL REPORT 2016 Vision: NETENT ANNUAL REPORT 2016 REPORT ANNUAL NETENT Driving the digital casino market through better gaming solutions ANNUAL REPORT 2016 Driving the digital casino market through better gaming solutions Contents NetEnt turns 20! 2 Highlights of the year 4 Comments from the CEO 6 Strategic development 6 Vision, mission, business concept and goals 8 Strategies for growth 10 Our business model 12 Geographic expansion 18 Flexible & scalable product offering 22 Innovation & quality 30 A business partner 34 Strong corporate culture 40 Sustainability 48 The share 51 Message from the Chairman 52 Five-year overview Administration report 54 Administration report 58 Risk factors 62 Corporate governance report 69 Remuneration for senior executives 70 Board of Directors 72 Senior executives 74 Internal control 77 Financial statements – Group 81 Financial statements – Parent Company 86 Accounting policies and notes 101 Statement of assurance from the Board of Directors and CEO 102 Auditors’ report 106 Glossary 108 Definitions 109 Shareholder information The formal annual report for NetEnt AB (publ) 556532-6443 consists of the administration report and the accompanying financial statements on pages 54–101. The annual report is published in Swedish and English. The Swedish version is the original and has been audited by NetEnt’s independent auditors. THIS IS NETENT NetEnt turns 20! 1996–2016 As a pioneer in online gaming solutions, NetEnt has driven the digitalization of the casino industry. For two decades, we have been creating entertainment and setting the pace for development in the online gaming industry. A lot has happened in 20 years and below we present a few of the key events that have contributed to our role as a leading provider to the industry.
    [Show full text]
  • An Overview of 3D Data Content, File Formats and Viewers
    Technical Report: isda08-002 Image Spatial Data Analysis Group National Center for Supercomputing Applications 1205 W Clark, Urbana, IL 61801 An Overview of 3D Data Content, File Formats and Viewers Kenton McHenry and Peter Bajcsy National Center for Supercomputing Applications University of Illinois at Urbana-Champaign, Urbana, IL {mchenry,pbajcsy}@ncsa.uiuc.edu October 31, 2008 Abstract This report presents an overview of 3D data content, 3D file formats and 3D viewers. It attempts to enumerate the past and current file formats used for storing 3D data and several software packages for viewing 3D data. The report also provides more specific details on a subset of file formats, as well as several pointers to existing 3D data sets. This overview serves as a foundation for understanding the information loss introduced by 3D file format conversions with many of the software packages designed for viewing and converting 3D data files. 1 Introduction 3D data represents information in several applications, such as medicine, structural engineering, the automobile industry, and architecture, the military, cultural heritage, and so on [6]. There is a gamut of problems related to 3D data acquisition, representation, storage, retrieval, comparison and rendering due to the lack of standard definitions of 3D data content, data structures in memory and file formats on disk, as well as rendering implementations. We performed an overview of 3D data content, file formats and viewers in order to build a foundation for understanding the information loss introduced by 3D file format conversions with many of the software packages designed for viewing and converting 3D files.
    [Show full text]
  • Independent Software Consultant and Game Developer Thomas Marcus Basse Fønss Gjørup Kærsholms Møllevej 8, DK-8620 Kjellerup, Denmark [email protected] - Tel
    Curriculum Vitae Independent Software Consultant and Game Developer Thomas Marcus Basse Fønss Gjørup Kærsholms Møllevej 8, DK-8620 Kjellerup, Denmark [email protected] - tel. (+45) 60 14 77 87 - www.brainphant.com ​ ​ ​ ​ Professional Profile Being blessed with an early interest in computers, I got involved in the software industry during my high-school years; working with PC magazines as a writer and software editor I got connected to a few computer game companies here, there and abroad and turned my hobby into a career while studying Computer Science and Physics in Aarhus. My experience doing programming, graphics, sound and music for a multitude of games on the early home computers provided me good training for the more competitive world of video console games; I started working for a couple of California-based companies and co-authored and developed games that were successfully published for the Sega Genesis system. After creating a 3D terrain rendering engine for a PC-based game project I returned from the States to join Interactive Vision, a Danish game developer, as Head of Development. We published the helicopter game "Search and Rescue", instigating a successful sequel of flight simulator titles. My main projects for this company became the construction of a modularized and reusable game framework (3D graphics engine, 3D sound engine, physics simulation, network play, device drivers and tools) and the development of the futuristic 3D shooter "B-Hunter". The years in the competitive and dynamic computer game industry - when the battle was fought on having the best proprietary middleware such as physics simulators and hand-optimized graphic pipelines - have trained my skills at paying attention to the quality of details - and the details of quality.
    [Show full text]
  • UBI Banca Spa
    Consolidated non-fi nancial 2019 statement pursuant to Legislative Decree No. 254 of 30th December 2016 Sustainability Report Dichiarazione consolidata di carattere non fi nanziario non fi consolidata di carattere Dichiarazione 2019 Unione di Banche Italiane Joint Stock Company in abbreviated form UBI Banca Spa Head Office and General Management: Piazza Vittorio Veneto 8, Bergamo (Italy) Operating offices: Bergamo, Brescia and Milan Member of the Interbank Deposit Protection Fund and the National Guarantee Fund Belonging to the IVA UBI Group with VAT No. 04334690163 Tax Code, VAT No. and Bergamo Company Registration No. 03053920165 ABI 3111.2 Register of Banks No. 5678 Register of Banking Groups No. 3111.2 Parent company of the Unione di Banche Italiane Banking Group Share capital as at 31st December 2019: EUR 2,843,177,160.24 fully paid up PEC address: [email protected] www.ubibanca.it This document has been written with no account taken of the public exchange offer on all the Bank’s shares launched by Intesa SanPaolo S.p.A. on 17th February 2020. The images reproduced in this document have been taken from the book entitled “Le nostre immagini, la nostra immagine” published by Mondadori in March 2020, which contains a collection of photos taken by Group employees in the photographic competition of the same name held in 2019. On the front cover: Oscar Babucci – Val di Chiana Consolidated non-financial statement pursuant to Legislative Decree No. 254 of 30th December 2016 Sustainability Report 2019 Letter to our Stakeholders Ever since its foundation, UBI has been very aware of and focused on sustainability issues.
    [Show full text]
  • 2021 Vision Product Range Catalogue
    Because people like dealing with us Everything modular from Crystal Vision... Crystal Vision provides project-winning interface and keying modules to all those involved in the professional broadcasting industry. As a main modular supplier we are able to provide all the essential ‘broadcast plumbing’ for your installation, while we are also known for our more specialist products – such as the chroma keyers used by broadcasters across the world. There’s a choice of two product ranges: the Indigo range for the biggest range of boards and frame sizes, and the forward-looking Vision range for those planning IP and 4K installations or who are seeking the maximum outputs from their SDI products. With reliable multi-functional products, responsive customer support, quick delivery and a five year warranty, Crystal Vision is a company that people like dealing with. The Vision product range – the broadcast industry’s most modern frame system… IP/SDI interface and keyers There’s nothing quite so flexible as MARBLE-V1. Our powerful media processor is purpose-built GPU/CPU hardware that fits in the Vision 3 frame and runs software apps that process both 10GbE video over IP and SDI. Apps that are bought with the hardware can be replaced with different apps as needs change. No other IP products make it quite so easy for your systems to grow and mature with the transition. Our initial IP/SDI video processing apps provide chroma keying, linear keying, web keying, video delay, profanity delay, colour correction, legalising, picture-in-picture and fail-safe switching. They work with IP, with SDI or with both IP and SDI at the same time.
    [Show full text]
  • Mapping Game Engines for Visualisation
    Mapping Game Engines for Visualisation An initial study by David Birch- [email protected] Contents Motivation & Goals: .......................................................................................................................... 2 Assessment Criteria .......................................................................................................................... 2 Methodology .................................................................................................................................... 3 Mapping Application ......................................................................................................................... 3 Data format ................................................................................................................................... 3 Classes of Game Engines ................................................................................................................... 4 Game Engines ................................................................................................................................... 5 Axes of Evaluation ......................................................................................................................... 5 3d Game Studio ....................................................................................................................................... 6 3DVIA Virtools ........................................................................................................................................
    [Show full text]
  • An Overview Study of Game Engines
    Faizi Noor Ahmad Int. Journal of Engineering Research and Applications www.ijera.com ISSN : 2248-9622, Vol. 3, Issue 5, Sep-Oct 2013, pp.1673-1693 RESEARCH ARTICLE OPEN ACCESS An Overview Study of Game Engines Faizi Noor Ahmad Student at Department of Computer Science, ACNCEMS (Mahamaya Technical University), Aligarh-202002, U.P., India ABSTRACT We live in a world where people always try to find a way to escape the bitter realities of hubbub life. This escapism gives rise to indulgences. Products of such indulgence are the video games people play. Back in the past the term ―game engine‖ did not exist. Back then, video games were considered by most adults to be nothing more than toys, and the software that made them tick was highly specialized to both the game and the hardware on which it ran. Today, video game industry is a multi-billion-dollar industry rivaling even the Hollywood. The software that drives these three dimensional worlds- the game engines-have become fully reusable software development kits. In this paper, I discuss the specifications of some of the top contenders in video game engines employed in the market today. I also try to compare up to some extent these engines and take a look at the games in which they are used. Keywords – engines comparison, engines overview, engines specification, video games, video game engines I. INTRODUCTION 1.1.2 Artists Back in the past the term ―game engine‖ did The artists produce all of the visual and audio not exist. Back then, video games were considered by content in the game, and the quality of their work can most adults to be nothing more than toys, and the literally make or break a game.
    [Show full text]
  • Using Game Engine to Generate Synthetic Datasets for Machine Learning
    Using Game Engine to Generate Synthetic Datasets for Machine Learning Toma´sˇ Buben´ıcekˇ ∗ Supervised by: Jiri Bittnery Department of Computer Graphics and Interaction Czech Technical University in Prague Prague / Czech Republic Abstract However, for some augmented image data (such as optical flow data), the real measured data is often sparse or not Datasets for use in computer vision machine learning are measurable by conventional sensors in general. For this often challenging to acquire. Often, datasets are created very reason, synthetic datasets, which are acquired purely either using hand-labeling or via expensive measurements. using a simulated scene, are often used. In this paper, we characterize different augmented image Several such synthetic datasets based on virtual scenes data used in computer vision machine learning tasks and already exist and were proven to be useful for machine propose a method of generating such data synthetically us- learning tasks, such as one presented by Mayer et al. [6]. ing a game engine. We implement a Unity plugin for cre- They used a modified version of Blender 3D creation suite, ating such augmented image data outputs, usable in exist- which was able to output additional augmented image data ing Unity projects. The implementation allows for RGB such as optical flow information and segmentation. What lit output and several ground-truth outputs, such as depth is missing is a way for others to create their data in an and normal information, object or category segmentation, easy-to-use environment, as the modified Blender suite is motion segmentation, forward and backward optical flow not available, and it is not straightforward to add differ- and occlusions, 2D and 3D bounding boxes, and camera ent types of output to its rendering.
    [Show full text]
  • Unrealcv: Connecting Computer Vision to Unreal Engine
    UnrealCV: Connecting Computer Vision to Unreal Engine Weichao Qiu, Alan Yuille Johns Hopkins University, Baltimore, MD, USA fqiuwch, [email protected] Abstract. Computer graphics can not only generate synthetic images and ground truth but it also offers the possibility of constructing virtual worlds in which: (i) an agent can perceive, navigate, and take actions guided by AI algorithms, (ii) properties of the worlds can be modified (e.g., material and reflectance), (iii) physical simulations can be per- formed, and (iv) algorithms can be learnt and evaluated. But creating realistic virtual worlds is not easy. The game industry, however, has spent a lot of effort creating 3D worlds, which a player can interact with. So re- searchers can build on these resources to create virtual worlds, provided we can access and modify the internal data structures of the games. To enable this we created an open-source plugin UnrealCV1 for a popular game engine Unreal Engine 4 (UE4). We show two applications: (i) a proof of concept image dataset, and (ii) linking Caffe with the virtual world to test deep network algorithms. 1 Introduction Computer vision has benefitted enormously from large datasets[7,8]. They en- able the training and testing of complex models such as deep networks[13]. But arXiv:1609.01326v1 [cs.CV] 5 Sep 2016 performing annotation is costly and time consuming so it is attractive to make synthetic datasets which contain large amounts of images and detailed annota- tion. These datasets are created by modifying open-source movies[2] or by con- structing a 3D world[17,9].
    [Show full text]
  • Does Computer Vision Matter for Action?
    Focus Intel and UT Austin1 Does Computer Vision Matter for Action? BRADY ZHOU1*,P HILIPP KRÄHENBÜHL1,2, AND VLADLEN KOLTUN1 1Intel Labs 2University of Texas at Austin *Corresponding author: [email protected] Controlled experiments indicate that explicit intermediate and semantic scene segmentation provide the highest boost in task representations help action. performance among the individual capabilities we evaluate. Using all capabilities in concert is more effective still. https://doi.org/10.1126/scirobotics.aaw6661 Biological vision systems evolved to support action in physical envi- A Urban driving O-road traversal Battle ronments [1, 2]. Action is also a driving inspiration for computer vision research. Problems in computer vision are often motivated by their relevance to robotics and their prospective utility for systems that move and act in the physical world. In contrast, a recent stream of research at the intersection of machine learning and robotics demonstrates that B Segmentation Albedo Segmentation Albedo Segmentation models can be trained to map raw visual input directly to action [3–6]. These models bypass explicit computer vision entirely. They do not incorporate modules that perform recognition, depth estimation, optical Depth Optical ow Depth Optical ow Depth Optical ow flow, or other explicit vision tasks. The underlying assumption is that perceptual capabilities will arise in the model as needed, as a result of training for specific motor tasks. This is a compelling hypothesis that, if taken at face value, appears
    [Show full text]