DOCSLIB.ORG

Scott D. Hill – Tech

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Scott D. Hill – Tech Scott D. Hill | Tech Art & Design [email protected] Ten years of bridging the gap between art and code by designing and developing workflows and tools to improve and enhance the development of console and PC games. Facilitating communication between game development designers, artists and engineers to ensure each group’s vision is equally represented and understood across a development team and that results are met through efficient, smart—not hard—development. Skills Focus: Big-picture; Communication; Consulting; Performance Data; Problem Solving; Training; Workflow Solutions Engines: Anvil; Frostbite 2; Unreal Engine 3; HeroEngine; Phyre Engine; BigWorld. Platforms: PlayStation 4; Xbox One; PlayStation 3; Xbox 360; Windows PC; iPhone; iPad Software: Autodesk Maya, Autodesk 3ds Max, Adobe Photoshop, Microsoft Office. Specialties: Team management; UX design for editor tools; authoring advanced-looking, inexpensive shaders; evaluation of technical issue solutions; custom workflow tool design and common task improvement; detection of opportunities for performance optimization; engine assessments, including in-depth understanding of system benefits and limitations; documentation and training; casual game design; monetization design; product branding. Experience Casual Games & Monetization Designer Unannounced Indie Company Feb 2014 — Dec 2014 Designed new casual games by blending classic childhood games with modern game rules from AAA titles. Designed "free-to-play" business models per game with monetization in mind to avoid "pay-to-win" exploits. Designed customer stickiness game systems: collections; login bonus resources/game credits; unlockable boosts via gameplay; social sharing virtual gifts. Design UX to avoid in-game UI from being covered up by device OS notifications. Designed Ad usage rules for healthy play breaks and to avoid ad spam. Designed themes for DLC as part of optional monetization. Designed company branding for product recognition. Graphics TD Ubisoft Montreal Apr 2013 — Dec 2013 Designed workflows for a work-in-progress user interface toolset built within an in-house game engine for developing 3D User Interfaces. Taught a training class to traditional UI Artists to learn the core elements and terminology for 3D rendering as they prepared to design & develop new 3D UI elements. Developed and managed a Heat Map Excel spreadsheet for tracking Feature Request & Tool Improvements which would sort which JIRA Issues and bugs where higher priority based on time gained for users versus difficulty and development cost to implement into the either the game engine or editor. Collaborated with other Technical Directors from different departments during development of the User Interface workflows to ensure the existing workflows using the same tools did not affect the Level Artist and Game Designers. Documented several editor updates for both VFX artist and Presentation UI artist after each feature request and tool update had been tested and released. Scott D Hill LinkedIn: linkedin.com/in/technicalart YouTube: youtube.com/user/techarthill Portfolio: scottdhill.wordpress.com/experience/samples Technical Artist / Shader Artist Electronic Arts / Visceral Games Montreal Mar 2011 — Feb 2013 Developed primary character shader supporting metal, fabrics, and accessories with detail mapping, diffuse color Fresnel, and reflective metals. Developed secondary character shader for fabrics and accessories with multi-region tinting for variations. Developed environment shaders, including blending and adding contrast via both vertex and pixel maps for use on surfaces and walls, reducing the number of decals needed to add visual interest. Employed specialized shader techniques for unique game elements, including fur, gore, vistas, and fountains. Applied texture saving specular techniques to add visual interest without complicating development or sacrificing performance. Created training videos and documentation on engine-specific shader technical for use by company studios worldwide. Designed and managed shader pipeline and workflows. Maya Interface Developer for Art Pipeline Tools. Engaged in performance monitoring during production. Lead Technical Artist Idea Fabrik Plc (formally Simutronics) / Hero Engine Jan 2010 — Feb 2011 Overhauled existing HeroTools for 3ds Max and Maya, including exporter, asset tools and character tools. Worked closely with RAD Game Tools on the latest release of Granny 3D for 3ds Max and Maya. Provided training and demonstrations for potential licensees of Hero Engine. Performed live demos at trade shows like D.I.C.E and GDC. Updated Wiki documentation for all art tools, workflows, limitations, and solutions to common issues. Trained new users on world building workflows in HeroBlade. Provided art support to multiple studios licensing Hero Engine. Designed new features for future releases of Hero Engine's HeroBlade editor. Helped launch HeroEngine with HeroCloud service for indie developers. International team training in Kiev, Ukraine, and Madrid, Spain. Shader and Lighting Technical Artist Supervisor Kung Fu Factory Mar 2009 — Dec 2009 Developed .cgfx and .fx shaders for PlayStation 3 and Xbox 360 using Shader FX. Developed inexpensive detailed sweat on skin shader. Worked with engineers to develop new shaders and production tools. Executed R&D and implemented new computer graphic techniques (ie. HDR Lighting and Surface Properties). Produced technical references and technical constraints documentation. Created, organized and conducted training sessions on the use of new tools and methods. Scripted repeatable and unique processes using MaxScript. Supported art team, solving 3ds Max issues and solving technical production issues. Acted as game art point of collaborative communication for artists, level designers and programmers. Lead Technical Artist Cheyenne Mountain Entertainment Nov 2005 — Mar 2009 Designed custom tools for Unreal Engine 3 to speed up game workflows. Heavily modified Maya to help 3ds Max users learn Maya faster. Provided single marking menu solution to customized GUI based on user’s job title with the Art Department. Developed a library of material shaders from which artists created instances. Designed the pipeline and workflows for game assets’ storage and management. Built relationships between multiple departments to ensure tasks where completed properly. Monitored and enforced budgets for texture, material, polygon, collision, and asset counts. Oversaw the in-house character creation editor and workflow between Character Artist & Engineers. Integrated faster workflows for artists to bring content from 3D software packages into BigWorld Client Tools. Page 2 Scott D Hill LinkedIn: linkedin.com/in/technicalart YouTube: youtube.com/user/techarthill Portfolio: scottdhill.wordpress.com/experience/samples Quality Assurance Jamdat / Knockabout Games Apr 2005 — Sep 2005 Provided feedback for improving user experience. Tracked Stats for playbooks for each NFL team. Tested on Multiple devices running Java, J2ME, BREW. Technical Art Intern / Contractor Critical Mass Interactive Mar 2005 — Sep 2005 Level Designs Game Design Documents Interactive PowerPoint Presentations Quality Assurance Mobile Game Reviews Education Associates Degree, Computer Animation Full Sail University Mar 2003 — Aug 2004 CG modeled, shading, and lighting of a PlayStation controller using NURBS. Level Design of a RC Dirt Track – Modeled games assets, textured, and layout completed in one week with PSP specs in mind. Maya MEL Script allowing users to create unique separate Outliner windows based on node types or object conditions. Level Design of a Horror Island – Modeled games assets, textured, and layout along with Stev Kalinowski in one week. Maya MEL Script creating a Remote Control like UI with new features and look based off of Jared Martin's keyframer script. Composited in Shake a two on one fight animation, composted over arcade footage with fake video scan line, fake health meters, and fake blinking "Credit 0" text. 3D Logo Animation all done in Maya using a 3D Text, a Lattice, and animated extrude for the burst running down the controller cord. Projects Unannounced Casual Games — iPhone, iPad Assassin’s Creed Unity — PlayStation 4, Xbox ONE, Windows PC Army of TWO: The Devil's Cartel — PlayStation 3, Xbox 360 Unannounced 3rd Person Action Game [Cancelled] — PlayStation 3, Xbox 360 HeroCloud Evaluation World Areas — Windows PC: SM3.0, SM2.0a, SM2.0, SM1.4, SM1.1, Fixed Function Supremacy MMA — PlayStation 3, Xbox 360 UFC Undisputed [Project Pulled] — PlayStation 3, Xbox 360 Stargate Resistance — Windows PC: SM3.0 Stargate Worlds MMO [Cancelled — Windows PC: SM3.0, SM2.5 SM2.0, SM1.5 Jamdat Sports NBA 2006 — Java, J2ME, BREW Jamdat Sports NFL 2006 — Java, J2ME, BREW Page 3 Scott D Hill LinkedIn: linkedin.com/in/technicalart YouTube: youtube.com/user/techarthill Portfolio: scottdhill.wordpress.com/experience/samples Addendum: Work Highlights Management Prioritized feature request and art tasks for the Technical Art team. Oversaw the in-house character creation editor and workflow between Character Artists and Engineers. Assigned art bugs to original author of the bug to instill accountability and learning from mistakes. Managed consistent lines of communication and a policy of collaboration to ensure all team members were on the same page. Collaborated with other Technical Directors from different departments during development of the User
Load more

Recommended publications
  • Opera Acquires Yoyo Games, Launches Opera Gaming
    Opera Acquires YoYo Games, Launches Opera Gaming January 20, 2021 - [Tuck-In] Acquisition forms the basis for Opera Gaming, a new division focused on expanding Opera's capabilities and monetization opportunities in the gaming space - Deal unites Opera GX, world's first gaming browser and popular game development engine, GameMaker - Opera GX hit 7 million MAUs in December 2020, up nearly 350% year-over-year DUNDEE, Scotland and OSLO, Norway, Jan. 20, 2021 /PRNewswire/ -- Opera (NASDAQ: OPRA), the browser developer and consumer internet brand, today announced its acquisition of YoYo Games, creator of the world's leading 2D game engine, GameMaker Studio 2, for approximately $10 million. The tuck-in acquisition represents the second building block in the foundation of Opera Gaming, a new division within Opera with global ambitions and follows the creation and rapid growth of Opera's innovative Opera GX browser, the world's first browser built specifically for gamers. Krystian Kolondra, EVP Browsers at Opera, said: "With Opera GX, Opera had adapted its proven, innovative browser tech platform to dramatically expand its footprint in gaming. We're at the brink of a shift, when more and more people start not only playing, but also creating and publishing games. GameMaker Studio2 is best-in-class game development software, and lowers the barrier to entry for anyone to start making their games and offer them across a wide range of web-supported platforms, from PCs, to, mobile iOS/Android devices, to consoles." Annette De Freitas, Head of Business Development & Strategic Partnerships, Opera Gaming, added: "Gaming is a growth area for Opera and the acquisition of YoYo Games reflects significant, sustained momentum across both of our businesses over the past year.
    [Show full text]
  • Middleware and European Standardisation” Köln, 17.8.2011
    ” Middleware and European Standardisation” Köln, 17.8.2011 Event supported by NEM initative Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu THROUGH more than in that employ over EGDF 12 17000 YOU CAN 600 game studios European game industry REACH countries professionals UK, AT, DE, FR, DK, FI, NO, BE, NL, LU, ES, IT Policy EGDF IS A development Dissemination Elaboration TRADE- participates proc- disseminates elaborates game ASSOCIATION esses developing the best developers’ policy recommen- practices, new mutual positions (SME) THAT dations that sup- standards, (technology, FOCUSES ON port game devel- new tools etc. content) opers Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu Source: © IHS Screen Digest, 2011 Consumer spending on entertainment media (€m) Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu Source: © IHS Screen Digest, 2011 European consumer spending on games (€m) Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu Value chains of video game industry Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu Viral innovation process Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu www.GameMiddleware.org Game Middleware Platform Dr. Malte Behrmann Secretary General [email protected] www.egdf.eu Standardization and Middelware Examples of European Standardization: Metric system, GSM Game Development uses increasingly specific middleware technologies. Developers tend less and less to reinvent the wheel. Europe is more and more the home of middleware of global relevance. Different aspects of the value chain are represented and the healthy competition shows also the commercial relevance.
    [Show full text]
  • 22012021 Pleniere French Gaia
    P l é n i è r e 1 22 JANVIER 2021 P l é n i è r e 2 Par Henri d’Agrain Délégué général du Cigref P l é n i è r e 3 22 JANVIER 2021 P l é n i è r e 4 Par Cédric O Secrétaire d’État chargé de la Transition numérique et des Communications électroniques P l é n i è r e 5 22 JANVIER 2021 P l é n i è r e 6 Par Bernard Duverneuil, Président du Cigref Gérard Roucairol, Président honoraire de l’Académie des technologies Jean-Luc Beylat, Président du pôle de compétitivité Systematic Paris-Région Mathieu Weill, Chef du service de l’économie numérique à la Direction Générale des Entreprises P l é n i è r e 7 22 JANVIER 2021 P l é n i è r e 8 Par Hubert Tardieu CEO AISBL GAIA-X Agenda 01 Introduction GAIA-X 02 Data Space Facilitation and the role of National Hubs 03 The AISBL Status and Organization 04 Outlook – 100 Days ahead 05 Summary 9 Overview: GAIA-X provides a user-friendly and homogenous ecosystem Joint Development of a user friendly and homogenous European ecosystem. Bringing together data spaces and their specific requirements with the provider side. 10 The GAIA-X objectives Objectives 11 The GAIA-X objectives Objectives Policy Rules Application portability Data & Software Infrastructure portability Infrastructure 12 The GAIA-X objectives Objectives Policy Rules Architecture of Standards Application portability Data Ontology Data Information API PaaS Data & Software By Industry vertical X-CSP Infrastructure portability IAM IaaS Self Description Network & Interconnects Infrastructure 13 The GAIA-X objectives Objectives Policy Rules Architecture of Standards GAIA-X Federation services Application portability Identity & Trust Data Ontology Data Information API PaaS Federated Catalogue Data & Software By Industry vertical X-CSP Infrastructure portability Data Sovereignty Services IAM IaaS Self Description Compliance Network & Interconnects Infrastructure 14 GAIA-X Federation Services – The Core Data Ecosystem …the implementation of secure Federated Identity …Sovereign Data Services which ensure the identity and trust mechanisms (security and privacy by design).
    [Show full text]
  • NETENT ANNUAL REPORT 2016 Driving the Digital Casino Market Through Better Gaming Solutions ANNUAL REPORT 2016
    ANNUAL REPORT 2016 Vision: NETENT ANNUAL REPORT 2016 REPORT ANNUAL NETENT Driving the digital casino market through better gaming solutions ANNUAL REPORT 2016 Driving the digital casino market through better gaming solutions Contents NetEnt turns 20! 2 Highlights of the year 4 Comments from the CEO 6 Strategic development 6 Vision, mission, business concept and goals 8 Strategies for growth 10 Our business model 12 Geographic expansion 18 Flexible & scalable product offering 22 Innovation & quality 30 A business partner 34 Strong corporate culture 40 Sustainability 48 The share 51 Message from the Chairman 52 Five-year overview Administration report 54 Administration report 58 Risk factors 62 Corporate governance report 69 Remuneration for senior executives 70 Board of Directors 72 Senior executives 74 Internal control 77 Financial statements – Group 81 Financial statements – Parent Company 86 Accounting policies and notes 101 Statement of assurance from the Board of Directors and CEO 102 Auditors’ report 106 Glossary 108 Definitions 109 Shareholder information The formal annual report for NetEnt AB (publ) 556532-6443 consists of the administration report and the accompanying financial statements on pages 54–101. The annual report is published in Swedish and English. The Swedish version is the original and has been audited by NetEnt’s independent auditors. THIS IS NETENT NetEnt turns 20! 1996–2016 As a pioneer in online gaming solutions, NetEnt has driven the digitalization of the casino industry. For two decades, we have been creating entertainment and setting the pace for development in the online gaming industry. A lot has happened in 20 years and below we present a few of the key events that have contributed to our role as a leading provider to the industry.
    [Show full text]
  • An Overview of 3D Data Content, File Formats and Viewers
    Technical Report: isda08-002 Image Spatial Data Analysis Group National Center for Supercomputing Applications 1205 W Clark, Urbana, IL 61801 An Overview of 3D Data Content, File Formats and Viewers Kenton McHenry and Peter Bajcsy National Center for Supercomputing Applications University of Illinois at Urbana-Champaign, Urbana, IL {mchenry,pbajcsy}@ncsa.uiuc.edu October 31, 2008 Abstract This report presents an overview of 3D data content, 3D file formats and 3D viewers. It attempts to enumerate the past and current file formats used for storing 3D data and several software packages for viewing 3D data. The report also provides more specific details on a subset of file formats, as well as several pointers to existing 3D data sets. This overview serves as a foundation for understanding the information loss introduced by 3D file format conversions with many of the software packages designed for viewing and converting 3D data files. 1 Introduction 3D data represents information in several applications, such as medicine, structural engineering, the automobile industry, and architecture, the military, cultural heritage, and so on [6]. There is a gamut of problems related to 3D data acquisition, representation, storage, retrieval, comparison and rendering due to the lack of standard definitions of 3D data content, data structures in memory and file formats on disk, as well as rendering implementations. We performed an overview of 3D data content, file formats and viewers in order to build a foundation for understanding the information loss introduced by 3D file format conversions with many of the software packages designed for viewing and converting 3D files.
    [Show full text]
  • Independent Software Consultant and Game Developer Thomas Marcus Basse Fønss Gjørup Kærsholms Møllevej 8, DK-8620 Kjellerup, Denmark [email protected] - Tel
    Curriculum Vitae Independent Software Consultant and Game Developer Thomas Marcus Basse Fønss Gjørup Kærsholms Møllevej 8, DK-8620 Kjellerup, Denmark [email protected] - tel. (+45) 60 14 77 87 - www.brainphant.com ​ ​ ​ ​ Professional Profile Being blessed with an early interest in computers, I got involved in the software industry during my high-school years; working with PC magazines as a writer and software editor I got connected to a few computer game companies here, there and abroad and turned my hobby into a career while studying Computer Science and Physics in Aarhus. My experience doing programming, graphics, sound and music for a multitude of games on the early home computers provided me good training for the more competitive world of video console games; I started working for a couple of California-based companies and co-authored and developed games that were successfully published for the Sega Genesis system. After creating a 3D terrain rendering engine for a PC-based game project I returned from the States to join Interactive Vision, a Danish game developer, as Head of Development. We published the helicopter game "Search and Rescue", instigating a successful sequel of flight simulator titles. My main projects for this company became the construction of a modularized and reusable game framework (3D graphics engine, 3D sound engine, physics simulation, network play, device drivers and tools) and the development of the futuristic 3D shooter "B-Hunter". The years in the competitive and dynamic computer game industry - when the battle was fought on having the best proprietary middleware such as physics simulators and hand-optimized graphic pipelines - have trained my skills at paying attention to the quality of details - and the details of quality.
    [Show full text]
  • UBI Banca Spa
    Consolidated non-fi nancial 2019 statement pursuant to Legislative Decree No. 254 of 30th December 2016 Sustainability Report Dichiarazione consolidata di carattere non fi nanziario non fi consolidata di carattere Dichiarazione 2019 Unione di Banche Italiane Joint Stock Company in abbreviated form UBI Banca Spa Head Office and General Management: Piazza Vittorio Veneto 8, Bergamo (Italy) Operating offices: Bergamo, Brescia and Milan Member of the Interbank Deposit Protection Fund and the National Guarantee Fund Belonging to the IVA UBI Group with VAT No. 04334690163 Tax Code, VAT No. and Bergamo Company Registration No. 03053920165 ABI 3111.2 Register of Banks No. 5678 Register of Banking Groups No. 3111.2 Parent company of the Unione di Banche Italiane Banking Group Share capital as at 31st December 2019: EUR 2,843,177,160.24 fully paid up PEC address: [email protected] www.ubibanca.it This document has been written with no account taken of the public exchange offer on all the Bank’s shares launched by Intesa SanPaolo S.p.A. on 17th February 2020. The images reproduced in this document have been taken from the book entitled “Le nostre immagini, la nostra immagine” published by Mondadori in March 2020, which contains a collection of photos taken by Group employees in the photographic competition of the same name held in 2019. On the front cover: Oscar Babucci – Val di Chiana Consolidated non-financial statement pursuant to Legislative Decree No. 254 of 30th December 2016 Sustainability Report 2019 Letter to our Stakeholders Ever since its foundation, UBI has been very aware of and focused on sustainability issues.
    [Show full text]
  • 2021 Vision Product Range Catalogue
    Because people like dealing with us Everything modular from Crystal Vision... Crystal Vision provides project-winning interface and keying modules to all those involved in the professional broadcasting industry. As a main modular supplier we are able to provide all the essential ‘broadcast plumbing’ for your installation, while we are also known for our more specialist products – such as the chroma keyers used by broadcasters across the world. There’s a choice of two product ranges: the Indigo range for the biggest range of boards and frame sizes, and the forward-looking Vision range for those planning IP and 4K installations or who are seeking the maximum outputs from their SDI products. With reliable multi-functional products, responsive customer support, quick delivery and a five year warranty, Crystal Vision is a company that people like dealing with. The Vision product range – the broadcast industry’s most modern frame system… IP/SDI interface and keyers There’s nothing quite so flexible as MARBLE-V1. Our powerful media processor is purpose-built GPU/CPU hardware that fits in the Vision 3 frame and runs software apps that process both 10GbE video over IP and SDI. Apps that are bought with the hardware can be replaced with different apps as needs change. No other IP products make it quite so easy for your systems to grow and mature with the transition. Our initial IP/SDI video processing apps provide chroma keying, linear keying, web keying, video delay, profanity delay, colour correction, legalising, picture-in-picture and fail-safe switching. They work with IP, with SDI or with both IP and SDI at the same time.
    [Show full text]
  • Mapping Game Engines for Visualisation
    Mapping Game Engines for Visualisation An initial study by David Birch- [email protected] Contents Motivation & Goals: .......................................................................................................................... 2 Assessment Criteria .......................................................................................................................... 2 Methodology .................................................................................................................................... 3 Mapping Application ......................................................................................................................... 3 Data format ................................................................................................................................... 3 Classes of Game Engines ................................................................................................................... 4 Game Engines ................................................................................................................................... 5 Axes of Evaluation ......................................................................................................................... 5 3d Game Studio ....................................................................................................................................... 6 3DVIA Virtools ........................................................................................................................................
    [Show full text]
  • An Overview Study of Game Engines
    Faizi Noor Ahmad Int. Journal of Engineering Research and Applications www.ijera.com ISSN : 2248-9622, Vol. 3, Issue 5, Sep-Oct 2013, pp.1673-1693 RESEARCH ARTICLE OPEN ACCESS An Overview Study of Game Engines Faizi Noor Ahmad Student at Department of Computer Science, ACNCEMS (Mahamaya Technical University), Aligarh-202002, U.P., India ABSTRACT We live in a world where people always try to find a way to escape the bitter realities of hubbub life. This escapism gives rise to indulgences. Products of such indulgence are the video games people play. Back in the past the term ―game engine‖ did not exist. Back then, video games were considered by most adults to be nothing more than toys, and the software that made them tick was highly specialized to both the game and the hardware on which it ran. Today, video game industry is a multi-billion-dollar industry rivaling even the Hollywood. The software that drives these three dimensional worlds- the game engines-have become fully reusable software development kits. In this paper, I discuss the specifications of some of the top contenders in video game engines employed in the market today. I also try to compare up to some extent these engines and take a look at the games in which they are used. Keywords – engines comparison, engines overview, engines specification, video games, video game engines I. INTRODUCTION 1.1.2 Artists Back in the past the term ―game engine‖ did The artists produce all of the visual and audio not exist. Back then, video games were considered by content in the game, and the quality of their work can most adults to be nothing more than toys, and the literally make or break a game.
    [Show full text]
  • Using Game Engine to Generate Synthetic Datasets for Machine Learning
    Using Game Engine to Generate Synthetic Datasets for Machine Learning Toma´sˇ Buben´ıcekˇ ∗ Supervised by: Jiri Bittnery Department of Computer Graphics and Interaction Czech Technical University in Prague Prague / Czech Republic Abstract However, for some augmented image data (such as optical flow data), the real measured data is often sparse or not Datasets for use in computer vision machine learning are measurable by conventional sensors in general. For this often challenging to acquire. Often, datasets are created very reason, synthetic datasets, which are acquired purely either using hand-labeling or via expensive measurements. using a simulated scene, are often used. In this paper, we characterize different augmented image Several such synthetic datasets based on virtual scenes data used in computer vision machine learning tasks and already exist and were proven to be useful for machine propose a method of generating such data synthetically us- learning tasks, such as one presented by Mayer et al. [6]. ing a game engine. We implement a Unity plugin for cre- They used a modified version of Blender 3D creation suite, ating such augmented image data outputs, usable in exist- which was able to output additional augmented image data ing Unity projects. The implementation allows for RGB such as optical flow information and segmentation. What lit output and several ground-truth outputs, such as depth is missing is a way for others to create their data in an and normal information, object or category segmentation, easy-to-use environment, as the modified Blender suite is motion segmentation, forward and backward optical flow not available, and it is not straightforward to add differ- and occlusions, 2D and 3D bounding boxes, and camera ent types of output to its rendering.
    [Show full text]
  • Unrealcv: Connecting Computer Vision to Unreal Engine
    UnrealCV: Connecting Computer Vision to Unreal Engine Weichao Qiu, Alan Yuille Johns Hopkins University, Baltimore, MD, USA fqiuwch, [email protected] Abstract. Computer graphics can not only generate synthetic images and ground truth but it also offers the possibility of constructing virtual worlds in which: (i) an agent can perceive, navigate, and take actions guided by AI algorithms, (ii) properties of the worlds can be modified (e.g., material and reflectance), (iii) physical simulations can be per- formed, and (iv) algorithms can be learnt and evaluated. But creating realistic virtual worlds is not easy. The game industry, however, has spent a lot of effort creating 3D worlds, which a player can interact with. So re- searchers can build on these resources to create virtual worlds, provided we can access and modify the internal data structures of the games. To enable this we created an open-source plugin UnrealCV1 for a popular game engine Unreal Engine 4 (UE4). We show two applications: (i) a proof of concept image dataset, and (ii) linking Caffe with the virtual world to test deep network algorithms. 1 Introduction Computer vision has benefitted enormously from large datasets[7,8]. They en- able the training and testing of complex models such as deep networks[13]. But arXiv:1609.01326v1 [cs.CV] 5 Sep 2016 performing annotation is costly and time consuming so it is attractive to make synthetic datasets which contain large amounts of images and detailed annota- tion. These datasets are created by modifying open-source movies[2] or by con- structing a 3D world[17,9].
    [Show full text]