DOCSLIB.ORG

Safe Employment of Augmented Reality in a Production Environment Market Research Deliverable #2

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Safe Employment of Augmented Reality in a Production Environment Market Research Deliverable #2 Naval Shipbuilding & Advanced Manufacturing Center Safe Employment of Augmented Reality in a Production Environment Market Research Deliverable #2 Q2804 N00014-14-D-0377 Prepared by: Scott Truitt, Project Manager, ATI Submitted by: _______________________ 06/13/2019 ______ Signature Date Name, Title, Organization Page 1 of 45 Table of Contents Introduction ........................................................................................................................................... 5 Purpose................................................................................................................................................... 5 1. Wearables & Mobile Devices for Augmented Reality (Lead: General Dynamics- Electric Boat) ............................................................................................................................................. 5 Background ........................................................................................................................................... 5 AR Registration Defined ..................................................................................................................... 6 2D Markers ............................................................................................................................................. 6 3D Markers ............................................................................................................................................. 8 Planar Registration .............................................................................................................................. 9 Control Point Registration ............................................................................................................... 10 AR Registration for Shipbuilding ................................................................................................... 12 Registration Support ......................................................................................................................... 12 Analysis ................................................................................................................................................ 13 Table Tabs ........................................................................................................................................ 14 Manufacturer Data Collection ..................................................................................................... 14 Hardware Data Collection ............................................................................................................ 15 Software Data Collection ............................................................................................................. 16 Wearable & Mobile Devices for Augment Reality Conclusion ............................................... 17 2. Safety Requirements (Lead: Boeing) ....................................................................................... 18 Background ......................................................................................................................................... 18 Situational Awareness ...................................................................................................................... 18 Standardization of Risk Assessment ............................................................................................ 19 Fitness Evaluation ............................................................................................................................. 20 Down selection Process ................................................................................................................... 21 Hardware Considerations ................................................................................................................ 21 Microsoft Hololens ......................................................................................................................... 22 Google Glass ................................................................................................................................... 22 Tablets .............................................................................................................................................. 22 Smartphones ................................................................................................................................... 22 Software Considerations ................................................................................................................. 22 3. Security Considerations (Lead: Huntington-Ingalls Industries, Ingalls Shipbuilding) 23 Background ......................................................................................................................................... 23 Page 2 of 45 Bluetooth .............................................................................................................................................. 23 Bluetooth v3.0 Vulnerabilities ..................................................................................................... 23 Bluetooth LE & v4.0 ....................................................................................................................... 24 Wi-Fi ....................................................................................................................................................... 24 Data Interception ............................................................................................................................ 24 Denial of Service (DoS) ................................................................................................................. 24 Rogue AP’s ...................................................................................................................................... 24 Wireless Intruders .......................................................................................................................... 24 Misconfigured AP’s ....................................................................................................................... 25 Ad Hocs and Soft AP’s ................................................................................................................. 25 Endpoint Attacks ............................................................................................................................ 25 Evil Twin AP’s ................................................................................................................................. 25 Wi-Fi 802.11ac ................................................................................................................................. 25 Operating Systems ............................................................................................................................ 26 Windows 10 ..................................................................................................................................... 26 Linux .................................................................................................................................................. 26 Blue Cat ............................................................................................................................................ 27 iOS ...................................................................................................................................................... 28 Android ............................................................................................................................................. 28 Software Development Kits (SDK) ................................................................................................. 29 DeepAR SDK ................................................................................................................................... 29 EasyAR SDK .................................................................................................................................... 30 ARCore SDK .................................................................................................................................... 31 Onirix SDK ....................................................................................................................................... 32 Pikkart AR SDK ............................................................................................................................... 33 Scope AR SDK ................................................................................................................................ 34 4. User Interface (Lead: Huntington-Ingalls Industries, Newport News Shipbuilding) .. 35 Background ......................................................................................................................................... 35 Analysis ................................................................................................................................................ 37 Hololens, Microsoft ....................................................................................................................... 37 Hololens 2, Microsoft .................................................................................................................... 38 Magic Leap One, Magic Leap ...................................................................................................... 39 Daqri Enterprise Smart Glasses, Daqri ...................................................................................
Load more

Recommended publications
  • Google ARCORE
    Google ARCORE Nisfu Asrul Sani @ Lab Langit 9 - PENS 20 - 22 November 2017 environtment Setting up your development environment Install the Android SDK version 7.0 (API Level 24) or higher. To install the Android SDK, install Android Studio. To update the Android SDK, use the Android SDK Manager tool in Android Studio. Install Unity 2017.2 Beta 11 or higher, with the Android Build Support component. For more info, see Downloading and Installing Unity. You will need to get the ARCore SDK for Unity. You can either: Download the SDK Preview for Unity and extract it. -or- Clone the repository with the following command: git clone https://github.com/google-ar/arcore-unity-sdk.git Prepare your device You must use a supported, physical device. ARCore does not support virtual devices such as the Android Emulator. To prepare your device: Enable developer options Enable USB debugging Install the ARCore Service on the device: Download the ARCore Service Connect your Android device to the development machine with a USB cable Install the service by running the following adb command: adb install -r -d arcore-preview.apk https://play.google.com/store/apps/details?id=com.un Additional ity3d.genericremote Supported Devices ARCore is designed to work on a wide variety of qualified Android phones running N and later. During the SDK preview, ARCore supports the following devices: Google Pixel, Pixel XL, Pixel 2, Pixel 2 XL Samsung Galaxy S8 (SM-G950U, SM-G950N, SM- G950F, SM-G950FD, SM-G950W, SM-G950U1) Initially, ARCore will only work with Samsung’s S8 and S8+ and Google’s Pixel phone, but by the end of the year, Google promised to have support for 100 million Android phones, including devices from LG, Huawei and Asus, among others.
    [Show full text]
  • Augmented Reality (AR) Indoor Navigation Mobile Application
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Sunway Institutional Repository Design of a Mobile Augmented Reality-based Indoor Navigation System Xin Hui Ng, Woan Ning Lim Research Centre for Human-Machine Collaboration Department of Computing and Information Systems School of Science and Technology Sunway University, Malaysia ( [email protected], [email protected] ) Abstract— GPS-based navigation technology has been widely immersive virtual navigation direction. A mobile application used in most of the commercial navigation applications prototype was developed in this project to provide navigation nowadays. However, its usage in indoor navigation is not as within Sunway University campus. effective as when it is used at outdoor environment. Much research and developments of indoor navigation technology II. RELATED WORK involve additional hardware installation which usually incur high An indoor navigation system is comprised of 3 important setup cost. In this paper, research and comparisons were done to components which are positioning, wayfinding, and route determine the appropriate techniques of indoor positioning, pathfinding, and route guidance for an indoor navigation guidance. Positioning refers to determining user’s current method. The aim of this project is to present a simple and cost- position, while wayfinding focuses on searching the route from effective indoor navigation system. The proposed system uses the user’s position to a specific destination. Route guidance is the existing built-in sensors embedded in most of the mobile devices navigation directions illustrating the route. to detect the user location, integrates with AR technology to A. Indoor Positioning Techniques provide user an immersive navigation experience.
    [Show full text]
  • 7 Things About Google Glass
    7 Things about Google Glass 1 - What is it? Google Glass is a computer that includes an optical display with a head mount, touch sensitive pad, a camera and a speaker. Google Glass is a head-mounted computer with technologies that make it comparable to a smartphone.1 It is a revolutionary device that lets you multitask without having to fumble for a phone or take your attention off of things in front of you.2 Learn more http://www.google.com/glass/ 2 - How does it work? Google Glass has a touch sensitive pad on one side of the frame that you use for scrolling, selecting and navigating.3 Glass also has the ability to read movement with multiple sensors. With a simple movement of your head, you are able to put the Google Glass to sleep, scroll through options or even wake it up. Voice sensors also give a user the ability to select, search and record.4 3 - Who’s doing it? Google Glass was developed in Google labs in Mountain View, California. Google calls the project, “Project Glass” and it is expected to be released to the public in 2014. Google engineers are currently working on new designs including a prescription glasses version.5 1 http://www.pcmag.com/article2/0,2817,2402613,00.asp 2http://www.google.com/glass/start/what-it-does/ 3 https://www.google.com/glass/help/ 4 http://www.google.com/glass/start/what-it-does/ 5 http://www.cnn.com/2014/01/28/tech/innovation/google-glass-lenses/index.html 4 - Why is it significant? Google Glass not only allows the user to take pictures, record videos, surf the web, check the weather, listen to music or message a friend but it allows them to do all of this without holding a device or having one awkwardly mounted to them.
    [Show full text]
  • Interaction Methods for Smart Glasses: a Survey
    This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2018.2831081, IEEE Access Date of publication xxxx 00, 0000, date of current version xxxx 00, 0000. Digital Object Identifier 10.1109/ACCESS.2018.Doi Number Interaction Methods for Smart Glasses: A survey Lik-Hang LEE1, and Pan HUI1&2 (Fellow, IEEE). 1The Hong Kong University of Science and Technology, Department of Computer Science and Engineering 2The University of Helsinki, Department of Computer Science Corresponding author: Pan HUI (e-mail: panhui@ cse.ust.hk). ABSTRACT Since the launch of Google Glass in 2014, smart glasses have mainly been designed to support micro-interactions. The ultimate goal for them to become an augmented reality interface has not yet been attained due to an encumbrance of controls. Augmented reality involves superimposing interactive computer graphics images onto physical objects in the real world. This survey reviews current research issues in the area of human-computer interaction for smart glasses. The survey first studies the smart glasses available in the market and afterwards investigates the interaction methods proposed in the wide body of literature. The interaction methods can be classified into hand-held, touch, and touchless input. This paper mainly focuses on the touch and touchless input. Touch input can be further divided into on-device and on-body, while touchless input can be classified into hands-free and freehand. Next, we summarize the existing research efforts and trends, in which touch and touchless input are evaluated by a total of eight interaction goals.
    [Show full text]
  • Getting Real with the Library
    Getting Real with the Library Samuel Putnam, Sara Gonzalez Marston Science Library University of Florida Outline What is Augmented Reality (AR) & Virtual Reality (VR)? What can you do with AR/VR? How to Create AR/VR AR/VR in the Library Find Resources What is Augmented and Virtual Reality? Paul Milgram ; Haruo Takemura ; Akira Utsumi ; Fumio Kishino; Augmented reality: a class of displays on the reality- virtuality continuum. Proc. SPIE 2351, Telemanipulator and Telepresence Technologies, 282 (December 21, 1995) What is Virtual Reality? A computer-generated simulation of a lifelike environment that can be interacted with in a seemingly real or physical way by a person, esp. by means of responsive hardware such as a visor with screen or gloves with sensors. "virtual reality, n". OED Online 2017. Web. 16 May 2017. Head mounted display, U.S. Patent Number 8,605,008 VR in the 90s By Dr. Waldern/Virtuality Group - Dr. Jonathan D. Waldern, Attribution, https://commons.wikimedia.org/w/index.php?curid=32899409 By Dr. Waldern/Virtuality Group - Dr. Jonathan D. Waldern, By Dr. Waldern/Virtuality Group - Dr. Jonathan D. Waldern, Attribution, Attribution, https://commons.wikimedia.org/w/index.php?curid=32525338 https://commons.wikimedia.org/w/index.php?curid=32525505 1 2 3 VR with a Phone 1. Google Daydream View 2. Google Cardboard 3. Samsung Gear VR Oculus Rift ● Popular VR system: headset, hand controllers, headset tracker ($598) ● Headset has speakers -> immersive environment ● Requires a powerful PC for full VR OSVR Headset ● Open Source ● “Plug in, Play Everything” ● Discounts for Developers and Academics ● Requires a powerful PC for full VR Augmented Reality The use of technology which allows the perception of the physical world to be enhanced or modified by computer-generated stimuli perceived with the aid of special equipment.
    [Show full text]
  • An Augmented Reality Social Communication Aid for Children and Adults with Autism: User and Caregiver Report of Safety and Lack of Negative Effects
    bioRxiv preprint doi: https://doi.org/10.1101/164335; this version posted July 19, 2017. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. An Augmented Reality Social Communication Aid for Children and Adults with Autism: User and caregiver report of safety and lack of negative effects. An Augmented Reality Social Communication Aid for Children and Adults with Autism: User and caregiver report of safety and lack of negative effects. Ned T. Sahin1,2*, Neha U. Keshav1, Joseph P. Salisbury1, Arshya Vahabzadeh1,3 1Brain Power, 1 Broadway 14th Fl, Cambridge MA 02142, United States 2Department of Psychology, Harvard University, United States 3Department of Psychiatry, Massachusetts General Hospital, Boston * Corresponding Author. Ned T. Sahin, PhD, Brain Power, 1 Broadway 14th Fl, Cambridge, MA 02142, USA. Email: [email protected]. Abstract Background: Interest has been growing in the use of augmented reality (AR) based social communication interventions in autism spectrum disorders (ASD), yet little is known about their safety or negative effects, particularly in head-worn digital smartglasses. Research to understand the safety of smartglasses in people with ASD is crucial given that these individuals may have altered sensory sensitivity, impaired verbal and non-verbal communication, and may experience extreme distress in response to changes in routine or environment. Objective: The objective of this report was to assess the safety and negative effects of the Brain Power Autism System (BPAS), a novel AR smartglasses-based social communication aid for children and adults with ASD. BPAS uses emotion-based artificial intelligence and a smartglasses hardware platform that keeps users engaged in the social world by encouraging “heads-up” interaction, unlike tablet- or phone-based apps.
    [Show full text]
  • The Use of Smartglasses in Everyday Life
    University of Erfurt Faculty of Philosophy The Use of Smartglasses in Everyday Life A Grounded Theory Study Dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy (Dr. phil.) at the Faculty of Philosophy of the University of Erfurt submitted by Timothy Christoph Kessler from Munich November 2015 URN: urn:nbn:de:gbv:547-201600175 First Assessment: Prof. Dr. Joachim R. Höflich Second Assessment: Prof. Dr. Dr. Castulus Kolo Date of publication: 18th of April 2016 Abstract We live in a mobile world. Laptops, tablets and smartphones have never been as ubiquitous as they have been today. New technologies are invented on a daily basis, lead- ing to the altering of society on a macro level, and to the change of the everyday life on a micro level. Through the introduction of a new category of devices, wearable computers, we might experience a shift away from the traditional smartphone. This dissertation aims to examine the topic of smartglasses, especially Google Glass, and how these wearable devices are embedded into the everyday life and, consequently, into a society at large. The current research models which are concerned with mobile communication are only partly applicable due to the distinctive character of smartglasses. Furthermore, new legal and privacy challenges for smartglasses arise, which are not taken into account by ex- isting theories. Since the literature on smartglasses is close to non-existent, it is argued that new models need to be developed in order to fully understand the impact of smart- glasses on everyday life and society as a whole.
    [Show full text]
  • 2(D) Citation Watch – Google Inc Towergatesoftware Towergatesoftware.Com 1 866 523 TWG8
    2(d) Citation Watch – Google inc towergatesoftware towergatesoftware.com 1 866 523 TWG8 Firm/Corresp Owner (cited) Mark (cited) Mark (refused) Owner (refused) ANDREW ABRAMS Google Inc. G+ EXHIBIA SOCIAL SHOPPING F OR Exhibía OY 85394867 G+ ACCOUNT REQUIRED TO BID 86325474 Andrew Abrams Google Inc. GOOGLE CURRENTS THE GOOGLE HANDSHAKE Goodway Marketing Co. 85564666 85822092 Andrew Abrams Google Inc. GOOGLE TAKEOUT GOOGLEBEERS "Munsch, Jim" 85358126 86048063 Annabelle Danielvarda Google Inc. BROADCAST YOURSELF ORR TUBE BROADCAST MYSELF "Orr, Andrew M" 78802315 85206952 Annabelle Danielvarda Google Inc. BROADCAST YOURSELF WEBCASTYOURSELF Todd R Saunders 78802315 85213501 Annabelle Danielvarda Google Inc. YOUTUBE ORR TUBE BROADCAST MYSELF "Orr, Andrew M" 77588871 85206952 Annabelle Danielvarda Google Inc. YOUTUBE YOU PHOTO TUBE Jorge David Candido 77588871 85345360 Annabelle Danielvarda Google Inc. YOUTUBE YOUTOO SOCIAL TV "Youtoo Technologies, Llc" 77588871 85192965 Building 41 Google Inc. GMAIL GOT GMAIL? "Kuchlous, Ankur" 78398233 85112794 Building 41 Google Inc. GMAIL "VOG ART, KITE, SURF, SKATE, "Kruesi, Margaretta E." 78398233 LIFE GRETTA KRUESI WWW.GRETTAKRUESI.COM [email protected]" 85397168 "BUMP TECHNOLOGIES, INC." GOOGLE INC. BUMP PAY BUMPTOPAY Nexus Taxi Inc 85549958 86242487 1 Copyright 2015 TowerGate Software Inc 2(d) Citation Watch – Google inc towergatesoftware towergatesoftware.com 1 866 523 TWG8 Firm/Corresp Owner (cited) Mark (cited) Mark (refused) Owner (refused) "BUMP TECHNOLOGIES, INC." GOOGLE INC. BUMP BUMP.COM Bump Network 77701789 85287257 "BUMP TECHNOLOGIES, INC." GOOGLE INC. BUMP BUMPTOPAY Nexus Taxi Inc 77701789 86242487 Christine Hsieh Google Inc. GLASS GLASS "Border Stylo, Llc" 85661672 86063261 Christine Hsieh Google Inc. GOOGLE MIRROR MIRROR MIX "Digital Audio Labs, Inc." 85793517 85837648 Christine Hsieh Google Inc.
    [Show full text]
  • Google Glass - Dazzling Yet Brittle Technology
    INTERNATIONAL JOURNAL OF SCIENTIFIC & TECHNOLOGY RESEARCH VOLUME 5, ISSUE 05, MAY 2016 ISSN 2277-8616 Google Glass - Dazzling Yet Brittle Technology Saideep Koppaka Abstract: In today’s digital world, everyone’s carrying a mobile phone, a laptop and a tablet. All the devices mentioned above need to be carried by an individual in his bag or in his pocket. Google tried to bring up a wearable revolution with the introduction of “Google glass”. It is a wearable computer with an optical head mounted display that is worn like a pair of glasses. This paper will discuss the technology, working, benefits and concerns over the first wearable computer. Index words: Augmented reality, Cloud computing, Gadget, Google glass, Invention, Marketing, Wearable technology, Wireless ———————————————————— 1. Introduction: 3. Technologies Used: Google glass is a piece of technology that performs the For the development of Google glass, multiple technologies tasks which can be performed by your smart phone through such as Wearable computing, Ambient Intelligence, Smart voice commands. In brief, the screen present in front of Clothing, Eye tap technology, Smart Grid technology, 4G your eye is operated with your voice. Project glass (other technology and Android operating system were brought into name for Google glass) is a development program by play. Google to develop an augmented reality head mounted In wearable computing, there will be a consistent display. Augmented reality is a direct or indirect view of real interaction between the man and the machine. In world which is live. It is further related to mediate reality this case, the computer acts as an extension to which deals with the view of reality that is modified by a the human mind [2].
    [Show full text]
  • Factors Influencing Consumer Attitudes Towards M-Commerce AR Apps
    “I see myself, therefore I purchase”: factors influencing consumer attitudes towards m-commerce AR apps Mafalda Teles Roxo and Pedro Quelhas Brito Faculdade de Economia da Universidade do Porto and LIAAD-INESC TEC, Portugal [email protected]; [email protected] Abstract Mobile commerce (m-commerce) is starting to represent a significant share of e-commerce. The use of Augmented Reality (AR) by brands to convey information about their products - within the store and mainly as mobile apps – makes it possible for researchers and managers to understand consumer reactions. Although attitudes towards AR have been studied, the overall effect of distinct aspects such as the influence of others, the imagery, projection and perceived presence, has not been tackled as far as we know. Therefore, we conducted a study on 218 undergraduate students, using a pre-test post-test experimental design to address the following questions: (1) Do AR media characteristics affect consumer attitudes towards the medium in a mobile shopping context? Also, (2) Do the opinion and physical presence of people influence the attitude towards an m-commerce AR app? It found that AR characteristics such as projection and imagery positively influence attitudes towards m-commerce AR apps, whereas social variables did not have any influence. Keywords: MAR; m-commerce; consumer psychology; AR-consumer relationship. 1 Introduction Simultaneously with the increasing percentage of e-commerce sales resulting from mobile retail commerce (m-commerce), it is estimated that in the U.S., by 2020, 49.2% of online sales will be made using mobile apps (Statista, 2019b). Also, in 2018, approximately 57% of internet users purchased fashion-related products online (Statista, 2019a).
    [Show full text]
  • Light Engines for XR Smartglasses by Jonathan Waldern, Ph.D
    August 28, 2020 Light Engines for XR Smartglasses By Jonathan Waldern, Ph.D. The near-term obstacle to meeting an elegant form factor for Extended Reality1 (XR) glasses is the size of the light engine2 that projects an image into the waveguide, providing a daylight-bright, wide field-of-view mobile display For original equipment manufacturers (OEMs) developing XR smartglasses that employ diffractive wave- guide lenses, there are several light engine architectures contending for the throne. Highly transmissive daylight-bright glasses demanded by early adopting customers translate to a level of display efficiency, 2k-by-2k and up resolution plus high contrast, simply do not exist today in the required less than ~2cc (cubic centimeter) package size. This thought piece examines both Laser and LED contenders. It becomes clear that even if MicroLED (µLED) solutions do actually emerge as forecast in the next five years, fundamentally, diffractive wave- guides are not ideally paired to broadband LED illumination and so only laser based light engines, are the realistic option over the next 5+ years. Bottom Line Up Front • µLED, a new emissive panel technology causing considerable excitement in the XR community, does dispense with some bulky refractive illumination optics and beam splitters, but still re- quires a bulky projection lens. Yet an even greater fundamental problem of µLEDs is that while bright compared with OLED, the technology falls short of the maximum & focused brightness needed for diffractive and holographic waveguides due to the fundamental inefficiencies of LED divergence. • A laser diode (LD) based light engine has a pencil like beam of light which permits higher effi- ciency at a higher F#.
    [Show full text]
  • Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking
    sensors Article Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking Sebastiano Verde 1 , Marco Marcon 2,* , Simone Milani 1 and Stefano Tubaro 2 1 Department of Information Engineering, University of Padova, 35131 Padua, Italy; [email protected] (S.V.); [email protected] (S.M.) 2 Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, 20133 Milan, Italy; [email protected] * Correspondence: [email protected] Received: 13 November 2020; Accepted: 9 December 2020; Published: 14 December 2020 Abstract: Internet of Things (IoT) applications play a relevant role in today’s industry in sharing diagnostic data with off-site service teams, as well as in enabling reliable predictive maintenance systems. Several interventions scenarios, however, require the physical presence of a human operator: Augmented Reality (AR), together with a broad-band connection, represents a major opportunity to integrate diagnostic data with real-time in-situ acquisitions. Diagnostic information can be shared with remote specialists that are able to monitor and guide maintenance operations from a control room as if they were in place. Furthermore, integrating heterogeneous sensors with AR visualization displays could largely improve operators’ safety in complex and dangerous industrial plants. In this paper, we present a complete setup for a remote assistive maintenance intervention based on 5G networking and tested at a Vodafone Base Transceiver Station (BTS) within the Vodafone 5G Program. Technicians’ safety was improved by means of a lightweight AR Head-Mounted Display (HDM) equipped with a thermal camera and a depth sensor to foresee possible collisions with hot surfaces and dangerous objects, by leveraging the processing power of remote computing paired with the low latency of 5G connection.
    [Show full text]