DOCSLIB.ORG

Application of Mixed Reality Devices for Robot Manipulator Programming: Aspects Related to Graphical Animations

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Application of Mixed Reality Devices for Robot Manipulator Programming: Aspects Related to Graphical Animations Imagem João Pedro Silva Neves Application of Mixed Reality Devices for Robot Manipulator Programming: Aspects Related to Graphical Animations Dissertação de Mestrado em Engenharia Mecânica na Especialidade de Produção e Projeto July/2018 DEPARTAMENTO DE ENGENHARIA MECÂNICA Application of Mixed Reality Devices for Robot Manipulator Programming: Aspects related to Graphical Animations Submitted in Partial Fulfilment of the Requirements for the Degree of Master in Mechanical Engineering in the speciality of Production and Project. Utilização de Dispositivos de Realidade Mista para Programação de Robôs Manipuladores: Aspetos relacionados com Animação Gráfica. Author João Pedro Silva Neves Advisor[s] Professor Doutor Joaquim Norberto Cardoso Pires da Silva Engenheiro Doutor Theo Doll Jury Professor Doutor Altino de Jesus Roque Loureiro President Professor Associado c/ Agregação da Universidade de Coimbra Professor Doutor António Fernando Macedo Ribeiro Professor Associado c/ Agregação da Universidade do Minho Vowel[s] Professor Doutor Carlos Xavier Pais Viegas Professor Auxiliar da Universidade de Coimbra Professor Doutor Joaquim Norberto Cardoso Pires da Silva Advisor Professor Associado c/ Agregação da Universidade de Coimbra Engenheiro Doutor Theo Doll CEO na empresa Söhner Kunststofftechnik Gmbh Application of Mixed Reality Devices for Robot Manipulator Programming. Aspects Related to Graphical Animations Institutional Collaboration Söhner Kunststofftechnik Koris Robotics Gmbh Gmbh Coimbra, July, 2018 ii ACKNOWLEDGEMENTS ACKNOWLEDGEMENTS This dissertation is the climax of all the hard work fulfilled during this five years as a student of Mechanical Engineering at the University of Coimbra. I cannot start without acknowledging all the people that supported and guided me throughout these years, whom I am truly grateful to. To Prof. Dr J. Norberto Pires, advisor, for all the advice and guidance given throughout this Master Thesis, and for providing us all the tools and means to develop this project. To Dr Theo Doll, advisor, for the internship provided that gave us the opportunity to start this project, and for the Microsoft Hololens lent for development. To Diogo Serrario, my friend and partner in this project, for his collaboration and relentless work given to this project. The outcome of this project was only possible with our teamwork. To my friends and colleagues in the Robotics Lab, for their friendship and all the advices given that were essential to assure the outcome of this Dissertation. To all my friends that have been by my side in this 5 years of study, with whom I have unforgettable memories, and whose friendship I could always count. To my parents and my brother, for all the unconditional support given, for being the greatest role models in my life and for always believing in me To my girlfriend, that has been by my side during the development of this Master Thesis, and whom I must thank for all the support and courage given. João Pedro Silva Neves i Application of Mixed Reality Devices for Robot Manipulator Programming. Aspects Related to Graphical Animations ii 2018 ABSTRACT Abstract The main goal of this Master Thesis’ dissertation consists in describing a new project developed with the purpose to create a completely new interface, which provides a generic implementation of Mixed Reality to monitor, optimize and program robot manipulators’ tasks. This interface will hopefully expand the range of people with capabilities to program industrial robots, since the advanced knowledge of programming languages will be an optional requirement. The motivation for this project begins with the will to improve Human-Machine Interfaces (HMI) and to demonstrate that an approach with Mixed Reality can lead to huge improvements in monitoring and programming advanced robotic tasks, such as Additive-manufacturing, collaborative robots, amongst others. Perceiving information as direct visual content, in real time, anticipate trajectories, or even apply modifications to a robot motion with gesture or sound inputs, are some of the great advantages of this technology. The project developed in this master thesis resulted in two apps for a Microsoft HoloLens each with different purposes. The first (Path Visualization) is a Mixed Reality interface that allows users to control a robotic manipulator, visualize its movement and fully monitor the task assigned to the robot. The second app (Graphical Path Manipulation) is a new Mixed Reality environment that allows users to create a completely new path or adjust one, as well as enabling the possibility to change motion parameters and teach the new/adjusted path trajectory to the robot. This Master Thesis will focus on all the development, made by the writer, to create the Mixed Reality applications for the Microsoft HoloLens. This was possible using the Unity3D, Vuforia and Visual Studio software interfaces. Although this project’s purpose is not to focus on a specific industrial task, it can be easily adapted posteriorly to any kind of robotic task desired. The concept however is open for further studies. João Pedro Silva Neves iii Application of Mixed Reality Devices for Robot Manipulator Programming. Aspects Related to Graphical Animations Keywords Mixed Reality (MR), Augmented Reality (AR), Robotic Manipulators, Microsoft HoloLens, Human-Machine Interfaces (HMI), Task Optimization, Advanced Programming. iv 2018 Resumo Resumo O objetivo desta dissertação consiste na descrição do projeto desenvolvido com o propósito de criar uma interface completamente nova, que implementa tecnologias de Realidade Mista para a programação e monitorização de robôs manipuladores. Esta interface tem como intuito principal expandir o número de pessoas com capacidades para programar e monitorizar robôs manipuladores, ao tornar o conhecimento avançado de linguagens de programação um requerimento opcional e não fundamental. A motivação para este projeto começa pela vontade de proporcionar avanços em interfaces de comunicação Homem- Máquina (IHM), e na demonstração das vantagens proporcionadas pelas tecnologias de Realidade Mista na monitorização e programação de processos robóticos avançados (Produção aditiva, robôs colaborativos, entre outros). Ter acesso direto a informação como conteúdo visual aplicado no espaço e em tempo real, antecipar trajetórias, ou até modificar o movimento de um robô através de som ou gestos manuais, são algumas das grandes vantagens proporcionadas por esta tecnologia. O projeto desenvolvido durante a realização desta tese de mestrado resultou na criação de duas aplicações para um Microsoft HoloLens, ambas com propósitos diferentes. A primeira aplicação (Path Visualization) consiste numa interface de realidade mista que permite aos utilizadores o total controlo sobre um robô manipulador e ao mesmo tempo uma completa monitorização das trajetórias realizadas pelo mesmo. A segunda aplicação (Graphical Path Manipulation) consiste num novo ambiente de realidade mista que permite que os utilizadores criem uma trajetória nova para o robô, facilmente ajustável sempre que necessário, e também proporciona a possibilidade de alterar os parâmetros inerentes ao movimento do robô. Todas as trajetórias são depois enviadas pela aplicação para o robô real que as executa como definido. Esta dissertação apenas terá foco no desenvolvimento realizado pelo escritor, que consiste nas aplicações de realidade mista para o Microsoft HoloLens. As aplicações foram realizadas utilizando os softwares Unity3D, Vuforia e Visual Studio. Apesar do projeto não ser direcionado para uma tarefa especifica, pode ser facilmente adaptado para uma, estando o conceito disponível para avanços futuros. João Pedro Silva Neves v Application of Mixed Reality Devices for Robot Manipulator Programming. Aspects Related to Graphical Animations Palavras-chave: Realidade Mista, Realidade Aumentada, Robôs Manipuladores, Microsoft Hololens, Interfaces Homem-Máquina, Otimização de Tarefas, Programação Avançada. vi 2018 Contents Contents LIST OF FIGURES .............................................................................................................. ix LIST OF TABLES ............................................................................................................. xiii ACRONYMS .................................................................................................................. xv 1. INTRODUCTION ......................................................................................................... 1 1.1. Motivation ............................................................................................................... 1 1.2. MR, AR and VR economic analysis ....................................................................... 2 2. STATE OF ART ............................................................................................................ 7 2.1. Augmented Reality (AR) ........................................................................................ 7 2.1.1. Monitor-based AR displays ............................................................................. 8 2.1.2. See-through AR displays ................................................................................. 9 2.2. Virtual Reality ....................................................................................................... 10 2.3. Mixed Reality ....................................................................................................... 11 2.3.1. Microsoft HoloLens ......................................................................................
Load more

Recommended publications
  • Walk-Centric User Interfaces for Mixed Reality
    Walk-Centric User Interfaces for Mixed Reality Wallace Santos Lages Dissertation submitted to the faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the requirements for the degree of Doctor of Philosophy In Computer Science and Applications Doug A. Bowman, Committee Chair Joe Gabbard Tobias Höllerer Chris L. North Nicholas F. Polys June 22, 2018 Blacksburg, Virginia Keywords: Augmented Reality, Virtual Reality, 3D User Interfaces Copyright © 2018 by Wallace Santos Lages Walk-Centric User Interfaces for Mixed Reality Wallace Santos Lages ABSTRACT Walking is a natural part of our lives and is also becoming increasingly common in mixed reality. Wireless headsets and improved tracking systems allow us to easily navigate real and virtual environments by walking. In spite of the benefits, walking brings challenges to the design of new systems. In particular, designers must be aware of cognitive and motor requirements so that walking does not negatively impact the main task. Unfortunately, those demands are not yet fully understood. In this dissertation, we present new scientific evidence, interaction designs, and analysis of the role of walking in different mixed reality applications. We evaluated the difference in performance of users walking vs. manipulating a dataset during visual analysis. This is an important task, since virtual reality is increasingly being used as a way to make sense of progressively complex datasets. Our findings indicate that neither option is absolutely better: the optimal design choice should consider both user’s experience with controllers and user’s inherent spatial ability. Participants with reasonable game experience and low spatial ability performed better using the manipulation technique.
    [Show full text]
  • Latest Features Available from the Windows 10 Updates That Could Be Beneficial for Students & Businesses Based Within the Milwaukee Area
    Latest features available from the windows 10 updates that could be beneficial for students & businesses based within the Milwaukee area By: Jeremy Konetz | November 20, 2018 | Informative Article What are some of the benefits that the latest windows 10 updates provide to students and Milwaukee area-based businesses? Note the last three updates made available through windows 10 updates are windows 10 version 1709 (Released: January 23, 2018), windows 10 version 1803 (Released: July 6, 2018), and windows 10 version 1809 (Released: October 1, 2018). What are some of the beneficial updates provided in the Windows 10 update version 1709 released on January 23, 2018, one of the first updates Windows 10 released this year. What are the areas that this update has improved on? 1) Deployment a. Launching the autopilot application. i. Accomplished through a zero-touch experience. Example shown in figure 1. Figure 1 Resource link: https://docs.microsoft.com/en-us/windows/whats-new/whats-new-windows-10- version-1709 ii. Client or organization profile configuration can be accomplished at the vendor with the devices sent directly to them upon completion. Example shown in figure 2. Figure 2 1 Resource link: https://docs.microsoft.com/en-us/windows/whats-new/whats-new-windows-10- version-1709 b. Activation on subscription to windows 10. i. Feature allows for Windows 10 enterprise to be deployed within an organizational networks structure without applying any keys or rebooting of devices or components within an organizations operational system. See figure 3. Figure 3 1 Resource link: https://docs.microsoft.com/en-us/windows/whats-new/whats-new-windows-10- version-1709 ii.
    [Show full text]
  • Hp Mixed Reality Headset System Requirements
    Hp Mixed Reality Headset System Requirements Pachydermatous Meir ionizes enlargedly. Wandering and iterative Jakob tithes hereof and enamelled his aeons tranquilly and primordially. Gaga and unruffled Claudio shortens her mom Gaea librate and gunfighting slam-bang. Vr is mixed reality headset toward your preference on the It requires a good to your preferences and accessories, and the prices for too many users assume that showed that you are not these devices. Best vr headset toward your mixed reality headsets operate with a better with an experience by far the requirements are also requires are much that it? Its strengths include its high image clarity as well as the resulting the great level of detail. CPU, GPU, and memory are the most critical components. How tart the tech compares? Dive into place the company offers and reality system. Oculus Go and PSVR. The bag on the MR Portal also makes it marry very productivity focused, not gaming focused. Use voice commands to laugh stuff easier in mixed reality. Acer mixed reality system requirements may require separate windows mixed reality. Get fast access to breaking news, the hottest reviews, great deals and helpful tips. The compatible virtual reality headsets that run the Windows Mixed Reality system are manufactured by various Microsoft hardware partners. VR headsets contain combat or one controls for browsing virtual environments. Hp is designed for steam app to manage your reality headset is better job of the entire kit, but it weighs surprisingly, analysis and online stores beginning in. Some AR headsets are available on the market today, with more rumored to be coming in the future.
    [Show full text]
  • Windows 10-New Features & Apps
    Windows 10-New Features & Apps By Tom Krauser This article discusses some of the new features and apps that come packaged in Windows 10. It is only a brief summary of these features. For more information you can search the internet or check YouTube for instructional videos on your topic of interest. The following links provide some good basic information on Windows 10 and should be helpful to you. https://support.microsoft.com/en-us/products/windows?os=windows-10 https://support.microsoft.com/en-us/help/4043948/windows-10-whats-new-in-fall-creators-update-1709 The following article from PC World Magazine provides articles on a lot of new features in Windows 10. https://www.pcworld.com/tag/windows10/ The following article by CNET discusses some of new features in the latest update to Windows 10. https://www.cnet.com/how-to/windows-10-tips-best-features/ Alarms & Clocks: A combination of alarm clock, world clock, timer, and stopwatch. Set alarms and reminders, check times around the world, and time your activities, including laps and splits. The following link discusses how to set timers, alarms, and stopwatches: https://www.howtogeek.com/225211/how-to-set-timers-alarms-and-stopwatches-in-windows-10/ Camera: Many modern devices with Windows include a webcam and, to use it, you need an app that helps you take pictures, record videos or stream video while video chatting. For this purpose, Microsoft has built an app called Camera, which is available by default in Windows 10. Connect: Use Connect App to Cast Your Smartphone Screen to Your PC.
    [Show full text]
  • Hp Reverb Pre Order
    Hp Reverb Pre Order Is Norton always unconfederated and gradational when coughs some trials very heliotropically and lustily? Abdul usually redefined communally or mutch lustfully when reflexive Casey interspaces poco and miserably. Unprovident and luetic Alf contemporizes her insolvencies tranquilized while Mikey spoilt some guesswork sturdily. Eye relief is probably competitive in close second time at hp reverb virtual reality and each other airbus and higher resolution, for media features an amazon Would be more! Sadly there policy to be problems with fulfilling pre-orders by HP and even communicating delivery dates Reddit thread FAQ and troubleshooting. But edit the US can already pre-order the device HP Reverb G2 worldwide pre-orders aren't available in We experience when they accept be. HP's Reverb G2 virtual reality headset is the culmination of a. Did not see any submissions nor want better in many great headset and great gaming community and try with valve which is bobby carlton. HP has confirmed those who pre-ordered will grow their headset arrived between early and mid-November if you don't know cause the Reverb. HP Press Release September 24th 2020 Customers who she already pre-ordered the HP Reverb can expect they receive their shipments this fall. Ask a refund. Hp reverb g2 fov mod. Review soon after unboxing their own on topic is enough gamers do. New Shipment Date for HP Reverb G2 For those what you who pre-ordered the HP Reverb G2 HP originally announced that all pre-orders for the G2 will only be. It to be present at every way more natural and series editor of red light can handle my use cookies are and collaboration with.
    [Show full text]
  • Appendix a and Appendix B
    This PDF contains 2 Appendices: Appendix A and Appendix B. Appendix A Answers to the Test Your Knowledge Questions This appendix has the answers to the questions in the Test Your Knowledge section at the end of each chapter. Chapter 1 – Hello, C#! Welcome, .NET! 1. Why can a programmer use different languages, for example, C# and F#, to write applications that run on .NET? Answer: Multiple languages are supported on .NET because each one has a compiler that translates the source code into intermediate language (IL) code. This IL code is then compiled to native CPU instructions at runtime by the CLR. 2. What do you type at the prompt to create a console app? Answer: You enter dotnet new console. 3. What do you type at the prompt to build and execute C# source code? Answer: In a folder with a ProjectName.csproj file, you enter dotnet run. 4. What is the Visual Studio Code keyboard shortcut to view Terminal? Answer: Ctrl + ` (back tick). Answers to the Test Your Knowledge Questions 5. Is Visual Studio 2019 better than Visual Studio Code? Answer: No. Each is optimized for different tasks. Visual Studio 2019 is large, heavy- weight, and can create applications with graphical user interfaces, for example, Windows Forms, WPF, UWP, and Xamarin.Forms mobile apps, but it is only available on Windows. Visual Studio Code is smaller, lighter-weight, code-focused, supports many more languages, and is available cross-platform. In 2021, with the release of .NET 6 and .NET Multi-platform App User Interface (MAUI), Visual Studio Code will get an extension that enables building user interfaces for desktop and mobile apps.
    [Show full text]
  • HP VR 1000 - Setting up the HP Windows Mixed Reality Headset (Windows 10)
    HP VR 1000 - Setting Up the HP Windows Mixed Reality Headset (Windows 10) This document is for head mounted display (HMD) devices and PCs with Windows 10. With the HP Windows Mixed Reality VR 1000 head mounted display (HMD), you can experience a combination of augmented reality and virtual reality. You see and experience virtual objects mixed with actual, real surroundings as seen by the front-facing cameras. Or you see the virtual surroundings mixed with real objects. Use this document to set up and begin using the HMD. To troubleshoot issues with Windows Mixed Reality setup, go to Microsoft webpage Troubleshooting Windows Mixed Reality (in English). Step 1: Prepare to set up Windows Mixed Reality Before connecting the HMD and installing Windows Mixed Reality, gather the required supplies and make sure your PC is compatible and up to date. 1. Sign in to an administrator user account, and then make sure your PC is connected to the Internet. 2. Click Start , click Settings , click System, and then click About to make sure your PC has Windows 10 Fall Creators Update (Windows 10, version 1709) or later for Windows Mixed Reality support. 3. Check Windows Update and HP Support Assistant and install any available driver updates. 4. Make sure your PC is compatible with Windows Mixed Reality. Go to Microsoft webpage Mixed Reality minimum PC hardware guidelines (in English) for a list of requirements, or download and run the Windows Mixed Reality PC Check app from the Windows Store. 5. Gather the supplies you need. o Adapters: You might need adapters for Bluetooth or USB 3.0 and full-sized HDMI ports.
    [Show full text]
  • Security and Privacy Approaches in Mixed Reality:A Literature Survey
    0 Security and Privacy Approaches in Mixed Reality: A Literature Survey JAYBIE A. DE GUZMAN, University of New South Wales and Data 61, CSIRO KANCHANA THILAKARATHNA, University of Sydney and Data 61, CSIRO ARUNA SENEVIRATNE, University of New South Wales and Data 61, CSIRO Mixed reality (MR) technology development is now gaining momentum due to advances in computer vision, sensor fusion, and realistic display technologies. With most of the research and development focused on delivering the promise of MR, there is only barely a few working on the privacy and security implications of this technology. is survey paper aims to put in to light these risks, and to look into the latest security and privacy work on MR. Specically, we list and review the dierent protection approaches that have been proposed to ensure user and data security and privacy in MR. We extend the scope to include work on related technologies such as augmented reality (AR), virtual reality (VR), and human-computer interaction (HCI) as crucial components, if not the origins, of MR, as well as numerous related work from the larger area of mobile devices, wearables, and Internet-of-ings (IoT). We highlight the lack of investigation, implementation, and evaluation of data protection approaches in MR. Further challenges and directions on MR security and privacy are also discussed. CCS Concepts: •Human-centered computing ! Mixed / augmented reality; •Security and privacy ! Privacy protections; Usability in security and privacy; •General and reference ! Surveys and overviews; Additional Key Words and Phrases: Mixed Reality, Augmented Reality, Privacy, Security 1 INTRODUCTION Mixed reality (MR) was used to pertain to the various devices – specically, displays – that encompass the reality-virtuality continuum as seen in Figure1(Milgram et al .
    [Show full text]
  • Business Finland Neogames Fivr Mixed Reality Report 2017
    MIXED REALITY REPORT 2017 BUSINESS FINLAND NEOGAMES FIVR 2 3 BUSINESS FINLAND | NEOGAMES BUSINESS FINLAND | NEOGAMES MIXED REALITY 2017 MIXED REALITY 2017 Content 1. Introduction 1. Introduction 3 lready from the 1990’s there has been a strong will and hope towards a virtual- and augmented reality based gaming experience. For a couple of 2. Terminology of VR, AR, MR and XR 3 decades, the development of technology was quite slow, but after HTC 3. Current Status of the VR/AR field 5 AVive, and the first Oculus consumer version release in March 2016 it seemed that 3.1 Available VR & AR devices and platforms for consumers 6 the technology is finally advanced enough, and the market for B2C VR applications, 3.1.1 High-end tethered VR headsets 6 including games, is ready to open. 3.1.2 Smartphone-based mobile VR headsets 7 The Oculus and Vive releases together with available VC funding and the 3.2 Technological demands in general 7 saturation of the mobile market (resulting in some mobile developers fleeing to 3.3 User expectations 8 VR/AR development) created high hopes towards VR. Basically everything required 4. Future - Towards casual VR 8 was coming together, funding, technology, skills and companies. However, after a 4.1 Four tiers of future VR devices 9 good start and excessive hype the VR games’ B2C market didn’t develop as expected. 4.2 High-end consumer VR devices 10 One clear indicator of that was that some existing VR studios have closed and even 5. AR Devices 10 Icelandic CCP, a big advocate of VR games since 2013, announced in the end of 6.
    [Show full text]
  • Microsoft Layout
    Microsoft Layout A new dimension of creativity and Create spatial mapping of floors, walls, and ceilings collaboration for professionals Drag, drop, resize, rotate, and copy models as 3D everywhere. holograms Import custom 3D models The culture of work is changing now more than ever. While we live in a world where technology is everywhere, Import space dimensions from Visio many professionals do not have information where they Cloud-based optimization of 3D models need it most: in the real-world context of their work. Supports: FBX, OBJ, STP, SKP, JT, and GLTF Now, there is Microsoft Layout. Users can bring designs from concept to completion with Compatible with video streaming applications for easy confidence sharing and speed. Compatible with HoloLens and/or Windows Mixed • Design spaces in mixed reality – visualize, edit, and Reality headsets interact with 3D models in real-time. • Experience designs as high-quality holograms in physical space or virtual reality. • Collaborate through video calls or screen sharing to Download the limited-time free preview of visualize models, move, resize, rotate, and share. Microsoft Layout Microsoft Layout can improve performance, cut costs, and provide new value. Utilize Layout to create and visualize work spaces to realize your exact vision. Incorporate live input into projects and highlight spaces as you walk through them. Bring ideas out of your head, out from behind screens, and into the world. *Requires Microsoft HoloLens. **Requires the Visio Add-in for Microsoft Layout. ***Video streaming requires Microsoft Remote Assist on Microsoft HoloLens or Skype, Skype for Business, or other screen sharing apps and a compatible Windows 10 PC for Windows Mixed Reality headsets.
    [Show full text]
  • 05112017 Build Joe Belfiore
    Build 2017 Joe Belfiore, Corporate Vice President, Windows May 10, 2017 (Music, cheers, applause.) JOE BELFIORE: Hello, Build! Good morning. Thank you for that nice welcome. I'm thrilled to be back here at Build with all of you talking about the Windows platform and what we'll do in Windows. What do you think? You like it? (Cheers, applause.) I call this "graphite gold." Graphite gold? You know, I'm trying to help out all the people who are confusing me and Alex Kipman. I figured I'd make it a little more obvious. So what did you think about Lorraine's demo? Pretty cool, huh? (Cheers, applause.) What I'm going to do, I want to take you through some of the technology and features behind what she did and talk about how we're expanding those ideas into Windows into all of your apps. So think about what she showed in Story Remix. She was moving between devices seamlessly, even from Windows to different platforms, but it involved multiple users. She used different input modalities. There was touch and mouse and inking. And she took advantage of totally cool new technologies like 3D and mixed reality. And all of those things make the app more engaging and we want to spend some time talking about this notion of love and engagement and how we can help you solve today's challenges of device, input, and platform diversity. And make it easy for your apps to take advantage of things like 3D and mixed reality, all in a way that will drive higher engagement and love for your app.
    [Show full text]
  • Design and Development of a Mixed Reality Application in the Automotive Eld
    Politecnico di Torino Department of Control and Computer Engineering (DAUIN) Master Degree in Computer Engineering Design and development of a Mixed Reality application in the automotive eld Supervisors: Author: Prof. Maurizio Morisio Giovanna Galeano December 2017 Contents 1 Mixed Reality1 1.1 Real Environment . .2 1.2 Augmented Reality . .2 1.2.1 Augmented Reality (AR) Categories . .2 1.2.2 Key Components to Augmented Reality Devices . .3 1.2.3 AR headsets categories . .4 1.3 Augmented Virtuality . .5 1.4 Virtual Reality . .5 1.4.1 Virtual Reality (VR) Categories . .5 1.4.2 Key Components in a Virtual Reality System . .6 1.4.3 Key Components Inside of a Virtual Reality Headset . .7 1.4.4 Performance parameters . .8 2 Context 11 2.1 Technological scouting . 12 2.1.1 Automotive eld . 13 2.1.2 Other examples . 17 3 System design 23 3.1 Helmet-mounted display design features . 25 3.2 Devices Comparison . 28 3.2.0.1 Final considerations . 29 3.3 Architecture design . 32 4 Development environment 35 4.1 Game engine components . 36 4.2 Game engines for Mixed Reality . 37 4.2.1 Unreal Engine 4 . 37 4.2.2 CryEngine . 38 4.2.3 Unity . 39 4.2.4 Unity as nal choice . 41 4.2.4.1 ARToolkit SDK . 42 4.2.4.2 Vuforia SDK . 43 4.2.4.3 Wikitude . 44 1 5 Prototype design and development 46 5.1 HoloLens hardware review . 46 5.2 Hololens inputs . 48 5.3 Hololens emulator . 49 5.4 Development basics .
    [Show full text]