DOCSLIB.ORG

A Mixed Reality Dashboard Based on a Distributed Data Streaming Architecture

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
A Mixed Reality Dashboard Based on a Distributed Data Streaming Architecture NATIONAL AND KAPODISTRIAN UNIVERSITY OF ATHENS SCHOOL OF SCIENCE DEPARTMENT OF INFORMATICS AND TELECOMMUNICATIONS MASTER OF SCIENCE "Computing Systems: Software and Hardware" M.Sc. THESIS A Mixed Reality Dashboard based on a distributed data streaming architecture Deligiannakis N. Nektarios Supervisor: Stathes P. Hadjiefthymiades, Professor ATHENS FEBRUARY 2020 ΕΘΝΙΚΟ ΚΑΙ ΚΑΠΟΔΙΣΤΡΙΑΚΟ ΠΑΝΕΠΙΣΤΗΜΙΟ ΑΘΗΝΩΝ ΣΧΟΛΗ ΘΕΤΙΚΩΝ ΕΠΙΣΤΗΜΩΝ ΤΜΗΜΑ ΠΛΗΡΟΦΟΡΙΚΗΣ ΚΑΙ ΤΗΛΕΠΙΚΟΙΝΩΝΙΩΝ ΠΡΟΓΡΑΜΜΑ ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ "Υπολογιστικά Συστήματα: Λογισμικό και Υλικό" ΔΙΠΛΩΜΑΤΙΚΗ ΕΡΓΑΣΙΑ Γραφικό Περιβάλλον Μεικτής Πραγματικότητας βασισμένο σε μια κατανεμημένη αρχιτεκτονική μεταφοράς ροών δεδομένων Δεληγιαννάκης Ν. Νεκτάριος Επιβλέπων: Ευστάθιος Χατζηευθυμιάδης, Καθηγητής ΑΘΗΝΑ ΦΕΒΡΟΥΑΡΙΟΣ 2020 M.Sc. Thesis A Mixed Reality Dashboard based on a distributed data streaming architecture Deligiannakis N. Nektarios S.N.: Μ1604 Supervisor: Stathes P. Hadjiefthymiades, Professor February 2020 ΔΙΠΛΩΜΑΤΙΚΗ ΕΡΓΑΣΙΑ Γραφικό Περιβάλλον Μεικτής Πραγματικότητας βασισμένο σε μια κατανεμημένη αρχιτεκτονική μεταφοράς ροών δεδομένων ΔΕΛΗΓΙΑΝΝΑΚΗΣ Ν. ΝΕΚΤΑΡΙΟΣ Α.Μ.: M1604 ΕΠΙΒΛΕΠΟΝΤΕΣ: Ευστάθιος Π. Χατζηευθυμιάδης, Καθηγητής ΦΕΒΡΟΥΑΡΙΟΣ 2020 ABSTRACT As computer science grows and evolves, new technologies come to surface. One of these is called Augmented Reality. New devices and gadgets start to hit the market from many companies like Microsoft with the HoloLens device. Data visualization is very important using mixed reality to make large data sets easier to navigate and understand and is the going to be a requirement for many proposals in the future. However, the creation of applications for these devices is yet a very difficult and peculiar job due to the high cost of the devices and the small developer community that insists on working with Augmented Reality or Mixed Reality applications. We present a Mixed Reality Dashboard that demonstrates functionalities that can be used to monitor and visualize data from sensors, UxVs or any other device. The scenario for applications is the visualization of sensor data and video feed from UxVs, but we also show the extensibility of the current application. Data visualization is very important using mixed reality to make large data sets easier to navigate and understand and is the going to be a requirement for many different and various use cases in many scientific fields and applications. The application consists of a User Interface, interactable with air taps and gestures, that visualizes data from a network. The API for receiving data is Apache Kafka and Zookeeper, a distributed streaming platform. Three main functionalities are presented in the UI, dynamic data graphs, video feeds and the reception of messages and status monitoring for the user and the device. The UI, receives data received from the internet with use of Kafka Rest Proxy that is a RESTful proxy built in Kafka platform. SUBJECT AREA: Mixed Reality Applications with the HoloLens device KEYWORDS: augmented reality, mixed reality, data visualization, HoloLens, data graph, REST, Apache Kafka, REST Proxy ΠΕΡΙΛΗΨΗ Καθώς οι επιστήμες των ηλεκτρονικών υπολογιστών και της πληροφορίας αναπτύσσονται και εξελίσσονται, νέες τεχνολογίες έρχονται στην επιφάνεια. Μία από αυτές είναι η τεχνολογία της Επαυξημένης Πραγματικότητας (Augmented Reality, AR). Οι νέες συσκευές αρχίζουν να προσφέρονται εμπορικά από πολλές εταιρείες όπως η Microsoft με τη συσκευή Μεικτής Πραγματικότητας (Mixed Reality, MR) HoloLens. Η απεικόνιση των δεδομένων είναι πολύ σημαντική, χρησιμοποιώντας τη μεικτή πραγματικότητα, για να διευκολύνουμε την πλοήγηση και την κατανόηση μεγάλων συνόλων δεδομένων και πρόκειται να αποτελέσει προϋπόθεση για πολλές τεχνολογικές προτάσεις στο μέλλον. Ωστόσο, η δημιουργία εφαρμογών για αυτές τις συσκευές είναι μια πολύ δύσκολη και ιδιόμορφη δουλειά λόγω του υψηλού κόστους των συσκευών και της μικρής κοινότητας προγραμματιστών που επιμένει στην εργασία με τις εφαρμογές Augmented Reality ή Mixed Reality. Στην παρούσα εργασία, αναπτύχθηκε και παρουσιάζεται ένα γραφικό περιβάλλον οπτικοποίησης ροών δεδομένων πολλαπλών τύπων. Η εργασία παρουσιάζει λειτουργίες που μπορούν να χρησιμοποιηθούν για την παρακολούθηση και την απεικόνιση δεδομένων από αισθητήρες, αισθητήρες μη επανδρωμένων οχημάτων (Unmanned Vehicles, UxVs) ή οποιαδήποτε άλλη συσκευή. Το σενάριο για εφαρμογές είναι η απεικόνιση δεδομένων αισθητήρων και ροής βίντεο από UxVs. Παράλληλα δείχνουμε την επεκτασιμότητα της τρέχουσας εφαρμογής. Η οπτικοποίηση των δεδομένων είναι πολύ σημαντική, χρησιμοποιώντας τη μεικτή πραγματικότητα, για να διευκολύνετε την πλοήγηση και την κατανόηση των μεγάλων συνόλων δεδομένων και αρχίζει να γίνεται επιτακτική ανάγκη σε πληθώρα επιστημονικών πεδίων και εφαρμογών. Η εφαρμογή αποτελείται από μια γραφική διεπαφή χρήστη, η οποία μπορεί να αλληλεπιδράσει με συγκεκριμένες χειρονομίες (gestures), και απεικονίζει δεδομένα προερχόμενα από ένα κατανεμημένο δίκτυο αισθητήρων. Χρησιμοποιήθηκε η πλατφόρμα Apache Kafka και Zookeeper για τη λήψη και επεξεργασία των ροών δεδομένων, μια κατανεμημένη πλατφόρμα ροής δεδομένων. Τρεις βασικές λειτουργίες παρουσιάζονται στο περιβάλλον: (i) τα δυναμικά γραφήματα δεδομένων, (ii) οι ροές βίντεο, (iii) η λήψη μηνυμάτων και η παρακολούθηση της κατάστασης για τον χρήστη και τη συσκευή. Η γραφική διεπαφή χρήστη, λαμβάνει δεδομένα που λαμβάνονται από το διαδίκτυο με τη χρήση του Kafka Rest Proxy το οποίο αποτελεί τμήμα της πλατφόρμας που υποστηρίζει RESTful κλήσεις δεδομένων. ΘΕΜΑΤΙΚΗ ΠΕΡΙΟΧΗ: Εφαρμογές στην Ενδιάμεση Πραγματικότητα με τη συσκευή HololLens ΛΕΞΕΙΣ ΚΛΕΙΔΙΑ: επαυξημένη πραγματικότητα, μεικτή πραγματικότητα, οπτικοποίηση δεδομένων, συσκευή HoloLens, middleware, γράφημα δεδομένων, REST, Apache Kafka REST Proxy Αφιερώνεται στον άνθρωπό μου, που χρειάστηκε να με υποστεί στην περάτωση και ολοκλήρωση αυτής της μεταπτυχιακής εργασίας. ΕΥΧΑΡΙΣΤΙΕΣ Ευχαριστίες πολλές απευθύνουμε στον επιβλέποντα και επιστημονικό υπεύθυνο της συγκεκριμένης εργασίας αλλά και επιστημονικού υπευθύνου της ερευνητικής ομάδας Διάχυτου Υπολογισμού του ΕΚΠΑ (Pervasive Computing Research Group), κ. Ευστάθιο Χατζηευθυμιάδη. Θερμές ευχαριστίες σε όλα τα μέλη της ερευνητικής ομάδας Διάχυτου Υπολογισμού αλλά ιδιαιτέρως στα μέλη Παπαταξιάρχη Βασίλη, Κωστή Γεράκο και Ζαμπούρα Δημήτρη για τη βοήθειά τους και τις συμβουλές τους σε τεχνικά και μη θέματα που αφορούσαν την παρούσα εργασία. CONTENTS ABSTRACT .............................................................................................................................................. 5 ΠΕΡΙΛΗΨΗ ............................................................................................................................................... 6 CONTENTS .............................................................................................................................................. 9 LIST OF IMAGES ................................................................................................................................ 11 PROLOGUE .......................................................................................................................................... 12 1 INTRODUCTION ......................................................................................................................... 13 2 STATE OF THE ART ................................................................................................................. 14 2.1 Introduction .................................................................................................................................... 14 2.2 Virtual Reality ................................................................................................................................. 14 2.3 Augmented Reality ......................................................................................................................... 15 2.4 Mixed Reality .................................................................................................................................. 16 2.5 Differences between Virtual Reality, Augmented Reality and Mixed Reality ........................... 16 3 TOOLS FOR THIS APPLICATION ....................................................................................... 18 3.1 Unity Editor 2018 LTS and 2019 ................................................................................................... 18 3.2 Mixed Reality Toolkit ..................................................................................................................... 18 3.3 Visual Studio .................................................................................................................................. 19 3.4 .NET Framework 4.5 - 4.6 in C# ..................................................................................................... 20 3.5 Python for Kafka consumers ........................................................................................................ 20 4. MIXED REALITY FEATURES .................................................................................................... 21 4.1 Holograms....................................................................................................................................... 21 4.2 Spatial Mapping and Anchors....................................................................................................... 22 4.3 Gaze ................................................................................................................................................
Load more

Recommended publications
  • Walk-Centric User Interfaces for Mixed Reality
    Walk-Centric User Interfaces for Mixed Reality Wallace Santos Lages Dissertation submitted to the faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the requirements for the degree of Doctor of Philosophy In Computer Science and Applications Doug A. Bowman, Committee Chair Joe Gabbard Tobias Höllerer Chris L. North Nicholas F. Polys June 22, 2018 Blacksburg, Virginia Keywords: Augmented Reality, Virtual Reality, 3D User Interfaces Copyright © 2018 by Wallace Santos Lages Walk-Centric User Interfaces for Mixed Reality Wallace Santos Lages ABSTRACT Walking is a natural part of our lives and is also becoming increasingly common in mixed reality. Wireless headsets and improved tracking systems allow us to easily navigate real and virtual environments by walking. In spite of the benefits, walking brings challenges to the design of new systems. In particular, designers must be aware of cognitive and motor requirements so that walking does not negatively impact the main task. Unfortunately, those demands are not yet fully understood. In this dissertation, we present new scientific evidence, interaction designs, and analysis of the role of walking in different mixed reality applications. We evaluated the difference in performance of users walking vs. manipulating a dataset during visual analysis. This is an important task, since virtual reality is increasingly being used as a way to make sense of progressively complex datasets. Our findings indicate that neither option is absolutely better: the optimal design choice should consider both user’s experience with controllers and user’s inherent spatial ability. Participants with reasonable game experience and low spatial ability performed better using the manipulation technique.
    [Show full text]
  • Latest Features Available from the Windows 10 Updates That Could Be Beneficial for Students & Businesses Based Within the Milwaukee Area
    Latest features available from the windows 10 updates that could be beneficial for students & businesses based within the Milwaukee area By: Jeremy Konetz | November 20, 2018 | Informative Article What are some of the benefits that the latest windows 10 updates provide to students and Milwaukee area-based businesses? Note the last three updates made available through windows 10 updates are windows 10 version 1709 (Released: January 23, 2018), windows 10 version 1803 (Released: July 6, 2018), and windows 10 version 1809 (Released: October 1, 2018). What are some of the beneficial updates provided in the Windows 10 update version 1709 released on January 23, 2018, one of the first updates Windows 10 released this year. What are the areas that this update has improved on? 1) Deployment a. Launching the autopilot application. i. Accomplished through a zero-touch experience. Example shown in figure 1. Figure 1 Resource link: https://docs.microsoft.com/en-us/windows/whats-new/whats-new-windows-10- version-1709 ii. Client or organization profile configuration can be accomplished at the vendor with the devices sent directly to them upon completion. Example shown in figure 2. Figure 2 1 Resource link: https://docs.microsoft.com/en-us/windows/whats-new/whats-new-windows-10- version-1709 b. Activation on subscription to windows 10. i. Feature allows for Windows 10 enterprise to be deployed within an organizational networks structure without applying any keys or rebooting of devices or components within an organizations operational system. See figure 3. Figure 3 1 Resource link: https://docs.microsoft.com/en-us/windows/whats-new/whats-new-windows-10- version-1709 ii.
    [Show full text]
  • Hp Mixed Reality Headset System Requirements
    Hp Mixed Reality Headset System Requirements Pachydermatous Meir ionizes enlargedly. Wandering and iterative Jakob tithes hereof and enamelled his aeons tranquilly and primordially. Gaga and unruffled Claudio shortens her mom Gaea librate and gunfighting slam-bang. Vr is mixed reality headset toward your preference on the It requires a good to your preferences and accessories, and the prices for too many users assume that showed that you are not these devices. Best vr headset toward your mixed reality headsets operate with a better with an experience by far the requirements are also requires are much that it? Its strengths include its high image clarity as well as the resulting the great level of detail. CPU, GPU, and memory are the most critical components. How tart the tech compares? Dive into place the company offers and reality system. Oculus Go and PSVR. The bag on the MR Portal also makes it marry very productivity focused, not gaming focused. Use voice commands to laugh stuff easier in mixed reality. Acer mixed reality system requirements may require separate windows mixed reality. Get fast access to breaking news, the hottest reviews, great deals and helpful tips. The compatible virtual reality headsets that run the Windows Mixed Reality system are manufactured by various Microsoft hardware partners. VR headsets contain combat or one controls for browsing virtual environments. Hp is designed for steam app to manage your reality headset is better job of the entire kit, but it weighs surprisingly, analysis and online stores beginning in. Some AR headsets are available on the market today, with more rumored to be coming in the future.
    [Show full text]
  • Windows 10-New Features & Apps
    Windows 10-New Features & Apps By Tom Krauser This article discusses some of the new features and apps that come packaged in Windows 10. It is only a brief summary of these features. For more information you can search the internet or check YouTube for instructional videos on your topic of interest. The following links provide some good basic information on Windows 10 and should be helpful to you. https://support.microsoft.com/en-us/products/windows?os=windows-10 https://support.microsoft.com/en-us/help/4043948/windows-10-whats-new-in-fall-creators-update-1709 The following article from PC World Magazine provides articles on a lot of new features in Windows 10. https://www.pcworld.com/tag/windows10/ The following article by CNET discusses some of new features in the latest update to Windows 10. https://www.cnet.com/how-to/windows-10-tips-best-features/ Alarms & Clocks: A combination of alarm clock, world clock, timer, and stopwatch. Set alarms and reminders, check times around the world, and time your activities, including laps and splits. The following link discusses how to set timers, alarms, and stopwatches: https://www.howtogeek.com/225211/how-to-set-timers-alarms-and-stopwatches-in-windows-10/ Camera: Many modern devices with Windows include a webcam and, to use it, you need an app that helps you take pictures, record videos or stream video while video chatting. For this purpose, Microsoft has built an app called Camera, which is available by default in Windows 10. Connect: Use Connect App to Cast Your Smartphone Screen to Your PC.
    [Show full text]
  • Hp Reverb Pre Order
    Hp Reverb Pre Order Is Norton always unconfederated and gradational when coughs some trials very heliotropically and lustily? Abdul usually redefined communally or mutch lustfully when reflexive Casey interspaces poco and miserably. Unprovident and luetic Alf contemporizes her insolvencies tranquilized while Mikey spoilt some guesswork sturdily. Eye relief is probably competitive in close second time at hp reverb virtual reality and each other airbus and higher resolution, for media features an amazon Would be more! Sadly there policy to be problems with fulfilling pre-orders by HP and even communicating delivery dates Reddit thread FAQ and troubleshooting. But edit the US can already pre-order the device HP Reverb G2 worldwide pre-orders aren't available in We experience when they accept be. HP's Reverb G2 virtual reality headset is the culmination of a. Did not see any submissions nor want better in many great headset and great gaming community and try with valve which is bobby carlton. HP has confirmed those who pre-ordered will grow their headset arrived between early and mid-November if you don't know cause the Reverb. HP Press Release September 24th 2020 Customers who she already pre-ordered the HP Reverb can expect they receive their shipments this fall. Ask a refund. Hp reverb g2 fov mod. Review soon after unboxing their own on topic is enough gamers do. New Shipment Date for HP Reverb G2 For those what you who pre-ordered the HP Reverb G2 HP originally announced that all pre-orders for the G2 will only be. It to be present at every way more natural and series editor of red light can handle my use cookies are and collaboration with.
    [Show full text]
  • Appendix a and Appendix B
    This PDF contains 2 Appendices: Appendix A and Appendix B. Appendix A Answers to the Test Your Knowledge Questions This appendix has the answers to the questions in the Test Your Knowledge section at the end of each chapter. Chapter 1 – Hello, C#! Welcome, .NET! 1. Why can a programmer use different languages, for example, C# and F#, to write applications that run on .NET? Answer: Multiple languages are supported on .NET because each one has a compiler that translates the source code into intermediate language (IL) code. This IL code is then compiled to native CPU instructions at runtime by the CLR. 2. What do you type at the prompt to create a console app? Answer: You enter dotnet new console. 3. What do you type at the prompt to build and execute C# source code? Answer: In a folder with a ProjectName.csproj file, you enter dotnet run. 4. What is the Visual Studio Code keyboard shortcut to view Terminal? Answer: Ctrl + ` (back tick). Answers to the Test Your Knowledge Questions 5. Is Visual Studio 2019 better than Visual Studio Code? Answer: No. Each is optimized for different tasks. Visual Studio 2019 is large, heavy- weight, and can create applications with graphical user interfaces, for example, Windows Forms, WPF, UWP, and Xamarin.Forms mobile apps, but it is only available on Windows. Visual Studio Code is smaller, lighter-weight, code-focused, supports many more languages, and is available cross-platform. In 2021, with the release of .NET 6 and .NET Multi-platform App User Interface (MAUI), Visual Studio Code will get an extension that enables building user interfaces for desktop and mobile apps.
    [Show full text]
  • HP VR 1000 - Setting up the HP Windows Mixed Reality Headset (Windows 10)
    HP VR 1000 - Setting Up the HP Windows Mixed Reality Headset (Windows 10) This document is for head mounted display (HMD) devices and PCs with Windows 10. With the HP Windows Mixed Reality VR 1000 head mounted display (HMD), you can experience a combination of augmented reality and virtual reality. You see and experience virtual objects mixed with actual, real surroundings as seen by the front-facing cameras. Or you see the virtual surroundings mixed with real objects. Use this document to set up and begin using the HMD. To troubleshoot issues with Windows Mixed Reality setup, go to Microsoft webpage Troubleshooting Windows Mixed Reality (in English). Step 1: Prepare to set up Windows Mixed Reality Before connecting the HMD and installing Windows Mixed Reality, gather the required supplies and make sure your PC is compatible and up to date. 1. Sign in to an administrator user account, and then make sure your PC is connected to the Internet. 2. Click Start , click Settings , click System, and then click About to make sure your PC has Windows 10 Fall Creators Update (Windows 10, version 1709) or later for Windows Mixed Reality support. 3. Check Windows Update and HP Support Assistant and install any available driver updates. 4. Make sure your PC is compatible with Windows Mixed Reality. Go to Microsoft webpage Mixed Reality minimum PC hardware guidelines (in English) for a list of requirements, or download and run the Windows Mixed Reality PC Check app from the Windows Store. 5. Gather the supplies you need. o Adapters: You might need adapters for Bluetooth or USB 3.0 and full-sized HDMI ports.
    [Show full text]
  • Security and Privacy Approaches in Mixed Reality:A Literature Survey
    0 Security and Privacy Approaches in Mixed Reality: A Literature Survey JAYBIE A. DE GUZMAN, University of New South Wales and Data 61, CSIRO KANCHANA THILAKARATHNA, University of Sydney and Data 61, CSIRO ARUNA SENEVIRATNE, University of New South Wales and Data 61, CSIRO Mixed reality (MR) technology development is now gaining momentum due to advances in computer vision, sensor fusion, and realistic display technologies. With most of the research and development focused on delivering the promise of MR, there is only barely a few working on the privacy and security implications of this technology. is survey paper aims to put in to light these risks, and to look into the latest security and privacy work on MR. Specically, we list and review the dierent protection approaches that have been proposed to ensure user and data security and privacy in MR. We extend the scope to include work on related technologies such as augmented reality (AR), virtual reality (VR), and human-computer interaction (HCI) as crucial components, if not the origins, of MR, as well as numerous related work from the larger area of mobile devices, wearables, and Internet-of-ings (IoT). We highlight the lack of investigation, implementation, and evaluation of data protection approaches in MR. Further challenges and directions on MR security and privacy are also discussed. CCS Concepts: •Human-centered computing ! Mixed / augmented reality; •Security and privacy ! Privacy protections; Usability in security and privacy; •General and reference ! Surveys and overviews; Additional Key Words and Phrases: Mixed Reality, Augmented Reality, Privacy, Security 1 INTRODUCTION Mixed reality (MR) was used to pertain to the various devices – specically, displays – that encompass the reality-virtuality continuum as seen in Figure1(Milgram et al .
    [Show full text]
  • Business Finland Neogames Fivr Mixed Reality Report 2017
    MIXED REALITY REPORT 2017 BUSINESS FINLAND NEOGAMES FIVR 2 3 BUSINESS FINLAND | NEOGAMES BUSINESS FINLAND | NEOGAMES MIXED REALITY 2017 MIXED REALITY 2017 Content 1. Introduction 1. Introduction 3 lready from the 1990’s there has been a strong will and hope towards a virtual- and augmented reality based gaming experience. For a couple of 2. Terminology of VR, AR, MR and XR 3 decades, the development of technology was quite slow, but after HTC 3. Current Status of the VR/AR field 5 AVive, and the first Oculus consumer version release in March 2016 it seemed that 3.1 Available VR & AR devices and platforms for consumers 6 the technology is finally advanced enough, and the market for B2C VR applications, 3.1.1 High-end tethered VR headsets 6 including games, is ready to open. 3.1.2 Smartphone-based mobile VR headsets 7 The Oculus and Vive releases together with available VC funding and the 3.2 Technological demands in general 7 saturation of the mobile market (resulting in some mobile developers fleeing to 3.3 User expectations 8 VR/AR development) created high hopes towards VR. Basically everything required 4. Future - Towards casual VR 8 was coming together, funding, technology, skills and companies. However, after a 4.1 Four tiers of future VR devices 9 good start and excessive hype the VR games’ B2C market didn’t develop as expected. 4.2 High-end consumer VR devices 10 One clear indicator of that was that some existing VR studios have closed and even 5. AR Devices 10 Icelandic CCP, a big advocate of VR games since 2013, announced in the end of 6.
    [Show full text]
  • Microsoft Layout
    Microsoft Layout A new dimension of creativity and Create spatial mapping of floors, walls, and ceilings collaboration for professionals Drag, drop, resize, rotate, and copy models as 3D everywhere. holograms Import custom 3D models The culture of work is changing now more than ever. While we live in a world where technology is everywhere, Import space dimensions from Visio many professionals do not have information where they Cloud-based optimization of 3D models need it most: in the real-world context of their work. Supports: FBX, OBJ, STP, SKP, JT, and GLTF Now, there is Microsoft Layout. Users can bring designs from concept to completion with Compatible with video streaming applications for easy confidence sharing and speed. Compatible with HoloLens and/or Windows Mixed • Design spaces in mixed reality – visualize, edit, and Reality headsets interact with 3D models in real-time. • Experience designs as high-quality holograms in physical space or virtual reality. • Collaborate through video calls or screen sharing to Download the limited-time free preview of visualize models, move, resize, rotate, and share. Microsoft Layout Microsoft Layout can improve performance, cut costs, and provide new value. Utilize Layout to create and visualize work spaces to realize your exact vision. Incorporate live input into projects and highlight spaces as you walk through them. Bring ideas out of your head, out from behind screens, and into the world. *Requires Microsoft HoloLens. **Requires the Visio Add-in for Microsoft Layout. ***Video streaming requires Microsoft Remote Assist on Microsoft HoloLens or Skype, Skype for Business, or other screen sharing apps and a compatible Windows 10 PC for Windows Mixed Reality headsets.
    [Show full text]
  • 05112017 Build Joe Belfiore
    Build 2017 Joe Belfiore, Corporate Vice President, Windows May 10, 2017 (Music, cheers, applause.) JOE BELFIORE: Hello, Build! Good morning. Thank you for that nice welcome. I'm thrilled to be back here at Build with all of you talking about the Windows platform and what we'll do in Windows. What do you think? You like it? (Cheers, applause.) I call this "graphite gold." Graphite gold? You know, I'm trying to help out all the people who are confusing me and Alex Kipman. I figured I'd make it a little more obvious. So what did you think about Lorraine's demo? Pretty cool, huh? (Cheers, applause.) What I'm going to do, I want to take you through some of the technology and features behind what she did and talk about how we're expanding those ideas into Windows into all of your apps. So think about what she showed in Story Remix. She was moving between devices seamlessly, even from Windows to different platforms, but it involved multiple users. She used different input modalities. There was touch and mouse and inking. And she took advantage of totally cool new technologies like 3D and mixed reality. And all of those things make the app more engaging and we want to spend some time talking about this notion of love and engagement and how we can help you solve today's challenges of device, input, and platform diversity. And make it easy for your apps to take advantage of things like 3D and mixed reality, all in a way that will drive higher engagement and love for your app.
    [Show full text]
  • Design and Development of a Mixed Reality Application in the Automotive Eld
    Politecnico di Torino Department of Control and Computer Engineering (DAUIN) Master Degree in Computer Engineering Design and development of a Mixed Reality application in the automotive eld Supervisors: Author: Prof. Maurizio Morisio Giovanna Galeano December 2017 Contents 1 Mixed Reality1 1.1 Real Environment . .2 1.2 Augmented Reality . .2 1.2.1 Augmented Reality (AR) Categories . .2 1.2.2 Key Components to Augmented Reality Devices . .3 1.2.3 AR headsets categories . .4 1.3 Augmented Virtuality . .5 1.4 Virtual Reality . .5 1.4.1 Virtual Reality (VR) Categories . .5 1.4.2 Key Components in a Virtual Reality System . .6 1.4.3 Key Components Inside of a Virtual Reality Headset . .7 1.4.4 Performance parameters . .8 2 Context 11 2.1 Technological scouting . 12 2.1.1 Automotive eld . 13 2.1.2 Other examples . 17 3 System design 23 3.1 Helmet-mounted display design features . 25 3.2 Devices Comparison . 28 3.2.0.1 Final considerations . 29 3.3 Architecture design . 32 4 Development environment 35 4.1 Game engine components . 36 4.2 Game engines for Mixed Reality . 37 4.2.1 Unreal Engine 4 . 37 4.2.2 CryEngine . 38 4.2.3 Unity . 39 4.2.4 Unity as nal choice . 41 4.2.4.1 ARToolkit SDK . 42 4.2.4.2 Vuforia SDK . 43 4.2.4.3 Wikitude . 44 1 5 Prototype design and development 46 5.1 HoloLens hardware review . 46 5.2 Hololens inputs . 48 5.3 Hololens emulator . 49 5.4 Development basics .
    [Show full text]