Immersive Analysis of Hierarchical Semantic Datasets

Total Page:16

File Type:pdf, Size:1020Kb

Immersive Analysis of Hierarchical Semantic Datasets POLITECNICO DI TORINO COLLEGIO DI INGEGNERIA INFORMATICA, DEL CINEMA E MECCATRONICA Master Degree in Computer Engineering Master Degree Thesis Immersive Analysis of Hierarchical Semantic Datasets Supervisors Candidate Prof. Valentina Gatteschi Salvatore Calogero Di Cara Prof. Fabrizio Lamberti matricola: 251608 December 2019 I hereby declare that the contents and organisation of this thesis constitute my own original work and does not compromise in any way the rights of third parties, including those relating to the security of personal data. ................................... Salvatore Calogero Di Cara Turin, October 10, 2019 This work is subject to the Creative Commons Licence Sommario I recenti avanzamenti tecnologici nell’ambito della Realtà Virtuale (RV) hanno reso degli innovativi ed efficienti visori sufficientemente economici dapoter essere alla portata di un ampio pubblico. Oltre alle classiche applicazioni in RV, dedicate soprattutto all’intrattenimento e alla simulazione, gli studi in un nuovo campo di ricerca, detto Immersive Analytics, hanno evidenziato come le moderne tecnologie di visualizzazione e interazione abbiano un grande po- tenziale per creare degli utili strumenti di analisi dei dati. In quest’epoca, in cui la quantità di dati disponibili continua a crescere esponenzialmente, può essere di fondamentale importanza riuscire a estrarre informazioni utili da grandi collezioni di documenti. Inoltre, un’applicazione che rappresenti que- ste informazioni in maniera stimolante potrebbe suscitare l’interesse non solo degli esperti di dominio e degli analisti, ma anche degli utenti generici. Il pre- sente lavoro di tesi si occupa di discutere la progettazione e lo sviluppo di una piattaforma che, sfruttando le moderne tecnologie di RV, fornisca un ambien- te immersivo per la visualizzazione, l’analisi e la condivisione di dati relativi a dei documenti. In particolare, l’informazione è stata rappresentata mediante termini raggruppati in categorie semantiche. L’obiettivo è di fornire agli uten- ti un utile strumento che permetta loro di accrescere la conoscenza relativa a un certo tema e di individuarne facilmente gli argomenti principali. Le carat- teristiche fondamentali dell’applicazione realizzata includono un’accessibilità distribuita basata sul web, portabilità su diversi dispositivi, interazioni natura- li con l’ambiente virtuale, meccanismi di collaborazione asincrona e menu che permettono di modificare la categorizzazione rappresentata. Il progetto è stato condotto in collaborazione con il gruppo di ricerca DEI dell’Università Carlos III di Madrid. I membri del gruppo, in virtù della loro esperienza accumulata, hanno supervisionato il lavoro e fornito i requisiti necessari alla sua realiz- zazione. Inoltre, sono stati condotti dei test di valutazione della piattaforma, stimandone l’usabilità e mettendo in luce i vantaggi derivanti dall’utilizzarla in un ambiente immersivo, come quello offerto da un visore per la RV. Iri- sultati di tali test verranno discussi nella parte finale di questo documento. Abstract The recent improvements in Virtual Reality (VR) technologies made novel and efficient headsets cheap enough to be affordable for the wide public. Inaddi- tion to the classic VR applications, mainly with entertainment and simulation purposes, studies in the emerging research field of Immersive Analytics have highlighted the great potential of modern visualization and interaction tech- niques to create engaging data analysis tools. In this era, where the amount of available data keeps growing exponentially, it can be crucial to extract use- ful knowledge from large collections of documents. Furthermore, an appli- cation to depict such information in a stimulating way can arouse enthusi- asm not only in domain experts and data analysts but also in casual users. The present thesis work discusses the design and development of a platform which, exploiting modern VR technologies, provides an immersive environ- ment for the visualization, analysis, and sharing of document-related data. In particular, information has been represented as terms grouped into semantic categories. The goal is to provide users with an useful instrument that allows them to increase their knowledge on a certain subject and easily detect main topics. The key features of the realized application include a distributed web- based accessibility, portability on several devices, natural interactions with the virtual elements, asynchronous collaboration mechanisms, and menu in- terfaces to edit the presented categorization. The project has been conducted in collaboration with the DEI research team at University Carlos III of Madrid. The members of the team, thanks to their previous experience, supervised the work and supplied the requirements for its realization. An evaluation of the platform has also been conducted, assessing its usability and pointing out the benefits brought by using it in an immersive environment, such astheone offered by a VR headset. The results of this evaluation will be discussed inthe final part of the present document. Acknowledgements I would like to acknowledge Prof. Paloma Díaz and PhD. Teresa Onorati from University Carlos III of Madrid, who supported the development of this research. 3 Contents List of Tables 8 List of Figures 9 1 Introduction 11 1.1 Virtual Reality ........................... 11 1.1.1 Immersion and presence ................. 12 1.1.2 VR technologies overview ................ 13 1.2 Immersive Analytics ........................ 15 1.2.1 Historical Context .................... 15 1.2.2 What is Immersive Analytics? .............. 17 1.3 Motivations and goals ....................... 18 1.4 Chapters overview ......................... 19 2 State of the Art 21 2.1 Literature overview ........................ 21 2.1.1 A virtual reality visualization tool for neuron tracing ........................... 22 2.1.2 Visualization of vector field by virtual reality ..... 23 2.1.3 An immersive visualization study on molecules manipulation ....................... 23 2.1.4 Immersive and collaborative data visualization using virtual reality platforms .............. 25 2.1.5 Immersive visualization of abstract information: an evaluation on dimensionally-reduced data scatterplots ........................ 26 2.1.6 Building immersive data visualizations for the web .. 27 4 2.1.7 Immersive collaborative analysis of network connectivity: Cave-style or head-mounted display? .. 28 2.1.8 Maps and globes in virtual reality ............ 29 2.1.9 Origin-destination flow maps in immersive environments ....................... 30 2.1.10 FiberClay: sculpting three dimensional trajectories to reveal structural insights ................. 31 2.1.11 ImAxes: immersive axes as embodied affordances for interactive multivariate data visualisation ....... 32 2.1.12 3D visualization of astronomy data cubes using immersive displays .................... 33 2.1.13 A study of layout, rendering, and interaction methods for immersive graph visualization ...... 33 2.1.14 VRMiner: a tool for multimedia database mining with virtual reality ....................... 34 2.1.15 The hologram in my hand: how effective is interactive exploration of 3D visualizations in immersive tangible Augmented Reality? ........ 35 2.1.16 Multilingual semantic cyberspace of scientific papers based on WebVR technology .......... 37 2.1.17 Development of emergency drills system for petrochemical plants based on WebVR ......... 37 2.1.18 Exploring data in virtual reality: comparisons with 2D data visualizations .................... 38 2.1.19 The data in your hands: exploring novel interaction techniques and data visualization approaches for immersive data analytics ........ 39 2.2 Related Works ........................... 40 2.2.1 A taxonomy generation tool for semantic visual analysis of large corpus of documents ......... 40 2.2.2 Designing an immersive visualization for semantic datasets ..................... 41 2.3 Considerations ........................... 42 3 Requirements 51 4 Technologies 57 4.1 Software .............................. 57 5 4.1.1 Node.js ........................... 57 4.1.2 A-Frame .......................... 59 4.1.3 D3.js ............................ 63 4.1.4 WebSpeech API ...................... 63 4.1.5 Hosting .......................... 64 4.1.6 Atom ............................ 64 4.2 Hardware .............................. 64 4.2.1 Oculus Rift ........................ 65 5 Development 67 5.1 Server-side ............................. 67 5.1.1 Providing application ................... 67 5.1.2 File managing ....................... 68 5.1.3 Vocal commands handling ................ 68 5.2 Client-side ............................. 69 5.2.1 Taxonomy file format .................. 72 5.2.2 Scene design ....................... 73 5.2.3 Interaction ......................... 78 5.2.4 Navigation ......................... 82 5.2.5 Term details ........................ 85 5.2.6 Bubble menu ....................... 87 5.2.7 Support to collaboration ................. 91 6 Results 95 6.1 Evaluation ............................. 95 6.2 Experimental settings ....................... 97 6.2.1 Apparatus ......................... 97 6.2.2 Procedure ......................... 97 6.2.3 Case Study ........................ 98 6.2.4 Questionnaire ....................... 98 6.3 Participants ............................ 99 6.4 Results and findings ........................ 99 6.4.1 Simulator sickness .................... 100 6.4.2 SUS score ........................
Recommended publications
  • Development of an Entity Component System Architecture for Realtime Simulation
    Fachbereich 4: Informatik Development of an Entity Component System Architecture for Realtime Simulation Bachelorarbeit zur Erlangung des Grades Bachelor of Science (B.Sc.) im Studiengang Computervisualistik vorgelegt von Trevor Hollmann Erstgutachter: Prof. Dr.-Ing. Stefan Müller (Institut für Computervisualistik, AG Computergraphik) Zweitgutachter: Kevin Keul, M.Sc. (Institut für Computervisualistik, AG Computergraphik) Koblenz, im September 2019 Erklärung Ich versichere, dass ich die vorliegende Arbeit selbständig verfasst und keine anderen als die angegebenen Quellen und Hilfsmittel benutzt habe. Ja Nein Mit der Einstellung der Arbeit in die Bibliothek bin ich einverstanden. .................................................................................... (Ort, Datum) (Unterschrift) Abstract The development of a game engine is considered a non-trivial problem. [3] The architecture of such simulation software must be able to manage large amounts of simulation objects in real-time while dealing with “crosscutting concerns” [3, p. 36] between subsystems. The use of object oriented paradigms to model simulation objects in class hierar- chies has been reported as incompatible with constantly changing demands dur- ing game development [2, p. 9], resulting in anti-patterns and eventual, messy re-factoring. [13] Alternative architectures using data oriented paradigms re- volving around object composition and aggregation have been proposed as a result. [13, 9, 1, 11] This thesis describes the development of such an architecture with the explicit goals to be simple, inherently compatible with data oriented design, and to make reasoning about performance characteristics possible. Concepts are for- mally defined to help analyze the problem and evaluate results. A functional implementation of the architecture is presented together with use cases common to simulation software. Zusammenfassung Die Entwicklung einer Spiele-Engine wird als nichttriviales Problem betrach- tet.
    [Show full text]
  • Immersive Exploration of Hierarchical Networks in VR
    Immersive Exploration of Hierarchical Networks in VR BACHELORARBEIT zur Erlangung des akademischen Grades Bachelor of Science im Rahmen des Studiums Medieninformatik und Visual Computing eingereicht von Manuel Eiweck Matrikelnummer 01633012 an der Fakultät für Informatik der Technischen Universität Wien Betreuung: Univ.Ass. Dr.techn. Manuela Waldner, MSc. Mitwirkung: Dipl.-Ing. Dr.techn. Johannes Sorger Dipl.-Ing. Wolfgang Knecht Wien, 16 April, 2021 Manuel Eiweck Manuela Waldner Technische Universität Wien A-1040 Wien Karlsplatz 13 Tel. +43-1-58801-0 www.tuwien.at Immersive Exploration of Hierarchical Networks in VR BACHELOR’S THESIS submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Media Informatics and Visual Computing by Manuel Eiweck Registration Number 01633012 to the Faculty of Informatics at the TU Wien Advisor: Univ.Ass. Dr.techn. Manuela Waldner, MSc. Assistance: Dipl.-Ing. Dr.techn. Johannes Sorger Dipl.-Ing. Wolfgang Knecht Vienna, 16th April, 2021 Manuel Eiweck Manuela Waldner Technische Universität Wien A-1040 Wien Karlsplatz 13 Tel. +43-1-58801-0 www.tuwien.at Erklärung zur Verfassung der Arbeit Manuel Eiweck Hiermit erkläre ich, dass ich diese Arbeit selbständig verfasst habe, dass ich die verwendeten Quellen und Hilfsmittel vollständig angegeben habe und dass ich die Stellen der Arbeit – einschließlich Tabellen, Karten und Abbildungen –, die anderen Werken oder dem Internet im Wortlaut oder dem Sinn nach entnommen sind, auf jeden Fall unter Angabe der Quelle als Entlehnung kenntlich gemacht habe. Wien, 16 April, 2021 Manuel Eiweck v Danksagung Einen besonderen Dank möchte ich den Betreuern dieser Arbeit Johannes Sorger, Wolfgang Knecht sowie Manuela Waldner aussprechen welche mich in der Entwick- lungsphase dieser Bachelorarbeit tatkräftig unterstützt haben.
    [Show full text]
  • Procedural Generation of Content in Video Games
    Bachelor Thesis Sven Freiberg Procedural Generation of Content in Video Games Fakultät Technik und Informatik Faculty of Engineering and Computer Science Studiendepartment Informatik Department of Computer Science PROCEDURALGENERATIONOFCONTENTINVIDEOGAMES sven freiberg Bachelor Thesis handed in as part of the final examination course of studies Applied Computer Science Department Computer Science Faculty Engineering and Computer Science Hamburg University of Applied Science Supervisor Prof. Dr. Philipp Jenke 2nd Referee Prof. Dr. Axel Schmolitzky Handed in on March 3rd, 2016 Bachelor Thesis eingereicht im Rahmen der Bachelorprüfung Studiengang Angewandte Informatik Department Informatik Fakultät Technik und Informatik Hochschule für Angewandte Wissenschaften Hamburg Betreuender Prüfer Prof. Dr. Philipp Jenke Zweitgutachter Prof. Dr. Axel Schmolitzky Eingereicht am 03. März, 2016 ABSTRACT In the context of video games Procedrual Content Generation (PCG) has shown interesting, useful and impressive capabilities to aid de- velopers and designers bring their vision to life. In this thesis I will take a look at some examples of video games and how they made used of PCG. I also discuss how PCG can be defined and what mis- conceptions there might be. After this I will introduce a concept for a modular PCG workflow. The concept will be implemented as a Unity plugin called Velvet. This plugin will then be used to create a set of example applications showing what the system is capable of. Keywords: procedural content generation, software architecture, modular design, game development ZUSAMMENFASSUNG Procedrual Content Generation (PCG) (prozedurale Generierung von Inhalten) im Kontext von Videospielen zeigt interessante und ein- drucksvolle Fähigkeiten um Entwicklern und Designern zu helfen ihre Vision zum Leben zu erwecken.
    [Show full text]
  • Overload Journal
    “The magazines” The ACCU's C Vu and Overload magazines are published every two months, and contain relevant, high quality articles written by programmers for programmers. “The conferences” Our respected annual developers' conference is an excellent way to learn from the industry experts, and a great opportunity to meet other programmers who care about writing good code. “The community” The ACCU is a unique organisation, run by members for members. There are many ways to get involved. Active forums flow with programmer discussion. Mentored developers projects provide a place for you to learn new skills from other programmers. “The online forums” Our online forums provide an excellent place for discussion, to ask questions, and to meet like minded programmers. There are job posting forums, and special interest groups. Members also have online access to the back issue library of ACCU magazines, through the ACCU web site. Invest in your skills. Improve your join:join: inin code. Share your knowledge. accuaccu || Join a community of people who care about code. Join the ACCU. Use our online registration form at professionalism in programming www.accu.org. www.accu.org Design: Pete Goodliffe Pete Design: OVERLOAD CONTENTS OVERLOAD 144 Overload is a publication of the ACCU April 2018 For details of the ACCU, our publications and activities, ISSN 1354-3172 visit the ACCU website: www.accu.org Editor 4 No News is Good News Frances Buontempo [email protected] Paul Floyd uses Godbolt’s compiler explorer to see what happens when you use ‘new’. Advisors Andy Balaam 8 Monitoring: Turning Noise into Signal [email protected] Chris Oldwood shows the benefits of structured Balog Pal logging.
    [Show full text]
  • Objective Employment History
    Michael T. Mayers Santa Cruz, CA 95062 email: [email protected] www: http://www.tweakoz.com/portfolio/ github: http://github.com/tweakoz OBJECTIVE Seeking a position at a software/hardware engineering, entertainment or multimedia production company. Looking for a firm which will offer a challenging environment and which thrives upon creativity and cutting edge technology. EMPLOYMENT HISTORY Aug 2017 - Present TANZLE SCOTTS VALLEY, CA Principal Systems Architect Designing and engineering Tanzle’s distributed hardware and software visualization platform, employing technologies such as spatial tracking, 3d rendering, Infiniband networking, OpenGL, OpenCV, CUDA, etc.. Brought up company’s cross platform (Linux,MacOs,Windows) build and development environment. Mar 2015 - Aug 2017 MZ (aka MACHINE ZONE) PALO ALTO, CA Lead Rendering Engineer Working on MZ’s new engine. I work closely with the graphics team in Germany defining requirements for the rendering engine. I am also responsible for bringing up the ECS (Entity Component System) simulation layer that acts as the liaison between Lua and the rendering engine. Oct 2014 - Mar 2015 NVIDIA SANTA CLARA, CA Sr. SW Engineer Worked on bringing up the Linux Graphics Debugger. Oct 2013 - Sep 2014 BLUESCAPE REDWOOD SHORES, CA Principal SW Engineer, Architect : Wall Systems Continued work on the Bluescape wall platform started at Obscura. Jul 2012 - Oct 2013 OBSCURA DIGITAL SAN FRANCISCO, CA Head of Software Engineering Lead software engineer and software architect of the Bluescape wall platform, a multi-user and multi-touchscreen cloud enabled collaborative operating system. (see www.bluescape.com). Apr 2010 - Jul 2012 APPLE INC CUPERTINO, CA GPU Developer Technologies Software Engineer Worked on internal OpenGL command stream processing tools for OpenGL/OpenGLes driver/hardware testing and validation on OSX and iOS platforms.
    [Show full text]
  • Declarative Assembly of Web Applications from Predefined Concepts
    Declarative assembly of web applications from predefined concepts The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation Perez De Rosso, Santiago et al. "Declarative assembly of web applications from predefined concepts." Proceedings of the 2019 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward! ’19), Athens, Greece, Association for Computing Machinery, 2019. © 2019 Association for Computing Machinery As Published http://dx.doi.org/10.1145/3359591.3359728 Publisher ACM Press Version Author's final manuscript Citable link https://hdl.handle.net/1721.1/126599 Terms of Use Creative Commons Attribution-Noncommercial-Share Alike Detailed Terms http://creativecommons.org/licenses/by-nc-sa/4.0/ Declarative Assembly of Web Applications from Predefined Concepts Santiago Perez De Rosso Daniel Jackson Maryam Archie MIT CSAIL MIT CSAIL MIT CSAIL Cambridge, MA, USA Cambridge, MA, USA Cambridge, MA, USA [email protected] [email protected] [email protected] Czarina Lao Barry A. McNamara III MIT CSAIL MIT CSAIL Cambridge, MA, USA Cambridge, MA, USA [email protected] [email protected] Abstract Keywords application development, web applications, con- A new approach to web application development is pre- cepts, design, software design, modularity sented, in which an application is constructed by configuring ACM Reference Format: and composing concepts drawn from a catalog developed by Santiago Perez De Rosso, Daniel Jackson, Maryam Archie, Czarina experts. Lao, and Barry A. McNamara III. 2019. Declarative Assembly of A concept is a self-contained, reusable increment of func- Web Applications from Predefined Concepts.
    [Show full text]
  • Konzeption Und Evaluation Eines Entity-Component-Systems Anhand Eines Rundenbasierten Videospiels
    Bachelorarbeit Michael Hanisch Konzeption und Evaluation eines Entity-Component-Systems anhand eines rundenbasierten Videospiels Fakultät Technik und Informatik Faculty of Engineering and Computer Science Studiendepartment Informatik Department of Computer Science Michael Hanisch Konzeption und Evaluation eines Entity-Component-Systems anhand eines rundenbasierten Videospiels Bachelorarbeit eingereicht im Rahmen der Bachelorprüfung im Studiengang Bachelor of Science Angewandte Informatik am Department Informatik der Fakultät Technik und Informatik der Hochschule für Angewandte Wissenschaften Hamburg Betreuender Prüfer: Prof. Dr. Philipp Jenke Zweitgutachter: Dr.-Ing. Sabine Schumann Eingereicht am: 23. September 2016 Michael Hanisch Thema der Arbeit Konzeption und Evaluation eines Entity-Component-Systems anhand eines rundenbasierten Videospiels Stichworte Ashley, Freebooter’s Fate, Videospiel, ECS, LibGDX, Java Kurzzusammenfassung Dieses Arbeit behandelt den Aufbau eines Videospiels mithilfe des Entity-Component-Systems (ECS) Ashley. Als Vorlage dient das Tabletop Strategiespiel Freebooter’s Fate, welches auf Runden und abwechselnden Zügen basiert. Thematisiert wird die Nutzung eines Zustandsautomaten innerhalb eines ECS. Ergebnis ist ein leicht zu erweiterndes Videospiel. Michael Hanisch Title of the paper Conception and evaluation of an entity component system on the basis of a turn based video game Keywords ashley, Freebooter’s Fate, video games, ECS, libGDX, java Abstract This thesis shows the implementation of a video game, using entity component system (ECS) Ashley. Original is miniature wargaming Freebooter’s Fate, which is based on rounds and alternating turns. Picked out as a central theme is the usage of a nite state machine inside an ECS. The result is an easy to expand video game. Inhaltsverzeichnis 1 Einleitung1 1.1 Motivation . .1 1.2 Darstellung der Problemstellung .
    [Show full text]
  • Authoring Interactive Media : a Logical & Temporal Approach Jean-Michael Celerier
    Authoring interactive media : a logical & temporal approach Jean-Michael Celerier To cite this version: Jean-Michael Celerier. Authoring interactive media : a logical & temporal approach. Computation and Language [cs.CL]. Université de Bordeaux, 2018. English. NNT : 2018BORD0037. tel-01947309 HAL Id: tel-01947309 https://tel.archives-ouvertes.fr/tel-01947309 Submitted on 6 Dec 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. THÈSE DE DOCTORAT DE l’UNIVERSITÉ DE BORDEAUX École doctorale Mathématiques et Informatique Présentée par Jean-Michaël CELERIER Pour obtenir le grade de DOCTEUR de l’UNIVERSITÉ DE BORDEAUX Spécialité Informatique Sujet de la thèse : Une approche logico-temporelle pour la création de médias interactifs soutenue le 29 mars 2018 devant le jury composé de : Mme. Nadine Couture Présidente M. Jean Bresson Rapporteur M. Stéphane Natkin Rapporteur Mme. Myriam Desainte-Catherine Directrice de thèse M. Jean-Michel Couturier Examinateur M. Miller Puckette Examinateur Résumé La question de la conception de médias interactifs s’est posée dès l’apparition d’ordinateurs ayant des capacités audio-visuelles. Un thème récurrent est la question de la spécification tem- porelle d’objets multimédia interactifs : comment peut-on créer des présentations multimédia dont le déroulé prend en compte des événements extérieurs au système.
    [Show full text]
  • Unified Patterns for Realtime Interactive Simulation in Games
    Unified Patterns for Realtime Interactive Simulation in Games and Digital Storytelling Dieter Schmalstieg Graz University of Technology Abstract—This paper discusses the state of the art in realtime interactive simulation patterns, which are essential in the development of game engines, digital storytelling, and many other graphical applications. We show how currently popular patterns have evolved from equivalent, or, at least, very similar concepts, and are deeply related. We show that game engines do not need to choose a particular pattern, but can easily combine all desired properties with little or no overhead. Realtime interactive simulations, such as simulation should be flexible in accommodating computer games or cosimulations,1 typically use new entities and new tasks. entities and tasks as their building blocks. A Contemporary game engines, such as Uni- game world or other graphical environment is ty3D, favor the entity/component/system (ECS) populated by entities such as creatures or treas- pattern,2 which makes it easy to extend enti- ures. Many entities coexist, over longer periods ties and tasks independently. ECS decouples of time, and the digital narrative emerges as a entities and tasks, which is often seen as a consequence of their simulated interactions. major advantage over traditional object-ori- The challenge from a programming point of view ented programming techniques. However, it is scalability: We want to make it convenient for does not support communication between the programmer to express the desired simula- 3 entity groups. Mercury has recently shown tion in terms of entities and tasks, and the how Unity3D can be extended with group com- munication based on dataflow, but Mercury still requires to know communication patterns in advance.
    [Show full text]
  • Game and Engine Architecture Tvorba a Dizajn Počítačových Hier Návrh a Vývoj Počítačových Hier Game Development Is Software Development
    06 Game and Engine Architecture Tvorba a dizajn počítačových hier Návrh a vývoj počítačových hier Game development is software development •Use of well-defined design patterns •Relatively strict structure of a game and game engine •Not only graphics and physics •Although lots of concepts are borrowed/required from these fields 2 Game architecture •What are all the parts a game consists of? •How do they fit together? •Relying on established standards will make your life easier •You will create maintainable and reusable software pieces •Instead of doing something that immediately works, you need to think about the one constant in software development •Going against the stream might pay off in terms of efficiency •But the results might be harder to comprehend by others 3 What’s the only constant thing in software development? Change Game architecture layers • Architecture with lots of layers (think TCP/IP) • Every subsystem can be put into one of these categories: • Application layer • Deals with the hardware and the operating system • This is usually handled by the game engine • Game logic layer • Manages your game state and how it changes over time • Game view layer • Presents the game state with graphics and sound • Similar to the well-known design pattern Model-View-Controller • Changes in hardware should not affect the game logic or game view layers • Just like MVC 6 Game logic layer •This is your game – all its mechanics • Without input systems, rendering & audio playback… •Contains subsystems that manage the game world state •Communicating
    [Show full text]
  • An Object-Oriented Software Framework for Immersive Virtual Reality Exergames
    AN OBJECT-ORIENTED SOFTWARE FRAMEWORK FOR IMMERSIVE VIRTUAL REALITY EXERGAMES By Yifan Wang M.Eng. A thesis submitted in fulfilment of the requirements for the degree of Doctor of Philosophy School of Electrical and Information Engineering The University of Sydney March 2020 Faculty of Engineering The University of Sydney, Australia Authorship Attribution Statement Chapter 3, 4 and 5 of this thesis are published as Wang, Y., Ijaz, K., & Calvo, R. A. (2017). A software application framework for developing immersive virtual reality experiences in health domain. In 2017 IEEE Life Sciences Conference (pp. 27–30). IEEE. Wang, Y., Yuan, D., Ijaz, K., & Calvo, R. A. (2020). VR-Rides: An object-oriented application framework for immersive virtual reality exergames. Software - Practice and Experience. 1-20. I designed and developed this framework, extracted and analysed the data and wrote the drafts of the MS. Chapter 6 of this thesis contains part of the data that published as Ijaz, K., Ahmadpour, N., Wang, Y., & Calvo, R. A. (2020). Player experience of needs satisfaction (PENS) in an immersive virtual reality exercise platform describes motivation and enjoyment. International Journal of Human-Computer Interaction. 1-10. Ijaz, K., Wang, Y., Ahmadpour, N., & Calvo, R. A. (2017). Physical activity enjoyment on an immersive VR exergaming platform. In 2017 IEEE Life Sciences Conference (pp. 59– 62). IEEE. Ijaz, K., Wang, Y., Ahmadpour, N., & Calvo, R. A. (2019). Immersive VR exergames for health and wellbeing. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (p. INT043). ACM. Ijaz, K., Wang, Y., Milne, D., & Calvo, R.
    [Show full text]
  • OSS Scripting System for Game Development in Rust Pablo Silva, Rodrigo Campos, Carla Rocha
    OSS Scripting System for Game Development in Rust Pablo Silva, Rodrigo Campos, Carla Rocha To cite this version: Pablo Silva, Rodrigo Campos, Carla Rocha. OSS Scripting System for Game Development in Rust. 17th IFIP International Conference on Open Source Systems (OSS), May 2021, Lathi/virtual event, Finland. pp.51-58, 10.1007/978-3-030-75251-4_5. hal-03254065 HAL Id: hal-03254065 https://hal.inria.fr/hal-03254065 Submitted on 8 Jun 2021 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Distributed under a Creative Commons Attribution| 4.0 International License OSS Scripting System for Game Development in Rust Pablo Diego Silva da Silva, Rodrigo Oliveira Campos, and Carla Rocha1 University of Bras´ılia(UnB), Bras´ılia,Brasil [email protected] [email protected] [email protected] Abstract. Software development for electronic games has remarkable performance and portability requirements, and the system and low-level languages usually provide those. This ecosystem became homogeneous at commercial levels around C and C++, both for open source or pro- prietary solutions. However, innovations brought other possibilities that are still growing in this area, including Rust and other system languages.
    [Show full text]