A Mobile Augmented Reality Application for Visualizing and Interacting with Online Data

Total Page:16

File Type:pdf, Size:1020Kb

A Mobile Augmented Reality Application for Visualizing and Interacting with Online Data A mobile Augmented Reality application for visualizing and interacting with online data Author Nurane Kuqi Supervisor Aris Alissandrakis Co-supervisor Nico Reski Examiner Ilir Jusufi Exam date 30th May 2017 Subject Social Media and Web Technologies Level Master Course code 5ME11E i “Computing is not about computers anymore. It is about living.” Nicholas Negroponte (MIT Media Lab founder) ii Abstract Augmented Reality (AR) technology has recently received a lot of attention for hav- ing lots of potential for uses in a variety of contexts. From an interaction perspective, an important factor is not only the usability of the applications, but also the engage- ment that these allow. Of particular interest is the possibility of allowing users to interact with data from online sources via an Augmented Reality interface. The main focus of this master thesis is to create a mobile AR application that allows visualization and interaction with online data. For this purpose a prototype was designed and implemented using the Unity game engine with C# and the Vuforia SDK on the front-end (mobile app) and NodeJS with MongoDB on the back-end (database server). The prototype was tested, and also deployed in a two week user study to evaluate a) how the system allowed the participants to explore available data, and b) how the use of the system affected the participants daily behaviour. The results indicate that the prototype was well received by the users. They enjoyed the experience not only due to the functionality of the system, but also given the opportunity for better involvement and completion of the given task (scheduling their lunch at the university campus restaurant) successfully. The outcomes of the thesis are a proposed architecture for a mobile AR system that allows users to interact in an engaging manner with online data, the developed pro- totype, and the initial testing and evaluation of the prototype in a specific use case. It is hoped that this work constructively contributes to the overall Augmented Real- ity field, especially regarding the development of mobile Augmented Reality appli- cations. Keywords: Augmented Reality, mobile Augmented Reality, AR Cube, Vuforia, Unity 3D, NodeJS, MongoDB. iii Acknowledgements In order to successfully complete the Master Studies, many components have given support financially, spiritually and academically. First, I want to thank the Swedish Institute for the scholarship provision during these two years of studies. SI is the first institute that made possible a dream, to accomplish the master studies abroad. Throughout studies I have always thanked SI for this great opportunity to advance my knowledge in the IT field. I wish to express my sincere gratitude to the Professor Marcelo Milrad for providing me the opportunity to work as a student researcher within the Media Technology Department. I would like to express my deepest appreciation to Dr. Aris Alissandrakis. Our first academic collaboration was throughout the student research work that I had within the Media Technology department. Based on the good working experience, I de- cided to chose him as a supervisor for my thesis. He has not only been a great mentor, but he has also supported me a lot to advance my skills and knowledge. In addition, as part of the academic level support, I want to thank Nico Reski, for his sincere support and technical consultancy. Nico has not only been a co-supervisor but also a great friend. I feel lucky for the possibility to have spent this journey with professional mentors that helped me advance through their consultancy, pro- fessional conduct and fruitful discussions. My family has been one of the key motivations for pursuing the studies abroad. Their support in everything and heart warming care has boosted my motivation to successfully complete the studies. My fiancé has played an important role on the whole journey. He has been the greatest support of mine during all this time. He has supported me in every step, with advices, technical support and has been with me in the bad and in the good. His unconditional love and help has motivated me to successfully pass the difficult battles throughout this time. I also want to thank all the friends that helped me through this masters. Their sup- port and fika time together helped me become a better person in life. Moreover, participants of the user study played a crucial role in the validation of the prototype. Thank you for the readiness to participate and add value to the study. In order to bridge the gaps throughout the phase of literature review and technical implementation I have consulted a lot of online resources from very scientific to less formal communities of people. I appreciate the work of each of the people that contribute to the shared knowledge online. Thank you all good people! iv Contents Abstract ii Acknowledgements iii Contents iv List of Figures vi List of Tables vii List of Abbreviations viii 1 Introduction1 1.1 Background..................................1 1.2 Motivation...................................2 1.3 Research Question and Hypotheses.....................3 1.4 Thesis Outline.................................4 2 Related Work5 2.1 Literature Review...............................5 2.2 The Previous AR Cube Prototype......................7 3 Methodology9 3.1 System Development............................. 10 3.2 User Study................................... 10 3.2.1 Testing................................. 11 3.2.2 Data Collection............................ 11 4 Prototype 12 4.1 Prototype Design............................... 12 4.2 Server and Database Implementation.................... 14 4.2.1 Query Data From MongoDB and Google Calendar API..... 14 4.2.2 Activity Diagram........................... 16 4.3 User scenario................................. 16 5 User study 19 5.1 User Study Setting.............................. 19 5.1.1 Testing................................. 20 5.1.2 Data collection............................ 20 5.2 Summary.................................... 21 6 Results and Analysis 22 6.1 Testing..................................... 22 6.2 Weekly Diaries................................. 22 v 6.3 System Logs.................................. 23 6.4 Interview.................................... 25 7 Discussion and Conclusion 27 7.1 Research Question.............................. 27 7.2 Hypotheses.................................. 28 7.3 Limitations................................... 28 7.4 Lessons Learned................................ 29 7.5 Future Work.................................. 30 A Test Protocol 31 B Participant Initial Questionnaire 35 C Participant Weekly Diaries 38 D System Development 42 D.1 Unity 3D.................................... 42 D.2 Vuforia SDK.................................. 42 D.3 NodeJS..................................... 43 D.3.1 Single Threaded Approach..................... 43 D.3.2 JSON.................................. 44 D.4 MongoDB................................... 45 D.4.1 Database API............................. 45 Bibliography 46 vi List of Figures 1.1 Hype Cycle for Emerging Technologies...................3 2.1 The previous AR Cube prototype......................7 3.1 Iterative/Incremental software development approach of the research study...................................... 10 4.1 The AR prototype cube interface...................... 12 4.2 Mock-up of the menu opportunities of the implemented prototype (left), and example of the menu options layout based on the interface of the prototype................................ 13 4.3 Examples of all menu options......................... 13 4.4 System architecture of the implemented prototype............ 14 4.5 Server and database implementation of the prototype........... 15 4.6 Activity diagram................................ 18 5.1 Example of the weekly menu......................... 19 6.1 Participants’ average activity from the system logs............ 25 vii List of Tables 6.1 Dates that the participants ate at the restaurant, based on their weekly diaries...................................... 22 6.2 How often participants used the app, based on their weekly diaries... 23 6.3 System logs of participants’ overall activity................. 24 6.4 System logs of participants’ choices and cancellations........... 24 6.5 Participants’ overall activity from the system logs............. 24 6.6 Menu options chosen by the participants during the study........ 25 6.7 Matches and mismatches between system logs and participants diaries. 26 viii List of Abbreviations API Application Programming Interface AR Augmented Reality CLI Command Line Interface CRUD Create Read Update Delete CS Computer Science ECMA European Computer Manufacturer’s Association GQM Goal Question Metric HCI Human Computer Interaction HDM Head Mounted Display HTTP HyperText Transfer Protocol IDE Integrated Development Environment IoT Internet of Things IT Information Technology JSON JavaScript Object Notation MARS Mobile Augmented Reality Systems PEAR Public Engagement Augmented Reality POI Point Of Interest REST REpresentational State Transfer SDK Software Development Kit SSCI Social Science Citation Index UI User Interface URL Uniform Resource Locator UX User Experience VR Virtual Reality WWW World Wide Web ix To my parents Mr. Xhevad Kuqi and Mrs. Saide Kuqi, To my siblings Fatlinda Kuqi and Elida Kuqi and To my life partner Sazan Lushi This work is a sign of my love to you! 1 Chapter 1 Introduction 1.1 Background According to (Wu et al., 2013),“[Augmented Reality]
Recommended publications
  • A Language for Modelling Contextual Augmented Reality Environments Dariusz Rumiński, Krzysztof Walczak
    CARL: A Language for Modelling Contextual Augmented Reality Environments Dariusz Rumiński, Krzysztof Walczak To cite this version: Dariusz Rumiński, Krzysztof Walczak. CARL: A Language for Modelling Contextual Augmented Reality Environments. 5th Doctoral Conference on Computing, Electrical and Industrial Systems (DoCEIS), Apr 2014, Costa de Caparica, Portugal. pp.183-190, 10.1007/978-3-642-54734-8_21. hal- 01274770 HAL Id: hal-01274770 https://hal.inria.fr/hal-01274770 Submitted on 16 Feb 2016 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Distributed under a Creative Commons Attribution| 4.0 International License CARL: A Language for Modelling Contextual Augmented Reality Environments Dariusz Rumi ński, Krzysztof Walczak Pozna ń University of Economics Niepodległo ści 10, 61-875 Pozna ń, Poland {ruminski, walczak}@kti.ue.poznan.pl Abstract. The paper describes a novel, declarative language that enables modelling ubiquitous, contextual and interactive augmented reality environments. The language, called CARL – Contextual Augmented Reality Language, is highly componentised with regards to both the structure of AR scenes as well as the presented AR content. This enables dynamic composition of CARL presentations based on various data sources and depending on the context.
    [Show full text]
  • Augmented Reality
    Augmented Reality: A Review of available Augmented Reality packages and evaluation of their potential use in an educational context November 2010 Stephen Rose Dale Potter Matthew Newcombe Unlocking the Hidden Curriculum University of Exeter Learning and Teaching Innovation Grants (04/08) 2 Contents 1. Augmented Reality Page 4 2. Augmented Reality in Education 6 3. Augmented Reality Applications 8 3.1 Marker-based Augmented Reality 8 3.2 Markerless Augmented Reality 10 4. Available Augmented Reality Technologies 12 4.1 Current Smartphone Ownership Patterns 12 4.2 Platforms 16 4.3 AR Software 19 5. Technical Considerations 22 5.1 Limitations of Current Platforms 24 6. Choosing an Augmented Reality System 24 7. Glossary 28 8. References 29 9. Appendix 1: Unlocking the Hidden Curriculum - a JISC- 31 funded Learning and Teaching Innovation Project at the University of Exeter This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 2.0 Licence. To view a copy of this licence, visit: http://creativecommons.org/licenses/by-nc-sa/2.0/uk or send a letter to: Creative Commons, 171 Second Street, Suite 300, San Francisco, California, 94105, USA. 3 1. ‘Augmented Reality’ Every now and again a ‘new technology’ appears which seems to capture the public imagination. Invariably the technology enables a new means of interacting with screen-based entertainment or a computer game - 3DTV, the Nintendo Wii. The proliferation of so-called ‘smartphones’ with their abilities to run once-complex computer applications, in-built cameras and ‘GPS’ capability has unleashed the potential of ‘Augmented Reality’ – to date a regular feature of science fiction or ‘near future’ movies.
    [Show full text]
  • "Print &” Augmented Reality Guide
    "Print &” Augmented Reality Guide Terminology: - junaio: the Augmented Reality (AR) Browser Application powered by metaio - channel: the individual experience section within the junaio App - scanning: using the camera to frame objects (QR Code, images) to trigger experiences - tracking: occurs after scanning, when the camera locks on to an image and prompts the AR experience - QR (Quick Response) Code: black and white tiled square used to access a channel 1. Setting up junaio on an iOS or Android Device: - Go to iTunes App Store or Google Play and search for “junaio”. - Download the free app to your device. - Once downloaded, open junaio; a quick tutorial will follow. - Next, the Home channel will open in camera view mode. junaio logo: 2. Getting to the Sappi Channel: - Tap the “SCAN” button in the top right corner. - Hover the camera over the QR Code provided on the Numbers Experience page (p. 15). - This will bring you to the Sappi Channel. You will see the Sappi blue “S” on the top bar immediate to the left of junaio; you should see this “S” throughout the Numbers Experience, signifying you are in the right channel. - You can also access the Sappi Channel by touching the magnifying glass search button in the upper left corner and searching for “Sappi”. - Let the channel load completely (refer to the loading bar at the top). Sappi Channel QR Code: Sappi Channel Icon: 1 3. Numbers Experience in Sappi Channel: - Make sure the Numbers Experience page is unfolded completely and lying as flat as possible on a table. - The page should be facing you right side up.
    [Show full text]
  • Webizing Mobile Augmented Reality Content
    This article was downloaded by: [Sangchul Ahn] On: 10 February 2014, At: 12:48 Publisher: Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House, 37-41 Mortimer Street, London W1T 3JH, UK New Review of Hypermedia and Multimedia Publication details, including instructions for authors and subscription information: http://www.tandfonline.com/loi/tham20 Webizing mobile augmented reality content Sangchul Ahnab, Heedong Kob & Byounghyun Yoob a HCI & Robotics, University of Science and Technology, Daejeon, Korea b Imaging Media Research Center, Korea Institute of Science and Technology, Seoul, Korea Published online: 05 Feb 2014. To cite this article: Sangchul Ahn, Heedong Ko & Byounghyun Yoo , New Review of Hypermedia and Multimedia (2014): Webizing mobile augmented reality content, New Review of Hypermedia and Multimedia, DOI: 10.1080/13614568.2013.857727 To link to this article: http://dx.doi.org/10.1080/13614568.2013.857727 PLEASE SCROLL DOWN FOR ARTICLE Taylor & Francis makes every effort to ensure the accuracy of all the information (the “Content”) contained in the publications on our platform. However, Taylor & Francis, our agents, and our licensors make no representations or warranties whatsoever as to the accuracy, completeness, or suitability for any purpose of the Content. Any opinions and views expressed in this publication are the opinions and views of the authors, and are not the views of or endorsed by Taylor & Francis. The accuracy of the Content should not be relied upon and should be independently verified with primary sources of information. Taylor and Francis shall not be liable for any losses, actions, claims, proceedings, demands, costs, expenses, damages, and other liabilities whatsoever or howsoever caused arising directly or indirectly in connection with, in relation to or arising out of the use of the Content.
    [Show full text]
  • State-Of-The-Art
    State-of-the-Art Hyperlocal Mobile Advertising Charles Woodward, VTT NEXT MEDIA - A TIVIT PROGRAMME 21.5.2012 1 Scope of the Study Sources Mobile World Congress, Barcelona, 27-29 March 2012 Others: ARE 2011, ISMAR 2011, Google, Web Update from previous study NextMedia / Ubimedia State-of-the-Art report 2011 Further technical information available at Liite: Mika Hakkarainen (VTT): Lisätyn todellisuuden alustat NEXT MEDIA - A TIVIT PROGRAMME 21.5.2012 2 Application Categories Categories Geo located, World Browsing (WB) Image based, Close Range (CR) Main applications Layar CR commercial, WB free Wikitude, WB, commercial / free Metaio CR, WB, SDK, commercial Aurasma, CR, commercial BlippAR, CR, commercial T-Immersion (D-Fusion), CR, commercial Qualcomm (Vuforia), CR, SDK, free NEXT MEDIA - A TIVIT PROGRAMME 21.5.2012 3 Layar Layar http://layar.com/ World’s first commercial AR World Browser, 2009 Received €14 Million VC investment in 2010 Over 10 Million installs of Layar Reality Browser Comes preinstalled on Samsung Galaxy tablets Free for developers Commercial product: Layar Vision See video http://www.youtube.com/watch?v=AsD0DuPT1GI&feature=youtu.be Layar Vision Pricing http://www.layar.com/browser/pricing/ 0,01 € per match, first 10,000 free, max €1000 per month Also: Layar Stiktu Enables image based content creation by end-users See video http://www.stiktu.com/ NEXT MEDIA - A TIVIT PROGRAMME 21.5.2012 4 Metaio Metaio http://www.metaio.com Offers both location based & close range solutions See examples, http://www.metaio.com/software/junaio-plugin/ etc. Success Stories, see http://www.junaio.com/publish/success-stories/ Products Metaio Design 2,5 – high end PC based functionality Metaio Mobile SDK v.
    [Show full text]
  • Context-Aware Mobile Augmented Reality Visualization in Construction Engineering Education
    CONTEXT-AWARE MOBILE AUGMENTED REALITY VISUALIZATION IN CONSTRUCTION ENGINEERING EDUCATION by AREZOO SHIRAZI B.S. University of Tehran, 2012 A thesis submitted in partial fulfillment of the requirements for the degree of Master of Science in the Department of Civil, Environmental, and Construction Engineering in the College of Engineering and Computer Sciences at the University of Central Florida Orlando, Florida Spring Term 2014 Major Professor: Amir H. Behzadan © 2014 Arezoo Shirazi ii ABSTRACT Recent studies suggest that the number of students pursuing science, technology, engineering, and mathematics (STEM) degrees has been generally decreasing. An extensive body of research cites the lack of motivation and engagement in the learning process as a major underlying reason of this decline. It has been discussed that if properly implemented, instructional technology can enhance student engagement and the quality of learning. Therefore, the main goal of this research is to implement and assess effectiveness of augmented reality (AR)-based pedagogical tools on student learning. For this purpose, two sets of experiments were designed and implemented in two different construction and civil engineering undergraduate level courses at the University of Central Florida (UCF). The first experiment was designed to systematically assess the effectiveness of a context-aware mobile AR tool (CAM-ART) in real classroom-scale environment. This tool was used to enhance traditional lecture-based instruction and information delivery by augmenting the contents of an ordinary textbook using computer- generated three-dimensional (3D) objects and other virtual multimedia (e.g. sound, video, graphs). The experiment conducted on two separate control and test groups and pre- and post- performance data as well as student perception of using CAM-ART was collected through several feedback questionnaires.
    [Show full text]
  • Live TV-Set with Mobile Augmented Reality
    Live TV-Set with mobile Augmented Reality Thiemo Kastel1 1Institute of Media Productions, St. Pölten University of Applied Sciences, St. Pölten, Lower Austria, Austria Abstract - To interact as audience to a live television production is today a common procedure. New is to use Indirect profit Augmented Reality support to reach the audience at home. Also new is the situation to have many Television Sets at Television stations can create interactive applications to private houses connected with the internet. Both are offering increase customer loyalty. This is very important for PayTV lots of possibilities for interactive live television productions. stations. With new concepts of interactivity they acquire new The author shows current productions, a by himself produced customers and hold regular ones. case study with Augmented Reality at the OpenCampus 2011 and is going into discussion. Selling content Keywords: Audience Interaction, Broadcast, Streaming, Television broadcasters sell their videos or applications like WebTV, Augmented Reality, Virtual Reality PayPerView, PayPerTime or PayPer Download. Sky Austria for example provides additional channels, where viewer can pay 1 Introduction for new movies. Nowadays Live - Television Shows often include a way of audience interaction. The idea is to reach the viewer to Selling interactivity make him watching the show as longs as possible. One reason for that is often selling advertising time (commercial spots) to This means that people can participate in contests by sending finance the station. Another is the concept of the show itself, SMS or call in. Viewers get the feeling of interactivity and the social participation. Many technologies are in use to interact TV station earns money by its premium-rate telephone service.
    [Show full text]
  • Augmented Reality Using Javascript
    Aida Hailemichael Augmented reality using JavaScript Helsinki Metropolia University of Applied Sciences Bachelor of Engineering Media Engineering Thesis 13 May 2013 Abstract Author Aida Hailemichael Title Augmented Reality using JavaScript Number of Pages 39 pages + 1 appendix Date 13 May 2013 Degree Bachelor of Engineering Degree Programme Bachelor of Media Engineering Specialisation option Web Application Development Instructors Kari Salo, Principal Lecturer Erik Pöysti, Executive Director The project goal was to provide a mobile application, for a venue called Kulturhuset Karelia which is located in Tammisaari Finland. In this paper, the concept of Augmented Reality technology is briefly discussed along with the mobile application for the venue. The utilisa- tion of JavaScript for creating Augmented reality content for mobile Augmented reality browser is also demonstrated. The application was created by using Architecht API which is Jacvascript library based on the Wikitude world browser. Wikitude world browser is nowadays one of the most popular Augmented reality browsers for mobile phones. The development of the application was to demonstrate the possibility of utilising simple web technologies such as HTML, JavaScript and CSS for developing Augmented Reality application for mobile Augmented reality browsers. The application was implemented by using Wikitude ARchitecht API for creating the Augmented Reality features, together with additional JavaScript libraries JQuery mobile for creating the user interface and Google Maps API for
    [Show full text]
  • The Augmented Tegra Experience Agenda
    The Augmented Tegra Experience Agenda § Introduction to metaio § Overview of AR development processes and deployment to a mobile platform. § Example applications on a Tegra 4 ‘Dalmore’ platform § Consider some of the new features of the Tegra 4 platform § Look forward to some of the developments in open APIs from the perspective of an AR application developer AR Food Chain – Always ON, Always Augmented! Hardware Software Content Users Acceleration AR Applications AR Usage AR Content Access Augmented Reality Development Overview • Content Creation and Curation – most content formats supported • Deployment Options – Compatible with most CDN & Cloud Services • Platform Agnostic – ‘Write once’ Applications • Platform Performance Enhancement – Optimization & Acceleration Creator – Overview Display Display 3D Video Model Marker Display Image Display Audio Creator – Tegra 4 Example § Non-optimized ‘Junaio’ port § High polygon count ~35K∆ § High frame rate animation >25fps Junaio Demo – Screen Shot Junaio Browser running on nVidia ‘Dalmore’ Tegra 4 Development Platform Metaio SDK - Overview § Optimized client-based visual 4.1 search for a large number of 2D targets § Improved stability, robustness and performance of ID Marker and 2D marker-less tracking § Improved performance of 3D object tracking and teaching § SLAM integration § Sensor fusion with visual-based tracking § AREL support SDK Overview § Application Development Libraries § Xcode/Eclipse Development environments § Unity Plugin § Integrated Renderer § Fully functional free version (watermark)
    [Show full text]
  • Open Source Mobile Augmented Reality
    Mobile Augmented Reality Using FOSS Open source AR in the wild • Stats – Google Code: 104 – SourceForge: 37 – GitHub: ~75 • Mostly sketches, ARToolkit projects, libs and utilities • Not seeing many full clients Mobile Augmented Reality (MAR) Platforms Android iOS Current MAR Native Applications MAR Web Applications Kamra https://research.cc.gatech.edu/polaris/ MAR Web Applications Barriers to open source • Walled gardens/silos of AR data • Fragmentation – Android • 1.5, 1.6, 2.0, 2.1,2.2 • apps vary across carriers – Apple • iPhone, iPod Touch, iPad • iPad video out, determined by application Client choices • Evaluated available clients – Proprietary: Wikitude, Layar and Junaio – Open Source: gamaray and Mixare • Commonalities – XML/JSON formats – Points of Interest • Mixare – Android/java, most mature/active OS MAR project Choices of Geo Data Servers • Driven by client requirements – Required formats mostly XML or JSON based – Only point format supported, think POI (Points of Interest) • Chose GeoServer – Java – Familiarity – Work for OpenGeo Geoserver • Create data output used by Mixare {"status": "OK", "num_results": 1, "results": [ { "id": "2827", "lat": "46.43893", "lng": "11.21706", "elevation": "1737", "title": "Penegal", "distance": "9.756", "has_detail_page": "1", "webpage": "http%3A%2F%2Fwww.opengeo.org%2Fpic ` %2Fpicture.png" } Geoserver • Almost trivial with Geoserver-archetype- wfsoutputformat – Most of data contained in feature – Elevation from Geonames service – Added distance using a filter to modify response – JSON and GeoTools libs available and handy Mixare • Compilation – Failed on Android 1.6 (HTC Dream) – Worked on Android 2.1 (Droid, HTC EVO 4G) – Unstable on Android 2.2 – Cyanogen Mod 6.0 (HTC Dream) • Works for the most part but user experience is not as rich as commercial clients.
    [Show full text]
  • Augmented Reality (AR)
    Seeing GIS Data Using AR Richie Carmichael of the Esri Applications Prototype Lab has been experimenting with using AR to visualize GIS content. He thinks of AR as simply adding to reality GIS in a way that enhances or improves upon & what you see displayed in a web or desktop Making GIS content available application. “GIS data is already a source of spatially en- in interesting and useful ways abled information that can be fed directly to your mobile device,” explained Carmichael. By Keith Mann, Esri Writer “Your phone knows where it is, the direction the camera is facing, and the inclination of the device in your hand. This information, combined with GIS data, not only adds to the end user’s experience but also makes GIS ac- cessible in a new and interesting way.” As AR becomes more prevalent in phone, tablet, and computer applications, more de- velopers will begin integrating GIS services If you own a smartphone, such as an iPhone Familiar Applications of AR and content to serve very real and practical or Android, you probably have an app that While the concepts of AR have been around purposes. Mansour Raad, a senior software uses augmented reality (AR). This technol- for decades, the technology has been applied architect at Esri, envisions AR apps that ogy superimposes digital information on to so many different types of media that it will channel GIS content to professional whatever you’re looking at through your is difficult to point to any one application as end users using mobile devices to help them phone’s camera.
    [Show full text]
  • Challenges of a Pose Computation Augmented Reality Game Application
    Challenges of a Pose Computation Augmented Reality Game Application THESIS Presented in Partial Fulfillment of the Requirements for the Degree Master of Science in the Graduate School of The Ohio State University By Chiu Ni Wang Graduate Program in Computer Science and Engineering The Ohio State University 2011 Master's Examination Committee: Rajiv Ramnath, Advisor Jay Ramanathan Copyright by Chiu Ni Wang 2011 Abstract An Augmented Reality (AR) application combines the virtual world and reality to enhance the user‟s perception of the real world. Earlier, augmented reality technology had not found much commercial success because it required bulky gadgets and considerable processing power. But now AR technologies are available and computationally feasible on commodity mobile devices, such as smartphones. Pose estimation AR applications make use of inbuilt hardware features like the accelerometer, magnetometer and Global Positioning System (GPS) for overlaying images onto the real world. However, the dependence of the working of AR on hardware features gives rise to new challenges, which must be addressed in order to provide augmentation in as seamless a manner as possible. These challenges include real time estimation of the user‟s viewport, geo-magnetic sensor noise, the delay in receiving GPS data, and the synchronization of timer threads. Other challenges include those of debugging and testing because realistic GPS feeds and other sensory data are unavailable during development. Next, most AR applications have the need for common framework-based services, such as tracking, image registration and interface handling. This thesis also explores the feasibility of such a framework, where a reusable platform is coupled with a customizable application specific component to create the AR application.
    [Show full text]