Local Points of Interest Using Augmented Reality

Total Page:16

File Type:pdf, Size:1020Kb

Local Points of Interest Using Augmented Reality LOCAL POINTS OF INTEREST USING AUGMENTED REALITY _______________ A Thesis Presented to the Faculty of San Diego State University _______________ In Partial Fulfillment of the Requirements for the Degree Master of Science in Computer Science _______________ by Sudeshna Mukherjee Spring 2013 iii Copyright © 2013 by Sudeshna Mukherjee All Rights Reserved iv DEDICATION I dedicate this thesis work to my parents and teachers. The constant encouragement of my parents has given me direction in life. The guidance and support of my teachers has helped me in my educational journey of enlightenment. v ABSTRACT OF THE THESIS Local Points of Interest Using Augmented Reality by Sudeshna Mukherjee Master of Science in Computer Science San Diego State University, 2013 As the worldwide smartphone market continues to expand, by the third quarter of 2012 Android had a 75% share of the global smartphone market according to the research firm IDC. One reason that smartphones are so popular is because of the wide range of smartphone applications that they provide these applications are also so useful because they can integrate intimately with our personal lives. Augmented reality is a new technology which integrates the virtual world of a smart phone with the real world of nearby locations as seen by the user. This thesis implements a number of augmented reality features by blending both visual, map-based and non-map- based elements like live projection of nearby landmark on camera preview. The main screen of the proposed application gives the address of the current location and provides two buttons. The first button is for a map view and gives the representation of the current location on the map, with options. The second button on the main screen is for showing a camera preview. When this button is clicked a camera preview is shown, and as we hold the phone vertically, it projects various nearby landmarks as icons on the phone screen. Again there is a menu bar with useful options. vi TABLE OF CONTENTS PAGE ABSTRACT ...............................................................................................................................v LIST OF TABLES ................................................................................................................. viii LIST OF FIGURES ................................................................................................................. ix ACKNOWLEDGEMENTS ..................................................................................................... xi CHAPTER 1 INTRODUCTION .........................................................................................................1 1.2 Motivation ..........................................................................................................1 1.3 Thesis Organization ...........................................................................................2 2 USE OF AUGMENTED REALITY FOR MOBILE PHONE ......................................3 2.1 Introduction to Augmented Reality ...................................................................3 2.2 Hardware Components of a Phone Used for Mobile Augmented Reality ................................................................................................................3 2.3 Popular Mobile Augment Reality Applications .................................................3 2.4 Introduction to Unity Software Developent Kit .................................................5 2.4.1 Features of Unity Software Development Kit ..........................................5 2.4.2 A Sample Augmented Reality Application Developed Using Unity .........................................................................................................6 3 TECHNOLOGY DETAILS ...........................................................................................8 3.1 Android Architecture .........................................................................................8 3.2 Android Application Life Cycle ........................................................................9 3.3 Composition of Android Application ................................................................9 4 ANDROID APPLICATION PROGRAMMING INTERFACE DETAILS ................12 4.1 Location Services .............................................................................................12 4.1.1 Location Manager ...................................................................................12 4.1.2 Location Class .........................................................................................12 4.1.3 Geocoder Class .......................................................................................12 4.1.4 Address Class ..........................................................................................13 4.2 Google Maps Android API ..............................................................................13 vii 4.2.1 Google Maps Android API Map Types ..................................................14 4.2.2 Obtaining Google Map API Key ............................................................14 4.3 Data Source ......................................................................................................15 4.4 Android Package ORG.JSON ..........................................................................15 4.5 Android Camera API .......................................................................................15 4.6 Usage of Device Sensors .................................................................................16 4.6.1 Android Sensor API Methods .................................................................17 4.6.2 Pitch Roll Azimuth for Android Phone ..................................................19 5 IMPLEMENTATION DETAILS ................................................................................22 5.1 Permissions to Access Device Hardware and Other Services .........................22 5.2 Main Activity and Map View Details ..............................................................22 5.3 Usage of Google Map API Key in XML File ..................................................25 5.4 Obtaining Information About Landmarks Using JSONOBJECT ....................25 5.5 Plotting Icons for Nearby Landmark on Camera Preview ...............................26 5.5.1 Relationship between the Plotted Points and Radius ..............................30 5.5.2 Usage of Thread Pool for Dynamic Update of Phone Screen ................33 6 EXECUTION RESULTS ON ANDROID PHONE ....................................................35 6.1 Android Logging System .................................................................................36 6.2 Procedure for Recording Execution Times ......................................................38 6.3 Conclusion .......................................................................................................40 7 CONCLUSIONS AND OBSTACLES ........................................................................41 8 FUTURE SCOPE AND IMPROVEMENT.................................................................42 BIBLIOGRAPHY ....................................................................................................................43 APPENDIX SETTING OF DEVELOPMENT AND TEST ENVIRONMENT ....................................46 viii LIST OF TABLES PAGE Table 4.1. Table Describing Function Names and Their Descriptions ....................................13 Table 4.2. Table Describing the Parameters for the getRotationMatrix Method .....................19 Table 4.3. Table Describing the Parameters for remapCoordinateSystem Method ................20 Table 6.1. Table Describing Execution Times at Different Radius for Samsung Galaxy S3 .....................................................................................................................35 Table 6.2. Table Describing Execution Times at Different Radii for HTC Thunderbolt ........36 Table 6.3. Table Showing Summarized Data of Execution Times at Different Radius for HTC Thunderbolt and Samsung Galaxy S3 (From Table 6.1 and 6.2) ..................37 Table 6.4. Table Describing Phone Configurations Used for Running the Application .........38 ix LIST OF FIGURES PAGE Figure 2.1. Snapshot of translated text.......................................................................................4 Figure 2.2. Snapshot of Google Sky map application. ..............................................................4 Figure 2.3. User interface of Unity. Snapshot taken after downloading, installing and launching the trial version of the unity IDE. ..................................................................5 Figure 2.4. Snapshot of menu items of Unity. ...........................................................................6 Figure 2.5. Augmentation of GMCS building on map using Unity IDE. ..................................7 Figure 2.6. Snapshot of phone screen after augmentation. ........................................................7 Figure 3.1. Android architecture. ...............................................................................................8 Figure 3.2. Android application lifecycle. ...............................................................................10 Figure 4.1. Flowchart describing the order of call to various camera API methods needed to use the phone camera. ..................................................................................17 Figure 4.2. Default orientation of phone. .................................................................................18
Recommended publications
  • From Google Maps to a Fine-Grained Catalog of Street Trees
    From Google Maps to a Fine-Grained Catalog of Street trees Steve Bransona,1, Jan Dirk Wegnerb,1, David Halla, Nico Langb, Konrad Schindlerb, Pietro Peronaa aComputational Vision Laboratory, California Institute of Technology, USA bPhotogrammetry and Remote Sensing, ETH Z¨urich,Switzerland Abstract Up-to-date catalogs of the urban tree population are of importance for municipalities to monitor and improve quality of life in cities. Despite much research on automation of tree mapping, mainly relying on on dedicated airborne LiDAR or hyperspectral campaigns, tree detection and species recognition is still mostly done manually in practice. We present a fully automated tree detection and species recognition pipeline that can process thousands of trees within a few hours using publicly available aerial and street view images of Google MapsTM. These data provide rich information from different viewpoints and at different scales from global tree shapes to bark textures. Our work-flow is built around a supervised classification that automatically learns the most discriminative features from thousands of trees and corresponding, publicly available tree inventory data. In addition, we introduce a change tracker that recognizes changes of individual trees at city-scale, which is essential to keep an urban tree inventory up-to-date. The system takes street-level images of the same tree location at two different times and classifies the type of change (e.g., tree has been removed). Drawing on recent advances in computer vision and machine learning, we apply convolutional neural networks (CNN) for all classification tasks. We propose the following pipeline: download all available panoramas and overhead images of an area of interest, detect trees per image and combine multi-view detections in a probabilistic framework, adding prior knowledge; recognize fine-grained species of detected trees.
    [Show full text]
  • Creating Google Street Views with the Samsung Gear 360 Camera By
    Creating Google Street Views with the Samsung Gear 360 Camera1 by Andy Lyons ​ Last modified: November 2016 Google Street View Camera Loan Kit In October 2016, Google loaned a 360-camera kit to IGIS (a statewide technical support program in ANR), for the purposes of exploring how Google’s Street View technology can be useful for research and management at the Hopland Research and Extension Center (and ANR field stations more generally). Street View app and the Samsung Gear 360 2 The Street View app (for both Android and iOS) is what you use to create and upload Street Views. The Samsung Gear 360 is one of about four 360 cameras that the Google Street View app is setup to work with (meaning the app can control the camera pretty seamlessly). Most people use the Street View app only to view off-road street views. You can also view off-road street views in plain old Google Maps, but the Street View app makes it a little easier to find user generated content. If you have a VR device such as the Google Cardboard, you can view Street Views in 3 cardboard mode .​ In terms of content creation, the Street View app has three main functions: i) control the camera, ii) process images (which includes stitching them together, blurring faces and license plates, adding locations as needed, and linking nearby photos), and iii) upload the images to Google Street View (after which they’ll be available in Google Maps immediately). The Samsung Gear can also record 360 video. For that you need the Samsung Gear 360 Manager (or another app).
    [Show full text]
  • Google Camera Apk Download for Android 9.0
    Google camera apk download for android 9.0 Continue Although the Google Play Store has over a million apps that you can install on an Android device, the market sometimes removes popular software from its catalog such as Grooveshark Mobile and Adobe Flash Player. However, you don't have to download apps only from the official market; You can set up your device to download installation packages or APK files from elsewhere. To download a package from an email app and install it on Android, you need to download and use a third-party program. Open The Settings from the app screen or notification bar, and then tap Security. Scroll down to the device's administration and then check the Unknown Sources option. Download the attachment from your email app or mobile browser, and then open the Google Play Store from the Home or Apps screen. Search and then install Apk Installer Graphilos Studio from the Play Store. Open the app to complete the installation, and then review the folder containing the downloaded package. Select the APK file from the file manager, and then tap the Package Installer to start the setup. Follow the tips on the screen to install APK content on your smartphone. Open The Settings from the app screen or notification bar, and then tap Security. Scroll down to the device's administration and then check the Unknown Sources option. Download the attachment from your email app or mobile browser, and then open the Google Play Store from the Home or Apps screen. Search and then install Apk Installer by Array Infotech from the Play Store.
    [Show full text]
  • Progress, Privacy, and Google Jamuna D
    Brooklyn Law Review Volume 74 | Issue 1 Article 7 2008 A Computer with a View: Progress, Privacy, and Google Jamuna D. Kelley Follow this and additional works at: https://brooklynworks.brooklaw.edu/blr Recommended Citation Jamuna D. Kelley, A Computer with a View: Progress, Privacy, and Google, 74 Brook. L. Rev. (2008). Available at: https://brooklynworks.brooklaw.edu/blr/vol74/iss1/7 This Note is brought to you for free and open access by the Law Journals at BrooklynWorks. It has been accepted for inclusion in Brooklyn Law Review by an authorized editor of BrooklynWorks. A Computer with a View PROGRESS, PRIVACY, AND GOOGLE INTRODUCTION [Tihe existing law affords a principle which may be invoked to protect the privacy of the individual from invasion either by the too enterprising press, the photographer .... [or] any other modern device for recording or reproducing scenes .... [Is it the case that] any individual, by appearing upon the public highway, or in any other public place, makes his appearance public, so that any one may take and publish a picture of him as he is at the time[?] What if an utterly obscure citizen, reeling along drunk on the main street, is snapped by an 2enterprising reporter, and the picture given to the world? Is his privacy invaded? The authors of the quotations above, Samuel Warren, Louis Brandeis, and William Prosser, were not referring to the Internet when they described the increasing invasion of modem devices into personal privacy, but their words are still poignant for many citizens of a world in which novel technology seems to sprout silently, rapidly, and endlessly.
    [Show full text]
  • Augmented Reality in Cultural Heritages
    AR in Cultural Historical Museum Anil Ghimire Master’s thesis in Software Engineering at Department of Computing, Mathematics and Physics, Bergen University College Department of Informatics, University of Bergen June 2019 Abstract i Acknowledgements I offer my sinceriest gratitude to my supervisors (Harald, Atle, Daniel) , new media center HVL and the bachelor groups who helped in designing the model for the project. ii Contents Abstracti Acknowledgements ii List Of Figures vi List Of Tables vii Acronyms viii Glossary ix 1 Introduction1 1.1 A word about Centre for New Media .............. 1 1.2 Motivation............................. 2 1.3 Thesis goals and Research Questions .............. 2 1.4 Related Works........................... 3 1.5 Report Structure ......................... 3 2 Background4 2.1 Museums and Technology .................... 4 2.1.1 Virtual Reality (VR)................... 5 2.1.2 Other Technologies.................... 5 2.1.3 Augmented Reality (AR) ................ 5 2.1.4AR in museums...................... 5 3 Augmented Reality : An Overview8 3.1 What isAR? ........................... 8 3.2 History ofAR........................... 9 iii 3.3 Key Technologies......................... 10 3.3.1 Display Technology.................... 10 3.3.2 Tracking and Registeration Technology......... 11 3.3.3 Registeration ....................... 13 3.3.4 Calibration ........................ 13 3.4 HowAR system works?...................... 13 3.5 Current Uses of AR........................ 14 3.6 AR frameworks.......................... 14 3.6.1 ARKit........................... 15 3.6.2 ARCore .......................... 15 3.6.3 Vuforia........................... 16 3.6.4 Comparision........................ 16 4 ARCore: An Overview 18 4.1 ARCore and Project Tango ................... 18 4.2 Development Environments ................... 19 4.2.1 Android Studio...................... 19 4.2.2 Unreal Engine....................... 19 4.2.3 Unity ..........................
    [Show full text]
  • Room Layout Estimation on Mobile Devices
    En vue de l'obtention du DOCTORAT DE L'UNIVERSITÉ DE TOULOUSE Délivré par : Institut National Polytechnique de Toulouse (Toulouse INP) Discipline ou spécialité : Image, Information et Hypermédia Présentée et soutenue par : M. VINCENT ANGLADON le vendredi 27 avril 2018 Titre : Room layout estimation on mobile devices Ecole doctorale : Mathématiques, Informatique, Télécommunications de Toulouse (MITT) Unité de recherche : Institut de Recherche en Informatique de Toulouse (I.R.I.T.) Directeur(s) de Thèse : M. VINCENT CHARVILLAT M. SIMONE GASPARINI Rapporteurs : M. CARSTEN GRIWODZ, UNIVERSITE D'OSLO M. DAVID FOFI, UNIVERSITE DE BOURGOGNE Membre(s) du jury : Mme LUCE MORIN, INSA DE RENNES, Président M. PASCAL BERTOLINO, UNIVERSITE GRENOBLE ALPES, Membre M. SIMONE GASPARINI, INP TOULOUSE, Membre M. TOMISLAV PRIBANIC, UNIVERSITE DE ZAGREB, Membre M. VINCENT CHARVILLAT, INP TOULOUSE, Membre Acknowledgments I would like to thank my thesis committee for giving me the opportunity to work on an exciting topic, and for the trust they placed in me. First, Simone Gasparini, I had the pleasure to have as advisor, who kept a cautious eye on my scientific and technical productions. I am certain this great attention to the details played an important role in the quality of my publications and the absence of rejection notice. Then, my thesis director, Vincent Charvillat, who was always generous in original ideas and positive energy. His advice helped me to put a more flattering light on my works and feel more optimistic. Finally, Telequid, which funded my works, with a special thought to Frédéric Bruel and Benjamin Ahsan for their great patience. I would also like to thank my referees: Prof.
    [Show full text]
  • Pulse One API Client Specification Reference Guide
    Pulse One API Client Specification Reference Guide Release 1.0 Document Revision 1.2 Published Date 20 July 2020 Pulse One API Client Specification - Reference Guide Pulse Secure, LLC 2700 Zanker Road, Suite 200 San Jose CA 95134 https://www.pulsesecure.net Pulse Secure and the Pulse Secure logo are trademarks of Pulse Secure, LLC in the United States. All other trademarks, service marks, registered trademarks, or registered service marks are the property of their respective owners. Pulse Secure, LLC assumes no responsibility for any inaccuracies in this document. Pulse Secure, LLC reserves the right to change, modify, transfer, or otherwise revise this publication without notice. Products made or sold by Pulse Secure or components thereof might be covered by one or more of the following patents that are owned by or licensed to Pulse Secure: U.S. Patent Nos. 5,473,599, 5,905,725, 5,909,440, 6,192,051, 6,333,650, 6,359,479, 6,406,312, 6,429,706, 6,459,579, 6,493,347, 6,538,518, 6,538,899, 6,552,918, 6,567,902, 6,578,186, and 6,590,785. Pulse One API Client Specification - Reference Guide The information in this document is current as of the date on the title page. END USER LICENSE AGREEMENT The Pulse Secure product that is the subject of this technical documentation consists of (or is intended for use with) Pulse Secure software. Use of such software is subject to the terms and conditions of the End User License Agreement (“EULA”) posted at https://www.pulsesecure.net.
    [Show full text]
  • Hey Google, Activate Spyware! When Google Assistant Uses a Vulnerability As a Feature
    SESSION ID: SBX1-R2 Hey Google, Activate Spyware! When Google Assistant Uses a Vulnerability as a Feature Erez Yalon Director of Security Research Checkmarx @ErezYalon #RSAC Let’s Take a Selfie by Using Google’s Personal Assistant #RSAC Introduction Published: December 20 Photo: Angela Lang/CNET 3 Agenda Some Android Terms Step I – Let’s Get Hacking Step II – Persistence Step III – Stealth Step IV – Always Want More Step V – Disclosure What We Learned 4 Terms - Intents 101 Intents specify actions 5 Terms - permissions 101 Permissions allow actions Permissions overview (https://developer.android.com/guide/topics/permissions/overview) “The purpose of a permission is to protect the privacy of an Android useruser. Android apps must request permission to access sensitive user data (such as contacts and SMS), as well as certain system features (such as camera and internet). Depending on the feature, the system might grant the permission automatically or might prompt the user to approve the request.” “A central design point of the Android security architecture is that no app, by default, has permission to perform any operations that would adversely impact other apps, the operating system, or the user. This includes reading or writing the user's private data (such as contacts or emails), reading or writing another app's files, performing network access, keeping the device awake, and so on.” 6 Terms - permissions 101 Declaring the need of permission 7 Terms - permissions 101 Declaring the need of permission Check for permission 8 Terms - permissions
    [Show full text]
  • User Guide of Google Camera on Android Devices 140021659
    User Guide of Google Camera on Android devices 140021659 User Guide of Google Camera on Android devices Table of Contents User Guide of Google Camera on Android devices .............................................................. 1 1. Download .................................................................................................................................... 2 2. Create a photosphere ............................................................................................................. 2 3. View a photosphere ................................................................................................................ 8 4. Delete a photosphere .......................................................................................................... 11 5. Publish to Google Maps ...................................................................................................... 13 6. Share a photosphere ............................................................................................................ 17 7. Upload photospheres on Omeka ..................................................................................... 20 8. View a photosphere on Omeka ........................................................................................ 25 9. Create an Exhibit with photospheres ............................................................................ 28 10. Tips .................................................................................................................................... 36
    [Show full text]
  • CARTOGRAPHY May 2013
    http://bigthink.com/strange-maps/405-scroll-britannia-the-uks-first-road-map Mapping Sciences Institute, Australia ICA member: ABN 53 004 301 811 : Acn 004 301 811 CARTOGRAPHY May 2013 A monthly on-line periodical designed to capture the latest cartographic news and developments from around the world. If you have any general cartography items of interest then please email them to National Secretary Content Quotes ........................................................................................................................ 2 Mapping In the News .................................................................................................. 2 Crowd Sourcing .......................................................................................................... 9 Environmental Mapping ............................................................................................ 12 Cartography for the Health Industry ......................................................................... 19 Resources and Technology ...................................................................................... 22 Cartography – Applications ...................................................................................... 25 Mapmaker of Renown .............................................................................................. 28 Links ......................................................................................................................... 28 Conferences ............................................................................................................
    [Show full text]
  • Can You Download Stock Android on Other Phones 10 Best Stock Android Phones Available Under Rs
    can you download stock android on other phones 10 Best Stock Android Phones Available Under Rs. 20,000 In 2021. Motorola and HMD Global that markets Nokia Brand in India ar`e the two OEMs that are primarily accredited for pushing the pure Android software on affordable phones for the last few years. In 2021, however, the onus is now on Motorola and nascent brands like Micromax. ( ) Consumers have strong faith in stock Android software and it also makes more sense for new entrants to embrace stock Android rather than to spend time and resources perfecting a custom interface. Stock Android has progressively gotten better and is considered a safer bet. So, if you are looking for a stock Android or pure Android phone priced under 20,000 INR, here are a few options that you could consider. Stock Android: Advantages and Disadvantages. The stock Android software is popular because it’s relatively lighter and faster as it isn’t bogged down or burdened with customization options, added features, ads, and preloaded apps that you might or might not use. Or in other words, you will (generally) get a clean reliable interface, won’t have to endure ads and recommendations in your notifications panel, and get to decide what apps you want to keep on your phone. It’s also a safer bet for consumers. If you aren’t sure whether you will find a particular software in line with your taste, it’s generally safer to side with Google’s vision aka stock Android. On the other hand, the unadulterated Android experience can feel crippling and unbelievably bland at times.
    [Show full text]
  • Pixel Fnaf Vk Dc2
    Pixel Fnaf Vk Dc2 NoAds, Faster apk downloads and apk file update speed. Cartoon cat dc2 download vk Cartoon cat dc2 download vk. VK is a social networking service quite similar to Facebook and is very popular in Europe, especially among the Russian-speaking people. Collection by Christophergraham1982. 1 Physical Appearance 2 Personality 3 Role 4 Speculation 5 Trivia 5. Découvrez nos Ecriture avec impression pour vos cadeaux d'affaires. 100ÿû d K % 0 @ ˆ ¡‘A˜õ€³€%g 0ddapLV aá A ¸P @ 1• óœÑ£@ ! A°| Áð@ L Áðü L Þ' @ Áð| ?ˆ > ƒáÿø!âp| ÿ Ïü»ø€1ˆ Ê çýG?ø€ ü cðCùsÿ˃çâ|?Áðÿÿ ƒàø>°| Ãò€ƒ„ € (" šÖþïjª˜Ñ'Åq9 Û8 Ò|žK ñÌ6 )[( $. Ads keep us online. ru – это лучшая замена плей маркет и аппстор для ваших смартфонов. 103d #3 ★6. Download Draw Cartoons 2 for PC free at BrowserCam. 2 02- Intro 1. Everwar by. VK or VKontake means "In Contact" in Russian. Doesn’t any one think it’s strange that Bendy has two seperate addons with diffrent models for the same creature? I just find that interesting also 096 is scary as frick in this addon srsly he just looks menacing like a old grey Nemesis from re3 also he has cute lil eyebrows that’s kinda adorable but also it makes him look even scarier but i have on slight problem his fingies are too. Everybody knows about Teletubbies, because they are famous all over the world. Download RealmCraft apk 5. [DC2\FNaF] Built in the 80s Preview 2. Types Of Animations: • Head bob • Blinking • Facial expressions • Full body bouncing • Short Lip Sync Animation • Gore.
    [Show full text]