Team Ford Douglas Kantor Helena Narowski Rahul Patel Chengzhu Jin Eric Wu Department of Computer Science and Engineering Michigan State University

Total Page:16

File Type:pdf, Size:1020Kb

Team Ford Douglas Kantor Helena Narowski Rahul Patel Chengzhu Jin Eric Wu Department of Computer Science and Engineering Michigan State University Project Plan Ford SmartPark App The Capstone Experience Team Ford Douglas Kantor Helena Narowski Rahul Patel Chengzhu Jin Eric Wu Department of Computer Science and Engineering Michigan State University From Students… Fall 2017 …to Professionals Functional Specifications • Mobile App . Create / Edit Ford Smart Park Profile . Send in parking spots for reward incentives . View Rewards Leaderboard . Receive notifications of available parking spots nearby . Register owned vehicles • Google Tango . Scan parking spots . Analyze and report measurements • Sync 3 . Receive alerts from mobile app of available parking spots . Map to available parking spots • Server . AWS Free Tier Server The Capstone Experience Team Ford Project Plan Presentation 2 Design Specifications • Our project has two User Interfaces: Mobile Application and Sync 3 • Mobile Application has 7 interfaces • Sync 3 mirrors mobile app in the vehicle The Capstone Experience Team Ford Project Plan Presentation 3 Screen Mockup: Android Application The Capstone Experience Team Ford Project Plan Presentation 4 Screen Mockup: Android Application The Capstone Experience Team Ford Project Plan Presentation 5 Screen Mockup: Google Tango Parking Spot Scanning 2.8m 5.4m 5.4m 3.0m 2.8m 4.8m 4.8m 2.8m The Capstone Experience Team Ford Project Plan Presentation 6 Technical Specifications • Mobile Application . Android Studio 2.3.3 • Google Tango . Software Development Kit • Sync 3 . Emulator . Testing Development Kit • Server . MySQL . Amazon Relational Database Services The Capstone Experience Team Ford Project Plan Presentation 7 System Architecture The Capstone Experience Team Ford Project Plan Presentation 8 System Components • Hardware Platforms . Sync 3 Testing Development Kit . Lenovo Phab 2 Pro Smartphone • Software Platforms / Technologies . Android (Java) . Google Tango (Java) . Sync 3 Emulator & TDK . MySQL Database The Capstone Experience Team Ford Project Plan Presentation 9 Testing • Server Communication • Google Tango Communication • Sync 3 Communication . Sync 3 Emulator . Sync 3 TDK The Capstone Experience Team Ford Project Plan Presentation 10 Risks • Google Tango Augmented Reality Implementation . Team has no experience with AR. No existing evidence can prove that Google Tango can implement scanning functionality. Lots of time-consuming research and building process . Starting early is most efficient solution for time consuming tasks. Using Documentation and tutorials to manipulate source code. More team member work on AR implementation if needed. • Depth Sensing camera compatibility . Depth Sensing camera has maximum 3.5m detecting distance. However, length of most parking spot is larger than 4.5m . Try different method of depth sensing process and create new scanning algorithm. • Inbuilt Hardware corporation . Need to communicate lots of sensors since team is creating source code and no experiences. Barely any documentation provided . Go through tutorials and Test carefully ensure specific software functionality is cooperating with correct hardware signal The Capstone Experience Team Ford Project Plan Presentation 11 Questions? ? ? ? ? ? ? ? ? ? The Capstone Experience Team Ford Project Plan Presentation 12.
Recommended publications
  • Tracking an RGB-D Camera on Mobile Devices Using an Improved Frame-To-Frame Pose Estimation Method
    Tracking an RGB-D Camera on Mobile Devices Using an Improved Frame-to-Frame Pose Estimation Method Jaepung An∗ Jaehyun Lee† Jiman Jeong† Insung Ihm∗ ∗Department of Computer Science and Engineering †TmaxOS Sogang University, Korea Korea fajp5050,[email protected] fjaehyun lee,jiman [email protected] Abstract tion between two time frames. For effective pose estima- tion, several different forms of error models to formulate a The simple frame-to-frame tracking used for dense vi- cost function were proposed independently in 2011. New- sual odometry is computationally efficient, but regarded as combe et al. [11] used only geometric information from rather numerically unstable, easily entailing a rapid accu- input depth images to build an effective iterative closest mulation of pose estimation errors. In this paper, we show point (ICP) model, while Steinbrucker¨ et al. [14] and Au- that a cost-efficient extension of the frame-to-frame tracking dras et al. [1] minimized a cost function based on photo- can significantly improve the accuracy of estimated camera metric error. Whereas, Tykkal¨ a¨ et al. [17] used both geo- poses. In particular, we propose to use a multi-level pose metric and photometric information from the RGB-D im- error correction scheme in which the camera poses are re- age to build a bi-objective cost function. Since then, sev- estimated only when necessary against a few adaptively se- eral variants of optimization models have been developed lected reference frames. Unlike the recent successful cam- to improve the accuracy of pose estimation. Except for the era tracking methods that mostly rely on the extra comput- KinectFusion method [11], the initial direct dense methods ing time and/or memory space for performing global pose were applied to the framework of frame-to-frame tracking optimization and/or keeping accumulated models, the ex- that estimates the camera poses by repeatedly registering tended frame-to-frame tracking requires to keep only a few the current frame against the last frame.
    [Show full text]
  • Emerging Opportunities in Virtualization
    TECHNOLOGY INSIGHTS FOR BUSINESS LEADERS TECHNOLOGY INSIGHTS FOR BUSINESS LEADERS www.futurum.xyz EMERGING OPPORTUNITIES IN VIRTUALIZATION 2016-2020 DANIEL NEWMAN SHELLY KRAMER OLIVIER BLANCHARD Principal Analyst Principal Analyst Senior Analyst Published: November 1, 2016. TABLE OF CONTENTS 3 Executive Summary 4 Introduction 6 Uses for Virtualization – Breakdown by category 6 Virtual Reality (VR) 8 Augmented Reality and Mixed Reality (AR) 11 Mixed Reality (MR) 13 Industrial virtualization and modeling software 14 Key Takeaways 17 Additional Resources TECHNOLOGY INSIGHTS FUTURUM PREMIUM REPORT | 2 FOR BUSINESS LEADERS EXECUTIVE SUMMARY Futurum Research provides research, insights and analysis to the market that help tie leading and emerging technology solutions to strategic business needs. The purpose behind each of our reports is to help business executives and decision-makers gain a better understanding of the technologies driving digital transformation, connect the dots between the practical business requirements of digital transformation and the forces that impact employees, customers, markets and experiences, and take appro- priate action regarding critical digital transformation opportunities. Executive Summary This report is an overview of the state of virtualization-related opportunities busi- Virtualization Technology in 2016, and fo- nesses should be aware of going into H1 cuses on Virtual Reality, Augmented Real- and H2 2017. Among them: Healthcare, ity, and industrial virtualization and mod- education, design engineering, logistics, eling software. It outlines market trends retail, enterprise collaboration, hospitali- and specific categories of uses that plot ty and travel, virtual business travel, busi- virtualization’s adoption into 2020 and ness reporting, and systems manage- beyond, and identifies some of the key ment.
    [Show full text]
  • Utilizing the Google Project Tango Tablet Development Kit and the Unity Engine for Image and Infrared Data-Based Obstacle Detection for the Visually Impaired
    Int'l Conf. Health Informatics and Medical Systems | HIMS'16 | 163 Utilizing the Google Project Tango Tablet Development Kit and the Unity Engine for Image and Infrared Data-Based Obstacle Detection for the Visually Impaired Rabia Jafri1, Rodrigo Louzada Campos2, Syed Abid Ali3 and Hamid R. Arabnia2 1Department of Information Technology, King Saud University, Riyadh, Saudi Arabia 2Department of Computer Science, University of Georgia, Athens, Georgia, U.S.A. 3Araware LLC, Wilmington, Delaware, U.S.A Abstract: A novel image and infrared data-based application of within a few centimeters. Its integrated infra-red based to assist visually impaired (VI) users in detecting and depth sensors also allow it to measure the distance from the avoiding obstacles in their path while independently device to objects in the real world providing depth data about navigating indoors is proposed. The application will be the objects in the form of point clouds. The depth sensors and developed for the recently introduced Google Project Tango the visual sensors are synchronized, facilitating the Tablet Development Kit equipped with a powerful graphics integration of the data from these two modalities. processor and several sensors which allow it to track its Our project aims to utilize the Project Tango tablet to motion and orientation in 3D space in real-time. It will develop a system to assist VI users in detecting and avoiding exploit the inbuilt functionalities of the Unity engine in the obstacles in their path during navigation in an indoors Tango SDK to create a 3D reconstruction of the surrounding environment. The system will exploit the inbuilt environment and to detect obstacles.
    [Show full text]
  • Game Implementation in Real-Time Using the Project Tango
    Senior Project Game Implementation in Real-Time using the Project Tango By: Samantha Bhuiyan Senior Advisor: Professor Kurfess June 16, 2017 Figure 1: Project Tango Device Table of Contents Abstract 3 List of Figures 4 List of Tables 5 Project Overview 6 Requirements and Features 7 System Design and Architecture 15 Validation and Evaluation 17 Conclusions 19 Citations 20 2 ABSTRACT The goal of this senior project is to spread awareness of augmented reality, which Google defines as “a technology that superimposes a computer-generated image on a user's view of the real world, thus providing a composite view.” It’s a topic that is rarely known to those outside of a technology related field or one that has vested interest in technology. Games can be ideal tools to help educate the public on any subject matter. The task is to create an augmented reality game using a “learn by doing” method. The game will introduce players to augmented reality, and thus demonstrate how this technology can be combined with the world around them. The Tango, Unity and Vuforia are the tools to be used for development. The game itself will be a coin collecting game that changes dynamically to the world around the player. 3 List of Figures Figure 1: Project Tango Device 1 Figure 2: Ceiling with an array of markers 9 Figure 3: floor with an array of markers point 10 Figure 4: Vuforia stock image used for image recognition 11 Figure 5: Initial System Design 15 Figure 6: Final System design 15 Figure 7: Unity view of game 17 4 List of Tables Table 1: Evaluation Criteria 8-9 Table 2: Example of code for coin collection 11 Table 3: Research Questions 12 5 Project Overview Background Google developed the Tango to enable users to take advantage of the physical world around them.
    [Show full text]
  • Connecticut DEEP's List of Compliant Electronics Manufacturers Notice to Connecticut Retailersi
    Connecticut DEEP’s List of Compliant Electronics manufacturers Notice to Connecticut Retailersi: This list below identifies electronics manufacturers that are in compliance with the registration and payment obligations under Connecticut’s State-wide Electronics Program. Retailers must check this list before selling Covered Electronic Devices (“CEDs”) in Connecticut. If there is a brand of a CED that is not listed below including retail over the internet, the retailer must not sell the CED to Connecticut consumers pursuant to section 22a-634 of the Connecticut General Statutes. Manufacturer Brands CED Type Acer America Corp. Acer Computer, Monitor, Television, Printer eMachines Computer, Monitor Gateway Computer, Monitor, Television ALR Computer, Monitor Gateway 2000 Computer, Monitor AG Neovo Technology AG Neovo Monitor Corporation Amazon Fulfillment Service, Inc. Kindle Computers Amazon Kindle Kindle Fire Fire American Future Technology iBuypower Computer Corporation dba iBuypower Apple, Inc. Apple Computer, Monitor, Printer NeXT Computer, Monitor iMac Computer Mac Pro Computer Mac Mini Computer Thunder Bolt Display Monitor Archos, Inc. Archos Computer ASUS Computer International ASUS Computer, Monitor Eee Computer Nexus ASUS Computer EEE PC Computer Atico International USA, Inc. Digital Prism Television ATYME CORPRATION, INC. ATYME Television Bang & Olufsen Operations A/S Bang & Olufsen Television BenQ America Corp. BenQ Monitor Best Buy Insignia Television Dynex Television UB Computer Toshiba Television VPP Matrix Computer, Monitor Blackberry Limited Balckberry PlayBook Computer Bose Corp. Bose Videowave Television Brother International Corp. Brother Monitor, Printer Canon USA, Inc. Canon Computer, Monitor, Printer Oce Printer Imagistics Printer Cellco Partnership Verizon Ellipsis Computer Changhong Trading Corp. USA Changhong Television (Former Guangdong Changhong Electronics Co. LTD) Craig Electronics Craig Computer, Television Creative Labs, Inc.
    [Show full text]
  • Google Unveils 'Project Tango' 3D Smartphone Platform 20 February 2014
    Google unveils 'Project Tango' 3D smartphone platform 20 February 2014 "What if directions to a new location didn't stop at the street address? What if you never again found yourself lost in a new building? What if the visually impaired could navigate unassisted in unfamiliar indoor places? What if you could search for a product and see where the exact shelf is located in a super-store?" The technology could also be used for "playing hide- and-seek in your house with your favorite game character, or transforming the hallways into a tree- lined path." Smartphones are equipped with sensors which make over 1.4 million measurements per second, updating the positon and rotation of the phone. A reporter uses a cell phone to take a photograph of Google Android 3.0 Honeycomb OS being used on a Partners in the project include researchers from the Motorola Xoon tablet during a press event at Google headquarters on February 2, 2011 in Mountain View, University of Minnesota, George Washington California University, German tech firm Bosch and the Open Source Robotics Foundation, among others. Another partner is California-based Movidius, which Google announced a new research project makes vision-processor technology for mobile and Thursday aimed at bringing 3D technology to portable devices and will provide the processor smartphones, for potential applications such as platform. indoor mapping, gaming and helping blind people navigate. Movidius said in a statement the goal was "to mirror human vision with a newfound level of depth, clarity The California tech giant said its "Project Tango" and realism on mobile and portable connected would provide prototypes of its new smartphone to devices." outside developers to encourage the writing of new applications.
    [Show full text]
  • EMBL Beamline Control at Petra III
    EMBL Beamline control at Petra III Uwe Ristau PCaPAC 2008 Petra III Instrumentation EMBL-Hamburg PCaPAC08: EMBL Beamline control at PetraIII Content • Introduction • TINE @ EMBL • Control Concept for Petra III • Control Electronic • Beckhoff TwinCAT/EterCAT PCaPAC08: EMBL Beamline control at PetraIII Introduction • The European Molecular Biology Laboratory EMBL-Hamburg will build and operate an integrated infrastructure for life science applications at PETRA III / DESY. • Beside others the centre comprises two Beamlines for Macromolecular X-ray crystallography (MX1, MX2) and one for Small Angle X-ray Scattering (BioSAXS). • The EMBL operates currently 6 Beamlines at the DORISIII/DESY synchrotron PCaPAC08: EMBL Beamline control at PetraIII sample Horizontal focusing mirror Vertical focusing mirror Multilayer BIOSAXS Beamline Monochromator DCM first experiment 4/2010 61.4 59.9 Undulator 59.4 45.3 m from source 44.0 42.8 40.4 PCaPAC08: EMBL Beamline control at PetraIII TINE @ EMBL •TINE was first installed at the DESY/DORIS III Beamline BW7B in 2006. Since than the Beamline control module BCM, the experiment control and a robotic sample changer are controlled by TINE. Presented at the PCAPAC 2006. •Now TINE is integrated at the Doris Beamline for small angle scattering X33 and at the MX Beamlines BW7A and BW7B. •Since the beginning of 2008 BW7A and BW7B became test Beamlines for the new Petra III project of the EMBL. At the moment the first applications with the Petra III control concept are implemented at this Beamlines . TINE Stand alone Installation PCaPAC08: EMBL Beamline control at PetraIII Why TINE • Very good support of MCS • TINE unique features: – Different transport protocols: UDP,TCP/IP….
    [Show full text]
  • Lowe's Bets on Augmented Reality by April Berthene
    7 » LOWE'S BETS ON AUGMENTED REALITY In testing two augmented reality mobile apps, the home improvement retail chain aims to position Lowe's as a technology leader. Home improvement retailer Lowe's launched an augmented reality app that allows shoppers to visualize products in their home. Lowe's bets on augmented reality By April Berthene owe's Cos. Inc. wants to In-Store Navigation app, helps measure spaces, has yet to be be ready when augmented shoppers navigate the retailer's widely adopted; the Lenovo Phab 2 reality hits the mainstream. large stores, which average 112,000 Pro is the only consumer device that That's why the home square feet. hasTango. improvement retail chain The retailer's new technology In testing two different aug• Lrecently began testing two and development team, Lowe's mented reality apps, Lowe's seeks consumer-facing augmented Innovation Labs, developed the to position its brand as a leader as reality mobile apps. Lowe's Vision apps that rely on Google's Tango the still-new technology becomes allows shoppers to see how Lowe's technology. The nascent Tango more common. About 30.7 million products look in their home, while technology, which uses several consumers used augmented reality the other app, The Lowe's Vision: depth sensing cameras to accurately at least once per month in 2016 and 1ULY2017 | WWW.INTERNETRETAILER.COM LOWE'S BETS ON AUGMENTED REALITY that number is expected to grow 30.3% this year to 40.0 million, according to estimates by research firm eMarketer Inc. The Lowe's Vision app, which launched last November, allows consumers to use their smartphones to see how Lowe's products look in their home, says Kyle Nel, executive director at Lowe's Innovation Labs.
    [Show full text]
  • Smartphone with Google 3-D Tango from Taiwan's Asus 4 January 2017
    Smartphone with Google 3-D Tango from Taiwan's Asus 4 January 2017 virtual objects" and offers the ability to watch a movie or play a game in virtual or augmented reality. "This is really the next wave that is going to get consumers excited about smartphones," said Asus marketing chief Erik Hermanson. Project Tango uses depth sensing and motion tracking to create onscreen 3D experiences, allowing users to get a better picture of a physical environment for functions such as home decoration. Taiwan-based electronics group, Asus, announced on Google Project Tango leader Johnny Lee, who January 4, 2017 its plan to launch a new smartphone joined the Asus media event, said he expected featuring Google 3D Tango technology "dozens of Tango-enabled apps" to be available soon on the Google Play store. The only other handset using Project Tango is Taiwan-based electronics group Asus announced Lenovo's Phab2 phone, which was released last Wednesday it was launching a new smartphone year. which uses Google Tango 3D technology and allows users to experience augmented and virtual Asus announced it would be releasing another new reality. smartphone, the Zenfone 3 Zoom, with upgraded camera technology which aims at delivering The Zenfone AR is just the second handset to professional-quality images. incorporate the Tango computing platform which allows for indoor mapping, augmented reality and © 2017 AFP more. The new device, unveiled by Asus at the Consumer Electronics Show in Las Vegas, is also one of a small number of smartphones that is compatible with Google Daydream, the US tech giant's virtual reality system.
    [Show full text]
  • The Application of Virtual Reality and Augmented Reality in Oral & Maxillofacial Surgery Ashraf Ayoub* and Yeshwanth Pulijala
    Ayoub and Pulijala BMC Oral Health (2019) 19:238 https://doi.org/10.1186/s12903-019-0937-8 RESEARCH ARTICLE Open Access The application of virtual reality and augmented reality in Oral & Maxillofacial Surgery Ashraf Ayoub* and Yeshwanth Pulijala Abstract Background: Virtual reality is the science of creating a virtual environment for the assessment of various anatomical regions of the body for the diagnosis, planning and surgical training. Augmented reality is the superimposition of a 3D real environment specific to individual patient onto the surgical filed using semi-transparent glasses to augment the virtual scene.. The aim of this study is to provide an over view of the literature on the application of virtual and augmented reality in oral & maxillofacial surgery. Methods: Wereviewedtheliteratureandtheexistingdatabaseusing Ovid MEDLINE search, Cochran Library and PubMed. All the studies in the English literature in the last 10 years, from 2009 to 2019 were included. Results: We identified 101 articles related the broad application of virtual reality in oral & maxillofacial surgery. These included the following: Eight systematic reviews, 4 expert reviews, 9 case reports, 5 retrospective surveys, 2 historical perspectives, 13 manuscripts on virtual education and training, 5 on haptic technology, 4 on augmented reality, 10 on image fusion, 41 articles on the prediction planning for orthognathic surgery and maxillofacial reconstruction. Dental implantology and orthognathic surgery are the most frequent applications of virtual reality and augmented reality. Virtual planning improved the accuracy of inserting dental implants using either a statistic guidance or dynamic navigation. In orthognathic surgery, prediction planning and intraoperative navigation are the main applications of virtual reality.
    [Show full text]
  • Google Project Tango – a Convenient 3D Modeling Device
    International Journal of Current Engineering and Technology E-ISSN 2277 – 4106, P-ISSN 2347 - 5161 ® ©2014 INPRESSCO , All Rights Reserved Available at http://inpressco.com/category/ijcet General Article Google Project Tango – A Convenient 3D Modeling Device Deval KeraliaȦ, Khyati K.VyasȦ* and Khushali DeulkarȦ ȦComputer Science, Dwarkadas J.Sanghvi College of Engineering, Vile Parle(W),Mumbai-400056,India. Accepted 02 Sept 2014, Available online 01 Oct 2014, Vol.4, No.5 (Oct 2014) Abstract The goal of Project Tango is to create technology that lets you use mobile devices to piece together three-dimensional maps, thanks to an array of cameras, depth sensors and clever algorithms. It is Google's way of mapping a room interior using an Android device. 3D technology is the future of mobile. With the growing advent of 3D sensors being implemented in phones and tablets, various softwares will be an app enabling millions of people to engage, interact and share with the world around them in visually rich 3D. Keywords: Project Tango, three-dimensional maps, 3D sensor. 1. Introduction 2. Description 1 3D models represent a 3D object using a collection of points in a given 3D space, connected by various entities such as curved surfaces, triangles, lines, etc. Being a collection of data which includes points and other information, 3D models can be created by hand, scanned (procedural modeling), or algorithmically. The "Project Tango" prototype is an Android smartphone-like device which tracks the 3D motion of particular device, and creates a 3D model of the environment around it. The team at Google’s Advanced Technology and Projects Group (ATAP).
    [Show full text]
  • Electronic 3D Models Catalogue (On July 26, 2019)
    Electronic 3D models Catalogue (on July 26, 2019) Acer 001 Acer Iconia Tab A510 002 Acer Liquid Z5 003 Acer Liquid S2 Red 004 Acer Liquid S2 Black 005 Acer Iconia Tab A3 White 006 Acer Iconia Tab A1-810 White 007 Acer Iconia W4 008 Acer Liquid E3 Black 009 Acer Liquid E3 Silver 010 Acer Iconia B1-720 Iron Gray 011 Acer Iconia B1-720 Red 012 Acer Iconia B1-720 White 013 Acer Liquid Z3 Rock Black 014 Acer Liquid Z3 Classic White 015 Acer Iconia One 7 B1-730 Black 016 Acer Iconia One 7 B1-730 Red 017 Acer Iconia One 7 B1-730 Yellow 018 Acer Iconia One 7 B1-730 Green 019 Acer Iconia One 7 B1-730 Pink 020 Acer Iconia One 7 B1-730 Orange 021 Acer Iconia One 7 B1-730 Purple 022 Acer Iconia One 7 B1-730 White 023 Acer Iconia One 7 B1-730 Blue 024 Acer Iconia One 7 B1-730 Cyan 025 Acer Aspire Switch 10 026 Acer Iconia Tab A1-810 Red 027 Acer Iconia Tab A1-810 Black 028 Acer Iconia A1-830 White 029 Acer Liquid Z4 White 030 Acer Liquid Z4 Black 031 Acer Liquid Z200 Essential White 032 Acer Liquid Z200 Titanium Black 033 Acer Liquid Z200 Fragrant Pink 034 Acer Liquid Z200 Sky Blue 035 Acer Liquid Z200 Sunshine Yellow 036 Acer Liquid Jade Black 037 Acer Liquid Jade Green 038 Acer Liquid Jade White 039 Acer Liquid Z500 Sandy Silver 040 Acer Liquid Z500 Aquamarine Green 041 Acer Liquid Z500 Titanium Black 042 Acer Iconia Tab 7 (A1-713) 043 Acer Iconia Tab 7 (A1-713HD) 044 Acer Liquid E700 Burgundy Red 045 Acer Liquid E700 Titan Black 046 Acer Iconia Tab 8 047 Acer Liquid X1 Graphite Black 048 Acer Liquid X1 Wine Red 049 Acer Iconia Tab 8 W 050 Acer
    [Show full text]