Mobile AR/VR with Edge-Based Deep Learning Jiasi Chen Department of Computer Science & Engineering University of California, Riverside
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Google ARCORE
Google ARCORE Nisfu Asrul Sani @ Lab Langit 9 - PENS 20 - 22 November 2017 environtment Setting up your development environment Install the Android SDK version 7.0 (API Level 24) or higher. To install the Android SDK, install Android Studio. To update the Android SDK, use the Android SDK Manager tool in Android Studio. Install Unity 2017.2 Beta 11 or higher, with the Android Build Support component. For more info, see Downloading and Installing Unity. You will need to get the ARCore SDK for Unity. You can either: Download the SDK Preview for Unity and extract it. -or- Clone the repository with the following command: git clone https://github.com/google-ar/arcore-unity-sdk.git Prepare your device You must use a supported, physical device. ARCore does not support virtual devices such as the Android Emulator. To prepare your device: Enable developer options Enable USB debugging Install the ARCore Service on the device: Download the ARCore Service Connect your Android device to the development machine with a USB cable Install the service by running the following adb command: adb install -r -d arcore-preview.apk https://play.google.com/store/apps/details?id=com.un Additional ity3d.genericremote Supported Devices ARCore is designed to work on a wide variety of qualified Android phones running N and later. During the SDK preview, ARCore supports the following devices: Google Pixel, Pixel XL, Pixel 2, Pixel 2 XL Samsung Galaxy S8 (SM-G950U, SM-G950N, SM- G950F, SM-G950FD, SM-G950W, SM-G950U1) Initially, ARCore will only work with Samsung’s S8 and S8+ and Google’s Pixel phone, but by the end of the year, Google promised to have support for 100 million Android phones, including devices from LG, Huawei and Asus, among others. -
Augmented Reality (AR) Indoor Navigation Mobile Application
View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Sunway Institutional Repository Design of a Mobile Augmented Reality-based Indoor Navigation System Xin Hui Ng, Woan Ning Lim Research Centre for Human-Machine Collaboration Department of Computing and Information Systems School of Science and Technology Sunway University, Malaysia ( [email protected], [email protected] ) Abstract— GPS-based navigation technology has been widely immersive virtual navigation direction. A mobile application used in most of the commercial navigation applications prototype was developed in this project to provide navigation nowadays. However, its usage in indoor navigation is not as within Sunway University campus. effective as when it is used at outdoor environment. Much research and developments of indoor navigation technology II. RELATED WORK involve additional hardware installation which usually incur high An indoor navigation system is comprised of 3 important setup cost. In this paper, research and comparisons were done to components which are positioning, wayfinding, and route determine the appropriate techniques of indoor positioning, pathfinding, and route guidance for an indoor navigation guidance. Positioning refers to determining user’s current method. The aim of this project is to present a simple and cost- position, while wayfinding focuses on searching the route from effective indoor navigation system. The proposed system uses the user’s position to a specific destination. Route guidance is the existing built-in sensors embedded in most of the mobile devices navigation directions illustrating the route. to detect the user location, integrates with AR technology to A. Indoor Positioning Techniques provide user an immersive navigation experience. -
Getting Real with the Library
Getting Real with the Library Samuel Putnam, Sara Gonzalez Marston Science Library University of Florida Outline What is Augmented Reality (AR) & Virtual Reality (VR)? What can you do with AR/VR? How to Create AR/VR AR/VR in the Library Find Resources What is Augmented and Virtual Reality? Paul Milgram ; Haruo Takemura ; Akira Utsumi ; Fumio Kishino; Augmented reality: a class of displays on the reality- virtuality continuum. Proc. SPIE 2351, Telemanipulator and Telepresence Technologies, 282 (December 21, 1995) What is Virtual Reality? A computer-generated simulation of a lifelike environment that can be interacted with in a seemingly real or physical way by a person, esp. by means of responsive hardware such as a visor with screen or gloves with sensors. "virtual reality, n". OED Online 2017. Web. 16 May 2017. Head mounted display, U.S. Patent Number 8,605,008 VR in the 90s By Dr. Waldern/Virtuality Group - Dr. Jonathan D. Waldern, Attribution, https://commons.wikimedia.org/w/index.php?curid=32899409 By Dr. Waldern/Virtuality Group - Dr. Jonathan D. Waldern, By Dr. Waldern/Virtuality Group - Dr. Jonathan D. Waldern, Attribution, Attribution, https://commons.wikimedia.org/w/index.php?curid=32525338 https://commons.wikimedia.org/w/index.php?curid=32525505 1 2 3 VR with a Phone 1. Google Daydream View 2. Google Cardboard 3. Samsung Gear VR Oculus Rift ● Popular VR system: headset, hand controllers, headset tracker ($598) ● Headset has speakers -> immersive environment ● Requires a powerful PC for full VR OSVR Headset ● Open Source ● “Plug in, Play Everything” ● Discounts for Developers and Academics ● Requires a powerful PC for full VR Augmented Reality The use of technology which allows the perception of the physical world to be enhanced or modified by computer-generated stimuli perceived with the aid of special equipment. -
13 Cool Things You Can Do with Google Chromecast Chromecast
13 Cool Things You Can Do With Google Chromecast We bet you don't even know half of these Google Chromecast is a popular streaming dongle that makes for an easy and affordable way of throwing content from your smartphone, tablet, or computer to your television wirelessly. There’s so much you can do with it than just streaming Netflix, Hulu, Spotify, HBO and more from your mobile device and computer, to your TV. Our guide on How Does Google Chromecast Work explains more about what the device can do. The seemingly simple, ultraportable plug and play device has a few tricks up its sleeve that aren’t immediately apparent. Here’s a roundup of some of the hidden Chromecast tips and tricks you may not know that can make casting more magical. Chromecast Tips and Tricks You Didn’t Know 1. Enable Guest Mode 2. Make presentations 3. Play plenty of games 4. Cast videos using your voice 5. Stream live feeds from security cameras on your TV 6. Watch Amazon Prime Video on your TV 7. Create a casting queue 8. Cast Plex 9. Plug in your headphones 10. Share VR headset view with others 11. Cast on the go 12. Power on your TV 13. Get free movies and other perks Enable Guest Mode If you have guests over at your home, whether you’re hosting a family reunion, or have a party, you can let them cast their favorite music or TV shows onto your TV, without giving out your WiFi password. To do this, go to the Chromecast settings and enable Guest Mode. -
Utilization of Immersive 360 Degree Spherical Videos and Google Cardboard in Medical Training and Simulation: a Novel and Multi-Dimensional Way of Learning
Utilization of Immersive 360 Degree Spherical Videos and Google Cardboard in Medical Training and Simulation: A Novel and Multi-dimensional Way of Learning Shoeb Mohiuddin, MD CA-2 Daniel Roshan, MD CA-2 Heike Knorpp, MD University of Illinois at Chicago Financial Disclosure We have no relevant financial or nonfinancial relationships within the products or services described, reviewed, evaluated or compared in this presentation. To view video, search on YouTube App: “STA 2016 Abstract Demo” or go to https://youtu.be/yr5EDF_taa8 Outline ● Generation X & Learning ● Experiential Learning ● 360 Degree Videos ● Google Cardboard Viewers ● Video Demonstration ● Pros & Cons ● Questions To view video, search on YouTube App: “STA 2016 Abstract Demo” or go to https://youtu.be/yr5EDF_taa8 Generation X, Technology, and Learning Majority of anesthesia residents are Millennial students with divergent learning needs from their predecessors that desire interactive learning through experiential and immersive learning. - Psychosocial influences - Physiological changes of the brain that change the way information is processed Generational difference in learning creates challenges for educators to teach trainees that speak a “different language” Be aware of cognitive biases. Keil Centre. http://www.keilcentre.co. uk/news/cognitive-biases/. Accessed: 1/3/2016. (Chu, 2012) To view video, search on YouTube App: “STA 2016 Abstract Demo” or go to https://youtu.be/yr5EDF_taa8 Educational Preferences of Millennials ● Learning and working in teams ● Structure with achievement-oriented goals ● Engagement and experience ● Visual and kinesthetic educational modalities and environments ● Learning about things that they feel matter to them (Chu, 2012) To view video, search on YouTube App: “STA 2016 Abstract Demo” or go to https://youtu.be/yr5EDF_taa8 Experiential Learning Experiential learning is referred to as learning through action, learning by doing, learning through experience, and learning through discovery and exploration. -
Design Specification
SPACETALK DESIGN SPECIFICATION TEAM Brian Orlando Eugene Meng Edward Roberts Terrie Chan SPONSORS NASA Jet Propulsion Lab MHCI+D INTRO Introduction National Aeronautics and Space Administration Those with the SpaceTalk app installed on their (NASA) spacecraft missions require scientists and mobile device can request a VR talk with other users engineers across the country to share complex and discuss complex mission information in context. mission data with each other. Yet, data such We believe that the accessibility and immersion as scientific instrument schedules, spacecraft of mobile VR will enable scientists and engineers orientation, and orbital trajectory are difficult to to collaborate with each more efficiently and convey with static presentations, texts and charts. effectively than ever before, saving NASA precious Remotely located scientists and engineers need time and resources in missions. a quick and easy means of discussing complex mission-centric data in order to make decisions, or This Design Specification is meant to describe to gain a holistic understanding of the mission. the SpaceTalk application in full to create as little friction as possible during the development process. To solve this issue, we’ve designed SpaceTalk: a It is composed of an architecture, system flow, collaborative mobile virtual reality (VR) application interaction model and visual system to create a that creates an interactive and immersive simulation holistic definition of the application. of NASA spacecraft missions. With SpaceTalk, users can -
Introduction to Immersive Realities for Educators
Introduction to Immersive Realities for Educators Contents 1. Introduction 2. Resources & Examples 3. Recommendations 4. Getting Started 5. VR Applications 6. Recording in VR 7. Using Wander 8. VR Champions 9. FAQs 10. References Introduction How VR In Education Will Change How We Learn And Teach The ever-evolving nature of technology continues to influence teaching and learning. One area where advances have impacted educational settings is immersive technology. Virtual reality (VR) immersive technologies “support the creation of synthetic, highly interactive three dimensional (3D) spatial environments that represent real or non-real situations” (Mikropoulos and Natsis, 2010, p. 769). The usage of virtual reality can be traced to the 1960s when cinematographer and inventor Morton Heiling developed the Sensorama, a machine in which individuals watched a film while experiencing a variety of multi-sensory effects, such as wind and various smells related to the scenery. In the 1980’s VR moved into professional education and training. The integration of VR in higher education became apparent in the 1990’s, and continues to be explored within colleges and universities in the 21st century. Why does it all mean? VR, AR, MR and What Does Immersion Actually Mean? Terms such as "Virtual Reality"(VR), "Augmented Reality" (AR), "Mixed Reality" (MR), and "Immersive Content" are becoming increasingly common in education and are more user-friendly and affordable than ever. Like any other technology, IR is used to introduce, support, or reinforce course learning objectives not unlike a text, film, or field trip to a museum. The major difference is that learning can be much more immersive, interactive and engaging. -
Using Virtual Reality to Engage and Instruct: a Novel Tool for Outreach and Extension Age Group: All Ages! Dr. Geoffrey Attardo
Using Virtual Reality to Engage and Instruct: A novel tool for Outreach and Extension Age Group: All Ages! Dr. Geoffrey Attardo Email: [email protected] Assistant Professor Room 37 Briggs Hall Department of Entomology and Nematology University of California, Davis Davis, California 95616 Recent developments in computer and display technologies are providing novel ways to interact with information. One of these innovations is the development of Virtual Reality (VR) hardware. Innovations in hardware and software have made this technology broadly accessible with options ranging from cell phone based VR kits made of cardboard to dedicated headsets driven by computers using powerful graphical hardware. VR based educational experiences provide opportunities to present content in a form where they are experienced in 3 dimensions and are interactive. This is accomplished by placing users in virtual spaces with content of interest and allows for natural interactions where users can physically move within the space and use their hands to directly manipulate/experience content. VR also reduces the impact of external sensory distractions by completely immersing the user in the experience. These interactions are particularly compelling when content that is only observable through a microscope (or not at all) can be made large allowing the user to experience these things at scale. This has great potential for entomological education and outreach as students can experience animated models of insects and arthropods at impossible scales. VR has great potential as a new way to present entomological content including aspects of morphology, physiology, behavior and other aspects of insect biology. This demonstration allows users of all ages to view static and animated 3D models of insects and arthropods in virtual reality. -
UPDATED Activate Outlook 2021 FINAL DISTRIBUTION Dec
ACTIVATE TECHNOLOGY & MEDIA OUTLOOK 2021 www.activate.com Activate growth. Own the future. Technology. Internet. Media. Entertainment. These are the industries we’ve shaped, but the future is where we live. Activate Consulting helps technology and media companies drive revenue growth, identify new strategic opportunities, and position their businesses for the future. As the leading management consulting firm for these industries, we know what success looks like because we’ve helped our clients achieve it in the key areas that will impact their top and bottom lines: • Strategy • Go-to-market • Digital strategy • Marketing optimization • Strategic due diligence • Salesforce activation • M&A-led growth • Pricing Together, we can help you grow faster than the market and smarter than the competition. GET IN TOUCH: www.activate.com Michael J. Wolf Seref Turkmenoglu New York [email protected] [email protected] 212 316 4444 12 Takeaways from the Activate Technology & Media Outlook 2021 Time and Attention: The entire growth curve for consumer time spent with technology and media has shifted upwards and will be sustained at a higher level than ever before, opening up new opportunities. Video Games: Gaming is the new technology paradigm as most digital activities (e.g. search, social, shopping, live events) will increasingly take place inside of gaming. All of the major technology platforms will expand their presence in the gaming stack, leading to a new wave of mergers and technology investments. AR/VR: Augmented reality and virtual reality are on the verge of widespread adoption as headset sales take off and use cases expand beyond gaming into other consumer digital activities and enterprise functionality. -
Calar: a C++ Engine for Augmented Reality Applications on Android Mobile Devices
CalAR: A C++ Engine for Augmented Reality Applications on Android Mobile Devices Menghe Zhang, Karen Lucknavalai, Weichen Liu, J ¨urgen P. Schulze; University of California San Diego, La Jolla, CA, USA Abstract With the development of Apple’s ARKit and Google’s AR- Core, mobile augmented reality (AR) applications have become much more popular. For Android devices, ARCore provides ba- sic motion tracking and environmental understanding. However, with current software frameworks it can be difficult to create an AR application from the ground up. Our solution is CalAR, which is a lightweight, open-source software environment to develop AR applications for Android devices, while giving the programmer full control over the phone’s resources. With CalAR, the pro- grammer can create marker-less AR applications which run at 60 Figure 1: CalAR’s software structure and dependencies frames per second on Android smartphones. These applications can include more complex environment understanding, physical accessed through the smartphone’s touch screen. simulation, user interaction with virtual objects, and interaction This article describes each component of the software system between virtual objects and objects in the physical environment. we built, and summarizes our experiences with two demonstration With CalAR being based on CalVR, which is our multi-platform applications we created with CalAR. virtual reality software engine, it is possible to port CalVR ap- plications to an AR environment on Android phones with minimal Related Work effort. We demonstrate this with the example of a spatial visual- In the early days of augmented reality applications on smart ization application. phones, fiducial markers located in the physical environment were used to estimate the phone’s 3D pose with respect to the envi- Introduction ronment. -
Moving Web 3D Content Into Gearvr
Moving Web 3d Content into GearVR Mitch Williams Samsung / 3d-online GearVR Software Engineer August 1, 2017, Web 3D BOF SIGGRAPH 2017, Los Angeles Samsung GearVR s/w development goals • Build GearVRf (framework) • GearVR Java API to build apps (also works with JavaScript) • Play nice with other devices • Wands, Controllers, I/O devices • GearVR apps run on Google Daydream ! • Performance, New Features • Fight for every Millisecond: • Android OS, Oculus, GPU, CPU, Vulkun • Unity, Unreal, GearVRf (framework) • Enable content creation • Game developers, 3D artists, UI/UX people, Web designers Content Creation for GearVR • 360 movies • Game Editors: Unity, Unreal • GearVRf (framework) • Open source Java api, JavaScript bindings • WebVR • WebGL; frameworks: A-frame, Three.js, React, X3Dom • 3d file formats • Collada, .FBX, gltf, .OBJ &.mtl, etc. using Jassimp • Java binding for Assimp (Asset Import Library) • X3D Why implement X3D in GearVR • Samsung began this effort February, 2016 • X3D is a widely supported file format • Exported by 3DS Max, Blender, Maya, Moto • Or exports VRML and converts to X3D • No other file format had similar capabilities. • Interactivity via JavaScript • Declarative format easy to edit / visualize the scene. • GearVR is not just a VR game console like Sony PSVR • We are a phone, web access device, camera, apps platform • X3D enables web applications: • Compliments the game influence in GearVR from Unity, Unreal. • Enables new VR web apps including: Google Maps, Facebook, Yelp JavaScript API’s. GearVR app Build Runtime Live Demo Very daring for the presenter who possesses no art skills. • 3ds Max 1. Animated textured objects 2. Export VRML97, Convert with “Instant Reality” to X3D • Android Studio 1. -
Augmenting the Future: AR's Golden Opportunity
Industries > Media & Entertainment Augmenting the Future: AR’s Golden Opportunity AR exploded into mainstream attention with Pokémon Go – now the industry prepares for the first product cycle where AR is in the spotlight Industries > Media & Entertainment Augmenting the Future: AR’s Golden Opportunity AR exploded into mainstream attention with Pokémon Go – now the industry prepares for the first product cycle where AR is in the spotlight Abstract: Augmented Reality (AR) is a technology that has flown under most people’s radar as its cousin, virtual reality, has garnered a larger share of headlines. Catapulted into public attention through the overwhelming success of Pokémon Go, consumers have become aware of the existence of AR while Apple / Google have rushed to create tools for developers to make apps for the AR ecosystem. Within the consumer segment of AR, Apple can leverage its tightly controlled ecosystem and brand loyalty to quickly build a sizable installed base of AR-ready phones. However, within the enterprise segment, Google has quietly been piloting an updated version of the Google Glass to much success. As the consumer ecosystem continues to mature, the onus is now on content developers to create apps that take full advantage of AR capabilities to create valuable user experiences for consumers. False Starts and Small Niches Augmented reality, like its cousin virtual reality, is a concept that has been under development for decades. The first workable AR prototypes were available in the early 1990s, but the technology stayed under the radar for most companies and consumers until the ill-fated launch of Google Glass in 2013.