DOCSLIB.ORG

Augmented Reality in Sumerian

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Augmented Reality in Sumerian Amazon Sumerian Amazon Sumerian by Tutorials By Brian Moakley & Gur Raunaq Singh Copyright ©2019 Razeware LLC. Notice of Rights All rights reserved. No part of this book or corresponding materials (such as text, images, or source code) may be reproduced or distributed by any means without prior written permission of the copyright owner. Notice of Liability This book and all corresponding materials (such as source code) are provided on an “as is” basis, without warranty of any kind, express or implied, including but not limited to the warranties of merchantability, fitness for a particular purpose, and noninfringement. In no event shall the authors or copyright holders be liable for any claim, damages or other liability, whether in action of contract, tort or otherwise, arising from, out of or in connection with the software or the use of other dealing in the software. Trademarks All trademarks and registered trademarks appearing in this book are the property of their own respective owners. raywenderlich.com 2 Amazon Sumerian Table of Contents: Overview About the Cover...................................................................................... 13 What You Need........................................................................................ 17 Book License............................................................................................. 19 Project Files & Forum............................................................................ 20 Foreword.................................................................................................... 21 Introduction.............................................................................................. 23 Section I: Creating an Escape Room............................. 26 Chapter 1: Getting Started with Amazon Sumerian................. 28 Chapter 2: Building the Escape Room ............................................ 39 Chapter 3: Entities & Materials......................................................... 60 Chapter 4: Adding Interactivity with Behaviors......................... 96 Chapter 5: Attributes & Branching Logic ................................... 127 Chapter 6: Physics ............................................................................... 162 Chapter 7: Virtual Reality................................................................. 188 Chapter 8: Post Effects & Publishing Your Scene.................... 204 Section II: Building an Educational Experience 221..... Chapter 9: Custom Models & Sound............................................ 223 Chapter 10: Lights, Camera, Action.............................................. 250 Chapter 11: Introduction to JavaScript ...................................... 281 Chapter 12: The Sumerian API....................................................... 304 Chapter 13: Animation & Particle Systems ............................... 330 raywenderlich.com 3 Amazon Sumerian Chapter 14: Incorporating Web Content................................... 365 Section III: Creating an Augmented Reality Experience ......................................................................... 385 Chapter 15: Preparing Your Mobile Development Environment........................................................................................... 386 Chapter 16: Augmented Reality in Sumerian ........................... 415 Chapter 17: Fetching Data from DynamoDB ........................... 432 Chapter 18: Completing the Augmented Reality App .......... 456 Section IV: Creating a Virtual Travel Agent ............ 482 Chapter 19: Basics of a Sumerian Host....................................... 483 Chapter 20: Speech in Amazon Sumerian.................................. 500 Chapter 21: Audio Input & Lex ....................................................... 511 Chapter 22: Integrating Amazon Lambda with Lex................ 530 Conclusion .............................................................................................. 545 raywenderlich.com 4 Amazon Sumerian Table of Contents: Extended About the Cover . 13 About the Authors . 16 About the Editor . 16 About the Artists . 16 What You Need . 17 Book License . 19 Project Files & Forum . 20 Foreword . 21 Introduction . 23 Section I: Creating an Escape Room. 26 Chapter 1: Getting Started with Amazon Sumerian . 28. Creating an AWS Account . 30 Creating an IAM account . 34 Key points. 38 Where to go from here?. 38 Chapter 2: Building the Escape Room . 39 Launching Sumerian . 39 Using the Sumerian editor . 41 Configuring Firefox . 43 Navigating the Canvas . 44 Creating a secret door . 53 Challenges . 55 Key points. 59 Where to go from here?. 59 Chapter 3: Entities & Materials . 60 Diving deeper into entities. 60 raywenderlich.com 5 Amazon Sumerian Components . 62 Getting in sync . 63 Parenting entities . 70 Adjusting the Lights. 72 Using materials . 75 Adding models . 84 Challenge . 89 Key points. 95 Where to go from here?. 95 Chapter 4: Adding Interactivity with Behaviors . 96 Setting up the Player Camera. 97 Adding interactivity . 101 Sending messages . 105 Light switch puzzle . 115 Revealing the next clue . 118 Key points . 125 Where to go from here? . 126 Chapter 5: Attributes & Branching Logic. 127 Setting up the puzzle pieces . 128 Building logic with attributes. 134 Building a branching behavior. 136 Using multiple clues . 150 Challenge. 157 Key points . 161 Where to go from here? . 161 Chapter 6: Physics. 162 Setting up the third puzzle . 162 Using Rigid Bodies. 165 Adding colliders . 168 Adding velocity . 171 raywenderlich.com 6 Amazon Sumerian Listening for collisions. 179 Escaping the escape room . 182 Key points . 186 Where to go from here? . 186 Chapter 7: Virtual Reality . 188 Configuring Sumerian to use VR . 189 Setting up a tethered headset . 190 Setting up an untethered headset. ..
Load more

Recommended publications
  • Building Resilience for the Long Run
    Building Resilience for the Long Run How Travel & Hospitality companies can stay agile during business disruption COPYRIGHT 2020, AMAZON WEB SERVICES, INC. OR ITS AFFILIATES 1 About AWS Travel and Hospitality WS Travel and Hospitality is the global industry practice for Amazon Web Services (AWS), with a charter to support customers as they accelerate cloud adoption. Companies around the world, across every segment of the travel and hospitality industry - and of every size - run on AWS. This includes industry leaders like Airbnb, Avis Budget Group, Best Western, Choice Hotels, DoorDash, Dunkin’ Brands, Expedia Group, Korean Air, McDonald’s, Ryanair, SiteMinder, Sysco, Toast, United Airlines, and Wyndham Hotels. These companies and many others are transforming their business by leveraging technology to enhance customer experiences and increase operational efficiency. For more information about AWS Travel and Hospitality, please visit aws.com/travel. Keep up-to-date with executive insights and industry viewpoints at the AWS Travel and Hospitality Blog. Click here to be contacted by an AWS representative. COPYRIGHT 2020, AMAZON WEB SERVICES, INC. OR ITS AFFILIATES AWS.COM/TRAVEL 2 Foreword It has been said that challenges should not paralyze you but help discover who you are. We have seen time and again that immense challenges can bring about incredible innovation. That is especially true today. Around the globe, travel and hospitality companies are taking advantage of the flexibility of the AWS Cloud to innovate quickly and meet their needs during these trying times. Faced with disruption – whether a localized weather event or a pandemic that spans continents – travel and hospitality companies respond and rebuild.
    [Show full text]
  • Google ARCORE
    Google ARCORE Nisfu Asrul Sani @ Lab Langit 9 - PENS 20 - 22 November 2017 environtment Setting up your development environment Install the Android SDK version 7.0 (API Level 24) or higher. To install the Android SDK, install Android Studio. To update the Android SDK, use the Android SDK Manager tool in Android Studio. Install Unity 2017.2 Beta 11 or higher, with the Android Build Support component. For more info, see Downloading and Installing Unity. You will need to get the ARCore SDK for Unity. You can either: Download the SDK Preview for Unity and extract it. -or- Clone the repository with the following command: git clone https://github.com/google-ar/arcore-unity-sdk.git Prepare your device You must use a supported, physical device. ARCore does not support virtual devices such as the Android Emulator. To prepare your device: Enable developer options Enable USB debugging Install the ARCore Service on the device: Download the ARCore Service Connect your Android device to the development machine with a USB cable Install the service by running the following adb command: adb install -r -d arcore-preview.apk https://play.google.com/store/apps/details?id=com.un Additional ity3d.genericremote Supported Devices ARCore is designed to work on a wide variety of qualified Android phones running N and later. During the SDK preview, ARCore supports the following devices: Google Pixel, Pixel XL, Pixel 2, Pixel 2 XL Samsung Galaxy S8 (SM-G950U, SM-G950N, SM- G950F, SM-G950FD, SM-G950W, SM-G950U1) Initially, ARCore will only work with Samsung’s S8 and S8+ and Google’s Pixel phone, but by the end of the year, Google promised to have support for 100 million Android phones, including devices from LG, Huawei and Asus, among others.
    [Show full text]
  • Augmented Reality (AR) Indoor Navigation Mobile Application
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Sunway Institutional Repository Design of a Mobile Augmented Reality-based Indoor Navigation System Xin Hui Ng, Woan Ning Lim Research Centre for Human-Machine Collaboration Department of Computing and Information Systems School of Science and Technology Sunway University, Malaysia ( [email protected], [email protected] ) Abstract— GPS-based navigation technology has been widely immersive virtual navigation direction. A mobile application used in most of the commercial navigation applications prototype was developed in this project to provide navigation nowadays. However, its usage in indoor navigation is not as within Sunway University campus. effective as when it is used at outdoor environment. Much research and developments of indoor navigation technology II. RELATED WORK involve additional hardware installation which usually incur high An indoor navigation system is comprised of 3 important setup cost. In this paper, research and comparisons were done to components which are positioning, wayfinding, and route determine the appropriate techniques of indoor positioning, pathfinding, and route guidance for an indoor navigation guidance. Positioning refers to determining user’s current method. The aim of this project is to present a simple and cost- position, while wayfinding focuses on searching the route from effective indoor navigation system. The proposed system uses the user’s position to a specific destination. Route guidance is the existing built-in sensors embedded in most of the mobile devices navigation directions illustrating the route. to detect the user location, integrates with AR technology to A. Indoor Positioning Techniques provide user an immersive navigation experience.
    [Show full text]
  • Amazon Polly: Use Cases
    A I M 3 0 3 Stop guessing: Use AI to understand customer conversations Dirk Fröhner Boaz Ziniman Senior Solutions Architect Principal Technical Evangelist Amazon Web Services Amazon Web Services © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Agenda • Introduction Amazon Web Services (AWS) AI/ML offering • Introduction Amazon Connect • Architecture of the labs • Work on the labs • Wrap-up Related breakouts • AIM211 - AI document processing for business automation • AIM212 - ML in retail: Solutions that add intelligence to your business • AIM222 - Monetizing text-to-speech AI • AIM302 - Create a Q&A bot with Amazon Lex and Amazon Alexa © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Natural language processing (NLP) • Automatic speech recognition (ASR) • Natural language understanding (NLU) • Text to speech • Translation @ziniman @ziniman Use cases for NLP Voice of customer Knowledge management Education applications Customer service/ Semantic search Accessibility call centers Enterprise Captioning workflows Information bots digital assistant Personalization Localization The Amazon ML stack: Broadest & deepest set of capabilities Vision Speech Language Chatbots Forecasting Recommendations A I s e r v i c e s A m a z o n A m a z o n T r a n s l a t e A m a z o n A m a z o n A m a z o n A m a z o n A m a z o n C o m p r e h e n d A m a z o n A m a z o n A m a z o n Rekognition Rekognition T e x t r a c t P o l l y T r a n s c r i b e & A m a z o n L e x F o r e c a s t Personalize i m a
    [Show full text]
  • New Realities Risks in the Virtual World 2
    Emerging Risk Report 2018 Technology New realities Risks in the virtual world 2 Lloyd’s disclaimer About the author This report has been co-produced by Lloyd's and Amelia Kallman is a leading London futurist, speaker, Amelia Kallman for general information purposes only. and author. As an innovation and technology While care has been taken in gathering the data and communicator, Amelia regularly writes, consults, and preparing the report Lloyd's does not make any speaks on the impact of new technologies on the future representations or warranties as to its accuracy or of business and our lives. She is an expert on the completeness and expressly excludes to the maximum emerging risks of The New Realities (VR-AR-MR), and extent permitted by law all those that might otherwise also specialises in the future of retail. be implied. Coming from a theatrical background, Amelia started Lloyd's accepts no responsibility or liability for any loss her tech career by chance in 2013 at a creative or damage of any nature occasioned to any person as a technology agency where she worked her way up to result of acting or refraining from acting as a result of, or become their Global Head of Innovation. She opened, in reliance on, any statement, fact, figure or expression operated and curated innovation lounges in both of opinion or belief contained in this report. This report London and Dubai, working with start-ups and corporate does not constitute advice of any kind. clients to develop connections and future-proof strategies. Today she continues to discover and bring © Lloyd’s 2018 attention to cutting-edge start-ups, regularly curating All rights reserved events for WIRED UK.
    [Show full text]
  • Exploring Telepresence in Virtual Worlds
    Exploring Telepresence in Virtual Worlds Dan Zhang z3378568 A thesis in fulfillment of the requirements for the degree of Doctor of Philosophy School of Information Systems and Technology Management UNSW Business School March 2018 PLEASE TYPE THE UNIVERSITY OF NEW SOUTH WALES Thesis/Dissertation Sheet Surname or Family name: Zhang First name: Dan Other name/s: Abbreviation for degree as given in the University calendar: PhD School: School of Information Systems and Technology Management Faculty: UNSW Business School Title: Exploring telepresence in virtual worlds Abstract 350 words maximum: (PLEASE TYPE) Virtual worlds, as the computer-based simulated environments incorporating various representations of real-world elements, have great potential to not only transform the structures and operation modes of various industries but also change the way people work, do business, learn, play, and communicate. However, the existing sharp distinctions between virtual worlds and the real world also bring critical challenges. To address these challenges, the concept of telepresence—the user’s feeling of ‘being there’ in the virtual environments—is adopted as it is considered a direct and essential consequence of a virtual world’s reality. To cultivate this feeling, it is essential to understand what factors can lead to telepresence. However, some literature gaps on telepresence antecedents impede the understanding of telepresence antecedents and affect the adoption of the telepresence construct in the design of virtual worlds. To address these issues, this study explores the concept of telepresence in the context of virtual worlds. Specifically, by adopting means-end chain (MEC) theory, the study aims to investigate the antecedents of telepresence; to reveal the inter-relationships among these antecedents by building a hierarchical structure; and to develop an innovative approach for user segmentation to understand in-depth individual differences in perceiving telepresence.
    [Show full text]
  • “Jeff, What Does Day 2 Look Like?” That's a Question I Just Got at Our
    “Jeff, what does Day 2 look like?” That’s a question I just got at our most recent all-hands meeting. I’ve been reminding people that it’s Day 1 for a couple of decades. I work in an Amazon building named Day 1, and when I moved buildings, I took the name with me. I spend time thinking about this topic. “Day 2 is stasis. Followed by irrelevance. Followed by excruciating, painful decline. Followed by death. And that is why it is always Day 1.” To be sure, this kind of decline would happen in extreme slow motion. An established company might harvest Day 2 for decades, but the final result would still come. I’m interested in the question, how do you fend off Day 2? What are the techniques and tactics? How do you keep the vitality of Day 1, even inside a large organization? Such a question can’t have a simple answer. There will be many elements, multiple paths, and many traps. I don’t know the whole answer, but I may know bits of it. Here’s a starter pack of essentials for Day 1 defense: customer obsession, a skeptical view of proxies, the eager adoption of external trends, and high-velocity decision making. True Customer Obsession There are many ways to center a business. You can be competitor focused, you can be product focused, you can be technology focused, you can be business model focused, and there are more. But in my view, obsessive customer focus is by far the most protective of Day 1 vitality.
    [Show full text]
  • Cloud Methodologies for a Seamless Integrated Chatbot
    Published by : International Journal of Engineering Research & Technology (IJERT) http://www.ijert.org ISSN: 2278-0181 Vol. 9 Issue 08, August-2020 Cloud Methodologies for A Seamless Integrated Chatbot Sharan Kumar Paratala Rajagopal IEEE Member Senior Manager, Capgemini America, Inc. Dallas, Texas, USA Abstract—This research paper provides details of connecting C. Seamless AWS integrations Amazon connect to Amazon pinpoint to send SMS and also Amazon Lex provides built-in integration with AWS provides some insights on how it can be integrated with social Lambda and Amazon CloudWatch and you can easily platforms such as Facebook messaging and WhatsApp. Amazon integrate with many other services on the AWS platform Lex can be leveraged as standalone bot on the website or can be including Amazon Cognito and Amazon DynamoDB. You triggered from Amazon connect for Intelligent voice responses. can take advantage of the power of the AWS platform for Keywords—Amazon Lex, Amazon Connect, Amazon Pinpoint, security, monitoring, user authentication, business logic, WhatsApp, Facebook Messaging. storage and mobile app development. I. INTRODUCTION D. Cost effective Amazon Lex [1] is a service for building conversational With Amazon Lex, there are no upfront costs or minimum interfaces into any application using voice and text. Amazon fees. You are only charged for the text or speech requests that Lex provides the advanced deep learning functionalities of are made. Amazon Lex’ pay-as-you-go pricing and low cost automatic speech recognition (ASR) for converting speech to per request makes it a cost-effective way to build text, and natural language understanding (NLU) to recognize conversational interfaces anywhere.
    [Show full text]
  • Calar: a C++ Engine for Augmented Reality Applications on Android Mobile Devices
    CalAR: A C++ Engine for Augmented Reality Applications on Android Mobile Devices Menghe Zhang, Karen Lucknavalai, Weichen Liu, J ¨urgen P. Schulze; University of California San Diego, La Jolla, CA, USA Abstract With the development of Apple’s ARKit and Google’s AR- Core, mobile augmented reality (AR) applications have become much more popular. For Android devices, ARCore provides ba- sic motion tracking and environmental understanding. However, with current software frameworks it can be difficult to create an AR application from the ground up. Our solution is CalAR, which is a lightweight, open-source software environment to develop AR applications for Android devices, while giving the programmer full control over the phone’s resources. With CalAR, the pro- grammer can create marker-less AR applications which run at 60 Figure 1: CalAR’s software structure and dependencies frames per second on Android smartphones. These applications can include more complex environment understanding, physical accessed through the smartphone’s touch screen. simulation, user interaction with virtual objects, and interaction This article describes each component of the software system between virtual objects and objects in the physical environment. we built, and summarizes our experiences with two demonstration With CalAR being based on CalVR, which is our multi-platform applications we created with CalAR. virtual reality software engine, it is possible to port CalVR ap- plications to an AR environment on Android phones with minimal Related Work effort. We demonstrate this with the example of a spatial visual- In the early days of augmented reality applications on smart ization application. phones, fiducial markers located in the physical environment were used to estimate the phone’s 3D pose with respect to the envi- Introduction ronment.
    [Show full text]
  • Metaverse Roadmap Overview, 2007. 2007
    A Cross-Industry Public Foresight Project Co-Authors Contributing Authors John Smart, Acceleration Studies Foundation Corey Bridges, Multiverse Jamais Cascio, Open the Future Jochen Hummel, Metaversum Jerry Paffendorf, The Electric Sheep Company James Hursthouse, OGSi Randal Moss, American Cancer Society Lead Reviewers Edward Castronova, Indiana University Richard Marks, Sony Computer Entertainment Alexander Macris, Themis Group Rueben Steiger, Millions of Us LEAD SPONSOR FOUNDING PARTNERS Futuring and Innovation Center Graphic Design: FizBit.com accelerating.org metaverseroadmap.org MVR Summit Attendees Distinguished industry leaders, technologists, analysts, and creatives who provided their insights in various 3D web domains. Bridget C. Agabra Project Manager, Metaverse Roadmap Project Patrick Lincoln Director, Computer Science Department, SRI Janna Anderson Dir. of Pew Internet’s Imagining the Internet; Asst. International Prof. of Communications, Elon University Julian Lombardi Architect, Open Croquet; Assistant VP for Tod Antilla Flash Developer, American Cancer Society Academic Services and Technology Support, Office of Information Technology Wagner James Au Blogger, New World Notes; Author, The Making of Second Life, 2008 Richard Marks Creator of the EyeToy camera interface; Director of Special Projects, Sony CEA R&D Jeremy Bailenson Director, Virtual Human Interaction Lab, Stanford University Bob Moore Sociologist, Palo Alto Research Center (PARC), PlayOn project Betsy Book Director of Product Management, Makena Technologies/There;
    [Show full text]
  • Mobile AR/VR with Edge-Based Deep Learning Jiasi Chen Department of Computer Science & Engineering University of California, Riverside
    Mobile AR/VR with Edge-based Deep Learning Jiasi Chen Department of Computer Science & Engineering University of California, Riverside CNSM Oct. 23, 2019 Outline • What is AR/VR? • Edge computing can provide... 1. Real-time object detection for mobile AR 2. Bandwidth-efficient VR streaming with deep learning • Future directions 2 What is AR/VR? 3 End users Multimedia is… Audio On-demand video Internet Live video Content creation Compression Storage Distribution Virtual and augmented reality 4 What is AR/VR? | | | | virtual reality augmented virtuality augmented reality reality mixed reality 5 Who’s Using Virtual Reality? Smartphone-based hardware: Google Cardboard Google Daydream High-end hardware: 6 Playstation VR HTC Vive Why VR now? Portability (1) Have to go somewhere (2) Watch it at home (3) Carry it with you Movies: VR: CAVE (1992) Virtuality gaming (1990s) Oculus Rift (2016) Similar portability trend for VR, driven by hardware advances from the smartphone revolution.7 Who’s Using Augmented Reality? Smartphone- based: Pokemon Go Google Translate (text processing) Snapchat filters (face detection) High-end hardware: Google Glasses Microsoft Hololens 8 Is it all just fun and games? • AR/VR has applications in many areas: Data visualization Education Public Safety • What are the engineering challenges? • AR: process input from the real world (related to computer vision, robotics) • VR: output the virtual world to your display (related to computer graphics) 9 How AR/VR Works 1. Virtual world 3. Render 4. Display VR: generation 2. Real object detection AR: 4. Render 5. Display 1. Device tracking 10 What systems functionality is currently available in AR/VR? 11 Systems Support for VR Game engines • Unity • Unreal 1.
    [Show full text]
  • Augmenting the Future: AR's Golden Opportunity
    Industries > Media & Entertainment Augmenting the Future: AR’s Golden Opportunity AR exploded into mainstream attention with Pokémon Go – now the industry prepares for the first product cycle where AR is in the spotlight Industries > Media & Entertainment Augmenting the Future: AR’s Golden Opportunity AR exploded into mainstream attention with Pokémon Go – now the industry prepares for the first product cycle where AR is in the spotlight Abstract: Augmented Reality (AR) is a technology that has flown under most people’s radar as its cousin, virtual reality, has garnered a larger share of headlines. Catapulted into public attention through the overwhelming success of Pokémon Go, consumers have become aware of the existence of AR while Apple / Google have rushed to create tools for developers to make apps for the AR ecosystem. Within the consumer segment of AR, Apple can leverage its tightly controlled ecosystem and brand loyalty to quickly build a sizable installed base of AR-ready phones. However, within the enterprise segment, Google has quietly been piloting an updated version of the Google Glass to much success. As the consumer ecosystem continues to mature, the onus is now on content developers to create apps that take full advantage of AR capabilities to create valuable user experiences for consumers. False Starts and Small Niches Augmented reality, like its cousin virtual reality, is a concept that has been under development for decades. The first workable AR prototypes were available in the early 1990s, but the technology stayed under the radar for most companies and consumers until the ill-fated launch of Google Glass in 2013.
    [Show full text]