DOCSLIB.ORG

The Augmented Tegra Experience Agenda

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
The Augmented Tegra Experience Agenda The Augmented Tegra Experience Agenda § Introduction to metaio § Overview of AR development processes and deployment to a mobile platform. § Example applications on a Tegra 4 ‘Dalmore’ platform § Consider some of the new features of the Tegra 4 platform § Look forward to some of the developments in open APIs from the perspective of an AR application developer AR Food Chain – Always ON, Always Augmented! Hardware Software Content Users Acceleration AR Applications AR Usage AR Content Access Augmented Reality Development Overview • Content Creation and Curation – most content formats supported • Deployment Options – Compatible with most CDN & Cloud Services • Platform Agnostic – ‘Write once’ Applications • Platform Performance Enhancement – Optimization & Acceleration Creator – Overview Display Display 3D Video Model Marker Display Image Display Audio Creator – Tegra 4 Example § Non-optimized ‘Junaio’ port § High polygon count ~35K∆ § High frame rate animation >25fps Junaio Demo – Screen Shot Junaio Browser running on nVidia ‘Dalmore’ Tegra 4 Development Platform Metaio SDK - Overview § Optimized client-based visual 4.1 search for a large number of 2D targets § Improved stability, robustness and performance of ID Marker and 2D marker-less tracking § Improved performance of 3D object tracking and teaching § SLAM integration § Sensor fusion with visual-based tracking § AREL support SDK Overview § Application Development Libraries § Xcode/Eclipse Development environments § Unity Plugin § Integrated Renderer § Fully functional free version (watermark) § 2D and 3D Tracking versions available (multiple OS license) § Developer Portal (user forums, FAQ, helpdesk) § Developer Certification Program § Supports AREL AR Stack AR Applications Application AREL: Augmented Reality Experience Language, Interpreter(AREL) proprietary* from metaio Java, Objective C, C++ Android Windows iOS SDK: SDK: SDK: Objective C Java C++ AREL AREL AREL SW level Platform-specific programming interfaces Sensor- Rendering Capturing Tracking interface metaio native SDK OS (iOS, Android, Windows 7/8) SW DRIVER HW level Acceleration(AREngine) What is AREL? • Augmented Reality Experience Language is • a unique combination of XML, Javascript and HTML5 • Content (XML) • Interaction and AR (Javascript) • UI (HTML5) • Available in: • junaio (via channels) • metaio SDK • Produced by: • Creator 2.0 onwards • Developers using SDK ‘Big Kid’ Application Demo – Screen Shot • Full frame rate video • Fast load time • Instant marker registration • Check out the application at: - • http://tiny.cc/oixauw SDK based application running on nVidia ‘Dalmore’ Tegra 4 Development Platform Mobile AR Deployment Trends • 2D/Marker based 3D/Marker-less Tracking • Single function ‘AR’ apps AR embedded into multi-function apps • Click to Scan Always On • Content kick-off Photo realistic 3D Content • 2D imaging DoF Imaging • Hand held Head mounted • Fixed ‘channel’ content Unlimited ‘cloud’ content • Visual tracking Sensor fusion • Touch GUI Integrated gesture, Iris tracking, voice recognition • Viewfinder Translucent Screens Mobile AR Deployment Challenges § Content, Content, Content! § Instantaneous ‘Z’ data § ‘Time stamped’ Sensor information § System power efficiency § Cloud access performance § Data API § Platform variation (Android ecosystem) and emerging OS Tegra 4 – First Impressions § OOB experience with 4.2.2 § Excellent GPU performance § Camera API calls work! § CPE – good platform for accelerating CV requirements § Enhanced imaging possibilities § Utilize more Unity features: - — Real time lighting/shadows — Translucency effects — Material effects http://www.facebook.com/metaio @twitt_AR http://twitter.com/#!/twitt_AR http://augmentedblog.wordpress.com/ http://www.flickr.com/photos/metaio/ http://www.youtube.com/user/metaioAR Phone (EMEA): +49-89-5480-198-0 [email protected] Phone (US): +1-415-814-3376 www.metaio.com .
Load more

Recommended publications
  • A Language for Modelling Contextual Augmented Reality Environments Dariusz Rumiński, Krzysztof Walczak
    CARL: A Language for Modelling Contextual Augmented Reality Environments Dariusz Rumiński, Krzysztof Walczak To cite this version: Dariusz Rumiński, Krzysztof Walczak. CARL: A Language for Modelling Contextual Augmented Reality Environments. 5th Doctoral Conference on Computing, Electrical and Industrial Systems (DoCEIS), Apr 2014, Costa de Caparica, Portugal. pp.183-190, 10.1007/978-3-642-54734-8_21. hal- 01274770 HAL Id: hal-01274770 https://hal.inria.fr/hal-01274770 Submitted on 16 Feb 2016 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Distributed under a Creative Commons Attribution| 4.0 International License CARL: A Language for Modelling Contextual Augmented Reality Environments Dariusz Rumi ński, Krzysztof Walczak Pozna ń University of Economics Niepodległo ści 10, 61-875 Pozna ń, Poland {ruminski, walczak}@kti.ue.poznan.pl Abstract. The paper describes a novel, declarative language that enables modelling ubiquitous, contextual and interactive augmented reality environments. The language, called CARL – Contextual Augmented Reality Language, is highly componentised with regards to both the structure of AR scenes as well as the presented AR content. This enables dynamic composition of CARL presentations based on various data sources and depending on the context.
    [Show full text]
  • On-The-Fly Dense 3D Surface Reconstruction for Geometry-Aware Augmented Reality
    On-the-fly Dense 3D Surface Reconstruction for Geometry-Aware Augmented Reality by Long Chen Faculty of Science & Technology Bournemouth University Supervised by Prof. Wen Tang, Prof. Nigel W. John and Prof. Jian J. Zhang A thesis submitted in partial fulfilment of the requirements of Bournemouth University for the degree of Doctor of Philosophy Oct. 2018 Copyright Statement This copy of the thesis has been supplied on condition that anyone who consults it is understood to recognise that its copyright rests with its author and due acknowledgement must always be made of the use of any material contained in, or derived from, this thesis. Abstract Augmented Reality (AR) is an emerging technology that makes seamless connections between virtual space and the real world by superimposing computer-generated information onto the real-world environment. AR can provide additional information in a more intuitive and natural way than any other information-delivery method that a human has ever in- vented. Camera tracking is the enabling technology for AR and has been well studied for the last few decades. Apart from the tracking problems, sensing and perception of the surrounding environment are also very im- portant and challenging problems. Although there are existing hardware solutions such as Microsoft Kinect and HoloLens that can sense and build the environmental structure, they are either too bulky or too expensive for AR. In this thesis, the challenging real-time dense 3D surface reconstruction technologies are studied and reformulated for the reinvention of basic position-aware AR towards geometry-aware and the outlook of context- aware AR.
    [Show full text]
  • Rockbridge Report Thursday, April 7, 2016 Rockbridgereport.Wlu.Edu
    Villanova Wildcats win CEOs band together in NCAA National North Carolina against Championship | 8 transgender law | 4 ROCKBRIDGE REPORT Thursday, April 7, 2016 rockbridgereport.wlu.edu What’s Inside Refugees find a home in Rockbridge Anita Filson appointed Rockbridge County’s Refugee Working Group started gathering volunteers, clothes and furniture months before the new judge of Rockbridge County Circuit Court. Congolese family of eight arived in March. See page 2 By John Tompkins Rockbridge Area Health After lengthy flight delays and Center expands space temporarily losing all of their bag- gage, the Msimbwas, a family of and services. eight Congolese refugees, finally See page 3 arrived in town March 11. Their arrival is the culmination of efforts by the Refugee Working Group, an Donald Trump backtracks interfaith coalition that is working to resettle refugees in Rockbridge to appeal to women County. voters after abortion “I’m very happy, it’s a very pleas- comments. ing atmosphere,” said Fahizi See page 4 Msimbwa, the family’s father. “I’m especially happy with the peo- ple who already showed me the school. Everyone’s very welcom- Broadband high-speed i n g .” internet to become Eighty local residents welcomed a reality for BARC their new neighbors at an in- customers. formational meeting at Lylburn Downing Middle School a few See page 5 days after their arrival. “The meeting last night was to learn a little bit about what has With the help of the Refugee Working Group, the Msimbwa family is getting acclimated to life in Lexington. Local residents welcomed their new neighbors at New practice fields an informational meeting at Lylburn Downing Middle School on March 15.
    [Show full text]
  • Augmented Reality
    Augmented Reality: A Review of available Augmented Reality packages and evaluation of their potential use in an educational context November 2010 Stephen Rose Dale Potter Matthew Newcombe Unlocking the Hidden Curriculum University of Exeter Learning and Teaching Innovation Grants (04/08) 2 Contents 1. Augmented Reality Page 4 2. Augmented Reality in Education 6 3. Augmented Reality Applications 8 3.1 Marker-based Augmented Reality 8 3.2 Markerless Augmented Reality 10 4. Available Augmented Reality Technologies 12 4.1 Current Smartphone Ownership Patterns 12 4.2 Platforms 16 4.3 AR Software 19 5. Technical Considerations 22 5.1 Limitations of Current Platforms 24 6. Choosing an Augmented Reality System 24 7. Glossary 28 8. References 29 9. Appendix 1: Unlocking the Hidden Curriculum - a JISC- 31 funded Learning and Teaching Innovation Project at the University of Exeter This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 2.0 Licence. To view a copy of this licence, visit: http://creativecommons.org/licenses/by-nc-sa/2.0/uk or send a letter to: Creative Commons, 171 Second Street, Suite 300, San Francisco, California, 94105, USA. 3 1. ‘Augmented Reality’ Every now and again a ‘new technology’ appears which seems to capture the public imagination. Invariably the technology enables a new means of interacting with screen-based entertainment or a computer game - 3DTV, the Nintendo Wii. The proliferation of so-called ‘smartphones’ with their abilities to run once-complex computer applications, in-built cameras and ‘GPS’ capability has unleashed the potential of ‘Augmented Reality’ – to date a regular feature of science fiction or ‘near future’ movies.
    [Show full text]
  • Apple Strategy Teardown
    Apple Strategy Teardown The maverick of personal computing is looking for its next big thing in spaces like healthcare, AR, and autonomous cars, all while keeping its lead in consumer hardware. With an uphill battle in AI, slowing growth in smartphones, and its fingers in so many pies, can Apple reinvent itself for a third time? In many ways, Apple remains a company made in the image of Steve Jobs: iconoclastic and fiercely product focused. But today, Apple is at a crossroads. Under CEO Tim Cook, Apple’s ability to seize on emerging technology raises many new questions. Primarily, what’s next for Apple? Looking for the next wave, Apple is clearly expanding into augmented reality and wearables with the Apple Watch AirPods wireless headphones. Though delayed, Apple’s HomePod speaker system is poised to expand Siri’s footprint into the home and serve as a competitor to Amazon’s blockbuster Echo device and accompanying virtual assistant Alexa. But the next “big one” — a success and growth driver on the scale of the iPhone — has not yet been determined. Will it be augmented reality, healthcare, wearables? Or something else entirely? Apple is famously secretive, and a cloud of hearsay and gossip surrounds the company’s every move. Apple is believed to be working on augmented reality headsets, connected car software, transformative healthcare devices and apps, as well as smart home tech, and new machine learning applications. We dug through Apple’s trove of patents, acquisitions, earnings calls, recent product releases, and organizational structure for concrete hints at how the company will approach its next self-reinvention.
    [Show full text]
  • In Darwin's Garden: an Evolutionary Exploration of Augmented Reality In
    In Darwin’s Garden: an evolutionary exploration of augmented reality in practice Item Type Book chapter Authors Summers, Alan Citation Summers, A. (2020). ‘In Darwin’s Garden: an evolutionary exploration of augmented reality in practice, In Earnshaw, R., Liggett, S., Excell, P., Thalmann, D. (Eds). Technology, Design and the Arts - Challenges and Opportunities. Springer International Publishing Publisher Springer International Publishing Rights Attribution-NonCommercial-NoDerivatives 4.0 International Download date 28/09/2021 19:30:23 Item License http://creativecommons.org/licenses/by/4.0/ Link to Item http://hdl.handle.net/10034/623088 Chapter x In Darwin’s Garden: an evolutionary exploration of augmented reality in practice Alan Summers University of Chester [email protected] Abstract This chapter discusses the rapid developments in augmented reality and mixed reality technologies, from a practitioner’s perspective of making the augmented reality sculptural work In Darwin’s Garden. From its conception in 2012, to its exhibition at Carbon Meets Silicon II in 2017, the advances in augmented reality technology led to an interplay between the goal of the creators and the technological realisation of that vision. The art, design and technology involved, generated a reactive process that was mired in external influences as the accessibility to augmented reality became commercially valuable and subsequently restricted. This chapter will be of interest to anyone who wants to understand more about the possibilities, technologies and processes involved in realising mixed reality practice and about the commercial culture that supports it. Keywords: Augmented reality • Sculpture • Extended realities • Transmediation • Embodiment • Virtuality x.1 Introduction The artwork In Darwin’s Garden was developed by the artist Chris Meigh-Andrews with the collaboration and assistance of Rowan Blaik, Head gardener at Down House, and the author, a design educator and researcher at the University of Chester, UK.
    [Show full text]
  • Life on the Digital Edge: How Augmented Reality Can Enhance Customer Experience and Drive Growth
    Life on the digital edge: How augmented reality can enhance customer experience and drive growth Copyright © 2014 Accenture. All rights reserved. Accenture, its logo, and High Performance Delivered are trademarks of Accenture. Every business is a digital business. That’s because every customer is now a digital customer. Nowhere is this more evident than in the retail arena, where shoppers have used social networking and mobility to transform their purchasing experiences. In response to the rise of the digital customer, retailers are looking to leverage digital technologies to drive new levels of customer engagement and competitive advantage. One area that holds particular promise is augmented reality. 2 The (digital) natives are restless With today’s proliferation of social It’s not easy to meet the needs of networking and mobile applications, this new breed of customer. In an customers have non-stop access to “always-on” world, customers have more knowledge and more opinions the power to continually redefine than ever before. This information the retail shopping experience they is shaping their preferences for want to have. Their expectations are products and services, as well as rising—and constantly evolving. their expectations for personalized They want to be enticed and retail experiences. It is also upending engaged. They want digital content the linear buying process. That and digital options that are easily traditional path to purchase—which accessible 24/7. And they want a begins with awareness and ends seamless experience, across multiple with purchase and loyalty—has lost channels that enable them to search, its relevance for today’s customers.
    [Show full text]
  • Music's Augmented Future
    thereport ISSUE 410 | 17 OCTOBER 2017 Music’s augmented future 1 ISSUE 410 17.10.17 COVERAR SPECIAL FEATURE PART 1 AR you experienced? he first thing to understand about Cycle report alongside technologies like Kingston; in the years since there have been particularly around its potential to become augmented reality (AR) technology microblogging, social networking platforms a steady stream of experiments around music truly mainstream. There are several reasons is that while it may be a hot trend of and 3D printing. and AR. You can read about some of them for this, starting with 2016’s big app craze: 2017, it’s certainly not a new trend. 2008 was also the year when Apple and later in this issue. Pokémon Go (pictured). TSci-fi author William Gibson was writing Google launched their first app stores for In the years after 2008, many of these While catching virtual beasties in real- about the idea of augmenting humans’ vision smartphones, with startups like Layar and campaigns have, with hindsight (and often world locations also seemed gimmicky at first with digital content in 1994, although arguably Metaio early to experiment with “browser” even at the time) seemed like gimmicks; – the mobile game raced to $500m of revenue head-up displays (HUDs) in aircraft were the apps that overlaid information onto the good for getting a few headlines when they and then $1bn. Even in April 2017, there were first example of AR decades before that. phone’s camera feed. launched, then quickly forgotten with no still 65m active players globally, and for many report AR as we understand it in 2017 has been By 2009, Music Ally was writing about AR obvious impact on sales or fan engagement.
    [Show full text]
  • It Spot Issue
    [ Spot❘2016-06 ] 2016 ICT Spot Issue Ⅰ. 브렉시트 선언과 ICT산업 영향 Ⅱ. 스마트폰 카메라의 진화, 3D카메라 <CP Issue> IMS2016을 통해 살펴보는 전파기술의 최신 동향 목 차 ICT SPOT ISSUE 2016-06 Ⅰ. 브렉시트 선언과 ICT산업 영향 ································· 1 1. Brexit 발표 후 경제 지표 변화 ································································· 2 2. 미국 금융위기 사례를 통한 Brexit 영향 검토 ··········································· 5 3. Brexit의 ICT산업 파급효과 ········································································· 6 4. 정책적 시사점 ··························································································· 11 Ⅱ. 스마트폰 카메라의 진화, 3D카메라 ························ 12 1. 3D로 진화하는 스마트폰 카메라 ··························································· 13 2. 스마트폰용 3D 카메라 기술 개요 및 개발 동향 ···································· 15 3. 맺음말 ······································································································· 23 <CP Issue> IMS2016을 통해 살펴보는 전파기술의 최신 동향 1. IMS2016 개요 ························································································ 26 2. 이동전화: 탄생과 소멸 ············································································· 31 3. mm-Wave: 미래로 연결되는 관문 ·························································· 35 4. GaN: 고전력 반도체 혁신 ······································································ 41 5. 패러다임 이동: SW기반 플랫폼 ······························································· 47 6. 시사점과 제언 ···························································································
    [Show full text]
  • QR Codes & Augmented Reality for Mobile Library Users
    Portland State University PDXScholar Online Northwest Online Northwest 2011 Feb 11th, 3:00 PM - 4:00 PM QR Codes & Augmented Reality for Mobile Library Users Robin Ashford George Fox University Follow this and additional works at: https://pdxscholar.library.pdx.edu/onlinenorthwest Let us know how access to this document benefits ou.y Ashford, Robin, "QR Codes & Augmented Reality for Mobile Library Users" (2011). Online Northwest. 22. https://pdxscholar.library.pdx.edu/onlinenorthwest/2011/Presentations/22 This Presentation is brought to you for free and open access. It has been accepted for inclusion in Online Northwest by an authorized administrator of PDXScholar. Please contact us if we can make this document more accessible: [email protected]. QR Codes & Augmented Reality For Mobile Library Users Robin M. Ashford, MSLIS Handheld Librarian IV, February 23, 2011 Why Focus On Mobile Users? http://www.youtube.com/watch?v=6mCkbrYKQyI QR Codes - Overview • What are QR codes - How do they work • QR codes in libraries • Generating QR codes & tracking • Creating digital profiles • Proprietary codes and code readers • Successful QR code campaigns - creativity • QR code challenges & the future What are QR (Quick Response) Codes? • A QR code is a matrix barcode readable by smartphones & mobile devices with cameras (incl new iPod Touch) • Typically seen as white squares with black geometric shapes • Information such as text, a URL or other data can be easily encoded using a QR Code generator • Users point their device, scan, and are quickly taken
    [Show full text]
  • Purchase Intent Predicts Stock Performance
    Purchase Intent Predicts Stock Performance LikeFolio Purchase Intent Strategies Performance Report EDITION: APRIL 2018 TABLE OF CONTENTS LIKEFOLIO OVERVIEW ........................................................................................................... 1 PURCHASE INTENT (PI) METRIC & SIGNAL CALCULATION .................................................... 2 Purchase Intent (PI) Metric Definition & Examples ........................................................................ 2 Purchase Intent Signal Calculation .................................................................................................. 3 TRADING STRATEGIES UTILIZING LIKEFOLIO PI SIGNAL ....................................................... 4 Earnings Trading Strategy ................................................................................................................ 5 Active Trading Strategies ................................................................................................................. 6 Portfolio Strategy – Top-8 Long vs Bottom-8 Short ..................................................................... 12 Combined Portfolio ......................................................................................................................... 13 SUMMARY .......................................................................................................................... 15 CONTACT INFORMATION .................................................................................................... 16 LEGAL DISCLAIMERS..........................................................................................................
    [Show full text]
  • Geographical Visualization Within Augmented Reality Using Visualization of Geographical Data Through Augmented Reality to Locate Nearby City Services
    DEGREE PROJECT IN COMPUTER SCIENCE AND ENGINEERING, SECOND CYCLE, 30 CREDITS STOCKHOLM, SWEDEN 2018 Geographical Visualization Within Augmented Reality Using visualization of geographical data through augmented reality to locate nearby city services MATTIAS LARSSON KTH ROYAL INSTITUTE OF TECHNOLOGY SCHOOL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE 2 Geographical Visualization Within Augmented Reality Using visualization of geographical data through augmented reality to locate nearby city services MATTIAS LARSSON Master in Computer Science Date: May 30, 2018 Supervisor: Håkan Lane (KTH), Thomas Stjerne (Norconsult Astando) Examiner: Elena Troubitsyna Swedish title: Tillämpning av augmented reality på geografisk data för att förbättra stadens verksamhet School of Electrical Engineering and Computer Science Abstract Augmented Reality is today one of the most popular upcoming technologies most commonly known for its use within games and advertising. The technology is also used in other less known fields such as task support, navigation and sightseeing but still has additional usages to be discovered. This thesis investigates how Augmented Reality can be used to improve locating city services such as public toilets by visualizing data with the technology instead of more traditional 2D means. To establish a basis on how known Augmented Reality is compared to other visualization methods, a quantitative form was set up and answered by 105 persons. A qualitative study was also conducted that included an experiment with ten users, they were interviewed separately and their answers were recorded when they interacted with the Augmented Reality prototype using a think-aloud approach. The experiment was set up to gain more in-depth knowledge about how users experience using an Augmented Reality product to find nearby objects.
    [Show full text]