The Augmented Tegra Experience Agenda

§ Introduction to metaio § Overview of AR development processes and deployment to a mobile platform. § Example applications on a Tegra 4 ‘Dalmore’ platform § Consider some of the new features of the Tegra 4 platform § Look forward to some of the developments in open APIs from the perspective of an AR application developer AR Food Chain – Always ON, Always Augmented!

Hardware Software Content Users Acceleration AR Applications AR Usage AR Content Access

Augmented Reality Development Overview • Content Creation and Curation – most content formats supported • Deployment Options – Compatible with most CDN & Cloud Services • Platform Agnostic – ‘Write once’ Applications • Platform Performance Enhancement – Optimization & Acceleration Creator – Overview

Display Display 3D Video Model Marker

Display Image Display Audio Creator – Tegra 4 Example

§ Non-optimized ‘Junaio’ port

§ High polygon count ~35K∆

§ High frame rate animation >25fps Junaio Demo – Screen Shot

Junaio Browser running on nVidia ‘Dalmore’ Tegra 4 Development Platform Metaio SDK - Overview § Optimized client-based visual 4.1 search for a large number of 2D targets § Improved stability, robustness and performance of ID Marker and 2D marker-less tracking § Improved performance of 3D object tracking and teaching § SLAM integration § Sensor fusion with visual-based tracking § AREL support SDK Overview

§ Application Development Libraries § Xcode/Eclipse Development environments § Unity Plugin § Integrated Renderer § Fully functional free version (watermark) § 2D and 3D Tracking versions available (multiple OS license) § Developer Portal (user forums, FAQ, helpdesk) § Developer Certification Program § Supports AREL

AR Stack AR Applications Application AREL: Augmented Reality Experience Language, Interpreter(AREL) proprietary* from metaio Java, Objective C, C++ Android Windows iOS SDK: SDK: SDK: Objective C Java C++ AREL AREL AREL

SW level Platform-specific programming interfaces

Sensor- Rendering Capturing Tracking interface

metaio native SDK

OS (iOS, Android, Windows 7/8)

SW DRIVER HW level Acceleration(AREngine) What is AREL?

• Augmented Reality Experience Language is • a unique combination of XML, Javascript and HTML5 • Content (XML) • Interaction and AR (Javascript) • UI (HTML5)

• Available in: • junaio (via channels) • metaio SDK

• Produced by: • Creator 2.0 onwards • Developers using SDK ‘Big Kid’ Application Demo – Screen Shot

• Full frame rate video • Fast load time • Instant marker registration

• Check out the application at: - • http://tiny.cc/oixauw

SDK based application running on nVidia ‘Dalmore’ Tegra 4 Development Platform Mobile AR Deployment Trends • 2D/Marker based 3D/Marker-less Tracking • Single function ‘AR’ apps AR embedded into multi-function apps • Click to Scan Always On • Content kick-off Photo realistic 3D Content • 2D imaging DoF Imaging • Hand held Head mounted • Fixed ‘channel’ content Unlimited ‘cloud’ content • Visual tracking Sensor fusion • Touch GUI Integrated gesture, Iris tracking, voice recognition • Viewfinder Translucent Screens Mobile AR Deployment Challenges

§ Content, Content, Content! § Instantaneous ‘Z’ data § ‘Time stamped’ Sensor information § System power efficiency § Cloud access performance § Data API § Platform variation (Android ecosystem) and emerging OS Tegra 4 – First Impressions

§ OOB experience with 4.2.2 § Excellent GPU performance § Camera API calls work! § CPE – good platform for accelerating CV requirements § Enhanced imaging possibilities § Utilize more Unity features: - — Real time lighting/shadows — Translucency effects — Material effects

http://www.facebook.com/metaio

@twitt_AR http://twitter.com/#!/twitt_AR

http://augmentedblog.wordpress.com/

http://www.flickr.com/photos/metaio/

http://www.youtube.com/user/metaioAR

Phone (EMEA): +49-89-5480-198-0 [email protected] Phone (US): +1-415-814-3376 www.metaio.com