The Augmented Tegra Experience Agenda § Introduction to metaio § Overview of AR development processes and deployment to a mobile platform. § Example applications on a Tegra 4 ‘Dalmore’ platform § Consider some of the new features of the Tegra 4 platform § Look forward to some of the developments in open APIs from the perspective of an AR application developer AR Food Chain – Always ON, Always Augmented! Hardware Software Content Users Acceleration AR Applications AR Usage AR Content Access Augmented Reality Development Overview • Content Creation and Curation – most content formats supported • Deployment Options – Compatible with most CDN & Cloud Services • Platform Agnostic – ‘Write once’ Applications • Platform Performance Enhancement – Optimization & Acceleration Creator – Overview Display Display 3D Video Model Marker Display Image Display Audio Creator – Tegra 4 Example § Non-optimized ‘Junaio’ port § High polygon count ~35K∆ § High frame rate animation >25fps Junaio Demo – Screen Shot Junaio Browser running on nVidia ‘Dalmore’ Tegra 4 Development Platform Metaio SDK - Overview § Optimized client-based visual 4.1 search for a large number of 2D targets § Improved stability, robustness and performance of ID Marker and 2D marker-less tracking § Improved performance of 3D object tracking and teaching § SLAM integration § Sensor fusion with visual-based tracking § AREL support SDK Overview § Application Development Libraries § Xcode/Eclipse Development environments § Unity Plugin § Integrated Renderer § Fully functional free version (watermark) § 2D and 3D Tracking versions available (multiple OS license) § Developer Portal (user forums, FAQ, helpdesk) § Developer Certification Program § Supports AREL AR Stack AR Applications Application AREL: Augmented Reality Experience Language, Interpreter(AREL) proprietary* from metaio Java, Objective C, C++ Android Windows iOS SDK: SDK: SDK: Objective C Java C++ AREL AREL AREL SW level Platform-specific programming interfaces Sensor- Rendering Capturing Tracking interface metaio native SDK OS (iOS, Android, Windows 7/8) SW DRIVER HW level Acceleration(AREngine) What is AREL? • Augmented Reality Experience Language is • a unique combination of XML, Javascript and HTML5 • Content (XML) • Interaction and AR (Javascript) • UI (HTML5) • Available in: • junaio (via channels) • metaio SDK • Produced by: • Creator 2.0 onwards • Developers using SDK ‘Big Kid’ Application Demo – Screen Shot • Full frame rate video • Fast load time • Instant marker registration • Check out the application at: - • http://tiny.cc/oixauw SDK based application running on nVidia ‘Dalmore’ Tegra 4 Development Platform Mobile AR Deployment Trends • 2D/Marker based 3D/Marker-less Tracking • Single function ‘AR’ apps AR embedded into multi-function apps • Click to Scan Always On • Content kick-off Photo realistic 3D Content • 2D imaging DoF Imaging • Hand held Head mounted • Fixed ‘channel’ content Unlimited ‘cloud’ content • Visual tracking Sensor fusion • Touch GUI Integrated gesture, Iris tracking, voice recognition • Viewfinder Translucent Screens Mobile AR Deployment Challenges § Content, Content, Content! § Instantaneous ‘Z’ data § ‘Time stamped’ Sensor information § System power efficiency § Cloud access performance § Data API § Platform variation (Android ecosystem) and emerging OS Tegra 4 – First Impressions § OOB experience with 4.2.2 § Excellent GPU performance § Camera API calls work! § CPE – good platform for accelerating CV requirements § Enhanced imaging possibilities § Utilize more Unity features: - — Real time lighting/shadows — Translucency effects — Material effects http://www.facebook.com/metaio @twitt_AR http://twitter.com/#!/twitt_AR http://augmentedblog.wordpress.com/ http://www.flickr.com/photos/metaio/ http://www.youtube.com/user/metaioAR Phone (EMEA): +49-89-5480-198-0 [email protected] Phone (US): +1-415-814-3376 www.metaio.com .