BRINGING AI-POWERED ROBOTS TO LIFE Deepu Talla, VP & GM – Autonomous Machines
1 AI IS FUELING GLOBAL INDUSTRIES Multi-Trillion Dollar Global Industries Turning to AI
SMART CITIES PUBLIC SAFETY HEALTHCARE
STARTUPS INDUSTRIAL TRANSPORTATION
2 ACCELERATED COMPUTING 1000X EVERY 10 YEARS
107
6 10 GPU PERFORMANCE + CPU PERFORMANCE 105
104 103
102
1980 1990 2000 2010 2020
3 NVIDIA
GRAPHICS HPC AI ROBOTICS
RTX DGX HGX DRIVE & JETSON
4 NVIDIA ACCELERATED COMPUTING
NVIDIA GPU CLOUD
GAMING HPC TRANSPORTATION HEALTHCARE
PRO VIZ AI ROBOTICS AI IOT
CUDA-X
CUDA
RTX DGX HGX DRIVE & JETSON
5 ROBOTICS CONTROL LOOP
PERCEPTION
REASON ACT & PLAN
6 BRINGING AI ROBOTS TO LIFE
OPEN COMPUTING PLATFORM SOFTWARE & SIMULATION ECOSYSTEM
7 JETSON NANO $99 NVIDIA CUDA-X AI Computer
CUDA-X acceleration stack | High-resolution sensor support | Runs all AI frameworks & models
8 NVIDIA JETSON COMPUTING PLATFORM
DEEPSTREAM ISAAC Nsight
Depth Object Pose Gesture Path Autonomous Ecosystem
Estimation Detection Estimation Recognition Planning Navigation Modules Developer Tools Modules
TensorRT VisionWorks cuBLAS Vulkan Libargus Drivers
cuDNN OpenCV cuFFT OpenGL Video API Ecosystem SDK Deep Learning Computer Vision Accel. Computing Graphics Multimedia Sensors
JetPack CUDA | CUDA-X AI | Linux | RTOS | ROS 1&2
Jetson Nano Jetson TX2 Jetson AGX Xavier
developer.nvidia.com/jetson 9 CONTINUOUS SOFTWARE UPGRADES
Jetpack 3.0/3.1 Jetpack 4.2.1 + Jetson TX2 Jetpack 4.0/4.1 Deepstream 4.0 Jetpack 2.1/2.2 2x inference perf cuDNN 6.0 Deepstream 3.0 ISAAC SDK 2019.2 Jetson TX1 TensorRT 2.1 + Jetson Xavier Docker CUDA 7.0 Ubuntu 16.04 CUDA 10 Secure boot cuDNN 4.0 Kernel 4.4 Ubuntu 14.04 TensorRT 5.0 Kernel 3.10 Ubuntu 18.04 Jetpack 3.2/3.3 Kernel 4.9 Jetpack 2.3.x Deepstream 1.5 Jetpack 4.2 CUDA 8.0 TensorFlow +Jetson Nano cuDNN 5.1 CUDA 9.0 TrustedOS TensorRT 1.0 cuDNN 7.0 TensorRT 4.0
MAR SEPT MAR MAR DEC MAR JUN 2016 2016 2017 2018 2018 2019 2019
10 JETSON POWERING AUTONOMOUS MACHINES
WAREHOUSE DELIVERY AGRICULTURE RETAIL INDUSTRIAL
11 NVIDIA ISAAC
KAYA (Nano) CARTER (Xavier) LINK (Multi Xavier)
Sensor and Actuator Drivers Core Libraries GEMS Reference DNN Tools
ISAAC OPEN TOOLBOX
CUDA-X
JETSON NANO JETSON TX2 JETSON AGX XAVIER
Isaac Robot Engine Isaac Sim Isaac Gym
Isaac Robot Engine – Modular robot framework | Isaac Sim - Virtual robotics laboratory Isaac Gym – Reinforcement learning simulator | Isaac Robot Apps – Kaya, Carter and Link developer.nvidia.com/isaac-sdk
12 SIMULATION
Isaac Sim PhysX ISAAC SIM PHYSX
13 NVIDIA ROBOTICS ECOSYSTEM
SENSORS AI FRAMEWORKS
ROBOT COMPUTERS ROBOTICS SOFTWARE SOLUTIONS
REFERENCE PLATFORMS DEVICE MGMT & CLOUD INTEGRATION
AWS Robomaker
14 ROBOTICS COMPETITION
DJI RoboMaster AI Challenge FIRST Robotics Robonation
Lockheed Martin AlphaPilot AI RoboCup Drone Innovation Challenge Picking Challenges - Amazon, JDX
15 OPEN COMPUTING PLATFORM SOFTWARE & SIMULATION ECOSYSTEM
developer.nvidia.com/jetson
16