DSC 2020 EUROPE VR Driving Simulation & Virtual Reality Conference & Exhibition Title Accelerate automotive simulation development Presenter Seb Loze | Simulation Industry Manager T : @SLFeeding #DSC2020 | [email protected] DSC 2020 Europe VR Palais des Congrès - Antibes September 9, 2020 Remember last year ? Key takeaways from 2019 DSC speech : 1. Epic Games is strongly investing in some core non-game industries including Simulation 2. Unreal Engine is free (source code is available for free on GitHub as well) 3. Eager to aggregate insights coming from the simulation experts #UE4 | @UNREALENGINE Remember yesterday ? If you missed James Butcher Unreal Engine tutorial : https://learn.unrealengine.com/ #UE4 | @UNREALENGINE Driving Simulations | Smart and beautiful (and vice versa) Depending on their goals, priorities in the development process of driving simulators is focussing on 8 criterias impacting the way images are displayed (or not) : ● Image accuracy ● Photorealism ● Dynamics Engine Integration ● HIL Integration ● AI Integration ● Open Architecture ● Support of standards ● Pipeline Optimization “One thing that we're not necessarily doing is we're not doing a fancy 3D world like this because we are simulating perception.” - Uber, Matt Ranney “UE4 allowed us to achieve an impressive graphics quality, allowing top quality lighting effects, and rain/wet terrain simulation” - Kunos Assetto Corsa, Marco Massarutto #UE4 | @UNREALENGINE Driving Simulations | Smart and beautiful (and vice versa) Automotive digital marketing Man in the loop Simulator AV Simulator / machine learning Racing video game (Attributed values are projections based on typical use cases observations) #UE4 | @UNREALENGINE Unreal Engine | Driving Simulation use cases examples Inside a self-driving Uber Development of Pedestrian Artificial Intelligence Nvidia AI Can Render Complete Urban Microsoft Road-Runner photo-realistic simulation and Utilizing Unreal Engine 4 Environments in Unreal Engine 4 deep learning to train autonomous driving algorithms https://www.infoq.com/presentations/uber-self-driving-software/ https://www.ijrte.org/wp-content/uploads/papers/v8i1/A7288058119.pdf https://www.extremetech.com/extreme/281649-nvidia-ai-can-render- https://www.microsoft.com/en-us/garage/blog/2018/04/project-road- complete-urban-environments-in-unreal-engine-4 runner-train-autonomous-driving-algorithms-for-road-safety/ Reikko and Vertechs create Auto City OTSL strengthens 3D Real-Time Sensor Simulator Zoox merging Simulation & Reality GM’s Cruise is preparing for a self-driving Framework COSMOsim (R) Ecosystem future in the cloud https://www.vertechs.jp/autocity https://www.prnewswire.com/news-releases/otsl-strengthens-its-3d- https://zoox.com/journal/ https://venturebeat.com/2019/04/20/gms-cruise-is-preparing-for-a-self- real-time-sensor-simulator-framework-cosmosim-r-ecosystem-for- driving-future-in-the-cloud/ autonomous-driving-300883916.html #UE4 | @UNREALENGINE Digital Marketing - 2020 - Examples https://www.youtube.com/watch?v=FJsn2OGsLOc https://www.youtube.com/watch?v=CUH5hwkl7dI&t=10s https://www.youtube.com/watch?v=5Xqqe9WcZnk https://www.youtube.com/watch?v=wv5UeSZST5w https://www.youtube.com/watch?v=feteiyjsHOQ https://www.youtube.com/watch?v=SyUQ2IImObA #UE4 | @UNREALENGINE AV simulation and Engineering - 2020 - Examples https://www.unrealengine.com/en-US/spotlights/ike-develops-virtual- https://www.youtube.com/watch?v=ORpo_cpDH4s https://www.youtube.com/watch?v=skanz-dzaAg simulator-for-automated-trucks-with-unreal-engine https://www.unrealengine.com/en-US/spotlights/cm-labs-links-best-in- https://www.dspace.com/en/pub/home/news/sensor_realistic_simulation. class-real-time-toolsets-for-highest-fidelity-engineering-and-training- https://carla.org/ cfm#143_54589 simulation #UE4 | @UNREALENGINE Driving Simulations | Smart and beautiful (and vice versa) Automotive digital marketing Man in the loop Simulator AV Simulator / machine learning Racing video game (Attributed values are projections based on typical use cases observations) #UE4 | @UNREALENGINE #UE4 | @UNREALENGINE #UE4 | @UNREALENGINE What is so special about Driving Sim? Challenges Solutions Content Creation Handling formats / GIS / Terrain Data / Stream the world Non visible spectrum Sensors ( handling / representation ) Data accuracy Identifying potential integrations Deployment Cloud vs local #UE4 | @UNREALENGINE Content creation - the “classic” approach UE4 integrated Landscape - Create your own procedural geotypical environment ● Hand-crafted landscape, Terrain splines, Foliage tools, Marketplace assets ● Several training zones in same environment ● https://docs.unrealengine.com/en- US/Engine/OpenWorldTools/index.html ● https://docs.unrealengine.com/en-US/Engine/Landscape/index.html ● With terrain generation tools (World Machine, Instant Terra, World Creator, TerraForm) ● …) #UE4 | @UNREALENGINE Content creation - The “GIS data integration” approach Adapting to traditional simulation content creation pipelines ESRI TrianGraphics VectorZero Presagis O2U Trian3DBuilder CityEngine RoadRunner LiDAR Point Cloud OpenStreetMap Presagis Terra Vista (UE 4.24 free plugin) (free plugin) (UE4 output compiler WIP) #UE4 | @UNREALENGINE Content creation - The “GIS data integration” approach Adapting to traditional simulation content creation pipelines ESRI TrianGraphics VectorZero Presagis O2U Trian3DBuilder CityEngine RoadRunner LiDAR Point Cloud OpenStreetMap Presagis Terra Vista (UE 4.24 free plugin) (free plugin) (UE4 output compiler WIP) #UE4 | @UNREALENGINE Content creation - The “Standard DB” approach ESRI ArcGIS Presagis CESIUM 3D Tiles CDB ORB Viewer Simblocks CDB RTP for UE #UE4 | @UNREALENGINE #UE4 | @UNREALENGINE Content creation - your “Homemade” solution < Insert here your challenges > Using Unreal Engine source code and open structure allows you to create your own importers and your optimization process from your source data #UE4 | @UNREALENGINE Non visible spectrum #UE4 | @UNREALENGINE Non visible spectrum LIDAR semantic #UE4 | @UNREALENGINE Non visible spectrum < Insert here your challenges > We are using the sensors from our partners. We can help you to implement yours. Some implementations are being done internally by Epic Games. Your voices are important to help us to define what is our next step. #UE4 | @UNREALENGINE Simulation data accuracy #UE4 | @UNREALENGINE Deployment #UE4 | @UNREALENGINE How to conclude ? Progress have been made. Challenges have been taken care of. Partners are being supported to provide new solutions to the community. We can do better. Let’s make sure we don’t wait until the next DSC to chat. Send us a line ---> [email protected] Seb Loze | Simulation Industry Manager T : @SLFeeding #DSC2020 | [email protected] #UE4 | @UNREALENGINE.