ADAS and Autonomous Driving Validation V&V
Total Page:16
File Type:pdf, Size:1020Kb
Siemens-Microsoft Enabling simulation at scale Unrestricted ADAS/AD V&V framework 1. Context and challenges 2. Siemens ADAS/AD V&V framework a) Overview b) Environment and sensor simulation c) Vehicle dynamics and powertrain d) Simulation orchestration 3. Wrap-up and next steps Unrestricted © Siemens AG 2019 Page 2 Siemens PLM Software ADAS/AD V&V framework 1. Context and challenges 2. Siemens ADAS/AD V&V framework a) Overview b) Environment and sensor simulation c) Vehicle dynamics and powertrain d) Simulation orchestration 3. Wrap-up and next steps Unrestricted © Siemens AG 2019 Page 3 Siemens PLM Software Disruptive Innovation Key to sustained business Connectivity Autonomous Vehicles Vehicle Electrification Smart Mobility Engineering the NEXT product not just the best product for the future Unrestricted © Siemens AG 2019 Page 4 Siemens PLM Software Addressing engineering challenges for autonomous driving FROM ADAS TO AUTONOMOUS DRIVING… “+25% CAGR (through 2030) for Sensors” Roland Berger , on “Autonomous Driving”, 2014 Driver role ““…14.2 billion kilometers (8.8 billion miles) of Vehicle role testing, including simulation, are required.” SAE Akio Toyoda, CEO of Toyota Level 0 1 2 3 4 5 Paris Auto Show 2016 No Driver Partial Conditional High Full Automation assistance automation automation automation automation “Design validation will be a major – if not the largest – cost component” Roland Berger “Autonomous Driving” 2014 “While hardware innovations will deliver - software will remain a critical bottleneck” McKinsey Unrestricted“When will ©the Siemens robots AG hit 2019the road?” Page 5 Siemens PLM Software ADAS/AD systems virtual V&V Automotive industry needs Virtual validation • The number of scenarios needed to (MiL, SiL) properly validate ADAS/AD systems will explode from SAE level 1 up to level 5. ~102 test cases ~106 test cases SAE level 1 to 5 • The major part of AD V&V cannot be achieved through semi-virtual or real validation. Semi virtual validation (HiL, DiL, VehiL) • Frontloaded virtual V&V at MiL and SiL stages will have to play a much bigger role. ~102 test cases ~103 test cases SAE level 1 to 5 Real validation Need for efficient and automated vehicle testing (proving simulation orchestration ground, public road) ~102 test cases ~102 test cases SAE level 1 to 5 Unrestricted © Siemens AG 2019 Page 6 Siemens PLM Software ADAS/AD systems virtual V&V Automotive industry needs • Demonstrating an ADAS/AD system performs at least as well as human drivers (fatality criteria) requires 275 million miles to be driven. • Demonstrating the needed improvement over human drivers statistics will require billions miles to be driven. RAND RR1478-3 “Driving to safety” Unrestricted © Siemens AG 2019 Page 7 Siemens PLM Software ADAS/AD systems virtual V&V Automotive industry needs • How to build a minimal and covering validation profile? • Scenarios are numerous, but also qualitatively very diverse. Need to learn about new relevant scenarios and bring them to the simulation world • Our world is not an ideal environment • Pollutant emissions regulations and electrical vehicles range expectations will still apply to autonomous vehicles. Need for realistic and non-ideal environments Need for more vehicle physics than before Unrestricted © Siemens AG 2019 Page 8 Siemens PLM Software Validation and Verification – Test Orchestration Covering the entire virtual V&V workflow Massive HPC Real Time “14.2 billion miles of testing is needed” Akio Toyoda, CEO of Toyota Paris Auto Show 2016 Environment, Traffic, Sensors, Vehicle, Controls, Occupant… “Design validation will be a major – if not the largest – cost component” Roland Berger, “Autonomous Driving” 2014 Unrestricted © Siemens AG 2019 Page 9 Siemens PLM Software ADAS/AD V&V framework 1. Context and challenges 2. Siemens ADAS/AD V&V framework a) Overview b) Environment and sensor simulation c) Vehicle dynamics and powertrain d) Simulation orchestration 3. Wrap-up and next steps Unrestricted © Siemens AG 2019 Page 10 Siemens PLM Software Our solutions support autonomous vehicle development needs across all engineering domains with a focus on software Unrestricted © Siemens AG 2019 PageEnsuring 11 digital continuity, multi-domain traceability and functional safety of autonomousSiemens systems PLM Software ADAS / AD V&V framework on Azure cloud Plan Execute Report Realistic simulation, ready for robust virtual verification: • Real data import • High fidelity sensors, environments and vehicle physics Massive simulation: advanced parametric sampling, automated processes and extensible execution infrastructure Requirements-driven simulation: assets continuity and verification traceability ADAS/AD V&V framework on Azure cloud Benefits Use powerful modeling capabilities to frontload system simulation Shorter time-to-market and Use next generation simulation orchestration for improved coverage lower development costs Troubleshoot implementation issues earlier in development Efficient execution platform for planning and submission Enabling HAD verification in Advanced parametric sampling and results reporting a reasonable amount of time Faster insight into system under test Development process Scenarios-driven and metrics-driven requirements as input for simulation Connect critical scenarios experience to system engineering efficiency increase Enable rapid and robust development process Full simulation activity traceability to be ready for liability issues Compliance with audits and Validation methodology (e.g. ISO26262) is reflected by Polarion data relevant standards management Unrestricted © Siemens AG 2019 Page 13 Siemens PLM Software ADAS/AD V&V framework Generation 1 launch • Simulation batch planning HEEDS • Enhanced selective test cases Simulation plan orchestrator generation methodology Process automation • Unique results analysis • HEEDS / Simcenter Prescan Results analysis and reporting environment, from test plan level interoperability down to detailed run analysis • Extended externally-pilotable scenarios concepts Simcenter Prescan Scenario authoring Models integration environment Sensors and environment simulation Improved execution teamwork for tire / ground contact for intensive vehicle dynamics safety cases OR Simcenter Off-the-shelf validation Third party scenarios, metrics and Vehicle dynamics Amesim dashboards Vehicle dynamics Unrestricted © Siemens AG 2019 Page 14 Siemens PLM Software ADAS / AD V&V framework on Azure cloud Covered use cases Functional testing, robustness mapping or verification coverage At-scale Model-in-the-Loop and Software-in-the-Loop orchestration for ADAS/AD CAE groups Open-loop cases: Closed-loop cases: sensor design or specification, computer testing integrated systems, full autonomous vision, sensor fusion, embedded software vehicles or V2x ecosystems in their components testing environments Vehicle physics optimal fidelity available when needed (vehicle dynamics, powertrain, actuators) Unrestricted © Siemens AG 2019 Page 15 Siemens PLM Software ADAS/AD V&V framework Simulation production: overall workflow Scenarios Ego models Simulation plan definition Simulation plan execution Numerous results analysis Reporting Unrestricted © Siemens AG 2019 Page 16 Siemens PLM Software ADAS/AD V&V framework 1. Context and challenges 2. Siemens ADAS/AD V&V framework a) Overview b) Environment and sensor simulation c) Vehicle dynamics and powertrain d) Simulation orchestration 3. Wrap-up and next steps Unrestricted © Siemens AG 2019 Page 17 Siemens PLM Software Simcenter Prescan World Modelling Solutions GUI Scripted scenario generation Scenario import Ready to use scenarios Unrestricted © Siemens AG 2019 Page 18 Siemens PLM Software Simcenter Prescan World Modelling Non-ideal environment Realistic bumped asphalt Faded, dirty lane markers Non-perfect lane markers Lane markers with snow Mud, water puddles on the road Unrestricted © Siemens AG 2019 Page 19 Siemens PLM Software Unrestricted © Siemens AG 2019 Page 20 Siemens PLM Software Simcenter Prescan Virtual testing of autonomous driving functions Pedestrian AEB Adaptive Cruise Control based on radar-camera fusion Complete sensor models library: Camera, Radar, LIDAR, Ultrasone, Infrared, V2X, GPS Unrestricted © Siemens AG 2019 Page 21 Siemens PLM Software Simcenter Prescan Ready to use sensor models Sensor simulation Camera Lidar Radar Radar & V2N V2P V2I V2X & V2X V2V Ultrasonic Unrestricted © Siemens AG 2019 Page 22 Siemens PLM Software Simcenter Prescan: sensors models The right fidelity level for scaled-up simulation Balancing accuracy and computation time of sensor simulations Lidar (spinning and solid-state) Physics-based Radar simulation Example: during night-time driving Example: Realistic lighting conditions Simcenter PreScan Physics Based Camera (PBC) simulation Unrestricted © Siemens AG 2019 Page 23 Siemens PLM Software Radar Simulation example Validation Development with models validation in mind Two projects for radar models validation performed in close collaboration with major Dutch Tier2 and Japanese Tier1 From a lab… To a test track… To the real world… Unrestricted © Siemens AG 2019 Page 24 Siemens PLM Software Simcenter Prescan: World Modelling DataModel API • The Prescan DataModel API allows for a programmatic way of creating scenarios → Repeatability is ensured • All important assets can be created via scripting: • Roads • Actors • Traffic signs • Nature elements • Trajectories • Environmental conditions • Etc. Explore critical scenarios Prepare for certification • Parameters can also