HPC & AI Innovation Exchange
Total Page:16
File Type:pdf, Size:1020Kb
HPC & AI Innovation Exchange A series that examines key trends, technology infrastructures and solutions within high-performance computing. The ADAS/AD Architecture An in-depth technical analysis of infrastructure solutions for Manufacturing and Automotive, developing autonomous driving 002 and advanced driver assistance systems. This white paper provides an in-depth study of the Dell Technologies solutions for Autonomous Driving (AD) and ADAS (Advanced Driver Assisted Systems). It consists of a business-oriented management synopsis and a deep technical analysis. Contents Revisions . 2 3 4. Networking in the data centre . 45. Acknowledgements . 2 3 5. Test and Workbenches . 46 Table of contents . 2. 3 5. 1. HiL Test bench . 46 Executive summary . 4. 3 5. .2 SiL Test bench . 47 . Part 1 — Business-oriented management synopsis . 5 3 5. .3 .ADAS/AD Workbench . 48 1 An overview of the IT infrastructure needed for the development of autonomous driving . 5 . 1 1. Autonomous driving . 6. 3 6. User access — VDI . 49 1 1. 1. Complex managed IT infrastructure needed . 10 4 Technical Description — Software & Services . 51 1 .2 Overview of the IT infrastructure . 11. 4 .1 Software . 51 1 .2 1. On the remote site . 13 4 1. 1. Software — Container technology . .51 . 1 .2 .2 The data size — the need for a Data Lake . .14 . 4 1. .2 Create a complete software stack . 52. 1 .2 .3 Data analysis — the need for a Data Platform . 15 4 .2 Services . 54 1 .2 4. Development of scenarios — the need for a Compute Platform . 16 1 .2 5. Software & Services . 18. 4 .2 1. Hardware Deployment Services . .54 . 1 .3 System design considerations . 19 4 .2 .2 Software. Deployment Services . .54 . 1 .3 1. Data Lake . 20 4 .2 .3 Support Services . .55 . 1 .3 .2 Computing platform infrastructure . 20 4 .2 4. Labelling as a service . 55 . 1 .3 .3 Test benches . .21 . 4 .2 .5 Managed Services . 56 1 .3 .4 Workbench . 21 4 .2 6. Financial services . 57 1 .3 5. In support of the manufacturers’ development process . 21. Part 2 — Technical analysis . 23 . 5 Choosing the right platform — Infrastructure design . 57 2 Technical Description — Remote site . 23 . 5 1. Infrastructure design process . 58. 2 1. Data logging . 24 5 .2 Practical design examples . 59 2 .2 Data ingest and tagging . 24 5 .3 General server design considerations . 64 3 Technical Description — Data Centre . 28 . 5 4. Storage Design — Data Lake . 65. 3 1. Data Lake . 28. 5 4. 1. File storage and archive . 65 3 .2 Data Platform . 30 3 .2 1. Dynamic Data analytics . 31. 5 4. .2 File system and file protocol choices . 66 3 .3 Compute Platform . 32 5 5. Compute Server design . .67 . 3 .3 1. Scenario testing and development — simulation . 33 5 6. Network design . 68. 3 .3 .2 HPC system (Compute Platform) . 35. 6 Vocabulary & Terminology . 70 3 .3 .3 Storage and memory for HPC . 40 6 1. Vocabulary . .70 . 3 .3 4. Networking for HPC . .40 . 6 .2 Terminology . 71. 3 .3 5. Parallel file systems for HPC . 41 3 .3 6. HPC Cluster management . 43. A. Technical support and resources . 74 3 .3 7. AI support . 44. A 1. Related resources . 7. 4 . Executive summary Part 1 — Business-oriented management synopsis This white paper provides an in-depth study of the Dell Technologies solutions for Autonomous A global vision on the development of autonomous driving . Driving (AD) and ADAS (Advanced Driver Assisted Systems) . Our vision provides thorough technical analysis of projects we have been working on and the expected requirements for future projects in The structure of this part that consists of one chapter is: this space . Section 1.1 There are two distinct parts: a business-oriented management synopsis (part 1) Services a comprehensive deep technical analysis (part 2) Section 1.2.5 Software The business-oriented synopsis in Part 1 — chapter 1 describes a global vision on the development of autonomous driving . Dell Technologies understands the whole AD/ADAS development chain and can provide supporting solutions both for car manufacturers which own the complete chain and for Remote Site Data Centre organisations which focus on one or on a number of aspects in the chain . Section 1.2.3 The ensuing technical analysis in Part 2 — chapters 2-4 suggests and debates various options 1.2 Section Data available to.