Nvme Computational Storage Innovative Nvme SSD Solutions
Total Page:16
File Type:pdf, Size:1020Kb
NVMe Computational Storage Innovative NVMe SSD Solutions Driving Compute and Storage Without Compromise 1 NGD Systems, Inc. – AIC Joint Webinar January 21 The Market Needs a New Way to Look at Storage. Traditional storage architectures are in trouble. Pain Points Scaling requirements are not met with existing solutions One CPU to many storage devices creates bottlenecks Physical Space These bottlenecks exist, we currently just shift where they reside Available Power Scaling Mismatch Bottleneck Shuffle Technologies that ‘compose’ these elements just move the bottleneck A way to augment and support without wholesale change is needed 2 NGD Systems, Inc. – AIC Joint Webinar January 21 What it Looks like Today in Real-Life. Room for More. • AMD and AIC build Great Products together… But there is opportunity for More… Total Solution Without NGD Systems 36 x E1.S hot swap – 8TB drives – 288TB of Storage 2 sockets, 32 cores each – 64 CPU cores of Processing 3 NGD Systems, Inc. – AIC Joint Webinar January 21 The Market Solution Using Computational Storage. Scaling compute resources with storage provides access to results faster Value Add Computational Storage resources ‘offload’ work from the overtasked CPU ✓ Distributed Seamless architectures create new ‘servers’ with each storage device added Processing ✓ Faster Results ✓ Lower Power ✓ Smaller Footprint This ‘Server in a Server’ Architecture provides value across many use cases Additional CPU resources for the cost of Storage without added Rack Space 4 NGD Systems, Inc. – AIC Joint Webinar January 21 Computational Storage Recognized as Transformational “Business Impact Areas (per Hype Cycle): There is both a cost and time factor involved in shuffling terabytes of data around. CS can provide material performance benefits to data-intensive applications, especially in edge computing. Combined with its low power footprint, CS increases the performance-per-watt ratio, therein decreasing power consumption costs for applications at the edge.” – Jeff Vogel, Julia Palmer – Gartner Research 5 NGD Systems, Inc. – AIC Joint Webinar January 21 Computational Storage Done Right - Simple. • Computational storage drive (CSD) Solid State Drive (SSD) o High capacity o Low power Application processor • High-Capacity SSD • In-Storage Processing Stack Containers Microservices 6 NGD Systems, Inc. – AIC Joint Webinar January 21 Computational Storage is Not New, NGD Got it Right. https://dl.acm.org/toc/tos/2020/16/4 7 NGD Systems, Inc. – AIC Joint Webinar January 21 NVMe Products as a Starting Point. • Largest capacity NVMe U.2 on the market U.2 Up to 32TB • Large breadth of SSD solutions and capacity options • Leading W/TB Energy Efficiency • Encryption Support, FIPS Compliant Raw Capacity MAX Power Temp Range Form Factor TLC (TB) (W) (‘C) Commercial U.2 15mm up to 32 12 0 – 60 Extended M.2 EDSFF E1.S up to 12 12 -10 – 70 Industrial M.2 22110 up to 8 8 -40 - 85 EDSFF 8 NGD Systems, Inc. – Confidential and Proprietary January 21 COMPUTATIONAL STORAGE VALUE ADD!! • AN Amazing Platform Enabled with EVEN MORE Processing, NO Platform Changes Total Solution Without NGD Systems Total Solution With NGD Systems 36 x E1.S hot swap – 8TB drives – 288TB of Storage 36 x E1.S hot swap – 12TB drives – 432TB of Storage 2 sockets, 32 cores each – 64 CPU cores of Processing 2 sockets, 32 cores each – 64 CPU cores of Processing 36 Drives, 4 cores each – 144 Additional CPU CORES Computational Storage Makes Great Systems even Greater!! 9 NGD Systems, Inc. – AIC Joint Webinar January 21 The Data Lives on Storage. Why Not Work on it There? One Host Many Drives Computational Storage Drive ComputationalComputational Storage Storage Drive Drive Server Host Processor Complex Computational Storage Drive Traditional SSD Solutions NVMe media controller host OS Arm host quad-core shared API DRAM drive OS application NAND app media 10 NGD Systems, Inc. – AIC Joint Webinar January 21 Innovative Computational Storage Uses. SMART CITIES & EDGE GATEWAYS, AUTOMATION MECs, SERVERS Azure IoT Edge Linux DATACENTERS & AUTONOMOUS ANYTHING CDN DELIVERY 11 NGD Systems, Inc. – AIC Joint Webinar January 21 Microsoft Azure IoT – Running ON Drive. https://www.ngdsystems.com/media/NGDs-Computational- HOST System Linux ON DRIVE Linux Storage-device-is-powered-by-Azure-Iot-Edge Used for simply saving data Used for ALL Azure Interaction NGD Systems Computational Storage Drive (CSD) Demonstration shows use of Computer Vision Cloud- Based Application executed using only the NGD Image Systems Newport Drive OS, No Host Interaction with Analyzer Cloud Required Edge HUB Edge Agent 12 NGD Systems, Inc. – Confidential and Proprietary January 21 AI in eDiscovery on AIC HW https://www.ngdsystems.com/Computational-Storage-adds-AI-to-eDiscovery • Value Lowers TCO in eDiscovery platforms Automation and efficiency of data ingest and conversion to searchable formats • Problem eDiscovery requires at speed ingest of multiple document types, file structures, and object types that are NOT natively searchable Entire contents of ingested drive data needs to be: Seamlessly stored, Run through an OCR engine, Made text searchable • Solution Storage Device Independently runs OCR and creates outputs transformed into text searchable objects • Implementation Computational Storage used to do all the work, No additional HW, SW, or personnel intervention. Using Open-source SW to create Object Store (MinIO, OpenIO, etc.) Web event notification natively tells Computational Storage Drives new files were added to process 13 NGD Systems, Inc. – AIC Joint Webinar January 21 Computational Storage Demo – Machine Learning. By running Arm NN on NGD Systems’ Arm-based computational storage drives, processing can take place directly on the device. This is enabling a range of new workloads from database acceleration to advanced image processing, providing flexibility and scalability to unlock insight … where data is stored. Computational storage has the potential to revolutionize data storage and we are pleased to be working closely with NGD Systems as one of our key partners in this space. Host -Jason Molgaard, Principal Storage Solution Architect, ARM Co-Chair, SNIA Computational Storage Technical Working Group 14 NGD Systems, Inc. – AIC Joint Webinar January 21 ARM NN Demo – Two Views! VIDEO DEMO WITH IMAGES • More than 100k images per drive are processed without sending the images to host. • The output of application includes image numbers together with the label created by the Mobilenet model using the ArmNN library. • The output of the application is written directly to a MongoDB database implemented inside In-situ engine, and VIDEO DEMO WITH Accelerated response user can access the output data using MongoDB APIs. The image dataset is acquired from: http://cocodataset.org 15 NGD Systems, Inc. – Confidential and Proprietary January 21 FB128-AG Computational Storage Server • Value Impressive Capacity increase over other solutions Support of Computational Storage use cases 50% more storage per chassis 36 x 12TB – 432TB Total Capacity 20% overall system power reduction 36 x 4 CPUs – 144 Computational Storage cores • Problem EDSFF E.1S drives from most vendors exceed power limits for server hardware, creating power restricted use, or need to reduce number of drives per system. • Solution Achieve full server of drives, with compute resource increases by using NGD Computational Storage and add value with the 144 Compute CPUs added to bolster the AMD Host Cores. • Implementation Increase capacity per server by over 144TB (total of 432 TB) and reduce power draw on system. Drive power from 20W down to 12W when using NGD Systems drives Offer customers computational storage resources as an added value as a support feature for both AIC and NGD 16 NGD Systems, Inc. – AIC Joint Webinar January 21 Patent Portfolio. • Computational Storage • Data Management • Flash Management • High Capacity Management • Power Management Broad & Defensible Patent Portfolio 32 Granted, 8 Pending NSF / SBIR Grant awardee 2016, 2017, 2018, 2020 17 NGD Systems, Inc. – Confidential and Proprietary January 21 How Can We Help? 18 NGD Systems, Inc. – AIC Joint Webinar January 21.