Meet Data Challenges Affordably with Seagate® Lyve® Rack and Intel

Meet Data Challenges Affordably with Seagate® Lyve® Rack and Intel

Solution Brief Meet Data Challenges Affordably with Seagate® Lyve® Rack and Intel® Technologies Lyve Rack, powered by Intel® Xeon® Scalable processors, delivers a high-capacity object-storage solution that organizations like yours can easily deploy to manage increasing data growth What insights are you missing due to Intel Technologies Intel Xeon Scalable processors provide the missing data? performance necessary for fast write, read, and search capabilities in Seagate Lyve Rack. Data is being created every day at a ferocious rate. In a study Improvements in 2nd Generation Intel Xeon commissioned by Seagate in 2018, IDC estimated that the amount of Scalable processors over previous-generation data created, replicated, and consumed worldwide would grow from Intel Xeon processors include: 33 ZB to 175 ZB by 2025. That much data is enough to fill 12.5 billion • Improved performance through higher core 6 counts and higher maximum Intel Turbo of today’s largest hard drives. However, storing unstructured data has Boost Technology frequencies1,2 traditionally been too expensive to justify saving and using more than • Higher memory speeds3 a small fraction of the data. While hyperscale storage services can be • Larger memory capacity4 extremely economical for storing vast quantities of data, accessing that data can entail unexpectedly high charges. By contrast, enterprise object- • More cache5 storage solutions impose no extra charges to access data, but they tend As the CORTX community grows, Intel® Optane™ technology will become an important part of many to be too costly overall to store massive amounts of data. Until now, the object-storage solutions built using CORTX. economics of both saving and using enormous quantities of data have not aligned, and companies have been forced into unpleasant choices about which data to keep and which to discard. This profligate waste of data represents countless missed opportunities for businesses and society. Many business applications—particularly artificial intelligence (AI) applications—perform better with more data MEET DATA CHALLENGES AFFORDABLY WITH SEAGATE LYVE® RACK AND INTEL® TECHNOLOGIES | 1 | available for analysis, training, A community of data scientists and • Integration with the Seagate Lyve classification, and prediction. With so big data and enterprise storage ecosystem for full lifecycle data much data being disposed of without experts designed, built, and management from ingestion to movement to activation of your data analysis, what insights are being maintains CORTX. They built it with missed by your business? What an eye toward future data center • Data protection using hierarchical erasure coding value could you uncover if you could requirements: scalability, economically retain more of your resiliency, and hardware efficiency. Figure 1 shows how CORTX fits within unstructured data? the ecosystem of the network edge, AI, 5G, and machine-to-machine Key features of CORTX include: communications. The key to all of this CORTX Open Source • A familiar, Amazon S3–compatible functionality is the CORTX object- Object Storage API (S3 protocol) for local storage architecture. data access CORTX is an open source, • An identity and access management CORTX Architecture Overview software-defined object store (IAM)–compatible API for user management and data protection sponsored by Seagate. Seagate CORTX features an inherently using bucket policies and access- developed CORTX to offer low- control lists (ACLs) scalable architecture. Each server cost object storage using the latest node within an object-storage system • Multitenancy generation hardware for enterprise built on CORTX connects to the wider • A management layer with an customers, allowing them to capture data center and storage infrastructure API, command-line interface the efficiency and experience of the (command-line tool), and graphical through management, network, and cloud at the best possible price. user interface (GUI) storage connections. FIGURE 1 Frameworks: Apache Spark, PyTorch, TensorFlow, Apache Hadoop, Splunk, and others CORTX S3-Compatible Data Access Flexible Optional Plugins CLI Motr (Data Protection, Data Placement, Key-Value Store) API Management and Monitoring GUI Management Path Figure 1. The role of CORTX in the application ecosystem MEET DATA CHALLENGES AFFORDABLY WITH SEAGATE LYVE® RACK AND INTEL® TECHNOLOGIES | 2 | FIGURE 2 CORTX GUI (Web Browser) CORTX CLI S3 (SSH) Clients Management Network Data Network Management IP Data IP Figure 2. Architectural Node diagram of CORTX Management High-Availability GUI Proxy Management Stack S3-Compatible HARE Server [0-n] Internal Network (libfabric) Message Queue MOTR[0-n] SSPL Multipath Management SAS ... ... MD MD MD Data Data Data Data Data Controller-0 Controller-1 DG1 (ADAPT 8+2 / 16+2) DG1 (ADAPT 8+2 / 16+2) Management for CORTX is performed The actual storage in CORTX is guarantees are no longer desirable or through the Component Service powered by Motr software, the achievable at mass capacity. Instead, Management API, GUI, or command- software in CORTX that governs both Motr is a more general storage line interface (CLI), as shown in Figure object storage and key-value stores. system that provides an optional 2. Management continues through file-system interface. This approach the CORTX node to the storage back Motr allows a wider range of deployments, end using the (optional) Seagate such as for the cloud. Storage Platform Library (SSPL). This At the core of CORTX lies Motr. Motr enables administrators to manage is a distributed object-storage system Motr software provides CORTX their block storage without having that targets mass-capacity storage with both horizontal and vertical to rely on a separate software layer configurations. In order to ensure the scalability. Horizontally, Motr enables within the storage hardware. most efficient storage utilization, the addition of more CORTX nodes Motr interacts directly with block to increase storage capacity. It HARE is the software in CORTX that devices rather than a local file also enables handling extensions configures the Motr object and key- system. The Motr design was heavily running on other nodes and helps value store. HARE starts and stops influenced by the Lustre file system, avoid metadata hotspots by using Motr services, and it is ultimately Network File System (NFS) v4, and a shared-nothing input/output responsible for high availability for database technology. (I/O) path. Vertically, Motr makes Motr and the S3 protocol server. it possible to add memory and processors to servers Traditional file-system properties such running CORTX. as hierarchical directory namespace and strong POSIX consistency MEET DATA CHALLENGES AFFORDABLY WITH SEAGATE LYVE® RACK AND INTEL® TECHNOLOGIES | 3 | FIGURE 3 S3 Figure 3. Simplified architectural diagram of the relationship between the S3 protocol and the storage network libMotr Motr Object Store Key-Value Store Storage Network Beyond scalability, Motr also accessing and manipulating storage The base reference architecture for provides fault tolerance, observability, resources using CORTX. The Motr API Seagate Lyve Rack is shown in Figure extensibility, and portability. The is an alternative interface to storage 4, which shows the management, flexible erasure coding in Motr takes resources powered by CORTX, which data, and hardware layers of Lyve the specific storage hardware and provides fine-grained control over Rack. Because it is pretested and network topology into account, which storage access. preconfigured, Lyve Rack helps solve helps enable fast network RAID many challenges around deploying repairs. Built-in monitoring in Motr Seagate Lyve Rack R1 object-storage software, and it collects information about system simplifies the build-out of mass- behavior for administrators, which capacity storage solutions. Lyve Seagate Lyve Rack is a system-level provides observability. Motr also Rack is built using Seagate® Exos™ integrated infrastructure solution facilitates flexible transactions and X 5U84 storage-area network (SAN) available through Seagate partners, an extension interface to increase arrays that provide up to 1.3 PB of who test specific components extensibility. Finally, because Motr data in a single 5U enclosure,7 in together to deliver an enterprise- runs in the user space of any version addition to up to 99.999 percent high class object-storage solution. When of Linux, it also provides portability availability.8 Beyond the SAN arrays, organizations buy Lyve Rack through for CORTX. the Supermicro servers—powered by Seagate partners, they get enterprise- Intel Xeon Silver 4210R processors— class object storage with CORTX pre- in Lyve Rack power the multi-tier data The industry-standard S3 protocol installed on fully tested, preconfigured encoding in CORTX. This encoding allows multiple applications and hardware. They also get support, provides better data protection, with frameworks, such as Apache Spark, installation, deployment, and legal rebuild times for failed disks that are PyTorch, TensorFlow, Apache indemnification. Lyve Rack comes up to 95 percent lower than with Hadoop, Arrow, NoSQL, or Splunk, to ready to deploy in the data center, RAID.9 The Intel Xeon Silver 4210R use CORTX. The API in Motr provides without the high cost in time and processors that power Lyve Rack pair a library of functions that applications money required to build an object- high performance with an excellent and front-end programs can use for storage solution

View Full Text

Details

  • File Type
    pdf
  • Upload Time
    -
  • Content Languages
    English
  • Upload User
    Anonymous/Not logged-in
  • File Pages
    6 Page
  • File Size
    -

Download

Channel Download Status
Express Download Enable

Copyright

We respect the copyrights and intellectual property rights of all users. All uploaded documents are either original works of the uploader or authorized works of the rightful owners.

  • Not to be reproduced or distributed without explicit permission.
  • Not used for commercial purposes outside of approved use cases.
  • Not used to infringe on the rights of the original creators.
  • If you believe any content infringes your copyright, please contact us immediately.

Support

For help with questions, suggestions, or problems, please contact us