DOCSLIB.ORG

Openstack Deployment and Operations Guide

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Openstack Deployment and Operations Guide OpenStack Deployment and Operations Guide Bob Callaway, NetApp, Inc. Rob Esker, NetApp, Inc. July 2014 | Version 3.0 Abstract This guide is intended to detail design considerations, configuration, deployment and ongoing operational practices for the successful implementation of OpenStack services atop or in concert with NetApp technologies. Please note that this version of the guide applies to the Icehouse (Spring 2014) release of OpenStack. The Havana release and prior are documented in version 2.3 available at http://www.netapp.com/openstack. Table of Contents 1. Executive Summary .................................................................................................... 1 1.1. Authors and Contributors ................................................................................... 1 2. OpenStack Overview .................................................................................................. 2 2.1. OpenStack Foundation ....................................................................................... 2 2.2. OpenStack - A Modular Collection of Cloud Services ........................................... 2 2.3. OpenStack Releases and Distributions ............................................................... 6 2.4. NetApp's Contributions To OpenStack ................................................................ 6 3. About NetApp Storage Systems and Software ........................................................... 8 3.1. Description of Data ONTAP ............................................................................... 8 3.2. Description of FAS Systems ............................................................................. 10 3.3. Description of E-Series and EF-Series Systems ................................................ 10 4. OpenStack Block Storage Service (Cinder) .............................................................. 12 4.1. Overview ......................................................................................................... 12 4.2. Key Concepts .................................................................................................. 13 4.3. Process Structure ............................................................................................ 15 4.4. API Overview ................................................................................................... 18 4.5. Theory of Operation & Deployment Choices ...................................................... 19 4.6. Configuration ................................................................................................... 25 4.7. Examples ........................................................................................................ 40 5. OpenStack Image Service (Glance) .......................................................................... 49 5.1. Overview ......................................................................................................... 49 5.2. Key Concepts .................................................................................................. 49 5.3. Theory of Operation & Deployment Choices ...................................................... 50 5.4. Configuration ................................................................................................... 54 6. OpenStack Compute Service (Nova) ........................................................................ 56 6.1. Overview ......................................................................................................... 56 6.2. Key Concepts .................................................................................................. 56 6.3. Theory of Operation & Deployment Choices ...................................................... 57 7. OpenStack Object Storage Service (Swift) ............................................................... 59 7.1. Overview ......................................................................................................... 59 7.2. Swift Zones and NetApp E-Series Storage ........................................................ 61 7.3. Disk Pools, Volumes, and Mapping ................................................................... 62 7.4. Partitioning and File System Considerations ...................................................... 63 7.5. Swift Ring Considerations with DDP ................................................................. 65 8. Operational Concerns ............................................................................................... 67 8.1. Operational Concerns with Data ONTAP ........................................................... 67 A. Packaging ................................................................................................................. 70 A.1. Packaging and Downloading Requirements ...................................................... 70 A.2. Installation and Uninstallation ........................................................................... 70 A.3. Upgrading and Reverting ................................................................................. 70 A.4. Licensing ......................................................................................................... 70 A.5. Versioning ....................................................................................................... 70 A.6. Deprecated Drivers .......................................................................................... 70 B. Troubleshooting ....................................................................................................... 72 B.1. Common Problems .......................................................................................... 72 B.2. Triage and Data Collection ............................................................................... 75 B.3. References ...................................................................................................... 76 B.4. Support ........................................................................................................... 76 ii Deployment and Operations Guide List of Figures 2.1. OpenStack High Level Architecture ............................................................................ 3 4.1. Cinder and Nova Logical Architecture ....................................................................... 12 4.2. Cinder Processes Concept Diagram ......................................................................... 15 4.3. Cinder Workflow - Volume Creation .......................................................................... 16 4.4. Cinder & Nova Workflow - Volume Attach ................................................................. 17 4.5. Cinder & E-Series Deployment Topology .................................................................. 38 5.1. Enhanced Instance Creation Flowchart ..................................................................... 52 7.1. Traditional and E-Series Swift Stack Comparison ...................................................... 60 7.2. Controller-subsystem based zoning .......................................................................... 61 7.3. E-Series Controller Layout ....................................................................................... 62 iii Deployment and Operations Guide List of Tables 2.1. OpenStack Releases to Date ..................................................................................... 6 4.1. Cinder API Overview - Volume ................................................................................. 18 4.2. Cinder API Overview - Snapshot .............................................................................. 18 4.3. Cinder API Overview - Volume Type ........................................................................ 19 4.4. Cinder API Overview - Volume Type Extra Specs ...................................................... 19 4.5. Cinder API Overview - Volume Type QoS Specs ....................................................... 19 4.6. NetApp supported Extra Specs for use with Cinder Volume Types .............................. 24 4.7. Configuration options for clustered Data ONTAP with iSCSI ....................................... 27 4.8. Configuration options for clustered Data ONTAP with NFS ......................................... 29 4.9. Configuration options for Data ONTAP operating in 7-Mode with iSCSI ....................... 31 4.10. Configuration options for Data ONTAP operating in 7-Mode with NFS ....................... 33 4.11. Common Access Level Permissions Required with SVM Administrative Account ........ 35 4.12. Access Level Permissions Required For Extra Specs Support with SVM Administrative Account .................................................................................................... 36 4.13. Access Level Permissions Required For iSCSI Support with SVM Administrative Account .......................................................................................................................... 36 4.14. Access Level Permissions Required For NFS Support with SVM Administrative Account .......................................................................................................................... 36 4.15. Configuration options for E-Series with iSCSI .......................................................... 39 iv Deployment and Operations Guide Chapter 1. Executive Summary Most options for OpenStack integrated storage solutions aspire to offer scalability, but often lack the features and performance needed
Load more

Recommended publications
  • Netapp Datasheet
    Datasheet NetApp FlexArray Virtualization Software The industry’s only unified SAN and NAS storage virtualization platform The Challenge FlexArray software helps meet your KEY BENEFITS Expanding IT capabilities while changing business requirements Do More with Your reducing complexity through increased uptime with nondis- Existing Storage You have made substantial investments ruptive operations and continuous data Deliver advanced data in your existing infrastructure, but IT availability, superior cost control with management and software- requirements are changing. You’re being proven efficiency technologies, and defined storage capabilities. asked to increase uptime, improve improved performance with flash accel- application performance, and consider eration—all with the advantages of the Unify SAN and NAS new cloud strategies. You would like to NetApp Data ONTAP® operating sys- Serve a broader range of SAN satisfy these operational requirements tem. Clustered Data ONTAP provides and NAS workloads without with the storage you already own, but, the data control you need in a single complex add-on components. unfortunately, many platforms cannot platform that spans private, public, extend to meet new IT requirements. and hybrid clouds. Eliminate Downtime Perform maintenance and Adding new data storage architectures How NetApp FlexArray Works updates with no disruption; to your environment is one way to solve FlexArray connects your existing storage provide continuous data this challenge. But that creates silos arrays to FAS8000 controllers by using availability for mission-critical of storage that increase complexity, a Fibre Channel SAN. Array LUNs are applications. and retiring existing storage assets provisioned to the FAS8000 and col- can be costly. Enable Cloud Deployments lected into a storage pool from which NetApp volumes are created and Manage and maintain control of The Solution shared out to SAN hosts and NAS your data across private, public, NetApp FlexArray virtualization and hybrid clouds.
    [Show full text]
  • Netapp MAX Data
    WHITE PAPER Intel® Optane™ Persistent Memory Maximize Your Database Density and Performance NetApp Memory Accelerated Data (MAX Data) uses Intel Optane persistent memory to provide a low-latency, high-capacity data tier for SQL and NoSQL databases. Executive Summary To stay competitive, modern businesses need to ingest and process massive amounts of data efficiently and within budget. Database administrators (DBAs), in particular, struggle to reach performance and availability levels required to meet service-level agreements (SLAs). The problem stems from traditional data center infrastructure that relies on limited data tiers for processing and storing massive quantities of data. NetApp MAX Data helps solve this challenge by providing an auto-tiering solution that automatically moves frequently accessed hot data into persistent memory and less frequently used warm or cold data into local or remote storage based on NAND or NVM Express (NVMe) solid state drives (SSDs). The solution is designed to take advantage of Intel Optane persistent memory (PMem)—a revolutionary non-volatile memory technology in an affordable form factor that provides consistent, low-latency performance for bare-metal and virtualized single- or multi-tenant database instances. Testing performed by Intel and NetApp (and verified by Evaluator Group) demonstrated how MAX Data increases performance on bare-metal and virtualized systems and across a wide variety of tested database applications, as shown in Table 1. Test results also showed how organizations can meet or exceed SLAs while supporting a much higher number of database instances, without increasing the underlying hardware footprint. This paper describes how NetApp MAX Data and Intel Optane PMem provide low-latency performance for relational and NoSQL databases and other demanding applications.
    [Show full text]
  • Deep Dive : ONTAP Select
    Deep dive ONTAP Select NetApp September 23, 2021 This PDF was generated from https://docs.netapp.com/us-en/ontap- select/concept_stor_concepts_chars.html on September 23, 2021. Always check docs.netapp.com for the latest. Table of Contents Deep dive . 1 Storage. 1 Networking . 31 High availability architecture . 55 Performance. 63 Deep dive Storage Storage: General concepts and characteristics Discover general storage concepts that apply to the ONTAP Select environment before exploring the specific storage components. Phases of storage configuration The major configuration phases of the ONTAP Select host storage include the following: • Pre-deployment prerequisites ◦ Make sure that each hypervisor host is configured and ready for an ONTAP Select deployment. ◦ The configuration involves the physical drives, RAID controllers and groups, LUNs, as well as related network preparation. ◦ This configuration is performed outside of ONTAP Select. • Configuration using the hypervisor administrator utility ◦ You can configure certain aspects of the storage using the hypervisor administration utility (for example, vSphere in a VMware environment). ◦ This configuration is performed outside of ONTAP Select. • Configuration using the ONTAP Select Deploy administration utility ◦ You can use the Deploy administration utility to configure the core logical storage constructs. ◦ This is performed either explicitly through CLI commands or automatically by the utility as part of a deployment. • Post-deployment configuration ◦ After an ONTAP Select deployment completes, you can configure the cluster using the ONTAP CLI or System Manager. ◦ This configuration is performed outside of ONTAP Select Deploy. Managed versus unmanaged storage Storage that is accessed and directly controlled by ONTAP Select is managed storage. Any other storage on the same hypervisor host is unmanaged storage.
    [Show full text]
  • Disk Shelves, Storage Media and Cabling for Netapp FAS Systems
    Datasheet Disk Shelves, Storage Media, and Cabling for NetApp FAS Systems Key Benefits The Challenge High Availability and Resiliency Provide reliability and flexibility to support a broad set of application needs Full redundancy, multipath connections, Addressing the performance, capacity, and density needs of different applications out-of-band management, and advanced can be a tricky balancing act, especially in shared virtual infrastructures in which the analytics are standard. supported workloads can change quickly. Integrated Flash SSD Support Storage administrators must constantly think ahead. Their infrastructure must be highly Choose full solid-state disk (SSD) available, contain the right mix of HDD and SSD storage, and deliver the necessary data configurations or mix SSD and HDD to security for the changing requirements of modern IT deployments—including the cloud. combine the performance of flash with the capacity of hard disks. Acquiring and supporting separate storage systems for each workload can quickly exhaust your available budget, staff, and resources. When you add the ever-present Optical SAS Connectivity need to optimize power, cooling, and floor space utilization, it’s clear that storage Deliver high-performance, low-latency hardware must be more flexible than ever. SAS connections across distances of up to 500m for enhanced flexibility and The Solution resilience. Leading flexibility, performance, connectivity, and cross-platform leverage from NetApp Flexibility to Optimize Storage for Designed for the most demanding environments, the NetApp FAS architecture offers a Variety of Needs a high degree of flexibility and choice in supported disk shelves and storage media. NetApp® FAS disk shelves and storage From high-capacity HDDs to high-performance SSDs to self-encrypting drives, NetApp media give you flexibility to optimize delivers the right drive technology to meet your specific capacity, density, performance, for high performance or high capacity and security needs.
    [Show full text]
  • TR-4527: Netapp FAS and Cassandra
    VC Technical Report NetApp FAS and Cassandra Akshay Patil, Karthikeyan Nagalingam July 2016 | TR-4527 TABLE OF CONTENTS 1 Introduction ........................................................................................................................................ 4 2 Solution Overview ............................................................................................................................. 4 2.1 NetApp FAS ............................................................................................................................................... 4 2.2 Snap Creator Framework ........................................................................................................................... 4 2.3 Apache Cassandra Architecture Overview ................................................................................................. 5 3 Solution Architecture ........................................................................................................................ 6 3.1 Cassandra Cluster Architecture .................................................................................................................. 6 3.2 Network Architecture .................................................................................................................................. 7 4 Solution Validation ............................................................................................................................ 8 4.1 Hardware and Software Prerequisites .......................................................................................................
    [Show full text]
  • Netapp E/EF I FAS Storage Sistemi
    NetApp E/EF i FAS storage sistemi Nebojša Ilić COMING – Computer Engineering NetApp storage portfolio NPS for AWS AltaVault® for hybrid cloud Backup to the Cloud Data ONTAP-v™ for public cloud FlexPod®, FlexPod Select All Flash FAS converged infrastructure All-Flash Arrays NetApp® E-Series Arrays for highest performance purpose-built for performance, simplicity and reliability All-Flash SolidFire All-Flash EF FlexArray with E-Series StorageGRID® FlexArray™ object storage third-party array virtualization StorageGRID OnCommand® Hybrid Scale-out Arrays management software for shared infrastructures Professional and Support Services 2 NetApp E/EF serija 3 System highlights Entry and enterprise-class block storage designed for superior price/performance, storage density, and throughput Versatile Easy installation, low maintenance, and affordable reliable . storage . Modular design: choice of shelves, drives, I/O . E2700 . Tunable performance: both IOPS, bandwidth, and latency . E5600 . EF560 . Flash integration: performance and efficiency . Sustained performance and automated management 4 E-Series focus on performance Second Platform Third Platform Dedicated Enterprise Enterprise Workloads Workloads and Applications Workloads and Applications Workloads and Applications . Classic database and OLTP . Hadoop . HPC . Data warehouses/in-memory . NoSQL databases . Cybersecurity . At-scale backup . Analytics . Video analytics 5 NetApp E-Series at a glance Systems Years of OS shipped hardening 1M (nearing) 20+ Patents Items in current interoperability
    [Show full text]
  • Hardware RAID Services for Local Attached Storage : ONTAP Select
    Hardware RAID services for local attached storage ONTAP Select Barb Einarsen November 21, 2019 This PDF was generated from https://docs.netapp.com/us-en/ontap- select/concept_stor_hwraid_local.html on September 24, 2021. Always check docs.netapp.com for the latest. Table of Contents Hardware RAID services for local attached storage . 1 RAID controller configuration for local attached storage . 1 RAID mode. 2 Local disks shared between ONTAP Select and OS . 2 Local disks split between ONTAP Select and OS . 3 Multiple LUNs. 3 VMware vSphere virtual machine file system limits . 4 ONTAP Select virtual disks . 5 Virtual disk provisioning . 5 Virtualized NVRAM. 6 Data path explained: NVRAM and RAID controller . 6 Hardware RAID services for local attached storage When a hardware RAID controller is available, ONTAP Select can move RAID services to the hardware controller for both a write performance boost and protection against physical drive failures. As a result, RAID protection for all nodes within the ONTAP Select cluster is provided by the locally attached RAID controller and not through ONTAP software RAID. ONTAP Select data aggregates are configured to use RAID 0 because the physical RAID controller is providing RAID striping to the underlying drives. No other RAID levels are supported. RAID controller configuration for local attached storage All locally attached disks that provide ONTAP Select with backing storage must sit behind a RAID controller. Most commodity servers come with multiple RAID controller options across multiple price points, each with varying levels of functionality. The intent is to support as many of these options as possible, providing they meet certain minimum requirements placed on the controller.
    [Show full text]
  • Netapp Fabric-Attached Storage Systems
    HARDWARE NETWORK APPLIANCE™ FABRIC-ATTACHED STORAGE SYSTEMS Network Appliance provides the industry’s most fl exible, manageable, and scalable storage systems, which provide maximum data availability and data protection. KEY FEATURES THE CHALLENGE: MANAGING DATA risks, and control change. The breadth Reliable FOR MAXIMUM BUSINESS ADVANTAGE of the FAS product line provides storage Continuous data availability meeting the Continuous and ready access to an ever- solutions for a broad range of environments, needs of business- and mission-critical increasing volume of business information from large corporate data centers to remote applications has become essential to competitiveness offi ces. The FAS product line features the high-end FAS6000 series, for large-scale Fast and success of enterprises of all sizes. data consolidation and high-performance High throughput and fast response times Assuring that high-value data and content applications; the midrange FAS3000 series, demanded by transaction processing, are available whenever and wherever providing exceptional price-performance database, and technical applications needed enables faster decisions and higher productivity by managers, employees, value for both SAN and NAS; and Versatile and partners and better engagement the FAS200 series, for remote location One integrated architecture providing with customers, clients, and prospects. storage within geographically distributed concurrent block and fi le serving over enterprises. Fibre Channel and Ethernet networks Effi cient and effective data management INDUSTRY-LEADING ENTERPRISE Scalable is a core component of providing around- STORAGE CONSOLIDATION Nondisruptive capacity expansion the-clock and around-the-world information and quick performance upgrades from availability. Key aspects of data manage- NetApp FAS series are the most versatile entry-level to high-end confi gurations ment are consolidating data used by systems in the industry for storage multiple applications and many users on consolidation.
    [Show full text]
  • Netapp FAS8200 System Datasheet
    Datasheet NetApp FAS8200 Hybrid Flash System Quickly respond to changing storage needs across flash, disk, and cloud with industry-leading data management Key Benefits The Challenge Simplify Your Storage Environment Enabling the data-driven business Run SAN and NAS workloads with As the role of technology has expanded to cover key business operations as well as unified scale-out storage. back-office functions, IT leaders have had to rethink the way they architect storage. Traditional requirements such as storage uptime, scalability, and cost efficiency are still Accelerate Enterprise Applications critical, but so are factors such as flash acceleration, cloud integration, unified support Reduce latency and speed operations for SAN and NAS, and simplified data mining for competitive advantage. with up to 50% higher performance than previous generation. Many enterprises struggle, held back by structural limitations in legacy storage and data architectures. Traditional storage arrays might deliver on basic needs, but are Maximize Uptime divided into separate silos or are incapable of meeting advanced service requirements Eliminate planned downtime to add, and leveraging the cloud. upgrade, or retire storage with no disruptions. The Solution Accelerate business operations with unified scale-out storage Consolidate Infrastructure The demands of a data-driven business require a new approach to storage with an Scale up to 57PB, cluster with AFF integrated combination of high-performance hardware and adaptive, scalable storage all-flash systems, and integrate existing software. It needs to support existing workloads as well as adapt and scale quickly to third-party storage arrays. address new applications and evolving IT models. Optimize for the Hybrid Cloud FAS8200 hybrid storage systems are engineered specifically to address these needs.
    [Show full text]
  • TR-4190: Netapp Sizing Guidelines for MEDITECH Environments
    Technical Report NetApp Sizing Guidelines for MEDITECH Environments Brahmanna Chowdary Kodavali, NetApp March 2016 | TR-4190 TABLE OF CONTENTS 1 Introduction ........................................................................................................................................... 4 1.1 Scope ..............................................................................................................................................................4 1.2 Audience .........................................................................................................................................................5 2 MEDITECH and BridgeHead Workloads ............................................................................................. 5 2.1 MEDITECH Workload Description ..................................................................................................................5 2.2 BridgeHead Workload Description ..................................................................................................................7 3 Sizing NetApp Storage for MEDITECH and BridgeHead Workloads ............................................... 8 3.1 Sizing Methodology for NetApp Storage Systems ..........................................................................................8 3.2 Sizing for MEDITECH Production and BridgeHead Backup Workloads ..........................................................9 3.3 Sizing Parameters for NetApp SPM Sizing Tool ..........................................................................................
    [Show full text]
  • Recommended Tools for Data Migration : ONTAP
    Recommended tools for data migration ONTAP NetApp September 20, 2021 This PDF was generated from https://docs.netapp.com/us-en/ontap-fli/san- migration/concept_benchmarks_for_estimating_migration_durations.html on September 20, 2021. Always check docs.netapp.com for the latest. Table of Contents Recommended tools for data migration . 1 Benchmarks for estimating migration durations. 2 Recommended tools for data migration Service tools provide a standardized method for performing useful functions such as remote data collection, configuration, and storage management tasks. The following service tools are used to gather and parse data: • OneCollect NetApp Active IQ OneCollect, available with a web-based UI or the CLI, helps you collect data from storage, hosts, fabrics, and switches in both SAN and NAS environments. The collected data is used for troubleshooting, solution validation, data migration, and upgrade assessments. The diagnostic content related to your environment can be either sent to NetApp for further analysis or analyzed on-premises. • NetApp Data Migration Solaris Relabeler Solaris Relabeler is a command-line utility that provides the ability to update the ASCII label on volume table of contents (VTOC) disks after migration. During the initial VTOC disk initialization routines, the Solaris format command performs a SCSI inquiry against the disk and writes vendor-specific information (manufacturer, product, and revision) to the disk label. All further inquiries are directed to the disk label and not to the actual device. Block-level migration copies this disk label to the new disk, and old SCSI inquiry data is still visible in the system tools and logs. The relabeler updates the disks post-migration with new inquiry data.
    [Show full text]
  • CDW and Netapp Partner Practice
    CDW.com/netapp CDW.com/datacenter | 800.800.4239 IT’S WHO YOU KNOW: CDW + NETAPP DATA CENTER OPTIMIZATION WHEN IT COMES TO DATA CENTER OPTIMIZATION, IT’S NOT JUST WHAT YOU KNOW. IT’S WHO YOU KNOW. That’s why we partner with leading vendors like NetApp. They offer a wide range of optimization solutions to meet the performance, scalability and flexibility needs of your infrastructure. And as a FlexPod Premium Partner, CDW has the experts and the expertise to make them work for you. Together, we give our customers access to the latest innovations to help optimize their data centers for today and support the technological demands of the future. NETAPP GETS DATA CENTER OPTIMIZATION. POWERFUL AND AGILE STORAGE SOLUTIONS THAT GROW WITH YOU A FIRST STEP TO THE CLOUD NetApp® Fabric-Attached Storage (FAS) NetApp Data ONTAP® 8 architecture off ers Th e FlexPodTM data center platform is a systems deliver powerful storage with the a storage operating system to help address prevalidated solution. It combines storage, availability, scalability and performance to drive the challenges facing growing organizations. networking and server components and integrates them into a single fl exible the most demanding Storage Area Network · Data ONTAP 8 adds massive scalability, architecture. Th e FlexPod data center (SAN) and Network Attached Storage (NAS) improved management for large-scale platform is designed to ease IT transformation workloads. FAS boosts agility with: deployments and nondisruptive operations to virtual infrastructure and cloud computing with support for FC, FCoE, iSCSI, pNFS, NFS INTELLIGENCE with minimal risk. Its architecture can scale and CIFS.
    [Show full text]