Operations Guide
Total Page:16
File Type:pdf, Size:1020Kb
Operations Guide Release Version: 15.0.0 OpenStack contributors Jun 18, 2017 CONTENTS Abstract 1 Contents 2 Acknowledgements ......................................... 2 Preface ................................................ 2 Conventions ............................................. 8 Factors affecting OpenStack deployment ............................... 9 Planning for deploying and provisioning OpenStack ......................... 13 Capacity planning and scaling .................................... 16 Lay of the Land ........................................... 22 Managing Projects and Users ..................................... 32 User-Facing Operations ....................................... 44 Maintenance, Failures, and Debugging ................................ 81 Network Troubleshooting ...................................... 102 Logging and Monitoring ....................................... 118 Backup and Recovery ........................................ 130 Customization ............................................ 133 Advanced Configuration ....................................... 144 Upgrades ............................................... 146 Appendix ............................................... 155 Index 209 i ABSTRACT This guide provides information about operating OpenStack clouds. We recommend that you turn to the Installation Tutorials and Guides, which contains a step-by-step guide on how to manually install the OpenStack packages and dependencies on your cloud. While it is important for an operator to be familiar with the steps involved in deploying OpenStack, we also strongly encourage you to evaluate OpenStack deployment tools and configuration-management tools, such as Puppet or Chef, which can help automate this deployment process. In this guide, we assume that you have successfully deployed an OpenStack cloud and are able to perform basic operations such as adding images, booting instances, and attaching volumes. As your focus turns to stable operations, we recommend that you do skim this guide to get a sense of the content. Some of this content is useful to read in advance so that you can put best practices into effect to simplify your life in the long run. Other content is more useful as a reference that you might turn to when an unexpected event occurs (such as a power failure), or to troubleshoot a particular problem. 1 CONTENTS Acknowledgements The OpenStack Foundation supported the creation of this book with plane tickets to Austin, lodging (including one adventurous evening without power after a windstorm), and delicious food. For about USD $10,000, we could collaborate intensively for a week in the same room at the Rackspace Austin office. The authors are all members of the OpenStack Foundation, which you can join. Go to the Foundation web site. We want to acknowledge our excellent host Rackers at Rackspace in Austin: • Emma Richards of Rackspace Guest Relations took excellent care of our lunch orders and even set aside a pile of sticky notes that had fallen off the walls. • Betsy Hagemeier, a Fanatical Executive Assistant, took care of a room reshuffle and helped us settle in for the week. • The Real Estate team at Rackspace in Austin, also known as “The Victors,” were super responsive. • Adam Powell in Racker IT supplied us with bandwidth each day and second monitors for those of us needing more screens. • On Wednesday night we had a fun happy hour with the Austin OpenStack Meetup group and Racker Katie Schmidt took great care of our group. We also had some excellent input from outside of the room: • Tim Bell from CERN gave us feedback on the outline before we started and reviewed it mid-week. • Sébastien Han has written excellent blogs and generously gave his permission for re-use. • Oisin Feeley read it, made some edits, and provided emailed feedback right when we asked. Inside the book sprint room with us each day was our book sprint facilitator Adam Hyde. Without his tireless support and encouragement, we would have thought a book of this scope was impossible in five days. Adam has proven the book sprint method effectively again and again. He creates both tools and faith in collaborative authoring at www.booksprints.net. We couldn’t have pulled it off without so much supportive help and encouragement. Preface OpenStack is an open source platform that lets you build an Infrastructure-as-a-Service (IaaS) cloud that runs on commodity hardware. Introduction to OpenStack OpenStack believes in open source, open design, and open development, all in an open community that encour- ages participation by anyone. The long-term vision for OpenStack is to produce a ubiquitous open source cloud computing platform that meets the needs of public and private cloud providers regardless of size. OpenStack services control large pools of compute, storage, and networking resources throughout a data center. 2 Operations Guide (Release Version: 15.0.0) The technology behind OpenStack consists of a series of interrelated projects delivering various components for a cloud infrastructure solution. Each service provides an open API so that all of these resources can be managed through a dashboard that gives administrators control while empowering users to provision resources through a web interface, a command-line client, or software development kits that support the API. Many OpenStack APIs are extensible, meaning you can keep compatibility with a core set of calls while providing access to more resources and innovating through API extensions. The OpenStack project is a global collaboration of developers and cloud computing technologists. The project produces an open standard cloud computing platform for both public and private clouds. By focusing on ease of implementation, massive scalability, a variety of rich features, and tremendous extensibility, the project aims to deliver a practical and reliable cloud solution for all types of organizations. Getting Started with OpenStack As an open source project, one of the unique aspects of OpenStack is that it has many different levels at which you can begin to engage with it—you don’t have to do everything yourself. Using OpenStack You could ask, “Do I even need to build a cloud?” If you want to start using a compute or storage service by just swiping your credit card, you can go to eNovance, HP, Rackspace, or other organizations to start using their public OpenStack clouds. Using their OpenStack cloud resources is similar to accessing the publicly available Amazon Web Services Elastic Compute Cloud (EC2) or Simple Storage Solution (S3). Plug and Play OpenStack However, the enticing part of OpenStack might be to build your own private cloud, and there are several ways to accomplish this goal. Perhaps the simplest of all is an appliance-style solution. You purchase an appliance, unpack it, plug in the power and the network, and watch it transform into an OpenStack cloud with minimal additional configuration. However, hardware choice is important for many applications, so if that applies to you, consider that there are several software distributions available that you can run on servers, storage, and network products of your choosing. Canonical (where OpenStack replaced Eucalyptus as the default cloud option in 2011), Red Hat, and SUSE offer enterprise OpenStack solutions and support. You may also want to take a look at some of the specialized distributions, such as those from Rackspace, Piston, SwiftStack, or Cloudscaling. Alternatively, if you want someone to help guide you through the decisions about the underlying hardware or your applications, perhaps adding in a few features or integrating components along the way, consider contacting one of the system integrators with OpenStack experience, such as Mirantis or Metacloud. If your preference is to build your own OpenStack expertise internally, a good way to kick-start that might be to attend or arrange a training session. The OpenStack Foundation has a Training Marketplace where you can look for nearby events. Also, the OpenStack community is working to produce open source training materials. Roll Your Own OpenStack However, this guide has a different audience—those seeking flexibility from the OpenStack framework by deploying do-it-yourself solutions. OpenStack is designed for horizontal scalability, so you can easily add new compute, network, and storage resources to grow your cloud over time. In addition to the pervasiveness of massive OpenStack public clouds, Preface 3 Operations Guide (Release Version: 15.0.0) many organizations, such as PayPal, Intel, and Comcast, build large-scale private clouds. OpenStack offers much more than a typical software package because it lets you integrate a number of different technologies to construct a cloud. This approach provides great flexibility, but the number of options might be daunting at first. Who This Book Is For This book is for those of you starting to run OpenStack clouds as well as those of you who were handed an operational one and want to keep it running well. Perhaps you’re on a DevOps team, perhaps you are a system administrator starting to dabble in the cloud, or maybe you want to get on the OpenStack cloud team at your company. This book is for all of you. This guide assumes that you are familiar with a Linux distribution that supports OpenStack, SQL databases, and virtualization. You must be comfortable administering and configuring multiple Linux machines for net- working. You must install and maintain an SQL database and occasionally run queries against