OpenNebula 5.2 Deployment guide Release 5.2.1 OpenNebula Systems Jan 09, 2017 This document is being provided by OpenNebula Systems under the Creative Commons Attribution-NonCommercial- Share Alike License. THE DOCUMENT IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IM- PLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE DOCUMENT. i CONTENTS 1 Cloud Design 1 1.1 Overview.................................................1 1.2 Open Cloud Architecture.........................................1 1.3 VMware Cloud Architecture.......................................7 1.4 OpenNebula Provisioning Model.................................... 13 2 OpenNebula Installation 19 2.1 Overview................................................. 19 2.2 Front-end Installation.......................................... 19 2.3 MySQL Setup.............................................. 24 3 Node Installation 26 3.1 Overview................................................. 26 3.2 KVM Node Installation......................................... 27 3.3 vCenter Node Installation........................................ 33 3.4 Verify your Installation.......................................... 37 4 Authentication Setup 45 4.1 Overview................................................. 45 4.2 SSH Authentication........................................... 46 4.3 x509 Authentication........................................... 48 4.4 LDAP Authentication.......................................... 51 5 Sunstone Setup 56 5.1 Overview................................................. 56 5.2 Sunstone Installation & Configuration.................................. 57 5.3 Sunstone Views.............................................. 65 5.4 User Security and Authentication.................................... 74 5.5 Cloud Servers Authentication...................................... 79 5.6 Configuring Sunstone for Large Deployments.............................. 82 6 VMware Infrastructure Setup 88 6.1 Overview................................................. 88 6.2 vCenter Node............................................... 88 6.3 vCenter Datastore............................................ 94 6.4 vCenter Networking........................................... 96 7 Open Cloud Host Setup 99 7.1 Overview................................................. 99 7.2 KVM Driver............................................... 99 7.3 Monitoring................................................ 108 ii 7.4 PCI Passthrough............................................. 111 8 Open Cloud Storage Setup 118 8.1 Overview................................................. 118 8.2 Filesystem Datastore........................................... 120 8.3 Ceph Datastore.............................................. 124 8.4 LVM Datastore.............................................. 128 8.5 Raw Device Mapping (RDM) Datastore................................. 130 8.6 iSCSI - Libvirt Datastore......................................... 132 8.7 The Kernels & Files Datastore...................................... 134 9 Open Cloud Networking Setup 136 9.1 Overview................................................. 136 9.2 Node Setup................................................ 137 9.3 Bridged Networking........................................... 138 9.4 802.1Q VLAN Networks......................................... 140 9.5 VXLAN Networks............................................ 141 9.6 Open vSwitch Networks......................................... 142 10 References 145 10.1 Overview................................................. 145 10.2 ONED Configuration........................................... 145 10.3 Logging & Debugging.......................................... 159 10.4 Onedb Tool................................................ 162 10.5 Large Deployments............................................ 165 iii CHAPTER ONE CLOUD DESIGN 1.1 Overview The first step of building a reliable, useful and successful cloud is to decide a clear design. This design needs to be aligned with the expected use of the cloud, and it needs to describe which data center components are going to be part of the cloud. This comprises i) all the infrastructure components such as networking, storage, authorization and virtualization back-ends, as well as the ii) planned dimension of the cloud (characteristics of the workload, numbers of users and so on) and the iii) provisioning workflow, ie, how end users are going to be isolated and using the cloud. In order to get the most out of a OpenNebula Cloud, we recommend that you create a plan with the features, perfor- mance, scalability, and high availability characteristics you want in your deployment. This Chapter provides informa- tion to plan an OpenNebula cloud based on KVM or vCenter. With this information, you will be able to easily architect and dimension your deployment, as well as understand the technologies involved in the management of virtualized resources and their relationship. 1.1.1 How Should I Read This Chapter This is the first Chapter to read, as it introduces the needed concepts to correctly define a cloud architecture. Within this Chapter, as first step a design of the cloud and its dimension should be drafted. For KVM clouds proceed to Open Cloud Architecture and for vCenter clouds read VMware Cloud Architecture. Then you could read the OpenNebula Provisioning Model to identify the wanted model to provision resources to end users. In a small installation with a few hosts, you can skip this provisioning model guide and use OpenNebula without giving much thought to infrastructure partitioning and provisioning. But for medium and large deployments you will probably want to provide some level of isolation and structure. Once the cloud architecture has been designed the next step would be to learn how to install the OpenNebula front-end. 1.1.2 Hypervisor Compatibility Section Compatibility Open Cloud Architecture This Section applies to KVM. VMware Cloud Architecture This Section applies to vCenter. OpenNebula Provisioning Model This Section applies to both KVM and vCenter. 1.2 Open Cloud Architecture Enterprise cloud computing is the next step in the evolution of data center (DC) virtualization. OpenNebula is a simple but feature-rich and flexible solution to build and manage enterprise clouds and virtualized DCs, that combines existing 1 OpenNebula 5.2 Deployment guide, Release 5.2.1 virtualization technologies with advanced features for multi-tenancy, automatic provision and elasticity. OpenNebula follows a bottom-up approach driven by sysadmins, devops and users real needs. 1.2.1 Architectural Overview OpenNebula assumes that your physical infrastructure adopts a classical cluster-like architecture with a front-end, and a set of hosts where Virtual Machines (VM) will be executed. There is at least one physical network joining all the hosts with the front-end. A cloud architecture is defined by three components: storage, networking and virtualization. Therefore, the basic components of an OpenNebula system are: • Front-end that executes the OpenNebula services. • Hypervisor-enabled hosts that provide the resources needed by the VMs. • Datastores that hold the base images of the VMs. • Physical networks used to support basic services such as interconnection of the storage servers and OpenNebula control operations, and VLANs for the VMs. OpenNebula presents a highly modular architecture that offers broad support for commodity and enterprise-grade hypervisor, monitoring, storage, networking and user management services. This Section briefly describes the different choices that you can make for the management of the different subsystems. If your specific services are not supported we recommend to check the drivers available in the Add-on Catalog. We also provide information and support about how to develop new drivers. 1.2.2 Dimensioning the Cloud The dimension of a cloud infrastructure can be directly inferred from the expected workload in terms of VMs that the cloud infrastructure must sustain. This workload is also tricky to estimate, but this is a crucial exercise to build an efficient cloud. The main aspects to take into account at the time of dimensioning the OpenNebula cloud follows. OpenNebula front-end The minimum recommended specs are for the OpenNebula front-end are: Resources Minimum Recommended configuration Memory 2 GB CPU 1 CPU (2 cores) Disk Size 100 GB Network 2 NICS 1.2. Open Cloud Architecture 2 OpenNebula 5.2 Deployment guide, Release 5.2.1 The maximum number of servers (virtualization hosts) that can be managed by a single OpenNebula instance strongly depends on the performance and scalability of the underlying platform infrastructure, mainly the storage subsystem. The general recommendation is that no more than 500 servers managed by a single instance, but there are users with 1,000 servers in each zone. Related to this, read the section about how to tune OpenNebula for large deployments. KVM nodes Regarding the dimensions of the KVM virtualization nodes: • CPU: without overcommitment, each CPU core assigned to a VM must exists as a physical CPU core. By example, for a workload of 40 VMs with 2 CPUs, the cloud will need 80 physical CPUs. These 80 physical CPUs can be spread among different