OpenNebula 5.10 Deployment guide Release 5.10.5 OpenNebula Systems Sep 21, 2020 This document is being provided by OpenNebula Systems under the Creative Commons Attribution-NonCommercial- Share Alike License. THE DOCUMENT IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IM- PLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE DOCUMENT. i CONTENTS 1 Cloud Design 1 1.1 Overview.................................................1 1.2 Open Cloud Architecture.........................................2 1.3 VMware Cloud Architecture.......................................7 1.4 OpenNebula Provisioning Model.................................... 13 2 OpenNebula Installation 18 2.1 Overview................................................. 18 2.2 Front-end Installation.......................................... 18 2.3 MySQL Setup.............................................. 26 3 Node Installation 29 3.1 Overview................................................. 29 3.2 KVM Node Installation......................................... 30 3.3 LXD Node Installation.......................................... 37 3.4 vCenter Node Installation........................................ 39 3.5 Verify your Installation.......................................... 47 4 Authentication Setup 56 4.1 Overview................................................. 56 4.2 SSH Authentication........................................... 57 4.3 x509 Authentication........................................... 59 4.4 LDAP Authentication.......................................... 62 5 Sunstone Setup 68 5.1 Overview................................................. 68 5.2 Sunstone Installation & Configuration.................................. 69 5.3 Sunstone Views.............................................. 78 5.4 Labels.................................................. 82 5.5 User Security and Authentication.................................... 92 5.6 Cloud Servers Authentication...................................... 98 5.7 Configuring Sunstone for Large Deployments.............................. 101 6 VMware Infrastructure Setup 107 6.1 Overview................................................. 107 6.2 vCenter Driver Setup........................................... 107 6.3 vCenter Datastores............................................ 129 6.4 vCenter Networking Overview...................................... 137 6.5 NSX Setup................................................ 144 7 Open Cloud Host Setup 153 ii 7.1 Overview................................................. 153 7.2 KVM Driver............................................... 153 7.3 LXD Driver................................................ 163 7.4 Monitoring................................................ 169 7.5 PCI Passthrough............................................. 173 8 Open Cloud Storage Setup 180 8.1 Overview................................................. 180 8.2 Filesystem Datastore........................................... 182 8.3 Ceph Datastore.............................................. 187 8.4 LVM Datastore.............................................. 193 8.5 Raw Device Mapping (RDM) Datastore................................. 196 8.6 iSCSI - Libvirt Datastore......................................... 198 8.7 The Kernels & Files Datastore...................................... 200 9 Open Cloud Networking Setup 202 9.1 Overview................................................. 202 9.2 Node Setup................................................ 203 9.3 Bridged Networking........................................... 205 9.4 802.1Q VLAN Networks......................................... 206 9.5 VXLAN Networks............................................ 208 9.6 Open vSwitch Networks......................................... 212 10 References 216 10.1 Overview................................................. 216 10.2 ONED Configuration........................................... 216 10.3 Logging & Debugging.......................................... 233 10.4 Onedb Tool................................................ 236 10.5 Scalability Testing and Tuning...................................... 240 iii CHAPTER ONE CLOUD DESIGN 1.1 Overview The first step of building a reliable, useful and successful cloud is to decide a clear design. This design needs to be aligned with the expected use of the cloud, and it needs to describe which data center components are going to be part of the cloud. This comprises i) all the infrastructure components such as networking, storage, authorization and virtualization back-ends, as well as the ii) planned dimension of the cloud (characteristics of the workload, numbers of users and so on) and the iii) provisioning workflow, i.e. how end users are going to be isolated and using the cloud. In order to get the most out of a OpenNebula Cloud, we recommend that you create a plan with the features, perfor- mance, scalability, and high availability characteristics you want in your deployment. This Chapter provides infor- mation to plan an OpenNebula cloud based on KVM or LXD or vCenter. With this information, you will be able to easily architect and dimension your deployment, as well as understand the technologies involved in the management of virtualized resources and their relationship. 1.1.1 How Should I Read This Chapter This is the first Chapter to read, as it introduces the necessary concepts to correctly define a cloud architecture. Within this Chapter, as a first step, a design of the cloud and its dimension should be drafted. For KVM and LXD clouds proceed to Open Cloud Architecture and for vCenter clouds read VMware Cloud Architecture. Then you could read the OpenNebula Provisioning Model to identify the model wanted to provision resources to end users. In a small installation with a few hosts, you can skip this provisioning model guide and use OpenNebula without giving much thought to infrastructure partitioning and provisioning. But for medium and large deployments you will probably want to provide some level of isolation and structure. Once the cloud architecture has been designed, the next step would be to learn how to install the OpenNebula front-end. 1.1.2 Hypervisor Compatibility Section Compatibility Open Cloud Architecture This Section applies to KVM and LXD. VMware Cloud Architecture This Section applies to vCenter. OpenNebula Provisioning Model This Section applies to both KVM and vCenter. 1 OpenNebula 5.10 Deployment guide, Release 5.10.5 1.2 Open Cloud Architecture Enterprise cloud computing is the next step in the evolution of data center (DC) virtualization. OpenNebula is a simple but feature-rich and flexible solution to build and manage enterprise clouds and virtualized DCs, that combines existing virtualization technologies with advanced features for multi-tenancy, automatic provision and elasticity. OpenNebula follows a bottom-up approach driven by sysadmins, devops and users real needs. 1.2.1 Architectural Overview OpenNebula assumes that your physical infrastructure adopts a classical cluster-like architecture with a front-end, and a set of hosts where Virtual Machines (VM) will be executed. There is at least one physical network joining all the hosts with the front-end. A cloud architecture is defined by three components: storage, networking and virtualization. Therefore, the basic components of an OpenNebula system are: • Front-end that executes the OpenNebula services. • Hypervisor-enabled hosts that provide the resources needed by the VMs. • Datastores that hold the base images of the VMs. • Physical networks used to support basic services such as interconnection of the storage servers and OpenNebula control operations, and VLANs for the VMs. OpenNebula presents a highly modular architecture that offers broad support for commodity and enterprise-grade hy- pervisors, monitoring, storage, networking and user management services. This Section briefly describes the different choices that you can make for the management of the different subsystems. If your specific services are not supported we recommend checking the drivers available in the Add-on Catalog. We also provide information and support about how to develop new drivers. 1.2.2 Dimensioning the Cloud The dimension of a cloud infrastructure can be directly inferred from the expected workload in terms of VMs that the cloud infrastructure must sustain. This workload is also tricky to estimate, but this is a crucial exercise to build an 1.2. Open Cloud Architecture 2 OpenNebula 5.10 Deployment guide, Release 5.10.5 efficient cloud. The main aspects to take into account at the time of dimensioning the OpenNebula cloud follow. OpenNebula front-end The minimum recommended specs are for the OpenNebula front-end are: Resource Minimum Recommended configuration Memory 8 GB CPU 1 CPU (4 cores) Disk Size 100 GB Network 2 NICs Please take into account that these recommendations are meant as a guidance and may be relaxed or increased depend- ing on the size and workload of your cloud. The maximum number of servers (virtualization hosts) that can be managed by a single OpenNebula instance strongly depends on the performance and scalability of the underlying platform infrastructure, mainly the storage subsystem. The general recommendation is no more than