PROXMOX VE ADMINISTRATION GUIDE RELEASE 7.0 July 6, 2021 Proxmox Server Solutions Gmbh www.proxmox.com Proxmox VE Administration Guide ii Copyright © 2021 Proxmox Server Solutions Gmbh Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the section entitled "GNU Free Documentation License". Proxmox VE Administration Guide iii Contents 1 Introduction 1 1.1 Central Management....................................... 2 1.2 Flexible Storage......................................... 3 1.3 Integrated Backup and Restore................................. 3 1.4 High Availability Cluster..................................... 3 1.5 Flexible Networking........................................ 4 1.6 Integrated Firewall........................................ 4 1.7 Hyper-converged Infrastructure................................. 4 1.7.1 Benefits of a Hyper-Converged Infrastructure (HCI) with Proxmox VE.......... 4 1.7.2 Hyper-Converged Infrastructure: Storage........................ 5 1.8 Why Open Source........................................ 5 1.9 Your benefits with Proxmox VE.................................. 5 1.10 Getting Help........................................... 6 1.10.1 Proxmox VE Wiki..................................... 6 1.10.2 Community Support Forum................................ 6 1.10.3 Mailing Lists........................................ 6 1.10.4 Commercial Support................................... 6 1.10.5 Bug Tracker........................................ 6 1.11 Project History.......................................... 6 1.12 Improving the Proxmox VE Documentation........................... 7 1.13 Translating Proxmox VE..................................... 7 1.13.1 Translating with git.................................... 8 1.13.2 Translating without git................................... 8 1.13.3 Testing the Translation.................................. 8 1.13.4 Sending the Translation.................................. 9 Proxmox VE Administration Guide iv 2 Installing Proxmox VE 10 2.1 System Requirements...................................... 10 2.1.1 Minimum Requirements, for Evaluation.......................... 10 2.1.2 Recommended System Requirements.......................... 11 2.1.3 Simple Performance Overview.............................. 11 2.1.4 Supported Web Browsers for Accessing the Web Interface............... 11 2.2 Prepare Installation Media.................................... 12 2.2.1 Prepare a USB Flash Drive as Installation Medium................... 12 2.2.2 Instructions for GNU/Linux................................ 12 2.2.3 Instructions for macOS.................................. 13 2.2.4 Instructions for Windows................................. 14 2.3 Using the Proxmox VE Installer................................. 14 2.3.1 Advanced LVM Configuration Options.......................... 21 2.3.2 Advanced ZFS Configuration Options.......................... 22 2.3.3 ZFS Performance Tips.................................. 23 2.4 Install Proxmox VE on Debian.................................. 23 3 Host System Administration 24 3.1 Package Repositories...................................... 24 3.1.1 Repositories in Proxmox VE............................... 24 3.1.2 Proxmox VE Enterprise Repository............................ 26 3.1.3 Proxmox VE No-Subscription Repository......................... 26 3.1.4 Proxmox VE Test Repository............................... 26 3.1.5 Ceph Pacific Repository................................. 27 3.1.6 Ceph Pacific Test Repository............................... 27 3.1.7 Ceph Octopus Repository................................ 27 3.1.8 Ceph Octopus Test Repository.............................. 28 3.1.9 SecureApt......................................... 28 3.2 System Software Updates.................................... 29 3.3 Network Configuration...................................... 29 3.3.1 Apply Network Changes................................. 29 3.3.2 Naming Conventions................................... 30 3.3.3 Choosing a network configuration............................ 31 3.3.4 Default Configuration using a Bridge........................... 31 3.3.5 Routed Configuration................................... 32 3.3.6 Masquerading (NAT) with iptables .......................... 33 Proxmox VE Administration Guide v 3.3.7 Linux Bond........................................ 34 3.3.8 VLAN 802.1Q....................................... 37 3.3.9 Disabling IPv6 on the Node................................ 39 3.4 Time Synchronization...................................... 40 3.4.1 Using Custom NTP Servers............................... 40 3.5 External Metric Server...................................... 41 3.5.1 Graphite server configuration............................... 41 3.5.2 Influxdb plugin configuration............................... 42 3.6 Disk Health Monitoring...................................... 42 3.7 Logical Volume Manager (LVM)................................. 43 3.7.1 Hardware......................................... 44 3.7.2 Bootloader........................................ 44 3.7.3 Creating a Volume Group................................. 44 3.7.4 Creating an extra LV for /var/lib/vz ........................ 45 3.7.5 Resizing the thin pool................................... 45 3.7.6 Create a LVM-thin pool.................................. 45 3.8 ZFS on Linux........................................... 46 3.8.1 Hardware......................................... 46 3.8.2 Installation as Root File System............................. 47 3.8.3 ZFS RAID Level Considerations............................. 48 3.8.4 Bootloader........................................ 49 3.8.5 ZFS Administration.................................... 49 3.8.6 Activate E-Mail Notification................................ 52 3.8.7 Limit ZFS Memory Usage................................ 52 3.8.8 SWAP on ZFS...................................... 53 3.8.9 Encrypted ZFS Datasets................................. 54 3.8.10 Compression in ZFS................................... 55 3.8.11 ZFS Special Device.................................... 55 3.8.12 ZFS Pool Features.................................... 57 3.9 BTRFS.............................................. 57 3.9.1 Installation as Root File System............................. 58 3.9.2 BTRFS Administration.................................. 59 3.10 Proxmox Node Management................................... 61 3.10.1 Wake-on-LAN....................................... 61 3.11 Certificate Management..................................... 61 Proxmox VE Administration Guide vi 3.11.1 Certificates for Intra-Cluster Communication....................... 61 3.11.2 Certificates for API and Web GUI............................. 62 3.11.3 Upload Custom Certificate................................ 62 3.11.4 Trusted certificates via Let’s Encrypt (ACME)...................... 63 3.11.5 ACME HTTP Challenge Plugin.............................. 64 3.11.6 ACME DNS API Challenge Plugin............................ 65 3.11.7 Automatic renewal of ACME certificates......................... 66 3.11.8 ACME Examples with pvenode ............................. 66 3.12 Host Bootloader......................................... 69 3.12.1 Partitioning Scheme Used by the Installer........................ 69 3.12.2 Synchronizing the content of the ESP with proxmox-boot-tool .......... 70 3.12.3 Determine which Bootloader is Used........................... 72 3.12.4 Grub........................................... 73 3.12.5 Systemd-boot....................................... 74 3.12.6 Editing the Kernel Commandline............................. 74 4 Graphical User Interface 75 4.1 Features............................................. 75 4.2 Login............................................... 76 4.3 GUI Overview.......................................... 76 4.3.1 Header.......................................... 77 4.3.2 My Settings........................................ 78 4.3.3 Resource Tree...................................... 78 4.3.4 Log Panel......................................... 79 4.4 Content Panels.......................................... 79 4.4.1 Datacenter........................................ 80 4.4.2 Nodes........................................... 81 4.4.3 Guests.......................................... 82 4.4.4 Storage.......................................... 84 4.4.5 Pools........................................... 85 5 Cluster Manager 86 5.1 Requirements.......................................... 86 5.2 Preparing Nodes......................................... 87 5.3 Create a Cluster......................................... 87 5.3.1 Create via Web GUI................................... 87 Proxmox VE Administration Guide vii 5.3.2 Create via Command Line................................ 88 5.3.3 Multiple Clusters In Same Network............................ 88 5.4 Adding Nodes to the Cluster................................... 88 5.4.1 Join Node to Cluster via GUI............................... 89 5.4.2 Join Node to Cluster via Command Line......................... 89 5.4.3 Adding Nodes With Separated Cluster Network..................... 90 5.5 Remove a Cluster Node..................................... 91 5.5.1 Separate A Node Without Reinstalling.........................