Virtual GPU Software User Guide Is Organized As Follows: ‣ This Chapter Introduces the Capabilities and Features of NVIDIA Vgpu Software
Total Page:16
File Type:pdf, Size:1020Kb
Virtual GPU Software User Guide DU-06920-001 _v13.0 Revision 02 | August 2021 Table of Contents Chapter 1. Introduction to NVIDIA vGPU Software..............................................................1 1.1. How NVIDIA vGPU Software Is Used....................................................................................... 1 1.1.2. GPU Pass-Through.............................................................................................................1 1.1.3. Bare-Metal Deployment.....................................................................................................1 1.2. Primary Display Adapter Requirements for NVIDIA vGPU Software Deployments................2 1.3. NVIDIA vGPU Software Features............................................................................................. 3 1.3.1. GPU Instance Support on NVIDIA vGPU Software............................................................3 1.3.2. API Support on NVIDIA vGPU............................................................................................ 5 1.3.3. NVIDIA CUDA Toolkit and OpenCL Support on NVIDIA vGPU Software...........................5 1.3.4. Additional vWS Features....................................................................................................8 1.3.5. NVIDIA GPU Cloud (NGC) Containers Support on NVIDIA vGPU Software...................... 9 1.3.6. NVIDIA GPU Operator Support.......................................................................................... 9 1.4. How this Guide Is Organized..................................................................................................10 Chapter 2. Installing and Configuring NVIDIA Virtual GPU Manager................................ 11 2.1. About NVIDIA Virtual GPUs.................................................................................................... 11 2.1.1. NVIDIA vGPU Architecture............................................................................................... 11 2.1.1.1. Time-Sliced NVIDIA vGPU Internal Architecture..................................................... 12 2.1.1.2. MIG-Backed NVIDIA vGPU Internal Architecture.....................................................13 2.1.2. About Virtual GPU Types..................................................................................................14 2.1.3. Virtual Display Resolutions for Q-series and B-series vGPUs.......................................16 2.1.4. Valid Virtual GPU Configurations on a Single GPU........................................................ 17 2.1.4.1. Valid Time-Sliced Virtual GPU Configurations on a Single GPU............................. 17 2.1.4.2. Valid MIG-Backed Virtual GPU Configurations on a Single GPU.............................18 2.1.5. Guest VM Support............................................................................................................ 18 2.1.5.1. Windows Guest VM Support......................................................................................19 2.1.5.2. Linux Guest VM support............................................................................................19 2.2. Prerequisites for Using NVIDIA vGPU................................................................................... 19 2.3. Switching the Mode of a GPU that Supports Multiple Display Modes..................................20 2.4. Switching the Mode of a Tesla M60 or M6 GPU....................................................................21 2.5. Installing and Configuring the NVIDIA Virtual GPU Manager for Citrix Hypervisor..............21 2.5.1. Installing and Updating the NVIDIA Virtual GPU Manager for Citrix Hypervisor........... 22 2.5.1.1. Installing the RPM package for Citrix Hypervisor....................................................22 2.5.1.2. Updating the RPM Package for Citrix Hypervisor....................................................22 2.5.1.3. Installing or Updating the Supplemental Pack for Citrix Hypervisor...................... 23 Virtual GPU Software DU-06920-001 _v13.0 Revision 02 | ii 2.5.1.4. Verifying the Installation of the NVIDIA vGPU Software for Citrix Hypervisor Package.............................................................................................................................. 25 2.5.2. Configuring a Citrix Hypervisor VM with Virtual GPU.....................................................26 2.5.3. Setting vGPU Plugin Parameters on Citrix Hypervisor.................................................. 27 2.6. Installing the Virtual GPU Manager Package for Linux KVM................................................28 2.7. Installing and Configuring the NVIDIA Virtual GPU Manager for Red Hat Enterprise Linux KVM or RHV............................................................................................................................... 29 2.7.1. Installing the NVIDIA Virtual GPU Manager for Red Hat Enterprise Linux KVM or RHV......................................................................................................................................... 30 2.7.1.1. Installing the Virtual GPU Manager Package for Red Hat Enterprise Linux KVM or RHV.................................................................................................................................30 2.7.1.2. Verifying the Installation of the NVIDIA vGPU Software for Red Hat Enterprise Linux KVM or RHV............................................................................................................. 31 2.7.2. Adding a vGPU to a Red Hat Virtualization (RHV) VM.....................................................32 2.7.3. Getting the BDF and Domain of a GPU on Red Hat Enterprise Linux KVM................... 33 2.7.4. Creating an NVIDIA vGPU on Red Hat Enterprise Linux KVM........................................34 2.7.4.1. Creating a Legacy NVIDIA vGPU on Red Hat Enterprise Linux KVM....................... 35 2.7.4.2. Creating an NVIDIA vGPU that Supports SR-IOV on Red Hat Enterprise Linux KVM..................................................................................................................................... 36 2.7.5. Adding One or More vGPUs to a Red Hat Enterprise Linux KVM VM.............................39 2.7.5.1. Adding One or More vGPUs to a Red Hat Enterprise Linux KVM VM by Using virsh.....................................................................................................................................40 2.7.5.2. Adding One or More vGPUs to a Red Hat Enterprise Linux KVM VM by Using the QEMU Command Line....................................................................................................... 41 2.7.6. Setting vGPU Plugin Parameters on Red Hat Enterprise Linux KVM............................42 2.7.7. Deleting a vGPU on Red Hat Enterprise Linux KVM.......................................................42 2.7.8. Preparing a GPU Configured for Pass-Through for Use with vGPU..............................43 2.7.9. NVIDIA vGPU Information in the sysfs File System........................................................45 2.8. Installing and Configuring the NVIDIA Virtual GPU Manager for VMware vSphere............. 47 2.8.1. Installing and Updating the NVIDIA Virtual GPU Manager for vSphere.........................49 2.8.1.1. Installing the NVIDIA Virtual GPU Manager Package for vSphere.......................... 49 2.8.1.2. Updating the NVIDIA Virtual GPU Manager Package for vSphere...........................50 2.8.1.3. Verifying the Installation of the NVIDIA vGPU Software Package for vSphere...... 51 2.8.2. Configuring VMware vMotion with vGPU for VMware vSphere...................................... 51 2.8.3. Changing the Default Graphics Type in VMware vSphere 6.5 and Later....................... 53 2.8.4. Configuring a vSphere VM with NVIDIA vGPU................................................................ 57 2.8.5. Setting vGPU Plugin Parameters on VMware vSphere.................................................. 60 2.8.6. Configuring a vSphere VM with VMware vSGA............................................................... 61 2.9. Configuring a GPU for MIG-Backed vGPUs...........................................................................62 Virtual GPU Software DU-06920-001 _v13.0 Revision 02 | iii 2.9.1. Enabling MIG Mode for a GPU........................................................................................ 62 2.9.2. Creating GPU Instances on a MIG-Enabled GPU........................................................... 63 2.9.3. Optional: Creating Compute Instances in a GPU instance.............................................64 2.10. Disabling MIG Mode for One or More GPUs........................................................................66 2.11. Disabling and Enabling ECC Memory.................................................................................. 67 2.11.1. Disabling ECC Memory.................................................................................................. 68 2.11.2. Enabling ECC Memory................................................................................................... 69 Chapter 3. Using GPU Pass-Through................................................................................ 71 3.1. Display Resolutions for Physical GPUs................................................................................. 72 3.2. Using GPU Pass-Through on Citrix Hypervisor.....................................................................73 3.2.1. Configuring