GPU Virtualization Yiying Zhang A Full GPU Virtualization Solution with Mediated Pass-Through
Kun Tian, Yaozu Dong, David Cowperthwaite kevin.tian@intel.com, [email protected], [email protected] GPUvm:'Why'Not'Virtualizing'GPUs' at'the'Hypervisor?
Yusuke'Suzuki*' in'collaboraBon'with' Shinpei'Kato**,'Hiroshi'Yamada***,'Kenji'Kono*' ' *'Keio'University' **'Nagoya'University' ***'Tokyo'University'of'Agriculture'and'Technology'
Graphic'Processing'Unit'(GPU) • GPUs'are'used'for'dataMparallel'computaBons' – Composed'of'thousands'of'cores' – Peak'doubleMprecision'performance'exceeds'1'TFLOPS' – PerformanceMperMwaT'of'GPUs'outperforms'CPUs' • GPGPU'is'widely'accepted'for'various'uses' – Network'Systems'[Jang&et&al.&’11],'FS'[Silberstein&et&al.&’13]& [Sun&et&al.&’12],'DBMS'[He&et&al.&’08]&etc.' NVIDIA/GPU
L1 L1 L1 L1 L1 L1 L1 L2'Cache
Video'Memory CPU Main'Memory MoBvaBon • GPU'is'not'the'firstMclass'ciBzen'of'cloud' compuBng'environment' – Can'not'mulBplex'GPGPU'among'virtual'machines'(VM)' – Can'not'consolidate'VMs'that'run'GPGPU'applicaBons' • GPU'virtualizaBon'is'necessary' – VirtualizaBon'is'the'norms'in'the'clouds'
VM VM VM Share' Hypervisor a'single'GPU' among'VMs' Physical' GPU Machine VirtualizaBon'Approaches'
• Categorized'into'three'approaches' 1. I/O'passMthrough' 2. API'remoBng' 3. ParaMvirtualizaBon' I/O'passMthrough'
• Amazon'EC2'GPU'instance,'Intel'VTMd& – Assign'physical'GPUs'to'VMs'directly' – MulBplexing'is'impossible'