Intel® Graphics Virtualization Technology

Kevin Tian Graphics Virtualization Architect

Legal Disclaimer

INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD YOU PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND EXPENSES AND REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS. Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information. The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request. Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order. Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained by calling 1-800-548-4725, or go to: http://www.intel.com/design/literature.htm

Intel, Core, Look Inside, and the Intel logo are trademarks of Intel Corporation in the United States and other countries.

*Other names and brands may be claimed as the property of others. Copyright © 2014 Intel Corporation. GPU Virtualization

VM VM … VM

Hypervisor

3D Media Compute

Intel Processor Graphics

3 GPU Cloud

Video Delivery Cloud Graphics Visual Understanding Store/Stream, Transcode Gaming, Remote Apps, Search, Surveillance Rendering

GPU-as-a-service

GPU Cloud

4 Media Processing Opportunity

Consumer Internet Traffic 2011-2018 China Online Video Industry Market

Internet Video File Sharing

Thousands Web, Email and Data

Online Gaming Petabytes per Month Online video market (0.1B) Year on year growth (%)

Source: Cisco Systems Inc., Visual Network Index (VNI), 2013, 2015 Source: 2015.1 iResearch Inc., www.iresearch.com.cn

Internet video traffic is forecasted to grow at 29% CAGR and will represent 69% of consumer traffic by 2017

5 Media Delivery Example

Video files store Media transcoding Media transcoding 1 in cloud storage 2 before deliver to CDN 3 for client in Edge Content Provider Content Deliver Transport Edge Network (RAN, IP, Cable) Data Center Service Provider Laptop

Servers Servers

VMVM VMVM VMVM SDN VM VM VM NFV Edge Cloud Media Cloud Realtime, Video Conf, video awareness OTT, VOD, Offline Video …

6 Requirements of GPU Virtualization

hcsvg hb b Performance Direct GPU acceleration

Capability Consistent visual experience

Sharing Multiple Virtual Machines

Intel Confidential GPU Virtualization Approaches

API Forwarding Direct Pass-thru Full GPU Virtualization

Pros: Pros: Pros: • Performance • Performance • Performance • Sharing • Capability • Capability • Sharing Cons: Cons: • No media/GPGPU • No sharing • Compatibility

8 Intel® Graphics Virtualization Technology

. Intel® GVT-s for API level GPU sharing . Make existing API forwarding protocols running best on Intel platform

. Intel® GVT-d for direct GPU passthrough . Xen GPU passthrough upstreaming in progress . KVM PoC patch in community

. Intel® GVT-g for vGPU based sharing . Achieve a good balance of performance, feature and sharing . Xen implementations (a.k.a XenGT) in production quality on HSW . BDW support is in alpha quality in 2015/Q1 release . KVM support (a.k.a KVMGT) in prototype quality on HSW

9 Intel GVT-g: Full GPU Virtualization

Performance Feature Sharing

3DMark: 80% Native driver Simultaneously

accelerate multiple H.264 transcoding: 90% DirectX 11.1, OpenGL 4.2, OpenCL (of native performance) 1.2, MediaSDK x.x VMs

HSW BDW SKL … Building Blocks

Media Server Media Server * Media Server OpenStack Real Time Video VoD streaming Nova Transcoding Conference Control point GPU instance Intel® Media SDK Intel Media SDK Intel Media SDK

OpenStack Intel® HD Driver Intel HD Driver Intel HD Driver Network node

ISV Guest OS ISV Guest OS ISV Guest OS * * Ubuntu 14.04 LTS Windows 7 64bit Windows 8 32bit ISV/Non Intel OpenStack XenGT KVMGT Storage/Image Intel Hardware Xen* Hypervisor KVM Hypervisor Host OS or VM Intel Own

Cloud 4th generation Intel Xeon® E3 Processor Intel Contributed Infrastructure Intel® Core™ i7

11 Video Conference Usage Case

Media Server Pool (x86 platform with Intel® Processor graphics) 4K Camera

4K Display

Intel Processor graphics-based Encoding, Decoding, and Composing. * 1080P Camera OpenStack Media Cloud 4K Video Conferencing on Media Plane NFV Demo @ MWC’15

12 Performance Summary

High Density workload: 480p transcoding High Density workload: 1080p transcoding 1400.0 450.0 400.0 1200.0 350.0 1000.0 300.0 250.0 800.0 200.0 150.0 600.0 100.0 400.0 50.0 0.0 200.0

0.0 1ch-D1 5ch-D1 10ch-D1 20ch-D1 25ch-D1 30ch-D1

Native vMediaServer native vMediaServer

Config: I7 4770, Guest Ubuntu* 14.04LTS, 4GB mem, 1.5G GraphicMem, MediaSDK Avg S90% of native H.264 transcoding performance

13 CPU Transcoding vs. GPU Transcoding

vCPU vs Intel® Graphics Virtualization Technology (Intel® GVT-g) total fps (1ch x 1080p MPEG2->720p H264 transcoding)

180 120.00% 159.448 160 142.4 137.496 100.00%

140 131.142

120 80.00% 100 Performance boost 60.00% 80 66.11 60.925 with Intel GVT-g! 60 40.00% utilizedCPU% FPS throughput FPS 37.426 40 22.579 20.00% 20

0 0.00% 1 vCPU 2 vCPU 4 vCPU 6 vCPU

IA Software Solution Intel GVT-g based SW Solution vCPU % Intel GVT vCPU % Lab data. Config: I7 4770, Guest Windows* 7_x64, 4GB mem, 1.5G GraphicMem, MediaSDK

14 Q&A

Intel Confidential