Mellanox Winof VPI User Manual Rev 5.10
Total Page:16
File Type:pdf, Size:1020Kb
Mellanox WinOF VPI User Manual Rev 5.10 www.mellanox.com Rev 5.10 NOTE: THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT, INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND (INCLUDING, BUT NOT LIMITED TO, PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. Mellanox Technologies 350 Oakmead Parkway Suite 100 Sunnyvale, CA 94085 U.S.A. www.mellanox.com Tel: (408) 970-3400 Fax: (408) 970-3403 © Copyright 2015. Mellanox Technologies. All Rights Reserved. Mellanox®, Mellanox logo, BridgeX®, CloudX logo, Connect-IB®, ConnectX®, CoolBox®, CORE-Direct®, GPUDirect®, InfiniHost®, InfiniScale®, Kotura®, Kotura logo, Mellanox Federal Systems®, Mellanox Open Ethernet®, Mellanox ScalableHPC®, Mellanox Connect Accelerate Outperform logo, Mellanox Virtual Modular Switch®, MetroDX®, MetroX®, MLNX-OS®, Open Ethernet logo, PhyX®, SwitchX®, TestX®, The Generation of Open Ethernet logo, UFM®, Virtual Protocol Interconnect®, Voltaire® and Voltaire logo are registered trademarks of Mellanox Technologies, Ltd. Accelio™, CyPU™, FPGADirect™, HPC-X™, InfiniBridge™, LinkX™, Mellanox Care™, Mellanox CloudX™, Mellanox Multi-Host™, Mellanox NEO™, Mellanox PeerDirect™, Mellanox Socket Direct™, Mellanox Spectrum™, NVMeDirect™, StPU™, Spectrum logo, Switch-IB™, Unbreakable-Link™ are trademarks of Mellanox Technologies, Ltd. All other trademarks are property of their respective owners. 2 Mellanox Technologies Document Number: MLNX-15-3280 Rev 5.10 Table of Contents Document Revision History . 2 About this Manual . 8 Scope . .8 Intended Audience . .8 Documentation Conventions . .8 Common Abbreviations and Acronyms . .9 Related Documents . .10 Chapter 1 Introduction . 11 1.1 Supplied Packages . 12 1.2 WinOF Set of Documentation . 12 1.3 Windows MPI (MS-MPI) . 12 Chapter 2 Installation . 13 2.1 Hardware and Software Requirements . 13 2.2 Downloading Mellanox WinOF Driver. 13 2.3 Installing Mellanox WinOF Driver . 14 2.3.1 Attended Installation . 14 2.3.2 Unattended Installation . 19 2.4 Installation Results. 20 2.5 Extracting Files Without Running Installation . 21 2.6 Uninstalling Mellanox WinOF Driver. 23 2.6.1 Attended Uninstallation . 23 2.6.2 Unattended Uninstallation. 23 2.7 Firmware Upgrade . 24 2.8 Upgrading Mellanox WinOF Driver . 24 2.9 Booting Windows from an iSCSI Target. 24 2.9.1 Configuring the WDS, DHCP and iSCSI Servers . 24 2.9.2 Configuring the Client Machine . 25 2.9.3 Installing iSCSI . 26 Chapter 3 Features Overview and Configuration . 28 3.1 Ethernet Network. 28 3.1.1 Port Configuration. 28 3.1.2 Assigning Port IP After Installation . 30 3.1.3 56GbE Link Speed . 32 3.1.4 RDMA over Converged Ethernet (RoCE) . 33 3.1.5 Teaming and VLAN . 39 3.1.6 Header Data Split . 45 3.1.7 Ports TX Arbitration . 45 3.1.8 Configuring Quality of Service (QoS) . 46 3.1.9 Configuring the Ethernet Driver . 50 3.1.10 Differentiated Services Code Point (DSCP) . 51 Mellanox Technologies 3 Rev 5.10 3.1.11 Lossless TCP. 54 3.1.12 Receive Side Scaling (RSS) . 58 3.1.13 Ignore Frame Check Sequence (FCS) Errors . 59 3.2 InfiniBand Network . 59 3.2.1 Port Configuration. 59 3.2.2 OpenSM - Subnet Manager. 59 3.2.3 Modifying IPoIB Configuration . 60 3.2.4 Displaying Adapter Related Information . 60 3.2.5 Assigning Port IP After Installation . 61 3.2.6 Receive Side Scaling (RSS) . 61 3.2.7 Multiple Interfaces over non-default PKeys Support . 61 3.2.8 Teaming. 64 3.3 Management . 67 3.3.1 PowerShell Configuration. 67 3.4 Storage Protocols . 68 3.4.1 Deploying Windows Server 2012 and Above with SMB Direct . 68 3.5 Virtualization . 70 3.5.1 Virtual Ethernet Adapter. 70 3.5.2 Hyper-V with VMQ . 71 3.5.3 Network Virtualization using Generic Routing Encapsulation (NVGRE) . 71 3.5.4 Single Root I/O Virtualization (SR-IOV) . 75 3.6 Configuration Using Registry Keys. 92 3.6.1 Finding the Index Value of the HCA . 93 3.6.2 Finding the Index Value of the Network Interface . 93 3.6.3 Basic Registry Keys . 94 3.6.4 Off-load Registry Keys . 97 3.6.5 Performance Registry Keys. 99 3.6.6 Ethernet Registry Keys . 104 3.6.7 IPolB Registry Keys . 109 3.6.8 General Registry Values . 111 3.6.9 MLX BUS Registry Keys . ..