Host-Side Drivers User Guide for Linux Release 3.1.0
Total Page:16
File Type:pdf, Size:1020Kb
Host-Side Drivers User Guide for Linux Release 3.1.0 Part Number: 10-00125-02-A0 Copyright © 2005 Topspin Communications, Inc. All rights reserved. The Topspin Switched Computing System, Topspin Host Channel Adapter, Topspin Element Manager, and collateral software programs and documentation are subject to and made available only pursuant to the license agreement signed by you and Topspin, Communications, Inc. (or if no signed license agreement exists, the license agreement included with your original media) and may only be used in accordance with the terms of that agreement. Making copies, modifications, or compilation works of the software except as specifically allowed in that agreement is prohibited by law and constitutes a punishable violation of the law. This documentation may not be copied, modified or reduced to any electronic or machine-readable form without Topspin Communication, Inc.'s prior written consent. As defined in FAR section 2.101, DFAR section 252.227-7014(a)(1) and DFAR section 252.227-7014(a)(5) or otherwise, the collateral software programs provided to you are “commercial items,” “commercial computer software” and/or “commercial computer software documentation.” Consistent with DFAR section 227.7202, FAR section 12.212 and other sections, any use, modification, reproduction, release, performance, display, disclosure or distribution thereof by or for the U.S. Government shall be governed solely by the terms of the license agreement and shall be prohibited except to the extent expressly permitted by the terms of that agreement. Any technical data provided that is not covered by the above provisions shall be deemed “technical data-commercial items” pursuant to DFAR section 227.7015(a) or equivalent. Any use, modification, reproduction, release, performance, display or disclosure of such technical data shall be governed by the terms of DFAR section 227.7015(b) or equivalent. This documentation may include technical inaccuracies or typographical errors and is subject to correction and other revision without notice. TOPSPIN PROVIDES THIS DOCUMENTATION “AS IS” AND WITHOUT ANY WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states or jurisdictions do not allow disclaimer of express or implied warranties in certain transactions; therefore, this statement may not apply to you. © Copyright 2005, Topspin Communications, Inc. All rights reserved. Topspin is a registered trademark and the Topspin logo, TopspinOS, and Topspin Switched Computing System are trademarks of Topspin Communications, Inc. Other company, product, or service names are the property of their respective owners. Document Version: 3.0.1 Part Number: 10-00125-02-A0 July 2005 Printed in the United States of America. Document History For the most up-to-date release of the Host-Side Drivers User Guide for Linux, reference the Web-released version at the following site: http://support.topspin.com/support/technicaldocs/ Table I-1: Document History Document Part-Number Type of Release Release Date May 2005 10-00125-01-A0 CD Release July 2005 10-00125-02-A0 CD Release iii Contents Regulatory Notices........................................ vii Intended Audience .................................................................................................................................... vii Typographical Conventions...................................................................................................................... vii Contact Information................................................................................................................................. viii 1: About Host-Side Drivers............................. 1 Introduction..................................................................................................................................................1 Architecture .................................................................................................................................... 2 Supported Protocols.....................................................................................................................................2 IPoIB............................................................................................................................................... 2 SRP ................................................................................................................................................. 2 SDP ................................................................................................................................................. 3 Supported APIs ............................................................................................................................................3 uDAPL ............................................................................................................................................ 3 MPI ................................................................................................................................................. 3 HCA Utilities ...............................................................................................................................................3 2: Installing Host-Side Drivers........................ 5 Install Host-Side Drivers from the CD-ROM..............................................................................................5 Install Host-Side Drivers from an ISO over NFS ........................................................................................6 Upgrade Host-Side Drivers on your Linux Host .........................................................................................7 3: IP over IB Protocol ..................................... 9 iv Introduction..................................................................................................................................................9 Configure IPoIB...........................................................................................................................................9 Sample Startup Script ................................................................................................................... 14 Verify IPoIB ..............................................................................................................................................14 Configure High-Availability Ports.............................................................................................................14 Merge Physical Ports .................................................................................................................... 14 Unmerge Physical Ports................................................................................................................ 16 4: SCSI RDMA Protocol............................... 17 Introduction................................................................................................................................................17 Configure SRP ...........................................................................................................................................17 Configure Initiators....................................................................................................................... 18 Configure ITLs ............................................................................................................................. 18 Verify SRP.................................................................................................................................................21 Verify with the CLI....................................................................................................................... 21 Verify with Element Manager ...................................................................................................... 21 5: Sockets Direct Protocol............................ 23 Configure IPoIB Interfaces........................................................................................................................23 Specify Connection Overrides ...................................................................................................................23 Convert Sockets-Based Applications.........................................................................................................23 Converting Sockets-Based Applications to Use SDP................................................................... 24 Run a Performance Test on SDP ...............................................................................................................25 Sample Configuration - SDP for IBM DB2 v8.1.......................................................................................26 Performance Acceleration............................................................................................................. 26 Overview....................................................................................................................................... 26 Sample Topology.......................................................................................................................... 26 Prerequisites.................................................................................................................................. 27 Configure the Application Server ................................................................................................. 27 Configure