Host-Side Drivers User Guide for Linux Release 3.1.0

Total Page:16

File Type:pdf, Size:1020Kb

Host-Side Drivers User Guide for Linux Release 3.1.0 Host-Side Drivers User Guide for Linux Release 3.1.0 Part Number: 10-00125-02-A0 Copyright © 2005 Topspin Communications, Inc. All rights reserved. The Topspin Switched Computing System, Topspin Host Channel Adapter, Topspin Element Manager, and collateral software programs and documentation are subject to and made available only pursuant to the license agreement signed by you and Topspin, Communications, Inc. (or if no signed license agreement exists, the license agreement included with your original media) and may only be used in accordance with the terms of that agreement. Making copies, modifications, or compilation works of the software except as specifically allowed in that agreement is prohibited by law and constitutes a punishable violation of the law. This documentation may not be copied, modified or reduced to any electronic or machine-readable form without Topspin Communication, Inc.'s prior written consent. As defined in FAR section 2.101, DFAR section 252.227-7014(a)(1) and DFAR section 252.227-7014(a)(5) or otherwise, the collateral software programs provided to you are “commercial items,” “commercial computer software” and/or “commercial computer software documentation.” Consistent with DFAR section 227.7202, FAR section 12.212 and other sections, any use, modification, reproduction, release, performance, display, disclosure or distribution thereof by or for the U.S. Government shall be governed solely by the terms of the license agreement and shall be prohibited except to the extent expressly permitted by the terms of that agreement. Any technical data provided that is not covered by the above provisions shall be deemed “technical data-commercial items” pursuant to DFAR section 227.7015(a) or equivalent. Any use, modification, reproduction, release, performance, display or disclosure of such technical data shall be governed by the terms of DFAR section 227.7015(b) or equivalent. This documentation may include technical inaccuracies or typographical errors and is subject to correction and other revision without notice. TOPSPIN PROVIDES THIS DOCUMENTATION “AS IS” AND WITHOUT ANY WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states or jurisdictions do not allow disclaimer of express or implied warranties in certain transactions; therefore, this statement may not apply to you. © Copyright 2005, Topspin Communications, Inc. All rights reserved. Topspin is a registered trademark and the Topspin logo, TopspinOS, and Topspin Switched Computing System are trademarks of Topspin Communications, Inc. Other company, product, or service names are the property of their respective owners. Document Version: 3.0.1 Part Number: 10-00125-02-A0 July 2005 Printed in the United States of America. Document History For the most up-to-date release of the Host-Side Drivers User Guide for Linux, reference the Web-released version at the following site: http://support.topspin.com/support/technicaldocs/ Table I-1: Document History Document Part-Number Type of Release Release Date May 2005 10-00125-01-A0 CD Release July 2005 10-00125-02-A0 CD Release iii Contents Regulatory Notices........................................ vii Intended Audience .................................................................................................................................... vii Typographical Conventions...................................................................................................................... vii Contact Information................................................................................................................................. viii 1: About Host-Side Drivers............................. 1 Introduction..................................................................................................................................................1 Architecture .................................................................................................................................... 2 Supported Protocols.....................................................................................................................................2 IPoIB............................................................................................................................................... 2 SRP ................................................................................................................................................. 2 SDP ................................................................................................................................................. 3 Supported APIs ............................................................................................................................................3 uDAPL ............................................................................................................................................ 3 MPI ................................................................................................................................................. 3 HCA Utilities ...............................................................................................................................................3 2: Installing Host-Side Drivers........................ 5 Install Host-Side Drivers from the CD-ROM..............................................................................................5 Install Host-Side Drivers from an ISO over NFS ........................................................................................6 Upgrade Host-Side Drivers on your Linux Host .........................................................................................7 3: IP over IB Protocol ..................................... 9 iv Introduction..................................................................................................................................................9 Configure IPoIB...........................................................................................................................................9 Sample Startup Script ................................................................................................................... 14 Verify IPoIB ..............................................................................................................................................14 Configure High-Availability Ports.............................................................................................................14 Merge Physical Ports .................................................................................................................... 14 Unmerge Physical Ports................................................................................................................ 16 4: SCSI RDMA Protocol............................... 17 Introduction................................................................................................................................................17 Configure SRP ...........................................................................................................................................17 Configure Initiators....................................................................................................................... 18 Configure ITLs ............................................................................................................................. 18 Verify SRP.................................................................................................................................................21 Verify with the CLI....................................................................................................................... 21 Verify with Element Manager ...................................................................................................... 21 5: Sockets Direct Protocol............................ 23 Configure IPoIB Interfaces........................................................................................................................23 Specify Connection Overrides ...................................................................................................................23 Convert Sockets-Based Applications.........................................................................................................23 Converting Sockets-Based Applications to Use SDP................................................................... 24 Run a Performance Test on SDP ...............................................................................................................25 Sample Configuration - SDP for IBM DB2 v8.1.......................................................................................26 Performance Acceleration............................................................................................................. 26 Overview....................................................................................................................................... 26 Sample Topology.......................................................................................................................... 26 Prerequisites.................................................................................................................................. 27 Configure the Application Server ................................................................................................. 27 Configure
Recommended publications
  • Network/Socket Programming in Java
    Network/Socket Programming in Java Rajkumar Buyya Elements of C-S Computing a client, a server, and network Request Client Server Network Result Client machine Server machine java.net n Used to manage: c URL streams c Client/server sockets c Datagrams Part III - Networking ServerSocket(1234) Output/write stream Input/read stream Socket(“128.250.25.158”, 1234) Server_name: “manjira.cs.mu.oz.au” 4 Server side Socket Operations 1. Open Server Socket: ServerSocket server; DataOutputStream os; DataInputStream is; server = new ServerSocket( PORT ); 2. Wait for Client Request: Socket client = server.accept(); 3. Create I/O streams for communicating to clients is = new DataInputStream( client.getInputStream() ); os = new DataOutputStream( client.getOutputStream() ); 4. Perform communication with client Receiive from client: String line = is.readLine(); Send to client: os.writeBytes("Hello\n"); 5. Close sockets: client.close(); For multithreade server: while(true) { i. wait for client requests (step 2 above) ii. create a thread with “client” socket as parameter (the thread creates streams (as in step (3) and does communication as stated in (4). Remove thread once service is provided. } Client side Socket Operations 1. Get connection to server: client = new Socket( server, port_id ); 2. Create I/O streams for communicating to clients is = new DataInputStream( client.getInputStream() ); os = new DataOutputStream( client.getOutputStream() ); 3. Perform communication with client Receiive from client: String line = is.readLine(); Send to client: os.writeBytes("Hello\n");
    [Show full text]
  • Retrofitting Privacy Controls to Stock Android
    Saarland University Faculty of Mathematics and Computer Science Department of Computer Science Retrofitting Privacy Controls to Stock Android Dissertation zur Erlangung des Grades des Doktors der Ingenieurwissenschaften der Fakultät für Mathematik und Informatik der Universität des Saarlandes von Philipp von Styp-Rekowsky Saarbrücken, Dezember 2019 Tag des Kolloquiums: 18. Januar 2021 Dekan: Prof. Dr. Thomas Schuster Prüfungsausschuss: Vorsitzender: Prof. Dr. Thorsten Herfet Berichterstattende: Prof. Dr. Michael Backes Prof. Dr. Andreas Zeller Akademischer Mitarbeiter: Dr. Michael Schilling Zusammenfassung Android ist nicht nur das beliebteste Betriebssystem für mobile Endgeräte, sondern auch ein ein attraktives Ziel für Angreifer. Um diesen zu begegnen, nutzt Androids Sicher- heitskonzept App-Isolation und Zugangskontrolle zu kritischen Systemressourcen. Nutzer haben dabei aber nur wenige Optionen, App-Berechtigungen gemäß ihrer Bedürfnisse einzuschränken, sondern die Entwickler entscheiden über zu gewährende Berechtigungen. Androids Sicherheitsmodell kann zudem nicht durch Dritte angepasst werden, so dass Nutzer zum Schutz ihrer Privatsphäre auf die Gerätehersteller angewiesen sind. Diese Dissertation präsentiert einen Ansatz, Android mit umfassenden Privatsphäreeinstellun- gen nachzurüsten. Dabei geht es konkret um Techniken, die ohne Modifikationen des Betriebssystems oder Zugriff auf Root-Rechte auf regulären Android-Geräten eingesetzt werden können. Der erste Teil dieser Arbeit etabliert Techniken zur Durchsetzung von Sicherheitsrichtlinien
    [Show full text]
  • How to XDP (With Snabb)
    How to XDP (with Snabb) Max Rottenkolber <[email protected]> Tuesday, 21 January 2020 Table of Contents Intro 1 Creating an XDP socket 2 Mapping the descriptor rings 4 Binding an XDP socket to an interface 7 Forwarding packets from a queue to an XDP socket 8 Creating a BPF map . 9 Assembling a BPF program . 9 Attaching a BPF program to an interface . 12 Packet I/O 14 Deallocating the XDP socket 18 Intro Networking in userspace is becoming mainstream. Recent Linux kernels ship with a feature called eXpress Data Path (XDP) that intends to con- solidate kernel-bypass packet processing applications with the kernel’s networking stack. XDP provides a new kind of network socket that al- lows userspace applications to do almost direct I/O with network device drivers while maintaining integration with the kernel’s native network stack. To Snabb XDP looks like just another network I/O device. In fact the XDP ABI/API is so similar to a typical hardware interfaces that it feels a bit like driving a NIC, and not by accident. I think it is fair to describe XDP as a generic interface to Linux network drivers that also 1 has a virtual backend it integrates with: the Linux network stack. In that sense, XDP can be seen as a more hardware centric sibling of AF_PACKET. I can think of two reasons why XDP might be interesting for Snabb users: • While the Snabb community prefers NICs with open hardware interface specifications there are a lot of networking devices out there that lack open specifications.
    [Show full text]
  • Improving Networking
    IMPERIAL COLLEGE LONDON FINALYEARPROJECT JUNE 14, 2010 Improving Networking by moving the network stack to userspace Author: Matthew WHITWORTH Supervisor: Dr. Naranker DULAY 2 Abstract In our modern, networked world the software, protocols and algorithms involved in communication are among some of the most critical parts of an operating system. The core communication software in most modern systems is the network stack, but its basic monolithic design and functioning has remained unchanged for decades. Here we present an adaptable user-space network stack, as an addition to my operating system Whitix. The ideas and concepts presented in this report, however, are applicable to any mainstream operating system. We show how re-imagining the whole architecture of networking in a modern operating system offers numerous benefits for stack-application interactivity, protocol extensibility, and improvements in network throughput and latency. 3 4 Acknowledgements I would like to thank Naranker Dulay for supervising me during the course of this project. His time spent offering constructive feedback about the progress of the project is very much appreciated. I would also like to thank my family and friends for their support, and also anybody who has contributed to Whitix in the past or offered encouragement with the project. 5 6 Contents 1 Introduction 11 1.1 Motivation.................................... 11 1.1.1 Adaptability and interactivity.................... 11 1.1.2 Multiprocessor systems and locking................ 12 1.1.3 Cache performance.......................... 14 1.2 Whitix....................................... 14 1.3 Outline...................................... 15 2 Hardware and the LDL 17 2.1 Architectural overview............................. 17 2.2 Network drivers................................. 18 2.2.1 Driver and device setup.......................
    [Show full text]
  • Post Sockets - a Modern Systems Network API Mihail Yanev (2065983) April 23, 2018
    Post Sockets - A Modern Systems Network API Mihail Yanev (2065983) April 23, 2018 ABSTRACT In addition to providing native solutions for problems, es- The Berkeley Sockets API has been the de-facto standard tablishing optimal connection with a Remote point or struc- systems API for networking. However, designed more than tured data communication, we have identified that a com- three decades ago, it is not a good match for the networking mon issue with many of the previously provided networking applications today. We have identified three different sets of solutions has been leaving the products vulnerable to code problems in the Sockets API. In this paper, we present an injections and/or buffer overflow attacks. The root cause implementation of Post Sockets - a modern API, proposed by for such problems has mostly proved to be poor memory Trammell et al. that solves the identified limitations. This or resource management. For this reason, we have decided paper can be used for basis of evaluation of the maturity of to use the Rust programming language to implement the Post Sockets and if successful to promote its introduction as new API. Rust is a programming language, that provides a replacement API to Berkeley Sockets. data integrity and memory safety guarantees. It uses region based memory, freeing the programmer from the responsibil- ity of manually managing the heap resources. This in turn 1. INTRODUCTION eliminates the possibility of leaving the code vulnerable to Over the years, writing networked applications has be- resource management errors, as this is handled by the lan- come increasingly difficult.
    [Show full text]
  • Lesson-3 Case Study of Coding for Sending Application Layer Byte Streams on a TCP/IP Network Router Using RTOS Vxworks
    Design Examples and Case Studies of Program Modeling and Programming with RTOS: Lesson-3 Case Study Of Coding For Sending Application Layer Byte Streams on a TCP/IP Network Router Using RTOS VxWorks Chapter-13 L03: "Embedded Systems - Architecture, Programming and Design" , 2015 1 Raj Kamal, Publs.: McGraw-Hill Education 1. Specifications Chapter-13 L03: "Embedded Systems - Architecture, Programming and Design" , 2015 2 Raj Kamal, Publs.: McGraw-Hill Education TCP/IP Stack In TCP/IP suite of protocols, application layer transfers the data with appropriate header words to transport layer. At transport layer, either UDP or TCP protocol is used and additional header words placed. Chapter-13 L03: "Embedded Systems - Architecture, Programming and Design" , 2015 3 Raj Kamal, Publs.: McGraw-Hill Education TCP/IP Stack transmitting subsystem Chapter-13 L03: "Embedded Systems - Architecture, Programming and Design" , 2015 4 Raj Kamal, Publs.: McGraw-Hill Education TCP/IP Stack UDP is connection-less protocol for datagram transfer of total size including headers of less than 216 Byte. TCP is connection oriented protocol, in which data of unlimited size can be transferred in multiple sequences to the internet layer At internet layer, the IP protocol is used and IP packets are formed, each packet with an IP header transfers to the network through network driver subsystem. Chapter-13 L03: "Embedded Systems - Architecture, Programming and Design" , 2015 5 Raj Kamal, Publs.: McGraw-Hill Education TCP/IP stack A TCP/IP stack network driver is available in the RTOSes It has a library, sockLib for socket programming. The reader may refer to VxWorks Programmer’s Guide when using these APIs and sockLib.
    [Show full text]
  • Learning Python Network Programming
    Learning Python Network Programming Utilize Python 3 to get network applications up and running quickly and easily Dr. M. O. Faruque Sarker Sam Washington BIRMINGHAM - MUMBAI Learning Python Network Programming Copyright © 2015 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the authors, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book. Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information. First published: June 2015 Production reference: 1100615 Published by Packt Publishing Ltd. Livery Place 35 Livery Street Birmingham B3 2PB, UK. ISBN 978-1-78439-600-8 www.packtpub.com Credits Authors Project Coordinator Dr. M. O. Faruque Sarker Izzat Contractor Sam Washington Proofreaders Reviewers Stephen Copestake Konstantin Manchev Manchev Safis Editing Vishrut Mehta Anhad Jai Singh Indexer Hemangini Bari Ben Tasker Ilja Zegars Graphics Abhinash Sahu Commissioning Editor Kunal Parikh Production Coordinator Shantanu Zagade Acquisition Editor Kevin Colaco Cover Work Shantanu Zagade Content Development Editor Rohit Singh Technical Editor Saurabh Malhotra Copy Editors Ameesha Green Rashmi Sawant Trishla Singh About the Authors Dr.
    [Show full text]
  • Towards Access Control for Isolated Applications
    Towards Access Control for Isolated Applications Kirill Belyaev and Indrakshi Ray Computer Science Department, Colorado State University, Fort Collins, U.S.A Keywords: Access Control, Service and Systems Design, Inter-application Communication. Abstract: With the advancements in contemporary multi-core CPU architectures, it is now possible for a server operating system (OS), such as Linux, to handle a large number of concurrent application services on a single server instance. Individual application components of such services may run in different isolated runtime environ- ments, such as chrooted jails or application containers, and may need access to system resources and the ability to collaborate and coordinate with each other in a regulated and secure manner. We propose an access control framework for policy formulation, management, and enforcement that allows access to OS resources and also permits controlled collaboration and coordination for service components running in disjoint containerized environments under a single Linux OS server instance. The framework consists of two models and the policy formulation is based on the concept of policy classes for ease of administration and enforcement. The policy classes are managed and enforced through a Linux Policy Machine (LPM) that acts as the centralized reference monitor and provides a uniform interface for accessing system resources and requesting application data and control objects. We present the details of our framework and also discuss the preliminary implementation to demonstrate the feasibility of our approach. 1 INTRODUCTION plications for controlling access to OS resources, for regulating the access requests to the application data The advancements in contemporary multi-core CPU and control objects used for inter-application commu- architectures have greatly improved the ability of nication between service components.
    [Show full text]
  • COS 318: Operating Systems Message Passing
    Motivation u Locks, semaphores, monitors are good but they only COS 318: Operating Systems work under the shared-address-space model l Threads in the same process l Processes that share an address space Message Passing u We have assumed that processes/threads communicate via shared data (counter, producer-consumer buffer, …) u How to synchronize and communicate among processes with different address spaces? (http://www.cs.princeton.edu/courses/cos318/) l Inter-process communication (IPC) u Can we have a single set of primitives that work for all cases: single machine OS, multiple machines same OS, multiple machines multiple OS, distributed? With No Shared Address Space Sending A Message u No need for explicit mutual exclusion primitives l Processes cannot touch the same data directly Within A Computer Across A Network u Communicate by sending and receiving explicit messages: Message Passing P1 P2 Send() Recv() u Synchronization is implicit in message passing Send() Recv() l No need for explicit mutual exclusion Network l Event ordering via sending and receiving of messages OS Kernel OS OS u More portable to different environments, though lacks COS461 some of the convenience of a shared address space u Typically, communication in consummated via a send P1 can send to P2, P2 can send to P1 and a matching receive 4 1 Simple Send and Receive Simple API send( dest, data ), receive( src, data ) send( dest, data ), receive( src, data ) S S R u Destination or source l Direct address: send(dest, data) node Id, process Id recv(src, data) l Indirect address: send(dest, data) mailbox, socket, R channel, … u Data l Buffer (addr) and size recv(src, data) u Send “data” specifies where the data are in sender’s address space l Anything else that u Recv “data” specifies where the incoming message data should be specifies the source put in receiver’s address space data or destination data structure 5 6 Simple Semantics Issues/options u Send call does not return until data have been copied u Asynchronous vs.
    [Show full text]
  • ARTICLE VII: UNBUNDLED NETWORK ELEMENTS Centurytel/Socket Page 18 Of45 FINAL CONFORMING
    ARTICLE VII : UNBUNDLED NETWORK ELEMENTS CenturyTel/Socket Page 14 of 45 FINAL CONFORMING Section 2.20.7 through Section 2.20 .7 .4. For purposes of calculating and applying an "annual basis," it means a consecutive 12-month period, beginning upon CenturyTel's written notice that an audit will be performed for the State. 2 .20 .7.1 [Intentionally omitted] 2 .20 .7.2 Unless otherwise agreed by the Parties (including at the time of the audit), the independent auditor shall perform its evaluation in accordance with the standards established by the American Institute for Certified Public Accountants (AICPA), which will require the auditor to perform an "examination engagement" and issue an opinion that includes the auditor's determination regarding Socket's compliance with the qualifying service Eligibility Requirements criteria. The independent auditor's report will conclude whether Socket complied in all material respects with this Section 2.20. 2 .20 .7.3 Consistent with standard auditing practices, such audits require compliance testing designed by the independent auditor, which typically include an examination of a sample selected in accordance with the independent auditor's judgment. 2.20 .7.4 Should the independent auditor's report conclude that Socket failed to comply in all material respects with Section 2.20, Socket must true-up any difference in payments paid to CenturyTel and the rates and charges Socket would have owed CenturyTel beginning from the date that the non-compliant circuit was established as a UNE/UNE combination, in whole or in part (notwithstanding any other provision hereof), but no earlier than the date on which this Section 2.20 of this Article is effective .
    [Show full text]
  • Network Programming Management
    IT2351 NETWORK PROGRAMMING AND MANAGEMENT A Course Material on Network Programming Management By Mrs.D.KalaiAbirami ASSISTANT PROFESSOR DEPARTMENT OF INFORMATION TECHNOLOGY SASURIE COLLEGE OF ENGINEERING VIJAYAMANGALAM – 638 056 SCE Department Of Information Technology & Computer Applications IT2351 NETWORK PROGRAMMING AND MANAGEMENT QUALITY CERTIFICATE This is to certify that the e-course material Subject Code : IT2351 Subject : Network Programming and Management Class : III B.tech(INFORMATION TECHNOLOGY) being prepared by me and it meets the knowledge requirement of the university curriculum. Signature of the Author Name: D.Kalai Abirami Designation: AP This is to certify that the course material being prepared by Mrs.D.Kalai Abirami is of adequate quality. She has referred more than five books among them minimum one is from abroad author. Signature of HD Name: S.ASHOK KUMAR SEAL SCE Department Of Information Technology & Computer Applications IT2351 NETWORK PROGRAMMING AND MANAGEMENT IT2351 – NETWORK PROGRAMMING AND MANAGEMENT UNIT I ELEMENTARY TCP SOCKETS Introduction to socket programming – Overview of TCP / IP protocols – Introduction to sockets – Socket address structures – Byte ordering functions – Address conversion functions – Elementary TCP sockets – Socket – Connect – Bind – Listen – Accept – Read – Write – Close functions – Iterative server – Concurrent server. UNIT II APPLICATION DEVELOPMENT TCP echo server – TCP echo client – POSIX signal handling – Server with multiple clients – Boundary conditions– Server process crashes–
    [Show full text]
  • Comparing Tcp-Ipv4/ Tcp-Ipv6 Network Performance
    COMPARING TCP-IPV4/ TCP-IPV6 NETWORK PERFORMANCE A Thesis Presented to the Faculty of the Graduate School University of Missouri-Columbia ___________________________________ In Partial Fulfillment of the Requirements for the Degree Master of Science by HARSHIL SHAH Dr. Gordon K. Springer, Thesis Advisor DECEMBER 2013 The undersigned, appointed by the Dean of the Graduate School, have examined the thesis entitled COMPARING TCP-IPV4/ TCP-IPV6 NETWORK PERFORMANCE Presented by Harshil Shah A candidate for the degree of Master of Science And hereby certify that in their opinion it is worthy of acceptance. __________________________________________________ Dr. Gordon K Springer __________________________________________________ Dr. Dmitry Korkin __________________________________________________ Dr. Justin Legarsky ACKNOWLEDGEMENTS I would like to acknowledge and thank, with gratitude, the following people who helped me throughout my studies and completion of my project. First and foremost, my debt of thanks to my advisor, Gordon K Springer. I would like to thank him for his expert guidance, tutelage and confidence. I would also like to thank him for his patience entrusted upon me to complete the project, while living hundreds of miles away, employed in full-time job. The project would not have been successful without his motivation. Secondly I would like to thank to my committee members for taking time from their busy schedules and contribute valuable insights. Lastly I would like to thank to my friends and my family for their support and collaboration in completion of this project. My honors and achievements are dedicated to all of these people. ii TABLE OF CONTENTS ACKNOWLEDGMENTS.............................................................................................. ii LIST OF FIGURES ...................................................................................................... vi LIST OF TABLES .....................................................................................................
    [Show full text]