Infiniband Network Architecture

world-class technical training Are your company’s technical training needs being addressed in the most effective manner? MindShare has over 25 years experience in conducting technical training on cutting-edge technologies. We understand the challenges companies have when searching for quality, effective training which reduces the students’ time away from work and provides cost-effective alternatives. MindShare offers many fl exible solutions to meet those needs. Our courses are taught by highly-skilled, enthusiastic, knowledgeable and experienced instructors. We bring life to knowledge through a wide variety of learning methods and delivery options. training that fi ts your needs MindShare recognizes and addresses your company’s technical training issues with: • Scalable cost training • Customizable training options • Reducing time away from work • Just-in-time training • Overview and advanced topic courses • Training delivered effectively globally • Training in a classroom, at your cubicle or home offi ce • Concurrently delivered multiple-site training MindShare training courses expand your technical skillset 2 PCI Express 2.0 ® 2 Serial Attached SCSI (SAS) 2 Intel Core 2 Processor Architecture 2 DDR2/DDR3 DRAM Technology 2 AMD Opteron Processor Architecture 2 PC BIOS Firmware 2 Intel 64 and IA-32 Software Architecture 2 High-Speed Design 2 Intel PC and Chipset Architecture 2 Windows Internals and Drivers 2 PC Virtualization 2 Linux Fundamentals 2 USB 2.0 ... and many more. 2 Wireless USB All courses can be customized to meet your 2 Serial ATA (SATA) group’s needs. Detailed course outlines can be found at www.mindshare.com bringing life to knowledge. real-world tech training put into practice worldwide *PCI Express ® is a registered trademark of the PCISIG MindShare Learning Options MindShare MindShare MindShare MindShare Classroom Virtual Classroom eLearning Press Intro eLearning In-House Training Virtual In-House Training Books Modules Comprehensive Public Training Virtual Public Training eLearning Modules eBooks Classroom Training Virtual Classroom Training eLearning Module Training MindShare Press Invite MindShare to train The majority of our courses MindShare is also an eLearning Purchase our books and you in-house, or sign-up to live over the web in an inter- company. Our growing list of eBooks or publish your attend one of our many public active environment with WebEx interactive eLearning modules own content through us. classes held throughout the and a phone bridge. We deliver include: MindShare has authored year and around the world. training cost-effectively across • Intro to Virtualization over 25 books and the list No more boring classes, the multiple sites and time zones. Technology is growing. Let us help ‘MindShare Experience‘ is Imagine being trained in your • Intro to IO Virtualization make your book project sure to keep you engaged. cubicle or home offi ce and • Intro to PCI Express 2.0 a successful one. avoiding the hassle of travel. Updates Contact us to attend one of • PCI Express 2.0 our public virtual classes. • USB 2.0 • AMD Opteron Processor Architecture • Virtualization Technology ...and more Engage MindShare Have knowledge that you want to bring to life? MindShare will work with you to “Bring Your Knowledge to Life.” Engage us to transform your knowledge and design courses that can be delivered in classroom or virtual classroom settings, create online eLearning modules, or publish a book that you author. We are proud to be the preferred training provider at an extensive list of clients that include: ADAPTEC • AMD • AGILENT TECHNOLOGIES • APPLE • BROADCOM • CADENCE • CRAY • CISCO • DELL • FREESCALE GENERAL DYNAMICS • HP • IBM • KODAK • LSI LOGIC • MOTOROLA • MICROSOFT • NASA • NATIONAL SEMICONDUCTOR NETAPP • NOKIA • NVIDIA • PLX TECHNOLOGY • QLOGIC • SIEMENS • SUN MICROSYSTEMS SYNOPSYS • TI • UNISYS 4285 SLASH PINE DRIVE COLORADO SPRINGS, CO 80908 USA M 1.602.617.1123 O 1.800.633.1440 [email protected] www.mindshare.com InfiniBand Network Architecture First Edition InfiniBand Network Architecture First Edition MINDSHARE, INC. TOM SHANLEY TECHNICAL EDIT BY JOE WINKLES ADDISON-WESLEY DEVELOPER’S PRESS Reading, Massachusetts • Harlow, England • Menlo Park, California New York • Don Mills, Ontario • Sydney Bonn • Tokyo • Amsterdam • Mexico City • Seoul San Juan • Madrid • Singapore • Paris • Taipei • Milan Many of the designations used by manufacturers and sellers to distinguish their prod- ucts are claimed as trademarks. Where those designators appear in this book, and Add- ison-Wesley was aware of the trademark claim, the designations have been printed in initial capital letters or all capital letters. The authors and publishers have taken care in preparation of this book but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein. Library of Congress Cataloging-in-Publication Data ISBN: 0-201-726823zz Copyright ©2002 by MindShare, Inc. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopy- ing, recording, or otherwise, without the prior written permission of the publisher. Printed in the United States of America. Published simultaneously in Canada. Sponsoring Editor: Project Manager: Cover Design: Set in 10 point Palatino by MindShare, Inc. 1 2 3 4 5 6 7 8 9-MA-999897 First Printing, September 2000zz Addison-Wesley books are available for bulk purchases by corporations, institutions, and other organizations. For more information please contact the Corporate, Govern- ment, and Special Sales Department at (800) 238-9682. Find A-W Developers Press on the World Wide Web at: http://www/aw.com/devpress/ At-a-Glance Table of Contents Part 1, Core Concepts, introduces basic concepts and terminology and consists of the following chapters: • Chapter 1—Basic Terms and Concepts on page 9. • Chapter 2—Intro to Attributes and Managers on page 25. • Chapter 3—QP: Message Transfer Mechanism on page 31. • Chapter 4—Intro to Transport Types on page 61. • Chapter 5—Intro to Send/Receive Operations on page 77. • Chapter 6—Division of Labor on page 105. • Chapter 7—Subnet-Local Addressing on page 131. • Chapter 8—Global Addressing on page 141. • Chapter 9—Intro to the Managers on page 159. • Chapter 10—Intro to Connection Establishment on page 183. • Chapter 11—PSN Usage on page 205. Part 2, QP Creation and Operation, begins the portion of the book that provides detailed information about the InfiniBand technology. Part 2 provides a detailed descripion of the creation of, the management of, and the basic operation of the various types of Queue Pairs. Part 2 consists of the following chapters: • Chapter 12—QP Verbs and QP State Machine on page 219. • Chapter 13—WRs, WQEs, and CQEs on page 259. • Chapter 14—Asynchronous Events and Errors on page 291. Part 3, Protection Mechanisms, introduces memory management, memory protection, and the various other protection mechansims available in the Infini- Band environment. Part 3 consists of the following chapters: • Chapter 15—Memory Protection on page 297. • Chapter 16—Other Protection Mechanisms on page 315. Part 4, Detailed Description of the Transport Services, provides a detailed description of the four IBA transport services as well as the Raw IPv6 and Raw EtherType services. In addition, it also provides a detailed description of UD Multicasting, Automatic Path Migration, and Static rate Control. Part 4 consists of the following chapters: • Chapter 17—RC Transport Service on page 351. • Chapter 18—UC Transport Service on page 443. • Chapter 19—RD Transport Service on page 461. • Chapter 20—UD Transport Service on page 523. • Chapter 21—Raw Transport Service Types on page 537. • Chapter 22—Multicasting on page 563. • Chapter 23—Automatic Path Migration on page 575. • Chapter 24—Static Rate Control on page 589. Part 5, Link and Physical Layer Descriptions, provides a detailed description of the Link Layer and the Physical Layer and consists of the following chapters: • Chapter 25—Detailed Description of the Link Layer on page 599. • Chapter 26—Detailed Physical Layer Description on page 681. Part 6, The SM and the SA, provides a detailed description of the SM and the SA, as well as the interfaces to the SM and the SA: the SMI and the GSI. In addition, it discusses the issues related to multiple SMs in a subnet and the discovery (i.e., the configuration) process. Part 6 consists of the following chapters: • Chapter 27—The SMI on page 761. • Chapter 28—Detailed Description of MADs on page 779. • Chapter 29—SM Methods and Attributes on page 809. • Chapter 30—Multiple SMs on page 851. • Chapter 31—Discovery on page 871. • Chapter 32—The GSI on page 909. • Chapter 33—Detailed Description of SA on page 917. Part 7, General Services, provides a detailed description of the General Services and consists of the following chapters: • Chapter 34—Baseboard Management on page 987. • Chapter 35—Performance Management on page 1019. • Chapter 36—Communications Management on page 1069. • Chapter 37—Device Management on page 1117. Glossary on page 1133. Contents Chapter 1: About This Book Who Needs This Book?............................................................................................................. 1 The MindShare Architecture Series ......................................................................................

Load more