PCI Express® Base Specification Revision 2.0

Total Page:16

File Type:pdf, Size:1020Kb

PCI Express® Base Specification Revision 2.0 PCI Express® Base Specification Revision 2.0 December 20, 2006 Revision Revision History DATE 1.0 Initial release. 07/22/02 1.0a Incorporated Errata C1-C66 and E1-E4.17. 04/15/03 1.1 Incorporated approved Errata and ECNs. 03/28/05 2.0 Added 5.0 GT/s data rate and incorporated approved Errata 12/20/06 and ECNs. PCI-SIG® disclaims all warranties and liability for the use of this document and the information contained herein and assumes no responsibility for any errors that may appear in this document, nor does PCI-SIG make a commitment to update the information contained herein. Contact the PCI-SIG office to obtain the latest revision of this specification. Questions regarding the PCI Express Base Specification or membership in PCI-SIG may be forwarded to: Membership Services www.pcisig.com E-mail: [email protected] Phone: 503-619-0569 Fax: 503-644-6708 Technical Support [email protected] DISCLAIMER This PCI Express Base Specification is provided “as is” with no warranties whatsoever, including any warranty of merchantability, noninfringement, fitness for any particular purpose, or any warranty otherwise arising out of any proposal, specification, or sample. PCI-SIG disclaims all liability for infringement of proprietary rights, relating to use of information in this specification. No license, express or implied, by estoppel or otherwise, to any intellectual property rights is granted herein. PCI, PCI Express, PCIe, and PCI-SIG are trademarks or registered trademarks of PCI-SIG. All other product names are trademarks, registered trademarks, or servicemarks of their respective owners. Copyright © 2002-2006 PCI-SIG 2 PCI EXPRESS BASE SPECIFICATION, REV. 2.0 Contents OBJECTIVE OF THE SPECIFICATION.................................................................................... 21 DOCUMENT ORGANIZATION ................................................................................................ 21 DOCUMENTATION CONVENTIONS...................................................................................... 22 TERMS AND ACRONYMS........................................................................................................ 23 REFERENCE DOCUMENTS...................................................................................................... 29 1. INTRODUCTION ................................................................................................................ 31 1.1. A THIRD GENERATION I/O INTERCONNECT ................................................................... 31 1.2. PCI EXPRESS LINK......................................................................................................... 33 1.3. PCI EXPRESS FABRIC TOPOLOGY .................................................................................. 35 1.3.1. Root Complex........................................................................................................ 35 1.3.2. Endpoints .............................................................................................................. 36 1.3.3. Switch.................................................................................................................... 39 1.3.4. Root Complex Event Collector.............................................................................. 40 1.3.5. PCI Express to PCI/PCI-X Bridge........................................................................ 40 1.4. PCI EXPRESS FABRIC TOPOLOGY CONFIGURATION ....................................................... 40 1.5. PCI EXPRESS LAYERING OVERVIEW.............................................................................. 41 1.5.1. Transaction Layer................................................................................................. 42 1.5.2. Data Link Layer .................................................................................................... 42 1.5.3. Physical Layer ...................................................................................................... 43 1.5.4. Layer Functions and Services............................................................................... 43 2. TRANSACTION LAYER SPECIFICATION ..................................................................... 47 2.1. TRANSACTION LAYER OVERVIEW.................................................................................. 47 2.1.1. Address Spaces, Transaction Types, and Usage................................................... 48 2.1.2. Packet Format Overview ...................................................................................... 50 2.2. TRANSACTION LAYER PROTOCOL - PACKET DEFINITION............................................... 51 2.2.1. Common Packet Header Fields ............................................................................ 51 2.2.2. TLPs with Data Payloads - Rules ......................................................................... 54 2.2.3. TLP Digest Rules .................................................................................................. 56 2.2.4. Routing and Addressing Rules.............................................................................. 56 2.2.5. First/Last DW Byte Enables Rules........................................................................ 59 2.2.6. Transaction Descriptor......................................................................................... 61 2.2.7. Memory, I/O, and Configuration Request Rules................................................... 66 2.2.8. Message Request Rules......................................................................................... 69 2.2.9. Completion Rules.................................................................................................. 80 2.3. HANDLING OF RECEIVED TLPS...................................................................................... 82 2.3.1. Request Handling Rules........................................................................................ 85 3 PCI EXPRESS BASE SPECIFICATION, REV. 2.0 2.3.2. Completion Handling Rules.................................................................................. 98 2.4. TRANSACTION ORDERING............................................................................................ 100 2.4.1. Transaction Ordering Rules ............................................................................... 100 2.4.2. Update Ordering and Granularity Observed by a Read Transaction ................ 104 2.4.3. Update Ordering and Granularity Provided by a Write Transaction ................ 105 2.5. VIRTUAL CHANNEL (VC) MECHANISM........................................................................ 105 2.5.1. Virtual Channel Identification (VC ID) .............................................................. 108 2.5.2. TC to VC Mapping.............................................................................................. 109 2.5.3. VC and TC Rules................................................................................................. 110 2.6. ORDERING AND RECEIVE BUFFER FLOW CONTROL ..................................................... 111 2.6.1. Flow Control Rules............................................................................................. 112 2.7. DATA INTEGRITY ......................................................................................................... 122 2.7.1. ECRC Rules ........................................................................................................ 123 2.7.2. Error Forwarding ............................................................................................... 127 2.8. COMPLETION TIMEOUT MECHANISM ........................................................................... 129 2.9. LINK STATUS DEPENDENCIES ...................................................................................... 130 2.9.1. Transaction Layer Behavior in DL_Down Status............................................... 130 2.9.2. Transaction Layer Behavior in DL_Up Status ................................................... 131 3. DATA LINK LAYER SPECIFICATION.......................................................................... 133 3.1. DATA LINK LAYER OVERVIEW .................................................................................... 133 3.2. DATA LINK CONTROL AND MANAGEMENT STATE MACHINE ...................................... 135 3.2.1. Data Link Control and Management State Machine Rules ................................ 136 3.3. FLOW CONTROL INITIALIZATION PROTOCOL ............................................................... 138 3.3.1. Flow Control Initialization State Machine Rules ............................................... 138 3.4. DATA LINK LAYER PACKETS (DLLPS)........................................................................ 142 3.4.1. Data Link Layer Packet Rules ............................................................................ 142 3.5. DATA INTEGRITY ......................................................................................................... 147 3.5.1. Introduction......................................................................................................... 147 3.5.2. LCRC, Sequence Number, and Retry Management (TLP Transmitter).............. 147 3.5.3. LCRC and Sequence Number (TLP Receiver).................................................... 159 4. PHYSICAL LAYER SPECIFICATION ............................................................................ 167 4.1. INTRODUCTION ...........................................................................................................
Recommended publications
  • PPC7A10 at Our Website: Click HERE Powerx Product Manual PPC7A
    Full-service, independent repair center -~ ARTISAN® with experienced engineers and technicians on staff. TECHNOLOGY GROUP ~I We buy your excess, underutilized, and idle equipment along with credit for buybacks and trade-ins. Custom engineering Your definitive source so your equipment works exactly as you specify. for quality pre-owned • Critical and expedited services • Leasing / Rentals/ Demos equipment. • In stock/ Ready-to-ship • !TAR-certified secure asset solutions Expert team I Trust guarantee I 100% satisfaction Artisan Technology Group (217) 352-9330 | [email protected] | artisantg.com All trademarks, brand names, and brands appearing herein are the property o f their respective owners. Find the Abaco Systems / Radstone PPC7A10 at our website: Click HERE PowerX Product Manual PPC7A Appendix C - PPC7A This appendix contains hardware information for PPC7A boards. The information contained in this document must be used in conjunction with PowerX Quick Start, PowerX User Guides and/or the PowerX product Manual. Link Settings...................................................................................................................................... C-3 Default Link Settings............................................................................................................................... C-3 RTC Standby Supply Voltage Link (E1)................................................................................................. C-4 FLASH Write Enable Links (E3 and E9)...............................................................................................
    [Show full text]
  • A Not So Short Introduction to Pcie
    Practical introduction to PCI Express with FPGAs Michal HUSEJKO, John EVANS [email protected] IT-PES-ES v 1.0 Agenda • What is PCIe ? o System Level View o PCIe data transfer protocol • PCIe system architecture • PCIe with FPGAs o Hard IP with Altera/Xilinx FPGAs o Soft IP (PLDA) o External PCIe PHY (Gennum) v 1.0 System Level View • Interconnection • Top-down tree hierarchy • PCI/PCIe configuration space • Protocol v 1.0 Interconnection • Serial interconnection • Dual uni-directional • Lane, Link, Port • Scalable o Gen1 2.5/ Gen2 5.0/ Gen3 8.0 GT/s o Number of lanes in FPGAs: x1, x2, x4, x8 • Gen1/2 8b10b • Gen3 128b/130b v 1.0 Image taken from “Introduction to PCI Express” Tree hierarchy • Top-down tree hierarchy with single host • 3 types of devices: Root Complex, Endpoint, Switch • Point-to-point connection between devices without sideband signalling • 2 types of ports: downstream/upstream • Configuration space Image taken from “Introduction to PCI Express” v 1.0 PCIe Configuration space • Similar to PCI conf space – binary compatible for first 256 bytes • Defines device(system) capabilities • Clearly identifies device in the system o Device ID o Vendor ID o Function ID o All above • and defines memory space allocated to device. v 1.0 PCIe transfer protocol • Transaction categories • Protocol • Implementation of the protocol v 1.0 Transaction categories • Configuration – move downstream • Memory – address based routing • IO – address based routing • Message – ID based routing v 1.0 Transaction Types v 1.0 Table taken from “PCI
    [Show full text]
  • Hypertransport?
    HT.book Page 99 Monday, January 13, 2003 12:12 PM 5 Flow Control The Previous Chapter The previous chapter described the use of HyperTransport control and data packets to construct HyperTransport link transactions. Control packet types include Information, Request, and Response variants; data packets contain a payload of 0-64 valid bytes. The transmission, structure, and use of each packet type is presented. This Chapter This chapter describes HyperTransport flow control, used to throttle the move- ment of packets across each link interface. On a high-performance connection such as HyperTransport, efficient management of transaction flow is nearly as important as the raw bandwidth made possible by clock speed and data bus width. Topics covered here include background information on bus flow control and the initialization and use of the HyperTransport virtual channel flow con- trol buffer mechanism defined for each transmitter-receiver pair. The Next Chapter The next chapter describes the rules governing acceptance, forwarding, and rejection of packets seen by HyperTransport devices. Several factors come into play in routing, including the packet type, the direction it is moving, and the device type which sees it. A related topic also covered in this chapter is the fair- ness algorithm used by a tunnel device as it inserts its own packets into the traf- fic it forwards upstream on behalf of devices below it. The HyperTransport specification provides a fairness algorithm and a hardware method for tunnel management packet insertion. The Problem On any bus where an agent initiates the exchange of information (commands, data, status, etc.) with a target, a number of things can cause a delay (or even end) the normal completion of the intended transfer.
    [Show full text]
  • Comparison of High Performance Northbridge Architectures in Multiprocessor Servers
    Comparison of High Performance Northbridge Architectures in Multiprocessor Servers Michael Koontz MS CpE Scholarly Paper Advisor: Dr. Jens-Peter Kaps Co-Advisor: Dr. Daniel Tabak - 1 - Table of Contents 1. Introduction ...............................................................................................................3 2. The x86-64 Instruction Set Architecture (ISA) ...................................................... 3 3. Memory Coherency ...................................................................................................4 4. The MOESI and MESI Cache Coherency Models.................................................8 5. Scalable Coherent Interface (SCI) and HyperTransport ....................................14 6. Fully-Buffered DIMMS ..........................................................................................16 7. The AMD Opteron Northbridge ............................................................................19 8. The Intel Blackford Northbridge Architecture .................................................... 27 9. Performance and Power Consumption .................................................................32 10. Additional Considerations ..................................................................................34 11. Conclusion ............................................................................................................ 36 - 2 - 1. Introduction With the continuing growth of today’s multi-media, Internet based culture, businesses are becoming more dependent
    [Show full text]
  • TMS320C6452 DSP Host Port Interface (HPI)
    TMS320C6452 DSP Host Port Interface (HPI) User's Guide Literature Number: SPRUF87A October 2007–Revised May 2008 2 SPRUF87A–October 2007–Revised May 2008 Submit Documentation Feedback Contents Preface ........................................................................................................................................ 6 1 Introduction......................................................................................................................... 9 1.1 Purpose of the Peripheral................................................................................................ 9 1.2 Features .................................................................................................................... 9 1.3 Functional Block Diagram .............................................................................................. 10 1.4 Industry Standard(s) Compliance Statement ........................................................................ 11 1.5 Terminology Used in This Document ................................................................................. 11 2 Peripheral Architecture ....................................................................................................... 12 2.1 Clock Control............................................................................................................. 12 2.2 Memory Map ............................................................................................................ 12 2.3 Signal Descriptions .....................................................................................................
    [Show full text]
  • 1 Signal Definitions
    PI7C8140A 2-Port PCI-to-PCI Bridge REVISION 1.01 3545 North First Street, San Jose, CA 95134 Telephone: 1-877-PERICOM, (1-877-737-4266) Fax: 408-435-1100 Internet: http://www.pericom.com 07-0067 PI7C8140A 2-PORT PCI-TO-PCI BRIDGE LIFE SUPPORT POLICY Pericom Semiconductor Corporation’s products are not authorized for use as critical components in life support devices or systems unless a specific written agreement pertaining to such intended use is executed between the manufacturer and an officer of PSC. 1) Life support devices or system are devices or systems which: a) Are intended for surgical implant into the body or b) Support or sustain life and whose failure to perform, when properly used in accordance with instructions for use provided in the labeling, can be reasonably expected to result in a significant injury to the user. 2) A critical component is any component of a life support device or system whose failure to perform can be reasonably expected to cause the failure of the life support device or system, or to affect its safety or effectiveness. Pericom Semiconductor Corporation reserves the right to make changes to its products or specifications at any time, without notice, in order to improve design or performance and to supply the best possible product. Pericom Semiconductor does not assume any responsibility for use of any circuitry described other than the circuitry embodied in a Pericom Semiconductor product. The Company makes no representations that circuitry described herein is free from patent infringement or other rights of third parties which may result from its use.
    [Show full text]
  • IBM Elastic Storage System 3000: Service Guide Chapter 1
    IBM Elastic Storage System 3000 6.0.2 Service Guide IBM SC28-3187-03 Note Before using this information and the product it supports, read the information in “Notices” on page 63. This edition applies to Version 6 release 0 modification 2 of the following product and to all subsequent releases and modifications until otherwise indicated in new editions: • IBM Spectrum® Scale Data Management Edition for IBM® ESS (product number 5765-DME) • IBM Spectrum Scale Data Access Edition for IBM ESS (product number 5765-DAE) IBM welcomes your comments; see the topic “How to submit your comments” on page xiii. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you. © Copyright International Business Machines Corporation 2019, 2021. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Figures.................................................................................................................. v Tables................................................................................................................. vii About this information.......................................................................................... ix Who should read this information...............................................................................................................ix IBM Elastic Storage System information units..........................................................................................
    [Show full text]
  • Vitex-II Pro: the Platfom for Programmable Systems
    The Platform for Programmable Systems Developing high-performance systems with embedded pro- cessors and fast I/O is quite a challenge. To be successful, you Industry’s Fastest must solve the difficult technical FPGA Fabric problems of hardware and Up to 4 IBM PowerPC™ Processors immersed in FPGA Fabric software development, I/O Up to 24 Embedded Rocket I/O™ Multi-Gigabit Transceivers interfacing, and third-party IP Up to 12 Digital Clock Managers integration; you must rigorously XCITE Digitally Controlled Impedance Technology simulate, test, and verify your Up to 556 18x18 Multipliers design; and you must meet Over 10 Mb Embedded Block RAM increasingly difficult deadlines with a cost-effective product that can adapt as industry standards Virtex-II Pro Platform FPGA Family quickly evolve. Benefits are Overwhelming The revolutionary Virtex-II Pro™ Because all of the critical system components (such as microprocessors, memory, IP peripherals, programmable logic, and high-performance I/O) are located on one family, based on the highly successful programmable logic device, you gain a significant performance and productivity Virtex-II architecture, provides a advantage. The Virtex-II Pro FPGA family, along with the Wind River Systems embedded tools and Xilinx ISE development environment, is the fastest, easiest, and unique platform for developing most cost effective method for developing your next generation high-performance high-performance microprocessor- programmable systems. and I/O-intensive applications. With Virtex-II Pro FPGAs, you get: Virtex-II Pro FPGAs provide up to • On-Chip IBM PowerPC Processors – You get maximum performance and ease of use because these are hard cores, operating at peak efficiency, tightly coupled with ™ four embedded 32-bit IBM PowerPC all memory and programmable logic resources.
    [Show full text]
  • Design and Implementation of Clocked Open Core Protocol Interfaces for Intellectual Property Cores and On-Chip Network Fabric
    DESIGN AND IMPLEMENTATION OF CLOCKED OPEN CORE PROTOCOL INTERFACES FOR INTELLECTUAL PROPERTY CORES AND ON-CHIP NETWORK FABRIC by Raghu Prasad Gudla A thesis submitted to the faculty of The University of Utah in partial fulfillment of the requirements for the degree of Master of Science Department of Electrical and Computer Engineering The University of Utah May 2011 Copyright c Raghu Prasad Gudla 2011 All Rights Reserved The University of Utah Graduate School STATEMENT OF THESIS APPROVAL This thesis of Raghu Prasad Gudla has been approved by the following supervisory committee members: Kenneth S. Stevens , Chair 01/14/2011 Date Approved Alan L. Davis , Member 01/14/2011 Date Approved Erik L. Brunvand , Member 01/14/2011 Date Approved and by Gianluca Lazzi , Chair of the Department of Electrical and Computer Engineering and by Charles A. Wight, Dean of the Graduate School. ABSTRACT This thesis designs, implements, and evaluates modular Open Core Protocol (OCP) interfaces for Intellectual Property (IP) cores and Network-on-Chip (NoC) that re- duces System-On-Chip (SoC) design time and enables research on different archi- tectural sequencing control methods. To utilize the NoCs design time optimization feature at the boundaries, a standardized industry socket was required, which can address the SoC shorter time-to-market requirements, design issues, and also the subsequent reuse of developed IP cores. OCP is an open industry standard socket interface specification used in this research to enable the IP cores reusability across multiple SoC designs. This research work designs and implements clocked OCP interfaces between IP cores and On-Chip Network Fabric (NoC), in single- and multi- frequency clocked domains.
    [Show full text]
  • Tsi340 User Manual 80E3000 MA001 05 4 Contents
    ® IDT Tsi340™ PCI-to-PCI Bridge User Manual 80E3000_MA001_05 September 2009 6024 Silver Creek Valley Road, San Jose, California 95138 Telephone: (800) 345-7015 • (408) 284-8200 • FAX: (408) 284-2775 Printed in U.S.A. ©2009 Integrated Device Technology, Inc. GENERAL DISCLAIMER Integrated Device Technology, Inc. reserves the right to make changes to its products or specifications at any time, without notice, in order to improve design or performance and to supply the best possible product. IDT does not assume any responsibility for use of any circuitry described other than the circuitry embodied in an IDT product. The Company makes no representations that circuitry described herein is free from patent infringement or other rights of third parties which may result from its use. No license is granted by implication or otherwise under any patent, patent rights or other rights, of Integrated Device Technology, Inc. CODE DISCLAIMER Code examples provided by IDT are for illustrative purposes only and should not be relied upon for developing applications. Any use of the code examples below is completely at your own risk. IDT MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND CONCERNING THE NONINFRINGEMENT, QUALITY, SAFETY OR SUITABILITY OF THE CODE, EITHER EXPRESS OR IMPLIED, INCLUDING WITHOUT LIMITATION ANY IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICU- LAR PURPOSE, OR NON-INFRINGEMENT. FURTHER, IDT MAKES NO REPRESENTATIONS OR WARRANTIES AS TO THE TRUTH, ACCURACY OR COMPLETENESS OF ANY STATEMENTS, INFORMATION OR MATERIALS CONCERNING CODE EXAMPLES CONTAINED IN ANY IDT PUBLICATION OR PUBLIC DISCLOSURE OR THAT IS CONTAINED ON ANY IDT INTERNET SITE. IN NO EVENT WILL IDT BE LIABLE FOR ANY DIRECT, CONSEQUENTIAL, INCIDENTAL, INDIRECT, PUNITIVE OR SPECIAL DAMAGES, HOWEVER THEY MAY ARISE, AND EVEN IF IDT HAS BEEN PREVIOUSLY ADVISED ABOUT THE POSSIBILITY OF SUCH DAMAGES.
    [Show full text]
  • New Virtex™-II Pro Family Extends Platform FPGA Capability with Multi
    Virtex-II Pro Platform FPGA Family Product Backgrounder The Virtex-II Pro Platform FPGA solution is arguably the most technically sophisticated silicon and software product in the programmable logic industry. The goal in developing the Virtex-II Pro FPGA was to revolutionize system architecture “from the ground up.” To achieve that objective, circuit engineers and system architects from IBM, Mindspeed, and Xilinx co- developed this advanced Platform FPGA. Engineering teams from top embedded systems companies, including Wind River Systems and Celoxica, worked together with Xilinx software teams to develop the systems software and IP solutions that enable new system architecture. The result is the first Platform FPGA solution capable of implementing ultra-high bandwidth SoC (system-on-a-chip) designs that were previously the exclusive domain of custom ASICs, yet with the flexibility and low development cost of programmable logic. This new solution is expected to usher a new era of leading-edge system architectures in networking applications, embedded systems, and digital signal processing systems. Virtex-II Pro Family Features • Five family members with 3,168 to 50,832 logic cells and 216 to 3,888 Kbits of Block RAM • Based upon Virtex-II IP-Immersion architecture • Multi-gigabit (3.125 Gb/s) serial transceiver blocks, up to 16 per device • PowerPC embedded processor cores, up to four per device Virtex-II Pro Family Key Value Proposition • Platform for Programmable Systems • Enables architectural synthesis • Delivers next generation connectivity standards • Enables a new development paradigm • Delivers leading edge price/performance value Virtex-II Pro Family Highlights The Virtex-II Pro family consists of five members, each with four to 16 RocketIO™ multi- gigabit transceivers based on the Mindspeed SkyRail™ technology.
    [Show full text]
  • L 60 E9 L L 49 50 I
    US006085274A Ulllted States Patent [19] [11] Patent Number: 6,085,274 Seeman [45] Date 0f Patent: Jul. 4, 200() [54] COMPUTER SYSTEM WITH BRIDGES 5,613,075 3/1997 Wade et al. ........................... .. 395/287 HAVING POSTED MEMORY WRITE 5,636,374 6/1997 Rodgers et al. 395/384 BUFFERS 5,678,064 10/1997 Kulik et al. .. 395/309 5,684,997 11/1997 Kau et al. 395/309 . 5,941,970 8/1999 Lange .................................... .. 710/129 [75] Inventor' Thomas R’ Seeman’ Tombau’ TeX' 6,012,120 1/2000 Duncan etal. ....................... .. 710/129 [73] Assignee: Compaq Computer Corporation 6,021,451 2/2000 Bell et al. ............................. .. 710/128 Primary Examiner-Paul R. Myers [21] Appl' No* 09/260’962 Attorney, Agent, 0r Firm-Sharp, Comfort & Merrett, P.C. [22] Filed: Mar. 2, 1999 [57] ABSTRACT Related U.S. Application Data A computer system using posted memory Write buffers in a bridge can implement the system management mode Without COIIÍÍIllliitÍOIl 0f application N0. 08/775,129, DCC. 31, 1996. faulty Operation. The System management interrupt [51] Int. CI.7 .................................................... .. G06F 13/00 eeknewledge Signed is Pested in bridge buffers Se that any [52] U S C] ,n0/129. 37o/402 previously posted memory Write commands currently held l. ........................................... .. ., in a posted memory Write buffer in the bridge execute prior [58] Fleld of Search ........................... .. 370/470126/55/112386 to the appearance of the posted System management íntep ’ rupt acknowledge signal. In this Way, devices on a down [56] References Cited stream bus Will not be confused by the occurrence of posted memory Write transactions into mistaking such transactions U.S.
    [Show full text]