POWER8® Processor-Based Systems RAS Introduction to Power Systems™ Reliability, Availability, and Serviceability
Total Page:16
File Type:pdf, Size:1020Kb
POWER8® Processor-Based Systems RAS Introduction to Power Systems™ Reliability, Availability, and Serviceability March 17th, 2016 IBM Server and Technology Group Daniel Henderson Senior Technical Staff Member, RAS Information in this document is intended to be generally descriptive of a family of processors and servers. It is not intended to describe particular offerings of any individual servers. Not all features are available in all countries. Information contained herein is subject to change at any time without notice. Trademarks, Copyrights, Notices and Acknowledgements Trademarks IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol (® or ™), indicating US registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both: Active AIX® POWER® POWER Hypervisor™ Power Systems™ Power Systems Software™ Memory™ POWER6® POWER7® POWER7+™ POWER8™ PowerHA® PowerLinux™ PowerVM® System x® System z® POWER Hypervisor™ Additional Trademarks may be identified in the body of this document. The following terms are trademarks of other companies: Intel, Intel Xeon, Intel logo, Intel Inside logo, and Intel Centrino logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a trademark of Linus Torvalds in the United States, other countries, or both. LTO, Ultrium, the LTO Logo and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries. Microsoft, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Java, and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. UNIX is a registered trademark of The Open Group in the United States and other countries. Other company, product, or service names may be trademarks or service marks of others. Notices The last page of this document contains copyright information, important notices and other information. Acknowledgements While this whitepaper has a single principal author/editor it is the culmination of the work of a number of different subject matter experts within IBM who contributed ideas, detailed technical information, and the occasional photograph and section of description. These include the following: Theodore Maeurer, Thoi Nguyen, Doug Baska, Michael Mueller, Jim O’Connor, Gary Andrews, K Paul Muller, Len Daniels, Ken Wright, Steven Gold, Marc Gollub, Pat Egan, Ravi A. Shankar, Craig Shempert, Kevin Reick, Naresh Nayar, Peter Heyrman, Resham Kulkarni, Kanwal Bahri, Christopher Sturgill, Audrey Romonosky, George Ahrens, Jim Mitchell, Dan Hurlimann and Rob Overton. Page 4 POWER8 Processor Based Systems RAS, January 2016 Table of Contents Trademarks, Copyrights, Notices and Acknowledgements .................. 4 Trademarks ......................................................................................................................... 4 Notices ................................................................................................................................ 4 Acknowledgements ............................................................................................................. 4 Table of Contents ..................................................................................... 5 Introduction .............................................................................................. 9 Announce History ............................................................................................................................... 9 October 2015 Announcement ............................................................................................................ 9 Whitepaper Organization .................................................................................................................... 9 Section 1: POWER8 RAS Summary ....................................................... 11 RAS Summary: Common System Features ..................................................................... 11 POWER8 Processor RAS .................................................................................................. 11 Figure 1: POWER8 Processor Compared to POWER7+ ......................................................... 11 Figure 2: POWER8 DCM Module Integration ........................................................................... 12 Figure 3: POWER7/POWER7+ and POWER8 RAS Enhancements ....................................... 12 Memory RAS ..................................................................................................................... 13 Figure 4: POWER8 Custom DIMM Design............................................................................... 14 I/O Subsystem ................................................................................................................... 15 Figure 5: 1s and 2s POWER8 Processor-based Scale-out Systems ....................................... 15 RAS Summary: RAS Capabilities of Various System Models ........................................ 16 Introduction ....................................................................................................................... 16 Figure 6: Comparing Power System RAS Features ................................................................. 17 POWER8 processor-based 1s and 2s Systems IBM POWER System S814, S822, S824 . 18 POWER8 processor-based 1s and 2s Systems IBM POWER System S812L, S822L and S824L, ............................................................................................................................... 18 POWER8 processor-based IBM Power System S812LC and S822LC .............................. 19 Introduction ....................................................................................................................................... 19 Figure 7: Comparing Power System S812L and S822L to S812LC and S822LC ................... 19 Error Handling .................................................................................................................................. 20 POWER8 processor-based IBM POWER E850 System .................................................... 22 Introduction ....................................................................................................................................... 22 System Structure .............................................................................................................................. 22 Figure 8: A Schematic of a IBM Power System E850 .............................................................. 23 Comparing the IBM Power System E850 to POWER7 based IBM Power System 750 and 760 .... 23 Comparing the IBM Power System E850 to IBM Power System E870 and IBM Power System E880 .......................................................................................................................................................... 24 POWER8 processor-based IBM Power System E870 and IBM Power System E880 ........ 24 Introduction ....................................................................................................................................... 24 Figure 9: POWER8 SCM .......................................................................................................... 24 Figure 10: Logical View of Power System E870/E80 System Structure .................................. 25 Compared to POWER7 based IBM Power System 795 .................................................................. 26 Figure 11: Some Power System Featuresa E870/E880 Compared to 795.............................. 26 Compared to POWER7 based IBM Power System 770/780 ........................................................... 27 Figure 12: Power System E880 and E870 Compared to 770/780 ........................................... 27 CEC Hot Add Repair Maintenance (CHARM) .................................................................................. 28 Page 5 POWER8 Processor Based Systems RAS, January 2016 PCIe Gen 3 I/O Expansion Drawer .................................................................................... 29 Figure 13: PCIe Gen3 I/O Drawer RAS Features .................................................................... 29 Figure 14: PCIe Gen3 I/O Expansion Drawer RAS Feature Matrix ......................................... 30 Section 2: Hallmarks of Power Systems RAS ..................................... 31 Integrated System Design ................................................................................................. 31 Figure 15: IBM Enterprise System Stacks ................................................................................ 32 Alternate System Approach .............................................................................................................. 32 Hardware That Takes Care of the Hardware ..................................................................... 33 Figure 16: Two Concepts of Server RAS