Open Compute Project Yosemite Platform Design Specification Facebook Multi-Node Server Platform: Yosemite Design Specification V 0.5 Authors: Yan Zhao, Hardware Engineer, Facebook Renee Chu, Mechanical Engineer, Facebook JacoB Na, Thermal Engineer, Facebook Sai Dasari, Software Engineer, Facebook 1 http://opencompute.org Open Compute Project Yosemite Platform Design Specification Copyrights and Trademarks Intel® is a trademark of Intel Corporation in the U.S. and/or other countries. Texas Instruments™ is a trademark of Texas Instruments Incorporated. Tiva™ is a trademark of Texas Instruments Incorporated. 2 2/8/2016 Open Compute Project Yosemite Platform Design Specification 1 Scope This specification describes the design of the Yosemite Platform that hosts multiple One Socket (1S) servers. 2 Contents Copyrights and Trademarks ............................................................................................................ 2 1 Scope ........................................................................................................................................ 3 2 Contents .................................................................................................................................... 3 3 Overview ................................................................................................................................... 5 4 License ...................................................................................................................................... 6 5 Yosemite Platform Features ..................................................................................................... 7 5.1 Platform Block Diagram ................................................................................................... 7 5.2 Yosemite Platform Side Plane ......................................................................................... 8 5.3 Yosemite Platform Power Delivery ................................................................................. 9 5.4 SMBus Block Diagram .................................................................................................... 10 5.5 1S Server Slots ............................................................................................................... 11 5.6 Network Options ........................................................................................................... 12 6 Baseboard Management Controller ....................................................................................... 23 6.1 1S Server I2C Connections ............................................................................................. 23 6.2 1S Server Serial Connections ......................................................................................... 23 6.3 1S Server Discovery Process .......................................................................................... 23 6.4 1S Server Power-on Sequence ...................................................................................... 25 6.5 Network Interface ......................................................................................................... 25 6.6 BMC Multi-node Requirements .................................................................................... 25 6.7 Local Serial Console and Serial-Over-LAN ..................................................................... 25 6.8 Graphics and GUI ........................................................................................................... 26 6.9 Remote Power Control and Power Policy ..................................................................... 26 6.10 POST Codes ................................................................................................................. 26 6.11 Power and System Identification LEDs ........................................................................ 26 6.12 Time Sync .................................................................................................................... 28 6.13 Power and Thermal Monitoring, and Power Limiting ................................................. 29 6.14 Sensors ........................................................................................................................ 29 6.15 Event Log ..................................................................................................................... 30 3 http://opencompute.org Open Compute Project Yosemite Platform Design Specification 6.16 Fan Speed Control in BMC .......................................................................................... 32 6.17 BMC Firmware Update ................................................................................................ 32 6.18 OpenBMC .................................................................................................................... 33 7 Mechanical .............................................................................................................................. 34 7.1 Cubby Chassis ................................................................................................................ 34 7.2 Sled Chassis ................................................................................................................... 34 7.3 1S Server Card Retention/Extraction ............................................................................. 38 7.4 Silkscreen ....................................................................................................................... 41 7.5 Side Plane & Power Distribution ................................................................................... 41 8 Thermal ................................................................................................................................... 45 8.1 Data Center Environmental Conditions ......................................................................... 45 8.2 Server Operational Conditions ...................................................................................... 46 8.3 Thermal Kit Requirements ............................................................................................. 47 9 I/O System .............................................................................................................................. 49 9.1 PCI-E Slots ...................................................................................................................... 49 9.2 Network ......................................................................................................................... 49 9.3 1S Server slots assignment ............................................................................................ 49 9.4 Front Panel .................................................................................................................... 49 9.5 Fan Connector ............................................................................................................... 52 9.6 Power ............................................................................................................................ 53 9.7 Hot Swap Controller Circuit ........................................................................................... 53 9.8 1S Server Power Management ...................................................................................... 54 9.9 System VRM Efficiency .................................................................................................. 54 9.10 Power Policy ................................................................................................................ 54 10 Environmental Requirements and Other Regulations ............................................................ 55 10.1 Environmental Requirements ..................................................................................... 55 10.2 Vibration and Shock .................................................................................................... 55 10.3 Regulations .................................................................................................................. 55 11 Prescribed Materials ............................................................................................................... 56 11.1 Disallowed Components ............................................................................................. 56 11.2 Capacitors and Inductors ........................................................................................... 56 11.3 Component De-rating ................................................................................................. 56 12 Labels and Markings ............................................................................................................... 57 4 2/8/2016 Open Compute Project Yosemite Platform Design Specification 13 Revision History ...................................................................................................................... 58 3 Overview This document describes the Facebook’s multi-node Server platform (code name: Yosemite) and the design requirements to integrate the platform into Open Rack V2. The Yosemite Platform is a next generation multi-node server platform that hosts 4 Open Compute Platform (OCP) compliant One Socket (1S) server cards in a sled that can be plugged into an OCP Cubby chassis. There is a vertically installed side plane inside the chassis to hold 1S server cards horizontally in two floors. With this new architecture, we could leverage 1S server