盟 联 业 产 Consortium 算 计 色 Green Computing Consortium Computing Server Technical Standards Report 绿 Green Green Computing Consortium Copyright© 2018 绿色计算产业联盟（ GCC ） Green Computing Consortium Server Technical Standards Report 序 为统一产业对绿色计算发展现状和趋势的认知，阐释开放标准和 开放架构对产业和生态的重要意义，推动各方合作共赢，GCC 组织撰 写并与 2017 年底在第四届世界互联网大会发布了《绿色计算产业联 盟服务器技术标准报告》（以下简称：标准报告）。这份盟报告 在绿盟 内外、对产业各方都产生了重要且积极的影响。 联 为进一步推动绿盟成果与外部产业、国际产业的沟通和交流，标 准报告编写组安排专家对标准报告进行了英业文翻 译。可以用作和外界 厂商、国际标准组织、国内外用户进产行沟 通和成Consortium果分享，展现绿盟在 推动开放标准、促进生态建设中的观点和积极态度，推动各方交流碰 撞、分享成果。技术内容的解算读以 标准报告中文版为准。 编写组感谢参与英计文翻 译的各位专家，特别感谢 ARM 公司魏东老 师的贡献！ 色 Computing 绿 《绿色计算产业联盟服务器技术标准报告》编写组 Green ©2018 Green Computing Consortium Green Computing Consortium Server Technical Standards Report 目 录 1 Introduction...................................................................................................................2 1.1 Background.............................................................................................................2 1.2 Purpose and Significance.................................................................................7 1.3 Green Computing Framework...............................................................................9 2 Green Computing framework: hardware layer...................................................... 11 2.1 CPU Interface.....................................................................................................11 2.1.1 Memory Interface.....................................................................................12 2.1.2 Accelerator Interface...........................................................................盟 14 2.1.3 Network Interface...................................................................................15 2.1.4 Management Interface.............................................................................联 18 2.2 Hardware Architecture.....................................................................................20 3 Green computing framework: software layer...................................................... 22 3.1 Firmware...............................................................................................................业 22 3.2 Basic Software...................................................................................................23 3.3 Platform Software.............................................................................................25 4 Green computing framework: server system产 ........................................................Consortium27 4.1 Heterogeneous Computing.................................................................................27 4.2 Extensibility.....................................................................................................28 4.3 RAS.........................................................................................................................算 29 4.4 Security...............................................................................................................30 5 Green Computing Standardization Proposal........................................................ 33 6 References.....................................................................................................................计 35 APPENDIX A Acronyms.......................................................................................................36 APPENDIX B REferenced Standards bodies and open source organizations................... 37 B.1 Hardware色............................................................................................................... 37 B.1.1 CCIX.............................................................................................................Computing 37 B.1.2 PCI-SIG.......................................................................................................38 B.1.3绿 Gen-Z...........................................................................................................38 B.1.4 JEDEC...........................................................................................................39 B.2 Software...............................................................................................................40 B.2.1 UEFI forum.................................................................................................40 B.2.2Green Linaro......................................................................................................... 40 APPENDIX C ARM64 Architecture...................................................................................42 C.1 ARM Architecture Development...................................................................... 42 C.2 ARMv8 Architecture...........................................................................................43 ©2018 Green Computing Consortium Page 1 of 45 Green Computing Consortium Server Technical Standards Report 1 INTRODUCTION 1.1 Background Driven by market demand, modern data centers have entered rapid development. Emerging applications such as big data, Internet of Things, and artificial intelligence continue to increase in data size and computing scale which puts higher demands盟 on the functionalities, performance, and especially the green computing characteristics of cloud data center infrastructure. The goal of green computing, as the联 name suggests, is to increase the computing performance through innovative system architecture, hardware and software design, energy saving and heat dissipation业 methods, reduce the energy consumption and environmental impact of产 the IT infrastructure.Consortium With the increasing public awareness of energy saving and environmental impact, green computing has become the shared demand of the global算 industry. In order to support the constantly expanding application scenarios with “ green ” technologies, the server-centric计 computing infrastructure is experiencing exciting innovation and development.色 The industry has realized that relying only on the increase of the transistor number in theComputing CPU (following Moore's Law) or the increase of CPU’s frequency绿 can no longer meet the performance needs of the applications. Computer systems need innovative architectures to meet the calling of green computing. A direction fullGreen of potential is heterogeneous computing which uses dedicated accelerators (FPGA or field programmable logic gate arrays, GPU or graphics processors, even NPU or neural network processors, etc.) to offload CPU's load of specific algorithms (e.g., image Page 2 of 45 ©2018 Green Computing Consortium Green Computing Consortium Server Technical Standards Report analysis, deep learning, etc.) and perform efficient operations. At the same time, a new generation of memory interface will greatly increase the efficiency of in-memory processing. It opens a broad space for big data applications. ARM has always been committed to high-efficiency, low-power architecture innovations. From the instruction set, CPU architecture, IP design, to SOC (System-on-a- Chip) design, all are designed to meet users ’ needs and markets ’ demand盟 on green computing. ARM has been continuously improving CPU computing联 capabilities and optimizing the energy consumption. Through many years of research and development, the ARM64 server is considered to be the most promising业 solution for green computing systems with its multi-core, multi-threaded architecture,产 andConsortium performance. It has been supported by more and more customers through open architecture, open interfaces, support for heterogeneous computing算 of various types of accelerators and CPUs. ARM64 servers have unique advantages in a variety of data center applications: Big data analytics.计 Big data is characterized by big volume, diverse types, sparse valid information色 and high requirements on timeliness. The system must perform well in a large numberComputing of complex real-time calculations. The total cost and energy绿 efficiency of completing big data workload are two primary metrics for evaluating big data processing platforms. High concurrency is a significant feature of big dataGreen processing. The platform based on ARM64 architecture has inherent advantages in terms of high multi-core concurrency. At the same time, as ARM64 single-core performance increases, its overall performance continues to increase. In the meantime, the innovation of the ARM64 architecture in low-power design ©2018 Green Computing Consortium Page 3 of 45 Green Computing Consortium Server Technical Standards Report provides ARM64 servers with advantages in energy effiency. Therefore, ARM64 servers have good prospects for big data analytics, particularly suitable for highly parallel dataflow applications. HPC (High Performance Computing). High-performance computing applications are widely found in modeling and analysis in fields such as environmental sciences, biological sciences, materials sciencesand astrophysics盟 etc. Unlike other applications, the HPC system is a large system联 with a combination of computing, storage, and networking technologies with tailored optimization for for different workloads. In the meantime, energy consumption业 is the main expenditure of a supercomputing center, and therefore the returnConsortium is substantial for each one percentage reduction in energy consumption.产 The ARM64 architecture has evolved in recent years. The latest version算 of the instruction set already has features that enable high floating-point computing capabilities and massively parallel systems. ARM and related communities计