SGI® Altix® 330 Self-Paced Training
Total Page:16
File Type:pdf, Size:1020Kb
SGI Multi-Paradigm Architecture Michael Woodacre Chief Engineer, Server Platform Group [email protected] A History of Innovation in HPC Challenge® XL media server fuels Steven Spielberg’s Shoah NASA Ames and project to document Altix® set world Power Series™, Holocaust survivor record for multi-processing stories systems provide STREAMS Jim Clark compute power First systems benchmark founded SGI on SGI introduces for high-end deployed in Stephen the vision of its first 64-bit graphics Hawking’s COSMOS Altix®, first scalable Computer operating applications system 64-bit Linux® Server Visualization system 1982 1984 1988 1994 1995 1996 1997 1998 2001 2003 2004 DOE deploys 6144p Introduced First generation Origin 2000 to IRIS® Workstations modular NUMA System: monitor and become first integrated NUMAflex™ Origin® 2000 simulate nuclear 3D graphics systems architecture stockpile with Origin® 3000 First 512p Altix cluster Dockside engineering analysis on Origin® drives ocean research at NASA Ames 2000 and Indigo2™ helps Team New +10000p upgrade! Zealand win America’s Cup Images courtesy of Team New Zealand and the University of Cambridge SGI Proprietary 2 Over Time, Problems Get More Complex, Data Sets Exploding Bumper, hood, engine, wheels Entire car E-crash dummy Organ damage This Trend Continues Across SGI's Markets Improve design Improve patient safety Improve oil exploration Improve hurricane prediction & manufacturing First Row Images: EAI, Lana Rushing, Engineering Animation, Inc, Volvo Car Corporation, Images courtesy of the SCI, Second Row Images: The MacNeal-Schwendler Corp , Manchester Visualization Center and University Department of Surgery, Paradigm Geophysical, the Laboratory for Atmospheres,SGI Proprietary NASA Goddard Space Flight Center. 3 SGI Scalable ccNUMA Architecture Basic Node Structure and Interconnect C C C C A A A A C CPU CPU C C CPU CPU C H H H H E E E E NUMAlink™ Interconnect Interface Interface Chip Chip Physical Memory Physical Memory SGI Proprietary 4 SGI Scalable ccNUMA Architecture Basic Node Structure and Interconnect C C C C A A A A C CPU CPU C C CPU CPU C H H H H E E E E NUMAlink™ Interconnect Interface Interface Chip Chip Global Shared Memory SGI Proprietary 5 Logical Layout - 8TB Altix 128 Processor 8TB - 1.6GB/s Uniform Memory Bandwidth Plane A Level 2 Routers RC2A RC4A RC6A RC8A RC3A RC5A RC7A RC9A Level 1 Routers RB2 RB3 RB6 RB7 RB10 RB11 RB14 RB15 RB18 RB19 RB22 RB23 RB26 RB27 RB30 RB31 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 R13 R14 R15 R16 R17 R18 R19 R20 R21 R22 R23 R24 R25 R26 R27 R28 R29 R30 R31 R32 C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 R13 R14 R15 R16 R17 R18 R19 R20 R21 R22 R23 R24 R25 R26 R27 R28 R29 R30 R31 R32 RB2 RB3 RB6 RB7 RB10 RB11 RB14 RB15 RB18 RB19 RB22 RB23 RB26 RB27 RB30 RB31 Level 1 Routers RC2B RC4B RC6B RC8B SGI Proprietary Level 2 Routers RC3B RC5B RC7B RC9B Plane B 6 3.2 Interconnect Topology 3.0 Bi-Section Bandwidth Profiles ) 2.8 GBs/sec/cpu cpu 2.6 sec/ 2.4 Bs/ G ( 2.2 th id 2.0 w d n 1.8 Ba 1.6 ion ct e 1.4 -S i Dual Plane - NL3 router - 1.2 8 port router bricks wB a R 1.0 Dual Plane - NL4 router - 8 port router bricks 0.8 0.6 0.4 0.2 SGI Proprietary 4 8 16 32 64 128 256 512 1024 2048 Processors 7 Examples of Single-Paradigm Architectures Scalar Vector App-Specific Intel Itanium Cray X1 Graphics - GPU SGI MIPS NEC SX Signals - DSP IBM Power Prog’ble - FPGA Sun SPARC Other ASICs HP PA SGI Proprietary 8 Paradigms to Applications Application-specific high Application-specific Vector Scalar Intensity Compute Low Low Data locality High SGI Proprietary 9 Peer I/O: Increased I/O Flexibility & Performance XIO+ I/O C R C NL I/O XIO+ C 1:1 Ratio C-brick to I/O Peer I/O I/O R C NL I/O SGI Proprietary 10 SGI Scalable ccNUMA Architecture Multi-Paradigm Computing Architecture General Purpose RASC™ (FPGA) Scalable GPUs I/O Interfaces C C C C C C C General C A A A A A A GeneralA A C C C C C C C C H CPU CPU H H CPU FPGA(s) CPU H GPUsH CPU GPUsCPU H PurposeH CPU PurposeCPU H E E E E E E EI/O I/O E Interface Interface Interface Interface TIO Chip Chip TIOChip TIOChip Physical Memory Physical Memory Physical Memory Physical Memory NUMAlink™ Interconnect Fabric SGI Proprietary 11 Data-Centric Architecture CPU CPU CPU U CP IO IO Very Large GAM FPGA APU . Globally Addressable . Low Latency . High Bandwidth . Many Ports APU FPGA PU 3 A U- Graphics Graphics APU U GP G APU AP GPU-0 GPU-1 PU-0 GPU-1 GPU-2 osition Graphics Graphics Comp GPU-3 GPU-2 SGI Proprietary 12 Big Data 1TB, 32*32=1024 elements Each box represents 1GB SGI Proprietary 13 Big Data SGI Proprietary 14 Big Data SGI Proprietary 15 Big Datasets : 3D Interactive Visualization 1993 2004 100 MB 40,000x 400 GB 10% viewed / year Productivity 100% viewed / month ~1 MB / month 400 GB / month SGI Proprietary 16 Commodity GPU systems 5X the price of a Scale-up System March 17, 2005 nVIDIA visualizes large data set •473 million triangles •128 GPU’s on Dell Systems •~$1million system Compliments of nVIDIA January 21, 2005 SGI visualizes large data set •350 million triangles •12P, 56GB memory •Utilizes a ray tracer •~$180,000 system Compliments of Boeing SGI Proprietary 17 Dynamic Load Balancing Load Balancing OFF Load Balancing ON Given Most Work SGI Proprietary 18 Dimensions of Scalability • Processors • Processor bandwidth • Memory bandwidth • Memory capacity • Interconnect bandwidth • IO bandwidth • Graphics processing • Reconfigurable processing • Other acceleration elements SGI Proprietary 19 Origin3000 Building Blocks (Bricks) C-brick CPU Module R-brick Router Interconnect I-brick Base I/O Module P-brick PCI Expansion X-brick XIO Expansion D-brick Disk Storage SGI Proprietary 20 SGI Altix™ 3700 Bx2 Platform Introduction: Building Blocks Itanium® 2 CR-brick CPU and memory M-brick Memory R-brick SGI® Router interconnect Advanced Linux Environment IX-brick With Base I/O module SGI ProPack PA-brick, PX-brick PCI-X expansion D-brick2 Disk expansion SGI Proprietary 21 High-End Servers – Moving Forward: Altix® 4700 Platform….. Blade Packaging •Innovative Blade-to-NUMALink4 Concept: Provides Unprecedented Versatility, Density •Blade Architecture Leads Next-Wave of HPC Blade-Based Platforms: With Better Upgradeability, Expansion & Repair •Investment Protection: Processor-Only Upgrade to Future Dual Core Processors •Enables Flexible Multi-Paradigm Computing: Enhanced integrated RASC, Graphics SGI Proprietary 22 Next Generation RASC™ Technology Blade Base Package Blade Based Package SGI Proprietary 23 SGI Proprietary Standardized Blades, NUMAlinkBackbone Blade Individual RackUnit (IRU) Filler Panel Filler Panel Blade Slot 1 Blade Slot 2 (Contains 10Blades) Blade Slot 3 Blade Slot 4 24 Blade Slot 5 Blade Slot 6 Blade Slot 7 Blade Slot 8 Blade Slot 9 Blade Slot 10 L1 Display Small Rack =4IRUs Small Rack Rack L1 Display L1 Display L1 Display L1 L1 Display L1 L1 Display L1 Display L1 Display L1 Display L1 SGI Proprietary Altix® 4700ComputeBlades Filler Panel Filler Panel I/OBlade Blades Slot 1 GraphicsBlade Slot Blade 2 ComputeBlade Slot Blade 3 Blade Slot 4 MemoryBlade Slot Blade 5 Blade Slot 6 RASCBlade SlotBlade 7 Blade Slot 8 Blade Slot 9 Blade Slot 10 L1 Display 25 • ComputeBladeOptionsto Two • SupportforMadison9MProcessors Capabilities: Provide DifferentSystem (Montecito/Montvale asAvailable) – BestPerformance, BW Memory OR – Best$/FLOP,Density (Bandwidth ComputeBlade) (Bandwidth Compute Blade) (Density Altix® 4700 Compute Blades Top View Front View Highest Memory BW, Performance: Bandwidth DDR2 DIMM DDR2 DIMM Bandwidth Compute Blade Compute DDR2 DIMM DDR2 DIMM Blade • 667MHz FSB Madison9M -> DDR2 DIMM DDR2 DIMM 10.7GB/s Local Memory Bandwidth M9M Shub • 32 M9M Sockets / S-Rack NL4 6.4GB/s Socket 10.7GB/s 2.0 • Processors Supported: 1.66GHz/9M, 1.66GHz/6M Madison9M with DDR2 DIMM DDR2 DIMM 667MHz FSB DDR2 DIMM DDR2 DIMM DDR2 DIMM DDR2 DIMM • Memory Sizes: 2G – 48G/core Single Blade Top View Front View Best $/FLOP, Best Density: Density Density Compute DDR2 DIMM DDR2 DIMM Compute Blade Blade DDR2 DIMM DDR2 DIMM • 533MHz FSB Madison9M -> M9M DDR2 DIMM DDR2 DIMM 8.524GB/s Local Memory Bandwidth Socket Shub • 64 M9M Sockets / S-Rack NL4 6.4GB/s 8.5GB/s 2.0 • Processors Supported: 1.6GHz/9M, M9M 1.6GHz/6M Madison9M with 533MHz DDR2 DIMM DDR2 DIMM Socket FSB DDR2 DIMM DDR2 DIMM DDR2 DIMM DDR2 DIMM • Memory Sizes: 1G – 24GB/core Single Blade SGI Proprietary 26 Memory Blade Top View Front View 6 DDR2 DIMM DDR2 DIMM Y0 Memory Blade: C DDR2 DIMM DDR2 DIMM Q2 DDR2 DIMM DDR2 DIMM • Scale Memory Independently with 12 DDR2 DIMM Slots Per Blade Shub NL4 6.4GB/s • Up to 128TB 2.0 DDR2 DIMM DDR2 DIMM DDR2 DIMM DDR2 DIMM DDR2 DIMM DDR2 DIMM Single Blade SGI Proprietary 27 SGI Proprietary Altix® 4700RASCBlade Filler Panel Filler Panel I/OBlade Blades Slot 1 GraphicsBlade Slot Blade 2 CPUBlade Blade Slot 3 Blade Slot 4 MemoryBlade Slot Blade 5 Blade Slot 6 RASCBlade SlotBlade 7 Blade Slot 8 Blade Slot 9 Blade Slot 10 L1 Display 28 • RASC Blade – Enhanced Performance, Tightly – Abacus ComputationBlade Integrated RASC Blades – Cont.