Recent Supercomputing Development in Japan
Total Page:16
File Type:pdf, Size:1020Kb
Development of Supercomputers in Japan --From the Numerical Wind Tunnel to Fugaku-- Yoshio Oyanagi Science Advisor, RIST Kobe Center (高度情報科学技術研究機構) 2019/9/5 KSC 2019 1 How computers started in Japan PREHISTORY 2019/9/5 KSC 2019 2 “Computers” before WWII • Many Powers/Hollerith Punch Card Systems have been introduced to Japan since 1923 • The first one in universities: IBM Punch Card Systems in Kobe Univ. in 1941 • Since no PCS could be imported during WWII, Japan tried to copy the machine. • The next slide shows computer history exhibit of Kobe Univ. RIEB (Res. Inst. for Economics and Business Administration) . 2019/9/5 KSC 2019 3 2019/9/5 KSC 2019 4 Universities in 1950’s and 1960’s • Big computers were too expensive to buy with ordinary budget (we were poor, then!) • Some universities introduced small computers • Some universities developed computers by themselves – TAC 1952-1959 Univ. of Tokyo (Eng.) (with Toshiba) V – (no name) 1953-unfinished Osaka Univ. V – PC-1 1956- 1958 Univ. of Tokyo (Sci.) P – KDC-1 1958-1960 Kyoto Univ. (with Hitachi) T – SENAC-1 1956-1958 Tohoku Univ. (with NEC) P – K-1 1958-1960 Keio Univ. T • Those computers were open to teachers and students in the campus and were heavily used 2019/9/5 KSC 2019 5 PC-1 in Univ. of Tokyo (hand made) 2019/9/5 KSC 2019 6 Authorized Computer Centers • 1963/5/13 Recommendation of Science Council of Japan • 1963/7 Budget Proposal from Univ. of Tokyo • 1964/3 Accepted by government • Finalist computers were: – Hitachi HITAC 5020 (under development) – IBM 7094 II (popular but out-of-date) – CDC 3600 (new in Japan) • 1964/5 Committee selected HITAC 5020 – Rejected American computers 2019/9/5 KSC 2019 7 Computer Center, Univ. of Tokyo • 1965/4 Inauguration • 1965/7 Installed (main- and subsystems) • 1966/1 Service started (closed card system) • 1966/11 Main system was upgraded to HITAC 5020E 2019/9/5 KSC 2019 8 Seven Computer Centers Before 1971, seven centers started • Tohoku Univ.: NEAC 2200-500 • Kyoto Univ.: FACOM 230-60 • Osaka Univ.: NEAC 2200-200 • Kyushu Univ. : FACOM 230-60 • Hokkaido Univ. : FACOM 230-60 • Nagoya Univ.: FACOM 230-60 All were open to all teachers/staffs/graduate students in Japan They were upgraded every 4-6 years 2019/9/5 KSC 2019 9 In 1976 first Cray-1 was installed in LANL. We heard the news that computers with high speed were working in US, unfortunately they were beyond our reach. Japanese vendors tried to follow the Cray vector computers. FROM MAINFRAMES TO SUPERCOMPUTERS 2019/9/5 KSC 2019 10 75 80 85 90 95 00 05 0 I II III IV V Cray-1 205, XMP ETA10,YMP C90 T90 X1 Illiac IV CM-2 CM-5,Paragon SP-1/2, T3D T3E, Origin, Power APU, IAP S810 S820 S3800 SR2201/8000/11000 VP200 VP2600 VPP500 VPP300/700/5000 PP SX-1/2 SX-3 SX4 SX-5 SX-6/7/8 PAX-32 QCDPAX cp-pacs pacs-cs NWT ES MITI Supercomputer RWCP Project Fifth Generation Project 2019/9/5 KSC 2019 11 Historical Overview of Supercomputers ⚫ 1H of 1980’s: Japanese vectors comparable with American vectors ⚫ 2H of 1980’s: Japanese vectors supersede Americans. Trade conflicts (NCAR, MIT etc.) begin. ⚫ 1H of 1990’s: HPCC, NII start. MPP with Killer micros. Japan keeps vector architecture like NWT. ⚫ 2H of 1990’s: ASCI, PACI, PITAC in US ⚫ 1H of 2000’s: ES (“Computonik”), BG/L ⚫ 2H of 2000’s: Death and resurrection of the K. ASC, SciDAC, Teragrid and HPCS in US 2019/9/5 KSC 2019 12 ◆ ◆ 2019/9/5 KSC 2019 13 Observation (1/2) • Until late 1990’s, Japanese vendors focused to vector machines. • Users exploited the power of vectorization. • Vendors thought parallel machines were for specialized purposes (eg. image processing). Most users dared not try to harness parallel machines in the 80’s. • Users found difficulties in using message passing. • Softwares – Very good vectorizing compilers. – Users were spoiled by them. – HPF efforts for the Earth Simulator. 2019/9/5 KSC 2019 14 Observations (2/2) • Some computer scientists were interested in building parallel machines, but they were not used for practical scientific computing. • Practical parallel processing for scientific computing was started by application users: – qcd-pax (1989) for lattice QCD – NWT (1993) for fluid dynamics – cp-pacs (1996) for computational physics – GRAPE’s (1989- ) for astrophysics – Earth Simulator (2002) for climate, ocean, earthquake 2019/9/5 KSC 2019 15 Installation of SC’s in Japan (1987-8) • Cray Research (Cray-1, X-MP):10 (8 in com) • ETA (ETA-10): 1 • Hitachi (S810):15 (9 in com) • NEC (SX-1/2):7 (2 in com) • Fujitsu (VP-50, 100, 200, 400):36 (23 in com) – com: commercial sector (more than half) 2019/9/5 KSC 2019 16 US-Japan Trade Conflicts • 1985/9: Plaza Accord (G5) in NY • 1985: SX-2 was cancelled by NCAR after bidding • 1986/9: US-Japan Semiconductor Agreement • 1987: Japanese SC was cancelled by MIT after bidding 2019/9/5 KSC 2019 17 Super 301 Act • In 1989, US government decided to apply “Super 301 Act” (Omnibus Trade and Competitiveness Act of 1988) to Japan and identified three items including supercomputers. • Washington pressured Japanese governmental institutions to purchase US supercomputers. (Titech ETA10, ETL X-MP) • On the other hand, US governmental institutions had no Japanese supercomputers at all (yet now!). 2019/9/5 KSC 2019 18 HPCC in US • Blue Book (1991/2, G.W.Bush) – “Grand Challenges: High Performance Computing and Communications” • The High Performance Computing Act of 1991 • Trade conflicts: – “Japan should buy more US supers” (M. Kantor, 1993/4) Otherwise, possible retaliation. – 6 out of 11 in public sector bought US machines in the 1994 supplementary budget. • In Europe, Rubbia Report (1991/1) – European Teraflop Initiative 2019/9/5 KSC 2019 19 Japanese machines in Top 20 9306 9311 9406 9411 9506 9511 9606 9611 9706 9711 9806 9811 9906 9911 0006 0011 0106 0111 1 NWT NWT NWT NWT Todai cp-p 2 NWT NWT NWT cp-p 3 Todai NWT 4 Todai cp-p Todai 5 NEC ATP ATP KEK KEK Todai LRZ Todai 6 AES NEC Tsuku Tsuk Todai cp-p KEK 7 AES Riken Riken JAERI KEK NWT LRZ Todai 8 KEK ECMW Osak 9 NEC Kyush Todai KEK 10 Hitach Hitac NEC ECMW 11 Todai Todai JAERI Stutt 12 NEC Nagoy AES TAC ECMW LRZ Osak 13 Toho Toho Todai 14 ATP Gene JAERI Todai cp-p KEK 15 AES Tsuk ISS Nagoy NWT Kyoto 16 NEC Riken ECMW 17 Toho Toho Gene NEC Kyush TAC ISS Todai LRZ 18 AES Toho ISS Osaka KEK AES cp-p JMA 19 IMS AES ATP Osaka ECMW FZJ KEK 20 IMS Tsuk Stutt 2019/9/5 KSC 2019 20 US Trends in late 1990’s • ASCI Project (originally 1995-2004) – SC’s in LANL, LLNL, SNL – Red (1+), Blue (3+), White (10+), Q(30+), Purple (100+) --- every 2 years • PITAC (I:1997-2001, II: 2003-2005) – IT2 project • PACI (1997-2004) • Petaflops I in Pasadena (1994) Petaflops II in Santa Barbara (1999) 2019/9/5 KSC 2019 21 Japan Trends in early 2000’s • 2nd Five-year plan for science and technology (2001) • IT Strategic Headquarter (2001): e-Japan, but only network was emphasized. – At this stage, level up of supercomputers was to be promoted according to the needs of each field (not a national project). • Earth Simulator attained 36 Tflops (2002) • Information Science and Technology committee in Mext has been discussing the measures to promote computational science and technology since August 2004. 2019/9/5 KSC 2019 22 US Trends in early 2000’s • DOE: ASCI continues – BlueGene and Red Storm added – SciDAC (2001) • NSF: Teragrid (2001-15) • DOD: HPCS (High Productivity Computing Systems) – 2002: Phase I (IBM, Cray, Sun, HP, SGI) – 2003: Phase II (Cray, IBM, Sun) – 2006: Phase III (Cray: XC, IBM: PERCS) • HEC Revitalization Act of 2004 and 2005 • Exa started in “The Path to Extreme Computing” in Santa Fe (2004/10) 2019/9/5 KSC 2019 23 Sixth Generation (2H of 2000 and later) Japan US/Europe/China • 2006-12: K Computer P. • Cray XT/XE/XC – 2011: 10 PF attained • 2005: ASCI Purple (LLNL, IBM) • 2006: T2K open SC • 2006: Rangers (TACC) • 2007: NCSA, BlueWaters started – 2008: installed in 3 univ. (IBM→2011 Cray) • 2006: TSUBAME 1.0 • 2007: Kraken (Tennessee) – 2010: TSUBAME 2.0 • 2008: Roadrunner (LANL) • 2009: Fujitsu fx-1 to JAXA • 2010: Tianhe-1A (NUDT) • 2010: PRACE started • 2011: NSF, SXEDE • 2013 America COMPETES Act 2019/9/5 KSC 2019 24 After 5 consecutive top ranks of ES, Japan fell far behind. 0206 0211 0306 0311 0406 0411 0506 0511 0606 0611 0706 0711 0806 0811 0906 0911 1006 1 ES ES ES ES ES 2 3 ES 4 ES 5 6 NAL ES 7 Riken TIT 8 AIST 9 TIT 10 ES 11 JAXA 12 AIST 13 Todai TIT 14 LRZ Riken ES 15 JAERI AIST TIT Todai 16 17 KEK 18 KEK 19 Osak AIST 20 ES Tsuk 2019/9/5 KSC 2019 25 Most politicians thought “IT is network” (not HPC) Supercomputers were considered something like an F1 race car, a hobby of computer scientists. It was not easy to persuade them of the importance of supercomputers. HOW “K” COMPUTER WAS BORN 2019/9/5 KSC 2019 26 History of the K Computer • Recommendation to a Mext committee (2005): – Promote a national project to construct a leading edge supercomputer – Government decision (July 25, 2005) • Riken started the project (October 2005) • Mext funded four projects to promote “Element Technologies for Future Supercomputers” in 2005- 2007.