<<

The Importance of High-Performance and High-Throughput in Dr. Guy Tel-Zur Ben-Gurion University, Israel tel-zur@.org The Importance of Scientific Computing in Israel Dr. Guy Tel-Zur Ben-Gurion University, Israel [email protected] "For a successful technology, reality must take precedence over public relations, for nature cannot be fooled.“

R.P. Feynman Personal observations on the reliability of the Shuttle http://science.ksc.nasa.gov/shuttle/missions/51-l/docs/rogers-commission/Appendix-F.txt Talk Outline

• Israel achievements • The absurd • The importance of HPC & HTC – Supercomputing use cases • What would happen if Israel won’t have SC – US status – Israel and the middle east • The solutions – Sharing resources – The cyber initiative – International collaborations

Welcome to Israel – Some facts

Israel ranked 22nd in global competitiveness Israel rose two places from last year in the World Economic Forum rankings, and was up five places from 2009. Adrian Filut, 7 September 11 http://www.globes.co.il/serveen/globes/docview.asp?did=1000680340&fid=1725

Israel ranked 17th-most competitive economy

No. 1 for resilience, research expenditure. Sharon Wrobel, 21 May 2010 http://www.jpost.com/Business/BusinessNews/Article.aspx?id=176043 http://www.globalfirepower.com/ Dan The Technion Chemistry 2011 Shechtman

Ada E. Yonath Weizmann Chemistry 2009 Institute of Science Robert J. The Hebrew Economic 2005 Aumann Univ., Sciences Jerusalem Aaron The Technion Chemistry 2004 Ciechanover

Avram The Technion Chemistry 2004 Hershko

USA Economic 2002 Daniel Kahneman* Sciences Shared with Vernon L. Smith Turing Awards

Turing Awards

List of countries by patents

http://en.wikipedia.org/wiki/List_of_countries_by_patents Start-Up Nation

“…Where Tech Keeps Booming In Israel, a clustering of talent, research universities and venture capital.”

http://online.wsj.com/article/SB10001424052748704779704574553884271802474.html Best Space Agencies

Space Agency Country Score*

1. National Aeronautics and Space Administration 74.36 (=) 2. European Space Agency EU 61.80 (=) 3. Russian Federal Space Agency 56.10 (=) 4. Indian Space Research Organisation 44.63 (+ 2)

5. National Space Administration 43.50 (- 1) Agência Espacial Brasileira (Brazilian Space 6. 29.53 (- 1) Agency) 7. Aerospace Exploration Agency 26.33 (=) 8. Canadian Space Agency 21.31 (=) 9. Israeli Space Agency 14.19 (=) 10. National Space Agency of Ukraine 10.15 (=) http://www.rankopedia.com/Best-Space-Agency-(Updated)/Step1/9054/.htm Scientific Publications per 100K people The World top 20 countries

#Publications Country

284.2 1 213.5 2 213.0 3 191.6 4 186.3 5 185.2 6 177.1 7 174.7 8 167.6 9 162.2 10 160.5 11 156.4 12 155.4 ISRAEL 13 149.6 UK 14 148.4 IRELAND 15 139.3 16 136.2 17 Source: 109.6 USA 18 Samuel Neaman Institute 108.1 19 for National Policy Research 103.3 20

Nanotechnology

nations.html

-

the

- http://www.electroiq.com/articles/stm/2010/08/ranking Biotechnology 2009

Supercomputing? Samuel Samuel Mapping Mapping Research Infrastructures in Israel Neaman

Institute for National Policy Research Submitted to the National forCouncil R&D

www.most.gov.il Israel at the Top500 The Top500, Nov. 2011

CountX1000

1000000

100000

10000 Population(K) Rmax (TFlops) 1000 100 China Japan Germany Canada GDP per Capica Cores X10 $ Israel NERSC (*) (DOE) @ LBL “Each year NERSC's 4,000 users report more than 1,500 peer-reviewed paper submissions based on work using our resources.”

Rule of Three:

Where are: 4000/42.4=94 missing Israelis users?

1500/42.4=35 missing scientific papers?

(*) NERSC = National Energy Research Scientific Computing Center There are 140 experts affiliated with JSC

140/11.3 = 12

Where are those 12 missing Israelis HPC scientists?

And JSC is not the only SC center in Germany.. The actual numbers can be X5

Conclusion: There is a place to have a SC department in Israel with 60 scientists!

Instead of X12 take X17

Instead of 60  42 scientists

The Importance of HPC & HTC The Need for Speed

• 퐹 = 푚 ∙ 푎 Newton’s 2nd law in 1D, O(100) FLOPs 푀푚 • 퐹 = 퐺 ∙ 푟3 Gravitational force in 3D, 푟3 O(101) FLOPs • Acceleration ∫ velocity  ∫ position O(102) FLOPs • A typical Galaxy N~1010 stars • N-body interaction, O(N2) • O(1020) • Assume 100 time steps, O(1022) • Times the numerical operations from previous slide, O(1024) FLOPs • Assume a PetaFLOP computer ~1015 FLOPs • The computation will take 109 sec. ~11,574days ~32years

• Today’s MTBF ~100hours (checkpoint/restart) • Doable on an ExaFLOP machine • Need an algorithmic change!

A simulation of a galaxy merger, National Astronomical Observatory of Japan Supercomputing Discoveries SUPERNOVA SIMULATION LIGHTS UP THE SKY

SPEEDING PREDICTIONS OF THE MOLECULES OF LIFE UNLEASHING A VIRTUAL EARTHQUAKE

Israeli researchers can not do simulations in such scales because they luck the resources in the country!

EXPLORING THE DETAILS OF TURBULENCE PREDICTING WEATHER ON THE SUN Materials Science Plasma Physics Oak Ridge National Laboratory Helping to solve the curious case of Germanium-72

These images are isosurface contours of the accelerating electric field from a 3D particle-in- (PIC) simulation of a plasma wakefield accelerator. The simulation was done at NERSC and it used 14 million grid cells and 56 million particles

New Architectures Research

"Maverick" the University of Texas at Austin's test node, built with 's Knights Ferry test kit. The University is using this system to get ready for Intel's upcoming Knights Corner processor, which crams more than 50 Pentium processor cores into a single chip. Photo: Intel

http://www.wired.com/wiredenterprise/tag/high-performance-computing/ Science

Experiment Theory Computation Data Mining

2 out of 4 require Supercomputing The Concerns

The Fear and The Facts What would happen if Israel won’t have a Supercomputer In the U.S., 12 senators cited Tianhe-1A in a letter to President Obama warning that "the race is on" to develop capable of 1,000 petaflops (1 exaflop). In asking for funding, they wrote that "Our global competitors in Asia and Europe are already at work on technology...we cannot afford to risk our leadership position in computational sciences." Supercomputing's Exaflop Target Tom Geller Communications of the ACM Vol. 54 No. 8, Pages 16-18 August 2011 http://www.nsf.gov/nsb/news/news_summ.jsp?cntn_id=122859&org=NSB&from=news http://www.thedailybeast.com/content/newsweek/2011/11/27/in-race-for- fastest-supercomputer-china-outpaces-u-s.html http://www.conceivablytech.com/1120/business/china-challenges-u-s- in-supercomputing-leadership http://top500.org/lists/2010/11/press-release Will the first Exaflop machine be built using Chinese chips?

Godson-3C, a 16-core processor for the Dawning 6000 to be launched in 2013

FeiTeng (FT64) accelerator / stand alone CPU ?

Science and Engineering Indicators

http://www.nsf.gov/statistics/seind12/

Prof. Rafi Melnick - IDC Herzliya

http://www.herzliyaconference.org/ Weizac Educational Score Performance - Country Rankings http://www.geographic.org/country_ranks/educational _score_performance_country_ranks_2009_oecd.html SOURCE: OECD in Figures 2009

http://www.geographic.org/country_ranks/educational_scor e_performance_country_ranks_2009_oecd.html#science Teachers' salaries Annual statutory salaries in public institutions, minimum training, year 2008 Equivalent USD converted using PPPs Upper secondary education Salary Initial 15 years Maximum Australia 33 336 46 908 46 908 Austria 30 353 42 177 62 045 - Belgium (Fl.) 36 360 52 667 63 391 Belgium (Fr.) 34 885 50 541 60 838 16 587 23 540 25 846 Denmark 39 085 51 034 51 034

England 30 534 44 630 44 630 ISSN 2075 ISSN

Finland 32 731 44 919 57 925 - France 26 400 34 593 49 912 Germany 51 722 63 634 72 876 25 974 31 946 38 658 13 226 18 079 25 523 Iceland 25 503 31 983 33 483 Ireland 32 657 54 100 61 304 Italy 28 098 35 290 44 041

Japan 27 545 48 655 63 184 Korea 31 407 54 444 87 327 71 508 98 849 124 231

Netherlands 36 762 67 105 73 964 2011

New Zealand 25 964 38 412 38 412 Norway 31 652 39 016 39 016 Poland 9 173 18 548 19 334 Portugal 21 677 35 486 55 654

Scotland 30 475 48 611 48 611 OECD ©

-

Spain 42 440 48 945 59 234 Sweden 30 533 36 163 41 131

Switzerland 58 781 76 207 89 655 5120 United States 36 398 47 317 53 913 OECD from tables Key Education: OECD - Total 32 563 45 850 54 717 EU19 32 059 45 043 54 009 Estonia 11 981 12 687 17 510 1 995 2 582 2 813 Israel 18 199 22 410 27 680 Slovenia 27 470 32 075 33 967 Last updated: 21 March 2011 % of Israelis Ph.D.`s staying abroad vs. year of graduation as of 2010

Science and Engineering

Humanities and Social Sciences CaSToRC

Iran Amirkabir University of Technology 32/34/89TFLOPS(?)

Isfahan University of Bibliotheca Alexandrina Technology. (?)

“Shaheen” at King Abdullah University of Science and NARSS Super Computer Unit Technology (KAUST) (Blue-Gene)

King Abdulaziz University (KAU) The Solutions Lesson #1 Cultural, Israelis must learn to share resources

1000 Cores * 10GFLOP/core * 30 days* 24hours * 60min * 60sec =26 EFLOPs within one month for FREE!!!

UW-Madison Comp Sci Condor Pool Machine Statistics for January 2012 –High Throughput Computing (HTC) –Distributive owned resources • High Throughput - Large amounts of processing capacity sustained over very long time periods (FLOPY - Floating Point Operations Per Year)

FLOPY  30758400*FLOPS Concept

Matchmaking - enables requests for services and offers to provide services to find each other. Checkpointing - enables preemptive resume scheduling (go ahead and use it as long as it is available!).

Grid Stack - Globus, gLite or UNICORE Lesson #2: Government Support

• Education • Modern Infrastructure • An excellence center

Israel National Cyber Initiative

A Special Report to the Prime Minister May 2011 Industry

Defense Academy Main Findings of the Supercomputing and Networking Committee • There is no supercomputer in Israel • There is not enough knowledge in HPC in the country and there are knowledge gaps • There are however “Islands” of knowledge but there is no synergy among them and • Some of the consumers are not aware of the opportunities of using HPC for their projects • There is a Bandwidth bottleneck http://www.iucc.ac.il/ Main Recommendations of the Supercomputing and Networking Committee • There is a need to strengthen the research in the country in Cyber and related topics • There is a need to establish a center for supercomputing research and studies • There is a need to better cooperate between the industry and the academics • The is a need to strengthen the education in these fields • A Supercomputer is needed but it can have a moderate performance • There is a need to establish excellence centers in HPC Bad (today)

Computational Physics

Computational Biology

Computational

Mechanics

Goodput Better

Computational Physics

HPC Center Computational Biology

Computational Mechanics Best

Computational Physics

HPC Excellence Center Computational Biology

Computational

Mechanics

Basic HPC

Research Goodput Proximity between Computing elements

PC Local Remote

Departmental Cluster

GPGPU Cluster Number Number of Operations Cloud Computing HPC/HTC Infrastructure Complex

Parallel I/O

Supercomputing Grid Computing Grid HTC HPC Power

Embarrassingly MTBF Parallel

Availability

High

Can Cloud Computing Address Scientific Computing Requirements for DOE Research? Well, Yes, No and Maybe • Cloud approaches provide many advantages, including customized environments • Cloud computing can require significant initial effort and skills • Significant gaps and challenges exist in the areas of managing virtual environments, workflows, data, cyber- security • The key economic benefit of clouds comes from the consolidation of resources http://www.scientificcomputing.com/news-HPC-Can-Cloud-Computing-Address-Scientific-Computing- Requirements-for-DOE-Research-020212.aspx http://science.energy.gov/~/media/ascr/pdf/program-documents/docs/Magellan_Final_Report.pdf International Collaborations • - http://www.prace-ri.eu/ – 21 member countries – EU funded – FP7 – 3 Petaflop machines: • JUGENE in Germany – ranked 13th in the world • CURIE in France –ranked 106th in the world • HERMIT in Germany – ranked 12th in the world • Israel (IUCC) accepted to PRACE on Jan 24, 2012 as a full member – Next call to use resources to open in April 2012 and closes in May 2012 for use in October 2012 • http://www.prace-project.eu/Call-Announcements – Industry participation allowed Connecting the Dots

S/W & H/W People

Modern Science Super Comp. Education

Networks

HPC Grids Funding HTC

Scientific Domain Comp Decomposition Numerical Models United States China Japan Top500 Count United Kingdom France (November 2011) Germany Canada Poland Russia Italy Australia Switzerland Sweden United States Korea, South China Israel Japan United Kingdom McDonald's franchises France Germany Canada Poland Russia Italy Australia Switzerland Sweden Saudi Arabia Spain Korea, South Israel Thank You!