Highlights and Impacts of ASCR's Programs

Total Page:16

File Type:pdf, Size:1020Kb

Highlights and Impacts of ASCR's Programs ASCR@40 Highlights and Impacts of ASCR’s Programs A report compliled by the ASCAC Subcommittee on the 40-year history of ASCR for the U.S. Department of Energy’s Office of Advanced Scientific Computing Research 2020 Cover image: This snapshot of a thermonuclear supernova simulation with asymmetric ignition in a white dwarf was created by the Supernova Science Center which was part of SciDAC-1. Led by Michael Zingale of Stony Brook, the project wanted to see whether the ash bubble (in purple) would sweep around the star and collide with enough force to compress fuel in the area to trigger a spontaneous detonation. The 3D results disfavored that possibility. At the time, the issue of how the white dwarf ignites was one of the most debated issues in Type Ia supernova modeling. ASCR@40: Highlights and Impacts of ASCR’s Programs A report compiled by the ASCAC Subcommittee on the 40-year history of ASCR for the U.S. Department of Energy’s Office of Advanced Scientific Computing Research Chairs: Bruce Hendrickson, Paul Messina Committee members and authors: Buddy Bland, Jackie Chen, Phil Colella, Eli Dart, Jack Dongarra, Thom Dunning, Ian Foster, Richard Gerber, Rachel Harken, Wendy Huntoon, Bill Johnston, John Sarrao, Jeff Vetter Editors: Jon Bashor, Tiffani Conner CONTENTS 1.0 INTRODUCTION .................................................................................................................................................. 1 Document Overview .............................................................................................................................................................. 3 2.1 THE THIRD PILLAR OF SCIENCE: DELIVERING ON THE PROMISE OF COMPUTATIONAL SCIENCE ............................................................................................................................................................... 6 Background ............................................................................................................................................................. 7 Infrastructure for Computational Science & Engineering .................................................................................................8 Computational Resources .....................................................................................................................................................8 Advances in Applied Mathematics .......................................................................................................................................9 Advances in Computer Science ........................................................................................................................................... 11 High Performance Computing Initiatives and Programs .................................................................................................. 11 2.2 APPLIED MATHEMATICS: LAYING THE FOUNDATION .......................................................................17 Differential Equations .......................................................................................................................................................... 18 Partial Differential Equations .............................................................................................................................................. 18 Solvers ...................................................................................................................................................................................23 Optimization ........................................................................................................................................................................ 26 2.3 COMPUTER SCIENCE: UNLEASHING SCALE AND SPEED ...............................................................29 Massively Parallel Processing Computing ..........................................................................................................................29 Large-scale Data Analysis and Visualization ......................................................................................................................32 Deciding Who to Trust in a World of Strangers ................................................................................................................35 DOE Science Grid, ANL, LBNL, ORNL, PNNL ............................................................................................................38 Laying the Foundations for Scientific AI ...........................................................................................................................39 2.4 COMPUTER ARCHITECTURE ..................................................................................................................... 40 Context ................................................................................................................................................................................ 40 Paradigm Shifts ................................................................................................................................................................... 40 Computer Architecture Testbeds ........................................................................................................................................41 Government and Industry Partnerships .............................................................................................................................43 2.5 ASCR COMPUTING AND NETWORKING FACILITIES IN SEVENTH DECADE OF DRIVING SCIENTIFIC DISCOVERY ...............................................................................................................................45 Early History .........................................................................................................................................................................46 Bringing Computation to Open Science ...........................................................................................................................47 Working in Parallel ...............................................................................................................................................................47 Big Changes in the 1990s ................................................................................................................................................... 48 ASCR Cements DOE’s Role in HPC .............................................................................................................................. 50 Performance Modeling ....................................................................................................................................................... 53 I Getting Big Science out of Big Data ................................................................................................................................. 54 Networking at the Speed of Science: The Energy Sciences Network ........................................................................... 56 The First DOE Science-Oriented Network ......................................................................................................................57 Saving the Internet .............................................................................................................................................................. 58 Pushing Networking Technology ....................................................................................................................................... 58 Evolving to 400 Gbps Networks ....................................................................................................................................... 59 Services for Advanced Networking Supporting Data-Intensive Science ...................................................................... 59 perfSONAR Performance Monitoring Software ............................................................................................................60 ESnet’s Sixth-generation Network built on SDN Expertise ........................................................................................... 61 ASCR’s Supercomputing Landscape ................................................................................................................................. 61 Conclusion ............................................................................................................................................................................ 61 3.0 ASCR INVESTMENTS HELP DRIVE INDUSTRIAL DISCOVERY AND ECONOMIC COMPETITIVENESS ........................................................................................................................................64 Software Libraries Boost Circulation of ASCR Expertise ...............................................................................................64 ASCR Computing Facilities Help Drive Industrial Innovation ........................................................................................65 Helping Small Businesses Innovate ....................................................................................................................................70 4.0 ASCR’S IMPACT ON WORKFORCE DEVELOPMENT AND EDUCATION ..................................... 75 Educational Activities .......................................................................................................................................................... 75 The DOE Computational Science Graduate Fellowship Program .................................................................................
Recommended publications
  • Julia, My New Friend for Computing and Optimization? Pierre Haessig, Lilian Besson
    Julia, my new friend for computing and optimization? Pierre Haessig, Lilian Besson To cite this version: Pierre Haessig, Lilian Besson. Julia, my new friend for computing and optimization?. Master. France. 2018. cel-01830248 HAL Id: cel-01830248 https://hal.archives-ouvertes.fr/cel-01830248 Submitted on 4 Jul 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. « Julia, my new computing friend? » | 14 June 2018, IETR@Vannes | By: L. Besson & P. Haessig 1 « Julia, my New frieNd for computiNg aNd optimizatioN? » Intro to the Julia programming language, for MATLAB users Date: 14th of June 2018 Who: Lilian Besson & Pierre Haessig (SCEE & AUT team @ IETR / CentraleSupélec campus Rennes) « Julia, my new computing friend? » | 14 June 2018, IETR@Vannes | By: L. Besson & P. Haessig 2 AgeNda for today [30 miN] 1. What is Julia? [5 miN] 2. ComparisoN with MATLAB [5 miN] 3. Two examples of problems solved Julia [5 miN] 4. LoNger ex. oN optimizatioN with JuMP [13miN] 5. LiNks for more iNformatioN ? [2 miN] « Julia, my new computing friend? » | 14 June 2018, IETR@Vannes | By: L. Besson & P. Haessig 3 1. What is Julia ? Open-source and free programming language (MIT license) Developed since 2012 (creators: MIT researchers) Growing popularity worldwide, in research, data science, finance etc… Multi-platform: Windows, Mac OS X, GNU/Linux..
    [Show full text]
  • Numericaloptimization
    Numerical Optimization Alberto Bemporad http://cse.lab.imtlucca.it/~bemporad/teaching/numopt Academic year 2020-2021 Course objectives Solve complex decision problems by using numerical optimization Application domains: • Finance, management science, economics (portfolio optimization, business analytics, investment plans, resource allocation, logistics, ...) • Engineering (engineering design, process optimization, embedded control, ...) • Artificial intelligence (machine learning, data science, autonomous driving, ...) • Myriads of other applications (transportation, smart grids, water networks, sports scheduling, health-care, oil & gas, space, ...) ©2021 A. Bemporad - Numerical Optimization 2/102 Course objectives What this course is about: • How to formulate a decision problem as a numerical optimization problem? (modeling) • Which numerical algorithm is most appropriate to solve the problem? (algorithms) • What’s the theory behind the algorithm? (theory) ©2021 A. Bemporad - Numerical Optimization 3/102 Course contents • Optimization modeling – Linear models – Convex models • Optimization theory – Optimality conditions, sensitivity analysis – Duality • Optimization algorithms – Basics of numerical linear algebra – Convex programming – Nonlinear programming ©2021 A. Bemporad - Numerical Optimization 4/102 References i ©2021 A. Bemporad - Numerical Optimization 5/102 Other references • Stephen Boyd’s “Convex Optimization” courses at Stanford: http://ee364a.stanford.edu http://ee364b.stanford.edu • Lieven Vandenberghe’s courses at UCLA: http://www.seas.ucla.edu/~vandenbe/ • For more tutorials/books see http://plato.asu.edu/sub/tutorials.html ©2021 A. Bemporad - Numerical Optimization 6/102 Optimization modeling What is optimization? • Optimization = assign values to a set of decision variables so to optimize a certain objective function • Example: Which is the best velocity to minimize fuel consumption ? fuel [ℓ/km] velocity [km/h] 0 30 60 90 120 160 ©2021 A.
    [Show full text]
  • Pysp: Modeling and Solving Stochastic Programs in Python
    Noname manuscript No. (will be inserted by the editor) PySP: Modeling and Solving Stochastic Programs in Python Jean-Paul Watson · David L. Woodruff · William E. Hart Received: September 6, 2010. Abstract Although stochastic programming is a powerful tool for modeling decision- making under uncertainty, various impediments have historically prevented its wide- spread use. One key factor involves the ability of non-specialists to easily express stochastic programming problems as extensions of deterministic models, which are often formulated first. A second key factor relates to the difficulty of solving stochastic programming models, particularly the general mixed-integer, multi-stage case. Intri- cate, configurable, and parallel decomposition strategies are frequently required to achieve tractable run-times. We simultaneously address both of these factors in our PySP software package, which is part of the COIN-OR Coopr open-source Python project for optimization. To formulate a stochastic program in PySP, the user speci- fies both the deterministic base model and the scenario tree with associated uncertain parameters in the Pyomo open-source algebraic modeling language. Given these two models, PySP provides two paths for solution of the corresponding stochastic program. The first alternative involves writing the extensive form and invoking a standard deter- ministic (mixed-integer) solver. For more complex stochastic programs, we provide an implementation of Rockafellar and Wets’ Progressive Hedging algorithm. Our particu- lar focus is on the use of Progressive Hedging as an effective heuristic for approximating Jean-Paul Watson Sandia National Laboratories Discrete Math and Complex Systems Department PO Box 5800, MS 1318 Albuquerque, NM 87185-1318 E-mail: [email protected] David L.
    [Show full text]
  • Program Update: Year Three
    PHYSICAL SCIENCES-ONCOLOGY CENTER PROGRAM Program Update: Year Three Fall 2012 Table of Contents 1. Executive Summary .................................................................................................................................................................1 2. Physical Sciences-Oncology Program Organization ...............................................................................................................5 2.1. Introduction ..................................................................................................................................................................7 2.2. Office of Physical Sciences-Oncology Mission ............................................................................................................7 2.3. Program History ...........................................................................................................................................................8 2.3.1 Overview of Spring 2008 Think Tank Meetings ................................................................................................8 2.3.2 Program Development and Funding History ...................................................................................................10 2.4. Strategic Approach and Objectives ...........................................................................................................................11 2.4.1 A Focus on Addressing “Big Questions” in Oncology ....................................................................................11
    [Show full text]
  • Pyomo Documentation Release 5.6.2.Dev0
    Pyomo Documentation Release 5.6.2.dev0 Pyomo Feb 06, 2019 Contents 1 Installation 3 1.1 Using CONDA..............................................3 1.2 Using PIP.................................................3 2 Citing Pyomo 5 2.1 Pyomo..................................................5 2.2 PySP...................................................5 3 Pyomo Overview 7 3.1 Mathematical Modeling.........................................7 3.2 Overview of Modeling Components and Processes...........................9 3.3 Abstract Versus Concrete Models....................................9 3.4 Simple Models.............................................. 10 4 Pyomo Modeling Components 17 4.1 Sets.................................................... 17 4.2 Parameters................................................ 23 4.3 Variables................................................. 24 4.4 Objectives................................................ 25 4.5 Constraints................................................ 26 4.6 Expressions................................................ 26 4.7 Suffixes.................................................. 31 5 Solving Pyomo Models 41 5.1 Solving ConcreteModels......................................... 41 5.2 Solving AbstractModels......................................... 41 5.3 pyomo solve Command....................................... 41 5.4 Supported Solvers............................................ 42 6 Working with Pyomo Models 43 6.1 Repeated Solves............................................. 43 6.2 Changing
    [Show full text]
  • Biographies of Candidates 2017 Y C C ! OO S UUN T
    ELECTION SPECIAL SECTION FROM THE AMS SECRETARY R VO U T O E Biographies of Candidates 2017 Y C C ! OO S UUN T Biographical information about the candidates has been supplied and verified by the candidates. Candidates have had the opportunity to make a statement of not more than 200 words (400 for presidential can- didates) on any subject matter without restriction and to list up to five of their research papers. Candidates have had the opportunity to supply a photograph to accompany their biographical information. Acronyms: AAAS (American Association for the Advancement of Science); AMS (American Mathematical Society); ASA (American Statistical Association); AWM (Association for Women in Mathematics); CBMS (Conference Board of the Mathematical Sciences); IAS (Institute for Advanced Study), ICERM (The Institute for Computational and Experimen- tal Research in Mathematics; ICM (International Congress of Mathematicians); IMA (Institute for Mathematics and Its Applications); IMS (Institute of Mathematical Statistics); IMU (International Mathematical Union); IPAM (Institute for Pure and Applied Mathematics); LMS (London Mathematical Society); MAA (Mathematical Association of America); MSRI (Mathematical Sciences Research Institute); NAS (National Academy of Sciences); NRC (National Research Council); NSF (National Science Foundation); PIMS (Pacific Institute for the Mathematical Sciences); SIAM (Society for Industrial and Applied Mathematics); STEM (Science, Technology, Engineering and Mathematics). President ety, Inaugural Class, 2012; Member, Society for Industrial Jill C. Pipher and Applied Mathematics Committee on Science Policy, Elisha Benjamin Andrews Pro- 2014–2018; American Academy of Arts and Sciences, fessor of Mathematics, Brown Elected 2015; Member, Mathematical Association of University. America, Committee on Prizes and Awards, 2015–2017; PhD: University of California, Los Subcommittee Chair, NSF-Division of Mathematical Sci- Angeles, 1985.
    [Show full text]
  • Implicit Particle Filters for Data Assimilation Alexandre Chorin, Matthias Morzfeldand Xuemin Tu
    Communications in Applied Mathematics and Computational Science IMPLICIT PARTICLE FILTERS FOR DATA ASSIMILATION ALEXANDRE CHORIN, MATTHIAS MORZFELD AND XUEMIN TU vol. 5 no. 2 2010 mathematical sciences publishers COMM. APP. MATH. AND COMP. SCI. Vol. 5, No. 2, 2010 IMPLICIT PARTICLE FILTERS FOR DATA ASSIMILATION ALEXANDRE CHORIN, MATTHIAS MORZFELD AND XUEMIN TU Implicit particle filters for data assimilation update the particles by first choosing probabilities and then looking for particle locations that assume them, guiding the particles one by one to the high probability domain. We provide a detailed description of these filters, with illustrative examples, together with new, more general, methods for solving the algebraic equations and with a new algorithm for parameter identification. 1. Introduction There are many problems in science, for example in meteorology and economics, in which the state of a system must be identified from an uncertain equation supplemented by noisy data (see, for instance,[9; 22]). A natural model of this situation consists of an Ito stochastic differential equation (SDE): dx D f .x; t/ dt C g.x; t/ dw; (1) where x D .x1; x2;:::; xm/ is an m-dimensional vector, f is an m-dimensional vector function, g.x; t/ is an m by m matrix, and w is Brownian motion which encapsulates all the uncertainty in the model. In the present paper we assume for simplicity that the matrix g.x; t/ is diagonal. The initial state x.0/ is given and may be random as well. The SDE is supplemented by measurements bn at times tn, n D 0; 1;::: .
    [Show full text]
  • Convergence in the Max Norm Elbridge Gerry Puckett
    Communications in Applied Mathematics and Computational Science ON THE SECOND-ORDER ACCURACY OF VOLUME-OF-FLUID INTERFACE RECONSTRUCTION ALGORITHMS: CONVERGENCE IN THE MAX NORM ELBRIDGE GERRY PUCKETT vol. 5 no. 1 2010 mathematical sciences publishers COMM. APP. MATH. AND COMP. SCI. Vol. 5, No. 1, 2010 ON THE SECOND-ORDER ACCURACY OF VOLUME-OF-FLUID INTERFACE RECONSTRUCTION ALGORITHMS: CONVERGENCE IN THE MAX NORM ELBRIDGE GERRY PUCKETT Given a two times differentiable curve in the plane, I prove that — using only the volume fractions associated with the curve — one can construct a piecewise linear approximation that is second-order in the max norm. I derive two parame- ters that depend only on the grid size and the curvature of the curve, respectively. When the maximum curvature in the 3 by 3 block of cells centered on a cell through which the curve passes is less than the first parameter, the approxima- tion in that cell will be second-order. Conversely, if the grid size in this block is greater than the second parameter, the approximation in the center cell can be less than second-order. Thus, this parameter provides an a priori test for when the interface is under-resolved, so that when the interface reconstruction method is coupled to an adaptive mesh refinement algorithm, this parameter may be used to determine when to locally increase the resolution of the grid. 1. Introduction In this article I study the interface reconstruction problem for a volume-of-fluid method in two space dimensions. Let 2 R2 denote a simply connected domain and let z.s/ D .x.s/; y.s//, where s is arc length, denote a curve in .
    [Show full text]
  • MAA FOCUS October 2008
    MAA FOCUS October 2008 MAA FOCUS is published by the Mathematical Association of America in January, February, March, April, May/June, MAA FOCUS August/September, October, November, and December. Volume 28 Issue 7 Editor: Fernando Gouvêa, Colby College; [email protected] Managing Editor: Carol Baxter, MAA Inside [email protected] 4 ‘I can wear a math hat and a computer science hat’ Senior Writer: Harry Waldman, MAA An Interview with Margaret Wright [email protected] By Ivars Peterson Please address advertising inquiries to: [email protected] 6 Financial Information for Members is Now on the MAA Web Site By John W. Kenelly President: Joseph Gallian First Vice President: Elizabeth Mayfield, 7 It’s All About MAQ Second Vice President: Daniel J. Teague, By Kay Weiss Secretary: Martha J. Siegel, Associate Secretary: James J. Tattersall, Treasurer: 9 Letters to the Editor John W. Kenelly Executive Director: Tina H. Straley 10 Consternation and Exhilaration Director of Publications for Journals and Early Experiences in Conducting Undergraduate Research Communications: Ivars Peterson By Robin Blankenship Donald MAA FOCUS Editorial Board: 12 MathFest 2008 in Pictures J. Albers; Robert Bradley; Joseph Gallian; Jacqueline Giles; Colm Mulcahy; Michael Orrison; Peter Renz; Sharon Cutler Ross; An- 14 Report of the Secretary nie Selden; Hortensia Soto-Johnson; Peter By Martha J. Siegel Stanek; Ravi Vakil. 16 Renowned Mathematician Oded Schramm Dies in Fall Letters to the editor should be addressed to Fernando Gouvêa, Colby College, Dept. of Mathematics, Waterville, ME 04901, or by 17 In Memoriam email to [email protected]. Subscription and membership questions . should be directed to the MAA Customer 18 Joint Mathematics Meetings Service Center, 800-331-1622; email: [email protected]; (301) 617-7800 (outside U.S.
    [Show full text]
  • Lecture Notes on the Fermi-Pasta-Ulam-Tsingou Problem
    Lecture Notes on the Fermi-Pasta-Ulam-Tsingou Problem Andrew Larkoski November 9, 2016 Because this is a short week, we're going to just discuss some fun aspects of computational physics. Also, because last week's topic was the final homework (due the following Friday), just sit back and relax and forget about everything you have to do. Just kidding. Today, I'm going to discuss the Fermi-Pasta-Ulam-Tsingou (FPUT), problem. Actually, Laura Freeman did her thesis on this topic at Reed in 2008; you can pick up her thesis in the lounge or on the Reed Senior Thesis digital collections if you are interested. Laura actually interviewed Mary Tsingou for her thesis, so this is actually a fascinating historical document. In the early 1950's, Enrico Fermi, John Pasta, Stanislaw Ulam, and Mary Tsingou per- formed some of the earliest computer simulations on the MANIAC system at Los Alamos. (Remember MANIAC? Metropolis was the leader!) Their problem was very simple, but their results profound. They attempted to simulate a non-linear harmonic oscillator (i.e., spring) on a grid. Recall that Newton's equations for a spring on a grid is: mx¨j = k(xj+1 − 2xj + xj−1) ; (1) which is just a linear problem and so normal modes and eigenfrequencies can be found exactly, etc. The grid spacing is ∆x and so position xj is at xj = j∆x : (2) The problem that FPUT studied was slightly different, modified by non-linearities in x: mx¨j = k(xj+1 − 2xj + xj−1)[1 + α(xj+1 − xj−1)] : (3) When α = 0, this of course returns the linear system, but for α 6= 0 it is non-linear.
    [Show full text]
  • Institute for the Future, Mello Park, Calif: SPONS AGENCY ? National
    ;10 DOCUMENT RESUME AP ED 110' 011 IR 002 279 AUTHOR Amara, Roy TITLE. Toward Understanding, ,the Socialfmpactof Computers. IFF Report R-29. INSTITUTION 'Institute for the Future, MeLlo Park, Calif: SPONS AGENCY ?National Science Foundation, Washington, D.C. , . 'PUB DATE- ° May 74 . NOTE 141p. j 'AVA'ILABLE FROM Institute for the Future, 2740 Sand Hill Road, Menlo i Park, California 94015 (f10.00) 1.. / . EDRS PRICE MF-$0.76 PLUSATAGE,HC Not Available from EDRS. DESCRIPTORS" Adult Education; *Attitudes;. Computer"Pnograms; *Computers; Computer Science Education; Conference Reports;. Decision Makin Electronic Data Processing; Financial Policy; *,Future (of Society); Puplic Opinion; Scientific Literac .Simulation; Sodial . Attitudes; *Social Change; T_c ological Advancement; *Values 'IDENTIFIERS Computer Literacy; /FP; *Inttitute FOr The Future ABSTRACT r- Summaries of four,. workshops sponsored by the Institute For The Future' (IFF) are presented. Each'focuses on a ,particular aspect'of:the social impact of.computers:(1) computer models and simulatiohs Is aids to decision making;(2) the usd of computers in financitl'operations; 13) perceptions,attitudes, and literacy regarding computers knowledge about the capabilitirs ' and limitation's of computers in meeting humanneeds).; and (4) .individual access to domp ters. Workshop participants and e IFF * staff conclude that there is a need for. th to acqu re a deeper.understanding of 'how computers of ct the decisions individuals and organizations make, -the goods and services they produce, and tfleirorld that individual,perceive. It is also concluded that such improved understan ing must be acquiredin the near future. A programof education p the public 'is lyen propost4.... (Author/DGC) a v .4 , .
    [Show full text]
  • Mathematical Sciences Meetings and Conferences Section
    page 1349 Calendar of AMS Meetings and Conferences Thla calandar lists all meetings which have been approved prior to Mathematical Society in the issue corresponding to that of the Notices the date this issue of Notices was sent to the press. The summer which contains the program of the meeting, insofar as is possible. and annual meetings are joint meetings of the Mathematical Associ­ Abstracts should be submitted on special forms which are available in ation of America and the American Mathematical Society. The meet­ many departments of mathematics and from the headquarters office ing dates which fall rather far in the future are subject to change; this of the Society. Abstracts of papers to be presented at the meeting is particularly true of meetings to which no numbers have been as­ must be received at the headquarters of the Society in Providence, signed. Programs of the meetings will appear in the issues indicated Rhode Island, on or before the deadline given below for the meet­ below. First and supplementary announcements of the meetings will ing. Note that the deadline for abstracts for consideration for pre­ have appeared in earlier issues. sentation at special sessions is usually three weeks earlier than that Abatracta of papara presented at a meeting of the Society are pub­ specified below. For additional information, consult the meeting an­ lished in the journal Abstracts of papers presented to the American nouncements and the list of organizers of special sessions. Meetings Abstract Program Meeting# Date Place Deadline Issue
    [Show full text]