High Energy Physics and Nuclear Physics Network Requirements
Total Page:16
File Type:pdf, Size:1020Kb
High Energy Physics and Nuclear Physics Network Requirements HEP and NP Network Requirements Review Final Report Conducted August 20-22, 2013 ESnet Energy Sciences Network DISCLAIMER This document was prepared as an account of work sponsored by the United States Government. While this document is believed to contain correct information, neither the United States Government nor any agency thereof, nor The Regents of the University of California, nor any of their employees, makes any warranty, express or implied, or assumes any legal responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by its trade name, trademark, manufacturer, or otherwise, does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States Government or any agency thereof, or The Regents of the University of California. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States Government or any agency thereof or The Regents of the University of California. High Energy Physics and Nuclear Physics Network Requirements Offices of High Energy Physics and Nuclear Physics, DOE Office of Science Energy Sciences Network Gaithersburg, Maryland — August 20–22, 2013 ESnet is funded by the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research (ASCR). Vince Dattoria is the ESnet Program Manager. ESnet is operated by Lawrence Berkeley National Laboratory, which is operated by the University of California for the U.S. Department of Energy under contract DE-AC02-05CH11231. This work was supported by the Directors of the Office of Science, Office of Advanced Scientific Computing Research, Facilities Division, and the Offices of High Energy Physics and Nuclear Physics. This is LBNL report LBNL-6642E 3 Participants and Contributors Lothar Bauerdick, FNAL (LHC/CMS) Andy Kowalski, JLab (JLab Experiments) Greg Bell, ESnet (Networking) Jerome Lauret, BNL (RHIC/STAR) Leandro Ciuffo, RNP (Networking) Steffen Luitz, SLAC (SLAC Programs) Eli Dart, ESnet (Networking) Paul Mackenzie, FNAL (Lattice and Non- Sridhara Dasu, University of Wisconsin Lattice QCD) (LHC/CMS) Charles Maguire, Vanderbilt University Vince Dattoria, DOE/SC/ASCR (ESnet (LHC/CMS-HI) Program Manager) Joe Metzger, ESnet (Networking) Kaushik De, University of Texas at Inder Monga, ESnet (Networking) Arlington (LHC/ATLAS) Cho-Kuen Ng, SLAC (Accelerator Michael Ernst, BNL (LHC/ATLAS, RACF) Modeling) Dale Finkelson, Internet2 (Networking) Jason Nielsen, UC Santa Cruz Steven Gottlieb, Indiana University (LHC/ATLAS) (Lattice QCD) Larry Price, DOE/SC/HEP (HEP Program) Oliver Gutsche, FNAL (LHC/CMS) Jeff Porter, LBNL (LHC/ALICE) Salman Habib, ANL (Cosmic Frontier Martin Purschke, BNL (RHIC/PHENIX) Simulations) Gulshan Rai, DOE/SC/NP (NP Programs) Stefan Hoeche, SLAC (Non-Lattice QCD) Rob Roser, FNAL (Intensity Frontier Richard Hughes–Jones, DANTE Experiments) (Networking) Malachi Schram, PNNL (Belle II) Julio Ibarra, FIU (LSST) Craig Tull, LBNL (Daya Bay) Bill Johnston, ESnet (Networking) Chip Watson, JLab (JLab Experiments) Theodore Kisner, LBNL (DESI) Jason Zurawski, ESnet (Networking) Editors Eli Dart, ESnet — [email protected] Mary Hester, ESnet — [email protected] Jason Zurawski, ESnet — [email protected] 4 Table of Contents 1 Executive Summary ............................................................................................................. 6 2 Findings ............................................................................................................................... 8 3 Action Items ...................................................................................................................... 11 4 Review Background and Structure .................................................................................... 12 5 Program Perspectives........................................................................................................ 14 6 The ATLAS Experiment at the Large Hadron Collider ......................................................... 16 7 CMS Physics Analysis Case Study ...................................................................................... 43 8 Production Transfers to Support CMS Physics ................................................................... 54 9 CMS-HI Research Program ................................................................................................ 70 10 The ALICE Experiment ....................................................................................................... 84 11 The PHENIX Experiment at RHIC (BNL) ............................................................................ 100 12 The Solenoidal Tracker at RHIC (STAR) Experiment ......................................................... 105 13 RHIC Computing Facility (RCF) ......................................................................................... 131 14 Thomas Jefferson National Accelerator Facility .............................................................. 142 15 Heavy Photon Search ...................................................................................................... 152 16 Intensity Frontier Experiments at Fermilab ..................................................................... 155 17 SLAC — Participation in Current and Future off-site Experiments and Collaborations .... 161 18 Daya Bay Neutrino Experiment ....................................................................................... 164 19 Belle II Experiment .......................................................................................................... 173 20 Dark Energy Spectroscopic Instrument ........................................................................... 181 21 Large Synoptic Survey Telescope (LSST) .......................................................................... 190 22 DOE HEP Cosmic Frontier Simulations ............................................................................. 198 23 Computational Cosmology .............................................................................................. 203 24 Community Accelerator Modeling Using ACE3P .............................................................. 207 25 Lattice Gauge Theory ...................................................................................................... 211 26 Perturbative QCD and Phenomenology........................................................................... 216 27 Glossary .......................................................................................................................... 219 28 Acknowledgements ......................................................................................................... 225 5 1 Executive Summary The Energy Sciences Network (ESnet) is the primary provider of network connectivity for the U.S. Department of Energy (DOE) Office of Science (SC), the single largest supporter of basic research in the physical sciences in the United States. In support of SC programs, ESnet regularly updates and refreshes its understanding of the networking requirements needed by instruments, facilities, scientists, and science programs that it serves. This focus has helped ESnet to be a highly successful enabler of scientific discovery for over 25 years. In August 2013, ESnet and the DOE SC Offices of High Energy Physics (HEP) and Nuclear Physics (NP) organized a review to characterize the networking requirements of the programs funded by the HEP and NP program offices. Several key findings resulted from the review. Among them: 1. The Large Hadron Collider’s ATLAS (A Toroidal LHC Apparatus) and CMS (Compact Muon Solenoid) experiments are adopting remote input/output (I/O) as a core component of their data analysis infrastructure. This will significantly increase their demands on the network from both a reliability perspective and a performance perspective. 2. The Large Hadron Collider (LHC) experiments (particularly ATLAS and CMS) are working to integrate network awareness into the workflow systems that manage the large number of daily analysis jobs (1 million analysis jobs per day for ATLAS), which are an integral part of the experiments. Collaboration with networking organizations such as ESnet, and the consumption of performance data (e.g., from perfSONAR [PERformance Service Oriented Network monitoring Architecture]) are critical to the success of these efforts. 3. The international aspects of HEP and NP collaborations continue to expand. This includes the LHC experiments, the Relativistic Heavy Ion Collider (RHIC) experiments, the Belle II Collaboration, the Large Synoptic Survey Telescope (LSST), and others. The international nature of these collaborations makes them heavily reliant on transoceanic connectivity, which is subject to longer term service disruptions than terrestrial connectivity. The network engineering aspects of undersea connectivity will continue to be a significant part of the planning, deployment, and operation of the data analysis infrastructure for HEP and NP experiments for the foreseeable future. Given their critical dependency on networking services, the experiments have expressed the need for tight integration (both technically and operationally) of the domestic and the transoceanic parts of the network infrastructure that