DOE/SC-0188 6th Annual Earth System Grid Federation Face-to-Face Conference December 5–9, 2016 Washington, D.C. Convened by U.S. Department of Energy (DOE) U.S. National Aeronautics and Space Administration (NASA) U.S. National Oceanic and Atmospheric Administration (NOAA) U.S. National Science Foundation (NSF) Infrastructure for the European Network for Earth System Modelling (IS-ENES) National Computational Infrastructure (NCI) Australia Workshop and Report Organizers Dean N. Williams (Chair; DOE Lawrence Livermore National Laboratory) Michael Lautenschlager (Co-Chair; German Climate Computing Centre) Sébastien Denvil (Institut Pierre-Simon Laplace) Luca Cinquini (NASA Jet Propulsion Laboratory) Robert Ferraro (NASA Jet Propulsion Laboratory) Daniel Duffy (NASA Goddard Space Flight Center) Ben Evans (NCI) Claire Trenham (NCI) ESGF Steering Committee Justin (Jay) Hnilo (DOE, U.S.) Sylvie Joussaume (IS-ENES2, Europe) Tsengdar Lee (NASA, U.S.) Ben Evans (NCI, Australia) Dean N. Williams (DOE, U.S.; Ex-officio member) This document was prepared as an account of work sponsored by an agency of the United States government. Neither the United States government nor Lawrence Livermore National Security, LLC, nor any of their employees makes any warranty, expressed or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States government or Lawrence Livermore National Security, LLC. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States government or Lawrence Livermore National Security, LLC, and shall not be used for advertising or product endorsement purposes. Lawrence Livermore National Laboratory is operated by Lawrence Livermore National Security, LLC, for the U.S. Department of Energy, National Nuclear Security Administration under Contract DE-AC52-07NA27344. Suggested citation for this report: U.S. DOE. 2017. 6th Annual Earth System Grid Federation Face-to-Face Conference Report. DOE/SC-0188. U.S. Department of Energy Office of Science. DOE/SC-0188 6th Annual Earth System Grid Federation Face-to-Face Conference Report December 5–9, 2016 Washington, D.C. Publication Date: February 2017 U.S. Department of Energy Office of Science U.S. National Aeronautics and Space Administration U.S. National Oceanic and Atmospheric Administration U.S. National Science Foundation Infrastructure for the European Network for Earth System Modelling National Computational Infrastructure Australia December 2016 6th Annual ESGF Face-to-Face Conference i Earth System Grid Federation ii 6th Annual ESGF Face-to-Face Conference December 2016 Contents Preface by ESGF Executive Committee Chair ....................................................................................................................v Executive Summary ..............................................................................................................................................................ix 1. Stakeholders’ Summary by Steering Committee .........................................................................................................1 2. User Survey Results (2016) ...............................................................................................................................................3 3. Usage Demographics (2016) ......................................................................................................................................... 11 3.1 Statistics Overview.................................................................................................................................................................................................11 3.2 Registered Users and Downloads by Project ...............................................................................................................................................12 3.3 Downloads by Continent ....................................................................................................................................................................................12 3.4 Registered Users by Continent ..........................................................................................................................................................................12 3.5 Registered Users by Site .......................................................................................................................................................................................12 4. Conference Findings ....................................................................................................................................................... 17 4.1 CMIP6 Data Archive ...............................................................................................................................................................................................17 4.2 CMIP6 Tier 1 Node ..................................................................................................................................................................................................17 4.3 CMIP6 Tier 2 Node ..................................................................................................................................................................................................17 4.4 Software Security ...................................................................................................................................................................................................17 4.5 Server-Side Computing ........................................................................................................................................................................................18 4.6 Provenance Capture ..............................................................................................................................................................................................19 4.7 Search and Metadata ............................................................................................................................................................................................19 4.8 Metrics ........................................................................................................................................................................................................................20 4.9 Survey .........................................................................................................................................................................................................................20 4.10 Modularity ..............................................................................................................................................................................................................20 4.11 Installation ..............................................................................................................................................................................................................21 4.12 Container Software .............................................................................................................................................................................................21 4.13 Data Replication and Test Federation ...........................................................................................................................................................21 4.14 Network ...................................................................................................................................................................................................................22 4.15 Persistent Identifiers for Data Identification ..............................................................................................................................................23 4.16 Digital Object Identifiers ...................................................................................................................................................................................24 4.17 Training and Documentation ..........................................................................................................................................................................24 5. Scientific Challenges and Motivating Use Cases ....................................................................................................... 25 5.1 Open Science Cloud Challenge .........................................................................................................................................................................25 5.2 Data Challenge ........................................................................................................................................................................................................25 5.3 Data Integration Challenge ................................................................................................................................................................................25 5.4 Computational Environment