NASA Earth Science Data Systems Program

Martha Maiden Program Executive, Earth Science Data Systems Earth Science Subcommittee November 28, 2012

NASA’s Earth Observing System Data and Information System

Manages data from several types of sources – satellite missions, aircraft investigations, PI-led dataset generation efforts Initiated in 1990 • In operation since 1994 with mature metadata for “heritage” datasets • In operation since 1997 supporting EOS instrument datasets starting with the Tropical Rainfall Measuring Mission A petabyte-scale archive of environmental data that supports global climate change research Designed to receive, process, distribute and archive several terabytes of science data per day Provides a distributed information framework supporting a broad user community Open Data Policy – Data are openly available to all and free of charge except where governed by international agreements • Consistent with Circular A-130 By having open application layers to the EOSDIS framework, we allow many other value-added services to access NASA’s vast Earth Science Collection Interoperates with data archives of other agencies and countries 2 National Aeronautics and Space Administration Earth Science Measurements

MESOSPHERE Terra • 12/99 Aqua • 5/02 SORCE • 1/03 Aura • 7/04 Energy Atmospheric Surface Solar Atmospheric Albedo, Lower Surface Sounders Trace\ Aerosols, Atmospheric Imaging Budget Imaging Irradiance Gases Composition Acrimsat • 12/99 AMSR-E MODIS HIRDLS, Energy Budget Vegetation Chemistry MODIS, CERES AIRS/AMSU/ TIM, SIM, XPS TES Solar Output CERES MISR MOPITT ASTER HSB Solstice MLS, OMI ACRIM

STRATOSPHERE CloudSat • 4/06 TRMM • 11/97 O3, CIO, BrO, OH, Rainfall GRACE • 3/02 Cloud Trace Gases, Aerosols CERES, TMI Jason • 12/01 Properties CALIPSO • 4/06 Ocean OSTM • 6/08 VIRS, PR, LIS Gravity Field CPR Cloud, Aerosol Ice Bridge • 10/09 Altimetry Ocean Altimetry Ice Poseidon 2/ GPS, KBR Properties CALIOP Poseidon 3/ Topography JMR/DORIS AMR/DORIS and Altimetry ATM Rain Rain

Temperature Moisture TROPOSPHERE O3, Precursor Gases, Aerosols

Sea Surface Ecosystem Winds Dynamics

Volcanology

Ocean Sea Ice Biology Evaporation Ocean Surface H2O Topography Land Biology Ocean Circulation Fire Occurrence Land Ice and Snow Cover

www.nasa.gov Earth Science Measurements

Applied Discipline-oriented Data Centers

ASF SDC SAR Products, Sea Ice, Polar Processes, Geophysics SEDAC Human Interactions, Land Use, Environmental LP DAAC Sustainability, Surface Geospatial Data Reflectance, Land Cover, Vegetation Indices GES DISC Global Precipitation, NSIDC DAAC Solar Irradiance, Snow and Ice, Atmospheric Composition Cryosphere, and Dynamics, Climate Inter- Global Modeling actions, Sea Ice PO.DAAC Gravity, Sea Surface Temperature, Ocean Winds, Topography, CDDIS OBPG Space Geodesy, Ocean Biology, Circulation & Currents Solid Earth Sea Surface Temperature

LaRC ASDC MODAPS/ Radiation Budget, LAADS Clouds, Aerosols, MODIS Level-1 GHRC DAAC Tropospheric and Atmosphere Hydrologic Cycle, Chemistry Data Products Severe Weather Inter- actions, Lightning, Atmospheric Convection ORNL DAAC Biogeochemical Dynamics, Ecological Data, Environmental Processes ECHO Architecture

ECHO is NASA’s middleware layer between Earth science data and users via a service-oriented architecture. Designed to improve the discovery and access of NASA data.

Developed as a part of NASA’s core data systems but fully adaptable to the needs/requirem ents of science communities.

Acts as an order broker between end users and EOSDIS Data Centers who provide metadata for their data holdings and other Earth science-related data holdings.

User-defined specialized “clients” can be easily developed to give science data users of their community access to data and services using ECHO’s open APIs.

6 EOSDIS Key Metrics

Preliminary EOSDIS FY2012 Metrics

Unique Data Products 6,986 ESDIS Project Supports Distinct Users of EOSDIS Data and Services 1.49 M Science Data Centers 12 System Web Site Visits of 1 Minute or more 1.97 M Elements SIPS 14 Average Daily Archive Growth 5.3 TB/day Interface Control 22 Total Archive Volume 6.4 PB Interfaces Documents End User Distribution Products 635 M US 10 Partnerships End User Average Daily Distribution Volume 14.8 TB/day International 6 Millions Science Data 10 700 Processing

650 Archiving and 37 600 EOSDIS Products Delivered (Millions) Missions Distribution 550 ~635,000,000 products in 2012 Instruments 500 >120X increase over 2000 Supported 87 450

400

350

300

250 More information:

200 EOSDIS: http://earthdata.nasa.gov

150

100

0 FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 FY11 FY12 to date Sep 7 Evolution of EOSDIS Elements and Continuous Evolution

EOSDIS underwent a concerted process for “Evolution” in the 2005-2008 timeframe. •Led by EOSDIS Project Manager Esfandiari, OES Program Executive Martha Maiden •Recommendations by External Advisory Panel, led by Moshe Pniel •Effort under Terms of Reference signed by Ghassem Asrar, with Implementation Plan concurred by Mary Cleave

Resultant system reduced costs 30%, Information Technology currency, closer to science needs, with capability to continuously evolve. Continuous evolution investments about 10% of Multi-Mission Ops budget, and include system and data product/quality investments. ESS reviewed the EOSDIS System at their January 2008 meeting, reserving one hour on the agenda. ESS letter February 6, 2008 was complimentary (from NASA website). • “We were impressed by the success and clear sense of direction of that program.” • “We are a long way from the EOSDIS problems of less than a decade ago!”

2015 Vision Goals Addressed

Vision Tenet Vision 2015 Goals NASA will ensure safe stewardship of the data through its lifetime. Archive Management  . The EOS archive holdings are regularly peer reviewed for scientific merit.

. Multiple data and metadata streams can be seamlessly combined. EOS Data . Research and value added communities use EOS data interoperably with other Interoperability relevant data and systems. . Processing and data are mobile.  Data access latency is no longer an impediment.  Physical location of data storage is transparent. Future Data Access  Finding data is based on common search engines. and Processing  Services invoked by machine-machine interfaces.  Custom processing provides only the data needed, the way needed.  Open interfaces and best practice standard protocols universally employed. . Mechanisms to collect and preserve the pedigree of derived data products are readily Data Pedigree available.  Data systems evolve into components that allow a fine-grained control over cost Cost Control drivers.

User Community  Expert knowledge is readily accessible to enable researchers to understand and use the data. Support  Community feedback directly to those responsible for a given system element.  Access to all EOS data through services at least as rich as any contemporary science IT Currency information system.

Feb 3, 2005  EEE 2015 Vision Goals Addressed

Vision Tenet Vision 2015 Goals NASA will ensure safe stewardship of the data through its lifetime. Archive Management  +. The EOS archive holdings are regularly peer reviewed for scientific merit. . Multiple data and metadata streams can be seamlessly combined. EOS Data . Research and value added communities use EOS data interoperably with other Interoperability relevant data and systems. +. Processing and data are mobile.  Data access latency is no longer an impediment.  Physical location of data storage is transparent. Future Data Access  Finding data is based on common search engines. and Processing  Services invoked by machine-machine interfaces.  Custom processing provides only the data needed, the way needed.  Open interfaces and best practice standard protocols universally employed. +. Mechanisms to collect and preserve the pedigree of derived data products are readily Data Pedigree available.  Data systems evolve into components that allow a fine-grained control over cost Cost Control drivers.

 EEE As of 2012 + In Progress