Earth Science Data and Information System (ESDIS) Project Update

October 15-16, 2008

National Snow and Ice Data Center & Physical Oceanography DAAC User Working Group Meeting Pasadena, CA

Jeanne.Behnke@nasa.gov ESDIS Project Code 423 NASA GSFC Topics

•• ESDISESDIS OrganizationOrganization •• SystemSystem ContextContext •• KeyKey MetricsMetrics •• DataData ArchitectureArchitecture •• KeyKey ActivitiesActivities – Data Discovery – Customer Satisfaction & Metrics – Operations Management

2 Earth Science Data and Information System (ESDIS) Project

• The ESDIS Project is responsible for the Earth Observing System Data and Information System (EOSDIS), one of the largest civilian Science Information System in the world • The EOSDIS: – Ingests, archives, processes, and distributes an unprecedented volume of science data for NASA’s flagship Earth science missions (e.g., Terra, Aqua, Aura, ICESat) – Supports unique requirements of a variety of Earth science disciplines (e.g., land, atmosphere, snow/ice, and ocean) as well as inter- disciplinary researchers, climate

This Jason sea-surface height image shows modelers, and application users sea surface height anomalies with the seasonal cycle (the effects of summer, fall, (e.g., U.S. Forest Service) winter, and spring) removed. Each image is a 10-day average of data, centered on the date – Employs state-of-the-art hardware indicated. and software technology to achieve Courtesy: NASA EOSDIS Physical 3 Oceanography DAAC required data throughput EOSDIS Manages Data For All 24 EOS Measurements

Aqua (5/02) Aura (7/04) Terra (12/99) SORCE (1/03) Trace Atmospheric Energy Albedo, Lower Surface Energy Atmospheric Surface Solar Irradiance Gases Dynamics and Budget Aerosols, Atmospheric Imaging Budget Sounders Imaging TIM, SIM, XPS Chemistry Vegetation Chemistry TES CERES MODIS CERES AMSR-E MODIS SOLSTICE HIRDLS, ACRIMSAT MISR MOPITT ASTER AIRS/AMSU/HSB (12/99) MLS, OMI Solar Output Mesosphere ACRIM Stratosphere

O3 ClO CloudSat BrO METEOR 3M ICESat (4/06) OH TRMM (12/01) trace gases QuikScat Jason (12/01) (1/03) Cloud Properties aerosols (11/97) Aerosol Trace Gases Ocean Altimetry (6/99) Ice Topography Energy Budget CPR Sea Surface Winds SAGE III Poseidon/ and Altimetry CALIPSO CERES, LIS JMR/DORIS (4/06) SeaWinds GLAS Cloud, Aerosol Properties

CALIOP Rain Rain Troposphere

O3 precursor gases, aerosols Temperature Moisture Ecosystem Dynamics Sea Evaporation Surface H O Winds 2 Volcanology Sea Ice Ocean Biology Land Land Ice and Biology Snow Cover Fire Occurrence 4 Mission & Science 04102007.ppt Earth Science Data Availability by Mission

1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014

10/1984 - 2 years planned mission life ERBS (SAGE II) ERS-1

10/1978 - 10 yrs m life NIMBUS-7 (TOMS I) EOSDIS, Meteor 3 TOMS (TOMS II) operational UARS TOPEX/Poseidon since August JERS-1 1994, OrbView-2 (SeaStar) ERS-2 preserves Earth Probe TOMS (TOMS III) earth science RadarSat 1 data and Heritage Missions ADEOS I early failure TRMM CERES data only products EOS Era Missions Landsat 7 Transition to USGS from heritage QuikSCAT Terra missions as KEY ACRIMSAT well as EOS Science Data Available Jason-1 Planned Mission Life Meteor 3M (SAGE III) missions, Extended Mission Life GRACE 4 year Data Access Period ensuring long requirement Aqua early failure term data Post Mission Estimate ADEOS II No Planned EOL ICESat records April 2007 NASA Earth SORCE Science Senior Review Aura 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 5 Earth Science Context Diagram

Distribution, Access, Flight Operations, Science Data Processing, Data Interoperability & Data Acquisition Data Capture, Initial Data Mgmt., Data Archive Transport Reuse Processing & Backup & Distribution Tracking & to DAACs Data Relay Archive Spacecraft Satellite (TDRS) Research

Education

EOSDIS Science Data Systems Value-Added Data (DAACs) ECHO Providers Processing NASA & Mission Integrated Data Services Control Pools ACCESS W Interagency Network W Data Centers (NISN) W Mission REASoNs Ground Services Earth Stations System Models

International ACCESS Partners

Science Teams Benchmarking Measurement DSS Polar Ground Stations (SIPS) Teams

6 Technology Infusion EOSDIS Facilities

ASF DAAC Data centers, collocated with centers of science discipline SAR Products Sea Ice, Polar Processes expertise, archive and distribute standard data products produced by Science Investigator-led Processing Systems (SIPSs)

SEDAC CDDIS Human Interactions Crustal Dynamics in Global Change Solid Earth NCAR, U of Col. LP DAAC HIRDLS, MOPITT, Land Processes GSFC SORCE & Features GLAS, MODIS, GES DISC OMI, OBPG Atmos Composition & Key NSIDC DAAC Dynamics, Global OBPG Modeling, Hydrology, Cryosphere, Polar Ocean Biology & Processes Radiance Data JPL Biogeochemistry Center MLS, TES ORNL DAAC LAADS/ Biogeochemical MODAPS Dynamics, EOS Land SIPSs Validation LaRC Atmosphere CERES, San Diego SAGE III ACRIM GHRC PO.DAAC ASDC Hydrological Cycle & Radiation Budget, Ocean Circulation Severe Weather Air-Sea Interactions GHRC Clouds, Aerosols, AMSR-E, LIS Tropo Chemistry

7 Terrestrial Ecology • D. Wickland ORNL Land Earth Science & Data Systems • B. Emmanual DAAC DRAFT • W. Turner Processes DAAC Astro- physics Applied Application Scientists Applications Socioeconomic • S. Ambrose Data & Applic- Science ations Center T. Fryberger Helio- physics Physical SMD Oceanography Physical E. Weiler Research • E. Lindstrom Oceanography J. Kaye Program Scientists DAAC Earth Science Program Executive for Ocean Biology and M. Frielich Mission Operations Flight Biogeochemistry – C. Yuhas Ocean Biology Programs • P. Bontempi Processing Planetary S. Volz Group Program Executive for Earth Science Data Systems Atmospheric M. Maiden Dynamics Global • R. Kakar . Hydrology . . Resource Center . . DD 400 . 420 SAR Systems Earth Science 423 • C. Dobson Flight Earth SAR GSFC Projects Science Data and Information Data Center System (ESDIS) Project R. Strain G. Morrow G. Colon D. Lowe Upper Atmosphere 430 500 Research • K. Jucks Appl. Eng. Planetary GSFC Earth Science Data Center Sciences DISC & Science Systems Science Operations Technology Development Operations Office 440 Office D. Marinelli J. Behnke Earth Surface and Interior 600 Astro- • J. LaBrecque Crustal Sciences physics Dynamics DIS & Atmospheric Exploration . Radiation . • H. Maring Atmospheric . Cryoshpere Science Sciences . • S. Martin National Snow Data Center . and Ice Data . Center EOSDIS Products Delivered: 1996 thru Sept 2008

(in Millions)

180

160

17,263 K 140

120

100

80

60

40

20

0 FY96 FY97 FY98 FY99 FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 to date Sep 9 10 11 12 13 FY2008 Data Center Web Activity Sep 2008

ASF GESDISC LARC LPDAAC MODAPS NSIDC ORNL PODAAC

80,000

Previous Current Previous Unique Visitors 70,000 Month Month Year by Month Aug 08 Sep 08 Sep 07 60,000 Total Visitors 66,439 97,026 58,338

50,000 FY to date

Visitors Total Visitors 690,359 774,619 647,010

of 40,000 Repeat Visitors 117,519 132,315 108,372 30,000 Number

20,000

10,000

0 2 3 4 5-6 7-9 10 - 14 15 - 24 25 - 49 50 - 99 100+

FY08 Repeat Web Visitors by end of September Number of Visits 14 NASA Earth Science Interoperable Data Architecture

15 Earth Science Data Discovery

• Global Change Master Directory (GCMD) (http://gcmd.nasa.gov) – Provides a catalog ad portal for data discovery of NASA and other publicly available environmental data and services. • ECHO (EOS Clearing House) – Provides a data granule-level metadata for all NASA EOS data. – ECHO enables common searches of earth science relevant data across all NASA on-line data access systems. – XML-based structure allows more easy mapping between differing metadata formats. – Transition to the new Warehouse Inventory Search Tool (WIST) • Individual DAAC Tools • OGC Tools

• Collaboration Tools and Portals 16 - Over 17,000 metadata records - Over 1,000 worldwide data providers - Average 5 million visits per month

http://gcmd.nasa.gov/

17 ECHO Status – Holdings and Partners

• Current Holdings – Collections 2,674 – Granules 85 million – Browse 28 million • Data Partners – Operational Public: 10 – Test: 1 (GHRC) • Client Partners – Operational 3 (WIST, SNOW-I, ESA) – In evaluation or test2 (WECHO, AQUA) – Active development1 (WISRD)

18 2008 ECHO Improvements

• Synchronize TT/NCR prioritization scheme with ECS – Defect tracking & prioritization – Severity 1 escalation: are worked 24x7 until fixed for ECHO • Upgraded Support – 8:00am – 7:00pm EST Operations support – 24 Hour response time to echo@echo messages – 48 Hour notification prior to Operational planned downtime • Data Integrity fixes include better ingest validation; spatial representations fixed and enforced data rules • Performance & scalability enhancement – Ingest performance improved from 9K events/hr to 40K events/hr • Recovery & failover – Deployed a new redundant WIST system (recovery in under 15 mins) – Data corruption or system corruption recovery in under 6 hrs 19 EOSDIS ACSI Customer Satisfaction Survey

• EOSDIS sponsors an annual independent customer survey in conjunction with the American Customer Satisfaction Index (ACSI). • EOSDIS consistently exceeds the Federal Government average • Ratings in the mid to upper 70s are considered “very good” by the rating organization, the CFI Group

Federal Government 67 (Overall) 2008

NASA EOSDIS 77 2008

NASA EOSDIS 2007 75

E-Business News & Information 2008 72 (Public/Private Sectors) 20 30 40 50 60 70 80 ACSI and EOSDIS Metrics System

• ESDIS will coordinate the actions to address the 2008 ACSI survey results and determine focus areas for the next year – Work with DAACs to examine specific results and actions – Get the message out to users that we are looking at the ACSI results and have a corresponding action plan to address the key areas identified for improvement – ESDIS provides CFI Group a list of email addresses collected in the previous 12 months (37,229 in 2008; 23,827 in 2007) • CFI received 2,763 surveys in 2008 (2291 in 2007) • ESDIS will continue to develop the metrics system (EMS) – Provide opportunity to define new metrics on utilization of data documentation, data search, and data formatting services – Sponsor use of NetInsight Web tracking for finding common access patterns, guiding web page re-organization, and enabling more efficient access to data and documentation 21 Data Management Coordination

• Work to facilitate core (DAAC-SIPS) and community (MEaSURES) involvement in NASA ES data • Two meetings: system engineering & management – Upcoming focus is Data Center-SIPS interaction scheduled for November 2008 – Regular telecons – WIKI forums • Support the Earth Science Data Systems Working Group (ESDSWG) and ESIP Federation • Standards involvement - ex: HDF, Metadata,

FGDC, Process definition 22 23 Operating Budgets and Plans

• Every year DAACs and ESDIS prepare a work plan and operations budget – The work plan addresses contract tasks • ESDIS looks for activities that will improve data center operations while maintaining a high level of customer satisfaction – Budgets 5 years for input to NASA’s Program Operations Plans • FY010-16 submission prepared for NASA Science Mission Directorate Program review Apr 2009 • Annual excel spreadsheet entitled “the snowball” – Due January – February time frame – Details mission/cost-work function per fiscal year » (e.g., ops, engineering, equipment traceable to contract WBS) – Heritage from 1990’s • Current budget projection is stable (i.e., flat) – New mission data costs added as approved by ESDIS 24 ESDIS Project Contacts

• Dawn Lowe, Project Manager – [email protected] • Jeanne Behnke, Science Operations Office Manager – [email protected] • John Moses, Science Operations Office – [email protected] • Please feel free to contact any of us with suggestions or comments!

25