Earth Science Data and Information System (ESDIS) Project Update
Total Page:16
File Type:pdf, Size:1020Kb
Earth Science Data and Information System (ESDIS) Project Update October 15-16, 2008 National Snow and Ice Data Center & Physical Oceanography DAAC User Working Group Meeting Pasadena, CA [email protected] ESDIS Project Code 423 NASA GSFC Topics •• ESDISESDIS OrganizationOrganization •• SystemSystem ContextContext •• KeyKey MetricsMetrics •• DataData ArchitectureArchitecture •• KeyKey ActivitiesActivities – Data Discovery – Customer Satisfaction & Metrics – Operations Management 2 Earth Science Data and Information System (ESDIS) Project • The ESDIS Project is responsible for the Earth Observing System Data and Information System (EOSDIS), one of the largest civilian Science Information System in the world • The EOSDIS: – Ingests, archives, processes, and distributes an unprecedented volume of science data for NASA’s flagship Earth science missions (e.g., Terra, Aqua, Aura, ICESat) – Supports unique requirements of a variety of Earth science disciplines (e.g., land, atmosphere, snow/ice, and ocean) as well as inter- disciplinary researchers, climate This Jason sea-surface height image shows modelers, and application users sea surface height anomalies with the seasonal cycle (the effects of summer, fall, (e.g., U.S. Forest Service) winter, and spring) removed. Each image is a 10-day average of data, centered on the date – Employs state-of-the-art hardware indicated. and software technology to achieve Courtesy: NASA EOSDIS Physical 3 Oceanography DAAC required data throughput EOSDIS Manages Data For All 24 EOS Measurements Aqua (5/02) Aura (7/04) Terra (12/99) SORCE (1/03) Trace Atmospheric Energy Albedo, Lower Surface Energy Atmospheric Surface Solar Irradiance Gases Dynamics and Budget Aerosols, Atmospheric Imaging Budget Sounders Imaging TIM, SIM, XPS Chemistry Vegetation Chemistry TES CERES MODIS CERES AMSR-E MODIS SOLSTICE HIRDLS, ACRIMSAT MISR MOPITT ASTER AIRS/AMSU/HSB (12/99) MLS, OMI Solar Output Mesosphere ACRIM Stratosphere O3 ClO CloudSat BrO METEOR 3M ICESat (4/06) OH TRMM (12/01) trace gases QuikScat Jason (12/01) (1/03) Cloud Properties aerosols (11/97) Aerosol Trace Gases Ocean Altimetry (6/99) Ice Topography Energy Budget CPR Sea Surface Winds SAGE III Poseidon/ and Altimetry CALIPSO CERES, LIS JMR/DORIS (4/06) SeaWinds GLAS Cloud, Aerosol Properties CALIOP Rain Rain Troposphere O3 precursor gases, aerosols Temperature Moisture Ecosystem Dynamics Sea Evaporation Surface H O Winds 2 Volcanology Sea Ice Ocean Biology Land Land Ice and Biology Snow Cover Fire Occurrence 4 Mission & Science 04102007.ppt Earth Science Data Availability by Mission 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 10/1984 - 2 years planned mission life ERBS (SAGE II) ERS-1 10/1978 - 10 yrs m life NIMBUS-7 (TOMS I) EOSDIS, Meteor 3 TOMS (TOMS II) operational UARS TOPEX/Poseidon since August JERS-1 1994, OrbView-2 (SeaStar) ERS-2 preserves Earth Probe TOMS (TOMS III) earth science RadarSat 1 data and Heritage Missions ADEOS I early failure TRMM CERES data only products EOS Era Missions Landsat 7 Transition to USGS from heritage QuikSCAT Terra missions as KEY ACRIMSAT well as EOS Science Data Available Jason-1 Planned Mission Life Meteor 3M (SAGE III) missions, Extended Mission Life GRACE 4 year Data Access Period ensuring long requirement Aqua early failure term data Post Mission Estimate ADEOS II No Planned EOL ICESat records April 2007 NASA Earth SORCE Science Senior Review Aura 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 5 Earth Science Context Diagram Distribution, Access, Flight Operations, Science Data Processing, Data Interoperability & Data Acquisition Data Capture, Initial Data Mgmt., Data Archive Transport Reuse Processing & Backup & Distribution Tracking & to DAACs Data Relay Archive Spacecraft Satellite (TDRS) Research Education EOSDIS Science Data Systems Value-Added Data (DAACs) ECHO Providers Processing NASA & Mission Integrated Data Services Control Pools ACCESS W Interagency Network W Data Centers (NISN) W Mission REASoNs Ground Services Earth Stations System Models International ACCESS Partners Science Teams Benchmarking Measurement DSS Polar Ground Stations (SIPS) Teams 6 Technology Infusion EOSDIS Facilities ASF DAAC Data centers, collocated with centers of science discipline SAR Products Sea Ice, Polar Processes expertise, archive and distribute standard data products produced by Science Investigator-led Processing Systems (SIPSs) SEDAC CDDIS Human Interactions Crustal Dynamics in Global Change Solid Earth NCAR, U of Col. LP DAAC HIRDLS, MOPITT, Land Processes GSFC SORCE & Features GLAS, MODIS, GES DISC OMI, OBPG Atmos Composition & Key NSIDC DAAC Dynamics, Global OBPG Modeling, Hydrology, Cryosphere, Polar Ocean Biology & Processes Radiance Data JPL Biogeochemistry Center MLS, TES ORNL DAAC LAADS/ Biogeochemical MODAPS Dynamics, EOS Land SIPSs Validation LaRC Atmosphere CERES, San Diego SAGE III ACRIM GHRC PO.DAAC ASDC Hydrological Cycle & Radiation Budget, Ocean Circulation Severe Weather Air-Sea Interactions GHRC Clouds, Aerosols, AMSR-E, LIS Tropo Chemistry 7 Terrestrial Ecology • D. Wickland ORNL Land Earth Science & Data Systems • B. Emmanual DAAC DRAFT • W. Turner Processes DAAC Astro- physics Applied Application Scientists Applications Socioeconomic • S. Ambrose Data & Applic- Science ations Center T. Fryberger Helio- physics Physical SMD Oceanography Physical E. Weiler Research • E. Lindstrom Oceanography J. Kaye Program Scientists DAAC Earth Science Program Executive for Ocean Biology and M. Frielich Mission Operations Flight Biogeochemistry – C. Yuhas Ocean Biology Programs • P. Bontempi Processing Planetary S. Volz Group Program Executive for Earth Science Data Systems Atmospheric Dynamics M. Maiden Global • R. Kakar . Hydrology . Resource Center . DD 400 . 420 SAR Systems Earth Science 423 • C. Dobson Flight Earth SAR GSFC Projects Science Data and Information Data Center System (ESDIS) Project R. Strain G. Morrow G. Colon D. Lowe Upper Atmosphere 430 500 Research • K. Jucks Appl. Eng. Planetary GSFC Earth Science Data Center Sciences DISC & Science Systems Science Operations Technology Development Operations Office 440 Office D. Marinelli J. Behnke Earth Surface and Interior 600 Astro- • J. LaBrecque Crustal Sciences physics Dynamics DIS & Atmospheric Exploration . Radiation . • H. Maring Atmospheric . Cryoshpere Science Sciences . • S. Martin National Snow Data Center . and Ice Data . Center EOSDIS Products Delivered: 1996 thru Sept 2008 (in Millions) 180 160 17,263 K 140 120 100 80 60 40 20 0 FY96 FY97 FY98 FY99 FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 to date Sep 9 10 11 12 13 FY2008 Data Center Web Activity Sep 2008 ASF GESDISC LARC LPDAAC MODAPS NSIDC ORNL PODAAC 80,000 Previous Current Previous Unique Visitors 70,000 Month Month Year by Month Aug 08 Sep 08 Sep 07 60,000 Total Visitors 66,439 97,026 58,338 50,000 FY to date Visitors Total Visitors 690,359 774,619 647,010 of 40,000 Repeat Visitors 117,519 132,315 108,372 30,000 Number 20,000 10,000 0 2 3 4 5-6 7-9 10 - 14 15 - 24 25 - 49 50 - 99 100+ FY08 Repeat Web Visitors by end of September Number of Visits 14 NASA Earth Science Interoperable Data Architecture 15 Earth Science Data Discovery • Global Change Master Directory (GCMD) (http://gcmd.nasa.gov) – Provides a catalog ad portal for data discovery of NASA and other publicly available environmental data and services. • ECHO (EOS Clearing House) – Provides a data granule-level metadata for all NASA EOS data. – ECHO enables common searches of earth science relevant data across all NASA on-line data access systems. – XML-based structure allows more easy mapping between differing metadata formats. – Transition to the new Warehouse Inventory Search Tool (WIST) • Individual DAAC Tools • OGC Tools • Collaboration Tools and Portals 16 - Over 17,000 metadata records - Over 1,000 worldwide data providers - Average 5 million visits per month http://gcmd.nasa.gov/ 17 ECHO Status – Holdings and Partners • Current Holdings – Collections 2,674 – Granules 85 million – Browse 28 million • Data Partners – Operational Public: 10 – Test: 1 (GHRC) • Client Partners – Operational 3 (WIST, SNOW-I, ESA) – In evaluation or test2 (WECHO, AQUA) – Active development1 (WISRD) 18 2008 ECHO Improvements • Synchronize TT/NCR prioritization scheme with ECS – Defect tracking & prioritization – Severity 1 escalation: are worked 24x7 until fixed for ECHO • Upgraded Support – 8:00am – 7:00pm EST Operations support – 24 Hour response time to echo@echo messages – 48 Hour notification prior to Operational planned downtime • Data Integrity fixes include better ingest validation; spatial representations fixed and enforced data rules • Performance & scalability enhancement – Ingest performance improved from 9K events/hr to 40K events/hr • Recovery & failover – Deployed a new redundant WIST system (recovery in under 15 mins) – Data corruption or system corruption recovery in under 6 hrs 19 EOSDIS ACSI Customer Satisfaction Survey • EOSDIS sponsors an annual independent customer survey in conjunction with the American Customer Satisfaction Index (ACSI). • EOSDIS consistently exceeds the Federal Government average • Ratings in the mid to upper 70s are considered “very good” by the rating organization, the CFI Group Federal Government 67 (Overall) 2008 NASA EOSDIS 77 2008 NASA EOSDIS 2007 75 E-Business News & Information 2008 72 (Public/Private Sectors) 20 30 40 50 60 70 80 ACSI