The Community Satellite Processing Package (CSPP) for real- me data received by direct broadcast from Suomi NPP, POES, Metop, and EOS. VIIRS Day/Night Band, Hurricane Isaac, 2012/08/29
Liam E. Gumley Space Science and Engineering Center University of Wisconsin-Madison
WMO Vlab, April 9, 2014 Execu ve Summary
1. A constella on of polar orbi ng satellites provides freely available medium-resolu on data in visible, near- infrared, thermal, and microwave channels in real me. 2. Moderate cost antenna systems can receive the data in L- band or X-band; several hundred are in opera on worldwide. 3. CSPP is a so ware solu on for conver ng “raw” satellite data to calibrated sensor observa ons (e.g., reflectances) and geophysical products (e.g., cloud mask). Polar Orbi ng Satellite Fleet
• Suomi NPP (JPSS) • Terra/Aqua (NASA) • NOAA 15/16/18/19 (NOAA) • Metop-A, B (EUMETSAT) • FY-3A/B/C (CMA) • Meteor-M1 (Roshydromet) Polar Orbit About Suomi NPP Launched into a polar orbit on October 28, 2011. Developed by NASA, NOAA, and industry; operated by NOAA. Named a er Verner Suomi: Professor of Meteorology at University of Wisconsin-Madison; Founder of Space Science and Engineering Center. Suomi NPP at Ball Aerospace July 2010 Suomi NPP Sensor Suite
VIIRS – Medium Resolu on Visible & Infra-red Imager VIIRS CrIS – Fourier Transform Spectrometer for IR Temperature and Moisture sounding CrIS ATMS – Microwave sounding radiometer
OMPS – Total Ozone Mapping CERES and Ozone Profile ATMS measurements OMPS CERES - Earth Radia on Budget Real-Time Applica ons
• Numerical Weather Predic on: Infrared and Microwave Sounder Data • Wildfire Detec on for Disaster Management: Thermal Infrared Imager Data (e.g, GA Sen nel) • Sea Ice Detec on for Ship Naviga on: Day/Night Band Imager Data • Volcanic Ash Detec on: Thermal Infrared Imager Timeliness of the Data is Key NWP Forecast Error Reduc on
HyperspectralInfrared and Microwave Sounder data from polar orbi ng satellites Infrared Sounders and Advanced Microwave Sounders are the top two contributors for reducing forecast errorshave the largest impact on improving NWP forecast skill
Forecast error reduction contribution (%)
17 Wildfire Detec on
Sen nel Hotspot Detec ons Derived from MODIS Infrared Imagery Sea Ice Mapping for Naviga on
Russia
Chukchi Sea
VIIRS Day/Night Band as seen by NWS Anchorage Ice Desk Volcanic Ash Alert System
MODIS and VIIRS Infrared Imagery are used to Detect Volcanic Ash Receiving Real-Time Data
2.4-m X/L-band Antenna NWS Honolulu Hardware Required: • Tracking antenna with 2.4-3.0 meter reflector • LNA, Downconverter, Demodulator
X-band: SNPP, Terra, Aqua, FY-3 L-band: POES, Metop, Meteor-M
Output product is raw bitstream from demodulator. Worldwide X-band Sites Direct Broadcast So ware from SSEC
Interna onal ATOVS Processing Package (IAPP) heritage goes back to 1985. IAPP supports NOAA 15-19.
Interna onal MODIS/AIRS Processing Package (IMAPP) has been available since 2000 (funded by NASA). IMAPP supports Terra and Aqua.
Community Satellite Processing Package (CSPP) first released in 2012 (funded by JPSS). IMAPP MODIS TPW What is CSPP? CSPP (Community Satellite Processing Package) is a collec on of so ware systems for processing direct broadcast data from polar orbi ng meteorological satellites, including: Suomi NPP, POES, Metop, Terra, Aqua. Funded by NOAA via JPSS Project (thanks to Mitch Goldberg). Developed and supported by CIMSS/SSEC, UW-Madison. The first CSPP release occurred on March 14, 2012. Supported Satellites and Sensors CSPP includes support for Suomi NPP and JPSS, POES, Metop, Terra, Aqua, and eventually FY-3. • For Suomi NPP, supported sensors include VIIRS, CrIS, ATMS (SDRs and a subset of EDRs) • For POES and Metop, supported sensors include AVHRR, IASI, AMSU-A, MHS (Level 2 products only; Level 1 processing provided by AAPP). • For Aqua and Terra, supported sensors include MODIS and AIRS. CSPP So ware Philosophy
CSPP so ware must: • Create useful products for the DB community, • Include up-to-date algorithms, • Be pre-compiled for 64-bit Linux, • Be easy to install and operate, • Include test data for verifica on, • Have prompt user support, • Run efficiently on modest hardware. CSPP Products for Suomi NPP
• VIIRS, CrIS, and ATMS sensor observa ons and geoloca on • VIIRS Cloud Mask, Ac ve Fires, Aerosol Op cal Thickness, Sea Surface Temperature, NDVI • CrIS Temperature and Moisture profiles • VIIRS imagery (AWIPS, GeoTIFF, True Color)
Distribu on format is executable code and data (ready to run); source code is available from SSEC. Supported pla orm is CentOS 6 (64-bit) for Intel/AMD. All algorithms are based on ADL versions; the same code that runs in NESDIS opera ons.
CSPP value added for Suomi NPP
• Mul -core accelera on is available. • Op onal HDF5 internal compression, Granule aggrega on, and Mapped Quicklook images. • Ancillary data are ingested and processed automa cally. • Compiler flags are selected to provide op mized execu on speed. • Details of run- me configura on (e.g., XML files) are transparent. • Command line scripts require the name of the directory containing the input files, and nothing else. • Independent algorithms, e.g., CrIS Dual Regression Retrievals. CSPP Users
• EUMETSAT for EARS-NPP • China Na onal Satellite EUMETCast distribu on Meteorological Center • UK Met Office • Brazil INPE • Météo-France • Danish Meteorological Ins tute • CSIR South Africa • Japanese Meteorological Agency • Swedish Met Service • Norwegian Meteorological Ins tute • DWD – German Met Service • Swedish Met Ins tute • Australia Bureau of Meteorology • Kazakhstan Space Inves ga on • Taiwan Central Weather Bureau Ins tute • Belarus Na onal Academy of • UK Plymouth Marine Lab Science • Naval Research Lab • Indonesia Government Space • Vendors SeaSpace, ScanEx, SpaceTec Agency (LAPAN) and others. • German Aerospace Center • In addi on, CSPP DB products are • CONABIO Mexico being used in the US NWS in HI, • EURAC Remote Sensing Ins tute Alaska and CONUS Italy CSPP Quicklook Images
CrIS
VIIRS ATMS CSPP Product: VIIRS DNB and IR CSPP Product: VIIRS SST CSPP Product: VIIRS True Color CSPP Product: VIIRS Ac ve Fires
2012/12/10 Current CSPP So ware (2014/03)
1. Suomi NPP CrIS, VIIRS and ATMS SDR (geoloca on and calibra on)
2. Suomi NPP VIIRS EDR (cloud mask, ac ve fires, surface reflectance, NDVI, SST, aerosol op cal thickness)
3. CrIS, IASI, and AIRS Dual Regression Retrieval
4. VIIRS SDR GeoTIFF and AWIPS Reprojected Imagery
5. Microwave Integrated Retrieval System (MIRS)
6. HYDRA2 Mul spectral Data Analysis Toolkit
7. Suomi NPP Imagery EDR (projected imagery for AWIPS) CSPP Release History (2014/03)
March 21, 2014 (CSPP Suomi NPP Imagery EDR So ware Versions July 8, 2013 (CSPP Suomi NPP VIIRS EDR So ware Version 1.1) 1.1) April 29, 2013 (CSPP CrIS, AIRS and IASI Dual Regression Retrieval March 20, 2014 (CSPP Microwave Integrated Retrieval System So ware Version 1.1) (MIRS) So ware Version 1.0) February 22, 2013 (CSPP VIIRS SDR GeoTIFF and AWIPS Reprojec on March 19, 2014 (CSPP Suomi NPP HYDRA2 Mul spectral Data So ware Version 1.0) Analysis Toolkit Version 1.0) February 8, 2013 (CSPP Suomi NPP VIIRS Cloud Mask and Ac ve February 14, 2014 (CSPP Suomi NPP VIIRS EDR So ware Version Fires EDR So ware Version 1.0) 1.2.1) February 8, 2013 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR December 18, 2013 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR So ware Version 1.3) So ware Version 1.5) November 26, 2012 (CSPP CrIS, AIRS and IASI Dual Regression December 18, 2013 (CSPP Suomi NPP VIIRS EDR So ware Version Retrieval So ware Version 1.0) 1.2) October 4, 2012 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR October 18, 2013 (CSPP VIIRS SDR GeoTIFF and AWIPS Reprojec on So ware Version 1.2) So ware Version 1.1) May 4, 2012 (CSPP CrIS UW Retrieval So ware Version 1.0) September 24, 2013 (CSPP CrIS, AIRS and IASI Dual Regression Retrieval So ware Version 1.2) May 2, 2012 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR So ware Version 1.1) July 8, 2013 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR So ware Version 1.4) March 14, 2012 (CSPP Suomi NPP VIIRS and ATMS SDR So ware Version 1.0)
CSPP Website
h p://cimss.ssec.wisc.edu/cspp/ CSPP/IMAPP Users Group
• Held May 21-23, 2013 in Madison, WI, USA.
• Presenta ons from NOAA, NASA, Met Office, Meteo France, Landgate, SMHI, EUMETSAT, CONABIO, DWD, GINA, and SSEC.
• More than 40 a endees; 29 oral presenta ons.
• Next one in 2015? Perhaps in Europe? 1. SNPP VIIRS, CrIS, and ATMS SDR
• Converts RDR files (CCSDS packets) to SDR files (geoloca on and calibrated radiances and reflectances) • Based on opera onal algorithms and lookup tables (IDPS version Mx7.2) • CSPP version added features include mul -core processing, automated LUT updates, granule aggrega on, HDF5 compression. • Supports CrIS full spectral resolu on data. 2. SNPP VIIRS EDR
• Creates geophysical products from VIIRS radiances and reflectances. • Based on opera onal algorithms and lookup tables (IDPS version Mx7.2). • Products include cloud mask, ac ve fires, surface reflectance, NDVI, SST, AOT. • CSPP version added features include selectable products, mul - core processing, automated ancillary data download, granule aggrega on, HDF5 internal compression. CSPP Products from Direct Broadcast
VIIRS SDR CrIS SDR ATMS SDR
VIIRS Cloud Mask VIIRS NDVI VIIRS AOT 3. CrIS/IASI/AIRS Retrievals
• Computes profiles of atmospheric temperature, moisture, and ozone. • Computes cloud top products (height, pressure, emissivity) surface parameters. • Common fast regression algorithm for CrIS/IASI/AIRS by Smith/Weisz/Smith. • Products are created for every FOV, clear and cloudy. Retrievals from IASI and AIRS 22 May 2011, Joplin Tornado Case
“Dual-Regression Retrieval Algorithm for Real-Time Processing of Satellite Ultraspectral Radiances” William L. Smith et al, 2012, J. Appl. Meteor. Climatol., 51, 1455–1476. 4. VIIRS SDR Projected Imagery
• Creates VIIRS imagery on a user-defined grid and projec on.
• Reads mul -granule VIIRS SDRs as input (M-band, I- band, and DNB).
• Saves images in GeoTIFF and AWIPS formats.
• Used opera onally at SSEC and GINA to create products for Na onal Weather Service Forecast Offices. Low Cloud/ Fog Seen by VIIRS DNB at Night AREA FORECAST DISCUSSION NATIONAL WEATHER SERVICE SAN FRANCISCO BAY AREA 443 AM PDT FRI MAR 14 2014
.DISCUSSION...AS OF 4:10 AM PDT FRIDAY...THE DRY TAIL END OF A WEATHER SYSTEM MOVING IN TO THE PACIFIC NORTHWEST IS APPROACHING OUR DISTRICT...AND RESULTING IN ENHANCEMENT OF THE MARINE LAYER AND A RETURN OF THE MARINE STRATUS. LATEST GOES FOG PRODUCT IMAGERY...AND IN RATHER SPECTACULAR DETAIL JUST REC'D SUOMI VIIRS NIGHTTIME HIGH RES VISUAL IMAGE...SHOW COVERAGE ALONG MUCH OF THE COAST FROM PT REYES SOUTH TO THE VICINITY OF THE MONTEREY PENINSULA...AND A BROAD SWATH EXTENDING INLAND ACROSS SAN FRANCISCO AND THROUGH THE GOLDEN GATE TO THE EAST BAY. LATEST BODEGA BAY AND FT ORD PROFILER DATA INDICATE A MARINE LAYER DEPTH OF ABOUT 1300 FT. SOME THIN HIGH CLOUDS ARE ALSO PASSING THROUGH ABOVE. 5. Microwave Integrated Retrieval System
• Retrieves atmospheric profile and surface parameters from ATMS, AMSU-A, and MHS sensor SDR and Level 1B data. • Development is led by Sid Boukabara at the NOAA NESDIS Center for Satellite Applica ons and Research (STAR). • Supports ATMS SDR from CSPP or CLASS, and Metop/NOAA AMSU-A and MHS from AAPP v7. MIRS Product List
Official Validated Products: Ver cally-Integrated Graupel Water Path (IWP) Temperature profile over open water ocean Ver cally-Integrated Rain Water Path (RWP) Humidity profile over open water ocean Rainfall Rate (RR) over open water ocean and Humidity Profile over non-coastal Land non-coastal, non-snow-covered land surface types Total Precipitable Water (TPW) over open water ocean Experimental Products (not fully validated): Total Precipitable Water over non-coastal land Cloud Liquid Water Profile (CLWP) over ocean Land surface temperature Surface Temperature (skin) extended to snow- Surface Emissivity over land and snow covered land surface type Surface Type Classifica on Surface Temperature (skin) extended to open ocean water Snow Water Equivalent (SWE) Effec ve grain size of snow (over snow-covered Sea Ice Concentra on (SIC) land surface) Snow Cover Extent (SCE) Mul -Year (MY) Type Sea Ice Concentra on Ver cally-Integrated Non-precipita ng Cloud First-Year (FY) Type Sea Ice Concentra on Liquid Water (CLW) over open water ocean MIRS Products from ATMS DB Surface Temperature Total Precipitable Water with Rain Mass Profile with contours of Cloud Liquid Water
SNPP/ATMS 2014-01-23 18:19Z 6. Hydra2 Mul spectral Data Toolkit
• Allows interac ve display of Level 1B and Level 2 products from mul spectral imagers (VIIRS, MODIS), high spectral resolu on sounders (CrIS, IASI, AIRS), and microwave sounders (ATMS, AMSU). • Designed to be easy to learn and use, especially for students. • Supported on Windows, OS X, and Linux. Hydra2 Screenshots
FigureHydra 2 display of collocated VIIRS and ATMS 8b: (Top left) Transect display comparing VIIRS IR window with ATMS microwave window brightness temperatures. (Top right) ATMS measured spectra from 23.8 to 183 GHz for two cursor locations. (Bottom left) VIIRS brightness temperatures measured in the infrared window at 10.8 m (M15) with the transect location superimposed. (Bottom right) Co-located ATMS brightness temperatures measured in the microwave window at 23.8 GHz with the transect location superimposed.
Hydra 2 display of CrIS
Figure 6a: HYDRA2 display of CrIS data over Asia-Oceania on 30 August 2012 showing spectra (top) and long wave (902 cm-1) infrared window image (bottom). Brightness temperature spectra from 650 to 2550 cm-1 are measured by CrIS over the pixel in the Sea of Japan (marked by the turquoise cross and shown in the turquoise spectra) and over the nearby pixel in the high clouds (marked by the red cross and shown in the white spectra). Straight lines in the spectra cover the spectral gaps in the CrIS measurements. Sea of Japan brightness temperatures in the infrared window regions are near 290 K while the cloud top temperatures are about 225 K. 7. VIIRS Imagery EDR
• Creates projected VIIRS image data on a Ground Track Mercator grid. • Product can be directly ingested into NWS AWIPS2. • Supports I-band resolu on (375 meters). • Provides VIIRS Near Constant Contrast (NCC) product for Day/Night Band. VIIRS Imagery EDR: Band I-1 VIIRS Imagery EDR: Band I-3 Coming Soon #1: CLAVR-X
• Computes cloud parameters (cloud top height, pressure, phase, …) and surface parameters from mul spectral imager data. • Development led by Andy Heidinger. • Supports VIIRS, MODIS, and AVHRR. – VIIRS SDRs from CSPP or IDPS/CLASS – MODIS Level 1B from SeaDAS or MODAPS – AVHRR Level 1B from AAPP v7 • NOAA plans to make CLAVR-X the opera onal cloud algorithm for SNPP and JPSS. CLAVR-X products from VIIRS DB
VIIRS SVM07 Cloud Mask
Cloud Phase Cloud Top Pressure CLAVR-X AVHRR Cloud Top Temperature
NOAA-19, 2013/07/25 Coming Soon #2: NUCAPS
• Creates profiles of temperature, moisture, ozone, and other trace gases; cloud and surface products; and other products all from cloud cleared radiances. • Development led by Chris Barnet. • Also supports IASI/AMSU/MHS and AIRS/AMSU. • NOAA plans to make NUCAPS the opera onal sounding
algorithm for SNPP and JPSS. Coming Soon #3: CSPP GEO • NOAA GOES-R Project is funding the development of a DB package for GEO satellites. • Will create cloud and surface products from DB data (e.g., GRB from GOES-R). • Supported satellites/sensors will include GOES-R ABI, GOES-N Imager, and Himawari-8. • Algorithms will be based on GOES-R versions; implemented in GEOCAT. Coming Soon #4: Flood Detec on
• JPSS is funding the transi on of the GMU Flood Detec on algorithm to CSPP. • The algorithm uses reflected solar spectral tests to infer the presence of non-normal standing water (day me only). • Both VIIRS and MODIS products are supported. 52 Flood Detec on: Amur River Google Earth Base Imagery
53 MODIS False Color 2013/09/08
54 Flood Detec on Mask 2013/09/08
55 SNPP VIIRS True Color Imagery in KML Credits CSPP team at UW/SSEC/CIMSS. Algorithm Developers. JPSS Project. DB User Community!