The Community Satellite Processing Package (CSPP) for real-me data received by direct broadcast from Suomi NPP, POES, Metop, and EOS. VIIRS Day/Night Band, Hurricane Isaac, 2012/08/29

Liam E. Gumley Space Science and Engineering Center University of Wisconsin-Madison

WMO Vlab, April 9, 2014 Execuve Summary

1. A constellaon of polar orbing satellites provides freely available medium-resoluon data in visible, near- infrared, thermal, and microwave channels in real me. 2. Moderate cost antenna systems can receive the data in L- band or X-band; several hundred are in operaon worldwide. 3. CSPP is a soware soluon for converng “raw” satellite data to calibrated sensor observaons (e.g., reflectances) and geophysical products (e.g., cloud mask). Polar Orbing Satellite Fleet

• Suomi NPP (JPSS) • Terra/Aqua (NASA) • NOAA 15/16/18/19 (NOAA) • Metop-A, B (EUMETSAT) • FY-3A/B/C (CMA) • Meteor-M1 (Roshydromet) Polar Orbit About Suomi NPP Launched into a polar orbit on October 28, 2011. Developed by NASA, NOAA, and industry; operated by NOAA. Named aer Verner Suomi: Professor of at University of Wisconsin-Madison; Founder of Space Science and Engineering Center. Suomi NPP at Ball Aerospace July 2010 Suomi NPP Sensor Suite

VIIRS – Medium Resoluon Visible & Infra-red Imager VIIRS CrIS – Fourier Transform Spectrometer for IR Temperature and Moisture sounding CrIS ATMS – Microwave sounding radiometer

OMPS – Total Ozone Mapping CERES and Ozone Profile ATMS measurements OMPS CERES - Earth Radiaon Budget Real-Time Applicaons

• Numerical Weather Predicon: Infrared and Microwave Sounder Data • Wildfire Detecon for Disaster Management: Thermal Infrared Imager Data (e.g, GA Sennel) • Sea Ice Detecon for Ship Navigaon: Day/Night Band Imager Data • Volcanic Ash Detecon: Thermal Infrared Imager Timeliness of the Data is Key NWP Forecast Error Reducon

HyperspectralInfrared and Microwave Sounder data from polar orbing satellites Infrared Sounders and Advanced Microwave Sounders are the top two contributors for reducing forecast errorshave the largest impact on improving NWP forecast skill

Forecast error reduction contribution (%)

17 Wildfire Detecon

Sennel Hotspot Detecons Derived from MODIS Infrared Imagery Sea Ice Mapping for Navigaon

Russia

Chukchi Sea

VIIRS Day/Night Band as seen by NWS Anchorage Ice Desk Volcanic Ash Alert System

MODIS and VIIRS Infrared Imagery are used to Detect Volcanic Ash Receiving Real-Time Data

2.4-m X/L-band Antenna NWS Honolulu Hardware Required: • Tracking antenna with 2.4-3.0 meter reflector • LNA, Downconverter, Demodulator

X-band: SNPP, Terra, Aqua, FY-3 L-band: POES, Metop, Meteor-M

Output product is raw bitstream from demodulator. Worldwide X-band Sites Direct Broadcast Soware from SSEC

Internaonal ATOVS Processing Package (IAPP) heritage goes back to 1985. IAPP supports NOAA 15-19.

Internaonal MODIS/AIRS Processing Package (IMAPP) has been available since 2000 (funded by NASA). IMAPP supports Terra and Aqua.

Community Satellite Processing Package (CSPP) first released in 2012 (funded by JPSS). IMAPP MODIS TPW What is CSPP? CSPP (Community Satellite Processing Package) is a collecon of soware systems for processing direct broadcast data from polar orbing meteorological satellites, including: Suomi NPP, POES, Metop, Terra, Aqua. Funded by NOAA via JPSS Project (thanks to Mitch Goldberg). Developed and supported by CIMSS/SSEC, UW-Madison. The first CSPP release occurred on March 14, 2012. Supported Satellites and Sensors CSPP includes support for Suomi NPP and JPSS, POES, Metop, Terra, Aqua, and eventually FY-3. • For Suomi NPP, supported sensors include VIIRS, CrIS, ATMS (SDRs and a subset of EDRs) • For POES and Metop, supported sensors include AVHRR, IASI, AMSU-A, MHS (Level 2 products only; Level 1 processing provided by AAPP). • For Aqua and Terra, supported sensors include MODIS and AIRS. CSPP Soware Philosophy

CSPP soware must: • Create useful products for the DB community, • Include up-to-date algorithms, • Be pre-compiled for 64-bit Linux, • Be easy to install and operate, • Include test data for verificaon, • Have prompt user support, • Run efficiently on modest hardware. CSPP Products for Suomi NPP

• VIIRS, CrIS, and ATMS sensor observaons and geolocaon • VIIRS Cloud Mask, Acve Fires, Aerosol Opcal Thickness, Sea Surface Temperature, NDVI • CrIS Temperature and Moisture profiles • VIIRS imagery (AWIPS, GeoTIFF, True Color)

Distribuon format is executable code and data (ready to run); source code is available from SSEC. Supported plaorm is CentOS 6 (64-bit) for Intel/AMD. All algorithms are based on ADL versions; the same code that runs in NESDIS operaons.

CSPP value added for Suomi NPP

• Mul-core acceleraon is available. • Oponal HDF5 internal compression, Granule aggregaon, and Mapped Quicklook images. • Ancillary data are ingested and processed automacally. • Compiler flags are selected to provide opmized execuon speed. • Details of run-me configuraon (e.g., XML files) are transparent. • Command line scripts require the name of the directory containing the input files, and nothing else. • Independent algorithms, e.g., CrIS Dual Regression Retrievals. CSPP Users

• EUMETSAT for EARS-NPP • China Naonal Satellite EUMETCast distribuon Meteorological Center • UK Met Office • Brazil INPE • Météo-France • Danish Meteorological Instute • CSIR South Africa • Japanese Meteorological Agency • Swedish Met Service • Norwegian Meteorological Instute • DWD – German Met Service • Swedish Met Instute • Australia • Kazakhstan Space Invesgaon • Central Weather Bureau Instute • Belarus Naonal Academy of • UK Plymouth Marine Lab Science • Naval Research Lab • Indonesia Government Space • Vendors SeaSpace, ScanEx, SpaceTec Agency (LAPAN) and others. • German Aerospace Center • In addion, CSPP DB products are • CONABIO Mexico being used in the US NWS in HI, • EURAC Remote Sensing Instute Alaska and CONUS Italy CSPP Quicklook Images

CrIS

VIIRS ATMS CSPP Product: VIIRS DNB and IR CSPP Product: VIIRS SST CSPP Product: VIIRS True Color CSPP Product: VIIRS Acve Fires

2012/12/10 Current CSPP Soware (2014/03)

1. Suomi NPP CrIS, VIIRS and ATMS SDR (geolocaon and calibraon)

2. Suomi NPP VIIRS EDR (cloud mask, acve fires, surface reflectance, NDVI, SST, aerosol opcal thickness)

3. CrIS, IASI, and AIRS Dual Regression Retrieval

4. VIIRS SDR GeoTIFF and AWIPS Reprojected Imagery

5. Microwave Integrated Retrieval System (MIRS)

6. HYDRA2 Mulspectral Data Analysis Toolkit

7. Suomi NPP Imagery EDR (projected imagery for AWIPS) CSPP Release History (2014/03)

March 21, 2014 (CSPP Suomi NPP Imagery EDR Soware Versions July 8, 2013 (CSPP Suomi NPP VIIRS EDR Soware Version 1.1) 1.1) April 29, 2013 (CSPP CrIS, AIRS and IASI Dual Regression Retrieval March 20, 2014 (CSPP Microwave Integrated Retrieval System Soware Version 1.1) (MIRS) Soware Version 1.0) February 22, 2013 (CSPP VIIRS SDR GeoTIFF and AWIPS Reprojecon March 19, 2014 (CSPP Suomi NPP HYDRA2 Mulspectral Data Soware Version 1.0) Analysis Toolkit Version 1.0) February 8, 2013 (CSPP Suomi NPP VIIRS Cloud Mask and Acve February 14, 2014 (CSPP Suomi NPP VIIRS EDR Soware Version Fires EDR Soware Version 1.0) 1.2.1) February 8, 2013 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR December 18, 2013 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR Soware Version 1.3) Soware Version 1.5) November 26, 2012 (CSPP CrIS, AIRS and IASI Dual Regression December 18, 2013 (CSPP Suomi NPP VIIRS EDR Soware Version Retrieval Soware Version 1.0) 1.2) October 4, 2012 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR October 18, 2013 (CSPP VIIRS SDR GeoTIFF and AWIPS Reprojecon Soware Version 1.2) Soware Version 1.1) May 4, 2012 (CSPP CrIS UW Retrieval Soware Version 1.0) September 24, 2013 (CSPP CrIS, AIRS and IASI Dual Regression Retrieval Soware Version 1.2) May 2, 2012 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR Soware Version 1.1) July 8, 2013 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR Soware Version 1.4) March 14, 2012 (CSPP Suomi NPP VIIRS and ATMS SDR Soware Version 1.0)

CSPP Website

hp://cimss.ssec.wisc.edu/cspp/ CSPP/IMAPP Users Group

• Held May 21-23, 2013 in Madison, WI, USA.

• Presentaons from NOAA, NASA, Met Office, Meteo France, Landgate, SMHI, EUMETSAT, CONABIO, DWD, GINA, and SSEC.

• More than 40 aendees; 29 oral presentaons.

• Next one in 2015? Perhaps in Europe? 1. SNPP VIIRS, CrIS, and ATMS SDR

• Converts RDR files (CCSDS packets) to SDR files (geolocaon and calibrated radiances and reflectances) • Based on operaonal algorithms and lookup tables (IDPS version Mx7.2) • CSPP version added features include mul-core processing, automated LUT updates, granule aggregaon, HDF5 compression. • Supports CrIS full spectral resoluon data. 2. SNPP VIIRS EDR

• Creates geophysical products from VIIRS radiances and reflectances. • Based on operaonal algorithms and lookup tables (IDPS version Mx7.2). • Products include cloud mask, acve fires, surface reflectance, NDVI, SST, AOT. • CSPP version added features include selectable products, mul- core processing, automated ancillary data download, granule aggregaon, HDF5 internal compression. CSPP Products from Direct Broadcast

VIIRS SDR CrIS SDR ATMS SDR

VIIRS Cloud Mask VIIRS NDVI VIIRS AOT 3. CrIS/IASI/AIRS Retrievals

• Computes profiles of atmospheric temperature, moisture, and ozone. • Computes cloud top products (height, pressure, emissivity) surface parameters. • Common fast regression algorithm for CrIS/IASI/AIRS by Smith/Weisz/Smith. • Products are created for every FOV, clear and cloudy. Retrievals from IASI and AIRS 22 May 2011, Joplin Tornado Case

“Dual-Regression Retrieval Algorithm for Real-Time Processing of Satellite Ultraspectral Radiances” William L. Smith et al, 2012, J. Appl. Meteor. Climatol., 51, 1455–1476. 4. VIIRS SDR Projected Imagery

• Creates VIIRS imagery on a user-defined grid and projecon.

• Reads mul-granule VIIRS SDRs as input (M-band, I- band, and DNB).

• Saves images in GeoTIFF and AWIPS formats.

• Used operaonally at SSEC and GINA to create products for Naonal Weather Service Forecast Offices. Low Cloud/ Fog Seen by VIIRS DNB at Night AREA FORECAST DISCUSSION SAN FRANCISCO BAY AREA 443 AM PDT FRI MAR 14 2014

.DISCUSSION...AS OF 4:10 AM PDT FRIDAY...THE DRY TAIL END OF A WEATHER SYSTEM MOVING IN TO THE PACIFIC NORTHWEST IS APPROACHING OUR DISTRICT...AND RESULTING IN ENHANCEMENT OF THE MARINE LAYER AND A RETURN OF THE MARINE STRATUS. LATEST GOES FOG PRODUCT IMAGERY...AND IN RATHER SPECTACULAR DETAIL JUST REC'D SUOMI VIIRS NIGHTTIME HIGH RES VISUAL IMAGE...SHOW COVERAGE ALONG MUCH OF THE COAST FROM PT REYES SOUTH TO THE VICINITY OF THE MONTEREY PENINSULA...AND A BROAD SWATH EXTENDING INLAND ACROSS SAN FRANCISCO AND THROUGH THE GOLDEN GATE TO THE EAST BAY. LATEST BODEGA BAY AND FT ORD PROFILER DATA INDICATE A MARINE LAYER DEPTH OF ABOUT 1300 FT. SOME THIN HIGH CLOUDS ARE ALSO PASSING THROUGH ABOVE. 5. Microwave Integrated Retrieval System

• Retrieves atmospheric profile and surface parameters from ATMS, AMSU-A, and MHS sensor SDR and Level 1B data. • Development is led by Sid Boukabara at the NOAA NESDIS Center for Satellite Applicaons and Research (STAR). • Supports ATMS SDR from CSPP or CLASS, and Metop/NOAA AMSU-A and MHS from AAPP v7. MIRS Product List

Official Validated Products: Vercally-Integrated Graupel Water Path (IWP) Temperature profile over open water ocean Vercally-Integrated Rain Water Path (RWP) Humidity profile over open water ocean Rainfall Rate (RR) over open water ocean and Humidity Profile over non-coastal Land non-coastal, non-snow-covered land surface types Total Precipitable Water (TPW) over open water ocean Experimental Products (not fully validated): Total Precipitable Water over non-coastal land Cloud Liquid Water Profile (CLWP) over ocean Land surface temperature Surface Temperature (skin) extended to snow- Surface Emissivity over land and snow covered land surface type Surface Type Classificaon Surface Temperature (skin) extended to open ocean water Snow Water Equivalent (SWE) Effecve grain size of snow (over snow-covered Sea Ice Concentraon (SIC) land surface) Snow Cover Extent (SCE) Mul-Year (MY) Type Sea Ice Concentraon Vercally-Integrated Non-precipitang Cloud First-Year (FY) Type Sea Ice Concentraon Liquid Water (CLW) over open water ocean MIRS Products from ATMS DB Surface Temperature Total Precipitable Water with Rain Mass Profile with contours of Cloud Liquid Water

SNPP/ATMS 2014-01-23 18:19Z 6. Hydra2 Mulspectral Data Toolkit

• Allows interacve display of Level 1B and Level 2 products from mulspectral imagers (VIIRS, MODIS), high spectral resoluon sounders (CrIS, IASI, AIRS), and microwave sounders (ATMS, AMSU). • Designed to be easy to learn and use, especially for students. • Supported on Windows, OS X, and Linux. Hydra2 Screenshots

FigureHydra 2 display of collocated VIIRS and ATMS 8b: (Top left) Transect display comparing VIIRS IR window with ATMS microwave window brightness temperatures. (Top right) ATMS measured spectra from 23.8 to 183 GHz for two cursor locations. (Bottom left) VIIRS brightness temperatures measured in the infrared window at 10.8 m (M15) with the transect location superimposed. (Bottom right) Co-located ATMS brightness temperatures measured in the microwave window at 23.8 GHz with the transect location superimposed.

Hydra 2 display of CrIS

Figure 6a: HYDRA2 display of CrIS data over Asia-Oceania on 30 August 2012 showing spectra (top) and long wave (902 cm-1) infrared window image (bottom). Brightness temperature spectra from 650 to 2550 cm-1 are measured by CrIS over the pixel in the Sea of Japan (marked by the turquoise cross and shown in the turquoise spectra) and over the nearby pixel in the high clouds (marked by the red cross and shown in the white spectra). Straight lines in the spectra cover the spectral gaps in the CrIS measurements. Sea of Japan brightness temperatures in the infrared window regions are near 290 K while the cloud top temperatures are about 225 K. 7. VIIRS Imagery EDR

• Creates projected VIIRS image data on a Ground Track Mercator grid. • Product can be directly ingested into NWS AWIPS2. • Supports I-band resoluon (375 meters). • Provides VIIRS Near Constant Contrast (NCC) product for Day/Night Band. VIIRS Imagery EDR: Band I-1 VIIRS Imagery EDR: Band I-3 Coming Soon #1: CLAVR-X

• Computes cloud parameters (cloud top height, pressure, phase, …) and surface parameters from mulspectral imager data. • Development led by Andy Heidinger. • Supports VIIRS, MODIS, and AVHRR. – VIIRS SDRs from CSPP or IDPS/CLASS – MODIS Level 1B from SeaDAS or MODAPS – AVHRR Level 1B from AAPP v7 • NOAA plans to make CLAVR-X the operaonal cloud algorithm for SNPP and JPSS. CLAVR-X products from VIIRS DB

VIIRS SVM07 Cloud Mask

Cloud Phase Cloud Top Pressure CLAVR-X AVHRR Cloud Top Temperature

NOAA-19, 2013/07/25 Coming Soon #2: NUCAPS

• Creates profiles of temperature, moisture, ozone, and other trace gases; cloud and surface products; and other products all from cloud cleared radiances. • Development led by Chris Barnet. • Also supports IASI/AMSU/MHS and AIRS/AMSU. • NOAA plans to make NUCAPS the operaonal sounding

algorithm for SNPP and JPSS. Coming Soon #3: CSPP GEO • NOAA GOES-R Project is funding the development of a DB package for GEO satellites. • Will create cloud and surface products from DB data (e.g., GRB from GOES-R). • Supported satellites/sensors will include GOES-R ABI, GOES-N Imager, and Himawari-8. • Algorithms will be based on GOES-R versions; implemented in GEOCAT. Coming Soon #4: Flood Detecon

• JPSS is funding the transion of the GMU Flood Detecon algorithm to CSPP. • The algorithm uses reflected solar spectral tests to infer the presence of non-normal standing water (dayme only). • Both VIIRS and MODIS products are supported. 52 Flood Detecon: Amur River Google Earth Base Imagery

53 MODIS False Color 2013/09/08

54 Flood Detecon Mask 2013/09/08

55 SNPP VIIRS True Color Imagery in KML Credits CSPP team at UW/SSEC/CIMSS. Algorithm Developers. JPSS Project. DB User Community!

[email protected]