OGC Standards and Climate Monitoring, Modeling, and Data

OGC St andards and Clim at e Monit oring, Modeling, and Dat a Sharing

Carl Reed, PhD Open Geospatial Consortium May 9, 2014

Across multiple domains

Use cases

Example datasets

sustained polar Validate science campaign model Check winter highways compatibility maintenance

http://www.earthobservations.org/geoss.shtml

® The Open Geospatial Consortium

Not-for-profit, international voluntary consensus standards organization; leading development of geospatial standards

• Founded in 1994. • 475+ members and growing University • 38 standards 24% • Hundreds of product implementations Commercial 41% Research • Broad user community 7% implementation worldwide NGO 10% • Alliances and collaborative activities Government with ISO and many other SDO’s 18%

Hundreds of thousands of maps and datasets accessible through close to 10,000 servers running OGC Web Services

OpenIOOS.Org OneGeology.Org OGC Web Services Web Map Servers (WMS) Web Feature Servers (WFS) Web Coverage Servers (WCS)

GEOSS Portal geoportal.org NSDI - India GeoPortal Map Viewer Skyview2, Eurocontrol

® http://www.opengeospatial.org/standards

• Standards-based interoperability for climate change analysis • Deployed network of data services (WCS, WFS, SOS), analysis services (WPS, WCPS, WMS), and geospatial client applications that exercise those services Participants

52 North Australia Bureau of Meteorology (BoM) CSIRO

ERDAS ESRI OpenGeo Jacobs University lat/lon Lisasoft

UK Science & Technology Facilities Council (STFC)

US National Center for Atmospheric Research (NCAR)

OGC St andards used in Clim at e Sc ienc e, Monit oring, and Modeling

Copyright © 2014 Open Geospatial Consortium • Catalogue (CSW) • Geography Markup Language (GML) • KML • NetCDF • Observations and Measurements • SensorML • Sensor Observation Service (SOS) • Web Coverage Service (WCS) • Web Feature Service (WFS) • Web Map Service (WMS) • Web Processing Service (WPS)

Web Processing Service – WPS Geoprocessing Workflow • OGC Web Service access to algorithms • Change detection, coordinate transformation, modeling and simulation…

® OGC network Common Data Form (netCDF)

• A data model and a collection of access libraries for array- oriented scientific data.

• Source: University Corp. for Atmospheric Research (UCAR) • Designed for fluid earth systems (FES)

• A de facto standard used around the world. – For example, output datasets from climate models being used for the Fifth Assessment Report of the Intergovernmental Panel on Climate Change must be submitted in netCDF format, using the associated Climate and Forecast (CF) metadata conventions (CF- netCDF).

• Became an OGC standard in 2011.

• FES world is characterized by a set of parameters (e.g., pressure, temperature, wind speed) that vary as continuous functions in 4-dimensional space and time. The behavior of the parameters in space and time is governed by a set of partial differential equations.

OpenMI - Open Modeling Interface

OpenMI – a mature standard to integrate models

Models are linked though so called “Linkable Components“ with each other.

The “linkable component“ can contain temporal and/or spatial (such as point or polygon) structures. My model “Linkable components“ have bi directional interfaces, the so called “Exchange Item“

A model chain is executed by its’ last GetValues(time) model. The triggered model calls all other models and receives at the end the expected product.

Return

KISTERS AG KISTERS Partner Week 2011 13 16/05/2014 ®

Ex am ples

Supported by HQ’s Science Mission Directorate Discover Linux 10 10 GbE GbE Supercomputer, June 2013: JIBB Login • Intel Xeon nodes Dirac Discover Login Discover Login 3 Dali 1 Discover (batch) Dali-GPU JIBB • ~3,200 nodes Data 2 2 5 Archive SCU 8 Analysis SCUs1,2,3,4 SCU 7 SCU 9 Analysis JCSDA Portal Sandy Bridge • ~42,100 cores Parallel Nodes Westmere Westmere Sandy Bridge Nodes (batch) DMF ~160 TF peak ~160 TF peak 4 (interactive) ~161 TF peak (interactive) ~39 TF peak • Peak ~624 cluster ~139 TF peak “Phi” MIC ~3 TF peak Westmere TFLOPS general IB SANs Base (offline) ~485 TF peak IB purpose GPFS InfiniBand (IB) InfiniBand (IB) I/O GPFS GPFS GPFS Servers • 97 TB memory I/O Servers I/O Servers I/O Servers SAN SAN s Storage Area Network (SAN)

(2 or 4 GB per e i e r p a a r T b

core) i L • Coprocessors: • Intel Phi MIC Dali and Dali- Dirac Archive Data Portal Data JIBB Sharing Services • 480 units GPU Analysis • 0.9 PB disk • Linux cluster for • Earth System Grid • ~485 TFLOPS • 12- and 16-core • ~70 PB robotic tape Joint Center for nodes • OPeNDAP • NVIDIA GPUs library Satellite Data • 16 GB memory per • Data download: http, Assimilation • 64 units • Data Management https, ftp core community • ~33 TFLOPS Facility (DMF) • Web Mapping • Dali-GPU has • Shared disk: 7.2 PB space management Services NVIDIA GPUs (WMS)server ® March 1, 2013 15 NCCS User Forum, Sep. 24, 2013 NCAR’s GIS portal and Community Climate System Model (CCSM3)

• One of the global climate model included in the Fourth Assessment Report (AR4) of the Intergovernmental Panel on Climate Change (IPCC). Uses NetCDF, WMS, KML, WCS. Model driven by scenarios

SRES scenario B1 is a lower end emissions scenario. Scenario B1 assumes : • population that peaks in the mid-century and declines thereafter • rapid changed in economic structures • introduction of clean and resource-efficient technologies

The map of the winter season's total precipitation anomaly for the near term for scenario B1

• ADAGUC is a geographical information system to visualize netCDF files via the web. Implements OGC WMS, WFS, and WCS

• climate4impact portal, oriented towards climate change impact modellers, impact and adaptation consultants, as well as other experts using climate change data. Implements OGC WMS, WPS,

• CSML is a standards-based data model and GML application schema for atmospheric and oceanographic data.

Not just c lim at e m onit oring but m odeling of im pac t s relat ed t o c lim at e c hange

• Observations of pika over the last 20 years, plus modeling systems, to model pika distributions change with climate. Interoperability experiment to determine valuable predictors for the impact of climate change on biodiversity. Area of interest: US Great Basin.

GEO IP3 Portal Client & Workflow engine OpenModeller Server WPS CSW IP3 Distributed Community Catalog / Mediator

req req req req req req Broker resp resp resp resp resp resp

• Long time commitment to the use of OGC standards. Currently implement WMS, WFS, WCS, GML, NetCDF

Data/policy analyst monitoring populations that may be at risk from drought

® Developed by Greg Yetman, CIESIN, Columbia University Cross domain use case

• UC11: Riverine Flood Forecasting using Meteorological Ensemble Forecasts

• Few people are interested in weather itself, it’s the impacts of weather that are the concern

• How do we integrate weather and climate information into the hydrology domain?

• Cross-domain engagement with OGC Met Ocean and Hydrology Domain Working Groups Slides courtesy of Jeremy Tandy, UK Met Office ®

– Assessing energy production potential for photovoltaic and solar thermal heating. Required investments and achievable CO2 reductions have been computed for each of the 550,000 buildings bsed on the roof surface segments, and were added to the 3D city model

4. 7. 2012 ESFRI Environmental Research Infrastructures

• Tropospheric • Upgrade of • Multidisciplinary • Plate observing • Global ocean research aircraft incoherent seafloor system observing SCATter facility observatory infrastructure

EURO- COPAL EISCAT-3D EMSO EPOS ARGO

• Aircraft for • Integrated • Biodiversity and • Svalbard arctic global observing carbon ecosystem Earth observing system observation research infra system system

IAGOS ICOS LIFEWATCH SIOS

® 28 23/10/2012 W. Losi - ENVRI @ EUDAT Geospatial Data Services

Data Access Data Process

OGC OGC WCS WPS

THREDDS WPS 52N P1 P2 P..

WPS Hadoop Data Discovery Data Pub. /Vis. g n

OGC i Hadoop Cluster

g OGC a

OpenSearch t s WMS, WFS a

Linked Open Data t a

D H F

Catalogue e GeoServer

b D S Services u C g

Geospatial Repositories

® by courtesy of P. Pagano Increasing pressure to monitor, model, and preserve knowledge

Thank you for your part ic ipat ion!

Carl Reed, PhD CTO and Executive Director Standards Open Geospatial Consortium

[email protected]

• http://gosic.org/gcos

• http://www.euro4m.eu/datasets.html

• http://www.copernicus.eu/pages-principales/projects/on- going-projects/climate-change/

• http://www.meteoswiss.admin.ch/web/en/services/data_por tal/gridded_datasets/alpineprecip.html