OGC-EPRI Conflation Webinar

Carl Reed, PhD CTO Open Geospatial Consortium October 16, 2014

• I am a geographer who could not get the hang of manual cartography so in 1969 I started to use computers to make maps and have been a geospatial tech geek ever since.

• The great integrator, the power of map overlay, mashups, etc

Lancaster University

geosphere.gsapubs.org

• Different spatial reference systems • Different Accuracies • Different Scales • Different semantics • Different classification systems • Incompleteness of source materials • Collected for different use cases • And the list goes on

• Use case for emergency response: Create a seamless digital map of the transportation network between two counties in two adjacent states – Different road classifications – Different street names – Edge match issues – Scale differences

• Same theme but from two different sources – conflate the two datasets to create a higher quality product.

• The process of unifying two or more separate datasets, which share certain characteristics, into one integrated all- encompassing result (OGC)

• Combining map data from separate sources to create data that is better than either source on its own (OpenStreetMap wiki)

• The process of combining geographic information from overlapping sources so as to retain accurate data, minimize redundancy, and reconcile data conflicts. – Longley, Paul A. et al (2001). Geographic Information Systems and Science

• Vertical

• Horizontal – Edge match

• Attributes – Semantics – Vocabularies – Ontologies – Data models

• Visualization

• Complexity of representation • Volume and accuracy of the datasets involved. • Specifically, incompleteness and inaccuracy of the original datasets, different reference systems, distinct generalizations and representations of reality, semantic issues of terminology and classification, various scales, and different purposes, as well as various time frames – Goodchild and Raubal, 2009

• Metadata!

• Agreement on conflation rules – Coordinate reference system – Quality – Feature matching – Geometry matching – Attribute Matching – Selection rules – Accuracy

OGC Standards Relevant to Conflation

The GeoWeb is enabled by OGC standards:

Web Map Service (WMS) Web Feature Service (WFS) Web Coverage Service (WCS) Catalogue (CSW) Geography Markup Language (GML) Web Processing Service (WPS) Web Coverage Processing Service GeoSPARQL

The Geospatial Web is about the complete integration and use of location at all levels of the internet and the web. Dr. Carl Reed ® CTO OGC OGC © 2014, Open Geospatial Consortium OGC Web Map Service (WMS) Standard

• Simple HTTP interface for requesting geo-registered map images from one or more distributed geospatial databases. A WMS request defines the geographic layer(s) and area of interest to be processed. The response is one or more geo-registered map images (returned as JPEG, PNG, etc) that can be displayed in any browser application. – Thousands of implementations

• Easy to implement – http://clearinghouse1.fgdc.gov/scripts/ogc/ms.pl?version=1.1.1& request=map&srs=EPSG:4326&bBox=-180,-90,180,90& width=400&height=200&format=JPEG&styles=BLACK& layers=boundary,coastline,elevation,lakes,rivers&

• An ISO Standard

• Specifies the behaviour of a service that provides transactions on and access to geographic features in a manner independent of the underlying data store. The standard specifies discovery operations, query operations, locking operations, transaction operations and operations to manage stored parameterized query expressions.

http://nationalmap.gov/framework.html http://www.ibm.com/developerworks/data/library/techarticle/dm- 0810kleoppel/

Each layer is data, not merely a view: Elevation Borders

Cities Country is: _ Name: Italy _ Population: 57,500,000 _ Area: 301,325 sq km

. . . Multiple thematic data layers

GetFeature request:

Another Information Community’s Schema GML Highway is: _Pavement thickness Support for complex geometries, spatial and _Right of way temporal reference systems, topology, units of _Width …. measure, metadata, feature and coverage Cell transm. Platform is: visualization. One Information _Location Community’s Schema _No. of antennas Backward compatible _Elevation Road is: _Width …. _Lanes _Pavement type Mayberry’s Cell Tower …. (an instance of Cell Transm. Platform Cell tower is: in another IC’s schema) _Owner _Height _Licensees …. Mayberry Road

(an instance of Road in one IC’s schema)

GML defines a data encoding in XML that allows geographic data and its attributes to be moved between disparate systems ® Version 3.3 advances interoperability on all fronts!! OGC © 2014, Open Geospatial Consortium Web Processing Service 1.0

• Designed to standardize the way that geospatial calculations, such as polygon overlay, are made available to the Internet. WPS can describe any calculation (i.e. process) including all of its inputs and outputs, and trigger its execution as a Web Service.

• Supports simultaneous exposure of processes via GET, POST, and SOAP

• Integrated with Hadoop and MapReduce for Big Data analytics

WPS-client

Communication over the web using HTTP

WPSGetCapabilities DescribeProcess Execute

Algorithms Repository Data Handler Repository … … … … Algorithm 1 Data Handler A

Web Processing Service

Emergency Management Maps

Map Map Viewer Fire Incident Viewer Client Client Violent Activities: Arson Fire Emergency Unknown Friendly Neutral Hostile Management … Symbol Sets Commercial Forest Grassland Hotspot Facility Fire Fire Fire Fire

Features (GML) Maps (GIF,PNG,JPG) Metadata (XML) Styles (SLD), Symbols (CGM,SVG) WFS WMS CSW CSW

Cultural Transportation Critical Incidents Infrastructure Features Env. Cadastral Population Intelligence Conditions Emergency Management Data Sources (Regional, International, National, State, Local) ® OGC © 2014 Open Geospatial Consortium ®

OGC Activities Related to Conflation

• A global, collaborative, hands-on engineering, prototyping and testing designed to rapidly deliver

– Running code implementations – Engineering Reports – Change Requests – Demonstration in real world scenarios

• Sponsors and Participants work together.

– Sponsors provide requirements, use / business cases and funding – Participants work with sponsors to define and/or refine standards to solve a given interoperability problem

OGC OGC OGC Testbed Interoperability Pilot Experiment

Purpose Develop new Refine & extend Test existing standards & existing standards in refine existing standards operational specs environment Project OGC IP Team OGC Members OGC IP Team Management

Sponsorship Yes No Yes

Participation OGC Members OGC Members Members & & approved operational non-Members partners

The OGC Interoperability Program (OGC Document 05-127r5) ® http://portal.opengeospatial.org/files/?artifact_id=45656 OGC Copyright © 2014 Open Geospatial Consortium GOS-TP Goal & Objectives UML Completed 2002 Model

• Implement a vertical slice of GOS, testing the assumptions made in the broader GOS objectives using the UGAS Tool Road Transportation theme. • Primary Objectives: – Test assumption that Unified GML GML Modeling Language (UML) model can Application Application be successfully expressed as a Schema Schema physical schema (SchemaLocal) (SchemaGlobal) – Test assumption that Federal, State, Local, and/or Tribal data can be translated to a schema different from “User” their local, native schema Site

– Pilot a portal-based system DOT implementing metadata, data access Portal Node (including translation/semantic mediation), and web mapping Oregon California Node Node CIPI/Other Jackson Siskiyou Nodes County County Node Node OGC ® GOS-TP Operational Context

“User” Client Browser Site

DOT Registry & Portal Node Portrayal Services

Oregon California Node Node Data CIPI/Other Services Nodes Jackson Siskiyou County County Node Node OGC ® GOS-TP Technical Architecture

WFS-X Oregon WMSSLD Node

WRS WRS CG Jackson WFS-X

County WMSSLD WMS CG

Node WFS CG User Browser WOS CG Siskiyou WFS

County WMSSLD DOT Portal Node WOS Node

WFS Acronyms California WMSSLD WFS Web Feature Service Node WFS-X Web Feature Service, Translating WMS Web Map Service SLD Styled Layer Descriptor WRS Web Registry Service OGC ® WOS Web Object Service OWS 5 Conflation Study

• Describes the process of conflation, outlines a framework for conflation and conflation rules services within a service oriented architecture, and describes the implementation of conflation services during the testbed

California Monterey Airport National Field operator Guard Prefers

Prefers USGS model - NGA model - Local The National Map Topographic (TNM) Data Store (LTDS) Mediat e

• Describes the architecture of a WPS capable of conflating two datasets while capturing province information about the process. Also provides information about defining and encoding conflation rules and about encoding provenance information using the W3C PROV recommendation.

• Increase Geospatial community interoperability by building on CCI OWS-9 work in semantic mediation, volunteer geographic information (VGI), provenance and data quality, and Global Gazetteer. Explore the potential of interoperability in the hydrology domain utilizing semantic mediation and ontologies to more easily share and visualize geospatial data.

• The access to linked data information provided by these gazetteers was achieved by GeoSPARQL enabling these gazetteers using semantic mapping components (provided by Image Matters LLC) mapping RDBMS and WFS data to knowledge representation (RDF) on the fly

• Defining best practices for supporting interoperability among the National Hydrographic Network (NHN) of Canada, the National Hydrographic Dataset Plus (NHD+) of United States, and the OGC HY_Features model developed and proposed by the World Meteorological Organization (WMO)

Hydro Mediation Services

Mediation Retrieval (xlink inference ) /Storage /semantic mediation) Transaction Web ( Xlink-enabled Mediation Service WSDL

service operations Hydro Data Services Hydro Model Service Invocation / OGC WPS /Data retrieval OWL-enabled NHN Meidation Serivce SQL endpoint SPARQL GeoSPARQL

Hydro Modeling Clients NHD+ SQL

FCU.GIS Hydro Model Web Test Pyxis Client Data retrieval NHN OGC WFS

Data retrieval NHD+

An example of non-OGC Conflation Research and Activities

Where could EPRI and OGC collaboration have significant impact on conflation?

• Use Case: Many Smart City and Smart Energy workflows require integration of crowd sourced, in situ-sensor, and other near real time sources of new content (satellite or UAV) with existing geospatial data sources to enhance decision making and provide real time situational awareness. – Response to natural disasters – Reduce energy consumption – Increase effectiveness of planning and maintenance – Integration of alternative energy sources – Etc.

• Rapidly capture requirements

• Marshall technology resources (EPRI and OGC members, data, software, etc)

• Agile and rapid development of “demonstratable” prototypes

• Engineering reports, webinar, videos, etc

• All in 6 to 9 months

Example use cases from the Energy Sector

Source : LGV Hamburg, Fa. simuPLAN OGC ® Electric Car Charging, Austria

OGC ® 3d and sensors Common Scents – City Sense

• Workflow of crowd sourced sensor input, Open Street Map, data fusion, and modelling that generates a 3d visualization. Uses numerous OGC standards

• OGC CityGML & NetCDF for energy neutral cities – http://www.3dpilot.nl/?p=92

Thank you for your attention

Carl Reed [email protected]