OGC-EPRI Conflation Webinar
Total Page:16
File Type:pdf, Size:1020Kb
® OGC-EPRI Conflation Webinar Carl Reed, PhD CTO Open Geospatial Consortium October 16, 2014 © 2013 Open Geospatial Consortium Who am I? • I am a geographer who could not get the hang of manual cartography so in 1969 I started to use computers to make maps and have been a geospatial tech geek ever since. ® OGC Copyright (c) 2014 Open Geospatial Consortium http://www.opengeospatial.org. The Power of Geography • The great integrator, the power of map overlay, mashups, etc Lancaster University geosphere.gsapubs.org Bermuda Conservation ® OGC © 2014 Open Geospatial Consortium 3 However • Different spatial reference systems • Different Accuracies • Different Scales • Different semantics • Different classification systems • Incompleteness of source materials • Collected for different use cases • And the list goes on ® OGC © 2014 Open Geospatial Consortium 4 The “simple case” • Use case for emergency response: Create a seamless digital map of the transportation network between two counties in two adjacent states – Different road classifications – Different street names – Edge match issues – Scale differences ® OGC © 2013 Open Geospatial Consortium 5 And another simple case • Same theme but from two different sources – conflate the two datasets to create a higher quality product. ® University of California Santa Barbara OGC © 2014 Open Geospatial Consortium 6 Conflation: Definition • The process of unifying two or more separate datasets, which share certain characteristics, into one integrated all- encompassing result (OGC) • Combining map data from separate sources to create data that is better than either source on its own (OpenStreetMap wiki) • The process of combining geographic information from overlapping sources so as to retain accurate data, minimize redundancy, and reconcile data conflicts. – Longley, Paul A. et al (2001). Geographic Information Systems and Science ® OGC © 2014 Open Geospatial Consortium 7 ® OGC © 2014 Open Geospatial Consortium 8 Many aspects of conflation • Vertical • Horizontal – Edge match • Attributes – Semantics – Vocabularies – Ontologies – Data models • Visualization ® OGC © 2014 Open Geospatial Consortium 9 Difficulty of conflation depends on many factors • Complexity of representation • Volume and accuracy of the datasets involved. • Specifically, incompleteness and inaccuracy of the original datasets, different reference systems, distinct generalizations and representations of reality, semantic issues of terminology and classification, various scales, and different purposes, as well as various time frames – Goodchild and Raubal, 2009 From Geoinformatics (Digitális Tankönyvtár) ® www.tankonyvtar.hu OGC © 2014 Open Geospatial Consortium 10 Solution requires • Metadata! • Agreement on conflation rules – Coordinate reference system – Quality – Feature matching – Geometry matching – Attribute Matching – Selection rules – Accuracy ® OGC © 2014 Open Geospatial Consortium 11 ® OGC Standards Relevant to Conflation © 2014 Open Geospatial Consortium OGC Web Services Standards The GeoWeb is enabled by OGC standards: Web Map Service (WMS) Web Feature Service (WFS) Web Coverage Service (WCS) Catalogue (CSW) Geography Markup Language (GML) Web Processing Service (WPS) Web Coverage Processing Service GeoSPARQL The Geospatial Web is about the complete integration and use of location at all levels of the internet and the web. Dr. Carl Reed ® CTO OGC OGC © 2014, Open Geospatial Consortium OGC Web Map Service (WMS) Standard • Simple HTTP interface for requesting geo-registered map images from one or more distributed geospatial databases. A WMS request defines the geographic layer(s) and area of interest to be processed. The response is one or more geo-registered map images (returned as JPEG, PNG, etc) that can be displayed in any browser application. – Thousands of implementations • Easy to implement – http://clearinghouse1.fgdc.gov/scripts/ogc/ms.pl?version=1.1.1& request=map&srs=EPSG:4326&bBox=-180,-90,180,90& width=400&height=200&format=JPEG&styles=BLACK& layers=boundary,coastline,elevation,lakes,rivers& • An ISO Standard ® OGC Copyright (c) 2014, Open Geospatial Consortium 14 Web Feature Service Interface Standard • Specifies the behaviour of a service that provides transactions on and access to geographic features in a manner independent of the underlying data store. The standard specifies discovery operations, query operations, locking operations, transaction operations and operations to manage stored parameterized query expressions. http://nationalmap.gov/framework.html http://www.ibm.com/developerworks/data/library/techarticle/dm- 0810kleoppel/ ® OGC Copyright (c) 2014, Open Geospatial Consortium 15 Web Feature Service (WFS) gets operable feature data from multiple servers Each layer is data, not merely a view: Elevation Borders Cities Country is: _ Name: Italy _ Population: 57,500,000 _ Area: 301,325 sq km . Multiple thematic data layers GetFeature request: ® OGC © 2014 Open Geospatial Consortium Geography Markup Language: Representing Geographic Features Another Information Community’s Schema GML Highway is: _Pavement thickness Support for complex geometries, spatial and _Right of way temporal reference systems, topology, units of _Width …. measure, metadata, feature and coverage Cell transm. Platform is: visualization. One Information _Location Community’s Schema _No. of antennas Backward compatible _Elevation Road is: _Width …. _Lanes _Pavement type Mayberry’s Cell Tower …. (an instance of Cell Transm. Platform Cell tower is: in another IC’s schema) _Owner _Height _Licensees …. Mayberry Road (an instance of Road in one IC’s schema) GML defines a data encoding in XML that allows geographic data and its attributes to be moved between disparate systems ® Version 3.3 advances interoperability on all fronts!! OGC © 2014, Open Geospatial Consortium Web Processing Service 1.0 • Designed to standardize the way that geospatial calculations, such as polygon overlay, are made available to the Internet. WPS can describe any calculation (i.e. process) including all of its inputs and outputs, and trigger its execution as a Web Service. • Supports simultaneous exposure of processes via GET, POST, and SOAP • Integrated with Hadoop and MapReduce for Big Data analytics ® OGC Copyright (c) 2014 Open Geospatial Consortium http://www.opengeospatial.org. OGC Web Processing Service (WPS) WPS-client Communication over the web using HTTP WPSGetCapabilities DescribeProcess Execute Algorithms Repository Data Handler Repository … … … … Algorithm 1 Data Handler A Web Processing Service ® OGC © 2014 Open Geospatial Consortium Simple Symbology Conflation Display Feature Data with different Symbols User Community “A” User Community “Y” Emergency Management Maps Map Map Viewer Fire Incident Viewer Client Client Violent Activities: Arson Fire Emergency Unknown Friendly Neutral Hostile Management … Symbol Sets Commercial Forest Grassland Hotspot Facility Fire Fire Fire Fire Features (GML) Maps (GIF,PNG,JPG) Metadata (XML) Styles (SLD), Symbols (CGM,SVG) WFS WMS CSW CSW Cultural Transportation Critical Incidents Infrastructure Features Env. Cadastral Population Intelligence Conditions Emergency Management Data Sources (Regional, International, National, State, Local) ® OGC © 2014 Open Geospatial Consortium ® OGC Activities Related to Conflation © 2013 Open Geospatial Consortium The OGC Interoperability Program (IP) • A global, collaborative, hands-on engineering, prototyping and testing designed to rapidly deliver – Running code implementations – Engineering Reports – Change Requests – Demonstration in real world scenarios • Sponsors and Participants work together. – Sponsors provide requirements, use / business cases and funding – Participants work with sponsors to define and/or refine standards to solve a given interoperability problem ® OGC Copyright © 2014 Open Geospatial Consortium Types of OGC-IP Initiatives OGC OGC OGC Testbed Interoperability Pilot Experiment Purpose Develop new Refine & extend Test existing standards & existing standards in refine existing standards operational specs environment Project OGC IP Team OGC Members OGC IP Team Management Sponsorship Yes No Yes Participation OGC Members OGC Members Members & & approved operational non-Members partners The OGC Interoperability Program (OGC Document 05-127r5) ® http://portal.opengeospatial.org/files/?artifact_id=45656 OGC Copyright © 2014 Open Geospatial Consortium GOS-TP Goal & Objectives UML Completed 2002 Model • Implement a vertical slice of GOS, testing the assumptions made in the broader GOS objectives using the UGAS Tool Road Transportation theme. • Primary Objectives: – Test assumption that Unified GML GML Modeling Language (UML) model can Application Application be successfully expressed as a Schema Schema physical schema (SchemaLocal) (SchemaGlobal) – Test assumption that Federal, State, Local, and/or Tribal data can be translated to a schema different from “User” their local, native schema Site – Pilot a portal-based system DOT implementing metadata, data access Portal Node (including translation/semantic mediation), and web mapping Oregon California Node Node CIPI/Other Jackson Siskiyou Nodes County County Node Node OGC ® GOS-TP Operational Context “User” Client Browser Site DOT Registry & Portal Node Portrayal Services Oregon California Node Node Data CIPI/Other Services Nodes Jackson Siskiyou County County Node Node OGC ® GOS-TP Technical Architecture WFS-X Oregon WMSSLD Node WRS WRS CG Jackson WFS-X County WMSSLD WMS CG Node WFS CG User Browser WOS