SMS Platform & Spatial Data on The
Total Page:16
File Type:pdf, Size:1020Kb
SMS Platform & Spatial Data on the Web RISIS WP 9 Ali Khalili, Antonis Loizou, Peter van den Besselaar, Frank van Harmelen RISIS Datasets: Entity Types SMS Platform: Geo Services Application Service Data Spatial Data on the Web Spatial Data on the Web: Diverse Landscape of Standards http://www.opengeospatial.org/ ● Open Geospatial Consortium (OGC) ● making quality open standards for the global geospatial community Virtuoso Geo Spatial Geometry as SMS internal representation for Geo-data in RDF Spatial Data on the Web: Best Practices https://www.w3.org/TR/sdw-bp/ ● best practices related to the publication and usage of spatial data on the Web ● intended for practitioners, including Web developers and geospatial experts Best Practice 26: Include spatial information in dataset metadata <http://rdf.risis.eu/dataset/jorep/1.0/void. ttl#jorep_rdf_dataset> <http://purl. org/dc/terms/spatial> <http://dbpedia. org/resource/Spain> , <http://dbpedia. org/resource/United_Kingdom> , <http://dbpedia.org/resource/Italy> , <http: //dbpedia.org/resource/France> , <http://dbpedia. org/resource/Netherlands> ... SMS Platform: Geo Services & Applications ● Basic Geo Services ○ [Reverse] Geocoding ○ Geographical boundary-related services ● Innovative Geo Services ○ based on the new notion of distance Services: http://api.risis.ops.few.vu.nl/ Applications: https://github.com/risis-eu/LDA-apps SMS Platform: Designing Geo Web Services 1. identify the required service Point to NUTs ● Eurostat (shape files) 2. discover the related open data on the Web ● Eionet ● EuroGeographics Planet Data EU Network of Excellence: ● UN Food & Agriculture http://nuts.geovocab.org/ Organization 3. convert data to RDF and store in a triple store use Virtuoso Geometry data type 4. create/document the API for the required service http://api.risis.ops.few.vu.nl/PointToNUTS?long={long}&lat={lat} 5. build sample application(s) which exploit the API http://lda-apps.risis.ops.few.vu.nl/PointToNUTS/{longitude}/{latitude} Hierarchical Classification of Spatial Units Local Administrative Unit OECD NUTS-4 & NUTS-5 (LAU-1, LAU-2) Functional Urban Areas (FUA) Open Data Sources for LAU-1 & LAU-2 shapefiles on the Web ● OpenStreetMap ● Flickr geo-tagged photos ● Search the Web for each individual country ● GADM (Global Administrative Areas) OpenStreetMap (OSM) ● https://www.openstreetmap.org ● built by a community of mappers that contribute and maintain data about roads, trails, cafés, railway stations, and much more, all over the world. ● Data Access: ○ Nominatim Web API for querying OSM ○ The Overpass API for fetching specific OSM data ○ Planet.osm Data (over 617GB uncompressed!) ○ LinkedGeoData EU project has recently published an RDF version of the OpenStreetMap dataset: http: //downloads.linkedgeodata.org/releases/2015-11-02/ OpenStreetMap (OSM): Conceptual Data Model ● Node ○ represents a specific point on the earth's surface defined by its latitude and longitude. ● Way ○ an ordered list of between 2 and 2,000 nodes that define a polyline. ○ used to represent linear features such as rivers and roads. ○ can also represent the boundaries of areas (solid polygons) such as buildings or forests so called ‘closed way’. ● Relation ○ a multi-purpose data structure that documents a relationship between two or more data elements (nodes, ways, and/or other relations) e.g. a multipolygon that describes an area (whose boundary is the 'outer way') with holes (the 'inner ways'). OpenStreetMap (OSM): Nominatim Web API ● a tool to search OSM data by name and address and to generate synthetic addresses of OSM points (reverse geocoding) ● Several companies provide hosted instances of Nominatim query API, e.g MapQuest Open Initiative, PickPoint or the OpenCage Geocoder ● API documentation ● Example usage: ○ http://nominatim.openstreetmap.org/search.php? q=amsterdam&polygon=1&country=Netherlands&format=json&addressd etails=1 ○ MapQuest API Extracting Shpefiles using Nominatim API e.g. the Netherlands OpenStreetMap (OSM): Boundaries ● Boundaries mark the borders of areas: administrative, historic, maritime, national_park, political, postal_code, religious_administration, protected_area, etc. ● Administrative boundaries ○ range from large groups of nation states right down to small administrative districts and suburbs, with an indication of this size/level of importance, given by the combo tag 'admin_level' which takes a value from 1 to 10 (or 11) Country admin_level 1 2 3 4 5 6 7 8 9 10 Germany see N/A national N/A federal state-district county amt Towns, Parts of a Parts of a also Grenzen in border states border borders Municipalitie municipality with municipality Deutschland border Amtsgemeinde, s / City- parish councils / without ... Deutsche Regierungsbezir Landkreis Verwaltungs- districts self government Außengrenz Bundeslan k / Kreis / gemeinschaft Stadtteil / e d kreisfreie Stadt, Stadtbezirk / Gemeindeteil NUTS 2 Stadt / LAU 1 (aka Gemeinde Gemeindeteil mit ohne NUTS 1 Stadtkreis NUTS 4) Selbstverwaltung Selbstverwaltung LAU 2 (aka NUTS 3 NUTS 5) OpenStreetMap (OSM): Administrative Levels Areas covering the point (4.8650,52.3339) -> Vrije Universiteit Amsterdam http://lda-apps.risis.ops.few.vu. nl/PointToOSMAdminBoundaries/4. 8650/52.3339 boundary for municipality (gemeente) : LAU-2 Combining multiple API calls http://lda-apps.risis.ops.few.vu.nl/addressToMunicipality OpenStreetMap (OSM): RDF Release ● http://linkedgeodata.org/ ● a large spatial knowledge base (>400m geo elements) which has been derived from Open Street Map. ● provides unique URIs and has Mappings to DBpedia. ● seems useful for defining innovative Geo services ● Example queries ● Download: http://downloads.linkedgeodata.org/releases/2015-11-02/ ● More info: http://svn.aksw.org/papers/2011/SWJ_LinkedGeoData/public.pdf Flickr geo-tagged pictures ● Data from 190M geo-tagged photos on Flickr ○ new smart phone do not only have a camera but also the ability to capture location information. ○ plotted all the geotagged photos associated with a particular place to generate a mostly accurate contour of that place (something more fine- grained than a bounding box!). ● six associated Where On Earth (WOE) IDs ○ correspond to the hierarchy of places where a photo was taken: the neighbourhood, the town, the county, and so on up to continents. ○ for a given WOE entity, approximate shape of that place is inferred. ● shapes in GeoJSON format ● view shapes at http://polymaps.org/ex/flickr.html ● download at http://www.flickr.com/services/shapefiles/2.0.1/ ● more info: http://code.flickr.net/2012/10/24/2273/ Search the Web for each individual country ● Local administrative offices or Geo-related research centres might provide shape files specific to a country. ● E.g. for the Netherlands, shapefiles are provided by Centraal Bureau voor de Statistiek (CBS) ● Data collection needs to be done by a group of people in contact with Geo-related organization in countries. ● Current status GADM (Global Administrative Areas) ● GADM is developed by University of California, Berkeley Museum of Vertebrate Zoology, the International Rice Research Institute and the University of California, Davis, and with contributions of many others. ● uses other existing source: http://www.gadm.org/links ● data is available globally and for each individual country, in different formats: geopackage,R SpatialPolygonsDataFrame, ESRI file geodatabase, Google Earth OECD shapefiles : Still in negotiation... - We have received a snapshot of OECD shapefiles for 423 FUAs - CA: 34, JP: 76, KR: 45, ES: 76, FR: 83, NL: 35, SE: 12, CL: 26, IE: 5, NO: 6, EE: 3, DK: 4, LU: 1, BE: 11, AT: 6 - Some missing names for FUA shapefiles. - Data Parsing and transformation to RDF has been done. As soon as we get access to the full OECD shapefiles, will start the process. Open Data Sources for LAU-1 & LAU-2 shapefiles on the Web Summary ● Combination of different data sources might bring superior results in terms of coverage & precision. ● API usage limits is one of the key issues to be addresses (hosting these huge geo-data and querying it might require a lot of resource to be allocated!). ● Techniques for geo-data quality analysis and handling data updates need to be considered. ● Geo-entity disambiguation & using canonical names is another issue! Existing Web APIs RISIS-made Web APIs Data Access Other Shapefiles for individual countries Integration centered on Linked Geo Data ... ... Linked Geo datasets RISIS RISIS DS6 DS1 OSM GADM RISIS RISIS Dbpedia DS5 DS2 RISIS RISIS DS3 DS4 Innovative Geo services https://docs.google. com/presentation/d/1BnMVWCeAH7HTxPckKKgP2lDFO- XKLVxnoByajkBuOSw/edit#slide=id.gc80d5dc2e_0_47.