DOCSLIB.ORG

Developing a Free and Open Source Software Based Spatial Data Infrastructure

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Developing a Free and Open Source Software Based Spatial Data Infrastructure Developing a Free and Open Source Software based Spatial Data Infrastructure Jeroen Ticheler 1 License This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 2.5 License. To view a copy of this license, visit http:// creativecommons.org/licenses/by-nc-sa/2.5/ or send a letter to Creative Commons, 543 Howard Street, 5th Floor, San Francisco, California, 94105, USA. 2 The acronyms ☺ OGC - Open Geospatial Consortium ISO - International Standards Organization SDI - Spatial Data Infrastructure FOSS - Free and Open Source Software GEOFOSS - GeoSpatial FOSS ;-) 3 I’ll only use five acronyms in the presentation, so we’ll say them out loud together starting really easy! Overview What is Free and Open Source Software? Complexity of a Spatial Data Infrastructure Some examples Expert communities The future 4 What is Free and Open Source Software? 5 What is Software? Instructions that make hardware work Programmers write scripts that can be understood by people and by compilers: the source code Compiled software can not be fixed or adapted to user needs 6 What is Software? A key property is that it can be infinitely copied without any loss 7 What is FOSS? FOSS provides access to the source code of an application You are Free to use software and modify the source code to suit your needs 8 Source code is often the most secret property of a company What is FOSS? FOSS Closed Source The most prominent examples 9 Some of the most prominent examples of Open Source versus Commercial software: Linux vs Windows Mozilla Firefox vs Internet Explorer OpenOffice vs Microsoft Office What FOSS is not! FOSS does not come for free FOSS is not the same as Open Standards! (although there is a strong tendency towards full compliance with international standards) 10 Just two examples Do you use FOSS? With every single browse on the YES! Internet With almost every email you send 11 Some of the applications we almost all use without knowing, but that are vital to the existence of the Internet as we know it: -DNS => Bind -Web server => Apache - -Email => sendmail -Servers => Linux Complexity of a Spatial Data Infrastructure 12 Standards are required! 13 To make almost any system work, standards are required. Open Geospatial Consortium ISO-TC211 Standards are required! 14 OGC and ISO provide a large number of the required standards for an SDI Web Map Service - Style Layer Descriptor - Filter Encoding - Controlled vocabularies - Web Feature Service - RSS - Semantics - EPSG - Geography Markup Language - WSDL - Catalog Services for the Web - HTTP - Open Archive Initiative - FGDC - Web Coverage Service - SOAP - Web M a p C o n t e x t - G e o T I F F - W e b Coordinate Transformation Service - Z39.50 - Web Pricing and Ordering Service - ISO 19115 - XML/XSL/XSD - CSS - Web Processing Service - HTML 15 - To get the impression, a list of standards commonly used in an SDI (mainly based on OGC and ISO specs) - Not to mention the number of versions for each spec - This is only the top of the iceberg and mentions only the reasonably stable standards that have a fair amount of implementations GEOFOSS based SDI Software Architecture Thick (Desktop) Client Thin (Web) Client Client (uDig, QGIS, gvSIG, ArcGIS, Google Earth) (MapBuilder, InterMap, KaMap, OpenLayers) pplications a WMS (T-)WFS WCS CSW Direct (DC, FGDC, (GIF, PNG, (GML, (TIFF, ISO19115/ Access JPG, KML) Shapefile) GeoTIFF,...) Interfaces 19139) ers v Map Server Catalog Server (GeoServer, MapServer, Deegree) (GeoNetwork) Ser (Geo-)Database File System (MySQL, Postgresql/PostGIS DBMS) (Vector data & satellite images) (Vector data (both archive and for editing), Metadata) Databases GeoNetwork opensource 2006 16 Here’s an overview of some of these basic components. All of them FOSS except for the mentioned ESRI ArcGIS and Google Earth. For simplicity I have left out related standards as well as several other FOSS applications (e.g. GeoTools, GDAL/OGR, MapGuide, GRASS etc...) Some examples 17 GeoNetwork opensource 18 I take the opportunity to do some marketing of GeoNetwork opensource here :-) http://geonetwork.sourceforge.net 19 A view on a data description page + quicklooks Mixed search results 20 Search results in the catalog coming from different catalogs that are properly attributed. The interface provides direct access to data and map services. 1 2 InterMaGeoSerMaPpostGISpSer opensourvverer ce The eb Map Context documents. The slide also lists the applications that may be working in the back ground to provide the map views. composition can be made on the fly or through W The InterMap opensource map viewer showing a range of WMS services from distributed map servers. 2 2 FAO GeoNetwork AO GeoNetwork homepage. Customized version of GeoNetwork for the F 3 2 uDig - User Friendly Desktop GIS An example of a FOSS desktop GIS application gvSIG 24 Another Desktop GIS, connecting directly to the GeoNetwork catalog and pulling in data described in the catalog records. Many other applications exist that go well beyond e.g. Google Maps oferings (KaMap, OpenLayers, MapBuilder, ...) Expert Communities 25 This Rail-track was a really cool driving experience!!! Only one exploded suspension in the middle of nowhere! Interpretation of standards can prevent things to nicely work together 26 OpenGeospatial Consortium CITE test suites includes Open Source Reference Implementations The FOSS development model proofs useful where there is a need for implementing standards in a consistent and transparent manner. Experts required! 27 So we need experts that know how to read a map! To get the standards to interoperate, the input and knowledge of a wide range of specialists in required, or at least highly beneficial. Research institutes Universities Government Business Communities Experts required! 28 Experts from diverse communities with complementary expertise can provide the required knowledge Expert communities can be formed around FOSS projects to solve common problems FOSS Projects: - listed before FOSS Foundations, e.g.: - Apache Foundation - Open Source GeoSpatial Foundation (OSGeo) 29 Expert communities can reach far beyond the boundaries of a single company. Large expert communities do already exist. Foundations also exist and can provide legal protection, coordination, infrastructure, marketing, fundraising etc... Each participant has specific needs 30 At the same time, large parts of the required systems are or should be identical. Jointly participants agree on how the standard building blocks are developed... 31 Hi! Speak OGC? Hi! Sure! ... and ensure that each component will fit within the broader system architecture 32 The future 33 The future of (Geo)FOSS Shift from license to services based business model ๏ Support contracts for who needs them ๏ Add-on services & tools ๏ Competition ๏ Local capacity building ๏ Strong uptake at a global, non-exclusive scale 34 - More and more applications will be released as open source - Money otherwise spend on licenses can be invested in local capacity building - Need for strategic investments in these information systems The future of GeoFOSS Community building Further tool integration Need for more complex and innovative information systems ๏ Architecture development ๏ Web semantics ๏ Scalable from the local community to global level 35 Through the process of designing a UNSDI, the GeoNetwork project hopes to contribute to the process of building these complex information systems by bringing together experts in the field of SDIs at national and international level. Conclusions The GeoFOSS strategy should result in: Effective system development Effective data and information sharing Sustainable development and sustainable management of scares resources And ultimately... 36 We can all have a custom tool... ... while we developed the basis only once 37.
Load more

Recommended publications
  • An Open-Source Web Platform to Share Multisource, Multisensor Geospatial Data and Measurements of Ground Deformation in Mountain Areas
    International Journal of Geo-Information Article An Open-Source Web Platform to Share Multisource, Multisensor Geospatial Data and Measurements of Ground Deformation in Mountain Areas Martina Cignetti 1,2, Diego Guenzi 1,* , Francesca Ardizzone 3 , Paolo Allasia 1 and Daniele Giordan 1 1 National Research Council of Italy, Research Institute of Geo-Hydrological Protection (CNR IRPI), Strada delle Cacce 73, 10135 Turin, Italy; [email protected] (M.C.); [email protected] (P.A.); [email protected] (D.G.) 2 Department of Earth Sciences, University of Pavia, 27100 Pavia, Italy 3 National Research Council of Italy, Research Institute of Geo-Hydrological Protection (CNR IRPI), Via della Madonna Alta 126, 06128 Perugia, Italy; [email protected] * Correspondence: [email protected] Received: 20 November 2019; Accepted: 16 December 2019; Published: 18 December 2019 Abstract: Nowadays, the increasing demand to collect, manage and share archives of data supporting geo-hydrological processes investigations requires the development of spatial data infrastructure able to store geospatial data and ground deformation measurements, also considering multisource and heterogeneous data. We exploited the GeoNetwork open-source software to simultaneously organize in-situ measurements and radar sensor observations, collected in the framework of the HAMMER project study areas, all located in high mountain regions distributed in the Alpines, Apennines, Pyrenees and Andes mountain chains, mainly focusing on active landslides. Taking advantage of this free and internationally recognized platform based on standard protocols, we present a valuable instrument to manage data and metadata, both in-situ surface measurements, typically acquired at local scale for short periods (e.g., during emergency), and satellite observations, usually exploited for regional scale analysis of surface displacement.
    [Show full text]
  • Implementing Data Share Policy Final
    Implementing Data Share Through Open Source Portal Platforms presented by Bo Guo, PE, PhD and Kathy O’Donnell of Gistic Research, Inc and Scott Andreasen of Parsons Brinckerhoff Spatial Data Infrastructure (SDI) An SDI is to acquire, process, distribute, use, maintain, and preserve spatial data through Technology Policies Standards Human Resources, and related activities necessary A geospatial data portal is an important part of an SDI Tale of Two Portals Geoportal Discussion of GOS 2 Esri Opensource GOS Initiative performance & Geoportal scalability GOS implementation GOS retires with Geoportal Toolkit Merged with data.gov as geo.data.gov Version 2 GeoNetwork FAO + UNEP Multiple metadata standards started Harvesting development Initial release as FOSS 2001 2003 2006 2009 2012 Outline AGIC Data Sharing Guidelines Data Sharing Models and Web Portals Esri’s Geoportal Server OpenSource GeoNetwork Opensource Conclusion Arizona Data Sharing Guidelines “A Blueprint for Geospatial Data Sharing Policy in Arizona” Developed by AGIC Administration & Legal Committee Currently under review – discussed fully in next session! Provides guide to data sharing best practices Conforms to ARS provisions for data sharing No written agreement necessary between agencies – okay to share if you’re custodian Sharing agency retains custodial ownership of data Okay to prohibit redistribution of data, if desired Okay to exempt from commercial fees Sharing agency not liable for data errors Arizona Data Sharing Guidelines Arizona portal should
    [Show full text]
  • Establishing a CSW Metadata Catalogue with Geonetwork Opensource
    NETMAR Deliverable D7.9.2: ICAN semantic interoperability cookbooks – Part 3 International Coastal Atlas Network Cookbook: Establishing a CSW metadata catalogue with GeoNetwork opensource © 2012 NETMAR Consortium 1 EC FP7 Project No. 249024 NETMAR Deliverable D7.9.2: ICAN semantic interoperability cookbooks – Part 3 Table of Contents Introduction............................................................................................................................................3 What is a metadata catalogue? ...........................................................................................................3 What is CSW?.......................................................................................................................................3 CSW Application Profiles .....................................................................................................................3 CSW Servers.........................................................................................................................................4 Installing and configuring GeoNetwork 2.6.4......................................................................................5 Installing GeoNetwork 2.6.4.............................................................................................................5 Configuring the database for GeoNetwork 2.6.4............................................................................6 Configure GeoNetwork for Tomcat (optional).................................................................................8
    [Show full text]
  • Descargar Manual De Instalación De Geonetwork Para Windows
    MANUAL DE INSTALACIÓN Y CONFIGURACIÓN DE GEONETWORK 3.2 EN WINDOWS Versión: 1.0 Autor: Darwin Denis Quispe Llancacuro Contacto: [email protected] Resumen: En este documento se detallan los pasos para la instalación y configuración de Geonetwork 3.2.x. Palabras claves: metadatos, IDEP, geonetwork Fecha: 19/07/2017 Manual De Instalación Y Configuración De Geonetwork 3.2 1 CONTENIDO INTRODUCCIÓN ............................................................................................................................. 3 PROPÓSITO ................................................................................................................................ 3 DEFINICIONES ............................................................................................................................ 3 TÉRMINOS Y ABREVIACIONES ................................................................................................... 4 REQUERIMIENTOS PREVIOS A LA INSTALACIÓN ........................................................................... 6 Software Requerido .................................................................................................................. 6 Hardware Requerido ................................................................................................................. 6 PROCESO DE INSTALACIÓN EN WINDOWS ................................................................................... 7 1. Instalación y Configuración de Java Runtime Environment (JRE) ..................................... 7 1.1. Instalación
    [Show full text]
  • Newsletter Ecdl-Gis@Lartu Ecdl-Gis
    NEWSLETTER ECDL-GIS@LARTU ECDL-GIS NEWSLETTER Anno I - Numero 2 – Novembre 2011 - Politecnico e Università di Torino - Dipartimento Interateneo Territorio [ DITER ] - Laboratorio di Analisi e Rappresentazioni Territoriali ed Urbane [ LARTU ] - Castello del Valentino Manica Chevalley - Primo e secondo piano interrato - Viale Mattioli, 39 - 10125 Torino - Tel. +390115647478 - Fax. +390115647451 – www.ecdlgis.polito.it - www.lartu.polito.it – [email protected] – Test Center ECDL-GIS NEWSLETTER ECDL-GIS@LARTU Useful resources [!Update Your Bookmarks!] - Unsorted, unclassified GIS tools, blogs and other resources… ..................................................................................................................................5 GeoNetwork .............................................................................................................................................5 Nasa World Wind ....................................................................................................................................5 NatureServe Vista: Decision Support for Better Planning ................................................................5 Digital Media Center ...............................................................................................................................6 Biodiversity Informatics ..........................................................................................................................7 Open Topography ...................................................................................................................................7
    [Show full text]
  • Osgeo Journal the Journal of the Open Source Geospatial Foundation Volume 2 / September 2007
    OSGeo Journal The Journal of the Open Source Geospatial Foundation Volume 2 / September 2007 In This Volume Topology Basics 1Spatial: Data Quality Concepts Introducing MapWindow & GeoNetwork LizardTech: Why we use Open Source software Local Chapter Reports: Taiwan, U.K., Francophone, Spanish... Case studies: UN FAO, Fishing Vessel Tracking... Community Event Reports: India, France GRASS & distributed computing News & Software Updates... OSGeo Journal GeoNetwork opensource Vol. 2, September 2007 Project Spotlights GeoNetwork opensource Internationally Standardized Distributed Spatial within the UN system, forming a central and basic Information Management element in the development of a United Nations Spa- tial Data Infrastructure (UNSDI). In other national by Jeroen Ticheler and Jelle U. Hielkema and international organizations and initiatives such as the Consultative Group on International Agricul- GeoNetwork "opensource" is a standardized and tural Research (CGIAR), the European Space Agency decentralized Geospatial Information Management (ESA), the US Federal Geographic Data Committee System, based on the concept of distributed data (FGDC), in countries implementing National Spatial and information ownership and is designed to en- Data Infrastructures (NSDI), in Europe in the con- able access to geo-referenced data and cartographic text of The INfrastructure for SPatial InfoRmation products through descriptive metadata. Collections in Europe (INSPIRE), as contribution to the Group maintained at different organizations are accessible on Earth Observations (GEO) and others, GeoNetwork through a single entry point. This approach of ge- opensource has also seen a remarkable uptake. ographic information management enhances easy and timely access to existing spatial data for a wide community of users, supporting informed decision- The GeoNetwork opensource making in a variety of application fields.
    [Show full text]
  • Open Source Software
    Open Source Software Desktop GIS GRASS GIS -- Geographic Resources Analysis Support System, originally developed by the U.S. Army Corps of Engineers:, is a free, open source geographical information system (GIS) capable of handling raster, topological vector, image processing, and graphic data. http://grass.osgeo.org/ gvSIG -- is a geographic information system (GIS), that is, a desktop application designed for capturing, storing, handling, analyzing and deploying any kind of referenced geographic information in order to solve complex management and planning problems. http://www.gvsig.com/en ILWIS -- Integrated Land and Water Information System is a GIS / Remote sensing software for both vector and raster processing. http://52north.org/downloads/category/10-ilwis JUMP GIS / OpenJUMP -- is a Java based vector GIS and programming formwork. http://jump-pilot.sourceforge.net/ MapWindow GIS -- is an open source GIS (mapping) application and set of programmable mapping components. http://www.mapwindow.org/ QGIS -- is a cross-platform free and open-source desktop geographic information system (GIS) application that provides data viewing, editing, and analysis capabilities http://qgis.org/en/site/ SAGA GIS -- System for Automated Geoscientific Analysis (SAGA GIS) is a free and open source geographic information system used for editing spatial data. http://www.saga-gis.org/en/index.html uDig -- is a GIS software program produced by a community led by Canadian-based consulting company Refractions Research. http://udig.refractions.net/ Capaware -- is a 3D general purpose virtual world viewer. http://www.capaware.org/ FalconView -- is a mapping system created by the Georgia Tech Research Institute. https://www.falconview.org/trac/FalconView Web map servers GeoServer -- an open-source server written in Java - allows users to share process and edit geospatial data.
    [Show full text]
  • The Complete Manual in Pdf Format
    The complete manual By the developers V 2.4 Copyright © 2007-2009 The Open Source Geospatial Foundation Table of Contents Preface ..................................................................................................................................... vi I. User Guide ............................................................................................................................. 1 1. A Geographic Information Management System for all ..................................................... 2 1.1. Introduction ......................................................................................................... 2 What is GeoNetwork opensource ........................................................................ 2 Background and evolution .................................................................................. 2 The use of International Standards ..................................................................... 3 Harvesting geospatial data in a shared environment ............................................. 3 1.2. GeoNetwork and the Open Source Community Development ................................. 3 2. Getting Started ............................................................................................................... 5 2.1. Default Search .................................................................................................... 5 2.2. Searching by Categories ...................................................................................... 6 2.3. Advanced Search ...............................................................................................
    [Show full text]
  • Geonetwork User Manual (PDF)
    GeoNetwork User Manual Release 2.10.4-0 GeoNetwork September 23, 2021 CONTENTS 1 Preface 3 1.1 About this Project............................................3 1.2 License Information...........................................3 1.3 Author Information............................................4 2 Quick Start Guide 5 2.1 Geographic Information Management for all..............................5 2.2 Getting Started..............................................8 2.3 Viewing and Analysing the Data..................................... 21 2.4 Adding a metadata record........................................ 28 2.5 Uploading a New Record using the XML Metadata Insert Tool..................... 46 2.6 Metadata in Spatial Data Management.................................. 50 2.7 New Features............................................... 51 2.8 Installing the software.......................................... 55 2.9 Upgrading to a new Version....................................... 64 3 Administration 65 3.1 System configuration........................................... 65 3.2 Authentication.............................................. 75 3.3 OGC CSW server configuration..................................... 81 3.4 Advanced configuration......................................... 86 3.5 User and Group Administration..................................... 101 3.6 Localization............................................... 107 3.7 System Monitoring............................................ 108 4 Managing Metadata 111 4.1 Templates................................................
    [Show full text]
  • Geonetwork User Manual Release 2.6.4
    GeoNetwork User Manual Release 2.6.4 GeoNetwork May 24, 2011 Contents 1 Preface 3 1.1 About this Project.....................................3 1.2 License Information....................................3 1.3 Author Information.....................................4 2 Quick Start Guide5 2.1 Geographic Information Management for all.......................5 2.2 Getting Started.......................................8 2.3 Viewing and Analysing the Data.............................. 20 2.4 Adding new Data and Information............................. 27 2.5 Entering Metadata for your Map.............................. 34 2.6 Uploading a New Record using the XML Metadata Insert Tool.............. 49 2.7 Metadata in Spatial Data Management........................... 50 2.8 Installing the software................................... 54 3 Administration 61 3.1 Basic configuration..................................... 61 3.2 User and Group Administration.............................. 67 3.3 OGC CSW Server configuration.............................. 72 3.4 Import facilities...................................... 74 3.5 Harvesting......................................... 79 3.6 Metadata ownership.................................... 96 3.7 Templates.......................................... 98 3.8 Thesaurus.......................................... 100 3.9 GeoNetwork’s Administrator Survival Tool - GAST................... 105 3.10 Localization........................................ 108 3.11 Import / export tools.................................... 109 4 Glossary
    [Show full text]
  • Title: Report of the Metadata Catalog Implementation Creator: Matteo
    DOCUMENT INFORMATION Title: Report of the Metadata catalog implementation Creator: Matteo Mazzucato, Qiu Songyin Subject: Installation, setup and tests on metadata catalogue Description: This document describes how to install and setting the CAIQ metadata catalog Publisher: Istituto Zooprofilattico Sperimentale delle Venezie (Italy) Chinese Academy of Inspection and Quarantine (China) Date: 10/07/2016 Identifier: Metadata catalog Language: En Introduction In the previous meeting a scouting session was done in order to define which metadata catalog software would have been to be used for the project. The software named GeoNetwork (https://geonetwork- opensource.org/) was identified as the final solution. GeoNetwork GeoNetwork is a catalog application used to manage spatially referenced resources. It provides powerful metadata editing and search functions as well as an interactive web map viewer. It is currently used in numerous Spatial Data Infrastructure initiatives across the world. The software was selected for several reasons: an open-source solution named GeoNetwork opensource is available; it is constantly supported and maintained by the community; it is an OSGeo Project; it has a dedicated User Interface (UI) for metadata setting and publishing; it may work combined with Geoserver (software that we use in this project to publish spatial data). Installation During the training, under the supervision of Prof. Massimo Rumor, a dedicated Virtual Machine (VM) was activated in order to prepare a safe environment for installing and testing different software. The same was built locally in order to test configuration in different computers (not server) to test and verify the SO compatibility. To install GeoNetwork the WAR file method was applied.
    [Show full text]
  • Establishing a CSW Metadata Catalogue with Geonetwork Opensource
    International Coastal Atlas Network Cookbook: Establishing a CSW metadata catalogue with GeoNetwork opensource Table of Contents Introduction ............................................................................................................................................3 What is a metadata catalogue?................................................................................................................3 What is CSW? ..........................................................................................................................................3 CSW Application Profiles..........................................................................................................................3 CSW Servers ............................................................................................................................................4 Installing and configuring GeoNetwork 2.6.4 ...........................................................................................4 Installing GeoNetwork 2.6.4.................................................................................................................5 Configuring the database for GeoNetwork 2.6.4 ..................................................................................5 Starting GeoNetwork 2.6.4 ..................................................................................................................7 Stopping GeoNetwork 2.6.4.................................................................................................................7
    [Show full text]