Example of ReportNet (XML to Database) InfoRAC visit 2017

Jan Bliki, Copenhagen 19-21 April 2017 Data Data Data management planning collection Data acquisition Data processing Data dissemination

Content registry – CR (SPARQL) Data warehouse (Geonetworks) Public web (Google) Reporting Data dictionary - obligation DD European data monitoring (Tableau Server, ArcGis Online) Data dissemination database - ROD (MySQL, JAVA) (MySQL, JAVA) (Plone)

Central data repository - CDR (ZoDB, Zope) Common Workspace Storage National (MS SQL, NTFS) Data flow deliveries Interactive data viewers preparatio Workflow configuration (ArcGis online, Tableau, Workflow configuration Daviz, Elastic search, ArcGis n Server) Web forms European data processor and Conversion services extract , clean , conform , deliver Support QA/QC jobs (XSLT,JAVA) (FME Server) apps Collaborated projects (Climate Adapt, BISE Data analysis WISE, PRTR,...) ReportNet 2.0 (ArcGis Desktop, Tableau,SQL Server)

National Up-to-date data delivery (fetch services, FTP) system(s) Data streaming Common workspace Information systems LEGEND Reporters Data processing Dataflow managers / helpdesk Data storage Data architects Product owners Human interaction Support systems Data stewards End user tools 3 4 Example how we extract lastest ReportNet envelope per country

Visual overview of processed records

Probe any stage of your workflow

Read/Write over 350+ data sources.

Build in error management

5 Strong in spatial data manipulation

6 Data processing

Cleansing/Wrangling data is the biggest cost

BE

FR Confor Data Extract QC Clean Deliver IT m Dissemination ... FME Desktop / FME Server Enterprise integration

Production server Local desktop Create/update (Automation) Debug/test Schedule solutions Logs Process overview Web enabled

Easy server deployment

8 Data processing

9 CARIS CSAR GDAL Plugin CARIS CSAR Cloud C library cacert.pem CGAL Convex Hull Algorithm FME and Open Source GD Graphics Library gifread LandXML Software Developers Kit Version 1.1 Libcurl Minizip NCSA HDF5 Netcdf OpenSSL PostgreSQL Python Requests-Kerberos SWQ What3Words APACHE Apache ActiveMQ Codec Apache Commons Lang Apache Jakarta Commons IO Apache Apache XALAN-C AWS SDK for Java BigQuery API Client Library for Java HttpClient HttpCore Jackson JSON processor Kerberos-SSPI Log4Qt Mongo C++ Driver Urllib3 License CA Bundle License Zorba XQuery Processor BSD dateutil DSFL GeoHash NumPy PostgreSQL ppRepair pywin GNU LESSER The ESRI FGDB Unix Runtime Library FDO API GEOS (Geometry Engine Open Source) Library GNU libiconv IFC Exporter for Revit Mapnik MariaDB Client Library for C Qt SpatiaLite VRML Plugin for OpenSceneGraph. OpenVRML Library python-ntml3 Qt Bootstrap Expat XML Parsers GDAL/OGR Geospatial10 Data Abstraction Library OpenGIS Simple Features Reference Implementation PyParsing QUESTIONS ?

Jan Bliki, Copenhagen 19-21 April 2017