EOP O&M Metadata Demonstrator Technical Note

Home , OpenSearch

Reference: HMA-S.SPB.D3000.2

Issue: 1 – 13/05/2013

Revision: 2 – 25/04/2014

Distribution Code: Restricted Distribution

HMA-S

EOP O&M Metadata Demonstrator Technical Note

(D3000.2)

Prepared by:

Y. Coene (Spacebel) M.R. Barone (Intecs) M. Nguyen Quang (Spacebel)

25/04/2014

Verified by:

M. Gilles

25/04/2014

Approved by:

Y. Coene

25/04/2014 © Spacebel s.a.

HMA-S EOP O&M Metadata 2 Demonstrator

Abstract This document is the HMA-S EOP O&M Metadata Demonstrator Technical Note. It contains a description of the interfaces and the user manual.

Keywords HMA-S, ESRIN, HMA, Earth Observation, O&M, Demonstrator.

Contract Contractual :  Contract issuer : ESRIN / ASTRIUM-UK Contract n° : 284000 (internal)

Classification General Public : Industry Programme :  Restricted Dispatching Programme : Confidential Programme :

Configuration Configured document :  Non-configured document :

References Reference : HMA-S.SPB.D3000.2 Issue : 1 – 13/05/2013 Revision : 2 – 25/04/2014 Number of Pages : 41

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 3 Demonstrator

Internal Distribution For Name Dept. Copies Information Action Comments

Y. Coene Space 1  For preparation P. Jacques Space 1  For verification M. Gilles Space 1 For information Minh Nguyen Quang Space 1  For preparation Y. Coene Space 1  For approval M.R. Barone Intecs 1  For preparation

S. Gianfranceschi Intecs 1  For preparation V. Demeuse CM 1  For configuration

External Distribution For Name Dept. Copies Information Action Comments

Claudio Gizzi ASTRIUM-UK 1    Pier Giorgio Marchetti ESRIN 1   Andrea Della Vechia ESRIN 1  

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 4 Demonstrator

Document Change Log Issue Issue Date Pages Affected Relevant Information

1.0 13/05/2013 All Initial draft version for HMA-S SRR. 1.1 10/01/2014 All Updated following the demonstrator implementation. 1.2 25/04/2014 4.2 Update the installation of the EOP O&M catalog server. 3.1.2 Correct references.

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 5 Demonstrator

TABLE OF CONTENTS

TABLE OF CONTENTS ...... V

LIST OF FIGURES ...... VII

HMA-S PROJECT - EXECUTIVE SUMMARY ...... VIII

1 INTRODUCTION ...... 10

1.1 Purpose of the Document ...... 10 1.2 Scope of the Document ...... 10 1.3 Readership of the Document ...... 10 1.4 Organisation of the Document ...... 10 1.5 Applicability of the Document ...... 10 1.6 Abbreviations and Acronyms ...... 10 1.7 Definitions ...... 11

2 APPLICABLE AND REFERENCE DOCUMENTS ...... 12

2.1 Applicable Documents ...... 12 2.2 Reference Documents ...... 12

3 DEMONSTRATOR ARCHITECTURE ...... 13

3.1 Component Types ...... 13 3.1.1 H3.1 – EOP O&M Catalog Client ...... 13 3.1.2 H3.2 – EOP O&M Catalog Server ...... 14 3.2 Interfaces ...... 15 3.2.1 IF-HMAS-OpenSearch ...... 15 3.3 Persistent HMA-S Testbed ...... 15

4 SOFTWARE INSTALLATION MANUAL ...... 16

4.1 H3.1 – EOP O&M Catalog Client ...... 16 4.1.1 Prerequisites ...... 16 4.1.2 Installation ...... 16

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 6 Demonstrator

4.1.2.1 Compilation ...... 16 4.1.2.2 Deployment ...... 16 4.1.2.3 Configuration ...... 17 4.1.3 Installation Testing ...... 22 4.1.3.1 Failure cases ...... 22 4.1.3.2 Success cases ...... 24 4.2 H3.2 – EOP O&M Catalog Server ...... 30 4.2.1 Installation ...... 30 4.2.2 Data population ...... 31 4.2.2.1 Metadata insert ...... 31 4.2.2.2 Metadata replace ...... 31 4.2.2.3 Metadata Delete ...... 31

5 USER MANUAL ...... 32

5.1 Using the HMA-S Demonstrator ...... 32 5.1.1 Using the Online Catalog Client ...... 32 5.1.2 Using the Online Catalogue Server ...... 34

ANNEX A: LINUX INSTALLATION ...... 35

ANNEX B: O&M EXAMPLE ...... 38

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 7 Demonstrator

LIST OF FIGURES

Figure 1: Earth Observation Ground Segment Components [RD01] ...... viii Figure 2: Demonstrator Component Types and Interfaces ...... 13 Figure 3: Open-source HMA-S Catalog Client ...... 14 Figure 4: Display of the default catalog client when the page is loaded ...... 25 Figure 5: Selecting the catalog client ...... 25 Figure 6: Selecting the Task 3 catalog client ...... 26 Figure 7: Catalog results with atom:link accessible from the Atom response...... 27 Figure 8: Changing the accessed catalog ...... 27 Figure 9: Catalog results with EOP O&M as foreign mark-up included in the Atom response ...... 28 Figure 10: Search the EOP O&M catalogue with an AOI ...... 29 Figure 11: Catalogue Client ...... 32 Figure 12: Catalogue Selection ...... 33 Figure 13: Catalogue results with O&M links ...... 34

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 8 Demonstrator

HMA-S PROJECT - EXECUTIVE SUMMARY

The state of play of the standardization of the ground segment interfaces for EO missions is described in [RD01] and [RD02]. The figure below, taken from [RD01] highlights the existing space standards, mainly from the European Cooperation for Space Standardisation (ECSS), covering the overall earth observation process, and the interfaces where the harmonization work within the HMA projects is focused.

Figure 1: Earth Observation Ground Segment Components [RD01]

The objective of “Heterogeneous Missions Accessibility” – HMA” is to establish harmonised access to heterogeneous earth observation (EO) missions’ data from multiple mission ground segments, including national missions and ESA Sentinel missions. In practice, the goal of HMA is to standardise the ground segment interfaces of the satellite missions for easier access to EO data. The HMA Architecture Working Group (AWG) has been coordinating the ground segment interface harmonisation activities initiated by the Ground Segment Coordination Body (GSCB). These activities, which were performed under ESA contracts such as HMA-I, HMA-T and most recently HMA-Follow On (HMA-FO) have produced interface specifications standardised through the OGC Consortium. The so-called “HMA Cookbook” [RD02] describes in detail the domains which have been subject to standardisation. The ground segment interfaces covered by HMA-related projects and in various stages of standardisation at the Open Geospatial Consortium (OGC) include:  Dataset (i.e. Product) metadata: OGC 06-080 and OGC 10-157,  Catalogue access (datasets): OGC 06-131, OGC 10-189,

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 9 Demonstrator

 Catalogue access (dataset series and services) OGC 07-038, OGC 08-197,  Feasibility Analysis: OGC 10-135,  Ordering: OGC 06-141,  On-line data access: including EO WMS and EO WCS OGC 10-140 and related specifications OGC 09-110 (WCS 2.0 Core), OGC 09-147 (KVP binding), OGC 09-148 (XML/Post binding), OGC 09-149 (XML/SOAP binding), OGC 11-053 (CRS Extension), etc.  Identity management: OGC 07-118. The HMA-S project is the continuation of the standardisation activities from HMA-T and HMA-FO. The HMA-S project aims to further advance the HMA standardisation activities and address in particular the following interfaces:  Dataset metadata (Task 3),  Catalogue access (datasets, dataset series and services) (Task 4 and 5),  Feasibility analysis (Task 7),  Ordering and product download (Task 4),  Processing (Task 6),  Identity Management (Task 2).

The objectives of the HMA-S demonstrators are on one hand to re-use existing applications to optimise the effort and maintain a set of open-source reference implementations within the scope of HMA. On the other hand, the demonstrators need to be made available as a standalone version for independent download and use; but also integrated into the HMA-S Test Bed for online access. In response to these two challenges, Astrium and Spacebel are proposing demonstrators relying on previous implementation and relevant to the ongoing projects or specification to implement. The Identity Management, EO metadata and ebRIM CIM demonstrators will be based on previous developments from HMA-T for Identity Management and ERGO (Buddata) and SMAAD for the EO metadata and the CIM EP Demonstrators. The OpenSearch extensions and Web Processing Service demonstrator will reuse MapShup and the DREAM Multi-Mission Feasibility Analysis components.

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 10 Demonstrator

1 INTRODUCTION

1.1 Purpose of the Document

This document is the “EOP O&M Metadata Service Demonstrator” Technical Note. It is prepared by Spacebel with support from Intecs as a deliverable of WP3300 of the HMA for Science (HMA-S) project. It is identified as HMA-S.SPB.D3000.2 and provides both a description of the native interfaces and the user manual for the demonstrator. The main purpose of the present document is to provide guidance for understanding, deploying and configuring the EOP O&M Metadata Service Demonstrator in the context of HMA-S. It provides references and links to documents and software packages.

1.2 Scope of the Document

This document is deliverable HMA-S.SPB.D3000.2 as identified in WP3300. It satisfies Task 3 I26.3.1 and I26.3.2 requirements in the Statement of Work (SOW) [AD03]. The present document provides the main concepts of the EOP O&M Metadata Service Demonstrator of HMA-S; it explains the role of the different components as well as the ways they can be deployed and configured. The present document does not cover the internal interfaces or the architecture of the individual components.

1.3 Readership of the Document

This document is intended to be read by the HMA-S project team and the ESA Technical Officer. The target audience also includes software architects, system integrators and system administrators.

1.4 Organisation of the Document

This document is organised as follows:  Chapter 1 is the introduction to this document.  Chapter 2 lists the applicable and reference documents.  Chapter 3 describes the high level architecture of the Demonstrator and the main interfaces.  Chapter 4 contains the installation instructions for the Demonstrator.  Chapter 5 is the user manual for the online version of the Demonstrator.

1.5 Applicability of the Document

This document applies to Task 3 of the HMA-S project.

1.6 Abbreviations and Acronyms

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 11 Demonstrator

ATS Abstract test Suite CITE Compliance and Interoperability Testing and Evaluation CTL Conformance Test Language EO Earth Observation EOOS Earth Observation Open Search EOP EO Product ESA European Space Agency ETS Executable Test Suite HMA Heterogeneous Missions Accessibility HMA-FO HMA Follow-On HMA-I HMA-Interoperability HMA-S HMA for Science HTTP HyperText Transport Protocol HTTPS HTTP Secure ICD Interface Control Document O&M Observations and Measurements SP Service Provider XML Extensible Markup Language

1.7 Definitions

None

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 12 Demonstrator

2 APPLICABLE AND REFERENCE DOCUMENTS

2.1 Applicable Documents

The following documents are applicable to the project. In the current document, these documents are referenced as listed below. [AD01] HMA-S Project Management Plan, HMA-S.ASU.D100.1, Issue 1, Revision 0, 25/02/2013. [AD02] ECSS – Space Engineering Standards, ECSS-E-ST-40C, 6 March 2009. [AD03] Statement of Work LTDP-GSEG-EOPG-SW-12-0007, Heterogeneous Missions Accessibility for Science, Issue 1, Revision 0, 13/09/2012. [AD04] EOP-G Technical Baseline, OSMV-OPMT-EOPG-TN-10-0001, Issue 1, revision 2, 28/11/2012. [AD05] HMA-S.GIM.D3000.1: This document corresponds to the updated OGC 10-157r3 document modified as part of the WP 3100 of the HMA-S project. [AD06] OGC 10-157r4, Earth Observation Metadata profile of Observations & Measurements, Version 1.0.4, 06/01/2014. [AD07] OGC 13-026r3 - OGC OpenSearch Extension for Earth Observation Product, produced in HMA-S and corresponding to deliverable HMA-S.TRD.D4000.2. [AD08] OGC 10-032r8 – OpenSearch GeoSpatial and Temporal Extensions, modified in HMA-S and corresponding to deliverable HMA-S.TRD.D4000.1.

2.2 Reference Documents

The following documents provide background reference. In the body of the text these documents are referenced as listed below. [RD01] P.G. Marchetti, “Exploiting Earth Observation Missions: Opportunities and Issues in Ground Segment Interfaces Harmonisation”, October 2008 [RD02] “Heterogeneous Missions Accessibility (HMA), Design methodology, Architecture and Use of geospatial Standards for the Ground Segment Support of Earth Observation Missions”, European Space Agency, ESA TM-21, April 2012, ISBN 978-92-9221-883-6, http://esamultimedia.esa.int/multimedia/publications/TM-21/TM-21.pdf [RD03] HMA-S Identity Management Demonstrator Technical Note, HMA-S.SPB.D2000.3, Issue 1, Revision 2, 25/04/2014.

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 13 Demonstrator

3 DEMONSTRATOR ARCHITECTURE

3.1 Component Types

The figure below shows the Component Types and their interfaces as used in the EOP O&M Metadata Service Demonstrator of HMA-S. The following conventions are used in the diagram below:  Components Ey: identify external components not part of the downloadable HMA-S software.  Components Hx.y: identify HMA-S Demonstrator components which are the output of HMA-S Task x.

H8.1 – TEAM Engine

IF-HMAS-OpenSearch

H3.2 – EO O&M Catalog Server

IF-HMAS-OpenSearch

H3.1 – EO O&M Catalog Client

Figure 2: Demonstrator Component Types and Interfaces

The EOP O&M Metadata Service Demonstrator of HMA-S complies with the revised EOP O&M metadata format [AD05] and a subset of the OGC 13-026 [AD07] and OGC 10-032r4 [AD08] interfaces defined by HMA-S. These interfaces are shown as IF-HMAS-OpenSearch in the figure above. The Demonstrator is based on the components described in the following subsections.

3.1.1 H3.1 – EOP O&M Catalog Client

This component allows a user to search a catalog server compliant with the protocol IF-HMAS- OpenSearch with the objective to obtain EOP O&M metadata records. The demonstrator is an opensource client which:

 Shares DAIL/SSE source code for Catalog clients (same stylesheets).

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 14 Demonstrator

 Same source code as Task 5 Catalog client, different configuration files.

 Has endpoints/bindings which are configurable by the user.

 Can be configured with STS provided by HMA-S User Management STS part of task T2 (see

In the context of HMA-S, this software package can be found, as open-source software, on the google code repository at http://code.google.com/p/hma-catalog-client/.

Figure 3: Open-source HMA-S Catalog Client

3.1.2 H3.2 – EOP O&M Catalog Server

This component is a catalog server (EOOS – Earth Observation Open Search) which products metadata files compliant with [AD05] can be imported and which exposed the interface IF-HMAS- OpenSearch (see beginning of section 3.1).

EOOS is a catalogue server that exposes the interface IF-HMAS-OpenSearch and uses the Apache SOLR (http://lucene.apache.org/solr/) search engine to store and retrieve efficiently the EOP metadata. It is a java Web application running on top of tomcat that convert opensearch requests into solr compliant queries and returns the response messages in ATOM or EOP format. It is mainly based on Apache Velocity (http://velocity.apache.org/) for the generation of the responses and is easily customizable to support additional formats.

In the context of HMA-S, this software package can be found, as open-source software, on the google code repository at location:

https://code.google.com/p/eoos/

A set of EOP O&M metadata files are available for download on the ESA HMA FTP server (link available from the HMA-s wiki page)..

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 15 Demonstrator

3.2 Interfaces

The following interfaces were depicted on the component diagram in the previous section.

3.2.1 IF-HMAS-OpenSearch

Service Discovery Services Category Reference to OGC 13-026r3, specification OGC OpenSearch Extension for Earth Observation Products, 13/12/2013. OGC 10-032r8, OGC OpenSearch GeoSpatial and Temporal Extensions, 05/09/2013. OGC 10-157r4, Earth Observation Metadata profile of Observations & Measurements, Version 1.0.3, 06/01/2014 Standard RFC 4287 The Atom Syndication Format reference http://www.opensearch.org/Specifications/OpenSearch/1.1 http://www.opensearch.org/Specifications/OpenSearch/Extensions/Parameter/1.0/Draft_2 Description This interface supports the discovery of EO products using lightweight REST interfaces. The interface is defined in an OpenSearch Description Document (OSDD) which itself is discoverable through the IF-HMAS-OpenSearch interface. Format Web services over HTTP 1.1 Comment The Service Viewpoint of this HMA-compliant interface is described in detail in section 5.4.8 of [RD02].

3.3 Persistent HMA-S Testbed

The Demonstrator components described in the current document can be downloaded individually by an interested user (See download links in section 3.1.X or can be accessed on-line as they are part of the persistent Testbed at ESRIN. The addresses where the components are accessible are included below:

Id Component Persistent Testbed URL

H3.1 EOP O&M Catalog Client http://hma-s-catalogue.esa.int/catalogueClient/

H3.2 EOP O&M Catalog Server http://hma-s- catalogue.esa.int/catalogueClient/data/eop-om- osdd.xml

The above base URLs are to be agreed with ESA.

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 16 Demonstrator

4 SOFTWARE INSTALLATION MANUAL

The purpose of the present section is to provide references to a set of different software packages that implement the architecture described in the previous chapter. It provides also installation and configuration information to make these packages fit together.

4.1 H3.1 – EOP O&M Catalog Client

4.1.1 Prerequisites

Before starting the installation, the following prerequisites must be satisfied: - A machine with Red Hat Enterprise Linux 6.3 (64-bit) built following Annex A. - Java Development Kit (JDK) version 7. - Apache Tomcat version 6.x (apache-tomcat-6.0.35 is recommended). - Apache Ant tool version 1.8.x (apache-ant-1.8.2 is recommended). - The catalog client source code (file catalogue-client-1.0.zip). - A Linux account that is able to stop/start the Tomcat and execute Ant tool above.

4.1.2 Installation

4.1.2.1 Compilation

To obtain and compile the catalogue client, please follow the steps below: - Sign on to the Linux machine under the account specified in the previous section “Prerequisites”. - Check out the catalog client source code from http://hma-catalog- client.googlecode.com/svn/trunk/ into the directory ~/catalogue-client later referenced as $CATALOGUE_CLIENT_HOME. - Switch to directory $CATALOGUE_CLIENT_HOME/opensource-clients/CIM_EP to run the following command: $>ant - A war file named “catalogueClient.war” should be generated in directory $CATALOGUE_CLIENT_HOME/opensource-clients/CIM_EP/build after compiling successfully.

Alternatively, the catalogueClient.war file can be obtained by - Downloading the catalogueClient-bin-v1.0.zip from - https://drive.google.com/folderview?id=0B4WHm-d_5aovb0NsMG53R0VOSWc&usp=sharing - Unzip that file.

4.1.2.2 Deployment

- Sign on to the Linux machine under the account specified in section Prerequisites.

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 17 Demonstrator

- Create a directory named “catalogueClient” in $TOMCAT_HOME/webapps - Copy “catalogueClient.war” file to the directory $TOMCAT_HOME/webapps/catalogueClient generated at the previous step or downloaded from http://code.google.com/p/hma-catalog-client/source/browse/#svn/trunk/ opensource-clients/CIM_EP/build/ - Run the commands below to extract the catalogueClient.war file to $TOMCAT_HOME/webapps/catalogueClient $>cd $TOMCAT_HOME/webapps/catalogueClient $>unzip catalogueClient.war

4.1.2.3 Configuration

An XML configuration file called “services.xml” located at $TOMCAT_HOME/webapps/catalogueClient/WEB-INF/classes provides necessary descriptions of catalogs that are registered on the client. The following XML document is an example of such configuration file for the current demonstrator.

1 EOP O&M Catalogue (Task 3) ogc-13-026 http://catalogueServerUrl/openCatalogue/service/opensearch/description.xml application/atom+xml true eop_OpenSearch_Search.XSL false

For a I15 catalogue the service entry becomes:

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 18 Demonstrator

The steps below should be followed in order to register a new catalog to the client: - Stop Apache Tomcat - Add a new “service” element that describes all information of the catalog to the services.xml configuration file. See table below for elements details. - Start Apache Tomcat.

The following table describes the catalog client configuration file.

Element Attribute Description service One element for each remote catalog. id Catalog identifier. Any value is accepted but it has to unique. name Service name as it appears in the list of services available in this catalog client. icd Catalog interface name. The current version supports the three following interfaces: - ogc-07-038: CIM Extension Package for ebRIM (ISO/TS 15000-3) Application Profile. - ogc-13-084r1: INSPIRE Conformance Class of OGC I15 (ISO19115 Metadata) Extension Package of CS-W ebRIM Profile. - ogc-13-026: OGC OpenSearch Extension for Earth Observation (OGC 13-026, version 1.0.0). opensearch Only present for OpenSearch catalog.

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 19 Demonstrator

descriptionDocumentURL Location of OpenSearch Description document. responseFormat The MIME type of OpenSearch response. Only value “application/atom+xml” is accepted for this version removeEmptyParams Possible values: true, false. - true: remove all parameters that have empty value before sending to backend. - false: keep parameters with empty values. operation Represented for each operation of the catalog. operation name Operation name that can receive one of following possible values - “Search” : Search operation - “Present” : Present operation For opensearch, there must be a single element with “Search” operation name. xsl Name of style-sheet file that composes XML request for the catalog. Possible values: - “eop_OpenSearch_Search.XSL”: style-sheet file of Search operation of an OpenSearch catalog. - “I15_Catalogue_Search.XSL”: style-sheet file of Search operation of an I15 catalog. - “I15_Catalogue_Present.XSL”: style-sheet file of Present operation of an I15 catalog. - “CIM_EP_Catalogue_Search.XSL”: style- sheet file of Search operation of a CIM EP catalog. - “CIM_EP_Catalogue_Present.XSL”: style- sheet file of Present operation of a CIM EP catalog. binding The protocol that the back-end catalog supports for the operation. Only one of the elements below is accepted as its child node: - soap: SOAP protocol - httpget: HTTP GET protocol - httppost: HTTP POST protocol Should not be present for opensearch. soap SOAP location of the backend. Should not be present for opensearch. soap action SOAP action of the operation. Should not be present for opensearch. httpget HTTP GET location and fixed parameters of the backend.

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 20 Demonstrator

The dynamic parameters should be declared in stylesheet. httppost - HTTP POST location of the backend. aoiRequired - Possible values: - true: AOI in the request is mandatory. - false: AOI in the request is optional.

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 21 Demonstrator

The following text is an example of the OpenSearch Description Document (OSDD). Note that this OSDD contains some information to support the catalogue client side to generate the user interface (selection boxes).

openCaralogue Earth Observation Catalogue This OpenSearch Service allows the discovery of Earth Observation data. This search service is in accordance with the OGC 10-032r8 specification. ESA, Earth Observation, Digital Repository, Digital Earth Communities [email protected] Intecs team Intecs open false en-us UTF-8 UTF-8

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 22 Demonstrator

The OSDD should contain an “Url” element with: - Attribute type=application/atom+xml - Attribute template=backend location with full parameters descriptions. - When applicable, the possible values for the parameters should be declared in Parameter elements. These parameter values are used by the catalogue client to generate a drop-down list for that parameter in Search Input panel.

4.1.3 Installation Testing

4.1.3.1 Failure cases

- Case 1: Writable permission for data directory o Open catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient by web browser. If the following screen is displayed:

o Sign on to the Linux machine under root. o Execute the following command to change permission of data directory: root> chown $TOMCAT_USER $TOMCAT_HOME/webapps/catalogueClient/data . Where $TOMCAT_USER is the account that is using to stop/start the Tomcat (see section 4.1.1). o Restart Apache Tomcat. - Case 2: Service data validation o Open catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient by web browser. If the following screen is displayed:

o Please enter the service identifier as value of element service/id for the services in services.xml file. The service identifier should be unique. o Restart Apache Tomcat. o Open catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient by web browser. If the following screen is displayed:

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 23 Demonstrator

o Please correct the service identifier. It should be unique among the services list in services.xml file o Restart Apache Tomcat. o Open catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient by web browser. If the following screen is displayed:

o Please enter the service name as value of element service/name for the services in services.xml file. o Restart Apache Tomcat. o Open catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient by web browser. If the following screen is displayed:

o Please enter the service interface as value of element service/icd for the services in services.xml file. Possible ICD values are described in the table described in section Configuration 4.1.2.3. . o Restart Apache Tomcat. o Open catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient by web browser. If the following screen is displayed:

o Search operation is mandatory for every service. Please declare it for every service in services.xml file. o Restart Apache Tomcat. - Case 3: OpenSearch Description Document(OSDD) validation o Open catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient by web browser. If the following screen is displayed:

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 24 Demonstrator

o Please enter the OSDD location as value of element service/opensearch/descriptionDocumentURL for that service in services.xml file. o Restart Apache Tomcat. o Open catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient by web browser. If the following screen is displayed:

o Please correct the OSDD location by modifying the value of element service/opensearch/descriptionDocumentURL in services.xml file o Restart Apache Tomcat. o Open catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient by web browser. If the following screen is displayed:

o Please enter string “application/atom+xml” as value of element service/opensearch/responseFormat for OpenSearch services in services.xml file o Restart Apache Tomcat. o Open catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient by web browser. If the following screen is displayed:

o Please check if an URL template with attribute type=”application/atom+xml” exists in the OSDD.

4.1.3.2 Success cases

The installation is successful if steps below return expected results. - Step 1: o Open the catalog client at http://$SERVER_NAME:$SERVER_PORT/catalogueClient with a web browser. o The catalog client home page should be displayed as on the picture below:

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 25 Demonstrator

Figure 4: Display of the default catalog client when the page is loaded

o Click on the default catalog name on the left corner (CIM EP Catalog…), a drop-down list containing the names of available catalogs (as declared in services.xml file) should be shown:

Figure 5: Selecting the catalog client

o Select catalog “EOP O&M Catalogue (Task 3)” from the drop-down list. Verify that the screen is displayed as picture below:

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 26 Demonstrator

Figure 6: Selecting the Task 3 catalog client

o Enter values for the following fields and then click on Search button: . Parent Identifier: ASA_IMM_1P . Start Date: 01/12/2012 . End Date: 09/01/2014 o Verify that search results are displayed as below:

Restricted Distribution HMA-S.SPB.D3000.2 © Spacebel s.a. 1.2 - 25/04/2014

HMA-S EOP O&M Metadata 27 Demonstrator

Figure 7: Catalog results with atom:link accessible from the Atom response

o Check any check box in the search result. Verify that the footprint of that record is highlighted in the map. - Step 3: o Click on one “O&M” link and check that the associated EOP O&M metadata is displayed. An example of such returned EOP O&M is provided in Annex B. o This step has demonstrated that the catalog client supports catalog servers returning EOP O&M search results with atom:link accessible from the Atom response. - Step 4: o The service “EOP Catalogue (Task 3)” illustrates the case where a catalog server returns EOP O&M search results with EOP O&M as foreign mark-up included in the Atom response. o Select the service “EOP Catalogue (Task3)” by . Clicking on current catalogue “EOP O&M Catalogue (Task3)” . Select the service “EOP Catalogue (Task3)”

Figure 8: Changing the accessed catalog

o Execute the same query above

HMA-S EOP O&M Metadata 28 Demonstrator

Figure 9: Catalog results with EOP O&M as foreign mark-up included in the Atom response - Step 5: o Use the web map viewer zoom button on the displayed footprint o Draw an AOI around a few footprint to filter the results on that region o Check that the number of results is reduced and that all footprints intersect the AOI.

HMA-S EOP O&M Metadata 29 Demonstrator

Figure 10: Search the EOP O&M catalogue with an AOI

Notice: For opensearch client (EOP O&M Catalogue, FEDEO Catalogue), with parameters that accept integer beside providing an integer as input user can use mathematical notation for ranges to define the intervals as below: [n1,n2]: n1<=queryable<=n2 [n21,n2[: n1<=queryable

For example Provide “20]” to “Cloud cover” means that search for datasets whose cloud coverage is less than or equal to 20.

HMA-S EOP O&M Metadata 30 Demonstrator

Provide “]20,50[” to “Cloud cover” means that search for datasets whose cloud coverage is greater than 20 and less than 50.

4.2 H3.2 – EOP O&M Catalog Server

4.2.1 Installation

The installation procedure foresees the installation of the following components  Tomcat 7  SOLR 4  EOOS package Hereafter we report the required steps.

Step 1: Installing Tomcat 7 Just follow the installation guide reported here:  http://tomcat.apache.org/tomcat-7.0-doc/setup.html Step 2: Download and install the Solr Distribution Download Solr from the following URL:  http://lucene.apache.org/solr/downloads.html Unpack Solr and copy the dist/solr-VERSION.war to APACHE_TOMCAT/webapps folder. You can rename it to solr.war to prevent it from being accessible from http://TOMCAT_IP/solr-VERSION Edit the file APACHE_TOMCAT/bin/catalina.sh and add the following at the beginning of the script, just after the inital description: export JAVA_OPTS="$JAVA_OPTS -Dsolr.solr.home=/opt/solr" Download the Java Topology Suite version 1.13 from the following website:  http://sourceforge.net/projects/jts-topo-suite/ Unpack it and copy all libraries in lib into the APACHE_TOMCAT/lib folder. This will allow Tomcat load needed libraries at startup. Download the core definition form the link below and unpack it under /opt  https://drive.google.com/file/d/0B8-nHOAQqENuZm9sM2p5UHIzQ2M/edit?usp=sharing You can now start Tomcat as root user. Step 3: Download and unzip the EOOC package Shut down tomcat and download the latest version of EOOS from the following URL:  https://drive.google.com/file/d/0B8-nHOAQqENuX3lDNGtLaXROc3c/edit?usp=sharing Copy war file under APACHE_TOMCAT/webapps. Download the eoos workspace from the following URL:  https://drive.google.com/file/d/0B8-nHOAQqENuR0Jydl96UVVoSjQ/edit?usp=sharing Unpack it under a folder of your choice (now on referred as EOOS_WORKSPACE).

HMA-S EOP O&M Metadata 31 Demonstrator

Open the file EOOS_WORKSPACE/misc/config.properties Update the value of “solr.url” field to the address where solr is installed in step 2.

Edit the file APACHE_TOMCAT/bin/catalina.sh and add the following at the beginning of the script, just after the inital description: export JAVA_OPTS="$JAVA_OPTS -Deoos.workspace=EOOS_WORKSPACE" Edit the following file EOOS_WORKSPACE/misc/config.properties and set the variable solr.url accordingly to the Solr installation. Restart Tomcat

4.2.2 Data population

4.2.2.1 Metadata insert

The metadata can be inserted in the catalog by simply putting (using the http “put”) the metadata at the following URL  http://your_host/eoos/service/xml/oem The method will return back an ID that can be used in the following REST operations

4.2.2.2 Metadata replace

The metadata can be updated in the catalog by simply posting (using the http “post”) the metadata at the following URL  http://your_host/eoos/service/xml/oem/[ID_RETURNED_BY_THE_INSERT]

4.2.2.3 Metadata Delete

The metadata can be deleted in the catalog by simply performing a REST delete at the following URL  http://your_host/eoos/metadata/[ID_RETURNED_BY_THE_INSERT]

HMA-S EOP O&M Metadata 32 Demonstrator

5 USER MANUAL

5.1 Using the HMA-S Demonstrator

The purpose of the present section is to show how to use the HMA-S Demonstrator installed at ESA, which is an integrated installation of the afore-mentioned components. The URL to access the HMA-S T3 Demonstrator installed at ESRIN is provided in section 3.3.

5.1.1 Using the Online Catalog Client

After typing the URL of the HMA-S Catalog Client in your browser, the following page will be displayed.

Figure 11: Catalogue Client

To connect the catalogue client to another registered catalogue server, you have to click on the currently connected catalogue (“CIM EP Catalogue…” in the previous screen) to display the selection box and to select a T3 Catalogue client such as “EOP O&M Catalogue (Task3)”.

HMA-S EOP O&M Metadata 33 Demonstrator

Figure 12: Catalogue Selection

On the left side, below the selected service, the you can remove displayed queryables by clicking on the red cross or add queryables by clicking on the “Choose more queryables”. You can also reduce the search geographical area by drawing an area of interest on the map. When the queryables have been selected and possibly filled, click on the “Search” button to submit the search request. The retrieved results are displayed below the map with the associated footprints on the map. Once the results are displayed, you can check and uncheck the left boxes associated to the results to highlight and de-highlight the associated footprint on the map. You can also click on the Metadata O&M link that is the foreign markup included in the Atom response to display the EOP O&M. An example is provided in Annex B.

HMA-S EOP O&M Metadata 34 Demonstrator

Figure 13: Catalogue results with O&M links

5.1.2 Using the Online Catalogue Server

The Online Catalogue opensearch description file URL is provided in section 3.3.

HMA-S EOP O&M Metadata 35 Demonstrator

ANNEX A: LINUX INSTALLATION

The file below is the Kickstart file used to setup the Red Hat Entreprise Linux 6.3 (64bit) installation on the Virtual Machine for the HMA-S catalog clients for ebRIM CIM and EOP O&M Metadata demonstrators. This version of the Operating System is compliant with the applicable EOP-G Baseline [AD04].

1) After installation with the Kickstart file you must update Java to version 7:

# rpm –Uvh jdk-7u7-linux-x64.rpm

2) Add packages for Tomcat 6 that are not on the Operating System DVD:

# rpm -ivh xalan-j2-2.7.0-9.8.el6.noarch.rpm # rpm -ivh apache-tomcat-apis-0.1-1.el6.noarch.rpm # rpm -Uvh tomcat6-6.0.24-52.el6_4.noarch.rpm tomcat6-lib-6.0.24-52.el6_4.noarch.rpm \ tomcat6-jsp-2.1-api-6.0.24-52.el6_4.noarch.rpm tomcat6-el-2.1-api-6.0.24- 52.el6_4.noarch.rpm \ tomcat6-servlet-2.5-api-6.0.24-52.el6_4.noarch.rpm # rpm -Uvh jakarta-taglibs-standard-1.1.1-11.4.el6.noarch.rpm # rpm -ivh tomcat6-webapps-6.0.24-52.el6_4.noarch.rpm # rpm -ivh tomcat6-admin-webapps-6.0.24-52.el6_4.noarch.rpm

# Kickstart file automatically generated by anaconda.

#version=DEVEL install cdrom lang en_US.UTF-8 keyboard be-latin1 network --onboot yes --device eth0 --bootproto dhcp --noipv6 rootpw --iscrypted $1$Ne/ICc9q$noHCWTAGzHNI0eU1hqgkq/ # System services services --disabled="autofs,sendmail,rhnsd,cups,netfs,nfslock,kudzu,crond,portmap" firewall --port=22:tcp --service=http --service=ssh --service=smtp authconfig --enableshadow --passalgo=sha512 selinux --enforcing timezone --utc Europe/Brussels bootloader --location=mbr --driveorder=sda --append="crashkernel=auto rhgb rhgb quiet quiet" -- password=$1$VVPB9Dhs$JsCpc1EZx.1ugExvatawI0

HMA-S EOP O&M Metadata 36 Demonstrator

# The following is the partition information you requested # Note that any partitions you deleted are not expressed # here so unless you clear all partitions first, this is # not guaranteed to work #clearpart --linux --drives=sda #volgroup VG0 --pesize=32768 pv.008005 #logvol /data --fstype=ext4 --name=lv_data --vgname=VG0 --size=8192

#part /boot --fstype=ext3 --size=100 #part / --fstype=ext3 --size=20000 #part swap --size=3000

#part pv.008005 --grow --size=1

%packages @Base @Core @base @basic-desktop @client-mgmt-tools @console-internet @core @debugging @desktop-debugging @desktop-platform @directory-client @fonts @general-desktop @graphical-admin-tools @hardware-monitoring @internet-browser @java-platform @kde-desktop @large-systems @legacy-x @network-file-system-client @performance @perl-runtime @php @server-platform @server-policy @system-admin-tools @turbogears @web-server @web-servlet @x11 abrt-gui certmonger crypto-utils genisoimage krb5-workstation libXmu

HMA-S EOP O&M Metadata 37 Demonstrator mtools neon oddjob pam_krb5 pax perl-CGI perl-DBD-SQLite python-dmidecode qt-mysql screen sgpio subversion system-config-lvm system-config-network-tui wireshark-gnome wodim xorg-x11-xdm xterm -amtu -bluez-utils -iscsi-initiator-utils -jwhois -rp-pppoe -rsh -stunnel -telnet -vnc-server -words -ypbind

%end

HMA-S EOP O&M Metadata 38 Demonstrator

ANNEX B: O&M EXAMPLE 2011-02-04T06:27:52.000Z 2011-02-04T06:34:08.000Z ENVISAT ASAR RADAR NA IS6 46701 DESCENDING S HH

HMA-S EOP O&M Metadata 39 Demonstrator

48.7817 56.0905 48.9048 54.9964 26.7292 50.1979 26.5951 51.0025 48.7817 56.0905 QUICKLOOK epsg:4326 1.0 73039227 ASA_IMM_1PNPDE20110204_062752_000003763099_00135_46701_6747.N1 ASA_IMM_1P NOMINAL DEFAULT SAR ARCHIVED PDHS-E

HMA-S EOP O&M Metadata 40 Demonstrator

PDHS-E 2011-02-04T06:48:13.000Z ASAR/5.04 NOMINAL

Last page of: Reference: 41 pages HMA-S.SPB.D3000.2

Program: Issue: HMA-S 1 - 13/05/2013

Project: Revision: EOP O&M Metadata Demonstrator 2 - 25/04/2014 Technical Note Document Distribution Code: (D3000.2) Restricted Distribution

Spacebel s.a./n.v. BE-0435.536.532

Web : www.spacebel.be Mail : [email protected]

Liège

Liège Science Park, Rue des Chasseurs Ardennais, 4 B-4031 Angleur (Belgium) Tel : + 32 4 361 81 11 Fax : + 32 4 361 81 20

Brussels

I. Vandammestraat 7 B-1560 Hoeilaart (Belgium) Tel : + 32 2 658 20 11 Fax : + 32 2 658 20 90

Toulouse

Spacebel France 6, Voie l’Occitane BP 87671 F-31676 LABEGE CEDEX (France) Tel : + 33 5 61 00 35 44

Fax : + 33 5 61 00 20 31