CS ROMANIA SA PACII 29, 200692 CRAIOVA, ROMANIA ISO 9001:2015 OHSAS 18001:2008 TEL: +40 (0)251 412850 FAX: +40 (0)251 417307 EMAIL: [email protected]; WEB: www.c-s.ro ISO 14001:2015 ISO 27001:2013 Date : 8 December 2017 Origin : CS ROMANIA SA Business : Tool Augmentation by User Enhancements and Orchestration (TAO) DESIGN JUSTIFICATION FILE Title : (DJF) Reference : V16ESA0101/DJF0010 version 1.1 Status : APPROVED RESTRICTED CLIENT Last name / First name Date Signature Authors: Ilioiu Alexandru, Fomferra Norman 2017-05-16 Verified by: Udroiu Cosmin 2017-06-19 Approved by: Cara Cosmin 2017-06-20 CS ROMANIA S.A. WITH SUBSCRIBED AND PAID-IN SHARE CAPITAL 114.800 LEI - R.C. DOLJ J16/2041/91 - SIRUES 164431207 - C.F. RO2316981 CS COMMUNICATION & SYSTÈMES date page RESTRICTED TAO 08/12/2017 2 / 15 CLIENT Design Justification File (DJF) reference version V16ESA0101/DJF0010 1.1 SUCCESSIVE VERSIONS Vers. Date Authors Verification Approval Motive 1 16/05/2017 A. Ilioiu, C. Udroiu C. Cara Creation. N. Fomferra 1.1 08/12/2017 C. Cara C. Udroiu C. Cara Updated section 3.10 © Copyright TAO Consortium date page RESTRICTED TAO 08/12/2017 3 / 15 CLIENT Design Justification File (DJF) reference version V16ESA0101/DJF0010 1.1 TABLE OF CONTENTS 1 INTRODUCTION ............................................................................................................................ 4 1.1 PURPOSE AND SCOPE ...................................................................................................................... 4 1.2 STRUCTURE OF THE DOCUMENT ..................................................................................................... 4 1.3 REFERENCES ..................................................................................................................................... 4 1.3.1 Applicable documents ............................................................................................................... 4 1.3.2 Reference documents ................................................................................................................ 4 2 TERMS AND ABBREVIATIONS ........................................................................................................ 5 2.1 TERMS .............................................................................................................................................. 5 2.2 ABBREVIATIONS ............................................................................................................................... 6 3 DESIGN DECISIONS ....................................................................................................................... 8 3.1 GENERAL .......................................................................................................................................... 8 3.2 SYNTHESIS STACK DIAGRAM ............................................................................................................ 8 3.3 PLATFORM GUI ................................................................................................................................ 9 3.4 GUI FOR WORKFLOW DEFINITION ................................................................................................... 9 3.5 RESOURCE / USER CATALOG .......................................................................................................... 10 3.6 DATA VISUALIZATION ..................................................................................................................... 10 3.7 SERVICES CONNECTOR ................................................................................................................... 10 3.8 PROCESSING COMPONENT DEPLOYMENT..................................................................................... 10 3.9 SERVICE LAYER ............................................................................................................................... 11 3.10 CLUSTER MANAGER ....................................................................................................................... 11 3.11 DATA ACCESS CONNECTOR ............................................................................................................ 12 3.12 DATABASE ...................................................................................................................................... 12 3.13 INTEGRATION WITH EXTERNAL PROCESSING PLATFORMS ........................................................... 12 3.14 SNAP TOOLBOX INTEGRATION....................................................................................................... 12 3.14.1 Additional SNAP Operators and Operator Enhancements ...................................................... 13 LIST OF TABLES Table 3-1 : List of operators not available in SNAP .................................................................................... 13 Table 3-2 : List of SNAP operators that should be enhanced ..................................................................... 14 LIST OF FIGURES Figure 1 : High-level overview of the TAO logical model ..............................................................................8 Figure 2 : Stack TAO components and COTS .................................................................................................9 Figure 3 : Comparison between jQuery and react ..................................................................................... 10 © Copyright TAO Consortium date page RESTRICTED TAO 08/12/2017 4 / 15 CLIENT Design Justification File (DJF) reference version V16ESA0101/DJF0010 1.1 1 INTRODUCTION This document represents the Design Justification File (DJF) for the “Tool Augmentation by User Enhancements and Orchestration (TAO)” project funded by the European Space Agency (ESA). 1.1 PURPOSE AND SCOPE The overall objectives for the TAO project are to: 1. Assess the existing software toolboxes, libraries and processing frameworks in order to identify commonalities and reuse scenarios; 2. Query the EO user communities in order to extract a common set of requirements to be fulfilled by the TAO framework; 3. Select the relevant open standards for Machine-to-Machine and Human Machine interfaces that would allow opening the framework to other software toolboxes; 4. Design and develop a software framework for integration and orchestration of heterogeneous processing modules and libraries that would allow the automation and parallelization of processing chains; 5. Define several use case scenarios that would allow demonstrating the effectiveness of the developed framework. The DJF presents the result of all significant design choices, trade-offs, technical analyses, and benchmarking assessments justifying the design of processing components integration and workflow orchestration. It records all relevant information showing that the proposed solutions meet the requirements. 1.2 STRUCTURE OF THE DOCUMENT This document contains the sections that describe: the decisions taken in terms of system design few considerations regarding alternative solutions 1.3 REFERENCES 1.3.1 Applicable documents [A1] – TAO Software Requirements Specification CSRO/DMAS/CC/AI/17/0329 version 1.1 1.3.2 Reference documents [R1] – TAO Statement of Work .................................................... ESA-EOPG-GSTP-SOW-0004 issue 1 rev 1 [R2] – TAO Technical Proposal ....................................................................... CSRO/DMAS/CC/ET/16/0536 [R3] – Software requirements specification (SRS) - DRD ........................................ ECSS-E-ST-40C Annex D [R4] – Technologies, Interfaces and Standards Technical Note ............................ V16ESA0101/TN0001 v1 [R5] – User Survey Technical Note ....................................................................... V16ESA0101/TN0002 v1 [R6] – Software and Tools Technical Note ............................................................ V16ESA0101/TN0003 v1 © Copyright TAO Consortium date page RESTRICTED TAO 08/12/2017 5 / 15 CLIENT Design Justification File (DJF) reference version V16ESA0101/DJF0010 1.1 2 TERMS AND ABBREVIATIONS 2.1 TERMS Term Description Catalog Collection of metadata information about a list of (software) objects. The objects can be stored into a database or a file system. Cloud A service for delivery of on-demand computing resources—everything from applications to data centers—over the internet on a pay-for-use basis. Cluster (computing) Consists of a set of loosely or tightly connected computers that work together so that, in many respects, they can be viewed as a single system. Computer clusters have each node set to perform the same task, controlled and scheduled by software. Data product A descriptor for one or more files. The files represents an EO product, like GeoTIFF raster file, Sentinel-2 collection. Data source Describe how a set of data can be accessed, is an abstract representation of a way to connect to a live set of data (file system, database, stream, webservice, etc) Deployment Process by which the processing components are transferred, installed and configured into a node. Framework Is a universal, reusable software environment that provides particular functionality as part of a larger software platform to facilitate development of software applications, products and solutions. Grid (computing) Is the collection of computer resources from multiple locations to reach a common goal, having each node set to perform a different task/application. Grid computers also tend to be more heterogeneous and geographically dispersed