European Data Grant agreement number: RI-283304 D5.1.1: Technology Appraisal Report Author(s) Claudio Cacciari, CINECA Status Final Version v.1.0 Date 27/07/2012 Abstract: EUDAT is a project in which user communities play a prominent role in defining the collaborative data infrastructure (CDI) and are actively involved in the requirements gathering and in building and shaping the common data services which are deployed and operated at the service provider partner sites. This process is the backbone of EUDAT which fosters the assurance that EUDAT delivers services which are needed and actively used by the user communities and beyond. Within the project a technology appraisal is performed with the purpose to identify and utilise available technologies and tools to implement the required services and to identify gaps and market failures that should be addressed within the joint research activities. The present document reports about the work done in accordance with the project plan and it outlines the achievements gained by the technology appraisal task during the first ten project months. EUDAT – 283304 D5.1.1: Technology Appraisal Report Document identifier: EUDAT-DEL-WP5-D5.1.1 Deliverable lead CINECA Related work package WP5 Author(s) Claudio Cacciari (CINECA) Contributor(s) Mark van de Sanden (SARA), Giuseppe Fiameni, Giacomo Mariani (CINECA), Jens Jensen (STFC), Jedrzej Rybicki, Morris Riedel (JSC), Maciej Brzezniak (PSNC), Erwin Laurie (SNIC), Elena Erastova (RZG), Frank Toussaint (DKRZ), Marion Massol (CINES) Due date of deliverable 31/07/2012 Actual submission date 30/07/2012 Reviewed by Ian Bird (CERN), Yvonne Kustermann (MPI-M) Approved by PMO Dissemination level PUBLIC Website www.eudat.eu Call FP7-INFRA-2011-1.2.2 Project number 283304 Instrument CP-CSA Start date of project 01/10/2011 Duration 36 months Disclaimer: The content of the document herein is the sole responsibility of the publishers and it does not necessarily represent the views expressed by the European Commission or its services. While the information contained in the document is believed to be accurate, the author(s) or any other participant in the EUDAT Consortium make no warranty of any kind with regard to this material including, but not limited to the implied warranties of merchantability and fitness for a particular purpose. Neither the EUDAT Consortium nor any of its members, their officers, employees or agents shall be responsible or liable in negligence or otherwise howsoever in respect of any inaccuracy or omission herein. Without derogating from the generality of the foregoing neither the EUDAT Consortium nor any of its members, their officers, employees or agents shall be liable for any direct or indirect or consequential loss or damage caused by or arising from any information advice or inaccuracy or omission herein. Copyright © The EUDAT Consortium PUBLIC 2 / 74 EUDAT – 283304 D5.1.1: Technology Appraisal Report TABLE OF CONTENT EXECUTIVE SUMMARY .......................................................................................................................6 1. INTRODUCTION ......................................................................................................................7 1.1. Technology appraisal ........................................................................................................................ 8 2. REQUIREMENT ANALYSIS ...................................................................................................... 10 2.1. Methodology ................................................................................................................................... 10 2.2. Community Data Landscape ........................................................................................................... 10 2.3. Technology assessment .................................................................................................................. 11 2.4. Requirement Matching ................................................................................................................... 12 2.5. Service areas ................................................................................................................................... 12 2.5.1. Safe replication area ............................................................................................................... 12 2.5.2. Dynamic replication area ........................................................................................................ 14 2.5.3. Joint metadata services area .................................................................................................. 16 2.5.4. Simple store area .................................................................................................................... 18 2.5.5. Authentication and authorization area................................................................................... 20 3. TECHNOLOGY ASSESSMENT................................................................................................... 23 3.1. Partners' technology assessment ................................................................................................... 23 3.1.1. Authorization, Authentication and Accounting (AAA) ............................................................ 24 3.1.2. Long Term Preservation (LTP) ................................................................................................. 25 3.1.3. Persistent Identifiers (PIDs)..................................................................................................... 28 3.1.4. Policy Based Replication Systems ........................................................................................... 29 3.1.5. Upload/Download Service ...................................................................................................... 30 3.2. Scientific e-Infrastructure technology assessment ......................................................................... 32 3.2.1. i-Marine, D4Science, D4Science-II .......................................................................................... 33 3.2.2. ESPAS ....................................................................................................................................... 34 3.2.3. GeoSeas ................................................................................................................................... 35 3.2.4. OpenAIREplus .......................................................................................................................... 36 3.2.5. SCIDIP-ES ................................................................................................................................. 36 3.2.6. transPLANT .............................................................................................................................. 37 3.2.7. PaNdata-ODI ........................................................................................................................... 38 3.2.8. ENGAGE ................................................................................................................................... 38 3.2.9. diXA ......................................................................................................................................... 39 3.2.10. AgINFRA .................................................................................................................................. 40 3.2.11. Summary ................................................................................................................................. 40 3.3. Technology watch ........................................................................................................................... 41 3.3.1. Safe replication area ............................................................................................................... 41 3.3.2. Dynamic replication area ........................................................................................................ 42 3.3.3. Joint metadata services area .................................................................................................. 56 3.3.4. Simple store area .................................................................................................................... 57 3.3.5. Authentication and authorization area................................................................................... 58 4. TECHNOLOGIES FOR CANDIDATE SERVICES ............................................................................ 61 4.1. Criteria for the selection ................................................................................................................. 61 4.2. Selected technologies ..................................................................................................................... 62 4.3. Technology and functionality gaps ................................................................................................. 64 4.3.1. Access to PRACE T1 HPC computing service ........................................................................... 65 Copyright © The EUDAT Consortium PUBLIC 3 / 74 EUDAT – 283304 D5.1.1: Technology Appraisal Report 4.3.2. Access Control of the Handle PID system ............................................................................... 66 4.3.3. Persistent Data Object search ability ...................................................................................... 67 4.3.4. Creating user accounts on-demand: Integration