INNOVATION ACTION H2020 GRANT AGREEMENT NUMBER: 825171 WP3 – Vision Materialisation and Technical Infrastructure D3.5 – Design and implementation of P2P infrastructure Document Info Contractual Delivery Date: 31/12/2019 Actual Delivery Date: 31/12/2019 Responsible Beneficiary: INOV Contributing Beneficiaries: UoG Dissemination Level: Public Version: 1.0 Type: Final This project has received funding from the European Union’s H2020 research and innovation programme under the grant agreement No 825171 ` DOCUMENT INFORMATION Document ID: D3.5: Design and implementation of P2P infrastructure Version Date: 31/12/2019 Total Number of Pages: 36 Abstract: This deliverable describes the EUNOMIA P2P infrastructure, its design, the EUNOMIA P2P APIs and a first implementation of the P2P infrastructure and the corresponding APIs made available for the remaining EUNOMIA modules to start integration (for the 1st phase). Keywords: P2P design, P2P infrastructure, IPFS AUTHORS Full Name Beneficiary / Organisation Role INOV INESC INOVAÇÃO INOV Overall Editor University of Greenwich UoG Contributor REVIEWERS Full Name Beneficiary / Organisation Date University of Nicosia UNIC 23/12/2019 VERSION HISTORY Version Date Comments 0.1 13/12/2019 First internal draft 0.6 22/12/2019 Complete draft for review 0.8 29/12/2019 Final draft following review 1.0 31/12/2019 Final version to be released to the EC Type of deliverable PUBLIC Page | ii H2020 Grant Agreement Number: 825171 Document ID: WP3 / D3.5 EXECUTIVE SUMMARY This deliverable describes the P2P infrastructure that has been implemented during the first phase of the EUNOMIA to provide decentralized support for storage, communication and security functions. It starts with a review of the main existing P2P technologies, where each one is analysed and a selection of candidates are selected to be used in the project. This set of technologies consolidated, are characterized, compared, and their features are matched with the project requirements, extracted from the user requirements (described in D2.4), the functional and non-functional technical requirements (described in D3.1), extended with additional non-functional support requirements. In the end it’s showed why IPFS is selected, among them, as the P2P shared stored solution selected for EUNOMIA. Given the selected technology, the anatomy of a EUNOMIA P2P node is also presented here, where the different layers are detailed and explained including the high-level storing API used by other node components and the low-level P2P components. Besides the description of the low- level P2P components that run a node, a global view is presented, explaining how nodes connect among them to form a global shared storage pool. Limitations and challenges stemming from the selection of technologies are also discussed, that impacts the design and implementation of security and privacy framework (described in D3.3). For some of the challenges described, some solutions are already presented in this document, while other ones will be solved along the duration of the Task 3.5. @Copyright of EUNOMIA Consortium Page iii ` TABLE OF CONTENTS DOCUMENT INFORMATION ........................................................................................................ ii AUTHORS......................................................................................................................................... ii REVIEWERS ...................................................................................................................................... ii VERSION HISTORY ......................................................................................................................... ii Executive Summary ....................................................................................................................... iii Table of Contents .......................................................................................................................... iv LIST of Figures ................................................................................................................................. v LIST of Tables ................................................................................................................................. vi List of Acronyms and Abbreviations ......................................................................................... vii 1. INTRODUCTION .....................................................................................................................8 1.1 Scope and objectives of the deliverable ................................................................................ 8 1.2 Structure of the deliverable ...................................................................................................... 8 1.3 Relation to Other Tasks and Deliverables .............................................................................. 9 2. P2P Goals............................................................................................................................... 10 2.1 EUNOMIA Data requirements ................................................................................................ 10 2.2 Goals ........................................................................................................................................... 12 3. P2P State of the art .............................................................................................................. 13 Unstructured P2P ........................................................................................................................................... 13 Structured P2P ................................................................................................................................................ 14 3.1 Existing technologies ............................................................................................................... 16 3.2 Comparison matrices ............................................................................................................... 17 3.3 Selected technologies ............................................................................................................. 21 4. P2p Infrastructure ............................................................................................................... 24 4.1 P2P Node ...................................................................................................................................24 4.2 P2P Network ............................................................................................................................. 26 5. P2P Node API ...................................................................................................................... 28 5.1 Operations ................................................................................................................................. 28 5.2 Overall integration ................................................................................................................... 28 Type of deliverable PUBLIC Page | iv H2020 Grant Agreement Number: 825171 Document ID: WP3 / D3.5 6. Limitations and challenges ................................................................................................ 30 6.1 Known limitations ..................................................................................................................... 30 6.2 Possible solutions ..................................................................................................................... 31 7. Conclusions .......................................................................................................................... 33 8. References ............................................................................................................................ 34 LIST OF FIGURES Figure 1 : Overview of the P2P network architecture. .................................................................................. 24 Figure 2: Anatomy of a P2P EUNOMIA node. ................................................................................................ 25 Figure 3: Content based addressing used in IPFS. ........................................................................................ 26 Figure 4: PSP Network with 3 blocks with a replication factor of 2......................................................... 27 Figure 5: EUNOMIA nodes. ................................................................................................................................... 29 Figure 6: Storage data flow. ................................................................................................................................. 29 @Copyright of EUNOMIA Consortium Page v ` LIST OF TABLES Table 1: EUNOMIA P2P requirements. .............................................................................................................. 10 Table 2: Additional technical requirements. ..................................................................................................... 11 Table 3: P2P Storage functions............................................................................................................................ 12 Table 4: Analysed P2P technologies. ................................................................................................................. 16 Table 5: P2P protocols classification. ................................................................................................................