A Routing Table Insertion (RTI) Attack on Freenet

Total Page:16

File Type:pdf, Size:1020Kb

A Routing Table Insertion (RTI) Attack on Freenet A Routing Table Insertion (RTI) Attack on Freenet Technical Report University of Hawaii at Manoa Project Members Todd Baumeister Yingfei Dong Zhenhai Duan Guanyu Tian Date 9/18/2012 1 Table of Contents 1. Introduction 2. Route Prediction 2.1 Freenet Routing Algorithm 2.2 Route Prediction Model 2.2.1 Introduction 2.2.2 Routing Table 2.2.3 Routing: Next Peer Node 2.2.4 Routing: Complete Path 2.2.5 HTL 2.2.6 Data Retrieval versus Data Insert Routing 2.3. Routing Algorithm Pseudo-Code 3. RTI Attack 3.1. The Attack 3.2. Identifying the Intersect Node 3.3. Keep alive 4. Traceback Attack 4.1 Broadcast Traceback Attack 4.2 Broadcast Traceback Attack with Topology 4.3 Depth First Traceback Attack 4.4. Traceback Attack Uses 5.5 Traceback Algorithm 5. Freenet Testbed 5.1 Testbed Requirements 5.2 VMware Virtual Machines 5.2.1. Firewall/Router 5.2.2. Freenet Virtual Machine Servers 5.2.3. Freenet Data Analysis and Management 5.2.4. Analysis 5.3 Simulation 5.3.1. Simulator Process 5.3.2. Freenet Node Thread i 5.3.3. Analysis 6. Obtaining Freenet Topology 7. Announcement Protocol 8. Experiment Results 8.1. Routing Algorithm 8.1.1. Routing Algorithm Pseudocode 8.1.2. Example Topology 8.1.3. Example: Routing Failure at First Node 8.1.4. Example: Routing Failure at Third Node in Routing Chain 2 8.1.5. Example: Routing Failure at Node Later in Routing Chain 8.2. Route Prediction Model 8.2.1. Prediction Model Accuracy Experiment 8.2.2. Experiment Results 8.3. General Anonymous P2P Properties 8.4. RTI Attack 8.4.1. Manual RTI Attack 8.4.2. RTI Attack Experiment 8.4.3. Experiment Results 8.5. RTI Attack Coverage 8.6. Attack Pair 9. Definitions 10. Resources 3 1. Introduction This document is a technical report about a Routing Table Insertion(RTI) Attack on Freenet. The details of the RTI attack will be discussed along with other components of Freenet that either directly affect or are affected by the RTI attack. In the first few sections, we will describe the different components of the RTI attack and the theory behind them in Section 2, 3, and 4. Then the remaining section 5, 6, 7 and 8 focus on the experiments we performed on the theory we developed in the former sections. There are three major theories that are described in this document. 1) Route prediction in a Freenet network. 2) RTI attack against a Freenet network. 3) A traceback attack that can be enabled by the RTI attack. These central ideas form the base of this document, and the remaining content is here to support them. 4 2. Route Prediction 2.1 Freenet Routing Algorithm Freenet uses a distributed hash table system to store and retrieve information from its network. The routing algorithm that Freenet uses can be characterized as steepest-ascent hill- climbing algorithm. Every node in the Freenet network has a small world view of the entire system, and it will use its limited information to make the best routing decisions that it can. There are several sources [1,2] that describe the details of the routing algorithm. However, the route prediction model described in this document uses the routing algorithm defined in the source code (version 0.7.5) at https://github.com/freenet/fred-staging. It is the most current version of the routing algorithm, and it has a few differences from the design documents. The general Freenet network configuration, storage and retrieval mechanics will be discussed. Also the anonymity contribution from the Freenet routing algorithm will be covered. In a Freenet network, each node operates independently. A node can have a direct connection with up to 40 other nodes. These connected nodes are considered to be direct peers. Each node in Freenet has a node location that is a real number in the range [0,1). Figure 2.1.a depicts how this address range is laid out. This number is used to determine routing paths, and serves as an indicator that the node should store information with a data location close to its node location. A node will use the node locations of all of the peer nodes that are within two hops when it makes routing decisions. This means that potentially a node knows the node location of (Max Direct Peers)2 other nodes. [ Figure 2.1.a: Circular Value Range [ 0, 1 ). Node Locations and Data Locations are this type of value. ] How is information stored and retrieved from the Freenet network? Every piece of information that is inserted into Freenet is hashed into a key. This key is then used to index that piece of information. Freenet takes the key and converts it to a real number in the range [0, 1). This number is the data location for a given piece of information. This data location can then be used in combination with the node location of the nodes to route and store the piece of information. The routing algorithm will try and find the node with the closest node location to the data location for a piece of information. 5 How does Freenet route requests? Every request that is generated in Freenet has a unique identifier called a UID associated with it. The UID is passed with the request so nodes can identify a request that they have already seen. Each request has a data location associated with it. If a node is unable to directly service a request, it will forward the request on to the next peer. The next node will be a direct peer that has the closest node location to the given data location. Requests will be forwarded until the request can be serviced or the hops to live (HTL) reaches zero. The HTL will be decremented each time a request is forwarded. If a request can be serviced, the reply will be sent back down the path it came from to the original sender. How the next node is chosen, how HTL works, and the differences between insert and retrieval request will be discussed in details in the following. How does a node chose the next closest peer to route to? Each Freenet node will look at all its peers that are within two hops. Then based on the node location of those peers it will chose a node that is one hop away as the next peer to route to. An example of how routing works is covered in Section 4. When a node is forwarding a request to the next peer, it will never forward a request to the previous node. The previous node is the peer node that the current node received the request from. Also Freenet will not route to nodes that have already been visited with the current request. Since each node does not know this list of already visited nodes, it will initially send the request. Then if the node returns a ‘reject loop’ message that means the node was an already visited. When a node receives a request, it will check if it has already seen a request with the same UID, and if it has, it replies with a ‘reject loop’ message. A request is forwared until it can be serviced by a node or its HTL reaches 0. HTLs are used to help limit the amount of resources used by a request. Initially the HTL starts out as (Max HTL), which is 18 by default. The HTL is decremented each time that a request is forwarded to another peer node. Two exceptions arewhen HTL is equal to the Max HTL or equal to 1. There is a 50% chance that the HTL will not be decremented when HTL is at the maximum value. There is also a 25% chance that when the HTL is 1 that the HTL will be decremented to 0. Figure 2.1.b shows the probability distribution for the additional hops generated for both of these deterministic HTL mechanisms. The total path length would be the additional hops from each of the probability distributes added to the Max HTL. 6 [ Figure 2.1.b: Probability of Additional Path Length. HTL = Max HTL has a 50% none decrement chance. HTL = 1 has a 75% none decrement chance. Example: There is roughly a 5% chance that the length of the path will be Max HTL + 3 for HTL = Max HTL.] There are mainly two kinds of requests in Freenet. Data retrieval requests are used to get data out of Freenet, and data insert requests are used to insert data into Freenet. The data retrieval request is the simpler of the two, and it will continue to search until a node can service the request or the HTL expires. If the HTL expires, then the request fails. An data insert request is actually comprised of two separate data insert sub-requests. When the HTL on a data insert request reaches the cacheable HTL threshold (Max HTL -3), a new data insert request will be generated. The new request will have all the same parameters (key, HTL, etc). The only difference will be that the new request will have a different UID. Using a new UID causes the visited node set to be cleared. Resetting the visited node set is done to avoid local minimums when inserting. The data insert request will then continue until the HTL expires. A data insert request will permanently store the data being inserted into every node that it passes through where the HTL is cacheable.
Recommended publications
  • PVC Technical Specifications V.1.0
    Pryvate™ Ltd. Functional & Technical Specifications PVC Technical Specifications V.1.0 APRIL 10, 2018 © PRYVATE™ 2018. PRYVATE™ is a suite of security products from Criptyque Ltd. Registered in the Cayman Islands. PRYVATE™ Is a brand wholly owned by CRIPTYQUE Ltd. Pryvate™ Ltd. Functional & Technical Specifications TABLE OF CONTENTS 1 GENERAL INFORMATION 5 1.1 Scope 1.2 Current Platform Summary 2 FUNCTIONAL TECH SPECIFICATIONS 5 2.1 Encrypted Voice Calls (VOIP) 2.2 Off Net Calling 2.3 Secure Conferencing 2.4 Encrypted Video Calls 2.5 Encrypted Instant Message (IM) 2.6 Notification of Screenshots 2.7 Encrypted Email 2.8 Secure File Transfer & Storage 2.9 Pin-Encrypted Mobile Protection 2.10 Multiple Account Management 2.11 Secure managed conversations 2.12 Anti-Blocking 3 HYBRIDIZATION 13 3.1 Voice / Video / Messaging 3.2 File Storage / Archival 3.3 Pryvate Crypto Wallet 3.3.1 Two-Wallet Solution 3.3.2 Three Methods 3.3.3 Enterprise Multi - by Pryvate 3.3.4 Risks of Cryptocurrency Wallets 3.4 Decentralized Email 3.5 Pryvate Dashboard 4 PERFORMANCE REQUIREMENTS 20 4.1 System Maintenance 4.2 Failure Contingencies 4.3 Customization and Flexibility 4.4 Equipment 4.5 Software 4.6 Interface / UI 5 CONCLUSION 21 6 APPENDIX 22 © PRYVATE™ 2018. PRYVATE™ is a suite of security products from Criptyque Ltd. Registered in the Cayman Islands. PRYVATE™ Is a brand wholly owned by CRIPTYQUE Ltd. Pryvate™ Ltd. Functional & Technical Specifications Acronyms: Definitions SCP = Secure Communications Platform Crypto= Cryptocurrency IPFS= Interplanetary File System ZRTP= ("Z" is a reference to its inventor, Zimmermann; "RTP" stands for Real-time Transport Protocol) it is a cryptographic key-agreement protocol to negotiate the keys for encryption between two end points in a Voice over Internet Protocol Diffie-Hellman= A method of securely exchanging cryptographic keys over a public channel and was one of the first public-key protocols as originally conceptualized by Ralph Merkle and named after Whitfield Diffie and Martin Hellman.
    [Show full text]
  • IPFS and Friends: a Qualitative Comparison of Next Generation Peer-To-Peer Data Networks Erik Daniel and Florian Tschorsch
    1 IPFS and Friends: A Qualitative Comparison of Next Generation Peer-to-Peer Data Networks Erik Daniel and Florian Tschorsch Abstract—Decentralized, distributed storage offers a way to types of files [1]. Napster and Gnutella marked the beginning reduce the impact of data silos as often fostered by centralized and were followed by many other P2P networks focusing on cloud storage. While the intentions of this trend are not new, the specialized application areas or novel network structures. For topic gained traction due to technological advancements, most notably blockchain networks. As a consequence, we observe that example, Freenet [2] realizes anonymous storage and retrieval. a new generation of peer-to-peer data networks emerges. In this Chord [3], CAN [4], and Pastry [5] provide protocols to survey paper, we therefore provide a technical overview of the maintain a structured overlay network topology. In particular, next generation data networks. We use select data networks to BitTorrent [6] received a lot of attention from both users and introduce general concepts and to emphasize new developments. the research community. BitTorrent introduced an incentive Specifically, we provide a deeper outline of the Interplanetary File System and a general overview of Swarm, the Hypercore Pro- mechanism to achieve Pareto efficiency, trying to improve tocol, SAFE, Storj, and Arweave. We identify common building network utilization achieving a higher level of robustness. We blocks and provide a qualitative comparison. From the overview, consider networks such as Napster, Gnutella, Freenet, BitTor- we derive future challenges and research goals concerning data rent, and many more as first generation P2P data networks, networks.
    [Show full text]
  • Privacy Enhancing Technologies 2003 an Analysis of Gnunet And
    Privacy Enhancing Technologies 2003 An Analysis of GNUnet and the Implications for Anonymous, Censorship-Resistant Networks Dennis Kügler Federal Office for Information Security, Germany [email protected] 1 Anonymous, Censorship-Resistant Networks • Anonymous Peer-to-Peer Networks – Gnutella • Searching is relatively anonymous • Downloading is not anonymous • Censorship-Resistant Networks – Eternity Service • Distributed storage medium • Attack resistant • Anonymous, Censorship-Resistant Networks – Freenet – GNUnet 2 GNUnet: Obfuscated, Distributed Filesystem Content Hash Key: [H(B),H(E (B))] • H(B) – Content encryption: H(B) – Unambiguous filename: H(E (B)) H(B) • Content replication – Caching while delivering – Based on unambiguous filename • Searchability – Keywords 3 GNUnet: Peer-to-Peer MIX Network • Initiating node – Downloads content • Supplying nodes – Store content unencrypted • Intermediary nodes – Forward and cache encrypted content – Plausible deniability due to encryption • Economic model – Based on credit Query A Priority=20 B – Charge for queries c =c -20 B B - – Pay for responses 4 GNUnet Encoding • DBlocks DBlock DBlock ... DBlock – 1KB of the content – Content hash encrypted • IBlocks IBlock ... IBlock – CHKs of 25 DBlocks – Organized as tree – Content hash encrypted IBlock • RBlock – Description of the content – CHK of the root IBlock RBlock – Keyword encrypted 5 The Attacker Model • Attacker – Controls malicious nodes that behave correctly – Prepares dictionary of interesting keywords – Observes queries and
    [Show full text]
  • Everyone's Guide to Bypassing Internet Censorship
    EVERYONE’S GUIDE TO BY-PASSING INTERNET CENSORSHIP FOR CITIZENS WORLDWIDE A CIVISEC PROJECT The Citizen Lab The University of Toronto September, 2007 cover illustration by Jane Gowan Glossary page 4 Introduction page 5 Choosing Circumvention page 8 User self-assessment Provider self-assessment Technology page 17 Web-based Circumvention Systems Tunneling Software Anonymous Communications Systems Tricks of the trade page 28 Things to remember page 29 Further reading page 29 Circumvention Technologies Circumvention technologies are any tools, software, or methods used to bypass Inter- net filtering. These can range from complex computer programs to relatively simple manual steps, such as accessing a banned website stored on a search engine’s cache, instead of trying to access it directly. Circumvention Providers Circumvention providers install software on a computer in a non-filtered location and make connections to this computer available to those who access the Internet from a censored location. Circumvention providers can range from large commercial organi- zations offering circumvention services for a fee to individuals providing circumven- tion services for free. Circumvention Users Circumvention users are individuals who use circumvention technologies to bypass Internet content filtering. 4 Internet censorship, or content filtering, has become a major global problem. Whereas once it was assumed that states could not control Internet communications, according to research by the OpenNet Initiative (http://opennet.net) more than 25 countries now engage in Internet censorship practices. Those with the most pervasive filtering policies have been found to routinely block access to human rights organi- zations, news, blogs, and web services that challenge the status quo or are deemed threatening or undesirable.
    [Show full text]
  • Threat Modeling and Circumvention of Internet Censorship by David Fifield
    Threat modeling and circumvention of Internet censorship By David Fifield A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Computer Science in the Graduate Division of the University of California, Berkeley Committee in charge: Professor J.D. Tygar, Chair Professor Deirdre Mulligan Professor Vern Paxson Fall 2017 1 Abstract Threat modeling and circumvention of Internet censorship by David Fifield Doctor of Philosophy in Computer Science University of California, Berkeley Professor J.D. Tygar, Chair Research on Internet censorship is hampered by poor models of censor behavior. Censor models guide the development of circumvention systems, so it is important to get them right. A censor model should be understood not just as a set of capabilities|such as the ability to monitor network traffic—but as a set of priorities constrained by resource limitations. My research addresses the twin themes of modeling and circumvention. With a grounding in empirical research, I build up an abstract model of the circumvention problem and examine how to adapt it to concrete censorship challenges. I describe the results of experiments on censors that probe their strengths and weaknesses; specifically, on the subject of active probing to discover proxy servers, and on delays in their reaction to changes in circumvention. I present two circumvention designs: domain fronting, which derives its resistance to blocking from the censor's reluctance to block other useful services; and Snowflake, based on quickly changing peer-to-peer proxy servers. I hope to change the perception that the circumvention problem is a cat-and-mouse game that affords only incremental and temporary advancements.
    [Show full text]
  • Blockchain: an Enabler for Power Market Operations Exploring Potential Uses of Distributed Ledger Technology in the Evolving Georgian Power Market
    BLOCKCHAIN: AN ENABLER FOR POWER MARKET OPERATIONS EXPLORING POTENTIAL USES OF DISTRIBUTED LEDGER TECHNOLOGY IN THE EVOLVING GEORGIAN POWER MARKET USAID GOVERNING FOR GROWTH (G4G) IN GEORGIA 30 May 2019 This publication was produced for review by the United States Agency for International Development. It was prepared by Deloitte Consulting LLP. The author’s views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. BLOCKCHAIN: AN ENABLER FOR POWER MARKET OPERATIONS EXPLORING POTENTIAL USES OF DISTRIBUTED LEDGER TECHNOLOGY IN THE EVOLVING GEORGIAN POWER MARKET USAID GOVERNING FOR GROWTH (G4G) IN GEORGIA CONTRACT NUMBER: AID-114-C-14-00007 DELOITTE CONSULTING LLP USAID | GEORGIA USAID CONTRACTING OFFICER’S REPRESENTATIVE: PHILLIP GREENE AUTHOR(S): SRI SEKAR, JAMES CALLIHAN, AVTANDILI TODUA ACTIVITY AREA: 4420 LANGUAGE: ENGLISH 30 MAY 2019 DISCLAIMER: This publication was produced for review by the United States Agency for International Development. It was prepared by Deloitte Consulting LLP. The author’s views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. USAID | GOVERNING FOR GROWTH (G4G) IN GEORGIA BLOCKCHAIN: AN ENABLER FOR POWER MARKET OPERATIONS i DATA Reviewed by: Giorgi Giorgobiani, Andrea Lora Project Component: Energy Trade Policy Improvement Component Practice Area: Electricity Trading Mechanism (ETM) Key Words: Blockchain,
    [Show full text]
  • CS505: Distributed Systems
    Cristina Nita-Rotaru CS505: Distributed Systems Lookup services. Chord. CAN. Pastry. Kademlia. Required Reading } I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, H. Balakrishnan, Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications, SIGCOMM 2001. } A Scalable Content-Addressable Network S.a Ratnasamy, P. Francis, M. Handley, R. Karp, S. Shenker, SIGCOMM 2001 } A. Rowstron and P. Druschel. "Pastry: Scalable, decentralized object location and routing for large-scale peer-to-peer systems". IFIP/ACM International Conference on Distributed Systems Platforms (Middleware), 2001 } Kademlia: A Peer-to-peer Information System Based on the XOR Metric. P. Maymounkov and D. Mazieres, IPTPS '02 2 DHTs 1: Lookup services Peer-to-Peer (P2P) Systems } Applications that take advantage of resources (storage, cycles, content, human presence) available at the edges of the Internet. } Characteristics: } System consists of clients connected through Internet and acting as peers } System is designed to work in the presence of variable connectivity } Nodes at the edges of the network have significant autonomy; no centralized control } Nodes are symmetric in function 4 DHTs Benefits of P2P and Applications } High capacity: all clients provide resources (bandwidth, storage space, and computing power). The capacity of the system increases as more nodes become part of the system. } Increased reliability: achieved by replicating data over multiple peers, and by enabling peers to find the data without relying on a centralized index server. } Applications:
    [Show full text]
  • A Framework for Identifying Host-Based Artifacts in Dark Web Investigations
    Dakota State University Beadle Scholar Masters Theses & Doctoral Dissertations Fall 11-2020 A Framework for Identifying Host-based Artifacts in Dark Web Investigations Arica Kulm Dakota State University Follow this and additional works at: https://scholar.dsu.edu/theses Part of the Databases and Information Systems Commons, Information Security Commons, and the Systems Architecture Commons Recommended Citation Kulm, Arica, "A Framework for Identifying Host-based Artifacts in Dark Web Investigations" (2020). Masters Theses & Doctoral Dissertations. 357. https://scholar.dsu.edu/theses/357 This Dissertation is brought to you for free and open access by Beadle Scholar. It has been accepted for inclusion in Masters Theses & Doctoral Dissertations by an authorized administrator of Beadle Scholar. For more information, please contact [email protected]. A FRAMEWORK FOR IDENTIFYING HOST-BASED ARTIFACTS IN DARK WEB INVESTIGATIONS A dissertation submitted to Dakota State University in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Cyber Defense November 2020 By Arica Kulm Dissertation Committee: Dr. Ashley Podhradsky Dr. Kevin Streff Dr. Omar El-Gayar Cynthia Hetherington Trevor Jones ii DISSERTATION APPROVAL FORM This dissertation is approved as a credible and independent investigation by a candidate for the Doctor of Philosophy in Cyber Defense degree and is acceptable for meeting the dissertation requirements for this degree. Acceptance of this dissertation does not imply that the conclusions reached by the candidate are necessarily the conclusions of the major department or university. Student Name: Arica Kulm Dissertation Title: A Framework for Identifying Host-based Artifacts in Dark Web Investigations Dissertation Chair: Date: 11/12/20 Committee member: Date: 11/12/2020 Committee member: Date: Committee member: Date: Committee member: Date: iii ACKNOWLEDGMENT First, I would like to thank Dr.
    [Show full text]
  • Practical Anonymous Networking?
    gap – practical anonymous networking? Krista Bennett Christian Grothoff S3 lab and CERIAS, Department of Computer Sciences, Purdue University [email protected], [email protected] http://www.gnu.org/software/GNUnet/ Abstract. This paper describes how anonymity is achieved in gnunet, a framework for anonymous distributed and secure networking. The main focus of this work is gap, a simple protocol for anonymous transfer of data which can achieve better anonymity guarantees than many traditional indirection schemes and is additionally more efficient. gap is based on a new perspective on how to achieve anonymity. Based on this new perspective it is possible to relax the requirements stated in traditional indirection schemes, allowing individual nodes to balance anonymity with efficiency according to their specific needs. 1 Introduction In this paper, we present the anonymity aspect of gnunet, a framework for secure peer-to-peer networking. The gnunet framework provides peer discovery, link encryption and message-batching. At present, gnunet’s primary application is anonymous file-sharing. The anonymous file-sharing application uses a content encoding scheme that breaks files into 1k blocks as described in [1]. The 1k blocks are transmitted using gnunet’s anonymity protocol, gap. This paper describes gap and how it attempts to achieve privacy and scalability in an environment with malicious peers and actively participating adversaries. The gnunet core API offers node discovery, authentication and encryption services. All communication between nodes in the network is confidential; no host outside the network can observe the actual contents of the data that flows through the network. Even the type of the data cannot be observed, as all packets are padded to have identical size.
    [Show full text]
  • Zeronet Presentation
    ZeroNet Decentralized web platform using Bitcoin cryptography and BitTorrent network. ABOUT ZERONET Why? Current features We believe in open, free, and ◦ Real-time updated sites uncensored network and communication. ◦ Namecoin .bit domain support ◦ No hosting costs ◦ Multi-user sites Sites are served by visitors. ◦ Password less, Bitcoin's BIP32- ◦ Impossible to shut down based authorization It's nowhere because it's ◦ Built-in SQL server with P2P data everywhere. synchronization ◦ No single point of failure ◦ Tor network support Site remains online so long as at least 1 peer serving it. ◦ Works in any browser/OS ◦ Fast and works offline You can access the site even if your internet is unavailable. HOW DOES IT WORK? THE BASICS OF ASYMMETRIC CRYPTOGRAPHY When you create a new site you get two keys: Private key Public key 5JNiiGspzqt8sC8FM54FMr53U9XvLVh8Waz6YYDK69gG6hso9xu 16YsjZK9nweXyy3vNQQPKT8tfjCNjEX9JM ◦ Only you have it ◦ This is your site address ◦ Allows you to sign new content for ◦ Using this anyone can verify if the your site. file is created by the site owner. ◦ No central registry ◦ Every downloaded file is verified, It never leaves your computer. makes it safe from malicious code inserts or any modifications. ◦ Impossible to modify your site without it. MORE INFO ABOUT CRYPTOGRAPHY OF ZERONET ◦ ZeroNet uses the same elliptic curve based encryption as in your Bitcoin wallet. ◦ You can accept payments directly to your site address. ◦ Using the current fastest supercomputer, it would take around 1 billion years to "hack" a private key. WHAT HAPPENS WHEN YOU VISIT A ZERONET SITE? WHAT HAPPENS WHEN YOU VISIT A ZERONET SITE? (1/2) 1 Gathering visitors IP addresses: Please send some IP addresses for site 1EU1tbG9oC1A8jz2ouVwGZyQ5asrNsE4Vr OK, Here are some: 12.34.56.78:13433, 42.42.42.42:13411, ..
    [Show full text]
  • The Book of Swarm Storage and Communication Infrastructure for Self-Sovereign Digital Society Back-End Stack for the Decentralised Web
    the book of Swarm storage and communication infrastructure for self-sovereign digital society back-end stack for the decentralised web Viktor Trón v1.0 pre-release 7 - worked on November 17, 2020 the swarm is headed toward us Satoshi Nakamoto ii CONTENTS Prolegomena xi Acknowledgments xii i prelude 1 the evolution2 1.1 Historical context 2 1.1.1 Web 1.02 1.1.2 Web 2.03 1.1.3 Peer-to-peer networks 6 1.1.4 The economics of BitTorrent and its limits 7 1.1.5 Towards Web 3.08 1.2 Fair data economy 12 1.2.1 The current state of the data economy 12 1.2.2 The current state and issues of data sovereignty 13 1.2.3 Towards self-sovereign data 15 1.2.4 Artificial intelligence and self-sovereign data 16 1.2.5 Collective information 17 1.3 The vision 18 1.3.1 Values 18 1.3.2 Design principles 19 1.3.3 Objectives 19 1.3.4 Impact areas 20 1.3.5 The future 21 ii design and architecture 2 network 25 2.1 Topology and routing 25 2.1.1 Requirements for underlay network 25 2.1.2 Overlay addressing 26 2.1.3 Kademlia routing 27 2.1.4 Bootstrapping and maintaining Kademlia topology 32 2.2 Swarm storage 35 2.2.1 Distributed immutable store for chunks 35 2.2.2 Content addressed chunks 38 2.2.3 Single-owner chunks 41 2.2.4 Chunk encryption 42 2.2.5 Redundancy by replication 43 2.3 Push and pull: chunk retrieval and syncing 47 iii 2.3.1 Retrieval 47 2.3.2 Push syncing 51 2.3.3 Pull syncing 53 2.3.4 Light nodes 55 3 incentives 57 3.1 Sharing bandwidth 58 3.1.1 Incentives for serving and relaying 58 3.1.2 Pricing protocol for chunk retrieval 59 3.1.3 Incentivising push-syncing
    [Show full text]
  • CS 552 Peer 2 Peer Networking
    CS 552 Peer 2 Peer Networking R. Martin Credit slides from B. Richardson, I. Stoica, M. Cuenca Peer to Peer • Outline • Overview • Systems: – Gnutella – Freenet – Chord – PlanetP Why Study P2P • Huge fraction of traffic on networks today – >=50%! • Exciting new applications • Next level of resource sharing – Vs. timesharing, client-server, P2P – E.g. Access 10’s-100’s of TB at low cost. P2P usage • CMU network (external to world), 2003 • 47% of all traffic was easily classifiable as P2P • 18% of traffic was HTTP • Other traffic: 35% – Believe ~28% is port- hopping P2P • Other sites have a similar distribution Big Picture • Gnutella – Focus is simple sharing – Using simple flooding • Bit torrent – Designed for high bandwidth • PlanetP – Focus on search and retrieval – Creates global index on each node via controlled, randomized flooding • Cord – Focus on building a distributed hash table (DHT) – Finger tables Other P2P systems • Freenet: – Focus privacy and anonymity – Builds internal routing tables • KaaZa • eDonkey • Napster – Success started the whole craze Key issues for P2P systems • Join/leave – How do nodes join/leave? Who is allowed? • Search and retrieval – How to find content? – How are metadata indexes built, stored, distributed? • Content Distribution – Where is content stored? How is it downloaded and retrieved? Search and Retrieval • Basic strategies: – Flooding the query – Flooding the index – Routing the query • Different tradeoffs depending on application – Robustness, scalability, legal issues Flooding the Query (Gnutella) N3 Lookup(“title”) N1 N2 N4 N5 Key=title N8 N6 Value=mp3 N7 Pros: highly robust. Cons: Huge network traffic Flooding the Index (PlanetP) Key1=title1 N3 N1 Key2=title2 N2 N4 N5 Lookup(“title4”) Key1=title3 N8 N6 Key2=title4 N7 Pros: Robust.
    [Show full text]