A Survey and Comparison of Peer-To-Peer Overlay Network Schemes Eng Keong Lua, Jon Crowcroft, Marcelo Pias, Ravi Sharma and Steven Lim
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Overlay Networks EECS 122: Lecture 18
Overlay Networks EECS 122: Lecture 18 Department of Electrical Engineering and Computer Sciences University of California Berkeley What is an overlay network? A network defined over another set of networks A The overlay addresses its own nodes A’ A Links on one layer are network segments of lower layers Requires lower layer routing to be utilized Overlaying mechanism is called tunneling March 23, 2006 EE122, Lecture 18, AKP 2 1 Overlay Concept C5 7 4 8 6 11 2 10 A1 3 13 B12 Overlay Network Nodes March 23, 2006 EE122, Lecture 18, AKP 3 Overlay Concept C5 7 4 8 6 11 2 10 A1 3 13 B12 Overlay Networks are extremely popular Akamai, Virtual Private Networks, Napster, Gnutella, Kazaa, Bittorrent March 23, 2006 EE122, Lecture 18, AKP 4 2 Why overlay? Filesharing Example Single point of failure Performance bottleneck m5 Copyright infringement m6 E F D E? m1 A E m2 B m4 m3 C file transfer is m4 D Napster E? decentralized, but m5 E m5 locating content m6 F is highly C centralized A B m3 m1 m2 March 23, 2006 EE122, Lecture 18, AKP 5 Build an Overlay Network Underlying Network March 23, 2006 EE122, Lecture 18, AKP 6 3 Build an Overlay Network The underlying network induces a complete graph of connectivity No routing required! Underlying Network March 23, 2006 EE122, Lecture 18, AKP 7 Overlay The underlying network induces a complete graph of connectivity 10 No routing required! But 200 100 One virtual hop may be many 90 underlying hops away. 90 100 Latency and cost vary significantly over the virtual links 10 100 20 State information may grow with E (n^2) 10 March 23, 2006 EE122, Lecture 18, AKP 8 4 Overlay The underlying network induces a complete graph of connectivity No routing required! 1 2 But One virtual hop may be many underlying hops away. -
IPFS and Friends: a Qualitative Comparison of Next Generation Peer-To-Peer Data Networks Erik Daniel and Florian Tschorsch
1 IPFS and Friends: A Qualitative Comparison of Next Generation Peer-to-Peer Data Networks Erik Daniel and Florian Tschorsch Abstract—Decentralized, distributed storage offers a way to types of files [1]. Napster and Gnutella marked the beginning reduce the impact of data silos as often fostered by centralized and were followed by many other P2P networks focusing on cloud storage. While the intentions of this trend are not new, the specialized application areas or novel network structures. For topic gained traction due to technological advancements, most notably blockchain networks. As a consequence, we observe that example, Freenet [2] realizes anonymous storage and retrieval. a new generation of peer-to-peer data networks emerges. In this Chord [3], CAN [4], and Pastry [5] provide protocols to survey paper, we therefore provide a technical overview of the maintain a structured overlay network topology. In particular, next generation data networks. We use select data networks to BitTorrent [6] received a lot of attention from both users and introduce general concepts and to emphasize new developments. the research community. BitTorrent introduced an incentive Specifically, we provide a deeper outline of the Interplanetary File System and a general overview of Swarm, the Hypercore Pro- mechanism to achieve Pareto efficiency, trying to improve tocol, SAFE, Storj, and Arweave. We identify common building network utilization achieving a higher level of robustness. We blocks and provide a qualitative comparison. From the overview, consider networks such as Napster, Gnutella, Freenet, BitTor- we derive future challenges and research goals concerning data rent, and many more as first generation P2P data networks, networks. -
Privacy Enhancing Technologies 2003 an Analysis of Gnunet And
Privacy Enhancing Technologies 2003 An Analysis of GNUnet and the Implications for Anonymous, Censorship-Resistant Networks Dennis Kügler Federal Office for Information Security, Germany [email protected] 1 Anonymous, Censorship-Resistant Networks • Anonymous Peer-to-Peer Networks – Gnutella • Searching is relatively anonymous • Downloading is not anonymous • Censorship-Resistant Networks – Eternity Service • Distributed storage medium • Attack resistant • Anonymous, Censorship-Resistant Networks – Freenet – GNUnet 2 GNUnet: Obfuscated, Distributed Filesystem Content Hash Key: [H(B),H(E (B))] • H(B) – Content encryption: H(B) – Unambiguous filename: H(E (B)) H(B) • Content replication – Caching while delivering – Based on unambiguous filename • Searchability – Keywords 3 GNUnet: Peer-to-Peer MIX Network • Initiating node – Downloads content • Supplying nodes – Store content unencrypted • Intermediary nodes – Forward and cache encrypted content – Plausible deniability due to encryption • Economic model – Based on credit Query A Priority=20 B – Charge for queries c =c -20 B B - – Pay for responses 4 GNUnet Encoding • DBlocks DBlock DBlock ... DBlock – 1KB of the content – Content hash encrypted • IBlocks IBlock ... IBlock – CHKs of 25 DBlocks – Organized as tree – Content hash encrypted IBlock • RBlock – Description of the content – CHK of the root IBlock RBlock – Keyword encrypted 5 The Attacker Model • Attacker – Controls malicious nodes that behave correctly – Prepares dictionary of interesting keywords – Observes queries and -
A Content-Addressable Network for Similarity Search in Metric Spaces Fabrizio Falchi
University of Pisa Masaryk University Faculty of Informatics Department of Department of Information Engineering Information Technologies Doctoral Course in Doctoral Course in Information Engineering Informatics Ph.D. Thesis A Content-Addressable Network for Similarity Search in Metric Spaces Fabrizio Falchi Supervisor Supervisor Supervisor Lanfranco Lopriore Fausto Rabitti Pavel Zezula 2007 Abstract Because of the ongoing digital data explosion, more advanced search paradigms than the traditional exact match are needed for content- based retrieval in huge and ever growing collections of data pro- duced in application areas such as multimedia, molecular biology, marketing, computer-aided design and purchasing assistance. As the variety of data types is fast going towards creating a database utilized by people, the computer systems must be able to model hu- man fundamental reasoning paradigms, which are naturally based on similarity. The ability to perceive similarities is crucial for recog- nition, classification, and learning, and it plays an important role in scientific discovery and creativity. Recently, the mathematical notion of metric space has become a useful abstraction of similarity and many similarity search indexes have been developed. In this thesis, we accept the metric space similarity paradigm and concentrate on the scalability issues. By exploiting computer networks and applying the Peer-to-Peer communication paradigms, we build a structured network of computers able to process similar- ity queries in parallel. Since no centralized entities are used, such architectures are fully scalable. Specifically, we propose a Peer- to-Peer system for similarity search in metric spaces called Met- ric Content-Addressable Network (MCAN) which is an extension of the well known Content-Addressable Network (CAN) used for hash lookup. -
Adaptive Lookup for Unstructured Peer-To-Peer Overlays
Adaptive Lookup for Unstructured Peer-to-Peer Overlays K Haribabu, Dayakar Reddy, Chittaranjan Hota Antii Ylä-Jääski, Sasu Tarkoma Computer Science & Information Systems Telecommunication Software and Multimedia Laboratory Birla Institute of Technology & Science Helsinki University of Technology Pilani, Rajasthan, 333031, INDIA TKK, P.O. Box 5400, Helsinki, FINLAND {khari, f2005462, c_hota}@bits-pilani.ac.in {[email protected], [email protected]}.fi Abstract— Scalability and efficient global search in unstructured random peers but at specified locations that will make peer-to-peer overlays have been extensively studied in the subsequent queries more efficient. Most of the structured P2P literature. The global search comes at the expense of local overlays are Distributed Hash Table (DHT) based. Content interactions between peers. Most of the unstructured peer-to- Addressable Network (CAN) [6], Tapestry [7], Chord [8], peer overlays do not provide any performance guarantee. In this Pastry [9], Kademlia [10] and Viceroy [11] are some examples work we propose a novel Quality of Service enabled lookup for of structured P2P overlay networks. unstructured peer-to-peer overlays that will allow the user’s query to traverse only those overlay links which satisfy the given In unstructured P2P network, lookup is based on constraints. Additionally, it also improves the scalability by forwarding the queries [12]. At each node the query is judiciously using the overlay resources. Our approach selectively forwarded to neighbors. Unless the peer finds the item or the forwards the queries using QoS metrics like latency, bandwidth, hop count of the query reaches zero, query is forwarded to and overlay link status so as to ensure improved performance in neighbors. -
Services for Microsoft Onedrive for Business
Service Overview SERVICES FOR MICROSOFT ONEDRIVE FOR BUSINESS Simplify where workers go for content sharing and collaboration Business Challenge ESSENTIALS Dynamic teams are constantly collaborating, which means easily Dell Technologies Consulting Services can sharing personal and team documents is a must for todays’ help you gain the most from your OneDrive innovative workers. All too often organizations have multiple content for Business investment with: repositories without a single standard for the entire workforce which • Repeatable, mature methodologies can cause frustration and impact worker productivity. designed for delivery efficiency and Simplifying where your workers go to collaborate and share content quality accelerate content migrations can boost innovation, increase productivity and more importantly • Determining and delivering the optimal worker satisfaction. For organizations who have adopted Office 365, OneDrive client deployment model as OneDrive for Business is the logical choice. But how do you part of your Windows 10 and Office 365 efficiently migrate, retire and consolidate personal and team files ProPlus initiatives from overlapping content repositories to control costs? • Security and management tuning at the It’s easy with Dell Technologies Consulting Services. We are a Gold worker, device and application level Certified Microsoft Partner with experience migrating organizations of all sizes and verticals to Office 365. • Migration and consolidation of content from a wide variety of sources • The right mix of -
FASTTRACK Through FUJITSU-DEV
FASTTRACK through FUJITSU-DEV Americas Headquarters: Cisco Systems, Inc., 170 West Tasman Drive, San Jose, CA 95134-1706 USA FASTTRACK through FUJITSU-DEV FASTTRACK FASTTRACK Name/CLI Keyword fasttrack Full Name FastTrack Description FastTrack is a file sharing client software that is based on peer-to-peer connection. FastTrack is used by multiple file sharing applications such as Kazaa, Grokster, iMesh, and Morpheus. Initialization: Initial the connection with FastTrack server over HTTP. Search: Searching for files in FastTrack server. Download: Download request from FastTracker server. Reference http://developer.berlios.de/projects/gift-fasttrack/ Global ID L7:57 ID 57 Known Mappings UDP Port - TCP Port - IP Protocol - IP Version IPv4 Support Yes IPv6 Support Yes Application Group fasttrack-group Category file-sharing Sub Category p2p-networking P2P Technology Yes Encrypted No Tunnel No Underlying Protocols - 2 FASTTRACK through FUJITSU-DEV FASTTRACK-STATIC FASTTRACK-STATIC Name/CLI Keyword fasttrack-static Full Name fasttrack-static Description FastTrack Traffic - KaZaA Morpheus Grokster... Reference - Global ID L7:1322 ID 1322 Known Mappings UDP Port 1214 TCP Port 1214 IP Protocol - IP Version IPv4 Support Yes IPv6 Support Yes Application Group fasttrack-group Category file-sharing Sub Category p2p-networking P2P Technology Yes Encrypted No Tunnel No Underlying Protocols - 3 FASTTRACK through FUJITSU-DEV FATSERV FATSERV Name/CLI Keyword fatserv Full Name Fatmen Server Description Fatmen Server Reference - Global ID L4:305 ID 305 Known -
Qos-Assured Service Composition in Managed Service Overlay Networks
QoS-Assured Service Composition in Managed Service Overlay Networks Xiaohui Gu, Klara Nahrstedt Rong N. Chang, Christopher Ward Department of Computer Science Network Hosted Application Services University of Illinois at Urbana-Champaign IBM T.J. Watson Research Center ¡ ¡ ¢ xgu, klara ¢ @ cs.uiuc.edu rong, cw1 @ us.ibm.com Abstract Service Provider: XXX.com service Service Overlay Network instance X service instance (SON) service Z Many value-added and content delivery services are instance being offered via service level agreements (SLAs). These SON Y Portal services can be interconnected to form a service overlay network (SON) over the Internet. Service composition in SON Access SON has emerged as a cost-effective approach to quickly Domain creating new services. Previous research has addressed the reliability, adaptability, and compatibility issues for com- posed services. However, little has been done to manage SON generic quality-of-service (QoS) provisioning for composed SON Portal Portal services, based on the SLA contracts of individual ser- SON Access SON Access Domain vices. In this paper, we present QUEST, a QoS assUred Domain composEable Service infrasTructure, to address the prob- lem. QUEST framework provides: (1) initial service com- Figure 1. Illustration of the Service Overlay position, which can compose a qualified service path under Network Model. multiple QoS constraints (e.g., response time, availability). If multiple qualified service paths exist, QUEST chooses the best one according to the load balancing metric; and (2) dynamic service composition, which can dynamically re- and peer-to-peer file sharing overlays [2]. Beyond this, we compose the service path to quickly recover from service envision the emergence of service overlay networks (SON), outages and QoS violations. -
CS505: Distributed Systems
Cristina Nita-Rotaru CS505: Distributed Systems Lookup services. Chord. CAN. Pastry. Kademlia. Required Reading } I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, H. Balakrishnan, Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications, SIGCOMM 2001. } A Scalable Content-Addressable Network S.a Ratnasamy, P. Francis, M. Handley, R. Karp, S. Shenker, SIGCOMM 2001 } A. Rowstron and P. Druschel. "Pastry: Scalable, decentralized object location and routing for large-scale peer-to-peer systems". IFIP/ACM International Conference on Distributed Systems Platforms (Middleware), 2001 } Kademlia: A Peer-to-peer Information System Based on the XOR Metric. P. Maymounkov and D. Mazieres, IPTPS '02 2 DHTs 1: Lookup services Peer-to-Peer (P2P) Systems } Applications that take advantage of resources (storage, cycles, content, human presence) available at the edges of the Internet. } Characteristics: } System consists of clients connected through Internet and acting as peers } System is designed to work in the presence of variable connectivity } Nodes at the edges of the network have significant autonomy; no centralized control } Nodes are symmetric in function 4 DHTs Benefits of P2P and Applications } High capacity: all clients provide resources (bandwidth, storage space, and computing power). The capacity of the system increases as more nodes become part of the system. } Increased reliability: achieved by replicating data over multiple peers, and by enabling peers to find the data without relying on a centralized index server. } Applications: -
Practical Anonymous Networking?
gap – practical anonymous networking? Krista Bennett Christian Grothoff S3 lab and CERIAS, Department of Computer Sciences, Purdue University [email protected], [email protected] http://www.gnu.org/software/GNUnet/ Abstract. This paper describes how anonymity is achieved in gnunet, a framework for anonymous distributed and secure networking. The main focus of this work is gap, a simple protocol for anonymous transfer of data which can achieve better anonymity guarantees than many traditional indirection schemes and is additionally more efficient. gap is based on a new perspective on how to achieve anonymity. Based on this new perspective it is possible to relax the requirements stated in traditional indirection schemes, allowing individual nodes to balance anonymity with efficiency according to their specific needs. 1 Introduction In this paper, we present the anonymity aspect of gnunet, a framework for secure peer-to-peer networking. The gnunet framework provides peer discovery, link encryption and message-batching. At present, gnunet’s primary application is anonymous file-sharing. The anonymous file-sharing application uses a content encoding scheme that breaks files into 1k blocks as described in [1]. The 1k blocks are transmitted using gnunet’s anonymity protocol, gap. This paper describes gap and how it attempts to achieve privacy and scalability in an environment with malicious peers and actively participating adversaries. The gnunet core API offers node discovery, authentication and encryption services. All communication between nodes in the network is confidential; no host outside the network can observe the actual contents of the data that flows through the network. Even the type of the data cannot be observed, as all packets are padded to have identical size. -
Multicasting Over Overlay Networks – a Critical Review
(IJACSA) International Journal of Advanced Computer Science and Applications, Vol. 2, No. 3, March 2011 Multicasting over Overlay Networks – A Critical Review M.F.M Firdhous Faculty of Information Technology, University of Moratuwa, Moratuwa, Sri Lanka. [email protected] Abstract – Multicasting technology uses the minimum network internet due to the unnecessary congestion caused by resources to serve multiple clients by duplicating the data packets broadcast traffic that may bring the entire internet down in a at the closest possible point to the clients. This way at most only short time. one data packets travels down a network link at any one time irrespective of how many clients receive this packet. Traditionally Using the network layer multicast routers to create the multicasting has been implemented over a specialized network backbone of the internet is not that attractive as these routers built using multicast routers. This kind of network has the are more expensive compared to unicast routers. Also, the drawback of requiring the deployment of special routers that are absence of a multicast router at any point in the internet would more expensive than ordinary routers. Recently there is new defeat the objective of multicasting throughout the internet interest in delivering multicast traffic over application layer downstream from that point. Chu et al., have proposed to overlay networks. Application layer overlay networks though replace the multicast routers with peer to peer clients for built on top of the physical network, behave like an independent duplicating and forwarding the packets to downstream clients virtual network made up of only logical links between the nodes. -
Tutorial on P2P Systems
P2P Systems Keith W. Ross Dan Rubenstein Polytechnic University Columbia University http://cis.poly.edu/~ross http://www.cs.columbia.edu/~danr [email protected] [email protected] Thanks to: B. Bhattacharjee, A. Rowston, Don Towsley © Keith Ross and Dan Rubenstein 1 Defintion of P2P 1) Significant autonomy from central servers 2) Exploits resources at the edges of the Internet P storage and content P CPU cycles P human presence 3) Resources at edge have intermittent connectivity, being added & removed 2 It’s a broad definition: U P2P file sharing U DHTs & their apps P Napster, Gnutella, P Chord, CAN, Pastry, KaZaA, eDonkey, etc Tapestry U P2P communication U P Instant messaging P2P apps built over P Voice-over-IP: Skype emerging overlays P PlanetLab U P2P computation P seti@home Wireless ad-hoc networking not covered here 3 Tutorial Outline (1) U 1. Overview: overlay networks, P2P applications, copyright issues, worldwide computer vision U 2. Unstructured P2P file sharing: Napster, Gnutella, KaZaA, search theory, flashfloods U 3. Structured DHT systems: Chord, CAN, Pastry, Tapestry, etc. 4 Tutorial Outline (cont.) U 4. Applications of DHTs: persistent file storage, mobility management, etc. U 5. Security issues: vulnerabilities, solutions, anonymity U 6. Graphical structure: random graphs, fault tolerance U 7. Experimental observations: measurement studies U 8. Wrap up 5 1. Overview of P2P U overlay networks U P2P applications U worldwide computer vision 6 Overlay networks overlay edge 7 Overlay graph Virtual edge U TCP connection U or