Performance Evaluation of Dhts for Mobile Environment

Total Page:16

File Type:pdf, Size:1020Kb

Performance Evaluation of Dhts for Mobile Environment MEE10:13 Performance Evaluation of DHTs for Mobile Environment Monirul Islam Bhuiya Rakib Mohammad Ahsan This thesis is presented as part of Degree of Master of Science in Electrical Engineering Blekinge Institute of Technology December 2009 Blekinge Institute of Technology School of Engineering Department of Telecommunication Supervisor: Alexandru popescu & Karel De Vogeleer Examiner: Professor Adrian Popescu -1- -2- ABSTRACT istributed Hash Table (DHT) systems are an important part of peer-to-peer routing D infrastructures. They enable scalable wide-area storage and retrieval of information, and will support the rapid development of a wide variety of Internet-scale applications ranging from naming systems and file systems to application-layer multicast. A lot of research about peer-to-peer systems, today, has been focusing on designing better structured peer-to-peer overlay networks or Distributed Hash Tables (DHTs). As far as we concern, not so many papers, however, have been published in an organized way to check the adaptability of the existing four DHTs namely Content Addressable Network (CAN), Chord, Pastry and Tapestry for mobile environments. This thesis presents an attempt to evaluate the performances of these DHTs including adaptability with mobile environments. For this we survey these DHTs including existing solutions and based on that we decide our own conclusion. -3- -4- ACKNOWLEDGEMENT Fast of all we are grateful to our God, the most gracious and merciful, who give us energy and such kind of knowledge which is really helped us to perform well in difficult situation within thesis work. Also we would like to express our gratitude from heart for our parents, who supported us during this total time period. We really like to appreciate our thesis supervisors Alexandru popescu and Karel De Vogeleer, of the School of Engineering, Blekinge Institute of Technology (BTH), Sweden, for their helping, guiding with many inspiring ideas, steady encouragement and collaboration for doing well in our thesis work. We also like to give thanks to BTH and all other employees of BTH, who really helped us and suggest the right way to reach our goal in many awful situations. Finally, we are obliged to many of our friends for their unbelievable help, continuous encouragement and trust on us. We would like to dedicate our thesis work to all of our friends and to our grate parents. -5- -6- TABLE OF CONTENT ABSTRACT .............................................................................................................................................................. 3 ACKNOWLEDGEMENT ............................................................................................................................................ 5 TABLE OF CONTENT ............................................................................................................................................... 7 LIST OF FIGURE .................................................................................................................................................... 11 LIST OF TABLE ...................................................................................................................................................... 13 CHAPTER ONE ...................................................................................................................................................... 15 INTRODUCTION ................................................................................................................................................... 15 1.1. INTRODUCTION ..................................................................................................................................................... 15 1.2. OBJECTIVE ............................................................................................................................................................ 15 1.3. MOTIVATION ........................................................................................................................................................ 16 1.4. CONTRIBUTION ..................................................................................................................................................... 16 1.5. OUTLINE OF THE THESIS .......................................................................................................................................... 17 CHAPTER TWO ..................................................................................................................................................... 19 BACKGROUND ..................................................................................................................................................... 19 2.1. PEER TO PEER NETWORK .................................................................................................................................. 19 2.1.1 INTRODUCTION: ......................................................................................................................................... 19 2.1.2 P2P ARCHITECTURE: ................................................................................................................................... 19 2.2. OVERLAY NETWORK ......................................................................................................................................... 23 2.2.1 INTRODUCTION: ......................................................................................................................................... 23 2.2.2 WORKING MODEL OF OVERLAY NETWORKS [3]: ....................................................................................... 24 2.2.3 COSTS: ........................................................................................................................................................ 25 2.2.4 SOME BENEFITS: ........................................................................................................................................ 25 2.2.5 SOME PROBLEMS: ...................................................................................................................................... 26 2.3. DISTRIBUTED HASH TABLE ................................................................................................................................ 27 2.3.1 INTRODUCTION: ......................................................................................................................................... 27 2.3.2 ARCHITECTURE OF DHT: ............................................................................................................................. 28 A. Client: .......................................................................................................................................................................... 28 B. Service: ........................................................................................................................................................................ 29 C. API: ............................................................................................................................................................................. 29 D. DDS Library: ............................................................................................................................................................... 29 E. Brick: ........................................................................................................................................................................... 29 2.3.3 STRUCTURE OF DHT: ............................................................................................................................. 30 CHAPTER THREE ................................................................................................................................................... 31 OVERVIEW OF EXISTING DHT’S ............................................................................................................................ 31 3.1 CONTENT ADDRESSABLE NETWORK (CAN) ........................................................................................................ 31 3.1.1 INTRODUCTION: ......................................................................................................................................... 31 3.1.2 WORKING MODEL: ..................................................................................................................................... 32 A. Node Joining: .......................................................................................................................................................... 32 B. Bootstrapping Nodes: ............................................................................................................................................. 33 -7- C. Finding own zone: ................................................................................................................................................... 33 D. Neighbors’ Node: .................................................................................................................................................... 34 E. Node Leaving: ......................................................................................................................................................... 34 F. Node Failure: .......................................................................................................................................................... 35 G. Routing: .................................................................................................................................................................
Recommended publications
  • Looking up Data in P2p Systems
    LOOKING UP DATA IN P2P SYSTEMS Hari Balakrishnan, M. Frans Kaashoek, David Karger, Robert Morris, Ion Stoica∗ MIT Laboratory for Computer Science 1. Introduction a good example of how the challenges of designing P2P systems The recent success of some widely deployed peer-to-peer (P2P) can be addressed. file sharing applications has sparked new research in this area. We The recent algorithms developed by several research groups for are interested in the P2P systems that have no centralized control the lookup problem present a simple and general interface, a dis- or hierarchical organization, where the software running at each tributed hash table (DHT). Data items are inserted in a DHT and node is equivalent in functionality. Because these completely de- found by specifying a unique key for that data. To implement a centralized systems have the potential to significantly change the DHT, the underlying algorithm must be able to determine which way large-scale distributed systems are built in the future, it seems node is responsible for storing the data associated with any given timely to review some of this recent research. key. To solve this problem, each node maintains information (e.g., The main challenge in P2P computing is to design and imple- the IP address) of a small number of other nodes (“neighbors”) in ment a robust distributed system composed of inexpensive com- the system, forming an overlay network and routing messages in puters in unrelated administrative domains. The participants in a the overlay to store and retrieve keys. typical P2P system might be home computers with cable modem One might believe from recent news items that P2P systems are or DSL links to the Internet, as well as computers in enterprises.
    [Show full text]
  • Content-Based Multicast: Comparison of Implementation Options
    Content-Based Multicast: Comparison of Implementation Options Ryan Huebsch Report No. UCB/CSD-03-1229 February 2003 Computer Science Division (EECS) University of California Berkeley, California 94720 Content-Based Multicast: Comparison of Implementation Options½ Ryan Huebsch UC Berkeley [email protected] flooding of the content space, an efficient multicast func- Abstract tion should be provided. A DHT is composed of multiple components which This paper is an attempt to quantify the perfor- are connected through standard interfaces. It is important mance differences for content-based multicast im- to consider where specific functionality should be imple- plemented inside the overlay routing algorithm or mented in a layered system. Adding functionality to core built on top of the simple API provided by the rout- components often makes them more complicated, prone to ing layer. We focus on overlay networks designed bugs, and may decrease efficiency for more common tasks. for peer-to-peer distributed hash table (DHT) ap- In the network community, the end-to-end argument [13] is plications where content-based multicast is most often used as design principle that argues for pushing most applicable. In particular we study the Content functionality higher in the protocol stack unless it can be Addressable Networks (CAN) and Chord routing correctly (and significantly more efficiently) implemented algorithms. It is our conjecture that similar re- at the lower level. sults would be obtained through other protocols This paper is an attempt to quantify the performance dif- such as Pastry and Tapestry. ferences for content-based multicast implemented in two We show that it is feasible and in some ways more different layers of the DHT.
    [Show full text]
  • Truncating Blockchains with Tangly Statistics
    Truncating Blockchains with Tangly Statistics Nathan Stouffer advised by Dr. Mike Wittie Abstract Blockchains have applications in cryptocurrencies, supply chain tracking, and providing data integrity. A blockchain provides an immutable, decentralized record. To provide immutability, some blockchains use Proof of Work to construct an ever growing chain of blocks in a peer-to- peer network. Participants, known as miners, expend computational resources to create new blocks. By design, users trust the longest blockchain and blocks are intentionally difficult to create. As a result, data far back in the blockchain is immutable. By design, miners have collective, but not individual, control over a blockchain. When miners are sufficiently decentralized, it is infeasible for a coalition of miners to gain explicit control of a blockchain. Explicit control would allow a coalition to decide which blocks are added to the chain, reducing the integrity of the system. Thus a blockchain performs better when control of the chain is decentralized. Decentralization can be difficult to achieve when blockchains grow to an unmanageable length. To begin mining, one must download and process the entire chain (a process called bootstrapping). This is not a problem when the chain is relatively small, but a larger chain (such as Bitcoin) can take days to download and process. Such a long chain prevents lightweight devices from becoming miners and incredibly long bootstrapping time deters participation from many users who do have sufficient space. Together, these issues make joining a long blockchain more difficult. Over the summer of 2020, I worked with collaborators to devise a faster bootstrapping method. At a high level, our solution has miners of recent blocks vote for a blockchain summary.
    [Show full text]
  • Effective Bootstrapping of Peer-To Peer Networks Over Mobile Ad-Hoc
    Louisiana State University LSU Digital Commons LSU Doctoral Dissertations Graduate School 2006 Effective bootstrapping of Peer-to Peer networks over Mobile Ad-hoc networks Wei Ding Louisiana State University and Agricultural and Mechanical College, [email protected] Follow this and additional works at: https://digitalcommons.lsu.edu/gradschool_dissertations Part of the Computer Sciences Commons Recommended Citation Ding, Wei, "Effective bootstrapping of Peer-to Peer networks over Mobile Ad-hoc networks" (2006). LSU Doctoral Dissertations. 3684. https://digitalcommons.lsu.edu/gradschool_dissertations/3684 This Dissertation is brought to you for free and open access by the Graduate School at LSU Digital Commons. It has been accepted for inclusion in LSU Doctoral Dissertations by an authorized graduate school editor of LSU Digital Commons. For more information, please [email protected]. EFFECTIVE BOOTSTRAPPING OF PEER-TO-PEER NETWORKS OVER MOBILE AD HOC NETWORKS A DISSERTATION Submitted to the Graduate Faculty of the Louisiana State University and Agricultural and Mechanical College in partial fulfillment of the requirements for the degree of Doctor of Philosophy in The Department of Computer Science by Wei Ding Undergraduate Diploma, Northeastern University (China), 1988 M.S. University of Science and Technology of China, 1996 August 2006 Copyright 2006 Wei Ding All rights reserved ii This dissertation is dedicated to my lovely wife, Poy, and my wonderful daughter, Bingbing. It is a product of their patience. iii ACKNOWLEDGEMENTS First I would like express my gratitude to my parents. They support me spiritually, emotionally, and physically. Their love is unconditional and endless. My father, a distinguished electronic engineer and winner of multiple national professional awards in China, has been an inspiring example of hardworking for all my life.
    [Show full text]
  • Measuring Large Overlay Networks – the Overnet Example
    Measuring Large Overlay Networks { The Overnet Example Kendy Kutzner und Thomas Fuhrmann System Architecture Group, Universit¨at Karlsruhe (TH), 76128 Karlsruhe, Germany, [email protected] Abstract Peer-to-peer overlay networks have grown significantly in size and sophistication over the last years. Meanwhile, distributed hash tables (DHT) provide efficient means to create global scale overlay networks on top of which various applications can be built. Although filesharing still is the most prominent example, other applications are well conceivable. In order to rationally design such applications, it is important to know (and understand) the properties of the overlay networks as seen from the respective application. This paper reports the results from a two week measurement of the entire Overnet network, the currently most widely deployed DHT-based over- lay. We describe both, the design choices that made that measurement feasible and the results from the measurement itself. Besides the basic determination of network size, node availability and node distribution, we found unexpected results for the overlay latency distribution. 1 Description of Overnet and Kademlia Overnet is a popular peer-to-peer filesharing network, currently used by more than 106 unique servants (i.e. server-clients). It is based on Kademlia [8], a gen- eral peer-to-peer routing algorithm that can be used to implement distributed hash tables (DHT). Its service is similar to that of other popular DHT routing algorithms like Chord [15], CAN [11], or Pastry [14]. In all these DHTs, par- ticipating nodes are assigned a unique identifier, usually a 128 or 160 bit long unsigned integer.
    [Show full text]
  • A Survey on Security in Mobile Peer-To-Peer Architectures— Overlay-Based Vs
    Future Internet 2010, 2, 505-532; doi:10.3390/fi2040505 OPEN ACCESS future internet ISSN 1999-5903 www.mdpi.com/journal/futureinternet Article A Survey on Security in Mobile Peer-to-Peer Architectures— Overlay-Based vs. Underlay-Based Approaches Christian Gottron ?, Andre´ Konig¨ and Ralf Steinmetz Multimedia Communcations Lab, TU Darmstadt, Rundeturmstrasse 10, 64283 Darmstadt, Germany; E-Mails: [email protected] (A.K.); [email protected] (R.S.) ? Author to whom correspondence should be addressed; E-Mail: [email protected]; Tel.: +49 6151 164577; Fax: +49 6151 166152. Received: 10 September 2010; in revised form: 1 October 2010 / Accepted: 8 October 2010 / Published: 13 October 2010 Abstract: Mobile Ad hoc networks (MANET) and Peer-to-Peer (P2P) networks share central characteristics such as their distributed and decentralized nature. Combining both networking paradigms results in a Mobile Peer-to-Peer (MP2P) system that operates independently from a preexisting infrastructure. Securing MP2P networks in terms of availability and robustness as basic demands in envisioned application scenarios like first responder operations is a challenging task. In this article, we present a survey of selected threats and of state of the art countermeasures for MANETs and P2P networks. Further, we discuss the efficiency of MANET and P2P security mechanisms when applied in MP2P networks. Keywords: mobile ad hoc network; peer-to-peer; network security; mobile peer-to-peer 1. Introduction Mobile Ad hoc Networks (MANETs) and Peer-to-Peer (P2P) networks share concepts of self-organization and decentralization. Both systems operate without a central, coordinating entity and do not require a preexisting communication infrastructure for operation.
    [Show full text]
  • A Glance at Peer to Peer Systems
    A Glance at Peer to Peer Systems Omer Sinan Kaya May 14, 2005 Contents 1 Introduction 1 2 First Ramp Up 3 3 P2P Architectures 3 3.1 Centralized Approach . 4 3.2 Hybrid Approach . 4 3.3 Distributed Approach . 5 3.3.1 Unstructured P2P Distributed Systems . 5 3.3.2 Structured P2P Distributed Systems . 7 4 P2P Evolution 7 5 State of The Art 8 5.1 Freenet . 8 5.2 CAN . 9 5.3 Chord . 11 5.4 Pastry . 12 5.5 Tornado . 14 5.6 Kademlia . 16 5.7 Instant Messaging . 18 5.8 Jxta . 19 5.9 Free Haven . 20 5.10 Mojo Nation . 20 6 Conclusion 21 6.1 State of Research . 21 6.2 Architectural Issues . 21 6.3 Performance Metrics . 21 6.4 Future . 22 1 Introduction Peer to Peer (P2P) systems are described as a network of computers that is formed by nodes (peers) connected through the Internet (overlay network) to achieve some common 1 Figure 1: P2P Nodes goal or to share resources among the computers for applications. [39] makes definition of P2P systems as follows: ”A Distributed network architecture may be called a Peer-to-Peer (P-to-P, P2P) net- work, if the participants share a part of their own hardware resources (processing power, storage capacity, network link capacity, printers). These shared resources are necessary to provide the Service and content offered by the network (e.g., file sharing or shared workspace for collaboration). They are accessible by other peers directly, without passing intermediary entities. The participants of such a network are thus resource (Service and content) providers as well as resource (Service and content) requesters (Servant).” Peers in P2P systems consist of two layers which are presented on Fig.1.
    [Show full text]
  • Peercq: a Decentralized and Self-Configuring Peer-To-Peer Information Monitoring System
    PeerCQ: A Decentralized and Self-Configuring Peer-to-Peer Information Monitoring System Bu¯gra Gedik and Ling Liu College of Computing Georgia Institute of Technology {bgedik,lingliu}@cc.gatech.edu Abstract anteed a definite answer in a bounded number of net- work hops. The second generation of routing and location PeerCQ is a totally decentralized system that per- schemes is also considered more scalable. forms information monitoring tasks over a network of Surprisingly, most of the P2P protocols [1, 13, 9, 10, 3] peers with heterogeneous capabilities. It uses Continual to date make the assumption that all nodes tend to par- Queries (CQs) as its primitives to express information- ticipate and contribute equally to the system. Thus, these monitoring requests. A primary objective of the PeerCQ protocols distribute tasks and place data to peers based system is to build a decentralized Internet scale distributed on this assumption. However P2P applications should re- information-monitoring system, which is highly scalable, spect the peer heterogeneity and user characteristics in self-configurable and supports efficient and robust way of order to be more robust [12]. Another common weak- processing CQs. This paper describes the basic architec- ness of the second generation P2P protocols is the lack ture of the PeerCQ system and focuses on the mecha- of flexibility in optimizing the key to peer matching al- nisms used for service partitioning at the P2P protocol gorithms to incorporate important performance metrics layer. A set of initial experiments is reported, demon- such as load balance, system utilization, reliability, and strating the sensitiveness of the PeerCQ approach to large trust.
    [Show full text]
  • Attacking the Kad Network
    Attacking the Kad Network Peng Wang, James Tyra, Eric Chan-Tin, Tyson Malchow, Denis Foo Kune, Nicholas Hopper, Yongdae Kim University of Minnesota - Twin Cities 200 Union Street SE Minneapolis, MN 55455 {pwang,tyra,dchantin,malchow,foo,hopper,kyd}@cs.umn.edu ABSTRACT DHT Security in general – the problem of ensuring efficient and The Kad network, an implementation of the Kademlia DHT pro- correct peer discovery despite adversarial interference – is an im- tocol, supports the popular eDonkey peer-to-peer file sharing net- portant problem which has been addressed in a number of works [9, work and has over 1 million concurrent nodes. We describe several 26, 4, 17, 12, 23, 15, 24, 13]. However, the majority of these works attacks that exploit critical design weaknesses in Kad to allow an assume a DHT with ring topology and recursive routing; Kademlia attacker with modest resources to cause a significant fraction of all uses a fundamentally different, “multi-path” iterative routing algo- searches to fail. We measure the cost and effectiveness of these rithm as well as a different topology. To our knowledge, no specific, attacks against a set of 16,000 nodes connected to the operational applicable analysis of the security properties of the Kademlia DHT Kad network. We also measure the cost of previously proposed, or the deployed Kad network has appeared in the literature, despite generic DHT attacks against the Kad network and find that our at- the potential impact of an attack on this network. tacks are much more cost effective. Finally, we introduce and eval- In this paper, we describe an attack on the Kad network that uate simple mechanisms to significantly increase the cost of these would allow a few malicious nodes with only modest bandwidth attacks.
    [Show full text]
  • A Common Protocol for Implementing Various DHT Algorithms
    A Common Protocol for Implementing Various DHT Algorithms Salman Baset Henning Schulzrinne Eunsoo Shim Department of Computer Science Panasonic Princeton Laboratory Columbia University Two Research Way, 3rd Floor New York, NY 10027 Princeton, NJ 08540 fsalman,[email protected] [email protected] Abstract This document de¯nes DHT-independent and DHT-dependent features of DHT algorithms and presents a comparison of Chord, Pastry and Kademlia. It then describes key DHT oper- ations and their information requirements. 1 Introduction Over the last few years a number of distributed hash table (DHT) algorithms [1, 2, 3, 4, 5] have been proposed. These DHTs are based on the idea of consistent hashing [6] and they share a fundamental function, namely routing a message to a node responsible for an identi¯er (key) in O(log2b N) steps using a certain routing metric where N is the number of nodes in the system and b is the base of the logarithm. Identi¯ers can be pictured to be arranged in a circle in Chord [1], Kademlia [4] and Pastry [2] and a routing metric determines if the message can traverse only in one direction ([anti-]clockwise) or both directions on the identi¯er circle. However, independent of the routing metric and despite the fact that the author of these DHT algorithms have given di®erent names to the routing messages and tables, the basic routing concept of O(log2N) operations is the same across DHTs. In this paper, we want to understand if it is possible to exploit the commonalities in the DHT algorithms such as Chord [1], Pastry [2], Tapestry [3] and Kademlia [4] to de¯ne a protocol by which any of these algorithms can be implemented.
    [Show full text]
  • Admission Control in Peer-To-Peer: Design and Performance Evaluation
    Admission Control in Peer-to-Peer: Design and Performance Evaluation Nitesh Saxena Gene Tsudik Jeong Hyun Yi Computer Science Dept. Computer Science Dept. Computer Science Dept. UC Irvine UC Irvine UC Irvine [email protected] [email protected] [email protected] ABSTRACT 1. INTRODUCTION Peer-to-Peer (P2P) applications and services are very common in In a typical P2P scenario, a number of distributed entities (peers) today’s computing. The popularity of the P2P paradigm prompts perform some function in a decentralized manner. P2P applications the need for specialized security services which makes P2P secu- are generally divided into three classes: parallelizable, content- rity an important and challenging research topic. Most prior work based and collaborative. A parallelizable P2P application splits in P2P security focused on authentication, key management and a large task into smaller pieces that execute in parallel at a num- secure communication. However, an important pre-requisite for ber of independent peer nodes. A content-based P2P application many P2P security services is secure admission, or how one be- focuses on storing information at various peers in the network. A comes a peer in a P2P setting. This issue has been heretofore collaborative P2P application allows peers to collaborate, in real largely untouched. time, without relying on central servers to collect and relay infor- This paper builds upon some recent work [11] which constructed mation. Current P2P settings are clearly very diverse. For exam- a peer group admission control framework based on different poli- ple, some collaborative P2P applications require synchronous op- cies and corresponding cryptographic techniques.
    [Show full text]
  • File Management in a Mobile DHT-Based P2P Environment
    The 26th IEEE International Conference on Advanced Information Networking and Applications (AINA-2012), Fukuoka Institute of Technology (FIT), Fukuoka, Japan, March 26-29, 2012, pp415-422. File Management in a Mobile DHT-based P2P Environment Khalid Ashraf 1, Rachid Anane 2 and Behzad Bordbar 1 1School of Computer Science, University of Birmingham {k.ashraf, b.brodbar}@cs.bham.ac.uk 2Faculty of Engineering and Computing, Coventry University [email protected] ABSTRACT and adaptive schemes and hence may favour platform- The emergence of mobile P2P systems is largely due to the independent schemes. evolution of mobile devices into powerful information Within this context the P2P model is seen as ideal for processing units. The relatively structured context that providing order and structure on mobile interactions and for results from the mapping of mobile patterns of behaviour exploiting the potential of mobile devices. A more onto P2P models is however constrained by the disciplined approach to information management is vulnerabilities of P2P networks and the inherent limitations complemented by the flexibility of a personal device. The of mobile devices. Whilst the implementation of P2P affinity between mobility and P2P modes of interaction is models gives rise to security and reliability issues, the further reinforced by the dynamic and heterogeneous deployment of mobile devices is subject to efficiency domains they support. There are however legitimate constraints. This paper presents the development and concerns over reliability and security in P2P systems. These deployment of a mobile P2P system based on distributed issues tend to be exacerbated in a mobile context. hash tables (DHT).
    [Show full text]