DHT-based Traffic Localization in the Wild Matteo Varvello, Moritz Steiner Bell Labs, Alcatel-Lucent, USA {first.last}@alcatel-lucent.com Abstract—BitTorrent is both the dominant Peer-to-Peer (P2P) peers, if any, from the small peer-set received. More effective protocol for file-sharing and a nightmare for ISPs due to its designs, such as [2], [3], [10], propose to inform the trackers network agnostic nature. Many solutions exist to localize BitTor- about the ISP of each peer. In this way, a tracker could reply to rent traffic relying on cooperation between ISPs and the trackers. Recently, BitTorrent users have been abandoning the trackers a peer request for a specific torrent with a list of peers located in favor of Distributed Hash Tables (DHTs). Despite DHTs are in the same ISP as the requesting peer. complex heterogeneous systems, DHT-based traffic localization is Nowadays, BitTorrent DHTs are taking over the trackers also possible; however, it is unclear how it performs. The goal of as these are being shutdown by police due to copyright this work is to measure DHT-based traffic localization in the wild. issues. For example, in [8] we measure that about 40% of We run multiple experiments involving up to five commercial ISPs and a maximum duration of one month, collecting about the BitTorrent users from a large European ISP have already 400 GB of BitTorrent traffic. Then, we perform an extensive abandoned the trackers in favor of the DHTs. It follows that analysis with the following goals: understand the impact of system traffic localization mechanisms based on the central trackers parameters, verify accuracy of the measurements, estimate the might become soon ineffective. In [8], we also propose a localization benefits. technique to localize BitTorrent traffic that only relies on the I. INTRODUCTION DHT, with no need for the trackers. Compared to classic tracker-based localization, DHT-based localization is more A. BitTorrent challenging. In fact, DHTs are large P2P systems designed BitTorrent is by far the most popular Peer-to-Peer (P2P) pro- to fairly distribute responsibilities: it follows that tracking tocol, adopted by several file-sharing clients such as µTorrent, and controlling file swarms with the goal of localization is Transmission and BitComet. BitTorrent aims at maximizing not trivial. In addition, DHTs are heterogeneous environments the volume of data exchanged among peers without taking where several independent protocol implementations exist. into account their geographic location. This causes expensive inter-ISPs traffic, and thus a monetary loss at the ISPs. C. Contributions BitTorrent employs a tracker to discover peers and coordi- The goal of this work is to measure DHT-based traffic nate file exchanges. Peers retrieve the address of the tracker localization in the wild. Our measurement methodology is as from a torrent file they download from the web. In the paper, follows. We activate traffic localization for several ISPs and we use the term torrent also to refer to a file or set of files files by running the prototype for the Mainline DHT described that are exchanged. A peer contacts the tracker to retrieve a in [8]. Meanwhile, we measure its performance by running list of peers that participate to the swarm, group of peers that several BitTorrent clients from up to five commercial ISPs hold the file or a portion of it. The tracker answers with the for as long as four weeks. In total, we collect about 400 peer-list, composed by 50 active peers. GB of BitTorrent traffic on which we perform two different With the objective of increased resiliency BitTorrent also analyses: (1) sensitivity, to both understand the impact of uses distributed tracking, where a client discovers which peers system parameters and verify the accuracy of our method- hold a copy or a portion of a file querying a Distributed ology, and (2) localization benefits, to quantify the volume of Hash Table (DHT). Each peer and torrent is assigned a unique BitTorrent traffic that is kept local. identifier in the DHT, the nodeID and infohash; both are Our results show that while DHT-based traffic localization computed using hashing. Currently, BitTorrent use two large can keep local 90-100% of the traffic associated to a popular and incompatible DHTs called Azureus and Mainline. file, this fraction reduces to 60% for an unpopular one. In Beside the tracker and the DHT, the Peer-Exchange- fact, as popularity increases the probability to find peers that Protocol (PEX) is the third mechanism to discover peers that concurrently request the same file from the same ISP increases participate in a file exchange [9]. The PEX allows peers that as well. Also, at ISPs where the majority of the users have download the same file to exchange their peer-sets pairwise. very good connectivity, the localization benefits are much higher than at slow ISPs. This happens for two reasons: (1) B. Related Work the BitTorrent protocol tends to favor fast peers, and (2) fast In the past, several interesting strategies have been proposed local peers reduce the chance that external peers contribute to localize BitTorrent traffic, i.e., maintain traffic within an ISP to a file download. In the experiments, we also discovered when possible. Originally, researchers proposed to modify the that BitComet has a non-standard DHT implementation that peer selection at the client to favor local peers, as in [4], [7]. negatively detracts from the performance of DHT-based traffic However, these designs only manage to select the few local localization. II. METHODOLOGY 1200 Sybils Our measurement methodology has two components: the Non−sybils DHT side, a DHT-based traffic localization, and the client side, 1000 a combination of BitTorrent clients and measurement tools to 800 assess both DHT localization benefits and behavior. In the remainder of this section, we describe both components. 600 Sources [#] A. Client Side 400 Pcap - It collects statistics about a torrent download. The 200 pcap tool works in three consecutive steps: (1) start of a 0 0 3 6 9 12 15 18 21 24 27 30 BitTorrent client and collection of pcap traces using wireshark, Time [hrs] (2) extraction of volume of traffic sent and received per peer in the swarm, and (3) post processing to derive the following Fig. 1. Evolution over time of the sources received from non-sybil peers vs statistics: volume of local traffic, download/upload speed per sources received from the sybils; µTorrent; Comcast; 30 hrs. remote peer and number of peers contacted during a download. The pcap tool can be coupled with any legacy BitTorrent client. it. Then, it intercepts all requests for this file and answer with Query - It also collects statistics about a file download. local peer-sets. To intercept announces and requests for a file, This is done by instrumenting a Transmission client to log for the solution inserts several sybils [5] in the DHT: these are each peer it talks to the following statistics: upload/download (logical) peers with nodeIDs close to the info hash of the rate, client type and client location (local or non-local). These file to localize, that are controlled by a single (physical) peer. statistics are dumped to a file every two seconds. This tool Sybils respond to the queries for this file with localized peer- runs on Linux only as Transmission is a client for Linux. sets. If only few local peers are available, external peers are Lookup analyzer - It analyzes a lookup operation in Main- used to complete the peer-set. This localization mechanism line. First, it collects pcap traces filtered on the UDP port at targets popular files only as they are the only ones that have which a BitTorrent client is running on. Then, it analyzes the potential for localization. pcap traces to extract the following statistics: (1) IP addresses Unless otherwise stated, we run the “DHT side” (DHT- of the peers that reply to a file’s request, (2) time at which based traffic localization) from a data center in Chicago, USA. each reply message is received, and (3) set of “sources”, both According to the evaluation goals, we activate the DHT side leechers and seeders, returned from each replying peer. The for a set of torrents with specific popularity at a given ISP. lookup analyzer can be coupled with any BitTorrent client Since torrent popularity at ISP-level is not publicly available, implementation. we obtain the list of the 500 (globally) most popular torrents We run the tools from the following ISPs: Comcast Cable as indicated by PirateBay on May 5th, 2012. Then, we activate (US), Verizon Internet Services (US), Free SAS (France), Tele- the localization for 100 torrents, randomly selected out of the com Italia (Italy) and Belgacom Skynet (Belgium) (abbreviated 500 most popular torrents, along 24 hrs in order to quantify Comcast, Verizon, Free, TItalia and Belgacom). At Comcast, their popularity at ISP level, i.e., number of requests from we have access to a personal cable connection and both a peers located at the same ISP. Windows and Linux machine. At Verizon, we have access to a Unless otherwise stated, for the experiments in Comcast personal fiber connection and a Linux machine. At Free, TIalia we select the torrents whose average number of sources is and Belgacom, we have access to personal ADSL connections respectively the 100, 80, 60 and 20th percentile of the torrent and Linux machines. popularity distribution; we refer to these torrents as 1, 2, 3 For our measurements, we consider a scenario where a and 4, respectively. For the experiments that we run in the user clicks on a “magnet link”, a pointer to the infohash remaining ISPs, we only select the most popular torrent.