Bandwidth Estimation and Rate Control in Bitvampire

Total Page:16

File Type:pdf, Size:1020Kb

Bandwidth Estimation and Rate Control in Bitvampire Bandwidth Estimation and Rate Control in BitVampire CPSC 527: Advanced Computer Networks Mayukh Saubhasik Uwe Schmidt Department of Computer Science Department of Computer Science University of British Columbia University of British Columbia Vancouver, B.C. Vancouver, B.C. [email protected] [email protected] ABSTRACT demanding a certain bandwidth value. Each of these peers We consider the problem of bandwidth estimation and rate replies whether they can satisfy the request or not, subject control in the context of the peer-to-peer video streaming to their available bandwidth. application BitVampire. BitVampire requires each peer to maintain an estimate of its available upstream bandwidth. We are giving a brief overview over the rich body of work This is needed by a scheduling algorithm which takes in- which has already investigated in this problem. In section formation about peer’s bandwidth into account in order to 2.4 we will explain why these methods aren’t applicable in minimize the initial buffering time when watching a video. our context. As a result, we came up with a pragmatic It is also an interesting problem in general, since P2P ap- approach which is applicable in the context of any generic plications can generally offer a better quality of service if P2P application. Although the accuracy of the method is they are aware of their bandwidth limitations. We looked quite low, it makes up for this in terms of speed and ease of into the area of bandwidth estimation and evaluated their implementation. applicability for the context of P2P applications. We found that it is not easy to use them in this context since most of them require very accurate timing and low level network 2. RELATED WORK access which is often not given by high-level programming The bandwidth of a link can either be measured by pas- languages like Java. We went for a pragmatic approach in- sively monitoring the amount of traffic flowing through it, stead, which uses round-trip-time measurements as an in- or by actively probing the link to estimate its bandwidth. dicator for the available bandwidth of a peer. We did a The passive monitoring mechanism requires access to the prototype implementation in Java and evaluated it in the intermediate network elements or administrative resources, LAN environment. Future work has to investigate about whereas the active probing techniques can be run just on the the choice of many policy decisions which arose when creat- end hosts. Thus passive monitoring methods aren’t really ing the prototype. feasible except in a well controlled network testbed. Active bandwidth estimation is a well studied field, which 1. MOTIVATION has been around for at least 10 years. Despite that, there are This project is largely motivated by the need for accurate quite a few open problems within it. What makes the prob- bandwidth estimation in BitVampire [Liu and Vuong, 2006]. lem hard is its real-time nature and the need for a balance BitVampire is a peer-to-peer (P2P) video streaming soft- between the amount of traffic generated, time taken and ac- ware, which is being actively developed here at UBC. Bit- curacy of the measurements. Similar to all active measure- Vampire requires each peer to maintain an estimate of its ment techniques, the very act of measuring the bandwidth available upstream bandwidth. This is needed by a schedul- tends to change it. This makes the problem even more chal- ing algorithm which takes information about peer’s band- lenging. width into account in order to minimize the initial buffering time when watching a video. Although we are motivated by BitVampire, bandwidth estimation is also an interesting 2.1 Terminology problem in general, since P2P applications can generally A link is defined to be the interconnect between any two offer a better quality of service if they are aware of their network elements. For example, this could be between the bandwidth limitations. an end host and its gateway router or between any two in- termediate routers. BitVampire is a cost-effective P2P video streaming solution, which aims to collate the individual peer’s resources to sup- Each link is modelled to have a constant delay and band- port large scale on-demand media streaming. The basic width. The link latency is a constant delay which is a prop- idea of BitVampire is to split a published video in various erty of the physical medium being used for transmission, segments and distribute these segments among the peers. this value is independent of the amount of data being trans- When a peer requests to watch a video, it creates a schedule ferred. The bandwidth characterizes the rate at which data which aggregates the bandwidth from various other peers can be sent over the link [Curtis and McGregor, 2001]. to stream the video. In order to do that it sends a request to a number of peers, in possession of parts of the movie, Therefore for a packet size P , the time taken to transmit it 1 over a link t is given by The problem with this approach is that cross-traffic is de- P laying the transmission of the probe packets. Thus to cal- t = + l (1) culate the link capacity bandwidth, the measurements for b each packet size are repeated multiple times to discount for , where b is the link bandwidth and l the link latency. Some cross traffic. The assumption is that at least one probe for of the key terms, used in further discussion, are: each packet size won’t get delayed by cross-traffic. For each packet size, only the minimum recorded RTT is taken into account while calculating the linear fit as illustrated in figure Capacity bandwidth is the maximum bandwidth avail- 2. able on a link. This is a static value which doesn’t change over time. 0.75 RTT Available bandwidth refers to the currently available band- Minimum RTT Linear fit nents in the forward and reverse paths: serialization width on a link. Thus this value may continuously vary delays, propagation delays, and queuing delays. The serial- over time. 0.625 ization delay of a packet of size L at a link of transmission rate C is the time to transmit the packet on the link, equal Bottleneck link of a path refers to the link with the min- to L/C. The propagation delay of a packet at a link is the imum capacity bandwidth among all the links on a 0.5 time it takes for each bit of the packet to traverse the link, RTT (ms) and is independent of the packet size. Finally, queuing path. delays can occur in the buffers of routers or switches when there is contention at the input or output ports of these Path capacity bandwidth denotes the capacity bandwidth 0.375 devices. of the bottleneck link. VPS sends multiple probing packets of a given size from the sending host to each layer 3 device along the path. The 0.25 technique assumes that at least one of these packets, together Path available bandwidth is the available bandwidth of 0 200 400 600 800 1000 1200 1400 1600 with the ICMP reply it generates, will not encounter any the bottleneck link. Probing packet size (bytes) queuing delays. Therefore, the minimum RTT measured for each packet size will consist of two terms: a delay that is inde- Cross traffic refers to all traffic going over a link, apart I Figure 4. RTT measurements, minimum RTTs, and the least pendent of packet size and mostly due to propagation delays, from the traffic generated by the method itself. squares linear fit of the minimum RTTs for the first hop of a and a term proportional to the packet size due to serialization Figurepath. 2: Multiple measurements. Source: [Prasaddelays at each link along the packet’s path. Specifically, the et al., 2003] minimum RTT Ti(L) for a given packet size L up to hop i is expected to be able bandwidth metric does not depend on a specific transport We are mostly interested in the path capacity bandwidth i protocol. The BTC depends on how TCP shares bandwidth L T (L) = α + = α + β L, and the path available bandwidth. Note that a path in our with other TCP flows, while the available bandwidth metric i ∑ i (7) In order to get the path capacity bandwidth using this meth- k Ck case is the sequence of links from one peer to another. assumes that the average traffic load remains constant and =1 od, theest linkimate capacitys the additio bandwidthnal bandwidth for a p eachath can link offer along before theits pathwhere: has totig beht l calculated.ink is saturated The. To il RTTlustrate value this po forint, s aup linkpose Na sinis- given• Ck: capacity kth hop 2.2 Single Packet Techniques by equationgle-link p 2,ath wherein with capa wecity C takeis sa intoturate accountd by a sing thele TC RTTP con- values• α: delays up to hop i that do not depend on the probing nection. The available bandwidth in this path would be zero packet size L Single packet techniques work by sending probe packets, for all preceding links 1,...,N. Therefore if one knows the due to path saturation, but the BTC would be about C/2 if the • βi: slope of minimum RTT up to hop i against probing which are then echoed back by the destination. The mea- RTT valuesBTC con fornec alltion the has precedingthe same RT links,T as th onee com canpetin easilyg TCP calcu-packet size L, given by sured round-trip-time (RTT) values are used to form an es- connection.
Recommended publications
  • NET NEUTRALITY Work Operator
    Database NET NEUTRALITY work operator. In October 2007, Comcast was ac- cused of secretly deploying filtering technologies to manage its network in order to keep some peer-to- Net neutrality denotes the neutral transmission of peer traffic from overloading its network and hence data via the Internet, i.e., every packet of data, affecting the accessing speeds of its other Internet regardless of its content, origin and the application subscribers. The FCC deemed it unreasonable for that created it, is treated the same way and the best Comcast to discriminate against particular Internet effort should always be made to forward it.This con- applications and not to disclose its practice ade- cept is often regarded as a fundamental characteris- quately to its customers and therefore ruled against tic of the Internet. However, the amount of data that Comcast’s practices of throttling Internet traffic and is transported via the Internet is increasing rapidly, delaying peer-to-peer traffic. Comcast appealed to especially because of applications like music and vi- the US Court of Appeals, claiming that no legally deo downloads, Internet TV,and Internet telephony. enforceable standards or rules on the matter existed. All these applications require large capacities. This In April 2010 the federal appeals court ruled that the may lead to a capacity overload and delays of data FCC had limited power over Internet traffic under transmissions.The current technological state allows current law. This decision allows network operators for assigning different priorities to different data to block or slow specific sites and charge sites to packets. Therefore, the discussion has emerged deliver their content faster to users.
    [Show full text]
  • AB 1699 Page 1
    AB 1699 Page 1 Date of Hearing: April 30, 2019 ASSEMBLY COMMITTEE ON PRIVACY AND CONSUMER PROTECTION Ed Chau, Chair AB 1699 (Levine) – As Amended April 22, 2019 SUBJECT: Telecommunications: public safety customer accounts: states of emergency SUMMARY: This bill would prohibit, among other things, a mobile internet service provider (ISP) from impairing or degrading the lawful internet traffic of its public safety customer accounts, subject to reasonable network management, as specified, during a state of emergency declared by the President or the Governor, or upon the declaration of a local emergency by an official, board, or other governing body vested with authority to make such a declaration in any city, county, or city and county. This bill would state that the Legislature finds and declares that this bill is adopted pursuant to the police power granted to the State of California under the United States Constitution and cannot be preempted by the Federal Communications Commission (FCC), and that the bill ensures police and emergency services personnel have access to all of the resources necessary for them to operate effectively during a state of emergency. EXISTING LAW: 1) Declares it unlawful for a fixed or mobile ISP, insofar as the provider is engaged in providing fixed broadband internet access service, to engage in certain activities, including, among other things: Blocking lawful content, applications, services, or nonharmful devices, subject to reasonable network management. Impairing or degrading lawful internet traffic on the basis of internet content, application, or service, or use of a nonharmful device, subject to reasonable network management. Unreasonably interfering with, or unreasonably disadvantaging, either an end user’s ability to select, access, and use broadband internet access service or the lawful internet content, applications, services, or devices of the end user’s choice, or an edge provider’s ability to make lawful content, applications, services, or devices available to end users, subject to reasonable network management.
    [Show full text]
  • Zscaler Bandwidth Control Ensures Your Mission-Critical Applications, Like Office 365, Don’T Take a Back Seat to Youtube, OS Updates, and Streaming Content
    DATA SHEET Zscaler™ Bandwidth Control Prioritize business applications over recreational traffic Zscaler Bandwidth Control ensures your mission-critical applications, like Office 365, don’t take a back seat to YouTube, OS updates, and streaming content. The challenge of managing bandwidth in a UTM/Firewall Appliance Sprawl cloud world Leading organizations are moving toward local Internet breakouts to ensure a fast user experience and realize the full agility and cost-saving benefits of the cloud. With more traffic bound for the Internet, it is essential that business apps, like Office 365, are prioritized over YouTube, Spotify, and other recreational traffic like live-streaming sporting events. One way to route traffic locally and police bandwidth is to deploy next- generation firewalls or UTM appliances in each location, but this approach creates costly, unmanageable appliance sprawl. User experience also HQ DATA CENTER suffers with an appliance-based approach because appliances are not designed for bandwidth shaping and will drop packets and interrupt streaming video. And, because this approach is implemented in the last mile, instead of the cloud, the enterprise itself remains vulnerable to bottlenecks and bandwidth contention. Break Free with Zscaler A better approach: Zscaler Bandwidth Control With the majority of your users and applications in the cloud, and most of your traffic now bound for the Internet, it makes sense to move your security and controls to the cloud, too. By implementing Zscaler Bandwidth Control — part of the Zscaler Cloud Security Platform — you can route traffic locally to the Internet, providing great performance and the same level of protection for all users, across all locations.
    [Show full text]
  • FCC Jurisdiction Over ISPS in Protocol-Specific Bandwidth Throttling Andrew Gioia University of Michigan Law School
    Michigan Telecommunications and Technology Law Review Volume 15 | Issue 2 2009 FCC Jurisdiction over ISPS in Protocol-Specific Bandwidth Throttling Andrew Gioia University of Michigan Law School Follow this and additional works at: http://repository.law.umich.edu/mttlr Part of the Administrative Law Commons, Communications Law Commons, and the Internet Law Commons Recommended Citation Andrew Gioia, FCC Jurisdiction over ISPS in Protocol-Specific Bandwidth Throttling, 15 Mich. Telecomm. & Tech. L. Rev. 517 (2009). Available at: http://repository.law.umich.edu/mttlr/vol15/iss2/7 This Note is brought to you for free and open access by the Journals at University of Michigan Law School Scholarship Repository. It has been accepted for inclusion in Michigan Telecommunications and Technology Law Review by an authorized editor of University of Michigan Law School Scholarship Repository. For more information, please contact [email protected]. NOTE FCC JURISDICTION OVER ISPS IN PROTOCOL-SPECIFIC BANDWIDTH THROTTLING Andrew Gioia* Cite as: Andrew Gioia, FCC Jurisdictionover ISPs in Protocol-SpecificBandwidth Throttling, 15 MICH. TELECOMM. TECH. L. REV. 517 (2009), available at http://www.mttlr.org/volfifteen/gioia.pdf I. INTRODUCTION ......................................................................... 518 I. TECHNICAL AND PROCEDURAL BACKGROUND ......................... 519 A . The BitTorrent Protocol..................................................... 519 B. Comcast's Protocol-SpecificDiscrimination Policy .......... 520 III. THE FCC
    [Show full text]
  • Oxygen-3 User Guide
    Oxygen-3 User Guide Model Oxygen-3 3066 Beta Avenue | Burnaby, B.C. | V5G 4K4 Sales: 1.877.985.2878 \ 604.294.4465 Revision Rev 1.9 Support: 1.844.462.9773 \ 778.462.9773 [email protected] Firmware Rev 5.0 Revision Control 2 Revision Control Description Revision Date Release Update 1.1 04-Mar-2015 Minor Update 1.2 23-Sep-2015 Update for firmware rev. 4.3 1.3 29-Sep-2015 Update for firmware rev. 4.4 - 4.5 1.4 18-Dec-2015 Update for firmware rev. 4.6 - 4.7 1.5 09-Jun-2016 Update for firmware rev. 4.8 1.6 11-Aug-2016 Added Chapter on WLAN 1.7 21-Sept-2016 Update for firmware rev. 4.9 1.8 09-Jan-2017 Update for firmware rev. 5.0 1.9 10-July-2017 Contents Revision Control .............................................................................................................................................. 2 Contents .......................................................................................................................................................... 2 1 Legal Notices ........................................................................................................................................... 6 1.1 Regulatory Restrictions ................................................................................................................... 6 1.2 Electromagnetic Interference (EMI) – United States FCC Information ........................................... 7 1.3 Electromagnetic Interference (EMI) – Canada Information ........................................................... 7 1.4 Li-Ion Battery ..................................................................................................................................
    [Show full text]
  • Study on Net-Neutrality Regulation
    BoR (17) 159 Final public report for BEREC Study on net-neutrality regulation 18 September 2017 James Allen, Andrew Daly, J. Scott Marcus, David de Antonio Monte, Robert Woolfson Ref: 2009152-254 . Study on net-neutrality regulation Contents 1 Executive summary 1 1.1 Background and purpose of the work 1 1.2 Overview of approach to tackling net neutrality in each country 1 1.3 Case studies of monitoring tools and techniques 3 1.4 Lessons learnt and concluding remarks 4 2 Introduction 6 2.1 Aim of the study 6 2.2 Summary of net neutrality 6 2.3 Approach to conducting the study 7 2.4 Structure of this document 7 3 Approach to tackling net neutrality in benchmark countries 8 3.1 The evolution of net-neutrality rules over time 8 3.2 Non-net-neutral practices 11 3.3 Transparency obligations on ISPs in relation to practices which may affect net neutrality 19 3.4 Monitoring and supervision by NRAs 22 3.5 Legal mechanisms for enforcement of net neutrality by NRAs 24 3.6 Reporting by NRAs 25 4 Case studies 26 4.1 Chile: Adkintun 26 4.2 Chile: Sistema de Transferencia de Información (STI) 27 4.3 USA: Netalyzr 28 4.4 USA: Measuring Broadband America programme 28 5 Lessons learnt and concluding remarks 33 Annex A Tools and techniques available to detect and characterise non-net-neutral practices Ref: 2009152-254 . Study on net-neutrality regulation Copyright © 2017. Analysys Mason Limited has produced the information contained herein for BEREC. The ownership, use and disclosure of this information are subject to the Commercial Terms contained in the contract between Analysys Mason Limited and BEREC.
    [Show full text]
  • How to Tell If Your ISP Is Throttling and How to Avoid It by Joe Zahl
    http://www.bitvpn.net How to Tell if Your ISP is Throttling and How to Avoid It by Joe Zahl Has your Internet suffered from a slow connection without any reason? Or do you often meet buffering when streaming Netflix or YouTube? It possibly derives from Internet throttling. Here comes a guide on how to check and stop it. What is Throttling? Throttling refers to a process during which Internet Service Providers, or ISPs, intentionally slow down Internet users’ data transmission. Throttling occurs so that you suffer from a slow Internet connection from time to time. You won’t be informed by ISPs of the unexpected slow Internet connection, so it usually leads you to be depressed because of the uncertainty of the data capping. Up to now, the whole Internet connection gets throttled. However, with the abolishment of net neutrality, some people start to become worried that only specific online content will be limited by ISP. Better, it’s not the overall issue. Why do ISPs Throttle Internet? ISPs have more than one “excuse” to throttle your bandwidth. Traffic Congestion During the time when large online traffic is being used, everyone’s data is usually throttled by ISP so that everyone is able to have access to the Internet. Otherwise, some users enjoy the highest speed while others fail to connect at all. Traffic congestion usually takes place during rush hour, from 7 pm to 11 pm. http://www.bitvpn.net Data Caps If your data transmission lowers to the bottom, it’s possible that your Internet speed reaches a top limit.
    [Show full text]
  • The Internet Table How Canadian Arts and Culture Organizations Engage with Telecommunication Policy
    Girard 1 THE INTERNET TABLE HOW CANADIAN ARTS AND CULTURE ORGANIZATIONS ENGAGE WITH TELECOMMUNICATION POLICY Claire Girard, Communication Studies McGill University, Montreal July 2013 A thesis submitted to McGill University in partial fulfilment of the requirements of the degree of Master of Arts © Claire Girard July 2013 Girard 2 Table of Contents Abstract....................................................................................................5 Introduction........................................................................................................7 Chapter 1: Canadian Cultural Organizations....................................................13 Defining the Arts Organization.............................................................13 Cultural Institutions..........................................................................19 Cultural Industry Representative Organizations..............................21 Artists’ Organizations.......................................................................26 Art Service Organizations................................................................27 Overlapping Types and the Necessity for an Inclusive Definition...29 A History of Communication and Cultural Policy Advocacy From the Cultural Sector...............................................................................31 The Canadian Radio League and the Canadian Broadcasting Corporation..............................................................................32 Technological Developments and the Canadian Magazine
    [Show full text]
  • EXTENDING DARKNETS VIA MOBILE AD HOC NETWORKS Aaron Helton, St
    EXTENDING DARKNETS VIA MOBILE AD HOC NETWORKS Aaron Helton, St. Edward’s University ABSTRACT The future of darknets, for good or ill, depends on their ability to adapt to new technologies designed both to defeat them and to facilitate them. One of the best ways to strengthen and extend darknets is through mobile ad hoc networks that can provide robustness, and anonymizing software that can provide a fair amount of anonymity to users of darknets. This paper explores some of the ways that mobile ad hoc networks can be secured against attacks aimed at reducing or eliminating the availability of darknet materials or discovering the identities of darknet participants that utilize such networks. DARKNET OVERVIEW The term “darknet” was coined in 2002 by four Microsoft employees. It is typically used to describe one of the many peer-to-peer file sharing networks in wide use today. As Biddle, England, Peinado and Willman [3] state, a “darknet is not a separate physical network but an application and protocol layer riding on existing networks.” Ideologically, however, such networks are thought to exist on the fringes of the regular, “legitimate” Internet. Despite this, evidence suggests that usage is on the rise. For example, according to Nathan Anderson [1], writing for technology news site Ars Technica, users (called peers) of one of the most popular BitTorrent site on the Web, ThePirateBay, recently broke the twenty-two million mark. This represents only a fraction of total peer-to-peer file sharing, since this is only one site and one protocol. There are still numerous users on other file sharing networks such as Kazaa, GNUtella, and the like.
    [Show full text]
  • Att Complaints About Slow Internet
    Att Complaints About Slow Internet coheringAffinitive RameshBreughel. sometimes Polyhistoric synonymising Dana denuding, his beatnik his vulgariser bene and mills jab extolling so sideling! calamitously. Contractually intracardiac, Shay bandy Beaufort and News about internet Compare Time Warner Spectrum vs AT&T. The minimum internet speeds for streaming video in 2019. Determines how slow internet down your complaints currently at the order to about stock holders and slowing down data capacity, slowed down its all day. Internet problems today. We came after AT T for its wireless internet speed and arrange network set point in October. Worse thing monday morning and att. AT&T Unlimited Data Customers Getting Refunds Page 2. If should have questions or complaints about your country or bills please contact us online at attcomuversetvsupport or call 002. San diego and volume of no text and file a pandemic they give me on why? 15k votes 11k comments 101m members in the technology community Subreddit dedicated to the office and discussions about the creation and alternate of. AT T throttled their Internet speeds so frail they ask much slower than normal. What Is Consumer Cellular and Is coffin Worth It Tom's Guide. What is seeing good internet speed Why it matters to travelers Los. Prepaid carriers---also known as mobile virtual network operators. Why cooperate AT&T Website So Slow Internet Access Guide. There aren't any glaring complaints about either hand on our radar and lower think you'll place very satisfied. Fiber cut internet Rivo Sound. Sprint phone with att complaints about slow internet slow internet is att store to what internet speeds than satellite.
    [Show full text]
  • Improving Traffic Locality in Bittorrent Via Biased Neighbor
    Improving Traffic Locality in BitTorrent via Biased Neighbor Selection Ruchir Bindal Jan Medved Pei Cao George Suwala William Chan Tony Bates Department of Computer Science Amy Zhang Stanford University Cisco Systems, Inc. [email protected] Abstract transfers among randomly chosen sets of peers distributed over the Internet, it proves to be costly for ISP’s. Peer-to-peer (P2P) applications such as BitTorrent ig- ISPs often control BitTorrent traffic by “throttling”, or nore traffic costs at ISPs and generate a large amount of bandwidth limiting. Since BitTorrent traffic typically runs cross-ISP traffic. As a result, ISPs often throttle BitTor- over a fixed range of ports (6881 to 6889) [6] and is easily rent traffic to control the cost. In this paper, we examine decoded, traffic shaping devices such as [20, 13, 19, 23] are a new approach to enhance BitTorrent traffic locality, bi- deployed to limit the amount of bandwidth consumed by the ased neighbor selection, in which a peer chooses the ma- BitTorrent protocol. However, this mainly slows down the jority, but not all, of its neighbors from peers within the content transfer and worsens the user download experience, same ISP. Using simulations, we show that biased neighbor not addressing the fundamental concern of the ISP, which is selection maintains the nearly optimal performance of Bit- to improve the locality (i.e. reduce the cross-ISP traffic) of Torrent in a variety of environments, and fundamentally re- those transfers. duces the cross-ISP traffic by eliminating the traffic’s linear Many analytical and simulation studies [16, 1, 25, 22] growth with the number of peers.
    [Show full text]
  • Consultation on a Modern Copyright Framework for Online Intermediaries
    Consultation on a Modern Copyright Framework for Online Intermediaries Submission of the Canadian Internet Registration Authority Canadian Internet Registration Authority (CIRA) #400, 979 Bank Street Ottawa, On K1S 5K5 May 31, 2021 1 CLASSIFICATION:PUBLIC TABLE OF CONTENTS EXECUTIVE SUMMARY .................................................................................................................................. 3 INTRODUCTION ............................................................................................................................................. 5 ABOUT CIRA .................................................................................................................................................. 7 The .CA DNS and Registry ........................................................................................................... 7 CIRA’S Relevant Experience ........................................................................................................ 8 OPTIONS FOR REFORM AS CONTEMPLATED BY THE CONSULTATION PAPER ............................................. 9 DNS ABUSE .................................................................................................................................................. 10 PRINCIPLES .................................................................................................................................................. 13 Necessity ..................................................................................................................................
    [Show full text]