Performance Evaluation of Weighted Fair Queuing System Using Matrix Geometric Method
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
15-744: Computer Networking Fair Queuing Overview Example
Fair Queuing • Fair Queuing • Core-stateless Fair queuing 15-744: Computer Networking • Assigned reading • Analysis and Simulation of a Fair Queueing Algorithm, Internetworking: Research and Experience L-7 Fair Queuing • Congestion Control for High Bandwidth-Delay Product Networks (XTP - 2 sections) 2 Overview Example • 10Gb/s linecard • TCP and queues • Requires 300Mbytes of buffering. • Queuing disciplines • Read and write 40 byte packet every 32ns. •RED • Memory technologies • DRAM: require 4 devices, but too slow. • Fair-queuing • SRAM: require 80 devices, 1kW, $2000. • Core-stateless FQ • Problem gets harder at 40Gb/s • Hence RLDRAM, FCRAM, etc. •XCP 3 4 1 Rule-of-thumb If flows are synchronized • Rule-of-thumb makes sense for one flow Wmax • Typical backbone link has > 20,000 flows • Does the rule-of-thumb still hold? Wmax 2 Wmax Wmax 2 t • Aggregate window has same dynamics • Therefore buffer occupancy has same dynamics • Rule-of-thumb still holds. 5 6 If flows are not synchronized Central Limit Theorem W B • CLT tells us that the more variables (Congestion 0 Windows of Flows) we have, the narrower the Gaussian (Fluctuation of sum of windows) • Width of Gaussian decreases with 1 n 1 • Buffer size should also decreases with n Bn1 2T C Buffer Size Probability B Distribution n n 7 8 2 Required buffer size Overview • TCP and queues • Queuing disciplines •RED 2TC n • Fair-queuing • Core-stateless FQ Simulation •XCP 9 10 Queuing Disciplines Packet Drop Dimensions • Each router must implement some queuing discipline Aggregation Per-connection -
Queueing-Theoretic Solution Methods for Models of Parallel and Distributed Systems·
1 Queueing-Theoretic Solution Methods for Models of Parallel and Distributed Systems· Onno Boxmat, Ger Koolet & Zhen Liui t CW/, Amsterdam, The Netherlands t INRIA-Sophia Antipolis, France This paper aims to give an overview of solution methods for the performance analysis of parallel and distributed systems. After a brief review of some important general solution methods, we discuss key models of parallel and distributed systems, and optimization issues, from the viewpoint of solution methodology. 1 INTRODUCTION The purpose of this paper is to present a survey of queueing theoretic methods for the quantitative modeling and analysis of parallel and distributed systems. We discuss a number of queueing models that can be viewed as key models for the performance analysis and optimization of parallel and distributed systems. Most of these models are very simple, but display an essential feature of dis tributed processing. In their simplest form they allow an exact analysis. We explore the possibilities and limitations of existing solution methods for these key models, with the purpose of obtaining insight into the potential of these solution methods for more realistic complex quantitative models. As far as references is concerned, we have restricted ourselves in the text mainly to key references that make a methodological contribution, and to sur veys that give the reader further access to the literature; we apologize for any inadvertent omissions. The reader is referred to Gelenbe's book [65] for a general introduction to the area of multiprocessor performance modeling and analysis. Stochastic Petri nets provide another formalism for modeling and perfor mance analysis of discrete event systems. -
15-744: Computer Networking Fair Queuing Overview Example
Fair Queuing • Fair Queuing • Core-stateless Fair queuing 15-744: Computer Networking • Assigned reading • [DKS90] Analysis and Simulation of a Fair Queueing Algorithm, Internetworking: Research and Experience L-5 Fair Queuing • [SSZ98] Core-Stateless Fair Queueing: Achieving Approximately Fair Allocations in High Speed Networks 2 Overview Example • 10Gb/s linecard • TCP and queues • Requires 300Mbytes of buffering. • Queuing disciplines • Read and write 40 byte packet every 32ns. • RED • Memory technologies • DRAM: require 4 devices, but too slow. • Fair-queuing • SRAM: require 80 devices, 1kW, $2000. • Core-stateless FQ • Problem gets harder at 40Gb/s • Hence RLDRAM, FCRAM, etc. • XCP 3 4 1 Rule-of-thumb If flows are synchronized • Rule-of-thumb makes sense for one flow • Typical backbone link has > 20,000 flows • Does the rule-of-thumb still hold? t • Aggregate window has same dynamics • Therefore buffer occupancy has same dynamics • Rule-of-thumb still holds. 5 6 If flows are not synchronized Central Limit Theorem B • CLT tells us that the more variables (Congestion 0 Windows of Flows) we have, the narrower the Gaussian (Fluctuation of sum of windows) • Width of Gaussian decreases with • Buffer size should also decreases with Buffer Size Probability Distribution 7 8 2 Required buffer size Overview • TCP and queues • Queuing disciplines • RED • Fair-queuing • Core-stateless FQ Simulation • XCP 9 10 Queuing Disciplines Packet Drop Dimensions • Each router must implement some queuing discipline Aggregation Per-connection state Single -
A Simple, Practical Prioritization Scheme for a Job Shop Processing Multiple Job Types
University of Tennessee, Knoxville TRACE: Tennessee Research and Creative Exchange Doctoral Dissertations Graduate School 8-2013 A Simple, Practical Prioritization Scheme for a Job Shop Processing Multiple Job Types Shuping Zhang [email protected] Follow this and additional works at: https://trace.tennessee.edu/utk_graddiss Part of the Management Sciences and Quantitative Methods Commons Recommended Citation Zhang, Shuping, "A Simple, Practical Prioritization Scheme for a Job Shop Processing Multiple Job Types. " PhD diss., University of Tennessee, 2013. https://trace.tennessee.edu/utk_graddiss/2503 This Dissertation is brought to you for free and open access by the Graduate School at TRACE: Tennessee Research and Creative Exchange. It has been accepted for inclusion in Doctoral Dissertations by an authorized administrator of TRACE: Tennessee Research and Creative Exchange. For more information, please contact [email protected]. To the Graduate Council: I am submitting herewith a dissertation written by Shuping Zhang entitled "A Simple, Practical Prioritization Scheme for a Job Shop Processing Multiple Job Types." I have examined the final electronic copy of this dissertation for form and content and recommend that it be accepted in partial fulfillment of the equirr ements for the degree of Doctor of Philosophy, with a major in Management Science. Mandyam M. Srinivasan, Melissa Bowers, Major Professor We have read this dissertation and recommend its acceptance: Ken Gilbert, Theodore P. Stank Accepted for the Council: Carolyn R. Hodges Vice Provost and Dean of the Graduate School (Original signatures are on file with official studentecor r ds.) A Simple, Practical Prioritization Scheme for a Job Shop Processing Multiple Job Types A Dissertation Presented for the Doctor of Philosophy Degree The University of Tennessee, Knoxville Shuping Zhang August 2013 Copyright © 2013 by Shuping Zhang All rights reserved. -
Queue Scheduling Disciplines
White Paper Supporting Differentiated Service Classes: Queue Scheduling Disciplines Chuck Semeria Marketing Engineer Juniper Networks, Inc. 1194 North Mathilda Avenue Sunnyvale, CA 94089 USA 408 745 2000 or 888 JUNIPER www.juniper.net Part Number:: 200020-001 12/01 Contents Executive Summary . 4 Perspective . 4 First-in, First-out (FIFO) Queuing . 5 FIFO Benefits and Limitations . 6 FIFO Implementations and Applications . 6 Priority Queuing (PQ) . 6 PQ Benefits and Limitations . 7 PQ Implementations and Applications . 8 Fair Queuing (FQ) . 9 FQ Benefits and Limitations . 9 FQ Implementations and Applications . 10 Weighted Fair Queuing (WFQ) . 11 WFQ Algorithm . 11 WFQ Benefits and Limitations . 13 Enhancements to WFQ . 14 WFQ Implementations and Applications . 14 Weighted Round Robin (WRR) or Class-based Queuing (CBQ) . 15 WRR Queuing Algorithm . 15 WRR Queuing Benefits and Limitations . 16 WRR Implementations and Applications . 18 Deficit Weighted Round Robin (DWRR) . 18 DWRR Algorithm . 18 DWRR Pseudo Code . 19 DWRR Example . 20 DWRR Benefits and Limitations . 24 DWRR Implementations and Applications . 25 Conclusion . 25 References . 26 Textbooks . 26 Technical Papers . 26 Seminars . 26 Web Sites . 27 Copyright © 2001, Juniper Networks, Inc. List of Figures Figure 1: First-in, First-out (FIFO) Queuing . 5 Figure 2: Priority Queuing . 7 Figure 3: Fair Queuing (FQ) . 9 Figure 4: Class-based Fair Queuing . 11 Figure 5: A Weighted Bit-by-bit Round-robin Scheduler with a Packet Reassembler . 12 Figure 6: Weighted Fair Queuing (WFQ)—Service According to Packet Finish Time . 13 Figure 7: Weighted Round Robin (WRR) Queuing . 15 Figure 8: WRR Queuing Is Fair with Fixed-length Packets . 17 Figure 9: WRR Queuing is Unfair with Variable-length Packets . -
Enhanced Core Stateless Fair Queuing with Multiple Queue Priority Scheduler
The International Arab Journal of Information Technology, Vol. 11, No. 2, March 2014 159 Enhanced Core Stateless Fair Queuing with Multiple Queue Priority Scheduler Nandhini Sivasubramaniam 1 and Palaniammal Senniappan 2 1Department of Computer Science, Garden City College of Science and Management Studies, India 2Department of Science and Humanities, VLB Janakiammal College of Engineering and Technology, India Abstract: The Core Stateless Fair Queuing (CSFQ) is a distributed approach of Fair Queuing (FQ). The limitations include its inability to estimate fairness during large traffic flows, which are short and bursty (VoIP or video), and also it utilizes the single FIFO queue at the core router. For improving the fairness and efficiency, we propose an Enhanced Core Stateless Fair Queuing (ECSFQ) with multiple queue priority scheduler. Initially priority scheduler is applied to the flows entering the ingress edge router. If it is real time flow i.e., VoIP or video flow, then the packets are given higher priority else lower priority. In core router, for higher priority flows the Multiple Queue Fair Queuing (MQFQ) is applied that allows a flow to utilize multiple queues to transmit the packets. In case of lower priority, the normal max-min fairness criterion of CSFQ is applied to perform probabilistic packet dropping. By simulation results, we show that this technique improves the throughput of real time flows by reducing the packet loss and delay. Keywords: CSFQ, quality of service, MQFQ, priority scheduler. Received November 21, 2011; accepted July 29, 2012; published online January 29, 2013 1. Introduction 1.2. Fair Queuing Techniques 1.1. Queuing Algorithms in Networking Queuing in networking includes techniques like priority queuing [7, 11, 13], Fair Queuing (FQ) [2, 10, Queueing Theory is a branch of applied probability 19] and Round Robin Queuing [12, 15, 16]. -
Algorithmic Methods in Queueing Theory (Aiqt)
Algorithmic Methods in Queueing Theory (AiQT) server arrival rate Lq = 3 load: = < 1 Thanks to: Ahmad Al Hanbali Rob van der Mei CWI and VU University Amsterdam Contact: [email protected], www.few.vu.nl/~mei 1 Time schedule Course Teacher Topics Date 1 Rob Methods for equilibrium distributions for Markov chains 19/11/18 2 Rob Markov processes and transient analysis 26/11/18 3 Rob M/M/1‐type models and matrix‐geometric method 03/12/18 4 Stella Compensation approach method 10/12/18 5 Stella Power‐series algorithm 17/12/18 6RobBuffer occupancy method 21/01/19 7 Rob Descendant set approach 28/01/19 8 Stella Boundary value approach 04/02/19 9 Stella Uniformization, Wiener‐Hopf factorization, kernel method, 11/02/19 numerical inversion of PGF’s, dominant pole approximation 10 Stella Connection of MG approach, boundary value approach and 18/02/19 compensation approach Wrap up of last two courses • Calculating equilbrium distributions for discrete- time Markov chains • Direct methods 1. Gaussian elimination – numerically unstable 2. GTH method (reduction of Markov chains via folding) • Spectral decomposition theorem for matrix power Qn • Maximum eigenvalue (spectral radius) and second largest eigenvalues (sub-radius) • Indirect methods 1. Matrix powers 2. Power method 3. Gauss-Seidel 4. Iterative bounds 3 Wrap up of last week • Continuous-time Markov chains and transient analysis • Continuous-time Markov chains 1. Generator matrix Q 2. Uniformization 3. Relation CTMC with discrete-time MC at jump moments • Transient analysis 1. Kolmogorov equations -
Per-Flow Fairness in the Datacenter Network Yixi Gong, James W
1 Per-Flow Fairness in the Datacenter Network YiXi Gong, James W. Roberts, Dario Rossi Telecom ParisTech Abstract—Datacenter network (DCN) design has been ac- produced by gaming applications [1], instant voice transla- tively researched for over a decade. Solutions proposed range tion [29] and augmented reality services, for example. The from end-to-end transport protocol redesign to more intricate, exact flow mix will also be highly variable in time, depending monolithic and cross-layer architectures. Despite this intense activity, to date we remark the absence of DCN proposals based both on the degree to which applications rely on offloading to on simple fair scheduling strategies. In this paper, we evaluate the Cloud and on the accessibility of the Cloud that varies due the effectiveness of FQ-CoDel in the DCN environment. Our to device capabilities, battery life, connectivity opportunity, results show, (i) that average throughput is greater than that etc. [9]. attained with DCN tailored protocols like DCTCP, and (ii) the As DCN resources are increasingly shared among multiple completion time of short flows is close to that of state-of-art DCN proposals like pFabric. Good enough performance and stakeholders, we must question the appropriateness of some striking simplicity make FQ-CoDel a serious contender in the frequently made assumptions. How can one rely on all end- DCN arena. systems implementing a common, tailor-made transport pro- tocol like DCTCP [6] when end-systems are virtual machines under tenant control? How can one rely on applications I. INTRODUCTION truthfully indicating the size of their flows to enable shortest In the last decade, datacenter networks (DCNs) have flow first scheduling as in pFabric [8] when a tenant can gain increasingly been built with relatively inexpensive off-the- better throughput by simply slicing a long flow into many shelf devices. -
Analysis of MAP/PH/1 Queueing Model with Breakdown, Instantaneous Feedback and Server Vacation
Available at Applications and Applied http://pvamu.edu/aam Mathematics: Appl. Appl. Math. An International Journal ISSN: 1932-9466 (AAM) Vol. 15, Issue 2 (June 2000), pp. 673 – 707 Analysis of MAP=PH=1 Queueing Model with Breakdown, Instantaneous Feedback and Server Vacation 1G. Ayyappan and 2K. Thilagavathy 1;2Department of Mathematics Pondicherry Engineering College Puducherry, India [email protected]; [email protected] Received: July 7, 2020; Accepted: October 3, 2020 Abstract In this article, we analyze a single server queueing model with feedback, a single vacation under Bernoulli schedule, breakdown and repair. The arriving customers follow the Markovian Arrival Process (MAP) and service follow the phase-type distribution. When the server returns from vacation, if there is no one present in the system, the server will wait until the customer’s arrival. When the service completion epoch if the customer is not satisfied then that customer will get the service immediately. Under the steady-state probability vector that the total number of customers are present in the system is probed by the Matrix-analytic method. In our model, the stability condition, some system performance measures are discussed and we have examined the analysis of the busy period. Numerical results and some graphical representation are discussed for the proposed model. Keywords: Markovian arrival process; Instantaneous feedback; Phase-type distributions; Breakdown; Repair; Single vacation; Matrix-analytic method MSC (2010) No.: 60K25, 68M20, 90B22 1. Introduction The Markovian Arrival Process is a rich class of point processes, a special class of tractable Markov renewal process that includes many well-known process such as Poisson, Markov-Modulated Poisson process and PH-renewal processes. -
Matrix-Geometric Method for M/M/1 Queueing Model Subject to Breakdown ATM Machines
American Journal of Engineering Research (AJER) 2018 American Journal of Engineering Research (AJER) e-ISSN: 2320-0847 p-ISSN : 2320-0936 Volume-7, Issue-1, pp-246-252 www.ajer.org Research Paper Open Access Matrix Geometric Method for M/M/1 Queueing Model With And Without Breakdown ATM Machines 1Shoukry, E.M.*, 2Salwa, M. Assar* 3Boshra, A. Shehata*. * Department of Mathematical Statistics, Institute of Statistical Studies and Research, Cairo University. Corresponding Author: Shoukry, E.M ABSTRACT: The matrix geometric method is used to derive the stationary distribution of the M/M/1 queueing model with breakdown using the transition structure of its Markov Chain. The M/M/1 queueing model for the ATM machine using the matrix geometric method will be introduced. We study the stability of the two systems with and without breakdown to obtain expressions of the performance measures for the two models. Finally, a comparative study was introduced between the M/M/1 queueing models with and without breakdown. Keyword: Queues, ATM, Breakdown, Matrix geometric method, Markov Chain. --------------------------------------------------------------------------------------------------------------------------------------- Date of Submission: 12-01-2018 Date of acceptance: 27-01-2018 --------------------------------------------------------------------------------------------------------------------------------------- I. INTRODUCTION Queueing theory and related models are used to approximate real queueing situations, so the queueing behavior can be analyzed -
An Extension of the Codel Algorithm
Proceedings of the International MultiConference of Engineers and Computer Scientists 2015 Vol II, IMECS 2015, March 18 - 20, 2015, Hong Kong Hard Limit CoDel: An Extension of the CoDel Algorithm Fengyu Gao, Hongyan Qian, and Xiaoling Yang Abstract—The CoDel algorithm has been a significant ad- II. BACKGROUND INFORMATION vance in the field of AQM. However, it does not provide bounded delay. Rather than allowing bursts of traffic, we argue that a Nowadays the Internet is suffering from high latency and hard limit is necessary especially at the edge of the Internet jitter caused by unprotected large buffers. The “persistently where a single flow can congest a link. Thus in this paper we full buffer problem”, recently exposed as “bufferbloat” [1], proposed an extension of the CoDel algorithm called “hard [2], has been observed for decades, but is still with us. limit CoDel”, which is fairly simple but effective. Instead of number of packets, this extension uses the packet sojourn time When recognized the problem, Van Jacobson and Sally as the metric of limit. Simulation experiments showed that the Floyd developed a simple and effective algorithm called RED maximum delay and jitter have been well controlled with an (Random Early Detection) in 1993 [3]. In 1998, the Internet acceptable loss on throughput. Its performance is especially Research Task Force urged the deployment of active queue excellent with changing link rates. management in the Internet [4], specially recommending Index Terms—bufferbloat, CoDel, AQM. RED. However, this algorithm has never been widely deployed I. INTRODUCTION because of implementation difficulties. The performance of RED depends heavily on the appropriate setting of at least The CoDel algorithm proposed by Kathleen Nichols and four parameters: Van Jacobson in 2012 has been a great innovation in AQM. -
Scheduling for Fairness: Fair Queueing and CSFQ
Copyright Hari Balakrishnan, 1998-2005, all rights reserved. Please do not redistribute without permission. LECTURE 8 Scheduling for Fairness: Fair Queueing and CSFQ ! 8.1 Introduction nthe last lecture, we discussed two ways in which routers can help in congestion control: Iby signaling congestion, using either packet drops or marks (e.g., ECN), and by cleverly managing its buffers (e.g., using an active queue management scheme like RED). Today, we turn to the third way in which routers can assist in congestion control: scheduling. Specifically, we will first study a particular form of scheduling, called fair queueing (FQ) that achieves (weighted) fair allocation of bandwidth between flows (or between whatever traffic aggregates one chooses to distinguish between.1 While FQ achieves weighted-fair bandwidth allocations, it requires per-flow queueing and per-flow state in each router in the network. This is often prohibitively expensive. We will also study another scheme, called core-stateless fair queueing (CSFQ), which displays an interesting design where “edge” routers maintain per-flow state whereas “core” routers do not. They use their own non- per-flow state complimented with some information reaching them in packet headers (placed by the edge routers) to implement fair allocations. Strictly speaking, CSFQ is not a scheduling mechanism, but a way to achieve fair bandwidth allocation using differential packet dropping. But because it attempts to emulate fair queueing, it’s best to discuss the scheme in conjuction with fair queueing. The notes for this lecture are based on two papers: 1. A. Demers, S. Keshav, and S. Shenker, “Analysis and Simulation of a Fair Queueing Algorithm”, Internetworking: Research and Experience, Vol.