Performance Analysis of Multiclass Queueing Networks Via Brownian Approximation
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Running in Circles: Packet Routing on Ring Networks by William F
Running in Circles: Packet Routing on Ring Networks by William F. Bradley Submitted to the Department of Mathematics in partial fulfillment of the requirements for the degree of Doctor of Philosophy at the MASSACHUSETTS INSTITUTE OF TECHNOLOGY June 2002 c 2002 William F. Bradley. All rights reserved Author............................................. ............................... Department of Mathematics April 26, 2002 Certified by.......................................... .............................. F. T. Leighton Professor of Applied Mathematics Thesis Supervisor arXiv:1402.2963v1 [math.PR] 12 Feb 2014 Accepted by......................................... .............................. R. B. Melrose Chairman, Committee on Pure Mathematics 2 Running in Circles: Packet Routing on Ring Networks by William F. Bradley Submitted to the Department of Mathematics on April 26, 2002, in partial fulfillment of the requirements for the degree of Doctor of Philosophy Abstract I analyze packet routing on unidirectional ring networks, with an eye towards establishing bounds on the expected length of the queues. Suppose we route packets by a greedy “hot potato” protocol. If packets are inserted by a Bernoulli process and have uniform destinations around the ring, and if the nominal load is kept fixed, then I can construct an upper bound on the expected queue length per node that is independent of the size of the ring. If the packets only travel one or two steps, I can calculate the exact expected queue length for rings of any size. I also show some stability results under more general circumstances. If the packets are inserted by any ergodic hidden Markov process with nominal loads less than one, and routed by any greedy protocol, I prove that the ring is ergodic. Thesis Supervisor: F. -
Queueing Systems
Queueing Systems Queueing Systems Alain Jean-Marie INRIA/LIRMM, Université de Montpellier, CNRS [email protected] RESCOM Summer School 2019 June 2019 Queueing Systems About the class This class: Lesson 4: Queueing Systems (2h, now) Case Study 3: Queuing Systems (1h, after the break) Companion classes: Lesson 5 and Case Study 4: Markov Decision Processes by E. Hyon (2h + 1h, tomorrow) Common Lab: Lab 3: Queueing Systems and Markov Decision Processes (2h, Friday) Related talk: Opening 1: Models of Hidden Markov Chains for Trace Analysis on the Internet by S. Vatton (1h30, tomorrow) Queueing Systems Preparation of the lab Topic of the lab: programming the basic discrete-time queue with impatience using the library marmoreCore (C++ programming) programming the same queue with a control of the service using the library marmoteMDP finding the optimal control policy. Preparation: two possibilities using a virtual machine with virtualbox download VM + instructions from http://www-desir.lip6.fr/~hyon/Marmote/MachineVirtuelle/Rescom2019_ TP.html copy it from USB drive, ask the technician! using the library (linux only) tarball + instructions from https://marmotecore.gforge.inria.fr/dokuwiki/ Queueing Systems General Plan Part 1: Basic features of queueing systems Part 2: Metrics associated with queuing Part 3: Modeling queueing systems with Markov chains Part 4: Numerical solution and simulation Queueing Systems Part 1: Basics of Queueing Part 1: Basics of Queueing Queueing Systems Part 1: Basics of Queueing Basics of Queueing: Plan Table of contents customers, buffers, servers, arrival process, service time buffer capacity, blocking, rejection, impatience, balking, reneging customer classes, scheduling policy Kendall’s notation networks of queues, routing, blocking Queueing Systems Part 1: Basics of Queueing Single Queues Why study queues? Queues are everywhere.. -
Stochastic Monotonicity of Markovian Multi-Class Queueing
Stochastic Systems arXiv: arXiv:0000.0000 STOCHASTIC MONOTONICITY OF MARKOVIAN MULTI-CLASS QUEUEING NETWORKS By H. Leahu, M. Mandjes University of Amsterdam Multi-class queueing networks (McQNs) extend the classi- cal concept of Jackson network by allowing jobs of different classes to visit the same server. While such a generalization seems rather natural, from a structural perspective there is a sig- nificant gap between the two concepts. Nice analytical features of Jackson networks, such as stability conditions, product-form equilibrium distributions, and stochastic monotonicity do not immediately carry over to the multi-class framework. The aim of this paper is to shed some light on this structural gap, focusing on monotonicity properties. To this end, we in- troduce and study a class of Markov processes, which we call Q-processes, modeling the time evolution of the network configu- ration of any open, work-conservative McQN having exponential service times and Poisson input. We define a new monotonicity notion tailored for this class of processes. Our main result is that we show monotonicity for a large class of McQN models, covering virtually all instances of practical interest. This leads to interesting properties which are commonly encountered for ‘traditional’ queueing processes, such as (i) monotonicity with respect to external arrival rates and (ii) star-convexity of the stability region (with respect to the external arrival rates); such properties are well known for Jackson networks, but had not been established at this level of generality. This research was partly motivated by the recent development of a simulation-based method which allows one to numerically determine the stability region of a McQN parametrized in terms of the arrival rates vector. -
Queueing Network and Some Types of Customers and Signals
Queueing Network and Some Types of Customers and Signals Thu-Ha Dao-Thi Chargee´ de recherche CNRS, PRiSM, UVSQ, France Joint work with J.M Fourneau, J. Mairesse, M.A Tran VMS-SMF Joint Congress, Hue, August 23th 2012 Dao Ha Queueing Network and Some Types of Customers and Signals Introduction-Preliminaries 0-automatic queues and networks New type of signals Plan 1 Introduction-Preliminaries Queue? Network? 2 0-automatic queues and networks Introduction of 0-automatic queues Results on 0-automatic queues and networks 3 Some new types of signals in G-networks Dao Ha Queueing Network and Some Types of Customers and Signals Introduction-Preliminaries 0-automatic queues and networks New type of signals Plan 1 Introduction-Preliminaries Queue? Network? 2 0-automatic queues and networks Introduction of 0-automatic queues Results on 0-automatic queues and networks 3 Some new types of signals in G-networks Dao Ha Queueing Network and Some Types of Customers and Signals Introduction-Preliminaries 0-automatic queues and networks New type of signals Plan 1 Introduction-Preliminaries Queue? Network? 2 0-automatic queues and networks Introduction of 0-automatic queues Results on 0-automatic queues and networks 3 Some new types of signals in G-networks Dao Ha Queueing Network and Some Types of Customers and Signals Introduction-Preliminaries 0-automatic queues and networks Queue? Network? New type of signals Outline 1 Introduction-Preliminaries Queue? Network? 2 0-automatic queues and networks Introduction of 0-automatic queues Results on 0-automatic queues and networks 3 Some new types of signals in G-networks Dao Ha Queueing Network and Some Types of Customers and Signals Introduction-Preliminaries 0-automatic queues and networks Queue? Network? New type of signals In daily life Dao Ha Queueing Network and Some Types of Customers and Signals Servers 1 the arriving process 2 . -
Absorbing State in Markov Decision Process, 330 Absorption, 466
Index Absorbing state Average-cost criterion, 326, 360 in Markov decision process, 330 Back-substitution, 182-183 Absorption, 466 Bailey's bulk queue, 209, 247-248 Accelerating convergence, 273 Balance equations, 412 Acceleration, 268, 270 global, 130, 411-412, 414 Action space, 326 job-class, 423 Adjoint, 215, 230 local, 130, 422 Agarwal, 289, 298 partial, 411-414, 418, 422 Aggregate station, 437 station, 411, 413-414, 418, 422 Aggregation, 57 and blocking, 427 Aggregation matrix, 102 failure of, 425 Aggregation step, 103 restored, 427, 429, 435 Aliased sequence, 277 Barthez, 272 Aliasing, 266 BASTA, 373 See also Error, aliasing Benes, 282, 284, 287 Alternating series, 268 Bernoulli arrivals, 373 Analytic, 206, 208, 210, 216, 235, 238 Bernoulli process, 387 Analyticity condition, 294 Bertozzi, 304 And gate, 462 Binomial average, 270 Approximation, 375, 377-378, 380-381, 388, Binomial distribution, 270 392-393, 396 Block elimination, 175, 179, 183 of transition matrix, 180, 357 and paradigms of Neuts, 187-189 Arbitrary-epoch tail probabilities, 381 Block iterative methods, 93 Arbitrary service time, 381 Block Jacobi, 94 Argument principle, 207, 239 Block SOR, 94 Arnoldi's method, 53, 83, 97 Block-splitting, 93 Arrival-first, 366 Blocking, 158, 425-427 Asmussen, 293, 299, 301 Blocking probability, 410 Assembly line, 415 Erlang,283 Asymptotic behavior, 243 time dependent, 280, 282 Asymptotic formulas, 282 Borovkov, 281 Asymptotic parameter, 294 Boundary probabilities, 206, 210, 218 Asymptotics, 303 Bounding methodology, 428-429 Automata: -
Markovian Queueing Networks
Richard J. Boucherie Markovian queueing networks Lecture notes LNMB course MQSN September 5, 2020 Springer Contents Part I Solution concepts for Markovian networks of queues 1 Preliminaries .................................................. 3 1.1 Basic results for Markov chains . .3 1.2 Three solution concepts . 11 1.2.1 Reversibility . 12 1.2.2 Partial balance . 13 1.2.3 Kelly’s lemma . 13 2 Reversibility, Poisson flows and feedforward networks. 15 2.1 The birth-death process. 15 2.2 Detailed balance . 18 2.3 Erlang loss networks . 21 2.4 Reversibility . 23 2.5 Burke’s theorem and feedforward networks of MjMj1 queues . 25 2.6 Literature . 28 3 Partial balance and networks with Markovian routing . 29 3.1 Networks of MjMj1 queues . 29 3.2 Kelly-Whittle networks. 35 3.3 Partial balance . 39 3.4 State-dependent routing and blocking protocols . 44 3.5 Literature . 50 4 Kelly’s lemma and networks with fixed routes ..................... 51 4.1 The time-reversed process and Kelly’s Lemma . 51 4.2 Queue disciplines . 53 4.3 Networks with customer types and fixed routes . 59 4.4 Quasi-reversibility . 62 4.5 Networks of quasi-reversible queues with fixed routes . 68 4.6 Literature . 70 v Part I Solution concepts for Markovian networks of queues Chapter 1 Preliminaries This chapter reviews and discusses the basic assumptions and techniques that will be used in this monograph. Proofs of results given in this chapter are omitted, but can be found in standard textbooks on Markov chains and queueing theory, e.g. [?, ?, ?, ?, ?, ?, ?]. Results from these references are used in this chapter without reference except for cases where a specific result (e.g. -
An Overflow Loss Network Model for Capacity Plan
CORE Metadata, citation and similar papers at core.ac.uk Provided by STORE - Staffordshire Online Repository An Overflow Loss Network Model for Capacity Plan- ning of a Perinatal Network Md Asaduzzaman and Thierry J. Chaussalet University of Westminster, London, UK. Summary. In this paper, a model framework is developed to solve capacity planning problems faced by many perinatal networks in the UK. We propose a loss network model with overflow based on a continuous-time Markov chain for a perinatal network with specific application to a network in London. We derive the steady state expressions for overflow and rejection probabilities for each neonatal unit of the network based on a decomposition approach. Results obtained from the model are very close to observed values. Using the model, decisions on number of cots can be made for specific level of admission acceptance probabilities for each level of care at each neonatal unit of the network and specific levels of overflow to temporary care. Keywords: Queueing network model; Decomposition; Rejection; Continuous-time Markov chain 1. Introduction Every year over 80,000 (approximately 10%) neonates are born premature, very sick, or very small and require some form of specialist support in England (DH, 2003; RCPCH, 2007). Neonatal ser- vices aim to offer high quality care for these vulnerable babies. Over a six month period in 2006-07, neonatal units were shut to new admissions for an average of 24 days. One in ten units exceeded its capacity for intensive care for more than 50 days during a six month period (Bliss, 2007). The Na- tional Audit Office reported that capacity and staffing problems at unit level continue to constrain neonatal service (NAO, 2007). -
Kelly Cache Networks
Kelly Cache Networks Milad Mahdian, Armin Moharrer, Stratis Ioannidis, and Edmund Yeh Electrical and Computer Engineering, Northeastern University, Boston, MA, USA fmmahdian,amoharrer,ioannidis,[email protected] Abstract—We study networks of M/M/1 queues in which nodes We make the following contributions. First, we study the act as caches that store objects. Exogenous requests for objects problem of optimizing the placement of objects in caches in are routed towards nodes that store them; as a result, object Kelly cache networks of M/M/1 queues, with the objective traffic in the network is determined not only by demand but, crucially, by where objects are cached. We determine how to of minimizing a cost function of the system state. We show place objects in caches to attain a certain design objective, such that, for a broad class of cost functions, including packet as, e.g., minimizing network congestion or retrieval delays. We delay, system size, and server occupancy rate, this optimization show that for a broad class of objectives, including minimizing amounts to a submodular maximization problem with matroid both the expected network delay and the sum of network constraints. This result applies to general Kelly networks with queue lengths, this optimization problem can be cast as an NP- hard submodular maximization problem. We show that so-called fixed service rates; in particular, it holds for FIFO, LIFO, and continuous greedy algorithm [1] attains a ratio arbitrarily close processor sharing disciplines at each queue. to 1 − 1=e ≈ 0:63 using a deterministic estimation via a power The so-called continuous greedy algorithm [1] attains a series; this drastically reduces execution time over prior art, 1 − 1=e approximation for this NP-hard problem. -
Lecture Notes on Stochastic Networks
Lecture Notes on Stochastic Networks Frank Kelly and Elena Yudovina Contents Preface page ix Overview 1 Queueing and loss networks 2 Decentralized optimization 4 Random access networks 5 Broadband networks 6 Internet modelling 8 Part I 11 1 Markov chains 13 1.1 Definitions and notation 13 1.2 Time reversal 16 1.3 Erlang’s formula 18 1.4 Further reading 21 2 Queueing networks 22 2.1 An M/M/1 queue 22 2.2 A series of M/M/1 queues 24 2.3 Closed migration processes 26 2.4 Open migration processes 30 2.5 Little’s law 36 2.6 Linear migration processes 39 2.7 Generalizations 44 2.8 Further reading 48 3 Loss networks 49 3.1 Network model 49 3.2 Approximation procedure 51 3.3 Truncating reversible processes 52 v vi Contents 3.4 Maximum probability 57 3.5 A central limit theorem 61 3.6 Erlang fixed point 67 3.7 Diverse routing 71 3.8 Further reading 81 Part II 83 4 Decentralized optimization 85 4.1 An electrical network 86 4.2 Road traffic models 92 4.3 Optimization of queueing and loss networks 101 4.4 Further reading 107 5 Random access networks 108 5.1 The ALOHA protocol 109 5.2 Estimating backlog 115 5.3 Acknowledgement-based schemes 119 5.4 Distributed random access 125 5.5 Further reading 132 6 Effective bandwidth 133 6.1 Chernoff bound and Cramer’s´ theorem 134 6.2 Effective bandwidth 138 6.3 Large deviations for a queue with many sources 143 6.4 Further reading 148 Part III 149 7 Internet congestion control 151 7.1 Control of elastic network flows 151 7.2 Notions of fairness 158 7.3 A primal algorithm 162 7.4 Modelling TCP 166 7.5 What is being -
Lecture Notes on Stochastic Networks
Lecture Notes on Stochastic Networks Frank Kelly and Elena Yudovina Contents Preface page viii Overview 1 Queueing and loss networks 2 Decentralized optimization 4 Random access networks 5 Broadband networks 6 Internet modelling 8 Part I 11 1 Markov chains 13 1.1 Definitions and notation 13 1.2 Time reversal 16 1.3 Erlang’s formula 18 1.4 Further reading 21 2 Queueing networks 22 2.1 An M/M/1 queue 22 2.2 A series of M/M/1 queues 24 2.3 Closed migration processes 26 2.4 Open migration processes 30 2.5 Little’s law 36 2.6 Linear migration processes 39 2.7 Generalizations 44 2.8 Further reading 48 3 Loss networks 49 3.1 Network model 49 3.2 Approximation procedure 51 v vi Contents 3.3 Truncating reversible processes 52 3.4 Maximum probability 57 3.5 A central limit theorem 61 3.6 Erlang fixed point 67 3.7 Diverse routing 71 3.8 Further reading 81 Part II 83 4 Decentralized optimization 85 4.1 An electrical network 86 4.2 Road traffic models 92 4.3 Optimization of queueing and loss networks 101 4.4 Further reading 107 5 Random access networks 108 5.1 The ALOHA protocol 109 5.2 Estimating backlog 115 5.3 Acknowledgement-based schemes 119 5.4 Distributed random access 125 5.5 Further reading 132 6 Effective bandwidth 133 6.1 Chernoff bound and Cramer’s´ theorem 134 6.2 Effective bandwidth 138 6.3 Large deviations for a queue with many sources 143 6.4 Further reading 148 Part III 149 7 Internet congestion control 151 7.1 Control of elastic network flows 151 7.2 Notions of fairness 158 7.3 A primal algorithm 162 7.4 Modelling TCP 166 7.5 What is being -
Smart Parking PI: Robert C
Smart Parking PI: Robert C. Hampshire Research team: Daniel Jordon, Kats Sasanuma, Numeritics LLC. Contract No. DTRT-12-GUTC-11 DISCLAIMER The contents of this report reflect the views of the authors, who are responsible for the facts and the accuracy of the information presented herein. This document is disseminated under the sponsorship of the U.S. Department of Transportation’s University Transportation Centers Program, in the interest of information exchange. The U.S. Government assumes no liability for the contents or use thereof. Table of Contents The problem .................................................................................................................................................. 3 Approach ....................................................................................................................................................... 4 Methodology ................................................................................................................................................. 4 Stakeholder Analysis ................................................................................................................................. 5 Smart Parking: Impact of Information ...................................................................................................... 8 Smart Parking: Impact of Pricing ............................................................................................................... 9 Smart Parking: CrowdSourced Parking Information System .................................................................. -
Kelly Cache Networks
Kelly Cache Networks Milad Mahdian, Armin Moharrer, Stratis Ioannidis, and Edmund Yeh Electrical and Computer Engineering, Northeastern University, Boston, MA, USA fmmahdian,amoharrer,ioannidis,[email protected] Abstract—We study networks of M/M/1 queues in which nodes We make the following contributions. First, we study the act as caches that store objects. Exogenous requests for objects problem of optimizing the placement of objects in caches in are routed towards nodes that store them; as a result, object Kelly cache networks of M/M/1 queues, with the objective traffic in the network is determined not only by demand but, crucially, by where objects are cached. We determine how to of minimizing a cost function of the system state. We show place objects in caches to attain a certain design objective, such that, for a broad class of cost functions, including packet as, e.g., minimizing network congestion or retrieval delays. We delay, system size, and server occupancy rate, this optimization show that for a broad class of objectives, including minimizing amounts to a submodular maximization problem with matroid both the expected network delay and the sum of network constraints. This result applies to general Kelly networks with queue lengths, this optimization problem can be cast as an NP- hard submodular maximization problem. We show that so-called fixed service rates; in particular, it holds for FIFO, LIFO, and continuous greedy algorithm [1] attains a ratio arbitrarily close processor sharing disciplines at each queue. to 1 − 1=e ≈ 0:63 using a deterministic estimation via a power The so-called continuous greedy algorithm [1] attains a series; this drastically reduces execution time over prior art, 1 − 1=e approximation for this NP-hard problem.