Performance Evaluation : Contention and Queues Stochastic Modeling of Computer Systems MOSIG Master 2

Total Page:16

File Type:pdf, Size:1020Kb

Performance Evaluation : Contention and Queues Stochastic Modeling of Computer Systems MOSIG Master 2 Queues Stability Average Computable queues Networks Multiclass networks Performance Evaluation : Contention and Queues Stochastic Modeling of Computer Systems MOSIG Master 2 Jean-Marc Vincent Laboratoire LIG, projet Inria-Mescal UniversitéJoseph Fourier [email protected] 2012 October 19 Performance Evaluation : Contention and Queues 1 / 49 Queues Stability Average Computable queues Networks Multiclass networks Outline 1 Queues Characterization 2 Stability 3 Average 4 Computable queues 5 Networks 6 Multiclass networks Performance Evaluation : Contention and Queues 2 / 49 Queues Stability Average Computable queues Networks Multiclass networks Queues Queues are among simplest dynamic systems, but are still the source of many open problems. Tasks do not have any constraints, sizes and arrival times are often independent. Performance Evaluation : Contention and Queues 3 / 49 Queues Stability Average Computable queues Networks Multiclass networks Queues Queues are among simplest dynamic systems, but are still the source of many open problems. Tasks do not have any constraints, sizes and arrival times are often independent. Performance Evaluation : Contention and Queues 3 / 49 Queues Stability Average Computable queues Networks Multiclass networks Queues Queues are among simplest dynamic systems, but are still the source of many open problems. Tasks do not have any constraints, sizes and arrival times are often independent. Performance Evaluation : Contention and Queues 3 / 49 Queues Stability Average Computable queues Networks Multiclass networks Queues Queues are among simplest dynamic systems, but are still the source of many open problems. Tasks do not have any constraints, sizes and arrival times are often independent. Performance Evaluation : Contention and Queues 3 / 49 Queues Stability Average Computable queues Networks Multiclass networks Queues Queues are among simplest dynamic systems, but are still the source of many open problems. Tasks do not have any constraints, sizes and arrival times are often independent. Performance Evaluation : Contention and Queues 3 / 49 Queues Stability Average Computable queues Networks Multiclass networks Queues Queues are among simplest dynamic systems, but are still the source of many open problems. Tasks do not have any constraints, sizes and arrival times are often independent. Performance Evaluation : Contention and Queues 3 / 49 Queues Stability Average Computable queues Networks Multiclass networks Kendall’s notation Service Process Queue total capacity C Service rate µ Arrival Process arrival rate λ Rejection/blocking policy Number of servers K Notation : A=S=K =C=Disc A : arrival process B : service process K : number of servers C : total queue capacity (including currently served customers) Disc : Service discipline (FIFO, LIFO, PS, Quantum, Priorities,...) Performance Evaluation : Contention and Queues 4 / 49 Queues Stability Average Computable queues Networks Multiclass networks State variables User variables Input rate λ or inter-arrival δ Service time σ or S (service rate µ) Waiting time W Response time R (in some books W ) Rejection probability Resource variables Resource utilisation (offered load) ρ Queue occupation N System availability Performance Evaluation : Contention and Queues 5 / 49 Queues Stability Average Computable queues Networks Multiclass networks One Server Queue load aa1a23a45 a a6 δ δ δ δ δ δ 3245 61 σ W(t) 4 σ σ 2 3 σ 5 σ 1 σ 6 t 0 0 d1 dd2d3d45 Performance Evaluation : Contention and Queues 6 / 49 Queues Stability Average Computable queues Networks Multiclass networks Lindley’s formula (2) Wn is the waiting time of the n-th task. It is a dynamical system of the form Wn = '(Wn−1; Xn) with Xn = σn−1 − δn and ' defined by the Lindley’s equation: Wn = max (Wn−1 + Xn; 0) : - FIFO scheduling - Non-linear evolution equation Performance Evaluation : Contention and Queues 7 / 49 Queues Stability Average Computable queues Networks Multiclass networks Outline 1 Queues 2 Stability 3 Average 4 Computable queues 5 Networks 6 Multiclass networks Performance Evaluation : Contention and Queues 8 / 49 Queues Stability Average Computable queues Networks Multiclass networks Stability of the G=G=1 queue Wn = max (Wn−1 + Xn; 0) ; = max (max(Wn−2 + Xn−1; 0) + Xn; 0) ; = max (Wn−2 + Xn−1 + Xn; Xn; 0) ; = max (Wn−3 + Xn−2 + Xn−1 + Xn; Xn−1 + Xn; Xn; 0) ; = max (W0 + X1 + ··· + Xn−1 + Xn; ··· ; Xn−1 + Xn; Xn; 0) ; = max (X1 + ··· + Xn−1 + Xn; ··· ; Xn−1 + Xn; Xn; 0) ; ∼ max (Xn + ··· + X2 + X1; ··· ; X2 + X1; X1; 0) ; def = Mn: Wn =st Mn = max (Mn−1; X1 + ··· + Xn) : Performance Evaluation : Contention and Queues 9 / 49 Queues Stability Average Computable queues Networks Multiclass networks Stability of the G=G=1 queue (2) Wn =st Mn = max (Mn−1; X1 + ··· + Xn) : Mn is a non-decreasing sequence Either Mn −! M1 or Mn −! +1 Stability EX = E(σ − δ) < 0 The system is Stable M1 =st max(M1 + X; 0): Functional equation on the distribution def Z P(M1 < x) = F(x) = F(x − u)dFX (u): Condition : Eσ < Eδ or λ < µ EX = E(σ − δ) > 0 The system is Unstable Depends only on service and inter-arrival expectation Performance Evaluation : Contention and Queues 10 / 49 Queues Stability Average Computable queues Networks Multiclass networks Loynes’ scheme Theorem Wn 6st Wn+1 in a G/G/1 queue, initialy empty. Proof. done by a backward coupling known as the Loynes’ scheme. Construct on a common probability space two trajectories by going backward 1 2 1 2 in time: Si−n(!) = Si−n−1(!) with distribution Si and Ti−n(!) = Ti−n−1(!), 1 with distribution Ti − Tn+1 for all 0 6 i 6 n + 1 and S−n−1(!) = 0. 1 2 By construction, W0 =st Wn and W0 =st Wn+1. Also, it should be clear that 1 2 0 = W−n+1(!) 6 W−n+1(!) for all !. 1 2 This implies W−i (!) 6 W−i (!) so that Wn 6st Wn+1. Performance Evaluation : Contention and Queues 11 / 49 Queues Stability Average Computable queues Networks Multiclass networks Loynes’ scheme Theorem Wn 6st Wn+1 in a G/G/1 queue, initialy empty. Proof. done by a backward coupling known as the Loynes’ scheme. Construct on a common probability space two trajectories by going backward 1 2 1 2 in time: Si−n(!) = Si−n−1(!) with distribution Si and Ti−n(!) = Ti−n−1(!), 1 with distribution Ti − Tn+1 for all 0 6 i 6 n + 1 and S−n−1(!) = 0. 1 2 By construction, W0 =st Wn and W0 =st Wn+1. Also, it should be clear that 1 2 0 = W−n+1(!) 6 W−n+1(!) for all !. 1 2 This implies W−i (!) 6 W−i (!) so that Wn 6st Wn+1. Performance Evaluation : Contention and Queues 11 / 49 Queues Stability Average Computable queues Networks Multiclass networks Loynes’ scheme Theorem Wn 6st Wn+1 in a G/G/1 queue, initialy empty. Proof. done by a backward coupling known as the Loynes’ scheme. Construct on a common probability space two trajectories by going backward 1 2 1 2 in time: Si−n(!) = Si−n−1(!) with distribution Si and Ti−n(!) = Ti−n−1(!), 1 with distribution Ti − Tn+1 for all 0 6 i 6 n + 1 and S−n−1(!) = 0. 1 2 By construction, W0 =st Wn and W0 =st Wn+1. Also, it should be clear that 1 2 0 = W−n+1(!) 6 W−n+1(!) for all !. 1 2 This implies W−i (!) 6 W−i (!) so that Wn 6st Wn+1. Performance Evaluation : Contention and Queues 11 / 49 Queues Stability Average Computable queues Networks Multiclass networks Loynes’ scheme 2 W0 1 W0 T − T −Tn+1 i n+1 0 This has many consequences in terms of existence and uniqueness of a stationary (or limit) regime for the G/G/1 queue Baccelli Bremaud, 2002). Performance Evaluation : Contention and Queues 12 / 49 Queues Stability Average Computable queues Networks Multiclass networks Loynes’ scheme 2 W0 1 W0 T − T −Tn+1 i n+1 0 This has many consequences in terms of existence and uniqueness of a stationary (or limit) regime for the G/G/1 queue Baccelli Bremaud, 2002). Performance Evaluation : Contention and Queues 12 / 49 Queues Stability Average Computable queues Networks Multiclass networks Outline 1 Queues 2 Stability 3 Average 4 Computable queues 5 Networks 6 Multiclass networks Performance Evaluation : Contention and Queues 13 / 49 Queues Stability Average Computable queues Networks Multiclass networks Little’s Formula At Nt Rn Assumptions Z t n At 1 1 X lim = λ, lim Nsds = EN and lim Ri = ER; t!+1 t t!+1 t n!+1 n 0 i=1 Little’s Formula EN = λER: Performance Evaluation : Contention and Queues 14 / 49 Queues Stability Average Computable queues Networks Multiclass networks Little’s Formula (proof) Client a1 a2 a3 a4 a5 a6 a7 a8 a9 d1 d3 d2 d1 d7 d6 d1 d8 Time Nt Z T AT 1 AT 1 X Nsds = Ri : T T AT 0 i=1 T ! 1 implies EN = λER: Performance Evaluation : Contention and Queues 15 / 49 Queues Stability Average Computable queues Networks Multiclass networks Little’s Formula (proof) Client a1 a2 a3 a4 a5 a6 a7 a8 a9 d1 d3 d2 d1 d7 d6 d1 d8 Time Nt Z T AT 1 AT 1 X Nsds = Ri : T T AT 0 i=1 T ! 1 implies EN = λER: Performance Evaluation : Contention and Queues 15 / 49 Queues Stability Average Computable queues Networks Multiclass networks Little’s Formula (proof) Client a1 a2 a3 a4 a5 a6 a7 a8 a9 d1 d3 d2 d1 d7 d6 d1 d8 Time Nt Z T AT 1 AT 1 X Nsds = Ri : T T AT 0 i=1 T ! 1 implies EN = λER: Performance Evaluation : Contention and Queues 15 / 49 Queues Stability Average Computable queues Networks Multiclass networks Outline 1 Queues 2 Stability 3 Average 4 Computable queues Single server queue Limited capacity 5 Networks 6 Multiclass networks Performance Evaluation : Contention and Queues 16 / 49 Queues Stability Average Computable queues Networks Multiclass networks M/M/1 Infinite capacity λ µ Poisson(λ) arrivals Exp(µ) service times M/M/1 queue FIFO discipline Definition λ ρ = µ is the traffic intensity of the queueing system.
Recommended publications
  • Running in Circles: Packet Routing on Ring Networks by William F
    Running in Circles: Packet Routing on Ring Networks by William F. Bradley Submitted to the Department of Mathematics in partial fulfillment of the requirements for the degree of Doctor of Philosophy at the MASSACHUSETTS INSTITUTE OF TECHNOLOGY June 2002 c 2002 William F. Bradley. All rights reserved Author............................................. ............................... Department of Mathematics April 26, 2002 Certified by.......................................... .............................. F. T. Leighton Professor of Applied Mathematics Thesis Supervisor arXiv:1402.2963v1 [math.PR] 12 Feb 2014 Accepted by......................................... .............................. R. B. Melrose Chairman, Committee on Pure Mathematics 2 Running in Circles: Packet Routing on Ring Networks by William F. Bradley Submitted to the Department of Mathematics on April 26, 2002, in partial fulfillment of the requirements for the degree of Doctor of Philosophy Abstract I analyze packet routing on unidirectional ring networks, with an eye towards establishing bounds on the expected length of the queues. Suppose we route packets by a greedy “hot potato” protocol. If packets are inserted by a Bernoulli process and have uniform destinations around the ring, and if the nominal load is kept fixed, then I can construct an upper bound on the expected queue length per node that is independent of the size of the ring. If the packets only travel one or two steps, I can calculate the exact expected queue length for rings of any size. I also show some stability results under more general circumstances. If the packets are inserted by any ergodic hidden Markov process with nominal loads less than one, and routed by any greedy protocol, I prove that the ring is ergodic. Thesis Supervisor: F.
    [Show full text]
  • Queueing Systems
    Queueing Systems Queueing Systems Alain Jean-Marie INRIA/LIRMM, Université de Montpellier, CNRS [email protected] RESCOM Summer School 2019 June 2019 Queueing Systems About the class This class: Lesson 4: Queueing Systems (2h, now) Case Study 3: Queuing Systems (1h, after the break) Companion classes: Lesson 5 and Case Study 4: Markov Decision Processes by E. Hyon (2h + 1h, tomorrow) Common Lab: Lab 3: Queueing Systems and Markov Decision Processes (2h, Friday) Related talk: Opening 1: Models of Hidden Markov Chains for Trace Analysis on the Internet by S. Vatton (1h30, tomorrow) Queueing Systems Preparation of the lab Topic of the lab: programming the basic discrete-time queue with impatience using the library marmoreCore (C++ programming) programming the same queue with a control of the service using the library marmoteMDP finding the optimal control policy. Preparation: two possibilities using a virtual machine with virtualbox download VM + instructions from http://www-desir.lip6.fr/~hyon/Marmote/MachineVirtuelle/Rescom2019_ TP.html copy it from USB drive, ask the technician! using the library (linux only) tarball + instructions from https://marmotecore.gforge.inria.fr/dokuwiki/ Queueing Systems General Plan Part 1: Basic features of queueing systems Part 2: Metrics associated with queuing Part 3: Modeling queueing systems with Markov chains Part 4: Numerical solution and simulation Queueing Systems Part 1: Basics of Queueing Part 1: Basics of Queueing Queueing Systems Part 1: Basics of Queueing Basics of Queueing: Plan Table of contents customers, buffers, servers, arrival process, service time buffer capacity, blocking, rejection, impatience, balking, reneging customer classes, scheduling policy Kendall’s notation networks of queues, routing, blocking Queueing Systems Part 1: Basics of Queueing Single Queues Why study queues? Queues are everywhere..
    [Show full text]
  • Stochastic Monotonicity of Markovian Multi-Class Queueing
    Stochastic Systems arXiv: arXiv:0000.0000 STOCHASTIC MONOTONICITY OF MARKOVIAN MULTI-CLASS QUEUEING NETWORKS By H. Leahu, M. Mandjes University of Amsterdam Multi-class queueing networks (McQNs) extend the classi- cal concept of Jackson network by allowing jobs of different classes to visit the same server. While such a generalization seems rather natural, from a structural perspective there is a sig- nificant gap between the two concepts. Nice analytical features of Jackson networks, such as stability conditions, product-form equilibrium distributions, and stochastic monotonicity do not immediately carry over to the multi-class framework. The aim of this paper is to shed some light on this structural gap, focusing on monotonicity properties. To this end, we in- troduce and study a class of Markov processes, which we call Q-processes, modeling the time evolution of the network configu- ration of any open, work-conservative McQN having exponential service times and Poisson input. We define a new monotonicity notion tailored for this class of processes. Our main result is that we show monotonicity for a large class of McQN models, covering virtually all instances of practical interest. This leads to interesting properties which are commonly encountered for ‘traditional’ queueing processes, such as (i) monotonicity with respect to external arrival rates and (ii) star-convexity of the stability region (with respect to the external arrival rates); such properties are well known for Jackson networks, but had not been established at this level of generality. This research was partly motivated by the recent development of a simulation-based method which allows one to numerically determine the stability region of a McQN parametrized in terms of the arrival rates vector.
    [Show full text]
  • Queueing Network and Some Types of Customers and Signals
    Queueing Network and Some Types of Customers and Signals Thu-Ha Dao-Thi Chargee´ de recherche CNRS, PRiSM, UVSQ, France Joint work with J.M Fourneau, J. Mairesse, M.A Tran VMS-SMF Joint Congress, Hue, August 23th 2012 Dao Ha Queueing Network and Some Types of Customers and Signals Introduction-Preliminaries 0-automatic queues and networks New type of signals Plan 1 Introduction-Preliminaries Queue? Network? 2 0-automatic queues and networks Introduction of 0-automatic queues Results on 0-automatic queues and networks 3 Some new types of signals in G-networks Dao Ha Queueing Network and Some Types of Customers and Signals Introduction-Preliminaries 0-automatic queues and networks New type of signals Plan 1 Introduction-Preliminaries Queue? Network? 2 0-automatic queues and networks Introduction of 0-automatic queues Results on 0-automatic queues and networks 3 Some new types of signals in G-networks Dao Ha Queueing Network and Some Types of Customers and Signals Introduction-Preliminaries 0-automatic queues and networks New type of signals Plan 1 Introduction-Preliminaries Queue? Network? 2 0-automatic queues and networks Introduction of 0-automatic queues Results on 0-automatic queues and networks 3 Some new types of signals in G-networks Dao Ha Queueing Network and Some Types of Customers and Signals Introduction-Preliminaries 0-automatic queues and networks Queue? Network? New type of signals Outline 1 Introduction-Preliminaries Queue? Network? 2 0-automatic queues and networks Introduction of 0-automatic queues Results on 0-automatic queues and networks 3 Some new types of signals in G-networks Dao Ha Queueing Network and Some Types of Customers and Signals Introduction-Preliminaries 0-automatic queues and networks Queue? Network? New type of signals In daily life Dao Ha Queueing Network and Some Types of Customers and Signals Servers 1 the arriving process 2 .
    [Show full text]
  • Performance Analysis of Multiclass Queueing Networks Via Brownian Approximation
    Performance Analysis of Multiclass Queueing Networks via Brownian Approximation by Xinyang Shen B.Sc, Jilin University, China, 1993 A THESIS SUBMITTED IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY in THE FACULTY OF GRADUATE STUDIES (Faculty of Commerce and Business Administration; Operations and Logisitics) We accept this thesis as conforming to the required standard THE UNIVERSITY OF BRITISH COLUMBIA May 23, 2001 © Xinyang Shen, 2001 In presenting this thesis in partial fulfilment of the requirements for an advanced degree at the University of British Columbia, I agree that the Library shall make it freely available for reference and study. I further agree that permission for extensive copying of this thesis for scholarly purposes may be granted by the head of my department or by his or her representatives. It is understood that copying or publication of this thesis for financial gain shall not be allowed without my written permission. Faculty of Commerce and Business Administration The University of. British Columbia Abstract This dissertation focuses on the performance analysis of multiclass open queueing networks using semi-martingale reflecting Brownian motion (SRBM) approximation. It consists of four parts. In the first part, we derive a strong approximation for a multiclass feedforward queueing network, where jobs after service completion can only move to a downstream service station. Job classes are partitioned into groups. Within a group, jobs are served in the order of arrival; that is, a first-in-first-out (FIFO) discipline is in force, and among groups, jobs are served under a pre-assigned preemptive priority discipline.
    [Show full text]
  • Kelly Cache Networks
    Kelly Cache Networks Milad Mahdian, Armin Moharrer, Stratis Ioannidis, and Edmund Yeh Electrical and Computer Engineering, Northeastern University, Boston, MA, USA fmmahdian,amoharrer,ioannidis,[email protected] Abstract—We study networks of M/M/1 queues in which nodes We make the following contributions. First, we study the act as caches that store objects. Exogenous requests for objects problem of optimizing the placement of objects in caches in are routed towards nodes that store them; as a result, object Kelly cache networks of M/M/1 queues, with the objective traffic in the network is determined not only by demand but, crucially, by where objects are cached. We determine how to of minimizing a cost function of the system state. We show place objects in caches to attain a certain design objective, such that, for a broad class of cost functions, including packet as, e.g., minimizing network congestion or retrieval delays. We delay, system size, and server occupancy rate, this optimization show that for a broad class of objectives, including minimizing amounts to a submodular maximization problem with matroid both the expected network delay and the sum of network constraints. This result applies to general Kelly networks with queue lengths, this optimization problem can be cast as an NP- hard submodular maximization problem. We show that so-called fixed service rates; in particular, it holds for FIFO, LIFO, and continuous greedy algorithm [1] attains a ratio arbitrarily close processor sharing disciplines at each queue. to 1 − 1=e ≈ 0:63 using a deterministic estimation via a power The so-called continuous greedy algorithm [1] attains a series; this drastically reduces execution time over prior art, 1 − 1=e approximation for this NP-hard problem.
    [Show full text]
  • Smart Parking PI: Robert C
    Smart Parking PI: Robert C. Hampshire Research team: Daniel Jordon, Kats Sasanuma, Numeritics LLC. Contract No. DTRT-12-GUTC-11 DISCLAIMER The contents of this report reflect the views of the authors, who are responsible for the facts and the accuracy of the information presented herein. This document is disseminated under the sponsorship of the U.S. Department of Transportation’s University Transportation Centers Program, in the interest of information exchange. The U.S. Government assumes no liability for the contents or use thereof. Table of Contents The problem .................................................................................................................................................. 3 Approach ....................................................................................................................................................... 4 Methodology ................................................................................................................................................. 4 Stakeholder Analysis ................................................................................................................................. 5 Smart Parking: Impact of Information ...................................................................................................... 8 Smart Parking: Impact of Pricing ............................................................................................................... 9 Smart Parking: CrowdSourced Parking Information System ..................................................................
    [Show full text]
  • Kelly Cache Networks
    Kelly Cache Networks Milad Mahdian, Armin Moharrer, Stratis Ioannidis, and Edmund Yeh Electrical and Computer Engineering, Northeastern University, Boston, MA, USA fmmahdian,amoharrer,ioannidis,[email protected] Abstract—We study networks of M/M/1 queues in which nodes We make the following contributions. First, we study the act as caches that store objects. Exogenous requests for objects problem of optimizing the placement of objects in caches in are routed towards nodes that store them; as a result, object Kelly cache networks of M/M/1 queues, with the objective traffic in the network is determined not only by demand but, crucially, by where objects are cached. We determine how to of minimizing a cost function of the system state. We show place objects in caches to attain a certain design objective, such that, for a broad class of cost functions, including packet as, e.g., minimizing network congestion or retrieval delays. We delay, system size, and server occupancy rate, this optimization show that for a broad class of objectives, including minimizing amounts to a submodular maximization problem with matroid both the expected network delay and the sum of network constraints. This result applies to general Kelly networks with queue lengths, this optimization problem can be cast as an NP- hard submodular maximization problem. We show that so-called fixed service rates; in particular, it holds for FIFO, LIFO, and continuous greedy algorithm [1] attains a ratio arbitrarily close processor sharing disciplines at each queue. to 1 − 1=e ≈ 0:63 using a deterministic estimation via a power The so-called continuous greedy algorithm [1] attains a series; this drastically reduces execution time over prior art, 1 − 1=e approximation for this NP-hard problem.
    [Show full text]
  • Kelly Cache Networks
    Kelly Cache Networks Milad Mahdian, Armin Moharrer, Stratis Ioannidis, and Edmund Yeh Electrical and Computer Engineering, Northeastern University, Boston, MA, USA fmmahdian,amoharrer,ioannidis,[email protected] Abstract—We study networks of M/M/1 queues in which nodes We make the following contributions. First, we study the act as caches that store objects. Exogenous requests for objects problem of optimizing the placement of objects in caches in are routed towards nodes that store them; as a result, object Kelly cache networks of M/M/1 queues, with the objective traffic in the network is determined not only by demand but, crucially, by where objects are cached. We determine how to of minimizing a cost function of the system state. We show place objects in caches to attain a certain design objective, such that, for a broad class of cost functions, including packet as, e.g., minimizing network congestion or retrieval delays. We delay, system size, and server occupancy rate, this optimization show that for a broad class of objectives, including minimizing amounts to a submodular maximization problem with matroid both the expected network delay and the sum of network constraints. This result applies to general Kelly networks with queue lengths, this optimization problem can be cast as an NP- hard submodular maximization problem. We show that so-called fixed service rates; in particular, it holds for FIFO, LIFO, and continuous greedy algorithm [1] attains a ratio arbitrarily close processor sharing disciplines at each queue. to 1 − 1=e ≈ 0:63 using a deterministic estimation via a power The so-called continuous greedy algorithm [1] attains a series; this drastically reduces execution time over prior art, 1 − 1=e approximation for this NP-hard problem.
    [Show full text]
  • Stability in Adversarial Queueing Theory Panagiot Is Tsaparas
    Stability in Adversarial Queueing Theory Panagiot is Tsaparas ,A thesis submitted in conformity with the requirements for the degree of Master of Science Graduate Department of Corn puter Science University of Toronto @ Copyright by Panagiotis Tsaparas 1997 National Library Bibliothèque nationale 1+m of Canada du Canada Acquisitions and Acquisitions et Bibliographie Services services bibliographiques 395 Wellington Street 395, rue Wellington OttawaON KlAON4 Ottawa ON KIA ON4 Canada Canada The author has granted a non- L'auteur a accordé une licence non exclusive licence allowing the exclusive permettant à la National Library of Canada to Bibliothèque nationale du Canada de reproduce, loan, distribute or sell reproduire, prêter, distribuer ou copies of this thesis in microform, vendre des copies de cette thèse sous paper or electronic formats. La forme de microfiche/nlm, de reproduction sur papier ou sur format électronique. The author retains ownership of the L'auteur conserve la propriété du copyright in this thesis. Neither the droit d'auteur qui protège cette thèse. thesis nor substantial extracts fiom it Ni la thèse ni des extraits substantiels may be printed or othenirise de celle-ci ne doivent être imprimés reproduced without the author's ou autrement reproduits sans son permission. autorisation. Abstract -4 queueing network is a set of interconnected servers. Customers are injected continu- ously in the system. inducing some workload for each semer. A fundamental issue that arises in this context is that of stability: will the total workload in the sÿstem remain bounded over tirne:' in t his thesis, we investigate the question of stability within the model defined in [BKRf 961.
    [Show full text]
  • Kelly Cache Networks
    IEEE/ACM TRANSACTIONS OF NETWORKING, VOL. XX, NO. YY, AUGUST XXX 1 Kelly Cache Networks Milad Mahdian, Armin Moharrer, Stratis Ioannidis, and Edmund Yeh Electrical and Computer Engineering, Northeastern University, Boston, MA, USA fmmahdian,amoharrer,ioannidis,[email protected] Abstract—We study networks of M/M/1 queues in which nodes act as caches that store objects. Exogenous requests for objects are routed towards nodes that store them; as a result, object traffic in the network is determined not only by demand but, crucially, by where objects are cached. We determine how to place objects in caches to attain a certain design objective, such as, e.g., minimizing network congestion or retrieval delays. We show that for a broad class of objectives, including minimizing both the expected network delay and the sum of network queue lengths, this optimization problem can be cast as an NP-hard submodular maximization problem. We show that so-called continuous greedy algorithm [1] attains a ratio arbitrarily close to 1 − 1=e ≈ 0:63 using a deterministic estimation via a power series; this drastically reduces execution time over prior art, which resorts to sampling. Finally, we show that our results generalize, beyond M/M/1 queues, to networks of M/M/k and symmetric M/D/1 queues. Index Terms—Kelly networks, cache networks, ICN F 1 INTRODUCTION ELLY networks [3] are multi-class networks of queues Kelly cache networks of M/M/1 queues, with the objective K capturing a broad array of queue service disciplines, of minimizing a cost function of the system state.
    [Show full text]
  • 27 Apr 2013 Reversibility in Queueing Models
    Reversibility in Queueing Models Masakiyo Miyazawa Tokyo University of Science April 23, 2013, R1 corrected 1 Introduction Stochastic models for queues and their networks are usually described by stochastic pro- cesses, in which random events evolve in time. Here, time is continuous or discrete. We can view such evolution in backward for each stochastic model. A process for this back- ward evolution is referred to as a time reversed process. It also is called a reversed time process or simply a reversed process. We refer to the original process as a time forward process when it is required to distinguish from the time reversed process. It is often greatly helpful to view a stochastic model from two different time directions. In particular, if some property is invariant under change of the time directions, that is, under time reversal, then we may better understand that property. A concept of reversibility is invented for this invariance. A successful story about the reversibility in queueing networks and related models is presented in the book of Kelly [10]. The reversibility there is used in the sense that the time reversed process is stochastically identical with the time forward process, but there are many discussions about stochastic models whose time reversal have the same modeling features. In this article, we give a unified view to them using the broader concept of the arXiv:1212.0398v3 [math.PR] 27 Apr 2013 reversibility. We first consider some examples. (i) Stationary Markov process (continuous or discrete time) is again a stationary Markov process under time reversal if it has a stationary distribution.
    [Show full text]