DOCSLIB.ORG

Introduction to Queueing Theory and Stochastic Teletraffic Models

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Introduction to Queueing Theory and Stochastic Teletraffic Models Introduction to Queueing Theory and Stochastic Teletraffic Models Moshe Zukerman EE Department City University of Hong Kong email: [email protected] Copyright M. Zukerman c 2000–2020. This book can be used for educational and research purposes under the condition that it (including this first page) is not modified in any way. Preface The aim of this textbook is to provide students with basic knowledge of stochastic models with a special focus on queueing models, that may apply to telecommunications topics, such as traffic modelling, performance evaluation, resource provisioning and traffic management. These topics are included in a field called teletraffic. This book assumes prior knowledge of a programming language and mathematics normally taught in an electrical engineering bachelor program. The book aims to enhance intuitive and physical understanding of the theoretical concepts it introduces. The famous mathematician Pierre-Simon Laplace is quoted to say that “Probability is common sense reduced to calculation” [18]; as the content of this book falls under the field of applied probability, Laplace’s quote very much applies. Accordingly, the book aims to link intuition and common sense to the mathematical models and techniques it uses. It mainly focuses on steady-state analyses and avoids discussions of time-dependent analyses. arXiv:1307.2968v23 [math.PR] 21 Feb 2020 A unique feature of this book is the considerable attention given to guided homework assign- ments involving computer simulations and analyzes. By successfully completing these assign- ments, students learn to simulate and analyze stochastic models, such as queueing systems and networks, and by interpreting the results, they gain insight into the queueing performance effects and principles of telecommunications systems modelling. Although the book, at times, provides intuitive explanations, it still presents the important concepts and ideas required for the understanding of teletraffic, queueing theory fundamentals and related queueing behavior of telecommunications networks and systems. These concepts and ideas form a strong base for the more mathematically inclined students who can follow up with the extensive literature on probability models and queueing theory. A small sample of it is listed at the end of this Queueing Theory and Stochastic Teletraffic Models c Moshe Zukerman 2 book. The first two chapters provide background on probability and stochastic processes topics rele- vant to the queueing and teletraffic models of this book. These two chapters provide a summary of the key topics with relevant homework assignments that are especially tailored for under- standing the queueing and teletraffic models discussed in later chapters. The content of these chapters is mainly based on [18, 34, 90, 95, 96, 97]. Students are encouraged to study also the original textbooks for more explanations, illustrations, discussions, examples and homework assignments. Chapter 3 discusses general queueing notation and concepts. Chapter 4 aims to assist the student to perform simulations of queueing systems. Simulations are useful and important in the many cases where exact analytical results are not available. An important learning objective of this book is to train students to perform queueing simulations. Chapter 5 provides analyses of deterministic queues. Many queueing theory books tend to exclude deterministic queues; however, the study of such queues is useful for beginners in that it helps them better understand non-deterministic queueing models. Chapters 6 – 14 provide analyses of a wide range of queueing and teletraffic models most of which fall under the category of continuous- time Markov-chain processes. Chapter 15 provides an example of a discrete-time queue that is modelled as a discrete-time Markov chain. In Chapter 16, various aspects of a single server queue with Poisson arrivals and general service times are studied, mainly focussing on mean value results as in [17]. Then, in Chapter 17, some selected results of a single server queue with a general arrival process and general service times are provided. Chapter 18 focusses on multi access applications, and in Chapter 19, we extend our discussion to queueing networks. Finally, in Chapter 20, stochastic processes that have been used as traffic models are discussed with special focus on their characteristics that affect queueing performance. Throughout the book there is an emphasis on linking the theory with telecommunications ap- plications as demonstrated by the following examples. Section 1.19 describes how properties of Gaussian distribution can be applied to link dimensioning. Section 6.11 shows, in the con- text of an M/M/1 queueing model, how optimally to set a link service rate such that delay requirements are met and how the level of multiplexing affects the spare capacity required to meet such delay requirement. An application of M/M/ queueing model to a multiple access ∞ performance problem [17] is discussed in Section 7.5. Then later in Chapter 18 more multi- access models are presented. In Sections 8.8 and 9.5, discussions on dimensioning and related utilization issues of a multi-channel system are presented. Especially important is the empha- sis on the insensitivity property of models such as M/M/ , M/M/k/k, processor sharing and multi-service that lead to practical and robust approximations∞ as described in Chapters 7, 8, 13, and 14. Section 19.3 guides the reader to simulate a mobile cellular network. Section 20.6 describes a traffic model applicable to the Internet. Last but not least, the author wishes to thank all the students and colleagues that provided comments and questions that helped developing and editing the manuscript over the years. Queueing Theory and Stochastic Teletraffic Models c Moshe Zukerman 3 Contents 1 Background on Relevant Probability Topics 8 1.1 Events, Sample Space, and Random Variables . .... 8 1.2 Probability, Conditional Probability and Independence . ...... 9 1.3 Probability and Distribution Functions . .. 10 1.4 Joint Distribution Functions . 11 1.5 Conditional Probability for Random Variables . ... 12 1.6 Independence between Random Variables . ..... 13 1.7 Convolution...................................... 13 1.8 Selected Discrete Random Variables . ... 18 1.8.1 Non-parametric ................................ 18 1.8.2 Bernoulli.................................... 18 1.8.3 Geometric................................... 18 1.8.4 Binomial.................................... 19 1.8.5 Poisson .................................... 21 1.8.6 Pascal ..................................... 24 1.8.7 DiscreteUniform ............................... 25 1.9 Continuous Random Variables and their Distributions . ..... 25 1.10 Selected Continuous Random Variables . .... 29 1.10.1 Uniform .................................... 29 1.10.2 Exponential .................................. 30 1.10.3 Relationship between Exponential and Geometric Random Variables . 33 1.10.4 Hyper-Exponential .............................. 34 1.10.5 Erlang..................................... 34 1.10.6 Hypo-Exponential............................... 35 1.10.7 Gaussian.................................... 35 1.10.8 Pareto ..................................... 36 1.11 MomentsandVariance ............................... 36 1.11.1 Mean(orExpectation) ............................ 36 1.11.2 Moments.................................... 40 1.11.3 Variance.................................... 41 1.11.4 Conditional Mean and the Law of Iterated Expectation . ..... 43 1.11.5 Conditional Variance and the Law of Total Variance . .... 44 1.12 Mean and Variance of Specific Random Variables . .... 51 1.13 SampleMeanandSampleVariance . 55 1.14 CovarianceandCorrelation . .. 56 1.15Transforms ...................................... 58 1.15.1 Z-transform .................................. 61 1.15.2 LaplaceTransform .............................. 63 1.16 Multivariate Random Variables and Transform . ..... 66 1.17 Probability Inequalities and Their Dimensioning Applications . .... 66 1.18LimitTheorems.................................... 68 1.19 Link Dimensioning . 69 1.19.1 Case 1: Homogeneous Individual Sources . ... 70 1.19.2 Case 2: Non-homogeneous Individual Sources . .... 71 1.19.3 Case 3: Capacity Dimensioning for a Community . 72 Queueing Theory and Stochastic Teletraffic Models c Moshe Zukerman 4 2 Relevant Background on Stochastic Processes 73 2.1 GeneralConcepts.................................. 73 2.2 Two Orderly and Memoryless Point Processes . .... 76 2.2.1 BernoulliProcess ............................... 77 2.2.2 PoissonProcess ................................ 78 2.3 MarkovModulatedPoissonProcess . ... 87 2.4 Discrete-timeMarkovchains . .. 87 2.4.1 Definitions and Preliminaries . 87 2.4.2 Transition Probability Matrix . 88 2.4.3 Chapman-KolmogorovEquation. 88 2.4.4 Marginal Probabilities . 89 2.4.5 Properties and Classification of States . 89 2.4.6 Steady-state Probabilities . 91 2.4.7 BirthandDeathProcess ........................... 93 2.4.8 Reversibility . 94 2.4.9 Multi-dimensional Markov Chains . 95 2.5 ContinuousTimeMarkovchains. 96 2.5.1 Definitions and Preliminaries . 96 2.5.2 BirthandDeathProcess ........................... 97 2.5.3 FirstPassageTime .............................. 98 2.5.4 Transition Probability Function . 99 2.5.5 Steady-State Probabilities . 99 2.5.6 Multi-Dimensional Continuous-time Markov Chains . 101 2.5.7 Solutions by Successive Substitutions . 101 2.5.8 The Curse of Dimensionality . 102 2.5.9 Simulations ..................................102
Load more

Recommended publications
  • Fluid M/M/1 Catastrophic Queue in a Random Environment
    RAIRO-Oper. Res. 55 (2021) S2677{S2690 RAIRO Operations Research https://doi.org/10.1051/ro/2020100 www.rairo-ro.org FLUID M=M=1 CATASTROPHIC QUEUE IN A RANDOM ENVIRONMENT Sherif I. Ammar1;2;∗ Abstract. Our main objective in this study is to investigate the stationary behavior of a fluid catas- trophic queue of M=M=1 in a random multi-phase environment. Occasionally, a queueing system expe- riences a catastrophic failure causing a loss of all current jobs. The system then goes into a process of repair. As soon as the system is repaired, it moves with probability qi ≥ 0 to phase i. In this study, the distribution of the buffer content is determined using the probability generating function. In addition, some numerical results are provided to illustrate the effect of various parameters on the distribution of the buffer content. Mathematics Subject Classification. 90B22, 60K25, 68M20. Received January 12, 2020. Accepted September 8, 2020. 1. Introduction In recent years, studies on queueing systems in a random environment have become extremely important owing to their widespread application in telecommunication systems, advanced computer networks, and manufacturing systems. In addition, studies on fluid queueing systems are regarded as an important class of queueing theory; the interpretation of the behavior of such systems helps us understand and improve the behavior of many applications in our daily life. A fluid queue is an input-output system where a continuous fluid enters and leaves a storage device called a buffer; the system is governed by an external stochastic environment at randomly varying rates. These models have been well established as a valuable mathematical modeling method and have long been used to estimate the performance of certain systems as telecommunication systems, transportation systems, computer networks, and production and inventory systems.
    [Show full text]
  • Queueing Theory and Process Flow Performance
    QUEUEING THEORY AND PROCESS FLOW PERFORMANCE Chang-Sun Chin1 ABSTRACT Queuing delay occurs when a number of entities arrive for services at a work station where a server(s) has limited capacity so that the entities must wait until the server becomes available. We see this phenomenon in the physical production environment as well as in the office environment (e.g., document processing). The obvious solution may be to increase the number of servers to increase capacity of the work station, but other options can attain the same level of performance improvement. The study selects two different projects, investigates their submittal review/approval process and uses queuing theory to determine the major causes of long lead times. Queuing theory provides good categorical indices—variation factor, utilization factor and process time factor—for diagnosing the degree of performance degradation from queuing. By measuring the magnitude of these factors and adjusting their levels using various strategies, we can improve system performance. The study also explains what makes the submittal process of two projects perform differently and suggests options for improving performance in the context of queuing theory. KEY WORDS Process time, queueing theory, submittal, variation, utilization INTRODUCTION Part of becoming lean is eliminating all waste (or muda in Japanese). Waste is “any activity which consumes resources but creates no value” (Womack and Jones 2003). Waiting, one of seven wastes defined by Ohno of Toyota (Ohno 1988), can be seen from two different views: “work waiting” or “worker waiting.” “Work waiting” occurs when servers (people or equipment) at work stations are not available when entities (jobs, materials, etc) arrive at the work stations, that is, when the servers are busy and entities wait in queue.
    [Show full text]
  • M/M/C Queue with Two Priority Classes
    Submitted to Operations Research manuscript (Please, provide the mansucript number!) M=M=c Queue with Two Priority Classes Jianfu Wang Nanyang Business School, Nanyang Technological University, [email protected] Opher Baron Rotman School of Management, University of Toronto, [email protected] Alan Scheller-Wolf Tepper School of Business, Carnegie Mellon University, [email protected] This paper provides the first exact analysis of a preemptive M=M=c queue with two priority classes having different service rates. To perform our analysis, we introduce a new technique to reduce the 2-dimensionally (2D) infinite Markov Chain (MC), representing the two class state space, into a 1-dimensionally (1D) infinite MC, from which the Generating Function (GF) of the number of low-priority jobs can be derived in closed form. (The high-priority jobs form a simple M=M=c system, and are thus easy to solve.) We demonstrate our methodology for the c = 1; 2 cases; when c > 2, the closed-form expression of the GF becomes cumbersome. We thus develop an exact algorithm to calculate the moments of the number of low-priority jobs for any c ≥ 2. Numerical examples demonstrate the accuracy of our algorithm, and generate insights on: (i) the relative effect of improving the service rate of either priority class on the mean sojourn time of low-priority jobs; (ii) the performance of a system having many slow servers compared with one having fewer fast servers; and (iii) the validity of the square root staffing rule in maintaining a fixed service level for the low priority class.
    [Show full text]
  • Ewens' Sampling Formula
    Ewens’ sampling formula; a combinatorial derivation Bob Griffiths, University of Oxford Sabin Lessard, Universit´edeMontr´eal Infinitely-many-alleles-model: unique mutations ......................................................................................................... •. •. •. ............................................................................................................ •. •. .................................................................................................... •. •. •. ............................................................. ......................................... .............................................. •. ............................... ..................... ..................... ......................................... ......................................... ..................... • ••• • • • ••• • • • • • Sample configuration of alleles 4 A1,1A2,4A3,3A4,3A5. Ewens’ sampling formula (1972) n sampled genes k b Probability of a sample having types with j types represented j times, jbj = n,and bj = k,is n! 1 θk · · b b 1 1 ···n n b1! ···bn! θ(θ +1)···(θ + n − 1) Example: Sample 4 A1,1A2,4A3,3A4,3A5. b1 =1, b2 =0, b3 =2, b4 =2. Old and New lineages . •. ............................... ......................................... •. .............................................. ............................... ............................... ..................... ..................... ......................................... ..................... ..................... ◦ ◦◦◦◦◦ n1 n2 nm nm+1
    [Show full text]
  • Lecture 5/6 Queueing
    6.263/16.37: Lectures 5 & 6 Introduction to Queueing Theory Eytan Modiano Massachusetts Institute of Technology Eytan Modiano Slide 1 Packet Switched Networks Messages broken into Packets that are routed To their destination PS PS PS Packet Network PS PS PS Buffer Packet PS Switch Eytan Modiano Slide 2 Queueing Systems • Used for analyzing network performance • In packet networks, events are random – Random packet arrivals – Random packet lengths • While at the physical layer we were concerned with bit-error-rate, at the network layer we care about delays – How long does a packet spend waiting in buffers ? – How large are the buffers ? • In circuit switched networks want to know call blocking probability – How many circuits do we need to limit the blocking probability? Eytan Modiano Slide 3 Random events • Arrival process – Packets arrive according to a random process – Typically the arrival process is modeled as Poisson • The Poisson process – Arrival rate of λ packets per second – Over a small interval δ, P(exactly one arrival) = λδ + ο(δ) P(0 arrivals) = 1 - λδ + ο(δ) P(more than one arrival) = 0(δ) Where 0(δ)/ δ −> 0 as δ −> 0. – It can be shown that: (!T)n e"!T P(n arrivals in interval T)= n! Eytan Modiano Slide 4 The Poisson Process (!T)n e"!T P(n arrivals in interval T)= n! n = number of arrivals in T It can be shown that, E[n] = !T E[n2 ] = !T + (!T)2 " 2 = E[(n-E[n])2 ] = E[n2 ] - E[n]2 = !T Eytan Modiano Slide 5 Inter-arrival times • Time that elapses between arrivals (IA) P(IA <= t) = 1 - P(IA > t) = 1 - P(0 arrivals in time
    [Show full text]
  • Steady-State Analysis of Reflected Brownian Motions: Characterization, Numerical Methods and Queueing Applications
    STEADY-STATE ANALYSIS OF REFLECTED BROWNIAN MOTIONS: CHARACTERIZATION, NUMERICAL METHODS AND QUEUEING APPLICATIONS a dissertation submitted to the department of mathematics and the committee on graduate studies of stanford university in partial fulfillment of the requirements for the degree of doctor of philosophy By Jiangang Dai July 1990 c Copyright 2000 by Jiangang Dai All Rights Reserved ii I certify that I have read this dissertation and that in my opinion it is fully adequate, in scope and in quality, as a dissertation for the degree of Doctor of Philosophy. J. Michael Harrison (Graduate School of Business) (Principal Adviser) I certify that I have read this dissertation and that in my opinion it is fully adequate, in scope and in quality, as a dissertation for the degree of Doctor of Philosophy. Joseph Keller I certify that I have read this dissertation and that in my opinion it is fully adequate, in scope and in quality, as a dissertation for the degree of Doctor of Philosophy. David Siegmund (Statistics) Approved for the University Committee on Graduate Studies: Dean of Graduate Studies iii Abstract This dissertation is concerned with multidimensional diffusion processes that arise as ap- proximate models of queueing networks. To be specific, we consider two classes of semi- martingale reflected Brownian motions (SRBM's), each with polyhedral state space. For one class the state space is a two-dimensional rectangle, and for the other class it is the d general d-dimensional non-negative orthant R+. SRBM in a rectangle has been identified as an approximate model of a two-station queue- ing network with finite storage space at each station.
    [Show full text]
  • Introduction to Queueing Theory Review on Poisson Process
    Contents ELL 785–Computer Communication Networks Motivations Lecture 3 Discrete-time Markov processes Introduction to Queueing theory Review on Poisson process Continuous-time Markov processes Queueing systems 3-1 3-2 Circuit switching networks - I Circuit switching networks - II Traffic fluctuates as calls initiated & terminated Fluctuation in Trunk Occupancy Telephone calls come and go • Number of busy trunks People activity follow patterns: Mid-morning & mid-afternoon at All trunks busy, new call requests blocked • office, Evening at home, Summer vacation, etc. Outlier Days are extra busy (Mother’s Day, Christmas, ...), • disasters & other events cause surges in traffic Providing resources so Call requests always met is too expensive 1 active • Call requests met most of the time cost-effective 2 active • 3 active Switches concentrate traffic onto shared trunks: blocking of requests 4 active active will occur from time to time 5 active Trunk number Trunk 6 active active 7 active active Many Fewer lines trunks – minimize the number of trunks subject to a blocking probability 3-3 3-4 Packet switching networks - I Packet switching networks - II Statistical multiplexing Fluctuations in Packets in the System Dedicated lines involve not waiting for other users, but lines are • used inefficiently when user traffic is bursty (a) Dedicated lines A1 A2 Shared lines concentrate packets into shared line; packets buffered • (delayed) when line is not immediately available B1 B2 C1 C2 (a) Dedicated lines A1 A2 B1 B2 (b) Shared line A1 C1 B1 A2 B2 C2 C1 C2 A (b)
    [Show full text]
  • Copyrighted Material
    Index alternating renewal process, 353, 354 reflection principle, 474 scaling invariance, 471 Bayes rule, 23, 28 simulation, 480 Bernoulli process, 228, 293, 301–305, 309, 316 time invariance, 472 beta function, 60, 170, 265 Buffon’s needle problem, 83, 94 birth and catastrophe chain, 377 birth and death chain, 375, 392 Cauchy–Bunyakovsky–Schwarz inequality, 135, birthday problem, 30–31 137, 143, 149 Black–Karasinski model, 509 Central Limit Theorem, 2, 87, 92, 241, Blackwell renewal theorem, 346, 348 244, 245, 273, 282, 302, 342, 343, block replacement policy, 344 482, 523 Borel–Cantelli lemmas, 34–142, 224, 304 DeMoivre-Laplace version, 151 bounded convergence theorem, 131, 251, 422, changing the order of derivation and integra- 448, 455 tion, 243 branching process, 363, 366, 368, 441, 461 Chapman-Kolmogorov equation, 378, 379, 381, Brownian bridge, 483 389, 420 Brownian motion conditional distribution, 468 characteristic function, 192–194 covariance structure,COPYRIGHTED 471 MATERIALcontinuity theorem, 203 definition, 467 examples, 194–199 drift, 471 multivariate random vector, 194 examples, 468, 471 properties, 193 generation, 176 uniqueness, 200 hitting time, 475, 476 characterization theorem for convergence in dis- multidimensional, 473 tribution, 218 quadratic variation, 478 Cholesky decomposition, 174–176, 514 547 Probability and Stochastic Processes, First Edition. Ionut¸Florescu C 2015 John Wiley & Sons, Inc. Published 2015 by John Wiley & Sons, Inc. 548 INDEX CIR model, 507 Darboux sums, 349 moments, 510, 511 De Morgan laws,
    [Show full text]
  • On a Fractional Alternating Poisson Process
    AIMS Mathematics, 1(3): 212-224 DOI:10.3934/Math.2016.3.212 Received: 5 September 2016 Accepted: 12 September 2016 http://www.aimspress.com/journal/Math Published: 20 September 2016 Research article On a fractional alternating Poisson process Antonio Di Crescenzo∗and Alessandra Meoli Department of Mathematics, University of Salerno, Via Giovanni Paolo II, 132, 84084 Fisciano (SA), Italy ∗ Correspondence: Email: [email protected]; Tel: +39 089 96 3349; Fax: +39 089 96 3303. Abstract: We propose a generalization of the alternating Poisson process from the point of view of fractional calculus. We consider the system of differential equations governing the state probabilities of the alternating Poisson process and replace the ordinary derivative with the fractional derivative (in the Caputo sense). This produces a fractional 2-state point process. We obtain the probability mass function of this process in terms of the (two-parameter) Mittag-Leffler function. Then we show that it can be recovered also by means of renewal theory. We study the limit state probability, and certain proportions involving the fractional moments of the sub-renewal periods of the process. In conclusion, in order to derive new Mittag-Leffler-like distributions related to the considered process, we exploit a transformation acting on pairs of stochastically ordered random variables, which is an extension of the equilibrium operator and deserves interest in the analysis of alternating stochastic processes. Keywords: Caputo derivative; Mittag-Leffler function; fractional process; alternating process; renewal process; renewal function 1. Introduction Extension of continuous-time point processes to the fractional case has been a major topic in liter- ature for several years.
    [Show full text]
  • Optimal Surplus Capacity Utilization in Polling Systems Via Fluid Models
    Optimal Surplus Capacity Utilization in Polling Systems via Fluid Models Ayush Rawal, Veeraruna Kavitha and Manu K. Gupta Industrial Engineering and Operations Research, IIT Bombay, Powai, Mumbai - 400076, India E-mail: ayush.rawal, vkavitha, manu.gupta @iitb.ac.in Abstract—We discuss the idea of differential fairness in polling while maintaining the QoS requirements of primary customers. systems. One such example scenario is: primary customers One can model this scenario with polling systems, when it demand certain Quality of Service (QoS) and the idea is to takes non-zero time to switch the services between the two utilize the surplus server capacity to serve a secondary class of customers. We use achievable region approach for this. Towards classes of customers. Another example scenario is that of data this, we consider a two queue polling system and study its and voice users utilizing the same wireless network. In this ‘approximate achievable region’ using a new class of delay case, the network needs to maintain the drop probability of priority kind of schedulers. We obtain this approximate region, the impatient voice customers (who drop calls if not picked-up via a limit polling system with fluid queues. The approximation is within a negligible waiting times) below an acceptable level. accurate in the limit when the arrival rates and the service rates converge towards infinity while maintaining the load factor and Alongside, it also needs to optimize the expected sojourn times the ratio of arrival rates fixed. We show that the set of proposed of the data calls. schedulers and the exhaustive schedulers form a complete class: Polling systems can be categorized on the basis of different every point in the region is achieved by one of those schedulers.
    [Show full text]
  • AN EXTENSION of the MATRIX-ANALYTIC METHOD for M/G/1-TYPE MARKOV PROCESSES 1. Introduction We Consider a Bivariate Markov Proces
    Journal of the Operations Research Society of Japan ⃝c The Operations Research Society of Japan Vol. 58, No. 4, October 2015, pp. 376{393 AN EXTENSION OF THE MATRIX-ANALYTIC METHOD FOR M/G/1-TYPE MARKOV PROCESSES Yoshiaki Inoue Tetsuya Takine Osaka University Osaka University Research Fellow of JSPS (Received December 25, 2014; Revised May 23, 2015) Abstract We consider a bivariate Markov process f(U(t);S(t)); t ≥ 0g, where U(t)(t ≥ 0) takes values in [0; 1) and S(t)(t ≥ 0) takes values in a finite set. We assume that U(t)(t ≥ 0) is skip-free to the left, and therefore we call it the M/G/1-type Markov process. The M/G/1-type Markov process was first introduced as a generalization of the workload process in the MAP/G/1 queue and its stationary distribution was analyzed under a strong assumption that the conditional infinitesimal generator of the underlying Markov chain S(t) given U(t) > 0 is irreducible. In this paper, we extend known results for the stationary distribution to the case that the conditional infinitesimal generator of the underlying Markov chain given U(t) > 0 is reducible. With this extension, those results become applicable to the analysis of a certain class of queueing models. Keywords: Queue, bivariate Markov process, skip-free to the left, matrix-analytic method, reducible infinitesimal generator, MAP/G/1 queue 1. Introduction We consider a bivariate Markov process f(U(t);S(t)); t ≥ 0g, where U(t) and S(t) are referred to as the level and the phase, respectively, at time t.
    [Show full text]
  • 3 Lecture 3: Queueing Networks and Their Fluid and Diffusion Approximation
    3 Lecture 3: Queueing Networks and their Fluid and Diffusion Approximation • Fluid and diffusion scales • Queueing networks • Fluid and diffusion approximation of Generalized Jackson networks. • Reflected Brownian Motions • Routing in single class queueing networks. • Multi class queueing networks • Stability of policies for MCQN via fluid • Optimization of MCQN — MDP and the fluid model. • Formulation of the fluid problem for a MCQN 3.1 Fluid and diffusion scales As we saw, queues can only be studied under some very detailed assumptions. If we are willing to assume Poisson arrivals and exponetial service we get a very complete description of the queuing process, in which we can study almost every phenomenon of interest by analytic means. However, much of what we see in M/M/1 simply does not describe what goes on in non M/M/1 systems. If we give up the assumption of exponential service time, then it needs to be replaced by a distribution function G. Fortunately, M/G/1 can also be analyzed in moderate detail, and quite a lot can be said about it which does not depend too much on the detailed form of G. In particular, for the M/G/1 system in steady state, we can calculate moments of queue length and waiting times in terms of the same moments plus one of the distribution G, and so we can evaluate performance of M/G/1 without too many details on G, sometimes 2 E(G) and cG suffice. Again, behavior of M/G/1 does not describe what goes on in GI/G/1 systems.
    [Show full text]