Lecture Notes on Stochastic Networks

Total Page:16

File Type:pdf, Size:1020Kb

Lecture Notes on Stochastic Networks Lecture Notes on Stochastic Networks Frank Kelly and Elena Yudovina Contents Preface page ix Overview 1 Queueing and loss networks 2 Decentralized optimization 4 Random access networks 5 Broadband networks 6 Internet modelling 8 Part I 11 1 Markov chains 13 1.1 Definitions and notation 13 1.2 Time reversal 16 1.3 Erlang’s formula 18 1.4 Further reading 21 2 Queueing networks 22 2.1 An M/M/1 queue 22 2.2 A series of M/M/1 queues 24 2.3 Closed migration processes 26 2.4 Open migration processes 30 2.5 Little’s law 36 2.6 Linear migration processes 39 2.7 Generalizations 44 2.8 Further reading 48 3 Loss networks 49 3.1 Network model 49 3.2 Approximation procedure 51 3.3 Truncating reversible processes 52 v vi Contents 3.4 Maximum probability 57 3.5 A central limit theorem 61 3.6 Erlang fixed point 67 3.7 Diverse routing 71 3.8 Further reading 81 Part II 83 4 Decentralized optimization 85 4.1 An electrical network 86 4.2 Road traffic models 92 4.3 Optimization of queueing and loss networks 101 4.4 Further reading 107 5 Random access networks 108 5.1 The ALOHA protocol 109 5.2 Estimating backlog 115 5.3 Acknowledgement-based schemes 119 5.4 Distributed random access 125 5.5 Further reading 132 6 Effective bandwidth 133 6.1 Chernoff bound and Cramer’s´ theorem 134 6.2 Effective bandwidth 138 6.3 Large deviations for a queue with many sources 143 6.4 Further reading 148 Part III 149 7 Internet congestion control 151 7.1 Control of elastic network flows 151 7.2 Notions of fairness 158 7.3 A primal algorithm 162 7.4 Modelling TCP 166 7.5 What is being optimized? 170 7.6 A dual algorithm 172 7.7 Time delays 173 7.8 Modelling a switch 177 7.9 Further reading 185 8 Flow level Internet models 186 Contents vii 8.1 Evolution of flows 186 8.2 α-fair rate allocations 187 8.3 Stability of α-fair rate allocations 189 8.4 What can go wrong? 192 8.5 Linear network with proportional fairness 195 8.6 Further reading 199 Appendix A Continuous time Markov processes 201 Appendix B Little’s law 204 Appendix C Lagrange multipliers 207 Appendix D Foster–Lyapunov criteria 210 References 217 Index 221 Preface Communication networks underpin our modern world, and provide fasci- nating and challenging examples of large-scale stochastic systems. Ran- domness arises in communication systems at many levels: for example, the initiation and termination times of calls in a telephone network, or the sta- tistical structure of the arrival streams of packets at routers in the Internet. How can routing, flow control, and connection acceptance algorithms be designed to work well in uncertain and random environments? And can we design these algorithms using simple local rules so that they produce coherent and purposeful behaviour at the macroscopic level? The first two parts of the book will describe a variety of classical models that can be used to help understand the behaviour of large-scale stochastic networks. Queueing and loss networks will be studied, as well as random access schemes and the concept of an effective bandwidth. Parallels will be drawn with models from physics, and with models of traffic in road networks. The third part of the book will study more recently developed models of packet traffic and of congestion control algorithms in the Internet. This is an area of some practical importance, with network operators, content providers, hardware and software vendors, and regulators actively seeking ways of delivering new services reliably and effectively. The complex in- terplay between end-systems and the network has attracted the attention of economists as well as mathematicians and engineers. We describe enough of the technological background to communication networks to motivate our models, but no more. Some of the ideas described in the book are finding application in financial, energy, and economic net- works as computing and communication technologies transform these ar- eas. But communication networks currently provide the richest and best- developed area of application within which to present a connected account of the ideas. The lecture notes that have become this book were used for a Mas- ix x Preface ters course (“Part III”) in the Faculty of Mathematics at the University of Cambridge. This is a one-year postgraduate course which assumes a math- ematically mature audience, albeit from a variety of different mathemati- cal backgrounds. Familiarity with undergraduate courses on Optimization and Markov Chains is helpful, but not absolutely necessary. Appendices are provided on continuous time Markov processes, Little’s law, Lagrange multipliers, and Foster–Lyapunov criteria, reviewing the material needed. At Cambridge, students may attend other courses where topics touched on in these notes, for example Poisson point processes, large deviations, or game theory, are treated in more depth, and this course can serve as addi- tional motivation. Suggestions on further reading are given at the end of each chapter; these include reviews where the historical development and attribution of results can be found – we have not attempted this here – as well as some recent papers which give current research directions. The authors are grateful to students of the course at Cambridge (and, for one year, Stanford) for their questions and insights, and especially to Joe Hurd, Damon Wischik, Gaurav Raina, and Neil Walton, who produced earlier versions of these notes. Frank Kelly and Elena Yudovina Overview This book is about stochastic networks and their applications. Large-scale systems of interacting components have long been of interest to physicists. For example, the behaviour of the air in a room can be described at the mi- croscopic level in terms of the position and velocity of each molecule. At this level of detail a molecule’s velocity appears as a random process. Con- sistent with this detailed microscopic description of the system is macro- scopic behaviour best described by quantities such as temperature and pres- sure. Thus the pressure on the wall of the room is an average over an area and over time of many small momentum transfers as molecules bounce off the wall, and the relationship between temperature and pressure for a gas in a confined volume can be deduced from the microscopic behaviour of molecules. Economists, as well as physicists, are interested in large-scale systems, driven by the interactions of agents with preferences rather than inanimate particles. For example, from a market with many heterogeneous buyers and sellers there may emerge the notion of a price at which the market clears. Over the last 100 years, some of the most striking examples of large- scale systems have been technological in nature and constructed by us, from the telephony network through to the Internet. Can we relate the microscopic description of these systems in terms of calls or packets to macroscopic consequences such as blocking probabilities or throughput rates? And can we design the microscopic rules governing calls or packets to produce more desirable macroscopic behaviour? These are some of the questions we address in this book. We shall see that there are high-level constructs that parallel fundamental concepts from physics or economics such as energy or price, and which allow us to reason about the systems we design. In this chapter we briefly introduce some of the models that we shall en- counter. We’ll see in later chapters that for the systems we ourselves con- 1 2 Overview struct, we are sometimes able to use simple local rules to produce macro- scopic behaviour which appears coherent and purposeful. Queueing and loss networks We begin Chapter 1 with a brief introduction to Markov chains and Markov processes, which will be the underlying probabilistic model for most of the systems we consider. In Chapter 2 we study queueing networks, in which customers (or jobs or packets) wait for service by one or several servers. Figure 1 A network of four queues. First, we look at a single queue. We shall see how to model it as a Markov process, and derive information on the distribution of the queue size. We then look briefly at a network of queues. Starting from a simpli- fied description of each queue, we shall obtain information about the sys- tem behaviour. We define a traffic intensity for a simple queue, and identify Poisson flows in a network of queues. A natural queueing discipline is first-come-first-served, and we also look at processor sharing, where the server shares its effort equally over all the customers present in the queue. C=3 C=2 Figure 2 A loss network with some of the routes highlighted. In Chapter 3, we move on to consider loss networks. A loss network consists of several links, each of which may have a number of circuits. The classical example of its use is to model landline telephone connections Overview 3 between several cities. When a telephone call is placed between one node and another, it needs to hold simultaneously a circuit on each of the links on a route between the two nodes – otherwise, the call is lost. Note the key differences between this and a queueing network, which are summarized in Table 1. Table 1. Queueing versus loss networks Queueing networks Loss networks Sequential use of resources Simultaneous resource possession Congestion = delay Congestion = loss ⇒ ⇒ First, we treat loss networks where routing is fixed in advance. We show that the simple rules for call acceptance lead to a stationary distribution for the system state that is centred on the solution to a certain optimiza- tion problem, and we’ll relate this problem to a classical approximation procedure.
Recommended publications
  • Absorbing State in Markov Decision Process, 330 Absorption, 466
    Index Absorbing state Average-cost criterion, 326, 360 in Markov decision process, 330 Back-substitution, 182-183 Absorption, 466 Bailey's bulk queue, 209, 247-248 Accelerating convergence, 273 Balance equations, 412 Acceleration, 268, 270 global, 130, 411-412, 414 Action space, 326 job-class, 423 Adjoint, 215, 230 local, 130, 422 Agarwal, 289, 298 partial, 411-414, 418, 422 Aggregate station, 437 station, 411, 413-414, 418, 422 Aggregation, 57 and blocking, 427 Aggregation matrix, 102 failure of, 425 Aggregation step, 103 restored, 427, 429, 435 Aliased sequence, 277 Barthez, 272 Aliasing, 266 BASTA, 373 See also Error, aliasing Benes, 282, 284, 287 Alternating series, 268 Bernoulli arrivals, 373 Analytic, 206, 208, 210, 216, 235, 238 Bernoulli process, 387 Analyticity condition, 294 Bertozzi, 304 And gate, 462 Binomial average, 270 Approximation, 375, 377-378, 380-381, 388, Binomial distribution, 270 392-393, 396 Block elimination, 175, 179, 183 of transition matrix, 180, 357 and paradigms of Neuts, 187-189 Arbitrary-epoch tail probabilities, 381 Block iterative methods, 93 Arbitrary service time, 381 Block Jacobi, 94 Argument principle, 207, 239 Block SOR, 94 Arnoldi's method, 53, 83, 97 Block-splitting, 93 Arrival-first, 366 Blocking, 158, 425-427 Asmussen, 293, 299, 301 Blocking probability, 410 Assembly line, 415 Erlang,283 Asymptotic behavior, 243 time dependent, 280, 282 Asymptotic formulas, 282 Borovkov, 281 Asymptotic parameter, 294 Boundary probabilities, 206, 210, 218 Asymptotics, 303 Bounding methodology, 428-429 Automata:
    [Show full text]
  • Performance Analysis of Multiclass Queueing Networks Via Brownian Approximation
    Performance Analysis of Multiclass Queueing Networks via Brownian Approximation by Xinyang Shen B.Sc, Jilin University, China, 1993 A THESIS SUBMITTED IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY in THE FACULTY OF GRADUATE STUDIES (Faculty of Commerce and Business Administration; Operations and Logisitics) We accept this thesis as conforming to the required standard THE UNIVERSITY OF BRITISH COLUMBIA May 23, 2001 © Xinyang Shen, 2001 In presenting this thesis in partial fulfilment of the requirements for an advanced degree at the University of British Columbia, I agree that the Library shall make it freely available for reference and study. I further agree that permission for extensive copying of this thesis for scholarly purposes may be granted by the head of my department or by his or her representatives. It is understood that copying or publication of this thesis for financial gain shall not be allowed without my written permission. Faculty of Commerce and Business Administration The University of. British Columbia Abstract This dissertation focuses on the performance analysis of multiclass open queueing networks using semi-martingale reflecting Brownian motion (SRBM) approximation. It consists of four parts. In the first part, we derive a strong approximation for a multiclass feedforward queueing network, where jobs after service completion can only move to a downstream service station. Job classes are partitioned into groups. Within a group, jobs are served in the order of arrival; that is, a first-in-first-out (FIFO) discipline is in force, and among groups, jobs are served under a pre-assigned preemptive priority discipline.
    [Show full text]
  • Markovian Queueing Networks
    Richard J. Boucherie Markovian queueing networks Lecture notes LNMB course MQSN September 5, 2020 Springer Contents Part I Solution concepts for Markovian networks of queues 1 Preliminaries .................................................. 3 1.1 Basic results for Markov chains . .3 1.2 Three solution concepts . 11 1.2.1 Reversibility . 12 1.2.2 Partial balance . 13 1.2.3 Kelly’s lemma . 13 2 Reversibility, Poisson flows and feedforward networks. 15 2.1 The birth-death process. 15 2.2 Detailed balance . 18 2.3 Erlang loss networks . 21 2.4 Reversibility . 23 2.5 Burke’s theorem and feedforward networks of MjMj1 queues . 25 2.6 Literature . 28 3 Partial balance and networks with Markovian routing . 29 3.1 Networks of MjMj1 queues . 29 3.2 Kelly-Whittle networks. 35 3.3 Partial balance . 39 3.4 State-dependent routing and blocking protocols . 44 3.5 Literature . 50 4 Kelly’s lemma and networks with fixed routes ..................... 51 4.1 The time-reversed process and Kelly’s Lemma . 51 4.2 Queue disciplines . 53 4.3 Networks with customer types and fixed routes . 59 4.4 Quasi-reversibility . 62 4.5 Networks of quasi-reversible queues with fixed routes . 68 4.6 Literature . 70 v Part I Solution concepts for Markovian networks of queues Chapter 1 Preliminaries This chapter reviews and discusses the basic assumptions and techniques that will be used in this monograph. Proofs of results given in this chapter are omitted, but can be found in standard textbooks on Markov chains and queueing theory, e.g. [?, ?, ?, ?, ?, ?, ?]. Results from these references are used in this chapter without reference except for cases where a specific result (e.g.
    [Show full text]
  • An Overflow Loss Network Model for Capacity Plan
    CORE Metadata, citation and similar papers at core.ac.uk Provided by STORE - Staffordshire Online Repository An Overflow Loss Network Model for Capacity Plan- ning of a Perinatal Network Md Asaduzzaman and Thierry J. Chaussalet University of Westminster, London, UK. Summary. In this paper, a model framework is developed to solve capacity planning problems faced by many perinatal networks in the UK. We propose a loss network model with overflow based on a continuous-time Markov chain for a perinatal network with specific application to a network in London. We derive the steady state expressions for overflow and rejection probabilities for each neonatal unit of the network based on a decomposition approach. Results obtained from the model are very close to observed values. Using the model, decisions on number of cots can be made for specific level of admission acceptance probabilities for each level of care at each neonatal unit of the network and specific levels of overflow to temporary care. Keywords: Queueing network model; Decomposition; Rejection; Continuous-time Markov chain 1. Introduction Every year over 80,000 (approximately 10%) neonates are born premature, very sick, or very small and require some form of specialist support in England (DH, 2003; RCPCH, 2007). Neonatal ser- vices aim to offer high quality care for these vulnerable babies. Over a six month period in 2006-07, neonatal units were shut to new admissions for an average of 24 days. One in ten units exceeded its capacity for intensive care for more than 50 days during a six month period (Bliss, 2007). The Na- tional Audit Office reported that capacity and staffing problems at unit level continue to constrain neonatal service (NAO, 2007).
    [Show full text]
  • Lecture Notes on Stochastic Networks
    Lecture Notes on Stochastic Networks Frank Kelly and Elena Yudovina Contents Preface page viii Overview 1 Queueing and loss networks 2 Decentralized optimization 4 Random access networks 5 Broadband networks 6 Internet modelling 8 Part I 11 1 Markov chains 13 1.1 Definitions and notation 13 1.2 Time reversal 16 1.3 Erlang’s formula 18 1.4 Further reading 21 2 Queueing networks 22 2.1 An M/M/1 queue 22 2.2 A series of M/M/1 queues 24 2.3 Closed migration processes 26 2.4 Open migration processes 30 2.5 Little’s law 36 2.6 Linear migration processes 39 2.7 Generalizations 44 2.8 Further reading 48 3 Loss networks 49 3.1 Network model 49 3.2 Approximation procedure 51 v vi Contents 3.3 Truncating reversible processes 52 3.4 Maximum probability 57 3.5 A central limit theorem 61 3.6 Erlang fixed point 67 3.7 Diverse routing 71 3.8 Further reading 81 Part II 83 4 Decentralized optimization 85 4.1 An electrical network 86 4.2 Road traffic models 92 4.3 Optimization of queueing and loss networks 101 4.4 Further reading 107 5 Random access networks 108 5.1 The ALOHA protocol 109 5.2 Estimating backlog 115 5.3 Acknowledgement-based schemes 119 5.4 Distributed random access 125 5.5 Further reading 132 6 Effective bandwidth 133 6.1 Chernoff bound and Cramer’s´ theorem 134 6.2 Effective bandwidth 138 6.3 Large deviations for a queue with many sources 143 6.4 Further reading 148 Part III 149 7 Internet congestion control 151 7.1 Control of elastic network flows 151 7.2 Notions of fairness 158 7.3 A primal algorithm 162 7.4 Modelling TCP 166 7.5 What is being
    [Show full text]
  • Delay Asymptotics and Bounds for Multitask Parallel Jobs
    Queueing Systems (2019) 91:207–239 https://doi.org/10.1007/s11134-018-09597-5 Delay asymptotics and bounds for multitask parallel jobs Weina Wang1,2 · Mor Harchol-Balter2 · Haotian Jiang3 · Alan Scheller-Wolf4 · R. Srikant1 Received: 10 November 2018 / Published online: 16 January 2019 © Springer Science+Business Media, LLC, part of Springer Nature 2019 Abstract We study delay of jobs that consist of multiple parallel tasks, which is a critical performance metric in a wide range of applications such as data file retrieval in coded storage systems and parallel computing. In this problem, each job is completed only when all of its tasks are completed, so the delay of a job is the maximum of the delays of its tasks. Despite the wide attention this problem has received, tight analysis is still largely unknown since analyzing job delay requires characterizing the complicated correlation among task delays, which is hard to do. We first consider an asymptotic regime where the number of servers, n, goes to infinity, and the number of tasks in a job, k(n), is allowed to increase with n. We establish the asymptotic independence of any k(n) queues under the condition k(n) = o(n1/4). This greatly generalizes the asymptotic independence type of results in the literature, where asymptotic indepen- dence is shown only for a fixed constant number of queues. As a consequence of our independence result, the job delay converges to the maximum of independent task delays. We next consider the non-asymptotic regime. Here, we prove that inde- pendence yields a stochastic upper bound on job delay for any n and any k(n) with k(n) ≤ n.
    [Show full text]
  • Heavy-Traffic Optimality of a Stochastic
    Heavy-Traffic Optimality of a Stochastic Network under Utility-Maximizing Resource Control Heng-Qing Ye∗ Dept of Decision Science National University of Singapore, Singapore David D. Yaoy Dept of Industrial Engineering and Operations Research Columbia University, New York, USA December 2005 Abstract We study a stochastic network that consists of a set of servers processing multiple classes of jobs. Each class of jobs requires a concurrent occupancy of several servers while being processed, and each server is shared among the job classes in a head-of-the-line processor- sharing mechanism. The allocation of the service capacities is a real-time control mechanism: in each network state, the control is the solution to an optimization problem that maximizes a general utility function. Whereas this resource control optimizes in a \greedy" fashion, with respect to each state, we establish its asymptotic optimality in terms of (a) deriving the fluid and diffusion limits of the network under this control, and (b) identifying a cost function that is minimized in under the diffusion limit, along with a characterization of the so-called fixed point state of the network. Keywords: stochastic processing network, concurrent resource occupancy, utility-maximizing resource control, fluid limit, diffusion limit, resource pooling, heavy-traffic optimality, Lyapunov function. ∗Supported in part by the grant R-314-000-061-112 of National University Singapore. ySupported in part by NSF grant CNS-03-25495, and by HK/RGC Grant CUHK4179/05E. 1 1 Introduction We study a class of stochastic networks with concurrent occupancy of resources, which, in turn, are shared among jobs.
    [Show full text]
  • Economies-Of-Scale in Many-Server Queueing Systems: Tutorial and Partial Review of the QED Halfin-Whitt Heavy-Traffic Regime
    Economies-of-scale in many-server queueing systems: tutorial and partial review of the QED Halfin-Whitt heavy-traffic regime Johan S.H. van Leeuwaarden Britt W.J. Mathijsen Bert Zwart July 30, 2019 Abstract Multi-server queueing systems describe situations in which users require service from multiple parallel servers. Examples include check-in lines at airports, waiting rooms in hospitals, queues in contact centers, data buffers in wireless networks, and delayed service in cloud data centers. These are all situations with jobs (clients, patients, tasks) and servers (agents, beds, processors) that have large capacity levels, rang- ing from the order of tens (checkouts) to thousands (processors). This survey investigates how to design such systems to exploit resource pooling and economies-of-scale. In particular, we review the mathematics behind the Quality-and-Efficiency Driven (QED) regime, which lets the system operate close to full utiliza- tion, while the number of servers grows simultaneously large and delays remain manageable. Aimed at a broad audience, we describe in detail the mathematical concepts for the basic Markovian many-server system, and only provide sketches or references for more advanced settings related to e.g. load balancing, overdispersion, parameter uncertainty, general service requirements and queueing networks. While serving as a partial survey of a massive body of work, the tutorial is not aimed to be exhaustive. Contents 1 Introduction 2 5.1 Bounds . 19 5.2 Optimality gaps . 21 2 Example models 6 5.3 Refinements . 22 2.1 Many exponential servers . .6 2.2 Bulk-service queue . 11 6 Extensions 23 arXiv:1706.05397v2 [math.PR] 28 Jul 2019 3 Key QED properties 14 6.1 Abandonments .
    [Show full text]
  • A Heavy Traffic Limit Theorem for a Class of Open Queueing Networks With
    Queueing Systems 32 (1999) 5±40 5 A heavy traf®c limit theorem for a class of open queueing networks with ®nite buffers ∗ J.G. Dai a and W. Dai b,∗∗ a School of Industrial and Systems Engineering, and School of Mathematics, Georgia Institute of Technology, Atlanta, GA 30332-0205, USA E-mail: [email protected] b School of Mathematics, Georgia Institute of Technology, Atlanta, GA 30332-0160, USA Submitted 1 February 1998; accepted 1 December 1998 We consider a queueing network of d single server stations. Each station has a ®nite capacity waiting buffer, and all customers served at a station are homogeneous in terms of service requirements and routing. The routing is assumed to be deterministic and hence feedforward. A server stops working when the downstream buffer is full. We show that a properly normalized d-dimensional queue length process converges in distribution to a d-dimensional semimartingale re¯ecting Brownian motion (RBM) in a d-dimensional box under a heavy traf®c condition. The conventional continuous mapping approach does not apply here because the solution to our Skorohod problem may not be unique. Our proof relies heavily on a uniform oscillation result for solutions to a family of Skorohod problems. The oscillation result is proved in a general form that may be of independent interest. It has the potential to be used as an important ingredient in establishing heavy traf®c limit theorems for general ®nite buffer networks. Keywords: ®nite capacity network, blocking probabilities, loss network, semimartingale re¯ecting Brownian motion, RBM, heavy traf®c, limit theorems, oscillation estimates 1.
    [Show full text]
  • Continuous-Time Markov Chains
    CONTINUOUS-TIME MARKOV CHAINS by Ward Whitt Department of Industrial Engineering and Operations Research Columbia University New York, NY 10027-6699 Email: [email protected] URL: www.columbia.edu/∼ww2040 December 4, 2013 c Ward Whitt Contents 1 Introduction 1 2 Transition Probabilities and Finite-Dimensional Distributions 2 3 Modelling 4 3.1 A DTMC with Exponential Transition Times . ...... 6 3.2 TransitionRatesandODE’s. .... 7 3.3 Competing Clocks with Exponential Timers . ........ 11 3.4 Uniformization: A DTMC with Poisson Transitions . .......... 14 4 Birth-and-Death Processes 16 5 Stationary and Limiting Probabilities for CTMC’s 23 6 Reverse-Time CTMC’s and Reversibility 31 7 Open Queueing Networks (OQN’s) 36 7.1 TheModel ...................................... 36 7.2 The Traffic Rate Equations and the Stability Condition . .......... 36 7.3 The Limiting Product-Form Distribution . ......... 37 7.4 Extensions: More Servers or Different Service SchedulingRules ......... 39 7.5 Steady State in Discrete and Continuous Time . ........ 40 8 Closed Queueing Networks (CQN’s) 41 8.1 Why Are Closed Models Interesting? . ...... 41 8.2 A Normalized Product-Form Distribution . ........ 42 8.3 Computing the Normalization Constant: The Convolution Algorithm . 44 9 Stochastic Loss Models 45 9.1 TheErlangLossModel .............................. 45 9.2 StochasticLossNetworks . 47 9.3 InsensitivityintheErlangLossModel . ........ 48 10 Regularity and Irregularity in Infinite-State CTMC’s 50 10.1 Instantaneous Transitions, Explosions and the Minimal Construction . 51 10.2 Conditions for Regularity and Recurrence . .......... 52 11 More on Reversible CTMC’s and Birth-and-Death Processes 53 11.1 Spectral Representation in Reversible Markov Chains . .............. 53 11.2 FittingBDProcessestoData . ..... 55 11.3 ComparingBDprocesses.
    [Show full text]
  • Queuing Networks in Healthcare Systems
    Queuing Networks in Healthcare Systems Maartje E. Zonderland and Richard J. Boucherie Abstract Over the last decades, the concept of patient flow has received an increased amount of attention. Healthcare professionals have become aware that in order to analyze the performance of a single healthcare facility, its relationship with other healthcare facilities should also be taken into account. A natural choice for analysis of networks of healthcare facilities is queuing theory. With a queuing network a fast and flexible analysis is provided that discovers bottlenecks and allows for the evaluation of alternative set-ups of the network. In this chapter we describe how queuing theory, and networks of queues in particular, can be invoked to model, study, analyze and solve healthcare problems. We describe important theoretical queuing results, give a review of the literature on the topic, discuss in detail two examples of how a healthcare problem is analyzed using a queuing network, and suggest directions for future research. 1 Introduction With an aging population, the rising cost of new medical technologies, and a soci- ety wanting higher quality care, the demand for healthcare is increasing annually. In European countries, such as the Netherlands, healthcare expenditures consume around 10% of the GDP. In the United States this percentage is even bigger at 16% [45] (2008 data). Since the supply of healthcare is finite, policy makers have to ra- tion care and make choices on how to distribute physical, human, and monetary resources. Such choices also have to be made at the hospital level (e.g., which pa- Maartje E. Zonderland · Richard J.
    [Show full text]