Markov Chains, Renewal, Branching and Coalescent Processes: Four Topics in Probability Theory

Total Page:16

File Type:pdf, Size:1020Kb

Markov Chains, Renewal, Branching and Coalescent Processes: Four Topics in Probability Theory Markov Chains, Renewal, Branching and Coalescent Processes: Four Topics in Probability Theory Andreas Nordvall Lager˚as Mathematical Statistics Department of Mathematics Stockholm University 2007 Doctoral Dissertation 2007 Mathematical Statistics Stockholm University SE-106 91 Stockholm Typeset by LATEX c Andreas Nordvall Lager˚as ISBN 91-7155-375-4 pp. 1{14 Printed by US AB Abstract This thesis consists of four papers. In paper 1, we prove central limit theorems for Markov chains under (local) contraction conditions. As a corollary we obtain a central limit theorem for Markov chains associated with iterated function systems with contractive maps and place-dependent Dini-continuous probabilities. In paper 2, properties of inverse subordinators are investigated, in particular similarities with renewal processes. The main tool is a theorem on processes that are both renewal and Cox processes. In paper 3, distributional properties of supercritical and especially immortal branching processes are derived. The marginal distributions of immortal branching processes are found to be compound geometric. In paper 4, a description of a dynamic population model is presented, such that samples from the population have genealogies as given by a Λ-coalescent with mutations. Depending on whether the sample is grouped according to litters or families, the sampling distribution is either regenerative or non- regenerative. Tack Jag vill tacka - min handledare Thomas H¨oglund som var min f¨orsta f¨orel¨asare i san- nolikhetsteori och omedelbart fick mig att fatta tycke f¨or ¨amnet. - Anders Martin-L¨of som alltid har funnits till hands att bolla id´eer med. - Orjan¨ Stenflo som var mycket bra som en f¨orsta medf¨orfattare, ordent- ligt sporrande och tillr¨ackligt kr¨avande. - ¨ovriga kollegor p˚a matematisk statistik f¨or att vi fikar, ¨ater, undervisar och forskar s˚a bra tillsammans. S¨arskilt fikar. - min familj och v¨anner, f¨or allt det som sker utanf¨or min lilla verkstad. Stockholm 25 januari 2007 Andreas Nordvall Lager˚as Contents Introduction and summary of the four papers 1 1 Paper I 1 1.1 Markov chains as iterated function systems . 1 1.2 Limit theorems . 2 1.3 Main result . 3 2 Paper II 4 2.1 Renewal processes and beyond . 4 2.2 Cox processes . 5 2.3 Main result . 6 3 Paper III 8 3.1 Compound distributions . 8 3.2 Branching processes in continuous time . 8 3.3 Binary branching: the Yule process . 9 3.4 Main result . 10 4 Paper IV 12 4.1 Population models . 12 4.2 Main result . 14 List of papers I Lager˚as, A. N. and Stenflo, O.¨ (2005) Central limit theorems for contractive Markov chains.∗ Nonlinearity, 18(5), 1955{1965. II Lager˚as, A. N. (2005) A renewal-process-type expression for the mo- ments of inverse subordinators.y Journal of Applied Probability, 42(4), 1134{1144. III Lager˚as, A. N. and Martin-Lof,¨ A. (2006) Genealogy for super- critical branching processes.z Journal of Applied Probability, 43(4), 1066{1076. IV Lager˚as, A. N. (2006) A population model for Λ-coalescents with neutral mutations. Submitted. ∗ c 2005 IOP Publishing Ltd. y c 2005 The Applied Probability Trust z c 2006 The Applied Probability Trust Introduction and summary of the four papers This thesis consists of four papers that concern different areas in probability theory. The following pages have short summaries of each article for the non-specialist probabilist. 1 Paper I: Central limit theorems for con- tractive Markov chains The first article of this thesis is a joint work with Orjan¨ Stenflo, and was first published in Nonlinearity (2005), vol 18 no 5. It was also a part of my licentiate thesis. 1.1 Markov chains as iterated function systems Consider the following way of generating a Markov chain (Zn)n2N on some state space S. Let w be a collection of functions defined on S. Given f igi2I that Zn = zn, draw a random variable Xn on I, whose distribution may depend on zn, and let Zn+1 = wXn (Zn). In fact, any Markov chain can ∗ be described in this way, with I = [0; 1] and Xn being uniform on I and independent of Zn, but sometimes it is more natural to take Xn dependent on Zn. Example Let (Z ) N have state space 0; 1; 2; 3 , and transition matrix n n2 f g 1 1 0 2 0 2 1 1 2 0 2 0 (pij) = 0 1 3 1 0 4 0 4 B 3 0 1 0C B 4 4 C @ A which we can also describe with this picture: 3=4 Ò Ò 1=2 1=2 3=4 * * * * 89:;?>=<0 Vj 89?>1:;=<Vj 89:;?>=<2 Vj 89?>3:;=< j _ h _ h _ h B @ 1=2 1=4 1=4 ~B S W k Z ] _ a d g 1=2 Here full (dashed) arrows indicate a step up (down) modulo 4, and the double 3 1 1 (simple, half) arrowheads belong to jumps occurring with probability 4 ( 2 ; 4 ). ∗At least if S is Borel, see Proposition 7.6 in Kallenberg, O. (1997) Foundations of Modern Probability. Springer. 1 One way of generating this Markov chain is to let w (z) z 1 mod 4 # ≡ − w (z) z + 1 mod 4 " ≡ z 1 mod 4 for z = 0; 1 wl(z) − ≡ (z + 1 mod 4 for z = 2; 3 and let X1; X2; : : : be an i.i.d. sequence of random elements in ; ; such 1 1 1 f# " lg that P (Xn = ) = 4 , P (Xn = ) = 2 and P (Xn = ) = 4 for all n, and then set # " l Z = w n (Z ) = w n w n− (Z ) = = w n w (Z ): n+1 X n X ◦ X 1 n−1 · · · X ◦ · · · ◦ X1 0 If we allow X1; X2; : : : to be dependent on the values of Z1; Z2; : : : we can describe the dynamics with only w# and w", namely by letting 1 1 P (X = Z = 0; 1) = ; P (X = Z = 0; 1) = ; n # j n 2 n " j n 2 1 3 P (X = Z = 2; 3) = ; P (X = Z = 2; 3) = ; n # j n 4 n " j n 4 which is arguably more natural. In the article, we investigate properties of Markov chains with a compact state space, typically a closed and bounded subset of Rn, that are generated by a collection of contractive maps w , with I being countable, and the f igi2I probability of Xn = i given Zn = z is given by pi(z) for some functions pi(z) i2I . Such collections ( wi ; pi ) are called iterated function systems withf placeg dependent probabilities.f g f g 1.2 Limit theorems d When Zn Z, with Z having a stationary distribution for (Zn)n2N, you typically ha−v!e a law of large numbers for the Markov chain: 1 n f(Z ) a:s: E[f(Z)]; n n −! i=1 X or even a central limit theorem: 1 n f(Z ) E[f(Z)] d N(0; σ2) (1) pn k − −! Xk=1 2 where f is a function from the state space S to R. One could also want to center the summands in (1) by E[f(Zk)] instead of E[f(Z)]. A so called func- tional central limit theorem is a stronger version of a central limit theorem in which [nt] 1 f(Z ) E[f(Z)] d σB ; pn k − −! t Xk=1 where (Bt)0≤t≤1 is a standard Brownian motion. 1.3 Main result Our main result concerns Markov chains, that have contractive maps wi i2I when they are viewed as iterated function systems. Hence they aref calledg contractive Markov chains. With conditions on the smoothness of f and p we obtain a functional central limit theorem. The conditions are f igi2I such that a highly regular f allows for more \wild" pi i2I and vice versa. We also state the results with conditions on the rate off cong vergence towards the stationary distribution for the Markov chain. Often one consider chains such that the rate is, in a sense, \exponential", but our results also work with even slower convergence. 3 2 Paper II: A renewal-process-type expression for the moments of inverse subordinators This article was first published in Journal of Applied Probability (2005), vol 42 no 4, and was a part of my licentiate thesis. 2.1 Renewal processes and beyond One of the first stochastic processes that one is introduced to in a beginners course in stochastic processes is the renewal process. It is simply a collection of points in time, events of some sort, such that the times between consecutive events are independent and identically distributed. One quantity of interest is Nt = \the number of events in [0; t]." The simplest case of a renewal process is the Poisson process, which has an exponential distribution for the times between events. The name comes from the fact that Nt is Poisson distributed for all t. Calculations for the Poisson process are greatly simplified by the fact that it is a Markov process in continuous time, and the number of events in disjoint time intervals are independent. For other renewal processes, one can hardly give any exact results about the distribution of Nt. An exception to this is that if one has an explicit expression for E[Nt] it can be used to calculate moments of arbitrary integer order for the joint moments of the increments of (Nt) over disjoint intervals. It is easiest to state [k] the result with factorial moments instead of ordinary moments: E[Nt ] = E[Nt(Nt 1) (Nt k + 1)].
Recommended publications
  • Cox Process Representation and Inference for Stochastic Reaction-Diffusion Processes
    Edinburgh Research Explorer Cox process representation and inference for stochastic reaction-diffusion processes Citation for published version: Schnoerr, D, Grima, R & Sanguinetti, G 2016, 'Cox process representation and inference for stochastic reaction-diffusion processes', Nature Communications, vol. 7, 11729. https://doi.org/10.1038/ncomms11729 Digital Object Identifier (DOI): 10.1038/ncomms11729 Link: Link to publication record in Edinburgh Research Explorer Document Version: Publisher's PDF, also known as Version of record Published In: Nature Communications General rights Copyright for the publications made accessible via the Edinburgh Research Explorer is retained by the author(s) and / or other copyright owners and it is a condition of accessing these publications that users recognise and abide by the legal requirements associated with these rights. Take down policy The University of Edinburgh has made every reasonable effort to ensure that Edinburgh Research Explorer content complies with UK legislation. If you believe that the public display of this file breaches copyright please contact [email protected] providing details, and we will remove access to the work immediately and investigate your claim. Download date: 02. Oct. 2021 ARTICLE Received 16 Dec 2015 | Accepted 26 Apr 2016 | Published 25 May 2016 DOI: 10.1038/ncomms11729 OPEN Cox process representation and inference for stochastic reaction–diffusion processes David Schnoerr1,2,3, Ramon Grima1,3 & Guido Sanguinetti2,3 Complex behaviour in many systems arises from the stochastic interactions of spatially distributed particles or agents. Stochastic reaction–diffusion processes are widely used to model such behaviour in disciplines ranging from biology to the social sciences, yet they are notoriously difficult to simulate and calibrate to observational data.
    [Show full text]
  • Poisson Representations of Branching Markov and Measure-Valued
    The Annals of Probability 2011, Vol. 39, No. 3, 939–984 DOI: 10.1214/10-AOP574 c Institute of Mathematical Statistics, 2011 POISSON REPRESENTATIONS OF BRANCHING MARKOV AND MEASURE-VALUED BRANCHING PROCESSES By Thomas G. Kurtz1 and Eliane R. Rodrigues2 University of Wisconsin, Madison and UNAM Representations of branching Markov processes and their measure- valued limits in terms of countable systems of particles are con- structed for models with spatially varying birth and death rates. Each particle has a location and a “level,” but unlike earlier con- structions, the levels change with time. In fact, death of a particle occurs only when the level of the particle crosses a specified level r, or for the limiting models, hits infinity. For branching Markov pro- cesses, at each time t, conditioned on the state of the process, the levels are independent and uniformly distributed on [0,r]. For the limiting measure-valued process, at each time t, the joint distribu- tion of locations and levels is conditionally Poisson distributed with mean measure K(t) × Λ, where Λ denotes Lebesgue measure, and K is the desired measure-valued process. The representation simplifies or gives alternative proofs for a vari- ety of calculations and results including conditioning on extinction or nonextinction, Harris’s convergence theorem for supercritical branch- ing processes, and diffusion approximations for processes in random environments. 1. Introduction. Measure-valued processes arise naturally as infinite sys- tem limits of empirical measures of finite particle systems. A number of ap- proaches have been developed which preserve distinct particles in the limit and which give a representation of the measure-valued process as a transfor- mation of the limiting infinite particle system.
    [Show full text]
  • Poisson Processes Stochastic Processes
    Poisson Processes Stochastic Processes UC3M Feb. 2012 Exponential random variables A random variable T has exponential distribution with rate λ > 0 if its probability density function can been written as −λt f (t) = λe 1(0;+1)(t) We summarize the above by T ∼ exp(λ): The cumulative distribution function of a exponential random variable is −λt F (t) = P(T ≤ t) = 1 − e 1(0;+1)(t) And the tail, expectation and variance are P(T > t) = e−λt ; E[T ] = λ−1; and Var(T ) = E[T ] = λ−2 The exponential random variable has the lack of memory property P(T > t + sjT > t) = P(T > s) Exponencial races In what follows, T1;:::; Tn are independent r.v., with Ti ∼ exp(λi ). P1: min(T1;:::; Tn) ∼ exp(λ1 + ··· + λn) . P2 λ1 P(T1 < T2) = λ1 + λ2 P3: λi P(Ti = min(T1;:::; Tn)) = λ1 + ··· + λn P4: If λi = λ and Sn = T1 + ··· + Tn ∼ Γ(n; λ). That is, Sn has probability density function (λs)n−1 f (s) = λe−λs 1 (s) Sn (n − 1)! (0;+1) The Poisson Process as a renewal process Let T1; T2;::: be a sequence of i.i.d. nonnegative r.v. (interarrival times). Define the arrival times Sn = T1 + ··· + Tn if n ≥ 1 and S0 = 0: The process N(t) = maxfn : Sn ≤ tg; is called Renewal Process. If the common distribution of the times is the exponential distribution with rate λ then process is called Poisson Process of with rate λ. Lemma. N(t) ∼ Poisson(λt) and N(t + s) − N(s); t ≥ 0; is a Poisson process independent of N(s); t ≥ 0 The Poisson Process as a L´evy Process A stochastic process fX (t); t ≥ 0g is a L´evyProcess if it verifies the following properties: 1.
    [Show full text]
  • Local Conditioning in Dawson–Watanabe Superprocesses
    The Annals of Probability 2013, Vol. 41, No. 1, 385–443 DOI: 10.1214/11-AOP702 c Institute of Mathematical Statistics, 2013 LOCAL CONDITIONING IN DAWSON–WATANABE SUPERPROCESSES By Olav Kallenberg Auburn University Consider a locally finite Dawson–Watanabe superprocess ξ =(ξt) in Rd with d ≥ 2. Our main results include some recursive formulas for the moment measures of ξ, with connections to the uniform Brown- ian tree, a Brownian snake representation of Palm measures, continu- ity properties of conditional moment densities, leading by duality to strongly continuous versions of the multivariate Palm distributions, and a local approximation of ξt by a stationary clusterη ˜ with nice continuity and scaling properties. This all leads up to an asymptotic description of the conditional distribution of ξt for a fixed t> 0, given d that ξt charges the ε-neighborhoods of some points x1,...,xn ∈ R . In the limit as ε → 0, the restrictions to those sets are conditionally in- dependent and given by the pseudo-random measures ξ˜ orη ˜, whereas the contribution to the exterior is given by the Palm distribution of ξt at x1,...,xn. Our proofs are based on the Cox cluster representa- tions of the historical process and involve some delicate estimates of moment densities. 1. Introduction. This paper may be regarded as a continuation of [19], where we considered some local properties of a Dawson–Watanabe super- process (henceforth referred to as a DW-process) at a fixed time t> 0. Recall that a DW-process ξ = (ξt) is a vaguely continuous, measure-valued diffu- d ξtf µvt sion process in R with Laplace functionals Eµe− = e− for suitable functions f 0, where v = (vt) is the unique solution to the evolution equa- 1 ≥ 2 tion v˙ = 2 ∆v v with initial condition v0 = f.
    [Show full text]
  • The Maximum of a Random Walk Reflected at a General Barrier
    The Annals of Applied Probability 2006, Vol. 16, No. 1, 15–29 DOI: 10.1214/105051605000000610 c Institute of Mathematical Statistics, 2006 THE MAXIMUM OF A RANDOM WALK REFLECTED AT A GENERAL BARRIER By Niels Richard Hansen University of Copenhagen We define the reflection of a random walk at a general barrier and derive, in case the increments are light tailed and have negative mean, a necessary and sufficient criterion for the global maximum of the reflected process to be finite a.s. If it is finite a.s., we show that the tail of the distribution of the global maximum decays exponentially fast and derive the precise rate of decay. Finally, we discuss an example from structural biology that motivated the interest in the reflection at a general barrier. 1. Introduction. The reflection of a random walk at zero is a well-studied process with several applications. We mention the interpretation from queue- ing theory—for a suitably defined random walk—as the waiting time until service for a customer at the time of arrival; see, for example, [1]. Another important application arises in molecular biology in the context of local com- parison of two finite sequences. To evaluate the significance of the findings from such a comparison, one needs to study the distribution of the locally highest scoring segment from two independent i.i.d. sequences, as shown in [8], which equals the distribution of the maximum of a random walk reflected at zero. The global maximum of a random walk with negative drift and, in par- ticular, the probability that the maximum exceeds a high value have also been studied in details.
    [Show full text]
  • Renewal Theory for Uniform Random Variables
    California State University, San Bernardino CSUSB ScholarWorks Theses Digitization Project John M. Pfau Library 2002 Renewal theory for uniform random variables Steven Robert Spencer Follow this and additional works at: https://scholarworks.lib.csusb.edu/etd-project Part of the Mathematics Commons Recommended Citation Spencer, Steven Robert, "Renewal theory for uniform random variables" (2002). Theses Digitization Project. 2248. https://scholarworks.lib.csusb.edu/etd-project/2248 This Thesis is brought to you for free and open access by the John M. Pfau Library at CSUSB ScholarWorks. It has been accepted for inclusion in Theses Digitization Project by an authorized administrator of CSUSB ScholarWorks. For more information, please contact [email protected]. RENEWAL THEORY FOR UNIFORM RANDOM VARIABLES A Thesis Presented to the Faculty of California State University, San Bernardino In Partial Fulfillment of the Requirements for the Degree Master of Arts in Mathematics by Steven Robert Spencer March 2002 RENEWAL THEORY FOR UNIFORM RANDOM VARIABLES A Thesis Presented to the Faculty of California State University, San Bernardino by Steven Robert Spencer March 2002 Approved by: Charles Stanton, Advisor, Mathematics Date Yuichiro Kakihara Terry Hallett j. Peter Williams, Chair Terry Hallett, Department of Mathematics Graduate Coordinator Department of Mathematics ABSTRACT The thesis answers the question, "How many times must you change a light-bulb in a month if the life-time- of any one light-bulb is anywhere from zero to one month in length?" This involves uniform random variables on the - interval [0,1] which must be summed to give expected values for the problem. The results of convolution calculations for both the uniform and exponential distributions of random variables give expected values that are in accordance with the Elementary Renewal Theorem and renewal function.
    [Show full text]
  • Cox Process Functional Learning Gérard Biau, Benoît Cadre, Quentin Paris
    Cox process functional learning Gérard Biau, Benoît Cadre, Quentin Paris To cite this version: Gérard Biau, Benoît Cadre, Quentin Paris. Cox process functional learning. Statistical Inference for Stochastic Processes, Springer Verlag, 2015, 18 (3), pp.257-277. 10.1007/s11203-015-9115-z. hal- 00820838 HAL Id: hal-00820838 https://hal.archives-ouvertes.fr/hal-00820838 Submitted on 6 May 2013 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Cox Process Learning G´erard Biau Universit´ePierre et Marie Curie1 & Ecole Normale Sup´erieure2, France [email protected] Benoˆıt Cadre IRMAR, ENS Cachan Bretagne, CNRS, UEB, France3 [email protected] Quentin Paris IRMAR, ENS Cachan Bretagne, CNRS, UEB, France [email protected] Abstract This article addresses the problem of supervised classification of Cox process trajectories, whose random intensity is driven by some exoge- nous random covariable. The classification task is achieved through a regularized convex empirical risk minimization procedure, and a nonasymptotic oracle inequality is derived. We show that the algo- rithm provides a Bayes-risk consistent classifier. Furthermore, it is proved that the classifier converges at a rate which adapts to the un- known regularity of the intensity process.
    [Show full text]
  • Spatio-Temporal Cluster Detection and Local Moran Statistics of Point Processes
    Old Dominion University ODU Digital Commons Mathematics & Statistics Theses & Dissertations Mathematics & Statistics Spring 2019 Spatio-Temporal Cluster Detection and Local Moran Statistics of Point Processes Jennifer L. Matthews Old Dominion University Follow this and additional works at: https://digitalcommons.odu.edu/mathstat_etds Part of the Applied Statistics Commons, and the Biostatistics Commons Recommended Citation Matthews, Jennifer L.. "Spatio-Temporal Cluster Detection and Local Moran Statistics of Point Processes" (2019). Doctor of Philosophy (PhD), Dissertation, Mathematics & Statistics, Old Dominion University, DOI: 10.25777/3mps-rk62 https://digitalcommons.odu.edu/mathstat_etds/46 This Dissertation is brought to you for free and open access by the Mathematics & Statistics at ODU Digital Commons. It has been accepted for inclusion in Mathematics & Statistics Theses & Dissertations by an authorized administrator of ODU Digital Commons. For more information, please contact [email protected]. ABSTRACT Approved for public release; distribution is unlimited SPATIO-TEMPORAL CLUSTER DETECTION AND LOCAL MORAN STATISTICS OF POINT PROCESSES Jennifer L. Matthews Commander, United States Navy Old Dominion University, 2019 Director: Dr. Norou Diawara Moran's index is a statistic that measures spatial dependence, quantifying the degree of dispersion or clustering of point processes and events in some location/area. Recognizing that a single Moran's index may not give a sufficient summary of the spatial autocorrelation measure, a local
    [Show full text]
  • Log Gaussian Cox Processes
    Log Gaussian Cox processes by Jesper Møller, Anne Randi Syversveen, and Rasmus Plenge Waagepetersen. Log Gaussian Cox processes JESPER MØLLER Aalborg University ANNE RANDI SYVERSVEEN The Norwegian University of Science and Technology RASMUS PLENGE WAAGEPETERSEN University of Aarhus ABSTRACT. Planar Cox processes directed by a log Gaussian intensity process are investigated in the univariate and multivariate cases. The appealing properties of such models are demonstrated theoretically as well as through data examples and simulations. In particular, the first, second and third-order properties are studied and utilized in the statistical analysis of clustered point patterns. Also empirical Bayesian inference for the underlying intensity surface is considered. Key words: empirical Bayesian inference; ergodicity; Markov chain Monte Carlo; Metropolis-adjusted Langevin algorithm; multivariate Cox processes; Neyman-Scott processes; pair correlation function; parameter estimation; spatial point processes; third- order properties. AMS 1991 subject classification: Primary 60G55, 62M30. Secondary 60D05. 1 Introduction Cox processes provide useful and frequently applied models for aggregated spatial point patterns where the aggregation is due to a stochastic environmental heterogeneity, see e.g. Diggle (1983), Cressie (1993), Stoyan et al. (1995), and the references therein. A Cox process is ’doubly stochastic’ as it arises as an inhomogeneous Poisson process with a random intensity measure. The random intensity measure is often specified by a random intensity function or as we prefer to call it an intensity process or surface. There may indeed be other sources of aggregation in a spatial point pattern than spatial heterogeneity. Cluster processes is a well-known class of models where clusters are generated by an unseen point process, cf.
    [Show full text]
  • Central Limit Theorem for Supercritical Binary Homogeneous Crump-Mode
    Central limit theorem for supercritical binary homogeneous Crump-Mode-Jagers processes Benoit Henry1,2 Abstract We consider a supercritical general branching population where the lifetimes of individuals are i.i.d. with arbitrary distribution and each individual gives birth to new individuals at Poisson times independently from each others. The population counting process of such population is a known as binary homogeneous Crump-Jargers-Mode process. It is known that such processes converges almost surely when correctly renormalized. In this paper, we study the error of this convergence. To this end, we use classical renewal theory and recent works [17, 6, 5] on this model to obtain the moments of the error. Then, we can precisely study the asymptotic behaviour of these moments thanks to L´evy processes theory. These results in conjunction with a new decomposition of the splitting trees allow us to obtain a central limit theorem. MSC 2000 subject classifications: Primary 60J80; secondary 92D10, 60J85, 60G51, 60K15, 60F05. Key words and phrases. branching process – splitting tree – Crump–Mode–Jagers process – linear birth–death process – L´evy processes – scale function – Central Limit Theorem. 1 Introduction In this work, we consider a general branching population where individuals live and reproduce inde- pendently from each other. Their lifetimes follow an arbitrary distribution PV and the births occur at Poisson times with constant rate b. The genealogical tree induced by this population is called a arXiv:1509.06583v2 [math.PR] 18 Nov 2016 splitting tree [11, 10, 17] and is of main importance in the study of the model. The population counting process Nt (giving the number of living individuals at time t) is a binary homogeneous Crump-Mode-Jagers (CMJ) process.
    [Show full text]
  • Cox Process Representation and Inference for Stochastic Reaction&Ndash
    ARTICLE Received 16 Dec 2015 | Accepted 26 Apr 2016 | Published 25 May 2016 DOI: 10.1038/ncomms11729 OPEN Cox process representation and inference for stochastic reaction–diffusion processes David Schnoerr1,2,3, Ramon Grima1,3 & Guido Sanguinetti2,3 Complex behaviour in many systems arises from the stochastic interactions of spatially distributed particles or agents. Stochastic reaction–diffusion processes are widely used to model such behaviour in disciplines ranging from biology to the social sciences, yet they are notoriously difficult to simulate and calibrate to observational data. Here we use ideas from statistical physics and machine learning to provide a solution to the inverse problem of learning a stochastic reaction–diffusion process from data. Our solution relies on a non-trivial connection between stochastic reaction–diffusion processes and spatio-temporal Cox processes, a well-studied class of models from computational statistics. This connection leads to an efficient and flexible algorithm for parameter inference and model selection. Our approach shows excellent accuracy on numeric and real data examples from systems biology and epidemiology. Our work provides both insights into spatio-temporal stochastic systems, and a practical solution to a long-standing problem in computational modelling. 1 School of Biological Sciences, University of Edinburgh, Edinburgh EH9 3JH, UK. 2 School of Informatics, University of Edinburgh, Edinburgh EH8 9AB, UK. 3 SynthSys, University of Edinburgh, Edinburgh EH9 3JD, UK. Correspondence and requests for materials should be addressed to G.S. (email: [email protected]). NATURE COMMUNICATIONS | 7:11729 | DOI: 10.1038/ncomms11729 | www.nature.com/naturecommunications 1 ARTICLE NATURE COMMUNICATIONS | DOI: 10.1038/ncomms11729 any complex behaviours in several disciplines originate process in terms of (stochastic) partial differential equations from a common mechanism: the dynamics of locally (SPDEs).
    [Show full text]
  • Applications of Renewal Theory to Pattern Analysis
    Rochester Institute of Technology RIT Scholar Works Theses 4-18-2016 Applications of Renewal Theory to Pattern Analysis Hallie L. Kleiner [email protected] Follow this and additional works at: https://scholarworks.rit.edu/theses Recommended Citation Kleiner, Hallie L., "Applications of Renewal Theory to Pattern Analysis" (2016). Thesis. Rochester Institute of Technology. Accessed from This Thesis is brought to you for free and open access by RIT Scholar Works. It has been accepted for inclusion in Theses by an authorized administrator of RIT Scholar Works. For more information, please contact [email protected]. APPLICATIONS OF RENEWAL THEORY TO PATTERN ANALYSIS by Hallie L. Kleiner A Thesis Submitted in Partial Fulfillment of the Requirements for the Degree of Master of Science in Applied Mathematics School of Mathematical Sciences, College of Science Rochester Institute of Technology Rochester, NY April 18, 2016 Committee Approval: Dr. James Marengo Date School of Mathematical Sciences Thesis Advisor Dr. Bernard Brooks Date School of Mathematical Sciences Committee Member Dr. Manuel Lopez Date School of Mathematical Sciences Committee Member Dr. Elizabeth Cherry Date School of Mathematical Sciences Director of Graduate Programs RENEWAL THEORY ON PATTERN ANALYSIS Abstract In this thesis, renewal theory is used to analyze patterns of outcomes for discrete random variables. We start by introducing the concept of a renewal process and by giving some examples. It is then shown that we may obtain the distribution of the number of renewals by time t and compute its expectation, the renewal function. We then proceed to state and illustrate the basic limit theorems for renewal processes and make use of Wald’s equation to give a proof of the Elementary Renewal Theorem.
    [Show full text]