Approximate Probability Distributions of the Master Equation

Total Page:16

File Type:pdf, Size:1020Kb

Approximate Probability Distributions of the Master Equation Approximate probability distributions of the master equation Philipp Thomas∗ School of Mathematics and School of Biological Sciences, University of Edinburgh Ramon Grimay School of Biological Sciences, University of Edinburgh Master equations are common descriptions of mesoscopic systems. Analytical solutions to these equations can rarely be obtained. We here derive an analytical approximation of the time-dependent probability distribution of the master equation using orthogonal polynomials. The solution is given in two alternative formulations: a series with continuous and a series with discrete support both of which can be systematically truncated. While both approximations satisfy the system size expansion of the master equation, the continuous distribution approximations become increasingly negative and tend to oscillations with increasing truncation order. In contrast, the discrete approximations rapidly converge to the underlying non-Gaussian distributions. The theory is shown to lead to particularly simple analytical expressions for the probability distributions of molecule numbers in metabolic reactions and gene expression systems. I. INTRODUCTION first few moments [12{14]; alternative methods are based on moment closure [15]. It is however the case that the Master equations are commonly used to describe fluc- knowledge of a limited number of moments does not al- tuations of particulate systems. In most instances, how- low to uniquely determine the underlying distribution ever, the number of reachable states is so large that their functions. Reconstruction of the probability distribution combinatorial complexity prevents one from obtaining therefore requires additional approximations such as the analytical solutions to these equations. Explicit solutions maximum entropy principle [16] or the truncated moment are known only for certain classes of linear birth-death generating function [17] which generally yield different processes [1], under detailed balance conditions [2], or results. While the accuracy of these repeated approxi- for particularly simple examples in stationary conditions mations remains unknown, analytical expressions for the [3]. Considerable effort has been undertaken to approx- probability density can rarely be obtained, or might not imate the solution of the master equation under more even exist [18]. A systematic investigation of the distri- general conditions including time-dependence and condi- butions implied by the higher order terms in the SSE, tions lacking detailed balance [4, 5]. without resorting to moments, is therefore still missing. A common technique addressing this issue was given We here analytically derive, for the first time, a closed- by van Kampen in terms of the system size expansion form series expansion of the probability distribution un- (SSE) [6]. The method assumes the existence of a spe- derlying the master equation. We proceed by outlining cific parameter, termed the system size, for which the the expansion of the master equation in Section I and master equation approaches a deterministic limit as its briefly review the solution of the leading order terms value is taken to infinity. The leading order term of this given by the LNA in Section II. While commonly the expansion describes small fluctuations about this limit SSE is truncated at this point, we show that the higher in terms of a Gaussian probability density, called the order terms can be obtained using an asymptotic expan- linear noise approximation (LNA). This approximation sion of the continuous probability density. The resulting has been widely applied in biochemical kinetics [7], but series is given in terms orthogonal polynomials and can also in the theory of polymer assembly [8], epidemics [9], be truncated systematically to any desired order in the economics [10], and machine learning [11]. The benefit inverse system size. Analytical expressions are given for of the LNA is that it yields generic expressions for the the expansion coefficients. probability density. Its deficiency lies in the fact that, Thereby we establish two alternative formulations of strictly speaking, it is valid only in the limit of infinite this expansion: a continuous and a discrete one both sat- system size. Hence one generally suspects that its pre- isfying the expansion of the master equation. We show arXiv:1411.3551v2 [cond-mat.stat-mech] 2 Oct 2015 dictions become inaccurate when one studies fluctuations that for linear birth-death processes, the continuous ap- that are not too small compared to the mean and there- proximation often fails to converge reasonably fast. In fore implying non-Gaussian statistics. contrast, the discrete approximation introduced in Sec- Higher order terms in the SSE have been employed to tion III accurately converges to the true distribution with calculate non-Gaussian corrections to the LNA for the increasing truncation order. In Section IV, we show that for nonlinear birth-death processes, renormalization is required for achieving rapid convergence of the series. Our analysis is motivated by the use of simple examples ∗ [email protected] throughout. Using a common model of gene expression, y [email protected] we conclude in Section VI that the new method allows to 2 predict the full time-dependence of the molecule number explicitly on Ω. We assume that the propensity possesses distribution. a power series in the inverse volume 1 X γ (Ω[X]; Ω) = Ω Ω−sf (s) ([X]) : (6) II. SYSTEM SIZE EXPANSION r r s=0 As a starting point, we focus on the master equation For mass-action kinetics, for instance, the propensity is 1−`r n given by γr(n; Ω) = Ω kr`r! , where `r is the re- formulation of biochemical kinetics. We therefore con- `r sider a set of R chemical reactions involving a single action order of the rth reaction. Using the Taylor ex- (0) species confined in a well-mixed volume Ω. Note that pansion of the binomial coefficient, we have fr ([X]) = (s) (s) for chemical systems the system size coincides with the `r `r −s kr[X] , fr ([X]) = kr[X] S`r ;`r −s, and fr = 0 for reaction volume. We denote by Sr the net-change in the s ≥ `r, where S denotes the Stirling numbers of the first th molecule numbers in the r reaction and by γr(n; Ω) the kind. Note also that effective propensities being deduced probability per unit time for this reaction to occur. The from mass action kinetics have an expansion similar to probability of finding n molecules in the volume Ω at time Eq. (6). The Michaelis-Menten propensity γr(n; Ω) = t, denoted by P (n; t), then obeys the master equation n (0) [X] Ωkr n+KΩ [19], for instance, has fr ([X]) = kr [X]+K (s) and fr ([X]) = 0 for s > 0. R dP (n; t) X Substituting now Eqs. (3-6) into Eq. (1) and rearrang- = E−Sr − 1 γ (n; Ω) P (n; t); (1) dt r ing the result in powers of Ω−1=2, we find r=1 where E−Sr is the step operator defined as E−Sr g(n) = @ d[X] @ − Ω1=2 Π(, t) g(n − Sr) for any function g(n) of the molecule numbers @t dt @ [6]. Note that throughout the article, deterministic initial R N conditions are assumed. The system size expansion now X @ X = −Ω1=2 S f (0)([X]) + Ω−k=2L Π(, t) proceeds by separating the instantaneous concentration r r @ k into a deterministic part, given by the solution of the rate r=1 k=0 −(N+1)=2 equations [X], and a fluctuating part , + O(Ω ): (7) Equating terms to order Ω1=2 yields the deterministic n = [X] + Ω−1=2, (2) rate equation Ω which is van Kampen's ansatz. The expansion of the R d[X] X master equation can be summarized in three steps: = S f (0)([X]): (8) dt r r (i) Using Eq. (2) one expands the step operator r=1 −Sr The higher order terms in the expansion of the master E γr (n; Ω) P (n; t) = γr (n − Sr; Ω) P (n − Sr; t) −1=2 equation can be written out explicitly −Ω Sr @ 1=2 1=2 = e γr(Ω[X] + Ω , Ω)P (Ω[X] + Ω , t); dk=2e k−2(s−1) k−p−2(s−1) (3) X X Dp;s L = (−@ )pk−p−2(s−1); k p!(k − p − 2(s − 1))! @ s=0 p=1 where @ denotes @ . (ii) Next, the probability for the molecule numbers is (9) cast into a probability density Π(, t) for the fluctuations where d·e denotes the ceiling value and the coefficients using van Kampen's ansatz, are given by 1=2 1=2 Π(, t) = Ω P (Ω[X] + Ω , t); (4) R X Dq = (S )p@q f (s)([X]); (10) which is essentially a change of variables. Note that p;s r [X] r this step implicitly assumes a continuous approximation r=1 Π(, t) of the probability distribution as thought in the which depend explicitly on the solution of the rate equa- original derivation of van Kampen [6]. tion (8). Note that in the following the abbreviation q q (iii) It remains to expand the propensity about the Dp = Dp;0 is used. deterministic limit 1 k k X @ γr(Ω[X]; Ω) III. EXPANSION OF THE CONTINUOUS γ (Ω[X] + Ω1=2, Ω) = Ω−k=2 : (5) r k! @[X]k PROBABILITY DENSITY k=0 Note that γr(Ω[X]; Ω) is just the propensity evaluated at We here study the time-dependent solution of the par- the macroscopic concentration and hence it must depend tial differential equation approximation of the master 3 equation, Eq. (7). We therefore expand the probabil- ity density of Eq. (4), @ − L Ψ = λ Ψ ; (16) @t 0 m m m N X −j=2 −(N+1)=2 Π(, t) = Ω πj(, t) + O(Ω ); (11) which is solved by λm = −mJ and Ψm = m(, t)π0(, t) j=0 with which also allows the expansion of the time-dependent moments to be deduced in closed-form.
Recommended publications
  • The Effect of Compression and Expansion on Stochastic Reaction Networks
    IMT School for Advanced Studies, Lucca Lucca, Italy The Effect of Compression and Expansion on Stochastic Reaction Networks PhD Program in Institutions, Markets and Technologies Curriculum in Computer Science and Systems Engineering (CSSE) XXXI Cycle By Tabea Waizmann 2021 The dissertation of Tabea Waizmann is approved. Program Coordinator: Prof. Rocco De Nicola, IMT Lucca Supervisor: Prof. Mirco Tribastone, IMT Lucca The dissertation of Tabea Waizmann has been reviewed by: Dr. Catia Trubiani, Gran Sasso Science Institute Prof. Michele Loreti, University of Camerino IMT School for Advanced Studies, Lucca 2021 To everyone who believed in me. Contents List of Figures ix List of Tables xi Acknowledgements xiii Vita and Publications xv Abstract xviii 1 Introduction 1 2 Background 6 2.1 Multisets . .6 2.2 Reaction Networks . .7 2.3 Ordinary Lumpability . 11 2.4 Layered Queuing Networks . 12 2.5 PEPA . 16 3 Coarse graining mass-action stochastic reaction networks by species equivalence 19 3.1 Species Equivalence . 20 3.1.1 Species equivalence as a generalization of Markov chain ordinary lumpability . 27 3.1.2 Characterization of SE for mass-action networks . 27 3.1.3 Computation of the maximal SE and reduced net- work . 28 vii 3.2 Applications . 31 3.2.1 Computational systems biology . 31 3.2.2 Epidemic processes in networks . 33 3.3 Discussion . 36 4 DiffLQN: Differential Equation Analysis of Layered Queuing Networks 37 4.1 DiffLQN .............................. 38 4.1.1 Architecture . 38 4.1.2 Capabilities . 38 4.1.3 Syntax . 39 4.2 Case Study: Client-Server dynamics . 41 4.3 Discussion .
    [Show full text]
  • Intrinsic Noise Analyzer: a Software Package for the Exploration of Stochastic Biochemical Kinetics Using the System Size Expansion
    Intrinsic Noise Analyzer: A Software Package for the Exploration of Stochastic Biochemical Kinetics Using the System Size Expansion Philipp Thomas1,2,3., Hannes Matuschek4., Ramon Grima1,2* 1 School of Biological Sciences, University of Edinburgh, Edinburgh, United Kingdom, 2 SynthSys Edinburgh, University of Edinburgh, Edinburgh, United Kingdom, 3 Department of Physics, Humboldt University of Berlin, Berlin, Germany, 4 Institute of Physics and Astronomy, University of Potsdam, Potsdam, Germany Abstract The accepted stochastic descriptions of biochemical dynamics under well-mixed conditions are given by the Chemical Master Equation and the Stochastic Simulation Algorithm, which are equivalent. The latter is a Monte-Carlo method, which, despite enjoying broad availability in a large number of existing software packages, is computationally expensive due to the huge amounts of ensemble averaging required for obtaining accurate statistical information. The former is a set of coupled differential-difference equations for the probability of the system being in any one of the possible mesoscopic states; these equations are typically computationally intractable because of the inherently large state space. Here we introduce the software package intrinsic Noise Analyzer (iNA), which allows for systematic analysis of stochastic biochemical kinetics by means of van Kampen’s system size expansion of the Chemical Master Equation. iNA is platform independent and supports the popular SBML format natively. The present implementation is the first to adopt a complementary approach that combines state-of-the-art analysis tools using the computer algebra system Ginac with traditional methods of stochastic simulation. iNA integrates two approximation methods based on the system size expansion, the Linear Noise Approximation and effective mesoscopic rate equations, which to-date have not been available to non-expert users, into an easy-to-use graphical user interface.
    [Show full text]
  • System Size Expansion Using Feynman Rules and Diagrams
    System size expansion using Feynman rules and diagrams Philipp Thomas∗y, Christian Fleck,z Ramon Grimay, Nikola Popovi´c∗ October 2, 2018 Abstract Few analytical methods exist for quantitative studies of large fluctuations in stochastic systems. In this article, we develop a simple diagrammatic approach to the Chemical Master Equation that allows us to calculate multi-time correlation functions which are accurate to a any desired order in van Kampen's system size expansion. Specifically, we present a set of Feynman rules from which this diagrammatic perturbation expansion can be constructed algo- rithmically. We then apply the methodology to derive in closed form the leading order corrections to the linear noise approximation of the intrinsic noise power spectrum for general biochemical reaction networks. Finally, we illustrate our results by describing noise-induced oscillations in the Brusselator reaction scheme which are not captured by the common linear noise approximation. 1 Introduction The quantification of intrinsic fluctuations in biochemical networks is becoming increasingly important for the study of living systems, as some of the key molecular players are expressed in low numbers of molecules per cell [1]. The most commonly employed method for investigating this type of cell-to-cell variability is the stochastic simulation algorithm (SSA) [2]. While the SSA allows for the exact sampling of trajectories of discrete intracellular biochemistry, it is computationally expensive, which often prevents one from obtaining statistics for large ranges of the biological parameter space. A widely used approach to overcome these limitations has been the linear noise approximation (LNA) [3, 4, 5]. The LNA is obtained to leading order in van Kampen's system size expansion [6].
    [Show full text]
  • How Reliable Is the Linear Noise Approximation Of
    Thomas et al. BMC Genomics 2013, 14(Suppl 4):S5 http://www.biomedcentral.com/1471-2164/14/S4/S5 RESEARCH Open Access How reliable is the linear noise approximation of gene regulatory networks? Philipp Thomas1,2, Hannes Matuschek3, Ramon Grima1* From IEEE International Conference on Bioinformatics and Biomedicine 2012 Philadelphia, PA, USA. 4-7 October 2012 Abstract Background: The linear noise approximation (LNA) is commonly used to predict how noise is regulated and exploited at the cellular level. These predictions are exact for reaction networks composed exclusively of first order reactions or for networks involving bimolecular reactions and large numbers of molecules. It is however well known that gene regulation involves bimolecular interactions with molecule numbers as small as a single copy of a particular gene. It is therefore questionable how reliable are the LNA predictions for these systems. Results: We implement in the software package intrinsic Noise Analyzer (iNA), a system size expansion based method which calculates the mean concentrations and the variances of the fluctuations to an order of accuracy higher than the LNA. We then use iNA to explore the parametric dependence of the Fano factors and of the coefficients of variation of the mRNA and protein fluctuations in models of genetic networks involving nonlinear protein degradation, post-transcriptional, post-translational and negative feedback regulation. We find that the LNA can significantly underestimate the amplitude and period of noise-induced oscillations in genetic oscillators. We also identify cases where the LNA predicts that noise levels can be optimized by tuning a bimolecular rate constant whereas our method shows that no such regulation is possible.
    [Show full text]
  • Computation of Biochemical Pathway Fluctuations Beyond the Linear Noise Approximation Using
    Computation of biochemical pathway fluctuations beyond the linear noise approximation using iNA Philipp Thomas∗†‡ ¶, Hannes Matuschek§¶ and Ramon Grima∗† ∗School of Biological Sciences, University of Edinburgh, Edinburgh, United Kingdom †SynthSys Edinburgh, University of Edinburgh, Edinburgh, United Kingdom ‡Department of Physics, Humboldt University of Berlin, Berlin, Germany §Institute of Physics and Astronomy, University of Potsdam, Potsdam, Germany ¶These authors contributed equally. Abstract—The linear noise approximation is commonly used the first software package enabling a fluctuation analysis of to obtain intrinsic noise statistics for biochemical networks. biochemical networks via the Linear Noise Approximation These estimates are accurate for networks with large numbers (LNA) and Effective Mesoscopic Rate Equation (EMRE) of molecules. However it is well known that many biochemical networks are characterized by at least one species with a approximations of the CME. The former gives the variance small number of molecules. We here describe version 0.3 of and covariance of concentration fluctuations in the limit of the software intrinsic Noise Analyzer (iNA) which allows for large molecule numbers while the latter gives the mean accurate computation of noise statistics over wide ranges of concentrations for intermediate to large molecule numbers molecule numbers. This is achieved by calculating the next and is more accurate than the conventional Rate Equations order corrections to the linear noise approximation’s estimates of variance and covariance of concentration fluctuations. The (REs). efficiency of the methods is significantly improved by auto- In this proceeding we develop and efficiently implement mated just-in-time compilation using the LLVM framework in iNA, the Inverse Omega Square (IOS) method comple- leading to a fluctuation analysis which typically outperforms menting the EMRE method by providing estimates for the that obtained by means of exact stochastic simulations.
    [Show full text]
  • Stochastic Analysis of Biochemical Systems
    ON MOMENTS AND TIMING { STOCHASTIC ANALYSIS OF BIOCHEMICAL SYSTEMS by Khem Raj Ghusinga A dissertation submitted to the Faculty of the University of Delaware in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Electrical and Computer Engineering Summer 2018 c 2018 Khem Raj Ghusinga All Rights Reserved ON MOMENTS AND TIMING { STOCHASTIC ANALYSIS OF BIOCHEMICAL SYSTEMS by Khem Raj Ghusinga Approved: Kenneth E. Barner, Ph.D. Chair of the Department of Electrical and Computer Engineering Approved: Babatunde Ogunnaike, Ph.D. Dean of the College of Engineering Approved: Ann L. Ardis, Ph.D. Senior Vice Provost for Graduate and Professional Education I certify that I have read this dissertation and that in my opinion it meets the academic and professional standard required by the University as a dissertation for the degree of Doctor of Philosophy. Signed: Abhyudai Singh, Ph.D. Professor in charge of dissertation I certify that I have read this dissertation and that in my opinion it meets the academic and professional standard required by the University as a dissertation for the degree of Doctor of Philosophy. Signed: Ryan Zurakowski, Ph.D. Member of dissertation committee I certify that I have read this dissertation and that in my opinion it meets the academic and professional standard required by the University as a dissertation for the degree of Doctor of Philosophy. Signed: Gonzalo R. Arce, Ph.D. Member of dissertation committee I certify that I have read this dissertation and that in my opinion it meets the academic and professional standard required by the University as a dissertation for the degree of Doctor of Philosophy.
    [Show full text]
  • Nonequilibrium Critical Phenomena: Exact Langevin Equations, Erosion of Tilted Landscapes
    Nonequilibrium critical phenomena : exact Langevin equations, erosion of tilted landscapes. Charlie Duclut To cite this version: Charlie Duclut. Nonequilibrium critical phenomena : exact Langevin equations, erosion of tilted landscapes.. Physics [physics]. Université Pierre et Marie Curie - Paris VI, 2017. English. NNT : 2017PA066241. tel-01690438 HAL Id: tel-01690438 https://tel.archives-ouvertes.fr/tel-01690438 Submitted on 23 Jan 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. UNIVERSITÉ PIERRE ET MARIE CURIE ÉCOLE DOCTORALE PHYSIQUE EN ÎLE-DE-FRANCE THÈSE pour obtenir le titre de Docteur de l’Université Pierre et Marie Curie Mention : PHYSIQUE THÉORIQUE Présentée et soutenue par Charlie DUCLUT Nonequilibrium critical phenomena: exact Langevin equations, erosion of tilted landscapes. Thèse dirigée par Bertrand DELAMOTTE préparée au Laboratoire de Physique Théorique de la Matière Condensée soutenue le 11 septembre 2017 devant le jury composé de : M. Andrea GAMBASSI Rapporteur M. Michael SCHERER Rapporteur M. Giulio BIROLI Examinateur Mme Leticia CUGLIANDOLO Présidente du jury M. Andrei FEDORENKO Examinateur M. Bertrand DELAMOTTE Directeur de thèse Remerciements First of all, I would like to thank the referees Andrea Gambassi and Michael Scherer for taking the time to carefully read the manuscript.
    [Show full text]
  • An Alternative Route to the System-Size Expansion
    Home Search Collections Journals About Contact us My IOPscience An alternative route to the system-size expansion This content has been downloaded from IOPscience. Please scroll down to see the full text. 2017 J. Phys. A: Math. Theor. 50 395003 (http://iopscience.iop.org/1751-8121/50/39/395003) View the table of contents for this issue, or go to the journal homepage for more Download details: IP Address: 129.215.109.91 This content was downloaded on 05/09/2017 at 12:10 Please note that terms and conditions apply. You may also be interested in: Symmetry and Collective Fluctuations in Evolutionary Games: Symmetry and collective fluctuations: large deviations and scaling in population processes E Smith and S Krishnamurthy Approximation and inference methods for stochastic biochemical kinetics—a tutorial review David Schnoerr, Guido Sanguinetti and Ramon Grima System size expansion using Feynman rules and diagrams Philipp Thomas, Christian Fleck, Ramon Grima et al. Master equations and the theory of stochastic path integrals Markus F Weber and Erwin Frey Stochastic switching in biology: from genotype to phenotype Paul C Bressloff Multi-compartment linear noise approximation Joseph D Challenger, Alan J McKane and Jürgen Pahle Modeling stochasticity in biochemical reaction networks P H Constantino, M Vlysidis, P Smadbeck et al. Fundamentals of higher order stochastic equations P D Drummond How limit cycles and quasi-cycles are related in systems with intrinsic noise Richard P Boland, Tobias Galla and Alan J McKane IOP Journal of Physics A: Mathematical and Theoretical J. Phys. A: Math. Theor. Journal of Physics A: Mathematical and Theoretical J.
    [Show full text]
  • How Reliable Is the Linear Noise Approximation of Gene Regulatory Networks?
    Mathematisch-Naturwissenschaftliche Fakultät Philipp Thomas | Hannes Matuschek | Ramon Grima How reliable is the linear noise approximation of gene regulatory networks? Suggested citation referring to the original publication: BMC Genomics 14 (2013) S5 DOI https://doi.org/10.1186/1471-2164-14-S4-S5 ISSN (online) 1471-2164 Postprint archived at the Institutional Repository of the Potsdam University in: Postprints der Universität Potsdam Mathematisch-Naturwissenschaftliche Reihe ; 876 ISSN 1866-8372 https://nbn-resolving.org/urn:nbn:de:kobv:517-opus4-435028 DOI https://doi.org/10.25932/publishup-43502 Thomas et al. BMC Genomics 2013, 14(Suppl 4):S5 http://www.biomedcentral.com/1471-2164/14/S4/S5 RESEARCH Open Access How reliable is the linear noise approximation of gene regulatory networks? Philipp Thomas1,2, Hannes Matuschek3, Ramon Grima1* From IEEE International Conference on Bioinformatics and Biomedicine 2012 Philadelphia, PA, USA. 4-7 October 2012 Abstract Background: The linear noise approximation (LNA) is commonly used to predict how noise is regulated and exploited at the cellular level. These predictions are exact for reaction networks composed exclusively of first order reactions or for networks involving bimolecular reactions and large numbers of molecules. It is however well known that gene regulation involves bimolecular interactions with molecule numbers as small as a single copy of a particular gene. It is therefore questionable how reliable are the LNA predictions for these systems. Results: We implement in the software package intrinsic Noise Analyzer (iNA), a system size expansion based method which calculates the mean concentrations and the variances of the fluctuations to an order of accuracy higher than the LNA.
    [Show full text]
  • Optimal Experimental Design Applied to Models of Microbial Gene Regulation
    Optimal Experimental Design Applied to Models of Microbial Gene Regulation by Nathan Braniff A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Doctor of Philosophy in Applied Mathematics Waterloo, Ontario, Canada, 2020 c Nathan Braniff 2020 Examining Committee Membership The following served on the Examining Committee for this thesis. The decision of the Examining Committee is by majority vote. External Examiner: Julio Banga Professor, IIM-CISC Supervisor: Brian Ingalls Professor, Applied Mathematics, University of Waterloo Internal Members: Matt Scott Assoc. Professor, Applied Mathematics, University of Waterloo Kirsten Morris Professor, Applied Mathematics, University of Waterloo Internal-External Member: Trevor Charles Professor, Biology, University of Waterloo ii Authour's Declaration This thesis consists of material all of which I authored or co-authored: see Statement of Contributions included in the thesis. This is a true copy of the thesis, including any required final revisions, as accepted by my examiners. I understand that my thesis may be made electronically available to the public. iii Statement of Contributions Chapters1,2,7,&8 : I am the sole author of this material, under the supervision of Brian Ingalls. This material has not been previously published. Chapter3 : This material has been previously published as: \New opportunities for optimal design of dynamic experiments in systems and synthetic biology" by Nathan Braniff, and Brian Ingalls in Current Opinion in Systems Biology 9 (2018): 42-48 I co-authored this manuscript with Brian Ingalls. My contribution was gathering the candidate references and in selecting the initial areas of focus for the article.
    [Show full text]
  • Arxiv:1810.05368V2 [Q-Bio.PE] 20 Feb 2019 a Rusaeemergent, Are Groups Mal .Introduction 1
    Deriving mesoscopic models of collective behaviour for finite populations Jitesh Jhawar1 , Richard G. Morris2, Vishwesha Guttal1 1. Centre for Ecological Sciences, Indian Institute of Science, Bengaluru, 560012 2. National Centre for Biological Sciences, TIFR, Bengaluru, 560012 Abstract Animal groups exhibit many emergent properties that are a consequence of local interactions. Link- ing individual-level behaviour, which is often stochastic and local, to coarse-grained descriptions of animal groups has been a question of fundamental interest from both biological and mathe- matical perspectives. In this book chapter, we present two complementary approaches to derive coarse-grained descriptions of collective behaviour at so-called mesoscopic scales, which account for the stochasticity arising from the finite sizes of animal groups. We construct stochastic dif- ferential equations (SDEs) for a coarse-grained variable that describes the order/consensus within a group. The first method of construction is based on van Kampen’s system-size expansion of transition rates. The second method employs Gillespie’s chemical Langevin equations. We apply these two methods to two microscopic models from the literature, in which organisms stochasti- cally interact and choose between two directions/choices of foraging. These ‘binary-choice’ models differ only in the types of interactions between individuals, with one assuming simple pairwise interactions, and the other incorporating ternary effects. In both cases, the derived mesoscopic SDEs have multiplicative/state-dependent noise, i.e., the strength of the noise depends on the current state of the system. However, the different models demonstrate the contrasting effects of noise: increasing the order/consensus in the pairwise interaction model, whilst reducing the order/consensus in the higher-order interaction model.
    [Show full text]
  • Chemical Kinetics Roots and Methods to Obtain the Probability Distribution Function Evolution of Reactants and Products in Chemi
    Review Chemical Kinetics Roots and Methods to Obtain the Probability Distribution Function Evolution of Reactants and Products in Chemical Networks Governed by a Master Equation José-Luis Muñoz-Cobo 1,2,* and Cesar Berna 2 1 Department of Chemical and Nuclear Engineering, Universitat Politècnica de València, 46022 Valencia, Spain 2 Instituto Universitario de Ingeniería Energética, Universitat Politècnica de València, 46022 Valencia, Spain; [email protected] * Correspondence: [email protected]; Tel.: +34-96-387-7631 Received: 24 January 2019; Accepted: 11 February 2019; Published: 14 February 2019 Abstract: In this paper first, we review the physical root bases of chemical reaction networks as a Markov process in multidimensional vector space. Then we study the chemical reactions from a microscopic point of view, to obtain the expression for the propensities for the different reactions that can happen in the network. These chemical propensities, at a given time, depend on the system state at that time, and do not depend on the state at an earlier time indicating that we are dealing with Markov processes. Then the Chemical Master Equation (CME) is deduced for an arbitrary chemical network from a probability balance and it is expressed in terms of the reaction propensities. This CME governs the dynamics of the chemical system. Due to the difficulty to solve this equation two methods are studied, the first one is the probability generating function method or z-transform, which permits to obtain the evolution of the factorial moment of the system with time in an easiest way or after some manipulation the evolution of the polynomial moments.
    [Show full text]