Arxiv:1506.00348V3 [Physics.Soc-Ph] 4 Feb 2019
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Information Theory and Statistics
MONOGRAPH SERIES INFORMATION TECHNOLOGIES: RESEARCH AND THEIR INTERDISCIPLINARY APPLICATIONS 1 ŁUKASZ DĘBOWSKI INFORMATION THEORY AND STATISTICS INSTITUTE OF COMPUTER SCIENCE i POLISH ACADEMY OF SCIENCES Warsaw, 2013 Publication issued as a part of the project: ‘Information technologies: research and their interdisciplinary applications’, Objective 4.1 of Human Capital Operational Programme. Agreement number UDA-POKL.04.01.01-00-051/10-00. Publication is co-financed by European Union from resources of European Social Fund. Project leader: Institute of Computer Science, Polish Academy of Sciences Project partners: System Research Institute, Polish Academy of Sciences, Nałęcz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences Editors-in-chief: Olgierd Hryniewicz Jan Mielniczuk Wojciech Penczek Jacek Waniewski Reviewer: Brunon Kamiński Łukasz Dębowski Institute of Computer Science, Polish Academy of Sciences [email protected] http://www.ipipan.waw.pl/staff/l.debowski/ Publication is distributed free of charge c Copyright by Łukasz Dębowski c Copyright by Institute of Computer Science, Polish Academy of Sciences, 2013 ISBN 978-83-63159-06-1 e-ISBN 978-83-63159-07-8 Cover design: Waldemar Słonina Table of Contents Preface :::::::::::::::::::::::::::::::::::::::::::::::::::::::: 5 1 Probabilistic preliminaries ::::::::::::::::::::::::::::: 7 2 Entropy and information ::::::::::::::::::::::::::::::: 15 3 Source coding :::::::::::::::::::::::::::::::::::::::::::: 27 4 Stationary processes :::::::::::::::::::::::::::::::::::: -
Random Walk: a Modern Introduction
Random Walk: A Modern Introduction Gregory F. Lawler and Vlada Limic Contents Preface page 6 1 Introduction 9 1.1 Basic definitions 9 1.2 Continuous-time random walk 12 1.3 Other lattices 14 1.4 Other walks 16 1.5 Generator 17 1.6 Filtrations and strong Markov property 19 1.7 A word about constants 21 2 Local Central Limit Theorem 24 2.1 Introduction 24 2.2 Characteristic Functions and LCLT 27 2.2.1 Characteristic functions of random variables in Rd 27 2.2.2 Characteristic functions of random variables in Zd 29 2.3 LCLT — characteristic function approach 29 2.3.1 Exponential moments 42 2.4 Some corollaries of the LCLT 47 2.5 LCLT — combinatorial approach 51 2.5.1 Stirling’s formula and 1-d walks 52 2.5.2 LCLT for Poisson and continuous-time walks 56 3 Approximation by Brownian motion 63 3.1 Introduction 63 3.2 Construction of Brownian motion 64 3.3 Skorokhod embedding 68 3.4 Higher dimensions 71 3.5 An alternative formulation 72 4 Green’s Function 75 4.1 Recurrence and transience 75 4.2 Green’s generating function 76 4.3 Green’s function, transient case 81 4.3.1 Asymptotics under weaker assumptions 84 3 4 Contents 4.4 Potential kernel 86 4.4.1 Two dimensions 86 4.4.2 Asymptotics under weaker assumptions 90 4.4.3 One dimension 92 4.5 Fundamental solutions 95 4.6 Green’s function for a set 96 5 One-dimensional walks 103 5.1 Gambler’s ruin estimate 103 5.1.1 General case 106 5.2 One-dimensional killed walks 112 5.3 Hitting a half-line 115 6 Potential Theory 119 6.1 Introduction 119 6.2 Dirichlet problem 121 6.3 Difference estimates and Harnack -
Unified Mathmatical Treatment of Complex Cascaded Bipartite Networks: the Case of Collections of Journal Papers
UNIFIED MATHMATICAL TREATMENT OF COMPLEX CASCADED BIPARTITE NETWORKS: THE CASE OF COLLECTIONS OF JOURNAL PAPERS By STEVEN ALLEN MORRIS Bachelor of Science Tulsa University Tulsa, Oklahoma 1983 Master of Science Tulsa University Tulsa, Oklahoma 1987 Submitted to the Faculty of the Graduate College of the Oklahoma State University in partial fulfillment of the requirements for the Degree of DOCTOR OF PHILOSOPHY May, 2005 UNIFIED MATHMATICAL TREATMENT OF COMPLEX CASCADED BIPARTITE NETWORKS: THE CASE OF COLLECTIONS OF JOURNAL PAPERS Thesis Approved: __________________Dr. Gary Yen___________________ Thesis Advisor ________________Dr. Chris Hutchens________________ _________________Dr. Martin Hagan________________ __________________Dr. David Pratt_________________ ________________Dr. A. Gordon Emslie______________ Dean of the Graduate College ii PREFACE In this study, a mathematical treatment is proposed for analysis of entities and relations among entities in complex networks consisting of cascaded bipartite networks. This treatment is applied to the case of collections of journal papers. In this case, entities are distinguishable objects and concepts, such as papers, references, paper authors, reference authors, paper journals, reference journals, institutions, terms, and term definitions. Relations are associations between entity-types such as papers and the references they cite, or paper authors and the papers they write. An entity-relationship model is introduced that explicitly shows direct links between entity-types and possible useful indirect relations. From this a matrix formulation and generalized matrix arithmetic are introduced that allow easy expression of relations between entities and calculation of weights of indirect links and co-occurrence links. Occurrence matrices, equivalence matrices, membership matrices and co-occurrence matrices are described. A dynamic model of growth describes recursive relations in occurrence and co-occurrence matrices as papers are added to the paper collection. -
M O N O Gr Ap H Series M O N O Gr Ap H Series 1
1 MONOGRAPH SERIES: ŁUKASZ DĘBOWSKI - INFORMATION THEORY AND STATISTICS THEORY MONOGRAPH SERIES: ŁUKASZ DĘBOWSKI - INFORMATION 1 MONOGRAPH SERIES MONOGRAPH MONOGRAPH SERIES MONOGRAPH ŁUKASZ DĘBOWSKI INFORMATION THEORY AND STATISTICS INSTITUTE OF COMPUTER SCIENCE POLISH ACADEMY OF SCIENCES MONOGRAPH SERIES INFORMATION TECHNOLOGIES: RESEARCH AND THEIR INTERDISCIPLINARY APPLICATIONS 1 ŁUKASZ DĘBOWSKI INFORMATION THEORY AND STATISTICS INSTITUTE OF COMPUTER SCIENCE i POLISH ACADEMY OF SCIENCES Warsaw, 2013 Publication issued as a part of the project: ‘Information technologies: research and their interdisciplinary applications’, Objective 4.1 of Human Capital Operational Programme. Agreement number UDA-POKL.04.01.01-00-051/10-00. Publication is co-financed by European Union from resources of European Social Fund. Project leader: Institute of Computer Science, Polish Academy of Sciences Project partners: System Research Institute, Polish Academy of Sciences, Nałęcz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences Editors-in-chief: Olgierd Hryniewicz Jan Mielniczuk Wojciech Penczek Jacek Waniewski Reviewer: Brunon Kamiński Łukasz Dębowski Institute of Computer Science, Polish Academy of Sciences [email protected] http://www.ipipan.waw.pl/staff/l.debowski/ Publication is distributed free of charge c Copyright by Łukasz Dębowski c Copyright by Institute of Computer Science, Polish Academy of Sciences, 2013 ISBN 978-83-63159-06-1 e-ISBN 978-83-63159-07-8 Cover design: Waldemar Słonina Table of Contents -
Lossless Data Compression Christian Steinruecken King’S College
Lossless Data Compression Christian Steinruecken King’s College Dissertation submitted in candidature for the degree of Doctor of Philosophy, University of Cambridge August 2014 2014 © Christian Steinruecken, University of Cambridge. Re-typeset on March 2, 2018, using LATEX, gnuplot, and custom-written software. Lossless Data Compression Christian Steinruecken Abstract This thesis makes several contributions to the field of data compression. Lossless data com- pression algorithms shorten the description of input objects, such as sequences of text, in a way that allows perfect recovery of the original object. Such algorithms exploit the fact that input objects are not uniformly distributed: by allocating shorter descriptions to more probable objects and longer descriptions to less probable objects, the expected length of the compressed output can be made shorter than the object’s original description. Compression algorithms can be designed to match almost any given probability distribution over input objects. This thesis employs probabilistic modelling, Bayesian inference, and arithmetic coding to derive compression algorithms for a variety of applications, making the underlying probability distributions explicit throughout. A general compression toolbox is described, consisting of practical algorithms for compressing data distributed by various fundamental probability distributions, and mechanisms for combining these algorithms in a principled way. Building on the compression toolbox, new mathematical theory is introduced for compressing objects with an underlying combinatorial structure, such as permutations, combinations, and multisets. An example application is given that compresses unordered collections of strings, even if the strings in the collection are individually incompressible. For text compression, a novel unifying construction is developed for a family of context- sensitive compression algorithms.