Package 'Laplacesdemon'

Total Page：16

File Type：pdf, Size：1020Kb

Package ‘LaplacesDemon’ March 4, 2013 Version 13.03.04 Date 2013-03-04 Title Complete Environment for Bayesian Inference Author Statisticat, LLC <[email protected]> Maintainer Martina Hall <[email protected]> Depends R (>= 2.14.1), parallel ByteCompile TRUE Description Laplace’s Demon is a complete environment for Bayesian inference. License GPL-2 URL http://www.r-project.org, http://www.bayesian-inference.com/software Repository CRAN NeedsCompilation no Date/Publication 2013-03-04 20:36:44 R topics documented: LaplacesDemon-package . .4 ABB.............................................5 as.covar . .7 as.initial.values . .8 as.parm.names . .9 as.ppc . 11 BayesFactor . 12 BayesianBootstrap . 15 BayesTheorem . 17 BMK.Diagnostic . 19 burnin . 21 1 2 R topics documented: caterpillar.plot . 22 CenterScale . 23 Combine . 25 Consort . 27 CSF............................................. 28 data.demonsnacks . 31 de.Finetti.Game . 32 dist.Asymmetric.Laplace . 33 dist.Asymmetric.Log.Laplace . 35 dist.Bernoulli . 36 dist.Categorical . 38 dist.Dirichlet . 39 dist.HalfCauchy . 41 dist.HalfNormal . 42 dist.Halft . 44 dist.Inverse.Beta . 45 dist.Inverse.ChiSquare . 47 dist.Inverse.Gamma . 48 dist.Inverse.Gaussian . 50 dist.Inverse.Wishart . 51 dist.Inverse.Wishart.Cholesky . 53 dist.Laplace . 55 dist.Laplace.Precision . 57 dist.Log.Laplace . 59 dist.Log.Normal.Precision . 60 dist.Multivariate.Cauchy . 62 dist.Multivariate.Cauchy.Cholesky . 64 dist.Multivariate.Cauchy.Precision . 65 dist.Multivariate.Cauchy.Precision.Cholesky . 67 dist.Multivariate.Laplace . 69 dist.Multivariate.Laplace.Cholesky . 71 dist.Multivariate.Normal . 74 dist.Multivariate.Normal.Cholesky . 75 dist.Multivariate.Normal.Precision . 77 dist.Multivariate.Normal.Precision.Cholesky . 79 dist.Multivariate.Polya . 80 dist.Multivariate.Power.Exponential . 82 dist.Multivariate.Power.Exponential.Cholesky . 84 dist.Multivariate.t . 86 dist.Multivariate.t.Cholesky . 87 dist.Multivariate.t.Precision . 89 dist.Multivariate.t.Precision.Cholesky . 91 dist.Normal.Precision . 93 dist.Normal.Variance . 95 dist.Pareto . 97 dist.Power.Exponential . 98 dist.Skew.Discrete.Laplace . 100 dist.Skew.Laplace . 102 R topics documented: 3 dist.Stick . 104 dist.Student.t . 105 dist.Student.t.Precision . 107 dist.Truncated . 109 dist.Wishart . 110 dist.Wishart.Cholesky . 112 Elicitation . 114 ESS ............................................. 116 Gelfand.Diagnostic . 117 Gelman.Diagnostic . 118 Geweke.Diagnostic . 121 GIV............................................. 123 hpc_server . 125 IAT ............................................. 126 Importance . 127 interval . 130 is.appeased . 131 is.class . 132 is.constant . 133 is.constrained . 134 is.data . 135 is.model . 136 is.proper . 137 is.stationary . 139 joint.density.plot . 140 joint.pr.plot . 141 Juxtapose . 142 KLD............................................. 145 KS.Diagnostic . 147 LaplaceApproximation . 148 LaplacesDemon . 155 LaplacesDemon.RAM . 168 Levene.Test . 170 LML............................................. 172 log-log . 175 logit . 176 LossMatrix . 177 LPL.interval . ..

266

Copy Link

Recommended publications

Bayesian Linear Mixed Models with Polygenic Effects
JSS Journal of Statistical Software June 2018, Volume 85, Issue 6. doi: 10.18637/jss.v085.i06 Bayesian Linear Mixed Models with Polygenic Effects Jing Hua Zhao Jian’an Luan Peter Congdon University of Cambridge University of Cambridge University of London Abstract We considered Bayesian estimation of polygenic effects, in particular heritability in relation to a class of linear mixed models implemented in R (R Core Team 2018). Our ap- proach is applicable to both family-based and population-based studies in human genetics with which a genetic relationship matrix can be derived either from family structure or genome-wide data. Using a simulated and a real data, we demonstrate our implementa- tion of the models in the generic statistical software systems JAGS (Plummer 2017) and Stan (Carpenter et al. 2017) as well as several R packages. In doing so, we have not only provided facilities in R linking standalone programs such as GCTA (Yang, Lee, Goddard, and Visscher 2011) and other packages in R but also addressed some technical issues in the analysis. Our experience with a host of general and special software systems will facilitate investigation into more complex models for both human and nonhuman genetics. Keywords: Bayesian linear mixed models, heritability, polygenic effects, relationship matrix, family-based design, genomewide association study. 1. Introduction The genetic basis of quantitative phenotypes has been a long-standing research problem as- sociated with a large and growing literature, and one of the earliest was by Fisher(1918) on additive effects of genetic variants (the polygenic effects). In human genetics it is common to estimate heritability, the proportion of polygenic variance to the total phenotypic variance, through twin and family studies.
[Show full text]
Probabilistic Programming in Python Using Pymc3
Probabilistic programming in Python using PyMC3 John Salvatier1, Thomas V. Wiecki2 and Christopher Fonnesbeck3 1 AI Impacts, Berkeley, CA, United States 2 Quantopian Inc, Boston, MA, United States 3 Department of Biostatistics, Vanderbilt University, Nashville, TN, United States ABSTRACT Probabilistic programming allows for automatic Bayesian inference on user-defined probabilistic models. Recent advances in Markov chain Monte Carlo (MCMC) sampling allow inference on increasingly complex models. This class of MCMC, known as Hamiltonian Monte Carlo, requires gradient information which is often not readily available. PyMC3 is a new open source probabilistic programming framework written in Python that uses Theano to compute gradients via automatic differentiation as well as compile probabilistic programs on-the-fly to C for increased speed. Contrary to other probabilistic programming languages, PyMC3 allows model specification directly in Python code. The lack of a domain specific language allows for great flexibility and direct interaction with the model. This paper is a tutorial-style introduction to this software package. Subjects Data Mining and Machine Learning, Data Science, Scientific Computing and Simulation Keywords Bayesian statistic, Probabilistic Programming, Python, Markov chain Monte Carlo, Statistical modeling INTRODUCTION Probabilistic programming (PP) allows for flexible specification and fitting of Bayesian Submitted 9 September 2015 statistical models. PyMC3 is a new, open-source PP framework with an intuitive and Accepted 8 March 2016 readable, yet powerful, syntax that is close to the natural syntax statisticians use to Published 6 April 2016 describe models. It features next-generation Markov chain Monte Carlo (MCMC) Corresponding author Thomas V. Wiecki, sampling algorithms such as the No-U-Turn Sampler (NUTS) (Hoffman & Gelman, [email protected] 2014), a self-tuning variant of Hamiltonian Monte Carlo (HMC) (Duane et al., 1987).
[Show full text]
Laplacesdemon: a Complete Environment for Bayesian Inference Within R
LaplacesDemon: A Complete Environment for Bayesian Inference within R Statisticat, LLC Abstract LaplacesDemon, usually referred to as Laplace's Demon, is a contributed R package for Bayesian inference, and is freely available on the Comprehensive R Archive Network (CRAN). Laplace's Demon is a complete environment for Bayesian inference. The user may build any kind of probability model with a user-specified model function. The model may be updated with Laplace Approximation, numerous MCMC algorithms, and PMC. After updating, a variety of facilities are available, including MCMC diagnostics, posterior predictive checks, and validation. Laplace's Demon seeks to be generalizable and user- friendly to Bayesians, especially Laplacians. Keywords:~Adaptive, AM, Bayesian, Delayed Rejection, DR, DRAM, DRM, DEMC, En- semble, Gradient Ascent, HARM, Hamiltonian, High Performance Computing, Hit-And- Run, HMC, HPC, Importance Sampling, INCA, Laplace Approximation, LaplacesDemon, Laplace's Demon, Markov chain Monte Carlo, MCMC, Metropolis, Metropolis-within-Gibbs, No-U-Turn Sampler, NUTS, Optimization, Parallel, R, PMC, Random Walk, Random-Walk, Resilient Backpropagation, Reversible-Jump, Slice, Statisticat, t-walk. Bayesian inference is named after Reverend Thomas Bayes (1701-1761) for developing Bayes' theorem, which was published posthumously after his death (Bayes and Price 1763). This was the first instance of what would be called inverse probability1. Unaware of Bayes, Pierre-Simon Laplace (1749-1827) independently developed Bayes' theo- rem and first published his version in 1774, eleven years after Bayes, in one of Laplace's first major works (Laplace 1774, p. 366{367). In 1812, Laplace introduced a host of new ideas and mathematical techniques in his book, Theorie Analytique des Probabilites (Laplace 1812).
[Show full text]
Laplacesdemon Examples
LaplacesDemon Examples Statisticat, LLC Abstract The LaplacesDemon package is a complete environment for Bayesian inference within R. Virtually any probability model may be specified. This vignette is a compendium of examples of how to specify different model forms. Keywords:~Bayesian, Bayesian Inference, Laplace's Demon, LaplacesDemon, R, Statisticat. LaplacesDemon (Statisticat LLC. 2013), usually referred to as Laplace's Demon, is an R pack- age that is available on CRAN (R Development Core Team 2012). A formal introduction to Laplace's Demon is provided in an accompanying vignette entitled \LaplacesDemon Tutorial", and an introduction to Bayesian inference is provided in the \Bayesian Inference" vignette. The purpose of this document is to provide users of the LaplacesDemon package with exam- ples of a variety of Bayesian methods. It is also a testament to the diverse applicability of LaplacesDemon to Bayesian inference. To conserve space, the examples are not worked out in detail, and only the minimum of nec- essary materials is provided for using the various methodologies. Necessary materials include the form expressed in notation, data (which is often simulated), the Model function, and initial values. The provided data, model specification, and initial values may be copy/pasted into an R file and updated with the LaplacesDemon or (usually) LaplaceApproximation func- tions. Although many of these examples update quickly, some examples are computationally intensive. Initial values are usually hard-coded in the examples, though the Parameter-Generating Func- tion (PGF) is also specified. It is recommended to generate initial values with the GIV function according to the user-specified PGF. Notation in this vignette follows these standards: Greek letters represent parameters, lower case letters represent indices, lower case bold face letters represent scalars or vectors, proba- bility distributions are represented with calligraphic font, upper case letters represent index limits, and upper case bold face letters represent matrices.
[Show full text]
Stratified Sampling and Bootstrapping for Approximate Bayesian
Stratified sampling and bootstrapping for approximate Bayesian computation Umberto Picchini∗ Richard G. Everitt† Abstract Approximate Bayesian computation (ABC) is computationally intensive for com- plex model simulators. To exploit expensive simulations, data-resampling via boot- strapping can be employed to obtain many artificial datasets at little cost. However, when using this approach within ABC, the posterior variance is inflated, thus resulting in biased posterior inference. Here we use stratified Monte Carlo to considerably re- duce the bias induced by data resampling. We also show empirically that it is possible to obtain reliable inference using a larger than usual ABC threshold. Finally, we show that with stratified Monte Carlo we obtain a less variable ABC likelihood. Ultimately we show how our approach improves the computational efficiency of the ABC samplers. We construct several ABC samplers employing our methodology, such as rejection and importance ABC samplers, and ABC-MCMC samplers. We consider simulation stud- ies for static (Gaussian, g-and-k distribution, Ising model, astronomical model) and dynamic models (Lotka-Volterra). We compare against state-of-art sequential Monte Carlo ABC samplers, synthetic likelihoods, and likelihood-free Bayesian optimization. For a computationally expensive Lotka-Volterra case study, we found that our strategy leads to a more than 10-fold computational saving, compared to a sampler that does not use our novel approach. Keywords: intractable likelihoods; likelihood-free; pseudo-marginal MCMC; sequential Monte Carlo; time series 1 Introduction The use of realistic models for complex experiments typically results in an intractable likelihood function, i.e. the likelihood is not analytically available in closed form, or it is computationally too expensive to evaluate.
[Show full text]
Laplacesdemon’
Package ‘LaplacesDemon’ July 9, 2021 Version 16.1.6 Title Complete Environment for Bayesian Inference Depends R (>= 3.0.0) Imports parallel, grDevices, graphics, stats, utils Suggests KernSmooth ByteCompile TRUE Description Provides a complete environment for Bayesian inference using a variety of different sam- plers (see ?LaplacesDemon for an overview). License MIT + ﬁle LICENSE URL https://github.com/LaplacesDemonR/LaplacesDemon BugReports https://github.com/LaplacesDemonR/LaplacesDemon/issues NeedsCompilation no Author Byron Hall [aut], Martina Hall [aut], Statisticat, LLC [aut], Eric Brown [ctb], Richard Hermanson [ctb], Emmanuel Charpentier [ctb], Daniel Heck [ctb], Stephane Laurent [ctb], Quentin F. Gronau [ctb], Henrik Singmann [cre] Maintainer Henrik Singmann <[email protected]> Repository CRAN Date/Publication 2021-07-09 14:00:02 UTC R topics documented: LaplacesDemon-package . .6 ABB............................................. 11 1 2 R topics documented: AcceptanceRate . 13 as.covar . 15 as.initial.values . 16 as.parm.names . 17 as.ppc . 18 BayesFactor . 19 BayesianBootstrap . 23 BayesTheorem . 25 BigData . 28 Blocks . 32 BMK.Diagnostic . 35 burnin . 36 caterpillar.plot . 38 CenterScale . 39 Combine . 40 cond.plot . 42 Consort . 43 CSF............................................. 46 data.demonchoice . 48 data.demonfx . 49 data.demonsessions . 50 data.demonsnacks . 51 data.demontexas . 52 de.Finetti.Game . 53 deburn . 54 dist.Asymmetric.Laplace . 55 dist.Asymmetric.Log.Laplace . 57 dist.Asymmetric.Multivariate.Laplace . 59 dist.Bernoulli . 61 dist.Categorical . 62 dist.ContinuousRelaxation . 64 dist.Dirichlet . 65 dist.Generalized.Pareto . 67 dist.Generalized.Poisson . 68 dist.HalfCauchy . 70 dist.HalfNormal . 71 dist.Halft . 73 dist.Horseshoe . 74 dist.HuangWand . 76 dist.Inverse.Beta . 78 dist.Inverse.ChiSquare . 79 dist.Inverse.Gamma . 81 dist.Inverse.Gaussian .
[Show full text]
Laplacesdemon Examples
LaplacesDemon Examples Statisticat, LLC Abstract The LaplacesDemon package is a complete environment for Bayesian inference within R. Virtually any probability model may be specified. This vignette is a compendium of examples of how to specify different model forms. Keywords: Bayesian, LaplacesDemon, LaplacesDemonCpp, R. LaplacesDemon (Statisticat LLC. 2015), often referred to as LD, is an R package that is avail- able at https://web.archive.org/web/20150430054143/http://www.bayesian-inference. com/software. LaplacesDemonCpp is an extension package that uses C++. A formal intro- duction to LaplacesDemon is provided in an accompanying vignette entitled “LaplacesDemon Tutorial”, and an introduction to Bayesian inference is provided in the “Bayesian Inference” vignette. The purpose of this document is to provide users of the LaplacesDemon package with exam- ples of a variety of Bayesian methods. It is also a testament to the diverse applicability of LaplacesDemon to Bayesian inference. To conserve space, the examples are not worked out in detail, and only the minimum of nec- essary materials is provided for using the various methodologies. Necessary materials include the form expressed in notation, data (which is often simulated), the Model function, and initial values. The provided data, model specification, and initial values may be copy/pasted into an R file and updated with the LaplacesDemon or (usually) LaplaceApproximation func- tions. Although many of these examples update quickly, some examples are computationally intensive. All examples are provided in R code, but the model specification function can be in an- other language. A goal is to provide these example model functions in C++ as well, and some are now available at https://web.archive.org/web/20140513065103/http://www.
[Show full text]
Changes on CRAN 2013-05-26 to 2013-11-30
NEWS AND NOTES 166 Changes on CRAN 2013-05-26 to 2013-11-30 by Kurt Hornik and Achim Zeileis New CRAN task views NumericalMathematics Topic: Numerical Mathematics. Maintainer: Hans W. Borchers. Packages: BB, Bessel, MASS, Matrix∗, MonoPoly, PolynomF, R.matlab, R2Cuba, Rcpp, RcppArmadillo, RcppEigen, RcppOctave, Rmpfr, Ryacas, SparseGrid, Spher- icalCubature, akima, appell, combinat, contfrac, cubature, eigeninv, elliptic, expm, features, gaussquad, gmp, gsl∗, hypergeo, irlba, magic, matlab, mpoly, multipol, nleqslv, numDeriv∗, numbers, onion, orthopolynom, partitions, pcenum, polyCub, polynom∗, pracma, rPython, rSymPy, signal, ssvd, statmod, stinepack, svd. WebTechnologies Topic: Web Technologies and Services. Maintainer: Scott Chamberlain, Karthik Ram, Christopher Gandrud, Patrick Mair. Packages: AWS.tools, CHCN, FAOSTAT, GuardianR, MTurkR, NCBI2R, OAIHarvester, Quandl, RCurl∗, RJSO- NIO∗, RLastFM, RMendeley, RNCBI, RNCEP, ROAuth, RSiteCatalyst, RSocrata, RTDAmeritrade, RWeather, Rcolombos, Reol, Rfacebook, RgoogleMaps, Rook, Syn- ergizeR, TFX, WDI, XML∗, alm, anametrix, bigml, cgdsr, cimis, crn, datamart, dataone, decctools, dismo, dvn, fImport, factualR, flora, ggmap, gooJSON, googlePublic- Data, googleVis, govStatJPN, govdat, httpuv, httr∗, imguR, ngramr, nhlscrapr, opencpu, osmar, pitchRx, plotGoogleMaps, plotKML, quantmod, rAltmetric, rPlant, rdata- market, rebird, rentrez, repmis, rfigshare, rfishbase, rfisheries, rgauges, rgbif, rj- son∗, rplos, rpubchem, rsnps, rvertnet, scholar, scrapeR, selectr, seq2R, seqinr, servr, shiny∗, sos4R,
[Show full text]
Bayesian Inference for Stable Differential Equation Models With
Bayesian inference for stable differential equation models with applications in computational neuroscience Author: Philip Maybank A thesis presented for the degree of doctor of philosophy school of mathematical, physical and computational sciences university of reading February 16, 2019 Remember to look up at the stars and not down at your feet. Try to make sense of what you see and wonder about what makes the universe exist. Be curious. And however difficult life may seem, there is always something you can do and succeed at. It matters that you don’t just give up. THE LATE PROF STEPHEN HAWKING, 1942-2018 ABSTRACT Inference for mechanistic models is challenging because of nonlinear interactions between model parameters and a lack of identifiability. Here we focus on a specific class of mechanistic models, which we term stable differential equations. The dynamics in these models are approximately linear around a stable fixed point of the system. We exploit this property to develop fast approximate methods for posterior inference. We first illustrate our approach using simulated EEG data on the Liley et al model, a mechanistic neural population model. Then we apply our methods to experimental EEG data from rats to estimate how parameters in the Liley et al model vary with level of isoflurane anaesthesia. More generally, stable differential equation models and the corresponding inference methods are useful for analysis of stationary time-series data. Compared to the existing state-of-the art, our methods are several orders of magnitude faster, and are particularly suited to analysis of long time-series (>10,000 time-points) and models of moderate dimension (10-50 state variables and 10-50 parameters.) 3 ACKNOWLEDGEMENTS I have enjoyed studying Bayesian methodology with Richard Culliford and Changqiong Wang, and Neuroscience with Asad Malik and Catriona Scrivener.
[Show full text]
Mamba.Jl Documentation Release 0.12.0
Mamba.jl Documentation Release 0.12.0 Brian J Smith Oct 20, 2018 Contents 1 Overview 3 1.1 Purpose..................................................3 1.2 Features..................................................3 1.3 Getting Started..............................................4 2 Contents 5 2.1 Introduction...............................................5 2.2 Tutorial..................................................7 2.3 MCMC Types.............................................. 21 2.4 Sampling Functions........................................... 57 2.5 Examples................................................. 93 2.6 Discussion................................................ 165 2.7 Supplement................................................ 165 2.8 References................................................ 166 2.9 Indices.................................................. 166 Bibliography 167 i ii Mamba.jl Documentation, Release 0.12.0 Version 0.12.0 Requires julia releases 1.0.x Date Oct 20, 2018 Maintainer Brian J Smith ([email protected]) Contributors Benjamin Deonovic ([email protected]), Brian J Smith (brian-j- [email protected]), and others Web site https://github.com/brian-j-smith/Mamba.jl License MIT Contents 1 Mamba.jl Documentation, Release 0.12.0 2 Contents CHAPTER 1 Overview 1.1 Purpose Mamba is an open platform for the implementation and application of MCMC methods to perform Bayesian analysis in julia. The package provides a framework for (1) speciﬁcation of hierarchical models through stated relationships between
[Show full text]
Laplacesdemon: a Complete Environment for Bayesian Inference Within R
LaplacesDemon: A Complete Environment for Bayesian Inference within R Statisticat, LLC Abstract LaplacesDemon, also referred to as LD, is a contributed R package for Bayesian infer- ence, and is freely available at https://web.archive.org/web/20141224051720/http: //www.bayesian-inference.com/indexe. The user may build any kind of probability model with a user-specified model function. The model may be updated with iterative quadrature, Laplace Approximation, MCMC, PMC, or variational Bayes. After updat- ing, a variety of facilities are available, including MCMC diagnostics, posterior predictive checks, and validation. Hopefully, LaplacesDemon is generalizable and user-friendly for Bayesians, especially Laplacians. Keywords: Bayesian, Big Data, High Performance Computing, HPC, Importance Sampling, Iterative Quadrature, Laplace Approximation, LaplacesDemon, LaplacesDemonCpp, Markov chain Monte Carlo, MCMC, Metropolis, Optimization, Parallel, PMC, R, Rejection Sampling, Variational Bayes. Bayesian inference is named after Reverend Thomas Bayes (1701-1761) for developing Bayes’ theorem, which was published posthumously after his death (Bayes and Price 1763). This was the first instance of what would be called inverse probability1. Unaware of Bayes, Pierre-Simon Laplace (1749-1827) independently developed Bayes’ theo- rem and first published his version in 1774, eleven years after Bayes, in one of Laplace’s first major works (Laplace 1774, p. 366–367). In 1812, Laplace introduced a host of new ideas and mathematical techniques in his book, Theorie Analytique des Probabilites (Laplace 1812). Before Laplace, probability theory was solely concerned with developing a mathematical anal- ysis of games of chance. Laplace applied probabilistic ideas to many scientific and practical problems. Although Laplace is not the father of probability, Laplace may be considered the father of the field of probability.
[Show full text]
Bayesian Optimization with Unknown Constraints
Bayesian Optimization with Unknown Constraints Michael A. Gelbart Jasper Snoek Ryan P. Adams Harvard University Harvard University Harvard University Cambridge, MA Cambridge, MA Cambridge, MA Abstract Therefore, for each proposed low-calorie recipe, they per- form a taste test with sample customers. Because different Recent work on Bayesian optimization has people, or the same people at different times, have differing shown its effectiveness in global optimization of opinions about the taste of cookies, the company decides to difﬁcult black-box objective functions. Many require that at least 95% of test subjects must like the new real-world optimization problems of interest also cookie. This is a constrained optimization problem: have constraints which are unknown a priori. min c(x) s:t: ρ(x) ≥ 1 − ; In this paper, we study Bayesian optimization x for constrained problems in the general case that where x is a real-valued vector representing a recipe, c(x) noise may be present in the constraint func- is the number of calories in recipe x, ρ(x) is the fraction of tions, and the objective and constraints may be test subjects that like recipe x, and 1 − is the minimum evaluated independently. We provide motivating acceptable fraction, i.e., 95%. practical examples, and present a general frame- work to solve such problems. We demonstrate This paper presents a general formulation of constrained the effectiveness of our approach on optimizing Bayesian optimization that is suitable for a large class of the performance of online latent Dirichlet
[Show full text]