Tutorial: Environment for Tree Exploration Release 2.3.6

Total Page:16

File Type:pdf, Size:1020Kb

Tutorial: Environment for Tree Exploration Release 2.3.6 Tutorial: Environment for Tree Exploration Release 2.3.6 Jaime Huerta-Cepas August 11, 2015 Contents 1 Changelog history3 1.1 What’s new in ETE 2.3...................................3 1.2 What’s new in ETE 2.2...................................5 1.3 What’s new in ETE 2.1...................................9 2 The ETE tutorial 13 2.1 Working With Tree Data Structures............................ 13 2.2 The Programmable Tree Drawing Engine......................... 43 2.3 Phylogenetic Trees..................................... 63 2.4 Clustering Trees...................................... 80 2.5 Phylogenetic XML standards............................... 85 2.6 Interactive web tree visualization............................. 92 2.7 Testing Evolutionary Hypothesis.............................. 94 2.8 Dealing with the NCBI Taxonomy database........................ 104 2.9 SCRIPTS: orthoXML................................... 108 3 ETE’s Reference Guide 115 3.1 Master Tree class...................................... 115 3.2 Treeview module...................................... 127 3.3 PhyloTree class....................................... 137 3.4 Clustering module..................................... 140 3.5 Nexml module....................................... 142 3.6 Phyloxml Module..................................... 157 3.7 Seqgroup class....................................... 160 3.8 WebTreeApplication object................................ 161 3.9 EvolTree class....................................... 161 3.10 NCBITaxa class...................................... 166 Bibliography 169 Python Module Index 171 Index 173 i ii Tutorial: Environment for Tree Exploration, Release 2.3.6 [Download PDF documentation] || Contents 1 Tutorial: Environment for Tree Exploration, Release 2.3.6 2 Contents CHAPTER 1 Changelog history 1.1 What’s new in ETE 2.3 1.1.1 Update 2.3.2 • added NCBITaxa.get_descendant_taxa() • added NCBITaxa.get_common_names() • ete ncbiquery: dump descendant taxa given a taxid or taxa name. new option ‘–descendants‘_; renamed ‘–taxonomy‘_ by ‘–tree‘_ • fixes <misaligned branches <https://github.com/jhcepas/ete/issues/113>‘_ in ultrametric tree im- ages using vt_line_width > 0 • fixes <windows installation problem <https://github.com/jhcepas/ete/issues/114>‘_ 1.1.2 New Modules tools A collection of command line tools, implementing common tree operations has been added to the ETE core package. All tools are wrapped by the ete command, which should become available in your path after installation. • ete build: Build phylogenetic trees using a using a number of predefined built-in gene-tree and species-tree workflows. Watch example • ete view: visualize and generate tree images directly form the command line. • ete compare: compare tree topologies based on any node feature (i.e. name, species name, etc) using the Robinson-Foulds distance and edge compatibility scores. • ete ncbiquery: query the ncbi taxonomy tree directly from the database. • ete mod: modify tree topologies directly from the command line. Allows rooting, sorting leaves, pruning and more • ete annotate: add features to the tree nodes by combining newick and text files. • ete generate: generate random trees, mostly for teaching and testing 3 Tutorial: Environment for Tree Exploration, Release 2.3.6 ncbi taxonomy The new ncbi_taxonomy module provides the class NCBITaxa, which allows to query a locally parsed NCBI taxonomy database. It provides taxid-name translations, tree annotation tools and other handy functions. A brief tutorial and examples on how to use it is available here 1.1.3 New features News in Tree instances • added TreeNode.iter_edges() and TreeNode.get_edges() • added TreeNode.compare() function • added TreeNode.standardize() utility function to quickly get rid of multifurcations, single-child nodes in a tree. • added TreeNode.get_topology_id() utility function to get an unique identifier of a tree based on their content and topology. • added TreeNode.expand_polytomies() • improved TreeNode.robinson_foulds() function to auto expand polytomies, filter by branch support, and auto prune. • improved TreeNode.check_monophyly() function now accepts unrooted trees as input • Default node is set to blank instead of the “NoName” string, which saves memory in very large trees. • The branch length distance of root nodes is set to 0.0 by default. • newick export allows to control the format of branch distance and support values. • Tree and SeqGroup instances allow now to open gzipped files transparently. News in the treeview module • improved SVG tree rendering • improved random_color() function (a list of colors can be fetch with a single call) • improved SeqMotifFace • Added RectFace • Added StackedBarFace 1.1.4 Highlighted Bug Fixes • Newick parser is now more strict when reading node names and branch distances, avoiding silent errors when parsing node names containing illegal symbols (i.e. ][)(,: ) • fixes several minor bugs when retrieving extra attributes in PhyloNode.get_speciation_trees(). • Tree viewer crashes when redrawing after changing node properties. • fixed installation problem using pip. 4 Chapter 1. Changelog history Tutorial: Environment for Tree Exploration, Release 2.3.6 • visualizing internal tree nodes as a circular tree produce crashes • math domain error in SequencePlotFace. • Fix likelihood calculation bug in EvolTree • Fix BarChartFace problem with negative numbers • Fix problem that produced TreeStyle attributes to be ignored in PhyloTree instances. 1.2 What’s new in ETE 2.2 1.2.1 BUGFIXES • Fixes in NeXML parser and exporting functions • Fixed ‘paste newick’ functionality on the GUI • Fixed PhyloNode.is_monophyletic() and moved to TreeNode.check_monophyly(). • Fixed consistency issued in TreeNode.sort_descendants() function. 1.2.2 SCRIPTS • Improvements in the standalone visualization script (a.k.a. ete2) • Added the etree2orthoxml script, which provides conversion between phylogenetic tree and the orthoXML format 1.2.3 NEW MODULES • New EvolNode tree object type is available as a part of adaptation-test extension recently devel- oped by François Serra (see Testing Evolutionary Hypothesis in the tutorial). 1.2.4 NEW FEATURES • News in core Tree instances: – Added TreeNode.robinson_foulds() distance to compare the topology of two trees (i.e. tree.robinson_foulds(tree2)). It includes automatic pruning to compare trees of different sizes. See tutorial and examples – Added new options to TreeNode.copy() function, allowing faster methods to duplicate tree node instances. See tutorial and examples 1.2. What’s new in ETE 2.2 5 Tutorial: Environment for Tree Exploration, Release 2.3.6 – Added preserve_branch_length argument to TreeNode.prune() and TreeNode.delete(), which allows to remove nodes from a tree while keeping original branch length distances among the remaining nodes. – Added TreeNode.resolve_polytomy() function to convert multifurcated nodes into an arbitrary structure of binary split nodes with distance. See tutorial and examples – Added TreeNode.get_cached_content() function, which returns a dictionary link- ing each node instance with its leaf content. Such a dictionary might be used as a cache to speed up functions that require intensive use of node traversing. See tutorial and examples – Improved TreeNode.get_ascii() function for text-based visualization of trees. A new attributes argument can be passed to display node attributes within the ASCII tree rep- resentation. from ete2 import Tree t= Tree("((A, B)Internal_1:0.7, (C, D)Internal_2:0.5)root:1.3;", format=1) t.add_features(size=4) print t.get_ascii(attributes=["name","dist","size"]) # # /-A, 0.0 # /Internal_1, 0.7 # | \-B, 0.0 # -root, 1.3, 4 # | /-C, 0.0 # \Internal_2, 0.5 # \-D, 0.0 # – Random branch length and support values generation is now available for the TreeNode.populate() function. – a new argument is_leaf_fn is available for a number of traversing functions, thus allow- ing to provide custom stopping criteria when browsing a tree. This is, any node matching the function provided through the is_leaf_fn argument will be temporarily considered as a terminal/leaf node by the traversing function (tree will look as a pruned version of itself). See tutorial and examples – Added TreeNode.iter_ancestors() and TreeNode.get_ancestors() func- tions. – Added TreeNode.iter_prepostorder() tree node iterator. – Newick parser accepts now the creation of single node trees. For example, a text string such as "node1;" will be parsed as a single tree node whose name is node1. By contrast, the newick string (node1); will be interpreted as an unnamed root node plus a single child named name1. – TreeNode.write() accepts now a format_root_node argument to export root node features as a part of the newick string. – The new TreeNode.check_monophyly() method allows to check if a node is mono, poly or paraphyletic for a given attribute and values (i.e. grouped species). Although mono- phyly is actually a phylogenetic concept, the idea can be applied to any tree, so any topology could be queried for the monophyly of certain attribute values. If not monophyletic, the method will return also the type of relationship connecting the provided values (para- or poly-phyletic). See tutorial and examples 6 Chapter 1. Changelog history Tutorial: Environment for Tree Exploration, Release 2.3.6 – New TreeNode.get_monophyletic() method that returns a list of nodes in a tree matching a custom monophyly criteria. • News PhyloTree instances: – Added PhyloNode.get_speciation_trees() method, which returns all
Recommended publications
  • Treebase: an R Package for Discovery, Access and Manipulation of Online Phylogenies
    Methods in Ecology and Evolution 2012, 3, 1060–1066 doi: 10.1111/j.2041-210X.2012.00247.x APPLICATION Treebase: an R package for discovery, access and manipulation of online phylogenies Carl Boettiger1* and Duncan Temple Lang2 1Center for Population Biology, University of California, Davis, CA,95616,USA; and 2Department of Statistics, University of California, Davis, CA,95616,USA Summary 1. The TreeBASE portal is an important and rapidly growing repository of phylogenetic data. The R statistical environment has also become a primary tool for applied phylogenetic analyses across a range of questions, from comparative evolution to community ecology to conservation planning. 2. We have developed treebase, an open-source software package (freely available from http://cran.r-project. org/web/packages/treebase) for the R programming environment, providing simplified, programmatic and inter- active access to phylogenetic data in the TreeBASE repository. 3. We illustrate how this package creates a bridge between the TreeBASE repository and the rapidly growing collection of R packages for phylogenetics that can reduce barriers to discovery and integration across phyloge- netic research. 4. We show how the treebase package can be used to facilitate replication of previous studies and testing of methods and hypotheses across a large sample of phylogenies, which may help make such important reproduc- ibility practices more common. Key-words: application programming interface, database, programmatic, R, software, TreeBASE, workflow include, but are not limited to, ancestral state reconstruction Introduction (Paradis 2004; Butler & King 2004), diversification analysis Applications that use phylogenetic information as part of their (Paradis 2004; Rabosky 2006; Harmon et al.
    [Show full text]
  • Ade4: Analysis of Ecological Data: Exploratory and Euclidean Methods
    Package ‘ade4’ September 16, 2021 Version 1.7-18 Title Analysis of Ecological Data: Exploratory and Euclidean Methods in Environmental Sciences Author Stéphane Dray <[email protected]>, Anne-Béatrice Du- four <[email protected]>, and Jean Thioulouse <[email protected]>, with con- tributions from Thibaut Jombart, Sandrine Pavoine, Jean R. Lobry, Sébastien Ollier, Daniel Bor- card, Pierre Legendre, Stéphanie Bougeard and Aurélie Siberchicot. Based on ear- lier work by Daniel Chessel. Maintainer Aurélie Siberchicot <[email protected]> Depends R (>= 2.10) Imports graphics, grDevices, methods, stats, utils, MASS, pixmap, sp Suggests ade4TkGUI, adegraphics, adephylo, ape, CircStats, deldir, lattice, spdep, splancs, waveslim, progress, foreach, parallel, doParallel, iterators Description Tools for multivariate data analysis. Several methods are provided for the analy- sis (i.e., ordination) of one-table (e.g., principal component analysis, correspondence analy- sis), two-table (e.g., coinertia analysis, redundancy analysis), three-table (e.g., RLQ analy- sis) and K-table (e.g., STATIS, multiple coinertia analysis). The philosophy of the package is de- scribed in Dray and Dufour (2007) <doi:10.18637/jss.v022.i04>. License GPL (>= 2) URL http://pbil.univ-lyon1.fr/ADE-4/ BugReports https://github.com/sdray/ade4/issues Encoding UTF-8 NeedsCompilation yes Repository CRAN Date/Publication 2021-09-16 11:30:02 UTC R topics documented: ade4-package . .8 1 2 R topics documented: abouheif.eg . .8 acacia . .9 add.scatter . 10 aminoacyl . 13 amova............................................ 14 apis108 . 15 apqe............................................. 16 aravo............................................. 17 ardeche . 18 area.plot . 19 arrival............................................ 21 as.taxo . 22 atlas .
    [Show full text]
  • Biocreative 2012 Proceedings
    Proceedings of 2012 BioCreative Workshop April 4 -5, 2012 Washington, DC USA Editors: Cecilia Arighi Kevin Cohen Lynette Hirschman Martin Krallinger Zhiyong Lu Carolyn Mattingly Alfonso Valencia Thomas Wiegers John Wilbur Cathy Wu 2012 BioCreative Workshop Proceedings Table of Contents Preface…………………………………………………………………………………….......... iv Committees……………………………………………………………………………………... v Workshop Agenda…………………………………………………………………………….. vi Track 1 Collaborative Biocuration-Text Mining Development Task for Document Prioritization for Curation……………………………………..……………………………………………….. 2 T Wiegers, AP Davis, and CJ Mattingly System Description for the BioCreative 2012 Triage Task ………………………………... 20 S Kim, W Kim, CH Wei, Z Lu and WJ Wilbur Ranking of CTD articles and interactions using the OntoGene pipeline ……………..….. 25 F Rinaldi, S Clematide and S Hafner Selection of relevant articles for curation for the Comparative Toxicogenomic Database…………………………………………………………………………………………. 31 D Vishnyakova, E Pasche and P Ruch CoIN: a network exploration for document triage………………………………................... 39 YY Hsu and HY Kao DrTW: A Biomedical Term Weighting Method for Document Recommendation ………... 45 JH Ju, YD Chen and JH Chiang C2HI: a Complete CHemical Information decision system……………………………..….. 52 CH Ke, TLM Lee and JH Chiang Track 2 Overview of BioCreative Curation Workshop Track II: Curation Workflows….…………... 59 Z Lu and L Hirschman WormBase Literature Curation Workflow ……………………………………………………. 66 KV Auken, T Bieri, A Cabunoc, J Chan, Wj Chen, P Davis, A Duong, R Fang, C Grove, Tw Harris, K Howe, R Kishore, R Lee, Y Li, Hm Muller, C Nakamura, B Nash, P Ozersky, M Paulini, D Raciti, A Rangarajan, G Schindelman, Ma Tuli, D Wang, X Wang, G Williams, K Yook, J Hodgkin, M Berriman, R Durbin, P Kersey, J Spieth, L Stein and Pw Sternberg Literature curation workflow at The Arabidopsis Information Resource (TAIR)…..……… 72 D Li, R Muller, TZ Berardini and E Huala Summary of Curation Process for one component of the Mouse Genome Informatics Database Resource …………………………………………………………………………....
    [Show full text]
  • "Introduction to Inferring Evolutionary Relationships". In: Current
    Introduction to Inferring Evolutionary UNIT 6.1 Relationships Much of bioinformatics is essentially comparative biology. Inferences based on compari- sons between entities such as motifs, sequences, genomes, and molecular structures are made. Given that living organisms and their constituent components have an evolutionary history, phylogeny properly lies at the heart of comparative biology (Harvey and Pagel, 1991). Increasingly, researchers in bioinformatics are realizing that phylogeny-based comparisons can yield important insights that can be missed using other techniques (Eisen, 1998; Rehmsmeier and Vingron, 2001). For example, a knowledge of phylogeny is vital in determining whether a set of sequences are orthologous or paralogous (Page and Charleston, 1997; Yuan et al., 1998; Storm and Sonnhammer, 2001; Zmasek and Eddy, 2001), which in turn has implications for predicting the function of a novel sequence (Eisen, 1998). Indeed, it is increasingly common for protein family databases to include gene phylogenies in addition to alignments. Examples include HOVERGEN (http://pbil.univ-lyon1.fr/databases/hovergen.html; Duret et al., 1994), SYSTERS (http://systers.molgen.mpg.de; Krause et al., 2000), and COPSE (http://copse.molgen. mpg.de). Phylogenetic analysis at the level of whole genomes poses new analytical challenges (Kim and Salisbury, 2001; Korbel et al., 2002; Wang et al., 2002), but promises new insights into genomic evolution. In some cases, the role of phylogeny might not be either obvious or explicit, so that many people may well have built phylogenetic trees without necessarily realizing it. The popular multiple sequence alignment program Clustal (UNIT 2.3) builds a phylogeny (the “guide tree”) every time it aligns sequences.
    [Show full text]
  • TESE Kelma Sirleide De Souza.Pdf
    UNIVERSIDADE FEDERAL DE PERNAMBUCO CENTRO DE CIÊNCIAS BIOLÓGICAS PROGRAMA DE PÓS-GRADUAÇÃO EM CIÊNCIAS BIOLÓGICAS KELMA SIRLEIDE DE SOUZA Efeitos bioquímicos e genotóxicos de poluentes na ostra Crassostrea sp., na região norte do complexo estuarino Canal de Santa Cruz, litoral norte de Pernambuco Recife 2016 KELMA SIRLEIDE DE SOUZA Efeitos bioquímicos e genotóxicos de poluentes na ostra Crassostrea sp., na região norte do complexo estuarino Canal de Santa Cruz, litoral norte de Pernambuco Tese apresentada ao Programa de Pós- Graduação em Ciências Biológicas da Universidade Federal de Pernambuco como pré- requisito para a obtenção do grau de doutor em Ciências Biológicas. Orientador: Prof. Dr. Ranilson de Souza Bezerra Co- Orientador: Dr. Caio Rodrigo Dias de Assis Recife 2016 Catalogação na fonte Elaine Barroso CRB 1728 Souza, Kelma Sirleide de Efeitos bioquímicos e genotóxicos de poluentes na ostra Crassostrea sp. na região norte do complexo estuarino Canal de Santa Cruz, litoral norte de Pernambuco / Kelma Sirleide de Souza - Recife: O Autor, 2016. 91 folhas: il., fig., tab. Orientador: Ranilson de Souza Bezerra Coorientador: Caio Rodrigo Silva de Assis Tese (doutorado) – Universidade Federal de Pernambuco. Centro de Biociências. Ciências Biológicas, 2016. Inclui referências 1. Ostras 2. Estuários 3. Santa Cruz, Canal de (PE) I. Bezerra, Ranilson de Souza (orient.) II. Assis, Caio Rodrigo Silva de (coorient.) III. Título 594.4 CDD (22.ed.) UFPE/CB-2017- 406 KELMA SIRLEIDE DE SOUZA Efeitos bioquímicos e genotóxicos de poluentes na ostra Crassostrea sp., na região norte do complexo estuarino Canal de Santa Cruz, litoral norte de Pernambuco Tese apresentada ao Programa de Pós- Graduação em Ciências Biológicas da Universidade Federal de Pernambuco como pré- requisito para a obtenção do grau de doutor em Ciências Biológicas.
    [Show full text]
  • Romanesco Documentation Release 0.1.0
    Romanesco Documentation Release 0.1.0 Kitware, Inc. January 27, 2016 Contents 1 What is Romanesco? 1 1.1 Installation................................................1 1.2 Configuration...............................................1 1.3 Types and formats............................................2 1.4 API documentation............................................5 1.5 Developer documentation........................................ 11 1.6 Plugins.................................................. 13 2 Indices and tables 17 Python Module Index 19 i ii CHAPTER 1 What is Romanesco? Romanesco is a python application for generic task execution. It can be run within a celery worker to provide a distributed batch job execution platform. The application can run tasks in a variety of languages and environments, including python, R, spark, and docker, all via a single python or celery broker interface. Tasks can be chained together into workflows, and these workflows can actually span multiple languages and environments seamlessly. Data flowing between tasks can be automatically converted into a format understandable in the target environment. For example, a python object from a python task can be automatically converted into an R object for an R task at the next stage of a pipeline. Romanesco defines a specification that prescribes a loose coupling between a task and its runtime inputs and outputs. That specification is described in the API documentation section. This specification is language-independent and instances of the spec are best represented by a hierarchical data format such as JSON or YAML, or an equivalent serializable type such as a dict in python. Romanesco is designed to be easily extended to new languages and environments, or to support new data types and formats, or modes of data transfer.
    [Show full text]
  • Tutorial: Environment for Tree Exploration Release 3.0.0B7
    Tutorial: Environment for Tree Exploration Release 3.0.0b7 Jaime Huerta-Cepas November 25, 2015 Contents 1 Changelog history3 1.1 What’s new in ETE 2.3...................................3 1.2 What’s new in ETE 2.2...................................5 1.3 What’s new in ETE 2.1...................................9 2 The ETE tutorial 13 2.1 Working With Tree Data Structures............................ 13 2.2 The Programmable Tree Drawing Engine......................... 43 2.3 Phylogenetic Trees..................................... 64 2.4 Clustering Trees...................................... 80 2.5 Phylogenetic XML standards............................... 85 2.6 Interactive web tree visualization............................. 93 2.7 Testing Evolutionary Hypothesis.............................. 95 2.8 Dealing with the NCBI Taxonomy database........................ 105 2.9 SCRIPTS: orthoXML................................... 108 3 ETE’s Reference Guide 115 3.1 Master Tree class...................................... 115 3.2 Treeview module...................................... 127 3.3 PhyloTree class....................................... 138 3.4 Clustering module..................................... 141 3.5 Nexml module....................................... 142 3.6 Phyloxml Module..................................... 158 3.7 Seqgroup class....................................... 161 3.8 WebTreeApplication object................................ 161 3.9 EvolTree class....................................... 162 3.10 NCBITaxa class.....................................
    [Show full text]
  • User Manual for Splitstree4 V4.6
    User Manual for SplitsTree4 V4.6 Daniel H. Huson and David Bryant August 4, 2006 Contents Contents 1 1 Introduction 4 2 Getting Started 5 3 Obtaining and Installing the Program 5 4 Program Overview 6 5 Splits, Trees and Networks 7 6 Opening, Reading and Writing Files 10 7 Estimating Distances 10 1 8 Building and Processing Trees 11 9 Building and Drawing Networks 11 10 Main Window 12 10.1 Network Tab ........................................ 13 10.2 Data Tab .......................................... 13 10.3 Source Tab ......................................... 13 10.4 Tool bar ........................................... 13 11 Graphical Interaction with the Network 13 12 Main Menus 14 12.1 File Menu .......................................... 14 12.2 Edit Menu .......................................... 16 12.3 View Menu ......................................... 16 12.4 Data Menu ......................................... 17 12.5 Distances Menu ....................................... 19 12.6 Trees Menu ......................................... 19 12.7 Network Menu ....................................... 20 12.8 Analysis Menu ....................................... 21 12.9 Draw Menu ......................................... 21 12.10Window Menu ....................................... 22 12.11Configuring Methods .................................... 23 13 Popup Menus 23 14 Tool Bar 24 15 Pipeline Window 24 15.1 Taxa Tab .......................................... 25 15.2 Unaligned Tab ....................................... 25 15.3 Characters Tab
    [Show full text]
  • Load-Balance and Fault-Tolerance for Massively Parallel Phylogenetic Inference
    Load-Balance and Fault-Tolerance for Massively Parallel Phylogenetic Inference Master’s Thesis of Klaus Lukas Hübner at the Department of Informatics Institute of Theoretical Informatics, Algorithmics II Reviewer: Prof. Dr. Alexandros Stamatakis Second reviewer: Prof. Dr. Peter Sanders Advisor: Dr. Alexey Kozlov Second advisor: M.Sc. Demian Hespe 01 January 2020 – 30 June 2020 Abstract Upcoming exascale supercomputers will comprise hundreds of thousands of CPUs. Scientic applications on these supercomputers will face two major challenges: Hardware failures, and parallelization eciency. We extend RAxML-ng, a widely used tool to build phylogenetic trees, to mitigate hardware failures without user intervention. For this, we increase the checkpointing frequency. We also detect failures, redistribute the work among the surviving ranks, restore a consistent search state, and restart the tree search automatically. RAxML-ng now supports fault tolerance in the tree search mode, using multiple starting trees, and multiple alignment data partitions. RAxML-ng can handle multiple failures at once as well as multiple successive failures. There is no limit on the number of failures that can occur simultaneously or sequentially. We also support mitigating failures which occur during the recovery of a previous failure or during checkpointing. In contrast to the previously available manual recovery scheme, a recovery is initiated automatically after a failure, that is, the user does not have to take any action. We benchmark our algorithms for checkpointing and recovery. In our experiments, creating a checkpoint of the model parameters requires at most 72.0 ± 0.9 ms (400 ranks, 4,116 partitions). Creating a checkpoint of the tree topology requires at most 0.575 ± 0.006 ms (1,879 taxa).
    [Show full text]
  • Efficient Coalescent Simulation and Genealogical Analysis for Large Sample Sizes
    RESEARCH ARTICLE Efficient Coalescent Simulation and Genealogical Analysis for Large Sample Sizes Jerome Kelleher1*, Alison M Etheridge2, Gilean McVean1,2,3 1 Wellcome Trust Centre for Human Genetics, University of Oxford, Oxford, United Kingdom, 2 Department of Statistics, University of Oxford, Oxford, United Kingdom, 3 Li Ka Shing Centre for Health Information and Discovery, University of Oxford, Oxford, United Kingdom * [email protected] Abstract A central challenge in the analysis of genetic variation is to provide realistic genome simula- tion across millions of samples. Present day coalescent simulations do not scale well, or use approximations that fail to capture important long-range linkage properties. Analysing the results of simulations also presents a substantial challenge, as current methods to store OPEN ACCESS genealogies consume a great deal of space, are slow to parse and do not take advantage of Citation: Kelleher J, Etheridge AM, McVean G shared structure in correlated trees. We solve these problems by introducing sparse trees (2016) Efficient Coalescent Simulation and Genealogical Analysis for Large Sample Sizes. PLoS and coalescence records as the key units of genealogical analysis. Using these tools, exact Comput Biol 12(5): e1004842. doi:10.1371/journal. simulation of the coalescent with recombination for chromosome-sized regions over hun- pcbi.1004842 dreds of thousands of samples is possible, and substantially faster than present-day Editor: Yun S. Song, UC Berkeley, UNITED STATES approximate methods. We can also analyse the results orders of magnitude more quickly Received: December 10, 2015 than with existing methods. Accepted: March 2, 2016 Published: May 4, 2016 Copyright: © 2016 Kelleher et al.
    [Show full text]
  • Dendropy Tutorial Release 3.12.1
    DendroPy Tutorial Release 3.12.1 Jeet Sukumaran and Mark T. Holder March 22, 2014 Contents i ii CHAPTER 1 Phylogenetic Data in DendroPy 1.1 Introduction to Phylogenetic Data Objects 1.1.1 Types of Phylogenetic Data Objects Phylogenetic data in DendroPy is represented by one or more objects of the following classes: Taxon A representation of an operational taxonomic unit, with an attribute, label, corresponding to the taxon label. TaxonSet A collection of Taxon objects representing a distinct definition of taxa (for example, as specified explicitly in a NEXUS “TAXA” block, or implicitly in the set of all taxon labels used across a Newick tree file). Tree A collection of Node and Edge objects representing a phylogenetic tree. Each Tree object maintains a reference to a TaxonSet object in its attribute, taxon_set, which specifies the set of taxa that are referenced by the tree and its nodes. Each Node object has a taxon attribute (which points to a particular Taxon object if there is an operational taxonomic unit associated with this node, or is None if not), a parent_node attribute (which will be None if the Node has no parent, e.g., a root node), a Edge attribute, as well as a list of references to child nodes, a copy of which can be obtained by calling child_nodes. TreeList A list of Tree objects. A TreeList object has an attribute, taxon_set, which speci- fies the set of taxa that are referenced by all member Tree elements. This is enforced when a Tree object is added to a TreeList, with the TaxonSet of the Tree object and all Taxon references of the Node objects in the Tree mapped to the TaxonSet of the TreeList.
    [Show full text]
  • Rutger Aldo Vos Doctorandus, Universiteit Van Amsterdam, 2000 THESIS SUBMITTED in PARTIAL FULFILLMENT of the REQUIREMENTS for TH
    Rutger Aldo Vos Doctorandus, Universiteit van Amsterdam, 2000 THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY in the Department of Biological Sciences 0Rutger Aldo Vos, 2006 SIMON FRASER UNIVERSITY Summer, 2006 All rights reserved. This work may not be reproduced in whole or in part, by photocopy or other means, without permission of the author. APPROVAL Name: Rutger Aldo Vos Degree: Doctor of Philosophy Title of Thesis: Inferring large phylogenies: The big tree problem Examining Committee: Chair: Dr. H. Hutter, Associate Professor Dr. A. Mooers, Assistant Professor, Senior Supervisor Department of Biological Sciences, S.F.U. Dr. W. Maddison, Professor Departments of Zoology and Botany, University of British Columbia Dr. B. Crespi, Professor Department of Biological Sciences, S.F.U. Dr. S. Graham, Assistant Professor Botanical Garden & Centre for Plant Research, and Department of Botany, University of British Columbia Public Examiner Dr. R. Page, Professor Division of Environmental and Evolutionary Biology, University of Glasgow External Examiner 12 May 2006 Date Approved SIMON FRASER UNI~ER~IW~~brary DECLARATION OF PARTIAL COPYRIGHT LICENCE The author, whose copyright is declared on the title page of this work, has granted to Simon Fraser University the right to lend this thesis, project or extended essay to users of the Simon Fraser University Library, and to make partial or single copies only for such users or in response to a request from the library of any other university, or other educational institution, on its own behalf or for one of its users. The author has further granted permission to Simon Fraser University to keep or make a digital copy for use in its circulating collection, and, without changing the content, to translate the thesislproject or extended essays, if technically possible, to any medium or format for the purpose of preservation of the digital work.
    [Show full text]