A Search-Based Approach to Chimera Identification for 16S Rrna

Total Page:16

File Type:pdf, Size:1020Kb

A Search-Based Approach to Chimera Identification for 16S Rrna DECIPHER: A Search-Based Approach to Chimera Identification for 16S rRNA Sequences Erik S. Wright ([email protected]), L. Safak Yilmaz, Daniel R. Noguera Introduction Methods Results Why are chimeras bad? How do you find chimeras with DECIPHER? What is the accuracy of this method? This method for chimera finding was derived by modeling a set of several hundred The method was validated by testing thousands of artificially generated chimeras real chimeric sequences present in public sequence repositories and thousands of developed by joining the rRNA sequences of randomly selected isolate organisms. artificial chimeras generated from the rRNA sequence of isolated organisms: Using this method resulted in many chimeras that were frequently difcult to 1. Break classified sequence into overlapping 30 nucleotide fragments: diferentiate from their parent sequences. Therefore, this sequence set served as an excellent benchmark for comparison between diferent chimera finding programs. 3.0% 40% fs_DECIPHER 35% 2.5% ss_DECIPHER fs_DECIPHER 30% 2. Categorize fragments by prevalence (search hits): 2.0% - High frequency in classified group: ss_DECIPHER 25% 1.5% 20% 15% 1.0% FalseNegatives 10% Chimeras are DNA sequences of - Low frequency in-group and high frequency out-of-group CumulativeFalsePositives 0.5% mythical organisms that can cause (suspect fragments): 5% false interpretations of diversity. 0.0% 0% 3. Apply Rules to chimeric region: 100 300 500 700 900 1100 1300 1500 100 300 500 700 900 1100 1300 1500 - At least 6 suspect fragments for full-length sequences (fs): Max. Sequence Length (nucleotides) Sequence Length (nucleotides) Which one of these sequences is a chimera? At least 2 suspect fragments for short-length sequences (ss): How did this method compare to others? - At least 70 nucleotides long for full-length sequences (fs): Qualitative rating for each DECIPHER1 Chimera Pintail4 Uchime2 characteristic fs ss Slayer3 (WigeoN) At least 40 nucleotides long for short-length sequences (ss): Detection in short sequences + +++ ++++ + + Detection in mid-range sequences + ++++ +++ ++ + - At least 1 nucleotide overlapping first or last 200 nucleotides: Detection in long sequences +++ ++++ +++ ++ ++ Detection of short chimeric regions ++ ++++ ++ ++ + Detection of complex chimeras ++++ ++++ ++++ + +++ - Greater than 60% coverage with suspect fragments: Detection of chimeras from low + + ++++ +++ + Where do chimeras come from? divergence parents Independence from reference dataset +++ +++ ++ ++ ++ Low false positives ++++ ++ ++ +++ ++ Imagine a single strand of DNA represented by a line: How was this applied to a real problem? 100% 100% Major public DNA sequences 2.0% repositories contain millions of 80% 80% There might be a lesion in the 16S Ribosomal RNA sequences. ss_DECIPHER 1.5% 60% 60% DNA strand caused by age, UV fs_DECIPHER Uchime radiation, or some other factor: 1.0% The curators of these databases ss_DECIPHER 40% 40% ChimeraSlayer 0.5% screen for sequence abnormalities fs_DECIPHER WigeoN RDP Silva greengenes Percent Detection such as chimeras, yet additional Uchime Percent Detection 20% 20% During PCR DNA Polymerase 0% chimeras are still present in these ChimeraSlayer WigeoN replicates the single strand of DNA: Sequences Chimeric public sequence repositories. 0% 0% 0 500 1000 1500 0 100 200 300 400 500 600 700 Sequence Length (nucleotides) Length of Chimeric Range (nucleotides) When DNA Polymerase reaches the lesion it may stop replication: How was the solution implemented? Where is there more information? Hundreds of thousands of suspect fragments A,C Find chimeras online at: In the next PCR cycle, can be queried against a set of over a million 0 C,G T,C the incomplete template 16S rRNA sequences. This is accomplished in DECIPHER.cee.wisc.edu may serve as a primer: linear time by using an Aho-Corasick string Contact Erik at: search algorithm. This method requires pre- T A G [email protected] processing the 30-mer fragments into a finite 1. Wright, E. S., Yilmaz L. S., and Noguera D. R. 2012. “DECIPHER: A Search-Based Approach to Chimera state machine that enables querying for all of Identification for 16S rRNA Sequences”, Appl. Environ. Microbiol., doi:10.1128/AEM.06516-11. Resulting in a PCR product that is a concatenation the sequence patterns simultaneously. 2. Edgar, R. C., B. J. Haas, J. C. Clemente, C. Quince, and R. Knight. 2011. UCHIME improves sensitivity and C G speed of chimera detection. Bioinformatics:Epub ahead of print, doi: 10.1093/bioinformatics/btr1381. of two diferent organism’s DNA sequence: 3. Quince, C., A. Lanzen, T. P. Curtis, R. J. Davenport, N. Hall, I. M. Head, L. F. Read, and W. T. Sloan. 2009. The example shows the state A Accurate determination of microbial diversity from 454 pyrosequencing data. Nat. Methods 6:639-U627. machine for the pattern set: 4. Ashelford, K. E., N. A. Chuzhanova, J. C. Fry, A. J. Jones, and A. J. Weightman. 2005. At least 1 in 20 16S {TG, TCA, TCT, GA}. A T rRNA sequence records currently held in public repositories is estimated to contain substantial anomalies. Appl. Environ. Microbiol. 71:7724-7736..
Recommended publications
  • DECIPHER: Harnessing Local Sequence Context to Improve Protein Multiple Sequence Alignment Erik S
    Wright BMC Bioinformatics (2015) 16:322 DOI 10.1186/s12859-015-0749-z RESEARCH ARTICLE Open Access DECIPHER: harnessing local sequence context to improve protein multiple sequence alignment Erik S. Wright1,2 Abstract Background: Alignment of large and diverse sequence sets is a common task in biological investigations, yet there remains considerable room for improvement in alignment quality. Multiple sequence alignment programs tend to reach maximal accuracy when aligning only a few sequences, and then diminish steadily as more sequences are added. This drop in accuracy can be partly attributed to a build-up of error and ambiguity as more sequences are aligned. Most high-throughput sequence alignment algorithms do not use contextual information under the assumption that sites are independent. This study examines the extent to which local sequence context can be exploited to improve the quality of large multiple sequence alignments. Results: Two predictors based on local sequence context were assessed: (i) single sequence secondary structure predictions, and (ii) modulation of gap costs according to the surrounding residues. The results indicate that context-based predictors have appreciable information content that can be utilized to create more accurate alignments. Furthermore, local context becomes more informative as the number of sequences increases, enabling more accurate protein alignments of large empirical benchmarks. These discoveries became the basis for DECIPHER, a new context-aware program for sequence alignment, which outperformed other programs on largesequencesets. Conclusions: Predicting secondary structure based on local sequence context is an efficient means of breaking the independence assumption in alignment. Since secondary structure is more conserved than primary sequence, it can be leveraged to improve the alignment of distantly related proteins.
    [Show full text]
  • Analysis the Structure of SAM and Cracking Password Base on Windows Operating System
    International Journal of Future Computer and Communication, Vol. 5, No. 2, April 2016 Analysis the Structure of SAM and Cracking Password Base on Windows Operating System Jiang Du and Jiwei Li latest Windows 10, the registry contains information that Abstract—Cracking Windows account password is critical to Windows continually references during operation, such as the forensic analyst. The general methods of decipher password profiles for each user, the applications installed on the include clean the password, guess by social engineering, computer and the types of documents, property sheet settings mathematical analyzing, exhaustive attacking, dictionary attacking and rainbow tables algorithm. This paper provides the of folders and application icons, what hardware exists on the details about the Security Account Manager(SAM) database system, and the ports that are being used [3]. On disk, the and describes how to get the user information from SAM and Windows registry is not only a large file but a set of discrete cracks account password of Windows 10 that the latest files called hives. Each hive is a hierarchical tree which operating system of Microsoft. identified by a root key to provide access to all sub-keys in the tree up to 512 levels deep. Index Terms—SAM, decipher password, crack password, Windows 10. III. SECURITY ACCOUNT MANAGER (SAM) I. INTRODUCTION Security Account Manager (SAM) is a database used to In the process of computer forensic the analyst need to store user account information, including password, account enter the Windows operating system by cracking windows groups, access rights, and special privileges in Windows account password to collect evidence at times.
    [Show full text]
  • Decipher Prostate Cancer Classifier
    Lab Management Guidelines v2.0.2019 Decipher Prostate Cancer Classifier MOL.TS.294.A v2.0.2019 Procedures addressed The inclusion of any procedure code in this table does not imply that the code is under management or requires prior authorization. Refer to the specific Health Plan's procedure code list for management requirements. Procedures addressed by this Procedure codes guideline Decipher Prostate Cancer Classifier 81479 What are gene expression profiling tests for prostate cancer Definition Prostate cancer (PC) is the most common cancer and a leading cause of cancer- related deaths worldwide. It is considered a heterogeneous disease with highly variable prognosis.1 High-risk prostate cancer (PC) patients treated with radical prostatectomy (RP) undergo risk assessment to assess future disease prognosis and determine optimal treatment strategies. Post-RP pathology findings, such as disease stage, baseline Gleason score, time of biochemical recurrence (BCR) after RP, and PSA doubling- time, are considered strong predictors of disease-associated metastasis and mortality. Following RP, up to 50% of patients have pathology or clinical features that are considered at high risk of recurrence and these patients usually undergo post-RP treatments, including adjuvant or salvage therapy or radiation therapy, which can have serious risks and complications. According to clinical practice guideline recommendations, high risk patients should undergo 6 to 8 weeks of radiation therapy (RT) following RP. However, approximately 90% of high-risk patients
    [Show full text]
  • Comparing Tools for Non-Coding RNA Multiple Sequence Alignment Based On
    Downloaded from rnajournal.cshlp.org on September 26, 2021 - Published by Cold Spring Harbor Laboratory Press ES Wright 1 1 TITLE 2 RNAconTest: Comparing tools for non-coding RNA multiple sequence alignment based on 3 structural consistency 4 Running title: RNAconTest: benchmarking comparative RNA programs 5 Author: Erik S. Wright1,* 6 1 Department of Biomedical Informatics, University of Pittsburgh (Pittsburgh, PA) 7 * Corresponding author: Erik S. Wright ([email protected]) 8 Keywords: Multiple sequence alignment, Secondary structure prediction, Benchmark, non- 9 coding RNA, Consensus secondary structure 10 Downloaded from rnajournal.cshlp.org on September 26, 2021 - Published by Cold Spring Harbor Laboratory Press ES Wright 2 11 ABSTRACT 12 The importance of non-coding RNA sequences has become increasingly clear over the past 13 decade. New RNA families are often detected and analyzed using comparative methods based on 14 multiple sequence alignments. Accordingly, a number of programs have been developed for 15 aligning and deriving secondary structures from sets of RNA sequences. Yet, the best tools for 16 these tasks remain unclear because existing benchmarks contain too few sequences belonging to 17 only a small number of RNA families. RNAconTest (RNA consistency test) is a new 18 benchmarking approach relying on the observation that secondary structure is often conserved 19 across highly divergent RNA sequences from the same family. RNAconTest scores multiple 20 sequence alignments based on the level of consistency among known secondary structures 21 belonging to reference sequences in their output alignment. Similarly, consensus secondary 22 structure predictions are scored according to their agreement with one or more known structures 23 in a family.
    [Show full text]
  • Getting Started Deciphering
    Getting Started DECIPHERing Erik S. Wright May 19, 2021 Contents 1 About DECIPHER 1 2 Design Philosophy 2 2.1 Curators Protect the Originals . 2 2.2 Don't Reinvent the Wheel . 2 2.3 That Which is the Most Difficult, Make Fastest . 2 2.4 Stay Organized . 2 3 Functionality 3 4 Installation 5 4.1 Typical Installation (recommended) . 5 4.2 Manual Installation . 5 4.2.1 All platforms . 5 4.2.2 MacOSX........................................... 6 4.2.3 Linux ............................................. 6 4.2.4 Windows ........................................... 6 5 Example Workflow 6 6 Session Information 11 1 About DECIPHER DECIPHER is a software toolset that can be used for deciphering and managing biological sequences efficiently using the R statistical programming language. The program features tools falling into five categories: Sequence databases: import, maintain, view, and export a massive number of sequences. Sequence alignment: accurately align thousands of DNA, RNA, or amino acid sequences. Quickly find and align the syntenic regions of multiple genomes. Oligo design: test oligos in silico, or create new primer and probe sequences optimized for a variety of objectives. Manipulate sequences: trim low quality regions, correct frameshifts, reorient nucleotides, determine consensus, or digest with restriction enzymes. Analyze sequences: find chimeras, classify into a taxonomy of organisms or functions, detect repeats, predict secondary structure, create phylogenetic trees, and reconstruct ancestral states. 1 Gene finding: predict coding and non-coding genes in a genome, extract them from the genome, and export them to a file. DECIPHER is available under the terms of the GNU Public License version 3. 2 Design Philosophy 2.1 Curators Protect the Originals One of the core principles of DECIPHER is the idea of the non-destructive workflow.
    [Show full text]
  • Basics of UNIX
    Basics of UNIX August 23, 2012 By UNIX, I mean any UNIX-like operating system, including Linux and Mac OS X. On the Mac you can access a UNIX terminal window with the Terminal application (under Applica- tions/Utilities). Most modern scientific computing is done on UNIX-based machines, often by remotely logging in to a UNIX-based server. 1 Connecting to a UNIX machine from {UNIX, Mac, Windows} See the file on bspace on connecting remotely to SCF. In addition, this SCF help page has infor- mation on logging in to remote machines via ssh without having to type your password every time. This can save a lot of time. 2 Getting help from SCF More generally, the department computing FAQs is the place to go for answers to questions about SCF. For questions not answered there, the SCF requests: “please report any problems regarding equipment or system software to the SCF staff by sending mail to ’trouble’ or by reporting the prob- lem directly to room 498/499. For information/questions on the use of application packages (e.g., R, SAS, Matlab), programming languages and libraries send mail to ’consult’. Questions/problems regarding accounts should be sent to ’manager’.” Note that for the purpose of this class, questions about application packages, languages, li- braries, etc. can be directed to me. 1 3 Files and directories 1. Files are stored in directories (aka folders) that are in a (inverted) directory tree, with “/” as the root of the tree 2. Where am I? > pwd 3. What’s in a directory? > ls > ls -a > ls -al 4.
    [Show full text]
  • Comparing Tools for Noncoding RNA Multiple Sequence Alignment Based on Structural Consistency
    Downloaded from rnajournal.cshlp.org on September 29, 2021 - Published by Cold Spring Harbor Laboratory Press BIOINFORMATICS RNAconTest: comparing tools for noncoding RNA multiple sequence alignment based on structural consistency ERIK S. WRIGHT Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania 15219, USA ABSTRACT The importance of noncoding RNA sequences has become increasingly clear over the past decade. New RNA families are often detected and analyzed using comparative methods based on multiple sequence alignments. Accordingly, a number of programs have been developed for aligning and deriving secondary structures from sets of RNA sequences. Yet, the best tools for these tasks remain unclear because existing benchmarks contain too few sequences belonging to only a small number of RNA families. RNAconTest (RNA consistency test) is a new benchmarking approach relying on the obser- vation that secondary structure is often conserved across highly divergent RNA sequences from the same family. RNAconTest scores multiple sequence alignments based on the level of consistency among known secondary structures belonging to reference sequences in their output alignment. Similarly, consensus secondary structure predictions are scored according to their agreement with one or more known structures in a family. Comparing the performance of 10 popular alignment programs using RNAconTest revealed that DAFS, DECIPHER, LocARNA, and MAFFT created the most structurally consistent alignments. The best consensus secondary structure predictions were generated by DAFS and LocARNA (via RNAalifold). Many of the methods specific to noncoding RNAs exhibited poor scalability as the number or length of input sequences increased, and several programs displayed substantial declines in score as more sequences were aligned.
    [Show full text]
  • Using DECIPHER V2.0 to Analyze Big Biological Sequence Data in R by Erik S
    CONTRIBUTED RESEARCH ARTICLES 352 Using DECIPHER v2.0 to Analyze Big Biological Sequence Data in R by Erik S. Wright Abstract In recent years, the cost of DNA sequencing has decreased at a rate that has outpaced improvements in memory capacity. It is now common to collect or have access to many gigabytes of biological sequences. This has created an urgent need for approaches that analyze sequences in subsets without requiring all of the sequences to be loaded into memory at one time. It has also opened opportunities to improve the organization and accessibility of information acquired in sequencing projects. The DECIPHER package offers solutions to these problems by assisting in the curation of large sets of biological sequences stored in compressed format inside a database. This approach has many practical advantages over standard bioinformatics workflows, and enables large analyses that would otherwise be prohibitively time consuming. Introduction With the advent of next-generation sequencing technologies, the cost of sequencing DNA has plum- meted, facilitating a deluge of biological sequences (Hayden, 2014). Since the cost of computer storage space has not kept pace with biologists’ ability to generate data, multiple compression methods have been developed for compactly storing nucleotide sequences (Deorowicz and Grabowski, 2013). These methods are critical for efficiently transmitting and preserving the outputs of next-generation sequencing machines. However, far less emphasis has been placed on the organization and usability of the massive amounts of biological sequences that are now routine in bioinformatics work. It is still commonplace to decompress large files and load them entirely into memory before analyses are performed.
    [Show full text]
  • Trend Micro Apex One™ (Mac) 2019 Administrator's Guide
    Trend Micro Incorporated reserves the right to make changes to this document and to the product described herein without notice. Before installing and using the product, review the readme files, release notes, and/or the latest version of the applicable documentation, which are available from the Trend Micro website at: http://docs.trendmicro.com/en-us/enterprise/apex-one-(mac).aspx Trend Micro, the Trend Micro t-ball logo, Trend Micro Apex One, Worry-Free, and TrendLabs are trademarks or registered trademarks of Trend Micro Incorporated. All other product or company names may be trademarks or registered trademarks of their owners. Copyright © 2019. Trend Micro Incorporated. All rights reserved. Document Part No.: APEM08506/181016 Release Date: March 2019 Protected by U.S. Patent No.: Patents pending. This documentation introduces the main features of the product and/or provides installation instructions for a production environment. Read through the documentation before installing or using the product. Detailed information about how to use specific features within the product may be available at the Trend Micro Online Help Center and/or the Trend Micro Knowledge Base. Trend Micro always seeks to improve its documentation. If you have questions, comments, or suggestions about this or any Trend Micro document, please contact us at [email protected]. Evaluate this documentation on the following site: http://www.trendmicro.com/download/documentation/rating.asp Privacy and Personal Data Collection Disclosure Certain features available in Trend Micro products collect and send feedback regarding product usage and detection information to Trend Micro. Some of this data is considered personal in certain jurisdictions and under certain regulations.
    [Show full text]
  • Getting Started Deciphering
    Getting Started DECIPHERing Erik S. Wright October 29, 2020 Contents 1 About DECIPHER 1 2 Design Philosophy 2 2.1 Curators Protect the Originals . 2 2.2 Don't Reinvent the Wheel . 2 2.3 That Which is the Most Difficult, Make Fastest . 2 2.4 Stay Organized . 2 3 Functionality 3 4 Installation 5 4.1 Typical Installation (recommended) . 5 4.2 Manual Installation . 5 4.2.1 All platforms . 5 4.2.2 MacOSX........................................... 5 4.2.3 Linux ............................................. 6 4.2.4 Windows ........................................... 6 5 Example Workflow 6 6 Session Information 11 1 About DECIPHER DECIPHER is a software toolset that can be used for deciphering and managing biological sequences efficiently using the R statistical programming language. The program features tools falling into five categories: Sequence databases: import, maintain, view, and export a massive number of sequences. Sequence alignment: accurately align thousands of DNA, RNA, or amino acid sequences. Quickly find and align the syntenic regions of multiple genomes. Oligo design: test oligos in silico, or create new primer and probe sequences optimized for a variety of objectives. Manipulate sequences: trim low quality regions, correct frameshifts, reorient nucleotides, determine consensus, or digest with restriction enzymes. Analyze sequences: find chimeras, classify into a taxonomy of organisms or functions, predict secondary structure, create phylogenetic trees, and reconstruct ancestral states. 1 Gene finding: predict genes in a genome, extract them from the genome, and export them to a file. DECIPHER is available under the terms of the GNU Public License version 3. 2 Design Philosophy 2.1 Curators Protect the Originals One of the core principles of DECIPHER is the idea of the non-destructive workflow.
    [Show full text]
  • Eeiiiiiiimanual Supplement Strategies for Direct
    Downloaded from genome.cshlp.org on September 28, 2021 - Published by Cold Spring Harbor Laboratory Press EEIIIIIIIManual Supplement The amplification of target DNA by PCR (1) followed by direct sequencing of Strategies amplified DNA(2~ has emerged as a powerful strategy for rapid molecular for Direct genetic analysis. Using this strategy, the time-consuming cloning steps can be bypassed completely, and the sequence of the target DNA can be determined Sequencing of directly from a crude biological sample. The crude sample can be cultured PCR-amplified cells, bacteria, or a viral preparation. Furthermore, the copy number of target DNA in the sample can be as low as one to a few molecules of genomic DNA DNA among a vast excess of contaminating nontarget DNA. (3'4) This review de- scribes two sequencing strategies. These would allow generation of DNA se- quence from almost any PCR-amplified DNA template. In addition, factors Venigalla B. Rao that influence the sequencing reactions that would allow manipulation of these strategies for specific sequencing needs are discussed. For a more com- Department of Biology, Institute prehensive analysis of the direct sequencing strategy, the reader is referred to for Biomolecular Studies, The reviews by Gyllesten (2) and Rao. (s) Catholic University of America, Washington, D.C. 20064 SEQUENASE STRATEGY This strategy consists of three steps. (6~ In the first step, the double-stranded PCR-amplified DNA is denatured to single strands, and the sequencing primer is annealed to the complementary sequence on one of the template strands. In the second step, the annealed primer is extended by DNA polymerase by 20-80 nucleotides, incorporating multiple radioactive labels into the newly synthesized DNA.
    [Show full text]
  • DECIPHER.Pdf
    Package ‘DECIPHER’ September 28, 2021 Type Package Title Tools for curating, analyzing, and manipulating biological sequences Version 2.21.0 Date 2021-05-18 Author Erik Wright Maintainer Erik Wright <[email protected]> biocViews Clustering, Genetics, Sequencing, DataImport, Visualization, Microarray, QualityControl, qPCR, Alignment, WholeGenome, Microbiome, ImmunoOncology, GenePrediction Description A toolset for deciphering and managing biological sequences. Depends R (>= 3.5.0), Biostrings (>= 2.59.1), RSQLite (>= 1.1), stats, parallel Imports methods, DBI, S4Vectors, IRanges, XVector LinkingTo Biostrings, S4Vectors, IRanges, XVector License GPL-3 ByteCompile true git_url https://git.bioconductor.org/packages/DECIPHER git_branch master git_last_commit 7cad0ab git_last_commit_date 2021-05-19 Date/Publication 2021-09-28 R topics documented: DECIPHER-package . .3 AA_REDUCED . .6 Add2DB . .7 AdjustAlignment . .8 AlignDB . 10 1 2 R topics documented: AlignProfiles . 13 AlignSeqs . 17 AlignSynteny . 20 AlignTranslation . 21 AmplifyDNA . 23 Array2Matrix . 26 BrowseDB . 27 BrowseSeqs . 28 CalculateEfficiencyArray . 32 CalculateEfficiencyFISH . 34 CalculateEfficiencyPCR . 36 Codec . 38 ConsensusSequence . 39 Cophenetic . 42 CorrectFrameshifts . 43 CreateChimeras . 46 DB2Seqs . 48 deltaGrules . 50 deltaHrules . 51 deltaHrulesRNA . 52 deltaSrules . 53 deltaSrulesRNA . 54 DesignArray . 55 DesignPrimers . 57 DesignProbes . 61 DesignSignatures . 64 DetectRepeats . 68 DigestDNA . 71 Disambiguate . 72 DistanceMatrix . 73 ExtractGenes . 76 FindChimeras
    [Show full text]