HMMER User's Guide

Total Page:16

File Type:pdf, Size:1020Kb

HMMER User's Guide HMMER User’s Guide Biological sequence analysis using profile hidden Markov models http://hmmer.org/ Version 3.0rc1; February 2010 Sean R. Eddy for the HMMER Development Team Janelia Farm Research Campus 19700 Helix Drive Ashburn VA 20147 USA http://eddylab.org/ Copyright (C) 2010 Howard Hughes Medical Institute. Permission is granted to make and distribute verbatim copies of this manual provided the copyright notice and this permission notice are retained on all copies. HMMER is licensed and freely distributed under the GNU General Public License version 3 (GPLv3). For a copy of the License, see http://www.gnu.org/licenses/. HMMER is a trademark of the Howard Hughes Medical Institute. 1 Contents 1 Introduction 5 How to avoid reading this manual . 5 How to avoid using this software (links to similar software) . 5 What profile HMMs are . 5 Applications of profile HMMs . 6 Design goals of HMMER3 . 7 What’s still missing in HMMER3 . 8 How to learn more about profile HMMs . 9 2 Installation 10 Quick installation instructions . 10 System requirements . 10 Multithreaded parallelization for multicores is the default . 11 MPI parallelization for clusters is optional . 11 Using build directories . 12 Makefile targets . 12 3 Tutorial 13 The programs in HMMER . 13 Files used in the tutorial . 13 Searching a sequence database with a single profile HMM . 14 Step 1: build a profile HMM with hmmbuild . 14 Step 2: search the sequence database with hmmsearch . 16 Searching a profile HMM database with a query sequence . 22 Step 1: create an HMM database flatfile . 22 Step 2: compress and index the flatfile with hmmpress . 22 Step 3: search the HMM database with hmmscan . 23 Creating multiple alignments with hmmalign . 24 Single sequence queries using phmmer . 25 Iterative searches using jackhmmer . 25 4 Manual pages 28 hmmalign - align sequences to a profile HMM . 28 Synopsis . 28 Description . 28 Options . 28 hmmbuild - construct profile HMM(s) from multiple sequence alignment(s) . 30 Synopsis . 30 Description . 30 Options . 30 Options for specifying the alphabet . 30 Options controlling profile construction . 30 Options controlling relative weights . 31 Options controlling effective sequence number . 31 Options controlling e-value calibration . 32 Other options . 33 hmmconvert - convert profile file to a HMMER format . 34 Synopsis . 34 Description . 34 Options . 34 2 hmmemit - sample sequences from a profile HMM . 35 Synopsis . 35 Description . 35 Common options . 35 Options controlling emission from profiles . 35 Other options . 36 hmmfetch - retrieve profile HMM(s) from a file . 37 Synopsis . 37 Description . 37 Options . 37 hmmpress - prepare an HMM database for hmmscan . 38 Synopsis . 38 Description . 38 Options . 38 hmmscan - search sequence(s) against a profile database . 39 Synopsis . 39 Description . 39 Options . 39 Options for controlling output . 39 Options for reporting thresholds . 40 Options for inclusion thresholds . 40 Options for model-specific score thresholding . 41 Control of the acceleration pipeline . 41 Other options . 42 hmmsearch - search profile(s) against a sequence database . 43 Synopsis . 43 Description . 43 Options . 43 Options for controlling output . 43 Options controlling reporting thresholds . 44 Options for inclusion thresholds . 44 Options for model-specific score thresholding . 45 Options controlling the acceleration pipeline . 45 Other options . 46 hmmsim - collect score distributions on random sequences . 47 Synopsis . 47 Description . 47 Miscellaneous options . 48 Options controlling output . 48 Options controlling model configuration (”mode”) . 49 Options controlling scoring algorithm . ..
Recommended publications
  • T-Coffee Documentation Release Version 13.45.47.Aba98c5
    T-Coffee Documentation Release Version_13.45.47.aba98c5 Cedric Notredame Aug 31, 2021 Contents 1 T-Coffee Installation 3 1.1 Installation................................................3 1.1.1 Unix/Linux Binaries......................................4 1.1.2 MacOS Binaries - Updated...................................4 1.1.3 Installation From Source/Binaries downloader (Mac OSX/Linux)...............4 1.2 Template based modes: PSI/TM-Coffee and Expresso.........................5 1.2.1 Why do I need BLAST with T-Coffee?.............................6 1.2.2 Using a BLAST local version on Unix.............................6 1.2.3 Using the EBI BLAST client..................................6 1.2.4 Using the NCBI BLAST client.................................7 1.2.5 Using another client.......................................7 1.3 Troubleshooting.............................................7 1.3.1 Third party packages......................................7 1.3.2 M-Coffee parameters......................................9 1.3.3 Structural modes (using PDB)................................. 10 1.3.4 R-Coffee associated packages................................. 10 2 Quick Start Regressive Algorithm 11 2.1 Introduction............................................... 11 2.2 Installation from source......................................... 12 2.3 Examples................................................. 12 2.3.1 Fast and accurate........................................ 12 2.3.2 Slower and more accurate.................................... 12 2.3.3 Very Fast...........................................
    [Show full text]
  • Comparative Analysis of Multiple Sequence Alignment Tools
    I.J. Information Technology and Computer Science, 2018, 8, 24-30 Published Online August 2018 in MECS (http://www.mecs-press.org/) DOI: 10.5815/ijitcs.2018.08.04 Comparative Analysis of Multiple Sequence Alignment Tools Eman M. Mohamed Faculty of Computers and Information, Menoufia University, Egypt E-mail: [email protected]. Hamdy M. Mousa, Arabi E. keshk Faculty of Computers and Information, Menoufia University, Egypt E-mail: [email protected], [email protected]. Received: 24 April 2018; Accepted: 07 July 2018; Published: 08 August 2018 Abstract—The perfect alignment between three or more global alignment algorithm built-in dynamic sequences of Protein, RNA or DNA is a very difficult programming technique [1]. This algorithm maximizes task in bioinformatics. There are many techniques for the number of amino acid matches and minimizes the alignment multiple sequences. Many techniques number of required gaps to finds globally optimal maximize speed and do not concern with the accuracy of alignment. Local alignments are more useful for aligning the resulting alignment. Likewise, many techniques sub-regions of the sequences, whereas local alignment maximize accuracy and do not concern with the speed. maximizes sub-regions similarity alignment. One of the Reducing memory and execution time requirements and most known of Local alignment is Smith-Waterman increasing the accuracy of multiple sequence alignment algorithm [2]. on large-scale datasets are the vital goal of any technique. The paper introduces the comparative analysis of the Table 1. Pairwise vs. multiple sequence alignment most well-known programs (CLUSTAL-OMEGA, PSA MSA MAFFT, BROBCONS, KALIGN, RETALIGN, and Compare two biological Compare more than two MUSCLE).
    [Show full text]
  • Ple Sequence Alignment Methods: Evidence from Data
    Mul$ple sequence alignment methods: evidence from data Tandy Warnow Alignment Error/Accuracy • SPFN: percentage of homologies in the true alignment that are not recovered (false negave homologies) • SPFP: percentage of homologies in the es$mated alignment that are false (false posi$ve homologies) • TC: total number of columns correctly recovered • SP-score: percentage of homologies in the true alignment that are recovered • Pairs score: 1-(avg of SP-FN and SP-FP) Benchmarks • Simulaons: can control everything, and true alignment is not disputed – Different simulators • Biological: can’t control anything, and reference alignment might not be true alignment – BAliBASE, HomFam, Prefab – CRW (Comparave Ribosomal Website) Alignment Methods (Sample) • Clustal-Omega • MAFFT • Muscle • Opal • Prank/Pagan • Probcons Co-es$maon of trees and alignments • Bali-Phy and Alifritz (stas$cal co-es$maon) • SATe-1, SATe-2, and PASTA (divide-and-conquer co- es$maon) • POY and Beetle (treelength op$mizaon) Other Criteria • Tree topology error • Tree branch length error • Gap length distribu$on • Inser$on/dele$on rao • Alignment length • Number of indels How does the guide tree impact accuracy? • Does improving the accuracy of the guide tree help? • Do all alignment methods respond iden$cally? (Is the same guide tree good for all methods?) • Do the default sengs for the guide tree work well? Alignment criteria • Does the relave performance of methods depend on the alignment criterion? • Which alignment criteria are predic$ve of tree accuracy? • How should we design MSA methods to produce best accuracy? Choice of best MSA method • Does it depend on type of data (DNA or amino acids?) • Does it depend on rate of evolu$on? • Does it depend on gap length distribu$on? • Does it depend on existence of fragments? Katoh and Standley .
    [Show full text]
  • HMMER User's Guide
    HMMER User's Guide Biological sequence analysis using pro®le hidden Markov models http://hmmer.wustl.edu/ Version 2.1.1; December 1998 Sean Eddy Dept. of Genetics, Washington University School of Medicine 4566 Scott Ave., St. Louis, MO 63110, USA [email protected] With contributions by Ewan Birney ([email protected]) Copyright (C) 1992-1998, Washington University in St. Louis. Permission is granted to make and distribute verbatim copies of this manual provided the copyright notice and this permission notice are retained on all copies. The HMMER software package is a copyrighted work that may be freely distributed and modi®ed under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. Some versions of HMMER may have been obtained under specialized commercial licenses from Washington University; for details, see the ®les COPYING and LICENSE that came with your copy of the HMMER software. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the Appendix for a copy of the full text of the GNU General Public License. 1 Contents 1 Tutorial 5 1.1 The programs in HMMER . 5 1.2 Files used in the tutorial . 6 1.3 Searching a sequence database with a single pro®le HMM . 6 HMM construction with hmmbuild . 7 HMM calibration with hmmcalibrate . 7 Sequence database search with hmmsearch . 8 Searching major databases like NR or SWISSPROT .
    [Show full text]
  • Apply Parallel Bioinformatics Applications on Linux PC Clusters
    Tunghai Science Vol. : 125−141 125 July, 2003 Apply Parallel Bioinformatics Applications on Linux PC Clusters Yu-Lun Kuo and Chao-Tung Yang* Abstract In addition to the traditional massively parallel computers, distributed workstation clusters now play an important role in scientific computing perhaps due to the advent of commodity high performance processors, low-latency/high-band width networks and powerful development tools. As we know, bioinformatics tools can speed up the analysis of large-scale sequence data, especially about sequence alignment. To fully utilize the relatively inexpensive CPU cycles available to today’s scientists, a PC cluster consists of one master node and seven slave nodes (16 processors totally), is proposed and built for bioinformatics applications. We use the mpiBLAST and HMMer on parallel computer to speed up the process for sequence alignment. The mpiBLAST software uses a message-passing library called MPI (Message Passing Interface) and the HMMer software uses a software package called PVM (Parallel Virtual Machine), respectively. The system architecture and performances of the cluster are also presented in this paper. Keywords: Parallel computing, Bioinformatics, BLAST, HMMer, PC Clusters, Speedup. 1. Introduction Extraordinary technological improvements over the past few years in areas such as microprocessors, memory, buses, networks, and software have made it possible to assemble groups of inexpensive personal computers and/or workstations into a cost effective system that functions in concert and posses tremendous processing power. Cluster computing is not new, but in company with other technical capabilities, particularly in the area of networking, this class of machines is becoming a high-performance platform for parallel and distributed applications [1, 2, 11, 12, 13, 14, 15, 16, 17].
    [Show full text]
  • Determination of Optimal Parameters of MAFFT Program Based on Balibase3.0 Database
    Long et al. SpringerPlus (2016) 5:736 DOI 10.1186/s40064-016-2526-5 RESEARCH Open Access Determination of optimal parameters of MAFFT program based on BAliBASE3.0 database HaiXia Long1, ManZhi Li2* and HaiYan Fu1 *Correspondence: myresearch_hainnu@163. Abstract com Background: Multiple sequence alignment (MSA) is one of the most important 2 School of Mathematics and Statistics, Hainan Normal research contents in bioinformatics. A number of MSA programs have emerged. The University, Haikou 571158, accuracy of MSA programs highly depends on the parameters setting, mainly including HaiNan, China gap open penalties (GOP), gap extension penalties (GEP) and substitution matrix (SM). Full list of author information is available at the end of the This research tries to obtain the optimal GOP, GEP and SM rather than MAFFT default article parameters. Results: The paper discusses the MAFFT program benchmarked on BAliBASE3.0 data- base, and the optimal parameters of MAFFT program are obtained, which are better than the default parameters of CLUSTALW and MAFFT program. Conclusions: The optimal parameters can improve the results of multiple sequence alignment, which is feasible and efficient. Keywords: Multiple sequence alignment, Gap open penalties, Gap extension penalties, Substitution matrix, MAFFT program, Default parameters Background Multiple sequence alignment (MSA), one of the most basic bioinformatics tool, has wide applications in sequence analysis, gene recognition, protein structure prediction, and phylogenetic tree reconstruction, etc. MSA computation is a NP-complete problem (Lathrop 1995), whose time and space complexity have sharp increase while the length and the number of sequences are increasing. At present, many scholars have developed open source online alignment tools, such as CLUSTALW, T-COFFEE, MAFFT, (Thompson et al.
    [Show full text]
  • The Art of Multiple Sequence Alignment in R
    The Art of Multiple Sequence Alignment in R Erik S. Wright May 19, 2021 Contents 1 Introduction 1 2 Alignment Speed 2 3 Alignment Accuracy 4 4 Recommendations for optimal performance 7 5 Single Gene Alignment 8 5.1 Example: Protein coding sequences . 8 5.2 Example: Non-coding RNA sequences . 9 5.3 Example: Aligning two aligned sequence sets . 9 6 Advanced Options & Features 10 6.1 Example: Building a Guide Tree . 10 6.2 Example: Post-processing an existing multiple alignment . 12 7 Aligning Homologous Regions of Multiple Genomes 12 8 Session Information 15 1 Introduction This document is intended to illustrate the art of multiple sequence alignment in R using DECIPHER. Even though its beauty is often con- cealed, multiple sequence alignment is a form of art in more ways than one. Take a look at Figure 1 for an illustration of what is happening behind the scenes during multiple sequence alignment. The practice of sequence alignment is one that requires a degree of skill, and it is that art which this vignette intends to convey. It is simply not enough to \plug" sequences into a multiple sequence aligner and blindly trust the result. An appreciation for the art as well a careful consideration of the results are required. What really is multiple sequence alignment, and is there a single cor- rect alignment? Generally speaking, alignment seeks to perform the act of taking multiple divergent biological sequences of the same \type" and Figure 1: The art of multiple se- fitting them to a form that reflects some shared quality.
    [Show full text]
  • Improvement in the Accuracy of Multiple Sequence Alignment Program MAFFT
    22 Genome Informatics 16(1): 22-33 (2005) Improvement in the Accuracy of Multiple Sequence Alignment Program MAFFT Kazutaka Katohl Kei-ichi Kuma1 [email protected] [email protected] Takashi Miyata2" Hiroyuki Toh5 [email protected] [email protected] 1 Bioinformatics Center , Institute for Chemical Research, Kyoto University, Uji, Kyoto 611-0011, Japan 2 Biohistory Research Hall , Takatsuki, Osaka 569-1125, Japan 3 Department of Electrical Engineering and Bioscience , Science and Engineering, Waseda University, Tokyo 169-8555, Japan 4 Department of Biophysics , Graduate School of Science, Kyoto University, Kyoto 606- 8502, Japan 5 Division of Bioinformatics , Research Center for Prevention of Infectious Diseases, Medical Institute of Bioregulation, Kyushu University, Fukuoka 812-8582,Japan Abstract In 2002, we developed and released a rapid multiple sequence alignment program MAFFT that was designed to handle a huge (up to•`5,000 sequences) and long data (,-2,000 as or •`5,000 nt) in a reasonable time on a standard desktop PC. As for the accuracy, however, the previous versions (v.4 and lower) of MAFFT were outperformed by ProbCons and TCoffee v.2, both of which were released in 2004, in several benchmark tests. Here we report a recent extension of MAFFT that aims to improve the accuracy with as little cost of calculation time as possible. The extended version of MAFFT (v.5) has new iterative refinement options, G-INS-i and L-INS-i (collectively denoted as [GL]-INS-iin this report). These options use a new objective function combining the weighted sum-of-pairs (WSP) score and a score similar to COFFEE derived from all pairwise alignments.
    [Show full text]
  • Software List for Biology, Bioinformatics and Biostatistics CCT
    Software List for biology, bioinformatics and biostatistics v CCT - Delta Software Version Application short read assembler and it works on both small and large (mammalian size) ALLPATHS-LG 52488 genomes provides a fast, flexible C++ API & toolkit for reading, writing, and manipulating BAMtools 2.4.0 BAM files a high level of alignment fidelity and is comparable to other mainstream Barracuda 0.7.107b alignment programs allows one to intersect, merge, count, complement, and shuffle genomic bedtools 2.25.0 intervals from multiple files Bfast 0.7.0a universal DNA sequence aligner tool analysis and comprehension of high-throughput genomic data using the R Bioconductor 3.2 statistical programming BioPython 1.66 tools for biological computation written in Python a fast approach to detecting gene-gene interactions in genome-wide case- Boost 1.54.0 control studies short read aligner geared toward quickly aligning large sets of short DNA Bowtie 1.1.2 sequences to large genomes Bowtie2 2.2.6 Bowtie + fully supports gapped alignment with affine gap penalties BWA 0.7.12 mapping low-divergent sequences against a large reference genome ClustalW 2.1 multiple sequence alignment program to align DNA and protein sequences assembles transcripts, estimates their abundances for differential expression Cufflinks 2.2.1 and regulation in RNA-Seq samples EBSEQ (R) 1.10.0 identifying genes and isoforms differentially expressed EMBOSS 6.5.7 a comprehensive set of sequence analysis programs FASTA 36.3.8b a DNA and protein sequence alignment software package FastQC
    [Show full text]
  • Validation and Annotation of Virus Sequence Submissions to Genbank Alejandro A
    Schäffer et al. BMC Bioinformatics (2020) 21:211 https://doi.org/10.1186/s12859-020-3537-3 SOFTWARE Open Access VADR: validation and annotation of virus sequence submissions to GenBank Alejandro A. Schäffer1,2, Eneida L. Hatcher2, Linda Yankie2, Lara Shonkwiler2,3,J.RodneyBrister2, Ilene Karsch-Mizrachi2 and Eric P. Nawrocki2* *Correspondence: [email protected] Abstract 2National Center for Biotechnology Background: GenBank contains over 3 million viral sequences. The National Center Information, National Library of for Biotechnology Information (NCBI) previously made available a tool for validating Medicine, National Institutes of Health, Bethesda, MD, 20894 USA and annotating influenza virus sequences that is used to check submissions to Full list of author information is GenBank. Before this project, there was no analogous tool in use for non-influenza viral available at the end of the article sequence submissions. Results: We developed a system called VADR (Viral Annotation DefineR) that validates and annotates viral sequences in GenBank submissions. The annotation system is based on the analysis of the input nucleotide sequence using models built from curated RefSeqs. Hidden Markov models are used to classify sequences by determining the RefSeq they are most similar to, and feature annotation from the RefSeq is mapped based on a nucleotide alignment of the full sequence to a covariance model. Predicted proteins encoded by the sequence are validated with nucleotide-to-protein alignments using BLAST. The system identifies 43 types of “alerts” that (unlike the previous BLAST-based system) provide deterministic and rigorous feedback to researchers who submit sequences with unexpected characteristics. VADR has been integrated into GenBank’s submission processing pipeline allowing for viral submissions passing all tests to be accepted and annotated automatically, without the need for any human (GenBank indexer) intervention.
    [Show full text]
  • PTIR: Predicted Tomato Interactome Resource
    www.nature.com/scientificreports OPEN PTIR: Predicted Tomato Interactome Resource Junyang Yue1,*, Wei Xu1,*, Rongjun Ban2,*, Shengxiong Huang1, Min Miao1, Xiaofeng Tang1, Guoqing Liu1 & Yongsheng Liu1,3 Received: 15 October 2015 Protein-protein interactions (PPIs) are involved in almost all biological processes and form the basis Accepted: 08 April 2016 of the entire interactomics systems of living organisms. Identification and characterization of these Published: 28 April 2016 interactions are fundamental to elucidating the molecular mechanisms of signal transduction and metabolic pathways at both the cellular and systemic levels. Although a number of experimental and computational studies have been performed on model organisms, the studies exploring and investigating PPIs in tomatoes remain lacking. Here, we developed a Predicted Tomato Interactome Resource (PTIR), based on experimentally determined orthologous interactions in six model organisms. The reliability of individual PPIs was also evaluated by shared gene ontology (GO) terms, co-evolution, co-expression, co-localization and available domain-domain interactions (DDIs). Currently, the PTIR covers 357,946 non-redundant PPIs among 10,626 proteins, including 12,291 high-confidence, 226,553 medium-confidence, and 119,102 low-confidence interactions. These interactions are expected to cover 30.6% of the entire tomato proteome and possess a reasonable distribution. In addition, ten randomly selected PPIs were verified using yeast two-hybrid (Y2H) screening or a bimolecular fluorescence complementation (BiFC) assay. The PTIR was constructed and implemented as a dedicated database and is available at http://bdg.hfut.edu.cn/ptir/index.html without registration. The increasing number of complete genome sequences has revealed the entire structure and composition of proteins, based mainly on theoretical predictions utilizing their corresponding DNA sequences.
    [Show full text]
  • RNA Ontology Consortium January 8-9, 2011
    UC San Diego UC San Diego Previously Published Works Title Meeting report of the RNA Ontology Consortium January 8-9, 2011. Permalink https://escholarship.org/uc/item/0kw6h252 Journal Standards in genomic sciences, 4(2) ISSN 1944-3277 Authors Birmingham, Amanda Clemente, Jose C Desai, Narayan et al. Publication Date 2011-04-01 DOI 10.4056/sigs.1724282 Peer reviewed eScholarship.org Powered by the California Digital Library University of California Standards in Genomic Sciences (2011) 4:252-256 DOI:10.4056/sigs.1724282 Meeting report of the RNA Ontology Consortium January 8-9, 2011 Amanda Birmingham1, Jose C. Clemente2, Narayan Desai3, Jack Gilbert3,4, Antonio Gonzalez2, Nikos Kyrpides5, Folker Meyer3,6, Eric Nawrocki7, Peter Sterk8, Jesse Stombaugh2, Zasha Weinberg9,10, Doug Wendel2, Neocles B. Leontis11, Craig Zirbel12, Rob Knight2,13, Alain Laederach14 1 Thermo Fisher Scientific, Lafayette, CO, USA 2 Department of Chemistry and Biochemistry, University of Colorado, Boulder, CO, USA 3 Argonne National Laboratory, Argonne, IL, USA 4 Department of Ecology and Evolution, University of Chicago, Chicago, IL, USA 5 DOE Joint Genome Institute, Walnut Creek, CA, USA 6 Computation Institute, University of Chicago, Chicago, IL, USA 7 Janelia Farm Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA 8 Wellcome Trust Sanger Institute, Wellcome Trust Genome Campus, Hinxton, Cambridge, UK 9 Department of Molecular, Cellular and Developmental, Yale University, New Haven, CT, USA 10 Howard Hughes Medical Institute, Yale University, New
    [Show full text]