Htslib - C Library for Reading/Writing High-Throughput Sequencing Data
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
De Novo Genomic Analyses for Non-Model Organisms: an Evaluation of Methods Across a Multi-Species Data Set
De novo genomic analyses for non-model organisms: an evaluation of methods across a multi-species data set Sonal Singhal [email protected] Museum of Vertebrate Zoology University of California, Berkeley 3101 Valley Life Sciences Building Berkeley, California 94720-3160 Department of Integrative Biology University of California, Berkeley 1005 Valley Life Sciences Building Berkeley, California 94720-3140 June 5, 2018 Abstract High-throughput sequencing (HTS) is revolutionizing biological research by enabling sci- entists to quickly and cheaply query variation at a genomic scale. Despite the increasing ease of obtaining such data, using these data effectively still poses notable challenges, especially for those working with organisms without a high-quality reference genome. For every stage of analysis – from assembly to annotation to variant discovery – researchers have to distinguish technical artifacts from the biological realities of their data before they can make inference. In this work, I explore these challenges by generating a large de novo comparative transcriptomic dataset data for a clade of lizards and constructing a pipeline to analyze these data. Then, using a combination of novel metrics and an externally validated variant data set, I test the efficacy of my approach, identify areas of improvement, and propose ways to minimize these errors. I arXiv:1211.1737v1 [q-bio.GN] 8 Nov 2012 find that with careful data curation, HTS can be a powerful tool for generating genomic data for non-model organisms. Keywords: de novo assembly, transcriptomes, suture zones, variant discovery, annotation Running Title: De novo genomic analyses for non-model organisms 1 Introduction High-throughput sequencing (HTS) is poised to revolutionize the field of evolutionary genetics by enabling researchers to assay thousands of loci for organisms across the tree of life. -
MATCH-G Program
MATCH-G Program The MATCH-G toolset MATCH-G (Mutational Analysis Toolset Comparing wHole Genomes) Download the Toolset The toolset is prepared for use with pombe genomes and a sample genome from Sanger is included. However, it is written in such a way as to allow it to utilize any set or number of chromosomes. Simply follow the naming convention "chromosomeX.contig.embl" where X=1,2,3 etc. For use in terminal windows in Mac OSX or Unix-like environments where Perl is present by default. Toolset Description Version History 2.0 – Bug fixes related to scaling to other genomes. First version of GUI interface. 1.0 – Initial Release. Includes build, alignment, snp, copy, and gap resolution routines in original form. Please note this project in under development and will undergo significant changes. Project Description The MATCH-G toolset has been developed to facilitate the evaluation of whole genome sequencing data from yeasts. Currently, the toolset is written for pombe strains, however the toolset is easily scalable to other yeasts or other sequenced genomes. The included tools assist in the identification of SNP mutations, short (and long) insertion/deletions, and changes in gene/region copy number between a parent strain and mutant or revertant strain. Currently, the toolset is run from the command line in a unix or similar terminal and requires a few additional programs to run noted below. Installation It is suggested that a separate folder be generated for the toolset and generated files. Free disk space proportional to the original read datasets is recommended. The toolset utilizes and requires a few additional free programs: Bowtie rapid alignment software: http://bowtie-bio.sourceforge.net/index.shtml (Langmead B, Trapnell C, Pop M, Salzberg SL. -
The Variant Call Format Specification Vcfv4.3 and Bcfv2.2
The Variant Call Format Specification VCFv4.3 and BCFv2.2 27 Jul 2021 The master version of this document can be found at https://github.com/samtools/hts-specs. This printing is version 1715701 from that repository, last modified on the date shown above. 1 Contents 1 The VCF specification 4 1.1 An example . .4 1.2 Character encoding, non-printable characters and characters with special meaning . .4 1.3 Data types . .4 1.4 Meta-information lines . .5 1.4.1 File format . .5 1.4.2 Information field format . .5 1.4.3 Filter field format . .5 1.4.4 Individual format field format . .6 1.4.5 Alternative allele field format . .6 1.4.6 Assembly field format . .6 1.4.7 Contig field format . .6 1.4.8 Sample field format . .7 1.4.9 Pedigree field format . .7 1.5 Header line syntax . .7 1.6 Data lines . .7 1.6.1 Fixed fields . .7 1.6.2 Genotype fields . .9 2 Understanding the VCF format and the haplotype representation 11 2.1 VCF tag naming conventions . 12 3 INFO keys used for structural variants 12 4 FORMAT keys used for structural variants 13 5 Representing variation in VCF records 13 5.1 Creating VCF entries for SNPs and small indels . 13 5.1.1 Example 1 . 13 5.1.2 Example 2 . 14 5.1.3 Example 3 . 14 5.2 Decoding VCF entries for SNPs and small indels . 14 5.2.1 SNP VCF record . 14 5.2.2 Insertion VCF record . -
A Semantic Standard for Describing the Location of Nucleotide and Protein Feature Annotation Jerven T
Bolleman et al. Journal of Biomedical Semantics (2016) 7:39 DOI 10.1186/s13326-016-0067-z RESEARCH Open Access FALDO: a semantic standard for describing the location of nucleotide and protein feature annotation Jerven T. Bolleman1*, Christopher J. Mungall2, Francesco Strozzi3, Joachim Baran4, Michel Dumontier5, Raoul J. P. Bonnal6, Robert Buels7, Robert Hoehndorf8, Takatomo Fujisawa9, Toshiaki Katayama10 and Peter J. A. Cock11 Abstract Background: Nucleotide and protein sequence feature annotations are essential to understand biology on the genomic, transcriptomic, and proteomic level. Using Semantic Web technologies to query biological annotations, there was no standard that described this potentially complex location information as subject-predicate-object triples. Description: We have developed an ontology, the Feature Annotation Location Description Ontology (FALDO), to describe the positions of annotated features on linear and circular sequences. FALDO can be used to describe nucleotide features in sequence records, protein annotations, and glycan binding sites, among other features in coordinate systems of the aforementioned “omics” areas. Using the same data format to represent sequence positions that are independent of file formats allows us to integrate sequence data from multiple sources and data types. The genome browser JBrowse is used to demonstrate accessing multiple SPARQL endpoints to display genomic feature annotations, as well as protein annotations from UniProt mapped to genomic locations. Conclusions: Our ontology allows -
Large Scale Genomic Rearrangements in Selected Arabidopsis Thaliana T
bioRxiv preprint doi: https://doi.org/10.1101/2021.03.03.433755; this version posted March 7, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY 4.0 International license. 1 Large scale genomic rearrangements in selected 2 Arabidopsis thaliana T-DNA lines are caused by T-DNA 3 insertion mutagenesis 4 5 Boas Pucker1,2+, Nils Kleinbölting3+, and Bernd Weisshaar1* 6 1 Genetics and Genomics of Plants, Center for Biotechnology (CeBiTec), Bielefeld University, 7 Sequenz 1, 33615 Bielefeld, Germany 8 2 Evolution and Diversity, Department of Plant Sciences, University of Cambridge, Cambridge, 9 United Kingdom 10 3 Bioinformatics Resource Facility, Center for Biotechnology (CeBiTec, Bielefeld University, 11 Sequenz 1, 33615 Bielefeld, Germany 12 + authors contributed equally 13 * corresponding author: Bernd Weisshaar 14 15 BP: [email protected], ORCID: 0000-0002-3321-7471 16 NK: [email protected], ORCID: 0000-0001-9124-5203 17 BW: [email protected], ORCID: 0000-0002-7635-3473 18 19 20 21 22 23 24 25 26 27 28 29 30 page 1 bioRxiv preprint doi: https://doi.org/10.1101/2021.03.03.433755; this version posted March 7, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY 4.0 International license. -
An Open-Sourced Bioinformatic Pipeline for the Processing of Next-Generation Sequencing Derived Nucleotide Reads
bioRxiv preprint doi: https://doi.org/10.1101/2020.04.20.050369; this version posted May 28, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY 4.0 International license. An open-sourced bioinformatic pipeline for the processing of Next-Generation Sequencing derived nucleotide reads: Identification and authentication of ancient metagenomic DNA Thomas C. Collin1, *, Konstantina Drosou2, 3, Jeremiah Daniel O’Riordan4, Tengiz Meshveliani5, Ron Pinhasi6, and Robin N. M. Feeney1 1School of Medicine, University College Dublin, Ireland 2Division of Cell Matrix Biology Regenerative Medicine, University of Manchester, United Kingdom 3Manchester Institute of Biotechnology, School of Earth and Environmental Sciences, University of Manchester, United Kingdom [email protected] 5Institute of Paleobiology and Paleoanthropology, National Museum of Georgia, Tbilisi, Georgia 6Department of Evolutionary Anthropology, University of Vienna, Austria *Corresponding Author Abstract The emerging field of ancient metagenomics adds to these Bioinformatic pipelines optimised for the processing and as- processing complexities with the need for additional steps sessment of metagenomic ancient DNA (aDNA) are needed in the separation and authentication of ancient sequences from modern sequences. Currently, there are few pipelines for studies that do not make use of high yielding DNA cap- available for the analysis of ancient metagenomic DNA ture techniques. These bioinformatic pipelines are tradition- 1 4 ally optimised for broad aDNA purposes, are contingent on (aDNA) ≠ The limited number of bioinformatic pipelines selection biases and are associated with high costs. -
Identification of Transcribed Sequences in Arabidopsis Thaliana by Using High-Resolution Genome Tiling Arrays
Identification of transcribed sequences in Arabidopsis thaliana by using high-resolution genome tiling arrays Viktor Stolc*†‡§, Manoj Pratim Samanta‡§¶, Waraporn Tongprasitʈ, Himanshu Sethiʈ, Shoudan Liang*, David C. Nelson**, Adrian Hegeman**, Clark Nelson**, David Rancour**, Sebastian Bednarek**, Eldon L. Ulrich**, Qin Zhao**, Russell L. Wrobel**, Craig S. Newman**, Brian G. Fox**, George N. Phillips, Jr.**, John L. Markley**, and Michael R. Sussman**†† *Genome Research Facility, National Aeronautics and Space Administration Ames Research Center, Moffett Field, CA 94035; †Department of Molecular, Cellular, and Developmental Biology, Yale University, New Haven, CT 06520; ¶Systemix Institute, Cupertino, CA 94035; ʈEloret Corporation at National Aeronautics and Space Administration Ames Research Center, Moffett Field, CA 94035; and **Center for Eukaryotic Structural Genomics, University of Wisconsin, Madison, WI 53706 Edited by Sidney Altman, Yale University, New Haven, CT, and approved January 28, 2005 (received for review November 4, 2004) Using a maskless photolithography method, we produced DNA Genome-wide tiling arrays can overcome many of the shortcom- oligonucleotide microarrays with probe sequences tiled through- ings of the previous approaches by comprehensively probing out the genome of the plant Arabidopsis thaliana. RNA expression transcription in all regions of the genome. This technology has was determined for the complete nuclear, mitochondrial, and been used successfully on different organisms (5–12). A recent chloroplast genomes by tiling 5 million 36-mer probes. These study on A. thaliana reported measuring transcriptional activities probes were hybridized to labeled mRNA isolated from liquid of four different cell lines by using 25-mer-based tiling arrays that grown T87 cells, an undifferentiated Arabidopsis cell culture line. -
A Combined RAD-Seq and WGS Approach Reveals the Genomic
www.nature.com/scientificreports OPEN A combined RAD‑Seq and WGS approach reveals the genomic basis of yellow color variation in bumble bee Bombus terrestris Sarthok Rasique Rahman1,2, Jonathan Cnaani3, Lisa N. Kinch4, Nick V. Grishin4 & Heather M. Hines1,5* Bumble bees exhibit exceptional diversity in their segmental body coloration largely as a result of mimicry. In this study we sought to discover genes involved in this variation through studying a lab‑generated mutant in bumble bee Bombus terrestris, in which the typical black coloration of the pleuron, scutellum, and frst metasomal tergite is replaced by yellow, a color variant also found in sister lineages to B. terrestris. Utilizing a combination of RAD‑Seq and whole‑genome re‑sequencing, we localized the color‑generating variant to a single SNP in the protein‑coding sequence of transcription factor cut. This mutation generates an amino acid change that modifes the conformation of a coiled‑coil structure outside DNA‑binding domains. We found that all sequenced Hymenoptera, including sister lineages, possess the non‑mutant allele, indicating diferent mechanisms are involved in the same color transition in nature. Cut is important for multiple facets of development, yet this mutation generated no noticeable external phenotypic efects outside of setal characteristics. Reproductive capacity was reduced, however, as queens were less likely to mate and produce female ofspring, exhibiting behavior similar to that of workers. Our research implicates a novel developmental player in pigmentation, and potentially caste, thus contributing to a better understanding of the evolution of diversity in both of these processes. Understanding the genetic architecture underlying phenotypic diversifcation has been a long-standing goal of evolutionary biology. -
Sequence Alignment/Map Format Specification
Sequence Alignment/Map Format Specification The SAM/BAM Format Specification Working Group 3 Jun 2021 The master version of this document can be found at https://github.com/samtools/hts-specs. This printing is version 53752fa from that repository, last modified on the date shown above. 1 The SAM Format Specification SAM stands for Sequence Alignment/Map format. It is a TAB-delimited text format consisting of a header section, which is optional, and an alignment section. If present, the header must be prior to the alignments. Header lines start with `@', while alignment lines do not. Each alignment line has 11 mandatory fields for essential alignment information such as mapping position, and variable number of optional fields for flexible or aligner specific information. This specification is for version 1.6 of the SAM and BAM formats. Each SAM and BAMfilemay optionally specify the version being used via the @HD VN tag. For full version history see Appendix B. Unless explicitly specified elsewhere, all fields are encoded using 7-bit US-ASCII 1 in using the POSIX / C locale. Regular expressions listed use the POSIX / IEEE Std 1003.1 extended syntax. 1.1 An example Suppose we have the following alignment with bases in lowercase clipped from the alignment. Read r001/1 and r001/2 constitute a read pair; r003 is a chimeric read; r004 represents a split alignment. Coor 12345678901234 5678901234567890123456789012345 ref AGCATGTTAGATAA**GATAGCTGTGCTAGTAGGCAGTCAGCGCCAT +r001/1 TTAGATAAAGGATA*CTG +r002 aaaAGATAA*GGATA +r003 gcctaAGCTAA +r004 ATAGCT..............TCAGC -r003 ttagctTAGGC -r001/2 CAGCGGCAT The corresponding SAM format is:2 1Charset ANSI X3.4-1968 as defined in RFC1345. -
VCF/Plotein: a Web Application to Facilitate the Clinical Interpretation Of
bioRxiv preprint doi: https://doi.org/10.1101/466490; this version posted November 14, 2018. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. Manuscript (All Manuscript Text Pages, including Title Page, References and Figure Legends) VCF/Plotein: A web application to facilitate the clinical interpretation of genetic and genomic variants from exome sequencing projects Raul Ossio MD1, Diego Said Anaya-Mancilla BSc1, O. Isaac Garcia-Salinas BSc1, Jair S. Garcia-Sotelo MSc1, Luis A. Aguilar MSc1, David J. Adams PhD2 and Carla Daniela Robles-Espinoza PhD1,2* 1Laboratorio Internacional de Investigación sobre el Genoma Humano, Universidad Nacional Autónoma de México, Querétaro, Qro., 76230, Mexico 2Experimental Cancer Genetics, Wellcome Sanger Institute, Hinxton Cambridge, CB10 1SA, UK * To whom correspondence should be addressed. Carla Daniela Robles-Espinoza Tel: +52 55 56 23 43 31 ext. 259 Email: [email protected] 1 bioRxiv preprint doi: https://doi.org/10.1101/466490; this version posted November 14, 2018. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. CONFLICT OF INTEREST No conflicts of interest. 2 bioRxiv preprint doi: https://doi.org/10.1101/466490; this version posted November 14, 2018. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. ABSTRACT Purpose To create a user-friendly web application that allows researchers, medical professionals and patients to easily and securely view, filter and interact with human exome sequencing data in the Variant Call Format (VCF). -
Assembly Exercise
Assembly Exercise Turning reads into genomes Where we are • 13:30-14:00 – Primer Design to Amplify Microbial Genomes for Sequencing • 14:00-14:15 – Primer Design Exercise • 14:15-14:45 – Molecular Barcoding to Allow Multiplexed NGS • 14:45-15:15 – Processing NGS Data – de novo and mapping assembly • 15:15-15:30 – Break • 15:30-15:45 – Assembly Exercise • 15:45-16:15 – Annotation • 16:15-16:30 – Annotation Exercise • 16:30-17:00 – Submitting Data to GenBank Log onto ILRI cluster • Log in to HPC using ILRI instructions • NOTE: All the commands here are also in the file - assembly_hands_on_steps.txt • If you are like me, it may be easier to cut and paste Linux commands from this file instead of typing them in from the slides Start an interactive session on larger servers • The interactive command will start a session on a server better equipped to do genome assembly $ interactive • Switch to csh (I use some csh features) $ csh • Set up Newbler software that will be used $ module load 454 A norovirus sample sequenced on both 454 and Illumina • The vendors use different file formats unknown_norovirus_454.GACT.sff unknown_norovirus_illumina.fastq • I have converted these files to additional formats for use with the assembly tools unknown_norovirus_454_convert.fasta unknown_norovirus_454_convert.fastq unknown_norovirus_illumina_convert.fasta Set up and run the Newbler de novo assembler • Create a new de novo assembly project $ newAssembly de_novo_assembly • Add read data to the project $ addRun de_novo_assembly unknown_norovirus_454.GACT.sff -
Infravec2 Open Research Data Management Plan
INFRAVEC2 OPEN RESEARCH DATA MANAGEMENT PLAN Authors: Andrea Crisanti, Gareth Maslen, Andy Yates, Paul Kersey, Alain Kohl, Clelia Supparo, Ken Vernick Date: 10th July 2020 Version: 3.0 Overview Infravec2 will align to Open Research Data, as follows: Data Types and Standards Infravec2 will generate a variety of data types, including molecular data types: genome sequence and assembly, structural annotation (gene models, repeats, other functional regions) and functional annotation (protein function assignment), variation data, and transcriptome data; arbovirus and malaria experimental infection data, linked to archived samples; and microbiome data (Operational Taxonomic Units), including natural virome composition. All data will be released according to the appropriate standards and formats for each data type. For example, DNA sequence will be released in FASTA format; variant calls in Variant Call Format; sequence alignments in BAM (Binary Alignment Map) and CRAM (Compressed Read Alignment Map) formats, etc. We will strongly encourage the organisation of linked data sets as Track Hubs, a mechanism for publishing a set of linked genomic data that aids data discovery, sharing, and selection for subsequent analysis. We will develop internal standards within the consortium to define minimal metadata that will accompany all data sets, following the template of the Minimal Information Standards for Biological and Biomedical Investigations (http://www.dcc.ac.uk/resources/metadata-standards/mibbi-minimum-information-biological- and-biomedical-investigations). Data Exploitation, Accessibility, Curation and Preservation All molecular data for which existing public data repositories exist will be submitted to such repositories on or before the publication of written manuscripts, with early release of data (i.e.