Sharing Programming Resources Between Bio* Projects
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Introduction to Bioinformatics Software and Computing Infrastructures
I have all this data – now what? Introduction to Bioinformatics Software and Computing Infrastructures Timothy Stockwell (JCVI) Vivien Dugan (NIAID/NIH) Bioinformatics • Bioinformatics Deals with methods for managing and analyzing biological data. Focus on using software to generate useful biological knowledge. • Bioinformatics for Sequencing and Genomics Sample tracking, LIMS (lab process tracking). Sequencing and assembly Genome annotation (structural and functional) Cross-genome comparisons My NGS run finished….. DATA OVERLOAD!!! DATA OVERLOAD!!! DATA OVERLOAD!!! Genomics Resources • General resources • Genomics resources • Bioinformatics resources • Pathogen-specific resources USA NIH National Center for Biomedical Information (NCBI) • NCBI – home page, http://www.ncbi.nlm.nih.gov • GenBank – genetic sequence database http://www.ncbi.nlm.nih.gov/genbank • PubMed – database of citations and links to over 22 million biomedical articles http://www.ncbi.nlm.nih.gov/pubmed • BLAST – Basic Local Alignment Search Tool – to search for similar biological sequences http://blast.ncbi.nlm.nih.gov/Blast.cgi Bioinformatics Resource Centers (BRCs) https://vectorbase.org/ http://eupathdb.org/ http://patric.vbi.vt.edu/ http://www.pathogenportal.org/ http://www.viprbrc.org/ http://www.fludb.org/ NIAID Bioinformatics Resource Centers Bioinformatic Services • Community-based Database & Bioinformatics Resource Centers • Partnerships with Infectious Diseases Research and Public Health communities • Genomic, omics, experimental, & clinical metadata -
Digital Skills in Sub-Saharan Africa Spotlight on Ghana
Digital Skills in Sub-Saharan Africa Spotlight on Ghana IN COOPERATION WITH: ABOUT IFC Research and writing underpinning the report was conducted by the L.E.K. Global Education practice. The L.E.K. IFC—a sister organization of the World Bank and member of team was led by Ashwin Assomull, Maryanna Abdo, and the World Bank Group—is the largest global development Ridhi Gupta, including writing by Maryanna Abdo, Priyanka institution focused on the private sector in emerging Thapar, and Jaisal Kapoor and research contributions by Neil markets. We work with more than 2,000 businesses Aneja, Shrrinesh Balasubramanian, Patrick Desmond, Ridhi worldwide, using our capital, expertise, and influence to Gupta, Jaisal Kapoor, Rohan Sur, and Priyanka Thapar. create markets and opportunities in the toughest areas of Sudeep Laad provided valuable insights on the Ghana the world. For more information, visit www.ifc.org. market landscape and opportunity sizing. ABOUT REPORT L.E.K. is a global management consulting firm that uses deep industry expertise and rigorous analysis to help business This publication, Digital Skills in Sub-Saharan Africa: Spotlight leaders achieve practical results with real impact. The Global on Ghana, was produced by the Manufacturing Agribusiness Education practice is a specialist international team based in and Services department of the International Finance Singapore serving a global client base from China to Chile. Corporation, in cooperation with the Global Education practice at L.E.K. Consulting. It was developed under the ACKNOWLEDGMENTS overall guidance of Tomasz Telma (Senior Director, MAS), The report would not have been possible without the Mary-Jean Moyo (Director, MAS, Middle-East and Africa), participation of leadership and alumni from eight case study Elena Sterlin (Senior Manager, Global Health and Education, organizations, including: MAS) and Olaf Schmidt (Manager, Services, MAS, Sub- Andela: Lara Kok, Executive Coordinator; Anudip: Dipak Saharan Africa). -
Easybuild Documentation Release 20210907.0
EasyBuild Documentation Release 20210907.0 Ghent University Tue, 07 Sep 2021 08:55:41 Contents 1 What is EasyBuild? 3 2 Concepts and terminology 5 2.1 EasyBuild framework..........................................5 2.2 Easyblocks................................................6 2.3 Toolchains................................................7 2.3.1 system toolchain.......................................7 2.3.2 dummy toolchain (DEPRECATED) ..............................7 2.3.3 Common toolchains.......................................7 2.4 Easyconfig files..............................................7 2.5 Extensions................................................8 3 Typical workflow example: building and installing WRF9 3.1 Searching for available easyconfigs files.................................9 3.2 Getting an overview of planned installations.............................. 10 3.3 Installing a software stack........................................ 11 4 Getting started 13 4.1 Installing EasyBuild........................................... 13 4.1.1 Requirements.......................................... 14 4.1.2 Using pip to Install EasyBuild................................. 14 4.1.3 Installing EasyBuild with EasyBuild.............................. 17 4.1.4 Dependencies.......................................... 19 4.1.5 Sources............................................. 21 4.1.6 In case of installation issues. .................................. 22 4.2 Configuring EasyBuild.......................................... 22 4.2.1 Supported configuration -
Teaching Bioinformatics and Neuroinformatics Using Free Web-Based Tools
UCLA Behavioral Neuroscience Title Teaching Bioinformatics and Neuroinformatics Using Free Web-based Tools Permalink https://escholarship.org/uc/item/2689x2hk Author Grisham, William Publication Date 2009 Supplemental Material https://escholarship.org/uc/item/2689x2hk#supplemental Peer reviewed eScholarship.org Powered by the California Digital Library University of California – SUBMITTED – [Article; 34,852 Characters] Teaching Bioinformatics and Neuroinformatics Using Free Web-based Tools William Grisham 1, Natalie A. Schottler 1, Joanne Valli-Marill 2, Lisa Beck 3, Jackson Beatty 1 1Department of Psychology, UCLA; 2 Office of Instructional Development, UCLA; 3Department of Psychology, Bryn Mawr College Keywords: quantitative trait locus, digital teaching tools, web-based learning, genetic analysis, in silico tools DRAFT: Copyright William Grisham, 2009 Address correspondence to: William Grisham Department of Psychology, UCLA PO Box 951563 Los Angeles, CA 90095-1563 [email protected] Grisham Teaching Bioinformatics Using Web-Based Tools ABSTRACT This completely computer-based module’s purpose is to introduce students to bioinformatics resources. We present an easy-to-adopt module that weaves together several important bioinformatic tools so students can grasp how these tools are used in answering research questions. This module integrates information gathered from websites dealing with anatomy (Mouse Brain Library), Quantitative Trait Locus analysis (WebQTL from GeneNetwork), bioinformatics and gene expression analyses (University of California, Santa Cruz Genome Browser, NCBI Entrez Gene, and the Allen Brain Atlas), and information resources (PubMed). This module provides for teaching genetics from the phenotypic level to the molecular level, some neuroanatomy, some aspects of histology, statistics, Quantitaive Trait Locus analysis, molecular biology including in situ hybridization and microarray analysis in addition to introducing bioinformatic resources. -
Python Data Analytics Open a File for Reading: Infile = Open("Input.Txt", "R")
DATA 301: Data Analytics (2) Python File Input/Output DATA 301 Many data processing tasks require reading and writing to files. Introduction to Data Analytics I/O Type Python Data Analytics Open a file for reading: infile = open("input.txt", "r") Dr. Ramon Lawrence Open a file for writing: University of British Columbia Okanagan outfile = open("output.txt", "w") [email protected] Open a file for read/write: myfile = open("data.txt", "r+") DATA 301: Data Analytics (3) DATA 301: Data Analytics (4) Reading from a Text File (as one String) Reading from a Text File (line by line) infile = open("input.txt", "r") infile = open("input.txt", "r") for line in infile: print(line.strip('\n')) val = infile.read() Read all file as one string infile.close() print(val) infile.close() Close file # Alternate syntax - will auto-close file with open("input.txt", "r") as infile: for line in infile: print(line.strip('\n')) DATA 301: Data Analytics (5) DATA 301: Data Analytics (6) Writing to a Text File Other File Methods outfile = open("output.txt", "w") infile = open("input.txt", "r") for n in range(1,11): # Check if a file is closed outfile.write(str(n) + "\n") print(infile.closed)# False outfile.close() # Read all lines in the file into a list lines = infile.readlines() infile.close() print(infile.closed)# True DATA 301: Data Analytics (7) DATA 301: Data Analytics (8) Use Split to Process a CSV File Using csv Module to Process a CSV File with open("data.csv", "r") as infile: import csv for line in infile: line = line.strip(" \n") with open("data.csv", "r") as infile: fields = line.split(",") csvfile = csv.reader(infile) for i in range(0,len(fields)): for row in csvfile: fields[i] = fields[i].strip() if int(row[0]) > 1: print(fields) print(row) DATA 301: Data Analytics (9) DATA 301: Data Analytics (10) List all Files in a Directory Python File I/O Question Question: How many of the following statements are TRUE? import os print(os.listdir(".")) 1) A Python file is automatically closed for you. -
Speeding up Eqtl Scans in the BXD Population Using Gpus
bioRxiv preprint doi: https://doi.org/10.1101/2020.06.22.153742; this version posted June 22, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC-ND 4.0 International license. Speeding up eQTL scans in the BXD population using GPUs Chelsea Trotter1, Hyeonju Kim1, Gregory Farage1, Pjotr Prins2, Robert W. Williams2, Karl W. Broman3, and Saunak´ Sen1, 1Department of Preventive Medicine, University of Tennessee Health Science Center, Memphis, TN 2Department of Genetics, Genomics and Informatics, University of Tennessee Health Science Center, Memphis, TN 3Department of Biostatistics, University of Wisconsin-Madison, Madison, WI The BXD recombinant inbred strains of mice are an important using standard algorithms for QTL analysis, such as those reference population for systems biology and genetics that have employed by R/qtl (4). In practice, this is too slow. For exam- been full sequenced and deeply phenotyped. To facilitate inter- ple, by using the Haley-Knott algorithms (5) using genotype active use of genotype-phenotype relations using many massive probabilities on batches of phenotypes with the same miss- omics data sets for this and other segregating populations, we ing data pattern, instead of using the EM algorithm (6) on have developed new algorithms and code that enables near-real each phenotype individually, substantial speedups are possi- time whole genome QTL scans for up to 1 million traits. By ble. This is a well-known trick and is used by R/qtl. -
Redundancy-Free Analysis of Multi-Revision Software Artifacts
Empirical Software Engineering (preprint) Redundancy-free Analysis of Multi-revision Software Artifacts Carol V. Alexandru · Sebastiano Panichella · Sebastian Proksch · Harald C. Gall 30. April 2018 Abstract Researchers often analyze several revisions of a software project to obtain historical data about its evolution. For example, they statically ana- lyze the source code and monitor the evolution of certain metrics over multi- ple revisions. The time and resource requirements for running these analyses often make it necessary to limit the number of analyzed revisions, e.g., by only selecting major revisions or by using a coarse-grained sampling strategy, which could remove significant details of the evolution. Most existing analy- sis techniques are not designed for the analysis of multi-revision artifacts and they treat each revision individually. However, the actual difference between two subsequent revisions is typically very small. Thus, tools tailored for the analysis of multiple revisions should only analyze these differences, thereby preventing re-computation and storage of redundant data, improving scalabil- ity and enabling the study of a larger number of revisions. In this work, we propose the Lean Language-Independent Software Analyzer (LISA), a generic framework for representing and analyzing multi-revisioned software artifacts. It employs a redundancy-free, multi-revision representation for artifacts and avoids re-computation by only analyzing changed artifact fragments across thousands of revisions. The evaluation of our approach consists of measur- ing the effect of each individual technique incorporated, an in-depth study of LISA's resource requirements and a large-scale analysis over 7 million program revisions of 4,000 software projects written in four languages. -
Biopython BOSC 2007
The 8th annual Bioinformatics Open Source Conference (BOSC 2007) 18th July, Vienna, Austria Biopython Project Update Peter Cock, MOAC Doctoral Training Centre, University of Warwick, UK Talk Outline What is python? What is Biopython? Short history Project organisation What can you do with it? How can you contribute? Acknowledgements The 8th annual Bioinformatics Open Source Conference Biopython Project Update @ BOSC 2007, Vienna, Austria What is Python? High level programming language Object orientated Open Source, free ($$$) Cross platform: Linux, Windows, Mac OS X, … Extensible in C, C++, … The 8th annual Bioinformatics Open Source Conference Biopython Project Update @ BOSC 2007, Vienna, Austria What is Biopython? Set of libraries for computational biology Open Source, free ($$$) Cross platform: Linux, Windows, Mac OS X, … Sibling project to BioPerl, BioRuby, BioJava, … The 8th annual Bioinformatics Open Source Conference Biopython Project Update @ BOSC 2007, Vienna, Austria Popularity by Google Hits Python 98 million Biopython 252,000 Perl 101 million BioPerlBioPerl 610,000 Ruby 101 million BioRuby 122,000 Java 289 million BioJava 185,000 Both Perl and Python are strong at text Python may have the edge for numerical work (with the Numerical python libraries) The 8th annual Bioinformatics Open Source Conference Biopython Project Update @ BOSC 2007, Vienna, Austria Biopython history 1999 : Started by Jeff Chang & Andrew Dalke 2000 : Biopython 0.90, first release 2001 : Biopython 1.00, “semi-complete” 2002 -
Biological Interpretation of Genome-Wide Association Studies Using Predicted Gene Functions
Edinburgh Research Explorer Biological interpretation of genome-wide association studies using predicted gene functions Citation for published version: Pers, TH, Karjalainen, JM, Chan, Y, Westra, H-J, Wood, AR, Yang, J, Lui, JC, Vedantam, S, Gustafsson, S, Esko, T, Frayling, T, Speliotes, EK, Boehnke, M, Raychaudhuri, S, Fehrmann, RSN, Hirschhorn, JN, Franke, L, Genetic Invest ANthropometric Trai, McLachlan, S, Campbell, H, Price, J, Rudan, I & Wilson, J 2015, 'Biological interpretation of genome-wide association studies using predicted gene functions', Nature Communications, vol. 6, 5890. https://doi.org/10.1038/ncomms6890 Digital Object Identifier (DOI): 10.1038/ncomms6890 Link: Link to publication record in Edinburgh Research Explorer Document Version: Peer reviewed version Published In: Nature Communications Publisher Rights Statement: This is the author's accepted manuscript. General rights Copyright for the publications made accessible via the Edinburgh Research Explorer is retained by the author(s) and / or other copyright owners and it is a condition of accessing these publications that users recognise and abide by the legal requirements associated with these rights. Take down policy The University of Edinburgh has made every reasonable effort to ensure that Edinburgh Research Explorer content complies with UK legislation. If you believe that the public display of this file breaches copyright please contact [email protected] providing details, and we will remove access to the work immediately and investigate your claim. Download date: 28. Sep. 2021 HHS Public Access Author manuscript Author Manuscript Author ManuscriptNat Commun Author Manuscript. Author manuscript; Author Manuscript available in PMC 2015 May 05. Published in final edited form as: Nat Commun. -
Benchmarking of Bioperl, Perl, Biojava, Java, Biopython, and Python for Primitive Bioinformatics Tasks 6 and Choosing a Suitable Language
Taewan Ryu : Benchmarking of BioPerl, Perl, BioJava, Java, BioPython, and Python for Primitive Bioinformatics Tasks 6 and Choosing a Suitable Language Benchmarking of BioPerl, Perl, BioJava, Java, BioPython, and Python for Primitive Bioinformatics Tasks and Choosing a Suitable Language Taewan Ryu Dept of Computer Science, California State University, Fullerton, CA 92834, USA ABSTRACT Recently many different programming languages have emerged for the development of bioinformatics applications. In addition to the traditional languages, languages from open source projects such as BioPerl, BioPython, and BioJava have become popular because they provide special tools for biological data processing and are easy to use. However, it is not well-studied which of these programming languages will be most suitable for a given bioinformatics task and which factors should be considered in choosing a language for a project. Like many other application projects, bioinformatics projects also require various types of tasks. Accordingly, it will be a challenge to characterize all the aspects of a project in order to choose a language. However, most projects require some common and primitive tasks such as file I/O, text processing, and basic computation for counting, translation, statistics, etc. This paper presents the benchmarking results of six popular languages, Perl, BioPerl, Python, BioPython, Java, and BioJava, for several common and simple bioinformatics tasks. The experimental results of each language are compared through quantitative evaluation metrics such as execution time, memory usage, and size of the source code. Other qualitative factors, including writeability, readability, portability, scalability, and maintainability, that affect the success of a project are also discussed. The results of this research can be useful for developers in choosing an appropriate language for the development of bioinformatics applications. -
Bioperl What’S Bioperl?
Bioperl What’s Bioperl? Bioperl is not a new language It is a collection of Perl modules that facilitate the development of Perl scripts for bioinformatics applications. Bioperl and perl Bioperl Modules Perl Modules Perls script input Perl Interpreter output Bioperl and Perl Why bioperl for bioinformatics? Perl is good at file manipulation and text processing, which make up a large part of the routine tasks in bioinformatics. Perl language, documentation and many Perl packages are freely available. Perl is easy to get started in, to write small and medium-sized programs. Where to get help Type perldoc <modulename> in terminal Search for particular module in https://metacpan.org Bioperl Document Object-oriented and Process-oriented programming Process-oriented: Yuan Hao eats chicken Name object: $name Action method: eat Food object: $food Object-oriented: $name->eat($food) Modularize the program Platform and Related Software Required Perl 5.6.1 or higher Version 5.8 or higher is highly recommended make for Mac OS X, this requires installing the Xcode Developer Tools Installation On Linux or Max OS X Install from cpanminus: perlbrew install-cpanm cpanm Bio::Perl Install from source code: git clone https://github.com/bioperl/bioperl-live.git cd bioperl-live perl Build.PL ./Build test (optional) ./Build install Installation On Windows Install MinGW (MinGW is incorporated in Strawberry Perl, but must it be installed through PPM for ActivePerl) : ppm install MinGW Install Module::Build, Test::Harness and Test::Most through CPAN: Type cpan to enter the CPAN shell. At the cpan> prompt, type install CPAN Quit (by typing ‘q’) and reload CPAN. -
Biolib: Sharing High Performance Code Between Bioperl, Biopython, Bioruby, R/Bioconductor and Biojava by Pjotr Prins
BioLib: Sharing high performance code between BioPerl, BioPython, BioRuby, R/Bioconductor and BioJAVA by Pjotr Prins Dept. of Nematology, Wageningen University, The Netherlands ([email protected]) website: http://biolib.open-bio.org/ git repository: http://github.com/pjotrp/biolib/ LICENSE: BioLib defaults to the BSD license, embedded libraries may override BioLib provides the infrastructure for mapping existing and novel C/C++ libraries against the major high level languages using a combination of SWIG and cmake. This allows writing code once and sharing it with all bioinformaticians - who, as it happens, are a diverse lot with diverse computing platforms and programming language preferences. Bioinformatics is facing some major challenges handling IO data from microarrays, sequencers etc., where every innovation comes with new data formats and data size increases rapidly. Writing so- lutions in every language domain usually entails duplication of effort. At the same time developers are a scarce resource in every Bio* project. In practice this often means missing or incomplete func- tionality. For example microarray support is only satisfactory in R/Bioconductor, but lacking in all other domains. By mapping libraries using SWIG we can support all languages in one strike, thereby concentrating the effort of supporting IO in one place. BioLib also provides an alternative to webservices. Webservices are often used to cross language barriers using a ’slow’ network interface. BioLib provides an alternative when fast low overhead communication is desired, like for high throughput, high performance computing. BioLib has mapped libraries for Affymetrix microarray IO (the Affyio implementation by Ben Bol- stad) and the Staden IO lib (James Bonfield) for 454-sequencer trace files, amongst others, and made these available for the major languages on the major computing platforms (thanks to CMake).