The Similarity Metric

Total Page:16

File Type:pdf, Size:1020Kb

The Similarity Metric IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. XX, NO Y, MONTH 2004 1 The Similarity Metric Ming Li, Xin Chen, Xin Li, Bin Ma, and Paul M.B. Vit´anyi Abstract— A new class of distances appropriate for mea- to different areas and even to collections of objects taken suring similarity relations between sequences, say one type from different areas. The method automatically zooms in of similarity per distance, is studied. We propose a new “normalized information distance”, based on the noncom- on the dominant similarity aspect between every two ob- putable notion of Kolmogorov complexity, and show that it jects. To realize this goal, we first define a wide class of is in this class and it minorizes every computable distance in similarity distances. Then, we show that this class con- the class (that is, it is universal in that it discovers all com- tains a particular distance that is universal in the following putable similarities). We demonstrate that it is a metric and call it the similarity metric. This theory forms the foun- sense: for every pair of objects the particular distance is less dation for a new practical tool. To evidence generality and than any “effective” distance in the class between those two robustness we give two distinctive applications in widely di- objects. This universal distance is called the “normalized vergent areas using standard compression programs like gzip and GenCompress. First, we compare whole mitochondrial information distance” (NID), it is shown to be a metric, genomes and infer their evolutionary history. This results in and, intuitively, it uncovers all similarities simultaneously a first completely automatic computed whole mitochondrial that effective distances in the class uncover a single simi- phylogeny tree. Secondly, we fully automatically compute the language tree of 52 different languages. larity apiece. (Here, “effective” is used as shorthand for a Index Terms— dissimilarity distance, Kolmogorov com- certain notion of “computability” that will acquire its pre- plexity, language tree construction, normalized information cise meaning below.) We develop a practical analogue of distance, normalized compression distance, phylogeny in the NID based on real-world compressors, called the “nor- bioinformatics, parameter-free data-mining, universal sim- ilarity metric malized compression distance” (NCD), and test it on real- world applications in a wide range of fields: we present the first completely automatic construction of the phylogeny I. Introduction tree based on whole mitochondrial genomes, and a com- How do we measure similarity—for example to determine pletely automatic construction of a language tree for over an evolutionary distance—between two sequences, such as 50 Euro-Asian languages. internet documents, different language text corpora in the Previous Work: Preliminary applications of the cur- same language, among different languages based on ex- rent approach were tentatively reported to the biological ample text corpora, computer programs, or chain letters? community and elsewhere [11], [31], [34]. That work, and How do we detect plagiarism of student source code in as- the present paper, is based on information distance [33], signments? Finally, the fast advance of worldwide genome [4], a universal metric that minorizes in an appropriate sequencing projects has raised the following fundamental sense every effective metric: effective versions of Ham- question to prominence in contemporary biological science: ming distance, Euclidean distance, edit distances, Lempel- how do we compare two genomes [30], [51]? Ziv distance, and the sophisticated distances introduced in Our aim here is not to define a similarity measure for [16], [38]. Subsequent work in the linguistics setting, [2], a certain application field based on background knowledge [3], used related ad hoc compression-based methods, Ap- and feature parameters specific to that field; instead we pendix A. The information distance studied in [32], [33], develop a general mathematical theory of similarity that [4], [31], and subsequently investigated in [25], [39], [43], arXiv:cs/0111054v3 [cs.CC] 5 Aug 2004 uses no background knowledge or features specific to an [49], is defined as the length of the shortest binary pro- application area. Hence it is, without changes, applicable gram that is needed to transform the two objects into each The material of this paper was presented in part in Proc. 14th other. This distance can be interpreted also as being pro- ACM-SIAM Symposium on Discrete Algorithms, 2003, pp 863- portional to the minimal amount of energy required to do 872. Ming Li is with the Computer Science Department, Uni- the transformation: A species may lose genes (by deletion) versity of Waterloo, Waterloo, Ontario N2L 3G1, Canada, and with BioInformatics Solutions Inc., Waterloo, Canada. He is par- or gain genes (by duplication or insertion from external tially supported by NSF-ITR grant 0085801 and NSERC. Email: sources), relatively easily. Deletion and insertion cost en- [email protected]. Xin Chen is with the Department of ergy (proportional to the Kolmogorov complexity of delet- Computer Science, University of California, Santa Barbara, CA 93106, USA. Email: [email protected]. Xin Li is with the Com- ing or inserting sequences in the information distance), and puter Science Department, University of Western Ontario, London, aspect that was stressed in [32]. But this distance is not Ontario N6A 5B7, Canada. Partially supported by NSERC grant RGP0238748. Email: [email protected]. Bin Ma is with the Com- proper to measure evolutionary sequence distance. For ex- puter Science Department, University of Western Ontario, London, ample, H. influenza and E. coli are two closely related sister Ontario N6A 5B7, Canada. Partially supported by NSERC grant species. The former has about 1,856,000 base pairs and the RGP0238748. Email: [email protected]. Paul Vit´anyi is with the CWI, Kruislaan 413, 1098 SJ Amsterdam, The Netherlands, and with latter has about 4,772,000 base pairs. However, using the the University of Amsterdam, Amsterdam, The Netherlands. Email information distance of [4], one would easily classify H. in- [email protected]. Partially supported by the EU project QAIP, fluenza with a short (of comparable length) but irrelevant IST–1999–11234, the EU Project RESQ, the NoE QUIPROCONE IST–1999–29064, the ESF QiT Programmme, the EU NeuroCOLT II species simply because of length, instead of with E. coli. Working Group EP 27150, and the EU PASCAL NoE. The problem is that the information distance of [4] deals IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. XX, NO Y, MONTH 2004 2 with absolute distance rather than with relative distance. of the Eutherians can be reconstructed automatically from The paper [48] defined a transformation distance between unaligned complete mitochondrial genomes by use of our two species, and [24] defined a compression distance. Both software implementing (an approximation of) our theory, of these measures are essentially related to K(x|y). Other confirming one of the hypotheses in [9]. These experimen- than being asymmetric, they also suffer from being abso- tal confirmations of the effacity of our comprehensive ap- lute rather than relative. As far as the authors know, the proach contrasts with recent more specialized approaches idea of relative or normalized distance is, surprisingly, not such as [50] that have (and perhaps can) only be tested on well studied. An exception is [52], which investigates nor- small numbers of genes. They have not been experimen- malized Euclidean metric and normalized symmetric-set- tally tried on whole mitochondrial genomes that are, appar- difference metric to account for relative distances rather ently, already numerically out of computational range. In than absolute ones, and it does so for much the same rea- area (ii) we fully automatically construct the language tree sons as does the present work. In [42] the equivalent func- of 52 primarily Indo-European languages from translations tional of (V.1) in information theory, expressed in terms of of the “Universal Declaration of Human Rights”—leading the corresponding probabilistic notions, is shown to be a to a grouping of language families largely consistent with metric. (Our Lemma V.4 implies this result, but obviously current linguistic viewpoints. Other experiments and ap- not the other way around.) plications performed earlier, not reported here are: detect- This Work: We develop a general mathematical the- ing plagiarism in student programming assignments [10], ory of similarity based on a notion of normalized distances. phylogeny of chain letters in [5]. Suppose we define a new distance by setting the value be- Subsequent Work: The current paper can be viewed tween every pair of objects to the minimal upper semi- as the theoretical basis out of a trilogy of papers: In [15] computable (Definition II.3 below) normalized distance we address the gap between the rigorously proven optimal- (possibly a different distance for every pair). This new ity of the normalized information distance based on the distance is a non-uniform lower bound on the upper semi- noncomputable notion of Kolmogorov complexity, and the computable normalized distances. The central notion of experimental successes of the “normalized compression dis- this work is the “normalized information distance,” given tance” or “NCD” which is the same formula with the Kol- by a simple formula, that is a metric, belongs to the class of mogorov complexity replaced by the
Recommended publications
  • Traveling Salesman Problem
    TRAVELING SALESMAN PROBLEM, THEORY AND APPLICATIONS Edited by Donald Davendra Traveling Salesman Problem, Theory and Applications Edited by Donald Davendra Published by InTech Janeza Trdine 9, 51000 Rijeka, Croatia Copyright © 2010 InTech All chapters are Open Access articles distributed under the Creative Commons Non Commercial Share Alike Attribution 3.0 license, which permits to copy, distribute, transmit, and adapt the work in any medium, so long as the original work is properly cited. After this work has been published by InTech, authors have the right to republish it, in whole or part, in any publication of which they are the author, and to make other personal use of the work. Any republication, referencing or personal use of the work must explicitly identify the original source. Statements and opinions expressed in the chapters are these of the individual contributors and not necessarily those of the editors or publisher. No responsibility is accepted for the accuracy of information contained in the published articles. The publisher assumes no responsibility for any damage or injury to persons or property arising out of the use of any materials, instructions, methods or ideas contained in the book. Publishing Process Manager Ana Nikolic Technical Editor Teodora Smiljanic Cover Designer Martina Sirotic Image Copyright Alex Staroseltsev, 2010. Used under license from Shutterstock.com First published December, 2010 Printed in India A free online edition of this book is available at www.intechopen.com Additional hard copies can be obtained
    [Show full text]
  • Early Fixation of an Optimal Genetic Code
    Early Fixation of an Optimal Genetic Code Stephen J. Freeland,* Robin D. Knight,* Laura F. Landweber,* and Laurence D. Hurst² *Department of Ecology and Evolution, Princeton University; and ²Department of Biology and Biochemistry, University of Bath, Bath, England The evolutionary forces that produced the canonical genetic code before the last universal ancestor remain obscure. One hypothesis is that the arrangement of amino acid/codon assignments results from selection to minimize the effects of errors (e.g., mistranslation and mutation) on resulting proteins. If amino acid similarity is measured as polarity, the canonical code does indeed outperform most theoretical alternatives. However, this ®nding does not hold for other amino acid properties, ignores plausible restrictions on possible code structure, and does not address the naturally occurring nonstandard genetic codes. Finally, other analyses have shown that signi®cantly better code structures are possible. Here, we show that if theoretically possible code structures are limited to re¯ect plausible biological constraints, and amino acid similarity is quanti®ed using empirical data of substitution frequencies, the canonical code is at or very close to a global optimum for error minimization across plausible parameter space. This result is robust to variation in the methods and assumptions of the analysis. Although signi®cantly better codes do exist under some assumptions, they are extremely rare and thus consistent with reports of an adaptive code: previous analyses which suggest otherwise derive from a misleading metric. However, all extant, naturally occurring, secondarily derived, nonstandard genetic codes do appear less adaptive. The arrangement of amino acid assignments to the codons of the standard genetic code appears to be a direct product of natural selection for a system that minimizes the phenotypic impact of genetic error.
    [Show full text]
  • Using Local Alignments for Relation Recognition
    Journal of Artificial Intelligence Research 38 (2010) 1-48 Submitted 11/09; published 05/10 Using Local Alignments for Relation Recognition Sophia Katrenko [email protected] Pieter Adriaans [email protected] Maarten van Someren [email protected] Informatics Institute, University of Amsterdam Science Park 107, 1098XG Amsterdam, the Netherlands Abstract This paper discusses the problem of marrying structural similarity with semantic relat- edness for Information Extraction from text. Aiming at accurate recognition of relations, we introduce local alignment kernels and explore various possibilities of using them for this task. We give a definition of a local alignment (LA) kernel based on the Smith-Waterman score as a sequence similarity measure and proceed with a range of possibilities for com- puting similarity between elements of sequences. We show how distributional similarity measures obtained from unlabeled data can be incorporated into the learning task as se- mantic knowledge. Our experiments suggest that the LA kernel yields promising results on various biomedical corpora outperforming two baselines by a large margin. Additional series of experiments have been conducted on the data sets of seven general relation types, where the performance of the LA kernel is comparable to the current state-of-the-art results. 1. Introduction Despite the fact that much work has been done on automatic relation extraction (or recog- nition) in the past few decades, it remains a popular research topic. The main reason for the keen interest in relation recognition lies in its utility. Once concepts and semantic relations are identified, they can be used for a variety of applications such as question answering (QA), ontology construction, hypothesis generation and others.
    [Show full text]
  • 1 Introduction
    Biological sequence analysis by vector-valued functions: revisiting alignment-free methodologies for DNA and protein classification Susana Vinga Instituto de Engenharia de Sistemas e Computadores: Investigação e Desenvolvimento (INESC-ID) R. Alves Redol 9, 1000-029 Lisboa, Portugal Tel. (+351) 213 100 300 Fax: (+351) 213 145 843 E-mail: [email protected] Departamento de Bioestatística e Informática, Faculdade de Ciências Médicas – Universidade Nova de Lisboa (FCM/UNL) Campo dos Mártires da Pátria 130, 1169-056 Lisboa, Portugal Tel. (+351) 218 803 052 Fax: (+351) 218 851 920 Abstract Biological sequence analysis is at the core of bioinformatics, bringing together several fields, from computer science to probability and statistics. Its purpose is to computationally process and decode the information stored in biological macromolecules involved in all cell mechanisms of living organisms – such as DNA, RNA and proteins – and provide prediction tools to reveal their structure, function and complex relationship networks. Within this context several methods have arisen that analyze sequences based on alignment algorithms, ubiquitously used in most bioinformatics applications. Alternatively, although less explored in the literature, the use of vector maps for the analysis of biological sequences, both DNA and proteins, represents a very elegant proposal to extract information from those types of sequences using an alignment-free approach. This work presents an overview of alignment-free methods used for sequence analysis and comparison and the new trends of these techniques, applied to DNA and proteins. The recent endeavors found in the literature along with new proposals and widening of applications fully justifies a revisit to these methodologies, partially reviewed before (Vinga and Almeida, 2003).
    [Show full text]
  • Efficient Alignment-Free Sequence Similarity Measurement Based on Kendall Statistics
    Clinical and Translational Science Institute Centers 5-15-2018 K2 and K2*: efficient alignment-free sequence similarity measurement based on Kendall statistics Jie Lin Fujian Normal University Donald A. Adjeroh West Virginia University Bing-Hua Jiang University of Iowa Yue Jiang Fujian Normal University Follow this and additional works at: https://researchrepository.wvu.edu/ctsi Part of the Medicine and Health Sciences Commons Digital Commons Citation Lin, Jie; Adjeroh, Donald A.; Jiang, Bing-Hua; and Jiang, Yue, "K2 and K2*: efficient alignment-free sequence similarity measurement based on Kendall statistics" (2018). Clinical and Translational Science Institute. 957. https://researchrepository.wvu.edu/ctsi/957 This Article is brought to you for free and open access by the Centers at The Research Repository @ WVU. It has been accepted for inclusion in Clinical and Translational Science Institute by an authorized administrator of The Research Repository @ WVU. For more information, please contact [email protected]. Bioinformatics, 34(10), 2018, 1682–1689 doi: 10.1093/bioinformatics/btx809 Advance Access Publication Date: 15 December 2017 Original Paper Sequence analysis * K2 and K2 : efficient alignment-free sequence similarity measurement based on Kendall statistics Jie Lin1, Donald A. Adjeroh2, Bing-Hua Jiang3 and Yue Jiang1,* 1Department of Software engineering, College of Mathematics and Informatics, Fujian Normal University, Fuzhou 350108, China, 2Department of Computer Science & Electrical Engineering, West Virginia University, Morgantown, WV 26506, USA and 3Department of Pathology, Carver College of Medicine, The University of Iowa, Iowa City, IA 52242, USA *To whom correspondence should be addressed. Associate Editor: John Hancock Received on September 8, 2017; revised on December 11, 2017; editorial decision on December 12, 2017; accepted on December 14, 2017 Abstract Motivation: Alignment-free sequence comparison methods can compute the pairwise similarity between a huge number of sequences much faster than sequence-alignment based methods.
    [Show full text]
  • Amino Acid Substitution Matrices from an Information Theoretic Perspective
    p J. Mol. Bd-(1991) 219, 555-565 Amino Acid Substitution Matrices from an , Information Theoretic Perspective Stephen F. Altschul National Center for Biotechnology Information National Library of Medicine National Institutes of Health Bethesda, MD 20894, U.S.S. (Received 1 October 1990; accepted 12 February 1991) Protein sequence alignments have become an important tool for molecular biologists. Local alignments are frequently constructed with the aid of a “substitution score matrix” that specifies a scorefor aligning each pair of amino acid residues. Over the years, manydifferent substitution matrices have been proposed, based on a wide variety of rationales. Statistical results, however, demonstrate that any such matrix is i.mplicitly a “log-odds” matrix, with a specific targetdistribution for aligned pairs of amino acid residues. Inthe light of information theory, itis possible to express the scores of a substitution matrix in bits and to see that different matrices are better adapted to different purposes. The most widely used matrix for protein sequence comparison has been the PAM-250 matrix. It is argued that for database searches the PAM-,I20 matrix generally is more appropriate, while for comparing two specific proteins with.suspecte4 homology the PAM-200 matrix is indicated. Examples discussed include the lipocalins, human a,B-glycoprotein, the cysticfibrosis transmembrane conductance regulator and the globins. Keywords: homology; sequence comparison; statistical significance; alignment algorithms; pattern recognition 2. Introduction . similarity measure (Smith & Waterman, 1981; Goad & Kanehisa, 1982; Sellers, 1984). This has the General methods for protein sequence comparison advantage of placing no a priori restrictions on the were introduced to molecular biology 20 years ago length of the local alignments sought.
    [Show full text]
  • Similarity in Design: a Framework for Evaluation
    MASTER’S THESIS Similarity in Design: A Framework for Evaluation Master’s Educational Program __Space and Engineering Systems__ Student: Alsalehi, Suhail Hasan Hael Signature, Name Research Advisor: Crawley, Edward F. Signature, Name, Title Moscow 2019 Copyright 2019 Author. All rights reserved. The author hereby grants to Skoltech permission to reproduce and to distribute publicly paper and electronic copies of this thesis document in whole and in part in any medium now known or hereafter created. МАГИСТЕРСКАЯ ДИССЕРТАЦИЯ Сходство в дизайне: Структура для оценки Магистерская образовательная программа__ Космические и Инженерные Системы_ Студент: Аль Салехи Сухаиль Хасан Хаил подпись, ФИО Научный руководитель: Кроули, Эдвард Ф. подпись, ФИО, должность Москва, 2019 Авторское право 2019. Все права защищены. Автор настоящим дает Сколковскому институту науки и технологий разрешение на воспроизводство и свободное распространение бумажных и электронных копий настоящей диссертации в целом или частично на любом ныне существующем или созданном в будущем носителе. "Aim for the moon. If you miss, you may hit a star" W. Clement Stone i ABSTRACT Engineered systems are rapidly increasing in complexity. Complexity, if not managed properly, can lead to inefficient design, higher risk of failures, and/or unexpected costs and schedule delays. This is specifically true during early design. The early phase of design, conceptual design, is characterized by high levels of uncertainty and fuzziness. In this phase, designers rely mostly on expertise to evaluate solution variants. Although researchers have developed many tools for solution variants evaluation during conceptual design, these tools have some drawbacks. A major drawback is that existing tools do not account for the system architecture during evaluation.
    [Show full text]
  • A Web Tool for Protein Semantic Similarity
    ProteInOn: A Web Tool for Protein Semantic Similarity Daniel Faria Catia Pesquita Francisco M. Couto Andr´eO. Falc˜ao DI–FCUL TR–07–6 March 2007 Departamento de Inform´atica Faculdade de Ciˆenciasda Universidade de Lisboa Campo Grande, 1749–016 Lisboa Portugal Technical reports are available at http://www.di.fc.ul.pt/tech-reports. The files are stored in PDF, with the report number as filename. Alternatively, reports are available by post from the above address. ProteInOn: A Web Tool for Protein Semantic Similarity Daniel Faria Catia Pesquita [email protected] [email protected] Francisco M. Couto André O. Falcão [email protected] [email protected] Departamento de Informática, Faculdade de Ciências da Universidade de Lisboa Campo Grande, 1749-016 Lisboa, Portugal ABSTRACT proaches [22]. Bioinformatics arose from the need to manage and extract Protein comparison is also essential to integrate the knowl- knowledge from the vast amount of sequence data generated edge from the sequence level to the system level. Sequence by automated Molecular Biology techniques. One impor- similarity, pattern discovery and structural comparisons are tant step for this was the development of the Gene Ontol- among the most common approaches for this purpose, but ogy (GO), which provided a unified and structured vocabu- it is also possible to compare proteins based on their an- lary to describe proteins, and also a background to compare notations within a BioOntology [14]. This type of compar- them, contributing to the integration of knowledge from the ison, called semantic similarity, is based on the structure sequence level to the system level.
    [Show full text]
  • Similarity Measures for Clustering SNP and Epidemiological Data
    A Service of Leibniz-Informationszentrum econstor Wirtschaft Leibniz Information Centre Make Your Publications Visible. zbw for Economics Selinski, Silvia Working Paper Similarity Measures for Clustering SNP and Epidemiological Data Technical Report, No. 2006,25 Provided in Cooperation with: Collaborative Research Center 'Reduction of Complexity in Multivariate Data Structures' (SFB 475), University of Dortmund Suggested Citation: Selinski, Silvia (2006) : Similarity Measures for Clustering SNP and Epidemiological Data, Technical Report, No. 2006,25, Universität Dortmund, Sonderforschungsbereich 475 - Komplexitätsreduktion in Multivariaten Datenstrukturen, Dortmund This Version is available at: http://hdl.handle.net/10419/22668 Standard-Nutzungsbedingungen: Terms of use: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Documents in EconStor may be saved and copied for your Zwecken und zum Privatgebrauch gespeichert und kopiert werden. personal and scholarly purposes. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle You are not to copy documents for public or commercial Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich purposes, to exhibit the documents publicly, to make them machen, vertreiben oder anderweitig nutzen. publicly available on the internet, or to distribute or otherwise use the documents in public. Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, If the documents have been made available under an Open gelten abweichend von diesen Nutzungsbedingungen die in der dort Content Licence (especially Creative Commons Licences), you genannten Lizenz gewährten Nutzungsrechte. may exercise further usage rights as specified in the indicated licence. www.econstor.eu Similarity Measures for Clustering SNP and Epidemiological Data Silvia Selinski SFB 475, Fachbereich Statistik, Universität Dortmund and the GENICA Network Interdisciplinary Study Group on Gene Environment Interaction and Breast Cancer in Germany, represented by C.
    [Show full text]
  • Research Article a Topology-Based Metric for Measuring Term Similarity in the Gene Ontology
    CORE Metadata, citation and similar papers at core.ac.uk Provided by PubMed Central Hindawi Publishing Corporation Advances in Bioinformatics Volume 2012, Article ID 975783, 17 pages doi:10.1155/2012/975783 Research Article A Topology-Based Metric for Measuring Term Similarity in the Gene Ontology Gaston K. Mazandu and Nicola J. Mulder Computational Biology Group, Department of Clinical Laboratory Sciences, Institute of Infectious Disease and Molecular Medicine, University of Cape Town, Cape Town 7925, South Africa Correspondence should be addressed to Nicola J. Mulder, [email protected] Received 13 December 2011; Revised 29 February 2012; Accepted 13 March 2012 Academic Editor: Satoru Miyano Copyright © 2012 G. K. Mazandu and N. J. Mulder. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The wide coverage and biological relevance of the Gene Ontology (GO), confirmed through its successful use in protein function prediction, have led to the growth in its popularity. In order to exploit the extent of biological knowledge that GO offers in describing genes or groups of genes, there is a need for an efficient, scalable similarity measure for GO terms and GO-annotated proteins. While several GO similarity measures exist, none adequately addresses all issues surrounding the design and usage of the ontology. We introduce a new metric for measuring the distance between two GO terms using the intrinsic topology of the GO-DAG, thus enabling the measurement of functional similarities between proteins based on their GO annotations.
    [Show full text]
  • Significance and Functional Similarity for Identification of Disease Genes 3
    IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, VOL. XX, NO. YY, 2016 1 Significance and Functional Similarity for Identification of Disease Genes Pradipta Maji and Ekta Shah Abstract—One of the most significant research issues in functional genomics is insilico identification of disease related genes. In this regard, the paper presents a new gene selection algorithm, termed as SiFS, for identification of disease genes. It integrates the information obtained from interaction network of proteins and gene expression profiles. The proposed SiFS algorithm culls out a subset of genes from microarray data as disease genes by maximizing both significance and functional similarity of the selected gene subset. Based on the gene expression profiles, the significance of a gene with respect to another gene is computed using mutual information. On the other hand, a new measure of similarity is introduced to compute the functional similarity between two genes. Information derived from the protein-protein interaction network forms the basis of the proposed SiFS algorithm. The performance of the proposed gene selection algorithm and new similarity measure, is compared with that of other related methods and similarity measures, using several cancer microarray data sets. Index Terms—Disease gene identification, microarray data analysis, feature selection, protein-protein interaction network. ✦ 1 INTRODUCTION (mRMR) criterion based gene selection algorithms [3], [9], [10]. The mRMR criterion, introduced in [3], selects ENETIC diseases are mainly caused due to muta- a set of genes from microarray data by maximizing tions in genes. New mutations or changes in the G the relevance of the selected genes and minimizing the DNA, inherited genetic conditions, or some non-genetic redundancy among them.
    [Show full text]
  • Sequence Analysis
    Sequence Analysis • Some algorithms analyze biological sequences for patterns – RNA splice sites – Open reading frames (ORFs): stretch of codons – Amino acid propensities in a protein – Conserved regions in • AA sequences [possible active site] • DNA/RNA [possible protein binding site] • Others make predictions based on sequence – Protein/RNA secondary structure folding 1 Bioinformatics Sequence Driven Problems • Genomics – Fragment assembly of the DNA sequence. • Not possible to read entire sequence. • Cut up into small fragments using restriction enzymes. • Then need to do fragment assembly. Overlapping similarities to matching fragments. • N-P complete problem. – Finding Genes • Identify open reading frames – Exons are spliced out. – Junk in between genes • Proteomics – Identification of functional domains in protein’s sequence • Determining functional pieces in proteins. – Protein Folding • 1D Sequence → 3D Structure 2 • What drives this process? Genome is Sequenced, What’s Next? • Tracing Phylogeny – Finding family relationships between species by tracking similarities between species. • Gene Annotation (cooperative genomics) – Comparison of similar species. • Determining Regulatory Networks – The variables that determine how the body reacts to certain stimuli. • Proteomics – From DNA sequence to a folded protein. 3 Modeling • Modeling biological processes tells us if we understand a given process • Because of the large number of variables that exist in biological problems, powerful computers are needed to analyze certain questions • Protein modeling: – Quantum chemistry imaging algorithms of active sites allow us to view possible bonding and reaction mechanisms – Homologous protein modeling is a comparative proteomic approach to determining an unknown protein’s tertiary structure • Regulatory Network Modeling: – Micro array experiments allow us to compare differences in expression for two different states – Algorithms for clustering groups of gene expression help point out possible regulatory networks (e.g.
    [Show full text]