A Mathematical Theory of Computation?
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
19 Theory of Computation
19 Theory of Computation "You are about to embark on the study of a fascinating and important subject: the theory of computation. It com- prises the fundamental mathematical properties of computer hardware, software, and certain applications thereof. In studying this subject we seek to determine what can and cannot be computed, how quickly, with how much memory, and on which type of computational model." - Michael Sipser, "Introduction to the Theory of Computation", one of the driest computer science textbooks ever In which we go back to the basics with arcane, boring, and irrelevant set theory and counting. This week’s material is made challenging by two orthogonal issues. There’s a whole bunch of stuff to cover, and 95% of it isn’t the least bit interesting to a physical scientist. Nevertheless, being the starry-eyed optimist that I am, I’ll forge ahead through the mountainous bulk of knowledge. In other words, expect these notes to be long! But skim when necessary; if you look at the homework first (and haven’t entirely forgotten the lectures), you should be able to pick out the important parts. I understand if this type of stuff isn’t exactly your cup of tea, but bear with me while you can. In some sense, most of what we refer to as computer science isn’t computer science at all, any more than what an accountant does is math. Sure, modern economics takes some crazy hardcore theory to make it all work, but un- derlying the whole thing is a solid layer of applications and industrial moolah. -
Turing's Influence on Programming — Book Extract from “The Dawn of Software Engineering: from Turing to Dijkstra”
Turing's Influence on Programming | Book extract from \The Dawn of Software Engineering: from Turing to Dijkstra" Edgar G. Daylight∗ Eindhoven University of Technology, The Netherlands [email protected] Abstract Turing's involvement with computer building was popularized in the 1970s and later. Most notable are the books by Brian Randell (1973), Andrew Hodges (1983), and Martin Davis (2000). A central question is whether John von Neumann was influenced by Turing's 1936 paper when he helped build the EDVAC machine, even though he never cited Turing's work. This question remains unsettled up till this day. As remarked by Charles Petzold, one standard history barely mentions Turing, while the other, written by a logician, makes Turing a key player. Contrast these observations then with the fact that Turing's 1936 paper was cited and heavily discussed in 1959 among computer programmers. In 1966, the first Turing award was given to a programmer, not a computer builder, as were several subsequent Turing awards. An historical investigation of Turing's influence on computing, presented here, shows that Turing's 1936 notion of universality became increasingly relevant among programmers during the 1950s. The central thesis of this paper states that Turing's in- fluence was felt more in programming after his death than in computer building during the 1940s. 1 Introduction Many people today are led to believe that Turing is the father of the computer, the father of our digital society, as also the following praise for Martin Davis's bestseller The Universal Computer: The Road from Leibniz to Turing1 suggests: At last, a book about the origin of the computer that goes to the heart of the story: the human struggle for logic and truth. -
Chapter 1 Logic and Set Theory
Chapter 1 Logic and Set Theory To criticize mathematics for its abstraction is to miss the point entirely. Abstraction is what makes mathematics work. If you concentrate too closely on too limited an application of a mathematical idea, you rob the mathematician of his most important tools: analogy, generality, and simplicity. – Ian Stewart Does God play dice? The mathematics of chaos In mathematics, a proof is a demonstration that, assuming certain axioms, some statement is necessarily true. That is, a proof is a logical argument, not an empir- ical one. One must demonstrate that a proposition is true in all cases before it is considered a theorem of mathematics. An unproven proposition for which there is some sort of empirical evidence is known as a conjecture. Mathematical logic is the framework upon which rigorous proofs are built. It is the study of the principles and criteria of valid inference and demonstrations. Logicians have analyzed set theory in great details, formulating a collection of axioms that affords a broad enough and strong enough foundation to mathematical reasoning. The standard form of axiomatic set theory is denoted ZFC and it consists of the Zermelo-Fraenkel (ZF) axioms combined with the axiom of choice (C). Each of the axioms included in this theory expresses a property of sets that is widely accepted by mathematicians. It is unfortunately true that careless use of set theory can lead to contradictions. Avoiding such contradictions was one of the original motivations for the axiomatization of set theory. 1 2 CHAPTER 1. LOGIC AND SET THEORY A rigorous analysis of set theory belongs to the foundations of mathematics and mathematical logic. -
Language and Automata Theory and Applications
LANGUAGE AND AUTOMATA THEORY AND APPLICATIONS Carlos Martín-Vide Characterization • It deals with the description of properties of sequences of symbols • Such an abstract characterization explains the interdisciplinary flavour of the field • The theory grew with the need of formalizing and describing the processes linked with the use of computers and communication devices, but its origins are within mathematical logic and linguistics A bit of history • Early roots in the work of logicians at the beginning of the XXth century: Emil Post, Alonzo Church, Alan Turing Developments motivated by the search for the foundations of the notion of proof in mathematics (Hilbert) • After the II World War: Claude Shannon, Stephen Kleene, John von Neumann Development of computers and telecommunications Interest in exploring the functions of the human brain • Late 50s XXth century: Noam Chomsky Formal methods to describe natural languages • Last decades Molecular biology considers the sequences of molecules formed by genomes as sequences of symbols on the alphabet of basic elements Interest in describing properties like repetitions of occurrences or similarity between sequences Chomsky hierarchy of languages • Finite-state or regular • Context-free • Context-sensitive • Recursively enumerable REG ⊂ CF ⊂ CS ⊂ RE Finite automata: origins • Warren McCulloch & Walter Pitts. A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics, 5:115-133, 1943 • Stephen C. Kleene. Representation of events in nerve nets and -
John P. Burgess Department of Philosophy Princeton University Princeton, NJ 08544-1006, USA [email protected]
John P. Burgess Department of Philosophy Princeton University Princeton, NJ 08544-1006, USA [email protected] LOGIC & PHILOSOPHICAL METHODOLOGY Introduction For present purposes “logic” will be understood to mean the subject whose development is described in Kneale & Kneale [1961] and of which a concise history is given in Scholz [1961]. As the terminological discussion at the beginning of the latter reference makes clear, this subject has at different times been known by different names, “analytics” and “organon” and “dialectic”, while inversely the name “logic” has at different times been applied much more broadly and loosely than it will be here. At certain times and in certain places — perhaps especially in Germany from the days of Kant through the days of Hegel — the label has come to be used so very broadly and loosely as to threaten to take in nearly the whole of metaphysics and epistemology. Logic in our sense has often been distinguished from “logic” in other, sometimes unmanageably broad and loose, senses by adding the adjectives “formal” or “deductive”. The scope of the art and science of logic, once one gets beyond elementary logic of the kind covered in introductory textbooks, is indicated by two other standard references, the Handbooks of mathematical and philosophical logic, Barwise [1977] and Gabbay & Guenthner [1983-89], though the latter includes also parts that are identified as applications of logic rather than logic proper. The term “philosophical logic” as currently used, for instance, in the Journal of Philosophical Logic, is a near-synonym for “nonclassical logic”. There is an older use of the term as a near-synonym for “philosophy of language”. -
2020 SIGACT REPORT SIGACT EC – Eric Allender, Shuchi Chawla, Nicole Immorlica, Samir Khuller (Chair), Bobby Kleinberg September 14Th, 2020
2020 SIGACT REPORT SIGACT EC – Eric Allender, Shuchi Chawla, Nicole Immorlica, Samir Khuller (chair), Bobby Kleinberg September 14th, 2020 SIGACT Mission Statement: The primary mission of ACM SIGACT (Association for Computing Machinery Special Interest Group on Algorithms and Computation Theory) is to foster and promote the discovery and dissemination of high quality research in the domain of theoretical computer science. The field of theoretical computer science is the rigorous study of all computational phenomena - natural, artificial or man-made. This includes the diverse areas of algorithms, data structures, complexity theory, distributed computation, parallel computation, VLSI, machine learning, computational biology, computational geometry, information theory, cryptography, quantum computation, computational number theory and algebra, program semantics and verification, automata theory, and the study of randomness. Work in this field is often distinguished by its emphasis on mathematical technique and rigor. 1. Awards ▪ 2020 Gödel Prize: This was awarded to Robin A. Moser and Gábor Tardos for their paper “A constructive proof of the general Lovász Local Lemma”, Journal of the ACM, Vol 57 (2), 2010. The Lovász Local Lemma (LLL) is a fundamental tool of the probabilistic method. It enables one to show the existence of certain objects even though they occur with exponentially small probability. The original proof was not algorithmic, and subsequent algorithmic versions had significant losses in parameters. This paper provides a simple, powerful algorithmic paradigm that converts almost all known applications of the LLL into randomized algorithms matching the bounds of the existence proof. The paper further gives a derandomized algorithm, a parallel algorithm, and an extension to the “lopsided” LLL. -
What Is Computerscience?
What is Computer Science? Computer Science Defined? • “computer science” —which, actually is like referring to surgery as “knife science” - Prof. Dr. Edsger W. Dijkstra • “A branch of science that deals with the theory of computation or the design of computers” - Webster Dictionary • Computer science "is the study of computation and information” - University of York • “Computer science is the study of process: how we or computers do things, how we specify what we do, and how we specify what the stuff is that we’re processing.” - Your Textbook Computer Science in Reality The study of using computers to solve problems. Fields of Computer Science • Software Engineering • Multimedia (Game Design, Animation, DataVisualization) • Web Development • Networking • Big Data / Machine Learning /AI • Bioinformatics • Robotics • Internet of Things • … Computers Rule the World! • Shopping • Communication / SocialMedia • Work • Entertainment • Vehicles • Appliances • Banking • … Overview of the Couse • Learn a programming language • Develop algorithms and write programs to implement them • Understand how computers store data and multimedia • Have fun! Programming Languages • How we communicate with computers in a way they understand • Lots of different languages, some with special purposes • How we write programs to implement algorithms What’s an Algorithm? Input Algorithm Output • An algorithm is a finite series of instructions applied to an input to produceoutput. • Computer programs are made up of algorithms. The “Recipe” Analogy Input Output Algorithm -
COMPUTER MODELS and AUTOMATA THEORY in BIOLOGY and MEDICINE Ion C
Mathematical Modelling, Vol. 7, pp. 1513-1577,1986 Printed in the U,S.A. All rights reserved. Copyright C 1986 Pergamon Journals Ltd. REVIEW ARTICLE COMPUTER MODELS AND AUTOMATA THEORY IN BIOLOGY AND MEDICINE Ion C. Baianu University of Ulinois at Urbana Physical Chemistry and NMR Laboratories 567 Bevier Hall, 905 S. Goodwin Ave .Urbana, UIinois 61801 (Received 27 February 1985; revised 12 September 1985) 1. INTRODUCTION The applications of computers to biological and biomedical problem solving goes back to the very beginnings of computer science, automata theory [1], and mathematical biology [2]. With the advent of more versatile and powerful computers, biological and biomedical applications of computers have proliferated so rapidly that it would be virtually impossible to compile a comprehensive review of all developments in this field. Limitations of computer simulations in biology have also come under close scrutiny, and claims have been made that biological systems have limited information processing power [3]. Such general conjectures do not, however, deter biologists and biomedical researchers from developing new computer applications in biology and medicine. Microprocessors are being widely employed in biological laboratories both for automatic data acquisition/processing and modeling; one particular area, which is of great biomedical interest, involves fast digital image processing and is already established for routine clinical examinations in radiological and nuclear medicine centers, Powerful techniques for biological research are routinely employing dedicated, on-line microprocessors or array processors; among such techniques are: Fourier-transform nuclear magnetic resonance (NMR), NMR imaging (or tomography), x-ray tomography, x-ray diffraction, high performance liquid chromatography, differential scanning calorimetry and mass spectrometry. -
Juhani Pallasmaa, Architect, Professor Emeritus
1 CROSSING WORLDS: MATHEMATICAL LOGIC, PHILOSOPHY, ART Honouring Juliette Kennedy University oF Helsinki, Small Hall Friday, 3 June, 2016-05-28 Juhani Pallasmaa, Architect, ProFessor Emeritus Draft 28 May 2016 THE SIXTH SENSE - diffuse perception, mood and embodied Wisdom ”Whether people are fully conscious oF this or not, they actually derive countenance and sustenance From the atmosphere oF things they live in and with”.1 Frank Lloyd Wright . --- Why do certain spaces and places make us Feel a strong aFFinity and emotional identification, while others leave us cold, or even frighten us? Why do we feel as insiders and participants in some spaces, Whereas others make us experience alienation and ”existential outsideness”, to use a notion of Edward Relph ?2 Isn’t it because the settings of the first type embrace and stimulate us, make us willingly surrender ourselves to them, and feel protected and sensually nourished? These spaces, places and environments strengthen our sense of reality and selF, whereas disturbing and alienating settings weaken our sense oF identity and reality. Resonance with the cosmos and a distinct harmonious tuning were essential qualities oF architecture since the Antiquity until the instrumentalized and aestheticized construction of the industrial era. Historically, the Fundamental task oF architecture Was to create a harmonic resonance betWeen the microcosm oF the human realm and the macrocosm oF the Universe. This harmony Was sought through proportionality based on small natural numbers FolloWing Pythagorean harmonics, on Which the harmony oF the Universe Was understood to be based. The Renaissance era also introduced the competing proportional ideal of the Golden Section. -
Mathematical Logic
Copyright c 1998–2005 by Stephen G. Simpson Mathematical Logic Stephen G. Simpson December 15, 2005 Department of Mathematics The Pennsylvania State University University Park, State College PA 16802 http://www.math.psu.edu/simpson/ This is a set of lecture notes for introductory courses in mathematical logic offered at the Pennsylvania State University. Contents Contents 1 1 Propositional Calculus 3 1.1 Formulas ............................... 3 1.2 Assignments and Satisfiability . 6 1.3 LogicalEquivalence. 10 1.4 TheTableauMethod......................... 12 1.5 TheCompletenessTheorem . 18 1.6 TreesandK¨onig’sLemma . 20 1.7 TheCompactnessTheorem . 21 1.8 CombinatorialApplications . 22 2 Predicate Calculus 24 2.1 FormulasandSentences . 24 2.2 StructuresandSatisfiability . 26 2.3 TheTableauMethod......................... 31 2.4 LogicalEquivalence. 37 2.5 TheCompletenessTheorem . 40 2.6 TheCompactnessTheorem . 46 2.7 SatisfiabilityinaDomain . 47 3 Proof Systems for Predicate Calculus 50 3.1 IntroductiontoProofSystems. 50 3.2 TheCompanionTheorem . 51 3.3 Hilbert-StyleProofSystems . 56 3.4 Gentzen-StyleProofSystems . 61 3.5 TheInterpolationTheorem . 66 4 Extensions of Predicate Calculus 71 4.1 PredicateCalculuswithIdentity . 71 4.2 TheSpectrumProblem . .. .. .. .. .. .. .. .. .. 75 4.3 PredicateCalculusWithOperations . 78 4.4 Predicate Calculus with Identity and Operations . ... 82 4.5 Many-SortedPredicateCalculus . 84 1 5 Theories, Models, Definability 87 5.1 TheoriesandModels ......................... 87 5.2 MathematicalTheories. 89 5.3 DefinabilityoveraModel . 97 5.4 DefinitionalExtensionsofTheories . 100 5.5 FoundationalTheories . 103 5.6 AxiomaticSetTheory . 106 5.7 Interpretability . 111 5.8 Beth’sDefinabilityTheorem. 112 6 Arithmetization of Predicate Calculus 114 6.1 Primitive Recursive Arithmetic . 114 6.2 Interpretability of PRA in Z1 ....................114 6.3 G¨odelNumbers ............................ 114 6.4 UndefinabilityofTruth. 117 6.5 TheProvabilityPredicate . -
Mathematical Logic and Foundations of Mathematics
Mathematical Logic and Foundations of Mathematics Stephen G. Simpson Pennsylvania State University Open House / Graduate Conference April 2–3, 2010 1 Foundations of mathematics (f.o.m.) is the study of the most basic concepts and logical structure of mathematics as a whole. Among the most basic mathematical concepts are: number, shape, set, function, algorithm, mathematical proof, mathematical definition, mathematical axiom, mathematical theorem. Some typical questions in f.o.m. are: 1. What is a number? 2. What is a shape? . 6. What is a mathematical proof? . 10. What are the appropriate axioms for mathematics? Mathematical logic gives some mathematically rigorous answers to some of these questions. 2 The concepts of “mathematical theorem” and “mathematical proof” are greatly clarified by the predicate calculus. Actually, the predicate calculus applies to non-mathematical subjects as well. Let Lxy be a 2-place predicate meaning “x loves y”. We can express properties of loving as sentences of the predicate calculus. ∀x ∃y Lxy ∃x ∀y Lyx ∀x (Lxx ⇒¬∃y Lyx) ∀x ∀y ∀z (((¬ Lyx) ∧ (¬ Lzy)) ⇒ Lzx) ∀x ((∃y Lxy) ⇒ Lxx) 3 There is a deterministic algorithm (the Tableau Method) which shows us (after a finite number of steps) that particular sentences are logically valid. For instance, the tableau ∃x (Sx ∧∀y (Eyx ⇔ (Sy ∧ ¬ Eyy))) Sa ∧∀y (Eya ⇔ Sy ∧ ¬ Eyy) Sa ∀y (Eya ⇔ Sy ∧ ¬ Eyy) Eaa ⇔ (Sa ∧ ¬ Eaa) / \ Eaa ¬ Eaa Sa ∧ ¬ Eaa ¬ (Sa ∧ ¬ Eaa) Sa / \ ¬ Sa ¬ ¬ Eaa ¬ Eaa Eaa tells us that the sentence ¬∃x (Sx ∧∀y (Eyx ⇔ (Sy ∧ ¬ Eyy))) is logically valid. This is the Russell Paradox. 4 Two significant results in mathematical logic: (G¨odel, Tarski, . -
Algorithmic Complexity in Computational Biology: Basics, Challenges and Limitations
Algorithmic complexity in computational biology: basics, challenges and limitations Davide Cirillo#,1,*, Miguel Ponce-de-Leon#,1, Alfonso Valencia1,2 1 Barcelona Supercomputing Center (BSC), C/ Jordi Girona 29, 08034, Barcelona, Spain 2 ICREA, Pg. Lluís Companys 23, 08010, Barcelona, Spain. # Contributed equally * corresponding author: [email protected] (Tel: +34 934137971) Key points: ● Computational biologists and bioinformaticians are challenged with a range of complex algorithmic problems. ● The significance and implications of the complexity of the algorithms commonly used in computational biology is not always well understood by users and developers. ● A better understanding of complexity in computational biology algorithms can help in the implementation of efficient solutions, as well as in the design of the concomitant high-performance computing and heuristic requirements. Keywords: Computational biology, Theory of computation, Complexity, High-performance computing, Heuristics Description of the author(s): Davide Cirillo is a postdoctoral researcher at the Computational biology Group within the Life Sciences Department at Barcelona Supercomputing Center (BSC). Davide Cirillo received the MSc degree in Pharmaceutical Biotechnology from University of Rome ‘La Sapienza’, Italy, in 2011, and the PhD degree in biomedicine from Universitat Pompeu Fabra (UPF) and Center for Genomic Regulation (CRG) in Barcelona, Spain, in 2016. His current research interests include Machine Learning, Artificial Intelligence, and Precision medicine. Miguel Ponce de León is a postdoctoral researcher at the Computational biology Group within the Life Sciences Department at Barcelona Supercomputing Center (BSC). Miguel Ponce de León received the MSc degree in bioinformatics from University UdelaR of Uruguay, in 2011, and the PhD degree in Biochemistry and biomedicine from University Complutense de, Madrid (UCM), Spain, in 2017.