238) Let E N Be a Decidable Set

Total Page:16

File Type:pdf, Size:1020Kb

238) Let E N Be a Decidable Set Foundations of Computer Science Logic, models, and computations Course INF412 of l’Ecole Polytechnique Olivier Bournez [email protected] Version of July 19, 2021 Logic, Models of computation, Complexity 3 Contents 1 Introduction 13 1 Mathematical concepts . 14 1.1 Sets, Functions . 14 1.2 Alphabets, Words, Languages . 15 1.3 Change of alphabet . 17 1.4 Graphs ....................................... 18 2 The diagonalisation method . 19 2 Recurrence and induction 21 1 Motivation . 21 2 Reasoning by recurrence over N ............................ 21 3 Inductive definitions . 23 3.1 General principle of an inductive definition ................. 23 3.2 Formalisation: First fix point theorem . 24 3.3 Various notations of an inductive definition . 24 4 Applications . 26 4.1 A few examples . 26 4.2 Labeled binary trees . 26 4.3 Arithmetic expressions . 28 4.4 Terms........................................ 28 5 Proofs by induction . 29 6 Derivations......................................... 31 6.1 Explicit expression of the elements: Second fix point theorem . 31 6.2 Derivation trees . 32 7 Functions defined inductively . 33 8 Bibliographic notes . 35 3 Propositional calculus 37 1 Syntax............................................ 37 2 Semantic . 39 3 Tautologies, equivalent formulas . 40 4 Some elementary facts . 40 5 Replacement of a formula by some equivalent formula . 42 5.1 A simple remark . 42 5.2 Substitutions . 42 5.3 Compositionality . 42 6 Complete systems of connectors . 43 5 Contents 7 Functional completeness . 43 8 Normalforms ....................................... 44 8.1 Conjunctive and disjunctive normal forms . 44 8.2 Transformation methods . 46 9 Compactness theorem . 47 9.1 Satisfaction of a set of formulas . 47 10 Exercises .......................................... 49 11 Bibliographic notes . 50 4 Proofs 51 1 Introduction . 51 2 Proofs à la Frege and Hilbert . 52 3 Demonstrations by natural deduction . 55 3.1 Rules from natural deduction . 55 3.2 Validity and completeness . 56 4 Proofs by resolution . 57 5 Proofs by tableau method . 58 5.1 Principle . 58 5.2 Description of the method . 61 5.3 Termination of the method . 62 5.4 Validity . 63 5.5 Completeness . 64 5.6 One consequence of compactness theorem . 65 6 Bibliographic notes . 65 5 Predicate calculus 67 1 Syntax............................................ 67 1.1 Terms........................................ 69 1.2 Atomic formulas . 69 1.3 Formulas . 70 2 First properties and definitions . 71 2.1 Decomposition / Uniqueness reading . 71 2.2 Free variables . 72 3 Semantic . 74 3.1 Interpretation of terms . 74 3.2 Interpretation of atomic formulas . 75 3.3 Interpretation of formulas . 76 3.4 Substitutions . 77 4 Equivalence, Normal forms . 78 4.1 Equivalent formulas . 78 4.2 Prenex normal form . 80 4.3 Skolem form . 82 5 Bibliographic notes . 84 6 Contents 6 Models. Completeness. 85 1 Examples of theories . 85 1.1 Graphs ....................................... 85 1.2 Simple remarks . 86 1.3 Equality . 87 1.4 Small digression . 88 1.5 Groups . 89 1.6 Fields . 89 1.7 Robinson Arithmetic . 90 1.8 Peano arithmetic . 92 2 Completeness . 93 2.1 Consequences . 93 2.2 Demonstration . 93 2.3 Statement of completeness theorem . 93 2.4 Meaning of the theorem . 94 2.5 Other formulation of the theorem . 94 3 Proof of completeness theorem . 94 3.1 A deduction system . 94 3.2 Finiteness theorem . 95 3.3 Some technical results . 96 3.4 Validity of the deduction system . 97 3.5 Completeness of the deduction system . 97 4 Compactness . 100 5 Other consequences . 100 6 Bibliographic notes . 100 7 Turing machines 103 1 Turingmachines ..................................... 104 1.1 Ingredients . 104 1.2 Description . 105 1.3 Programming with Turing machines . 109 1.4 Some programming techniques . 112 1.5 Applications . 114 1.6 Variants of the notion of Turing machine . 114 1.7 Locality of the notion of computation . 118 2 Bibliographic notes . 118 8 A few other models of computation 121 1 RAM............................................. 121 1.1 RAMmodel .................................... 121 1.2 Simulation of a RISC machine by a Turing machine . 122 1.3 Simulation of a RAM by a Turing machine . 124 2 Rudimentary models . 124 2.1 Machines with k 2 stacks . 124 ¸ 7 Contents 2.2 Counter machines . 125 3 Church-Turing thesis . ..
Recommended publications
  • PDF with Red/Green Hyperlinks
    Elements of Programming Elements of Programming Alexander Stepanov Paul McJones (ab)c = a(bc) Semigroup Press Palo Alto • Mountain View Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and the publisher was aware of a trademark claim, the designations have been printed with initial capital letters or in all capitals. The authors and publisher have taken care in the preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein. Copyright c 2009 Pearson Education, Inc. Portions Copyright c 2019 Alexander Stepanov and Paul McJones All rights reserved. Printed in the United States of America. This publication is protected by copyright, and permission must be obtained from the publisher prior to any prohibited reproduction, storage in a retrieval system, or transmission in any form or by any means, electronic, mechanical, photocopying, recording, or likewise. For information regarding permissions, request forms and the appropriate contacts within the Pearson Education Global Rights & Permissions Department, please visit www.pearsoned.com/permissions/. ISBN-13: 978-0-578-22214-1 First printing, June 2019 Contents Preface to Authors' Edition ix Preface xi 1 Foundations 1 1.1 Categories of Ideas: Entity, Species,
    [Show full text]
  • Undecidability of the Word Problem for Groups: the Point of View of Rewriting Theory
    Universita` degli Studi Roma Tre Facolta` di Scienze M.F.N. Corso di Laurea in Matematica Tesi di Laurea in Matematica Undecidability of the word problem for groups: the point of view of rewriting theory Candidato Relatori Matteo Acclavio Prof. Y. Lafont ..................................... Prof. L. Tortora de falco ...................................... questa tesi ´estata redatta nell'ambito del Curriculum Binazionale di Laurea Magistrale in Logica, con il sostegno dell'Universit´aItalo-Francese (programma Vinci 2009) Anno Accademico 2011-2012 Ottobre 2012 Classificazione AMS: Parole chiave: \There once was a king, Sitting on the sofa, He said to his maid, Tell me a story, And the maid began: There once was a king, Sitting on the sofa, He said to his maid, Tell me a story, And the maid began: There once was a king, Sitting on the sofa, He said to his maid, Tell me a story, And the maid began: There once was a king, Sitting on the sofa, . " Italian nursery rhyme Even if you don't know this tale, it's easy to understand that this could continue indefinitely, but it doesn't have to. If now we want to know if the nar- ration will finish, this question is what is called an undecidable problem: we'll need to listen the tale until it will finish, but even if it will not, one can never say it won't stop since it could finish later. those things make some people loose sleep, but usually children, bored, fall asleep. More precisely a decision problem is given by a question regarding some data that admit a negative or positive answer, for example: \is the integer number n odd?" or \ does the story of the king on the sofa admit an happy ending?".
    [Show full text]
  • CS411-2015F-14 Counter Machines & Recursive Functions
    Automata Theory CS411-2015F-14 Counter Machines & Recursive Functions David Galles Department of Computer Science University of San Francisco 14-0: Counter Machines Give a Non-Deterministic Finite Automata a counter Increment the counter Decrement the counter Check to see if the counter is zero 14-1: Counter Machines A Counter Machine M = (K, Σ, ∆,s,F ) K is a set of states Σ is the input alphabet s ∈ K is the start state F ⊂ K are Final states ∆ ⊆ ((K × (Σ ∪ ǫ) ×{zero, ¬zero}) × (K × {−1, 0, +1})) Accept if you reach the end of the string, end in an accept state, and have an empty counter. 14-2: Counter Machines Give a Non-Deterministic Finite Automata a counter Increment the counter Decrement the counter Check to see if the counter is zero Do we have more power than a standard NFA? 14-3: Counter Machines Give a counter machine for the language anbn 14-4: Counter Machines Give a counter machine for the language anbn (a,zero,+1) (a,~zero,+1) (b,~zero,−1) (b,~zero,−1) 0 1 14-5: Counter Machines Give a 2-counter machine for the language anbncn Straightforward extension – examine (and change) two counters instead of one. 14-6: Counter Machines Give a 2-counter machine for the language anbncn (a,zero,zero,+1,0) (a,~zero,zero,+1,0) (b,~zero,~zero,-1,+1) (b,~zero,zero,−1,+1) 0 1 (c,zero,~zero,0,-1) 2 (c,zero,~zero,0,-1) 14-7: Counter Machines Our counter machines only accept if the counter is zero Does this give us any more power than a counter machine that accepts whenever the end of the string is reached in an accept state? That is, given
    [Show full text]
  • A Microcontroller Based Fan Speed Control Using PID Controller Theory
    A Microcontroller Based Fan Speed Control Using PID Controller Theory Thu Thu Zue Zin and Hlaing Thida Oo University of Computer Studies, Yangon thuthuzuezin @gmail.com Abstract PIC control application is widely used and User define popular in modern elections. The aim of this paper Microcontroller speed PIC 16F877 is design and construct the fan speed control system Duty cycle with microcontroller. PIC 16F877 and photo transistor is used for the system. User define speed can be selected by keypads for various speed. Motor is controlled by the pulse width modulation. Driver The system can be operate with normal mode and circuit timer mode. Delay time for timer mode is 10 seconds. The feedback signal from sensor is controlled by the proportional integral derivative equations to reproduce the desire duty cycle. Sensor Motor 1. Introduction Figure 1. Block Diagram of the System Motors are widely used in many applications, such as air conditioners , slide doors, washing machines and control areas. Motors are 2. Background Theory derivate it’s output performance due to the PID Controller tolerances, operating conditions, process error and Proportional Integral Derivative controller is measurement error. Pulse Width Modulation a generic control loop feedback mechanism widely control technique is better for control the DC motor used in industrial control systems. A PID controller than others techniques. PWM control the speed of attempts to correct the error between a measured motor without changing the voltage supply to process variable and a desired set point by calculating motor. Series of pulse define the speed of the and then outputting a corrective action that can adjust motor.
    [Show full text]
  • Copyright © 1998, by the Author(S). All Rights Reserved
    Copyright © 1998, by the author(s). All rights reserved. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission. WHATS DECIDABLE ABOUT HYBRID AUTOMATA by Thomas A. Henzinger, Peter W. Kopke, Anuj Puri, and Pravin Varaiya Memorandum No. UCB/ERL M98/22 15 April 1998 WHAT'S DECIDABLE ABOUT HYBRID AUTOMATA by Thomas A. Henzinger,Peter W. Kopke, Anuj Puri, and Pravin Varaiya Memorandum No. UCB/ERL M98/22 15 April 1998 ELECTRONICS RESEARCH LABORATORY College ofEngineering University of California, Berkeley 94720 What's Decidable About Hybrid Automata?*^ Thomas A. Henzinger^ Peter W. Kopke^ Anuj Puri^ Pravin Varaiya^ Abstract. Hybrid automata model systems with both digital and analog compo nents, such as embedded control programs. Many verification tasks for such programs can be expressed as reachabibty problems for hybrid automata. By improving on pre vious decidability and undecidability results, we identify a precise boundary between decidability and undecidability for the reachabibty problem of hybrid automata. On the positive side, we give an (optimal) PSPACE reachabibty algorithmfor the case of initiabzed rectangular automata, where ab analog variables foUow independent tra jectories within piecewise-bnear envelopes and are reinitiabzed whenever the envelope changes. Our algorithm is based on the construction ofa timedautomaton that contains ab reachabibty information about a given initiabzed rectangular automaton.
    [Show full text]
  • Turing Machines [Fa’16]
    Models of Computation Lecture 6: Turing Machines [Fa’16] Think globally, act locally. — Attributed to Patrick Geddes (c.1915), among many others. We can only see a short distance ahead, but we can see plenty there that needs to be done. — Alan Turing, “Computing Machinery and Intelligence” (1950) Never worry about theory as long as the machinery does what it’s supposed to do. — Robert Anson Heinlein, Waldo & Magic, Inc. (1950) It is a sobering thought that when Mozart was my age, he had been dead for two years. — Tom Lehrer, introduction to “Alma”, That Was the Year That Was (1965) 6 Turing Machines In 1936, a few months before his 24th birthday, Alan Turing launched computer science as a modern intellectual discipline. In a single remarkable paper, Turing provided the following results: • A simple formal model of mechanical computation now known as Turing machines. • A description of a single universal machine that can be used to compute any function computable by any other Turing machine. • A proof that no Turing machine can solve the halting problem—Given the formal description of an arbitrary Turing machine M, does M halt or run forever? • A proof that no Turing machine can determine whether an arbitrary given proposition is provable from the axioms of first-order logic. This is Hilbert and Ackermann’s famous Entscheidungsproblem (“decision problem”). • Compelling arguments1 that his machines can execute arbitrary “calculation by finite means”. Although Turing did not know it at the time, he was not the first to prove that the Entschei- dungsproblem had no algorithmic solution.
    [Show full text]
  • Complexity: Automata DICE 2015
    An in-between “implicit” and “explicit” complexity: Automata DICE 2015 Clément Aubert Queen Mary University of London 12 April 2015 Introduction: Motivation (Dal Lago, 2011, p. 90) Question Is there an in-between? Answer One can also restrict the quality of the resources. ICC is machine-independent and without explicit bounds. 2 (Ibarra, 1971, p. 88) (Girard et al., 1992, p. 18) Machine-independant Bounded recursion on notation (Cobham, 1965), Bounded linear logic (Girard et al., 1992), Bounded arithmetic (Buss, 1986), . Explicit bounds Automaton, Descriptive complexity (Fagin, 1973), Auxiliary pushdown machine, Recursion on notation (Bellantoni and Cook, 1992), (Boolean circuit,) . Tiered recurrence (Leivant, 1993), . Implicit bounds Introduction: What is ICC? Machine-dependant Turing machine, Random access machine, Counter machine, . 3 (Ibarra, 1971, p. 88) (Girard et al., 1992, p. 18) Explicit bounds Automaton, Descriptive complexity (Fagin, 1973), Auxiliary pushdown machine, Recursion on notation (Bellantoni and Cook, 1992), (Boolean circuit,) . Tiered recurrence (Leivant, 1993), . Implicit bounds Introduction: What is ICC? Machine-dependant Machine-independant Turing machine, Bounded recursion on notation (Cobham, 1965), Random access machine, Bounded linear logic (Girard et al., 1992), Counter machine, . Bounded arithmetic (Buss, 1986), . 3 (Ibarra, 1971, p. 88) Explicit bounds Automaton, Descriptive complexity (Fagin, 1973), Auxiliary pushdown machine, Recursion on notation (Bellantoni and Cook, 1992), (Boolean circuit,) . Tiered recurrence (Leivant, 1993), . Implicit bounds Introduction: What is ICC? Machine-dependant Machine-independant Turing machine, Bounded recursion on notation (Cobham, 1965), Random access machine, Bounded linear logic (Girard et al., 1992), Counter machine, . Bounded arithmetic (Buss, 1986), . (Girard et al., 1992, p. 18) 3 (Ibarra, 1971, p. 88) (Girard et al., 1992, p.
    [Show full text]
  • Bounded Counter Languages
    Bounded Counter Languages⋆ Holger Petersen Reinsburgstr. 75 D-70197 Stuttgart Abstract. We show that deterministic finite automata equipped with k two-way heads are equivalent to deterministic machines with a single two-way input head and k − 1 linearly bounded counters if the accepted ∗ ∗ ∗ language is strictly bounded, i.e., a subset of a1a2 · · · am for a fixed se- quence of symbols a1,a2,...,am. Then we investigate linear speed-up for counter machines. Lower and upper time bounds for concrete recognition problems are shown, implying that in general linear speed-up does not hold for counter machines. For bounded languages we develop a technique for speeding up computations by any constant factor at the expense of adding a fixed number of counters. 1 Introduction The computational model investigated in the present work is the two-way counter machine as defined in [4]. Recently, the power of this model has been compared to quantum automata and probabilistic automata [17,14]. We will show that bounded counters and heads are equally powerful for finite deterministic devices, provided the languages under consideration are strictly bounded. By equally powerful we mean that up to a single head each two- way input head of a deterministic finite machine can be simulated by a counter bounded by the input length and vice versa. The condition that the input is bounded cannot be removed in general, since it is known that deterministic finite two-way two-head automata are more powerful than deterministic two- way one counter machines if the input is not bounded [2]. The special case of equivalence between deterministic one counter machines and two-head automata over a single letter alphabet has been shown with the help of a two-dimensional automata model as an intermediate step in [10], see also [11].
    [Show full text]
  • Programs = Data = First-Class Citizens in a Computational World
    PROGRAMS = DATA = FIRST-CLASS CITIZENS IN A COMPUTATIONAL WORLD Lars Hartmann Neil D. Jones Jakob Grue Simonsen + Visualization by Søren Bjerregaard Vrist (All now or recently at the University of Copenhagen) IMDEA and UCM Madrid (March 2012) Sources: I Conference CS2BIO Computer Science to Biology (ENTCS proceedings June 2010) I Journal Scientific Annals of Computer Science (2011, Vol. XXI) I Festschrift for Carolyn Talcott (November 2011, Springer Festschrift Series, LNCS vol. 7000) I Article accepted to appear in Philosophical Transactions A of the Royal Society | 0 | ALAN TURING STARTED THE BALL ROLLING (IN 1936) 1. A convincing analysis of the nature of computation 2. A very early model of computation (MOC) 3. The first programmers' manual 4. Undecidability of the halting problem 5. Universal Turing machine (a self-interpreter) 6. Contributor to the “Confluence of ideas'": that all sensible models of computation are equivalent, e.g., I Turing machine I Lambda calculus I Recursive function definitions I String rewrite systems | 1 | 75 YEARS OF MODELS OF COMPUTATION (just a few) Lambda calculus Church 1936 Turing machine 1936 von Neumann architecture 1945 Finite automata Rabin and Scott Counter machine Lambek and Minsky Random access machine (RAM) Cook and Reckhow Random access stored program (RASP) Elgot and Robinson Cellular automaton, LIFE,.. von Neumann, Conway, Wolfram Abstract state machine Gurevich et al Text register machine Moss Blob model 2010 | 2 | ABOUT MOCS (MODELS OF COMPUTATION) Criteria I How to compare I How to improve I Lacks, failings, inconveniences I What are they suitable for? Programming? Theorem proving ? Modeling ? . New direction: biological computing I Enormous potential (price, concurrency, automation, .
    [Show full text]
  • Complexity of Small Universal Turing Machines: a Survey
    The complexity of small universal Turing machines: a survey⋆ Turlough Neary1 and Damien Woods2 1 School of Computer Science & Informatics, University College Dublin, Ireland. [email protected] 2 Division of Engineering & Applied Science, California Institute of Technology, Pasadena, CA 91125, USA. [email protected] Abstract. We survey some work concerned with small universal Turing machines, cellular automata, tag systems, and other simple models of computation. For example it has been an open question for some time as to whether the smallest known universal Turing machines of Minsky, Rogozhin, Baiocchi and Kudlek are efficient (polynomial time) simula- tors of Turing machines. These are some of the most intuitively simple computational devices and previously the best known simulations were exponentially slow. We discuss recent work that shows that these ma- chines are indeed efficient simulators. In addition, another related result shows that Rule 110, a well-known elementary cellular automaton, is ef- ficiently universal. We also discuss some old and new universal program size results, including the smallest known universal Turing machines. We finish the survey with results on generalised and restricted Turing machine models including machines with a periodic background on the tape (instead of a blank symbol), multiple tapes, multiple dimensions, and machines that never write to their tape. We then discuss some ideas for future work. 1 Introduction In this survey we explore results related to the time and program size complexity of universal Turing machines, and other models of computation. We also discuss arXiv:1110.2230v1 [cs.CC] 10 Oct 2011 results for variants on the Turing machine model to give an idea of the many strands of work in the area.
    [Show full text]
  • Remote Exploitation of an Unaltered Passenger Vehicle
    TECHNICAL WHITE PAPER Remote Exploitation of an Unaltered Passenger Vehicle Chris Valasek, Director of Vehicle Security Research for IOActive [email protected] Charlie Miller, Security Researcher for Twitter [email protected] Copyright ©2015. All Rights Reserved.- 1 - Contents Introduction ............................................................................................................................ 5 Target – 2014 Jeep Cherokee ............................................................................................... 7 Network Architecture .......................................................................................................... 8 Cyber Physical Features .................................................................................................. 10 Adaptive Cruise Control (ACC) ..................................................................................... 10 Forward Collision Warning Plus (FCW+) ...................................................................... 10 Lane Departure Warning (LDW+) ................................................................................. 11 Park Assist System (PAM) ............................................................................................ 12 Remote Attack Surface ..................................................................................................... 13 Passive Anti-Theft System (PATS) ............................................................................... 13 Tire Pressure Monitoring System (TPMS) ...................................................................
    [Show full text]
  • List of Glossary Terms
    List of Glossary Terms A Ageofaclusterorfuzzyrule 1054 A correlated equilibrium 3064 Agent 58, 76, 105, 1767, 2578, 3004 Amechanism 1837 Agent architecture 105 Anearestneighbor 790 Agent based models 2940 A social choice function 1837 Agent (or software agent) 2999 A stochastic game 3064 Agent-based computational models 2898 Astrategy 3064 Agent-based model 58 Abelian group 2780 Agent-based modeling 1767 Absolute temperature 940 Agent-based modeling (ABM) 39 Absorbing state 1080 Agent-based simulation 18, 88 Abstract game 675 Aggregation 862 Abstract game of network formation with respect to Aggregation operators 122 irreflexive dominance 2044 Aging 2564, 2611 Abstract game of network formation with respect to path Algebra 2925 dominance 2044 Algebraic models 2898 Accuracy 161, 827 Algorithm 2496 Accuracy (rate) 862 Algorithmic complexity of object x 132 Achievable mate 3235 Algorithmic self-assembly of DNA tiles 1894 Action profile 3023 Allowable set of partners 3234 Action set 3023 Almost equicontinuous CA 914, 3212 Action type 2656 Alphabet of a cellular automaton 1 Activation function 813 ˛-Level set and support 1240 Activator 622 Alternating independent-2-paths 2953 Active membranes 1851 Alternating k-stars 2953 Actors 2029 Alternating k-triangles 2953 Adaptation 39 Amorphous computer 147 Adaptive system 1619 Analog 3187 Additive cellular automata 1 Analog circuit 3260 Additively separable preferences 3235 Ancilla qubits 2478 Adiabatic switching 1998 Anisotropic elements 754 Adjacency matrix 1746, 3114 Annealed law 2564 Adjacent 2864,
    [Show full text]