DOCSLIB.ORG

Church-Turing Thesis: Every Function F: {0,1}* -> {0,1}* Which Is "Effectively Computable" Is Computable by a Turing Machine

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Church-Turing Thesis: Every Function F: {0,1}* -> {0,1}* Which Is Church-Turing Thesis: Every function f: {0,1}* -> {0,1}* which is "effectively computable" is computable by a Turing Machine. Observation: Every Turing Machine (equivalently, every python program, or evey program in your favorite language) M can be encoded by a finite binary string #M. Moreover, our encoding guarantees #M != #M' whenever M and M' are different Turing Machines (different programs). Recall: Every finite binary string can be thought of as a natural number written in binary, and vice versa. Therefore, we can think of #M as a natural number. E.g. If #M = 1057, then we are talking about the 1057th Turing Machine, or 1057th python program. Intuitive takeaway: At most, there are as many different Turing Machines (Programs) as there are natural numbers. We will now show that some (in fact most) decision problems f: {0,1}* -> {0,1} are not computable by a TM (python program). If a decision problem is not comptuable a TM/program then we say it is "undecidable". Theorem: There are functions from {0,1}* to {0,1} which are not computable by a Turing Machine (We say, undecidable). Corollary: Assuming the CT thesis, there are functions which are not "effectively computable". Proof of Theorem: - Recall that we can think of instead of of {0,1}* - "How many" functions f: -> {0,1} are there? - We can think of each each such function f as an infinite binary string - For each x in (0,1), we can write its binary expansion as an infinite binary string to the right of a decimal point - The string to the right of the decimal point can be interpreted as a function f_x from natural numbers to {0,1} -- f_x(i) = ith bit of x to the right of the decimal point - In other words: for each x in (0,1) we get a different function f_x from natural numbers to {0,1}, so there are at least as many decision problems as there are numbers in (0,1). So, there are at least as many decision problems as there are numbers in (0,1). How many different Turing Machines (python programs) are there? - Recall: Each Turing machine (python program) can be encoded as a finite string. Also, finite binary strings are in a bijection with the natural numbers. - At most, there are as many Turing Machines (python programs) as there are natural numbers. -- We say: Turing machines are "countable". Suppose for a contradiction that each decision problem can be solved by a TM (or, a python program). - We have an injective map from decision problems to Turing Machines. Composing the two injective maps, we have an injective map from (0,1) to the natural numbers - I.e., (0,1) are countable. Theorem (Cantor): (0,1) are uncountable. (There does not exist an injection from (0,1) to the natural numbers). Note: Often this is stated as the real numbers are uncountable. This is equivalent, because We arrived at a contradiction. Upshot: There are as many decision problems as there are real numbers, but there are only as many algorithms as there are whole numbers. There are way more problems than there are algorithms. Recall: Turing Machines === Python programs === C programs === Algorithms in your favorite language. - Historically, we used to think of each algorithm as a different "machine". In other words, algorithms were thought of as "hardware", while inputs/outputs/intermediate results were thought of as the "software". - One of Turing's great insights, which is obvious to us but was revolutionary at the time, is that you can think of algorithms as "software". -- Each Turing Machine, or Algorithm in your favorite language, can be written as a finite binary string. -- There exists a "Universal Turing Machine" (today we call it "interpreter") which can take the description of another TM / Algorithm as input, and "simulate it". Definition: A Universal Turing Machine U is a Turing Machine which takes as input a string #M describing a different Turing machine M, and another string x, and "simulates" M on x. Nowadays we call U an "interpreter" (software perspective), or a "general purpose computer" (hardware perspective) Theorem (Turing): A Universal Turing Machine exists. Great insight at the time, and the proof was quite technical. Interpretation in modern lingo: --- Interpreters exist (software perspective). In other words, you can write an interpreter for your favorite language in your favorite language. --- General purpose computers exist (Hardware perspective). A computer can run virtual machines simulating other computers. Important to remember: An algorithm can take in another algorithm as input, simulate it on whatever input it wants, postprocess the output, etc. Input: - Algorithm M, written as a finite string in your favorite programming language. (e.g. Python, C, TM) - Binary string x Output: Does M halt on input x? Return H (meaning, "halts") if yes, otherwise return L (meaning "loops forever). Theorem: The halting problem is undecidable. In other words, there is no algorithm, no matter its runtime, which solves the halting problem, assuming the CT thesis. .
Load more

Recommended publications
  • Elementary Functions: Towards Automatically Generated, Efficient
    Elementary functions : towards automatically generated, efficient, and vectorizable implementations Hugues De Lassus Saint-Genies To cite this version: Hugues De Lassus Saint-Genies. Elementary functions : towards automatically generated, efficient, and vectorizable implementations. Other [cs.OH]. Université de Perpignan, 2018. English. NNT : 2018PERP0010. tel-01841424 HAL Id: tel-01841424 https://tel.archives-ouvertes.fr/tel-01841424 Submitted on 17 Jul 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Délivré par l’Université de Perpignan Via Domitia Préparée au sein de l’école doctorale 305 – Énergie et Environnement Et de l’unité de recherche DALI – LIRMM – CNRS UMR 5506 Spécialité: Informatique Présentée par Hugues de Lassus Saint-Geniès [email protected] Elementary functions: towards automatically generated, efficient, and vectorizable implementations Version soumise aux rapporteurs. Jury composé de : M. Florent de Dinechin Pr. INSA Lyon Rapporteur Mme Fabienne Jézéquel MC, HDR UParis 2 Rapporteur M. Marc Daumas Pr. UPVD Examinateur M. Lionel Lacassagne Pr. UParis 6 Examinateur M. Daniel Menard Pr. INSA Rennes Examinateur M. Éric Petit Ph.D. Intel Examinateur M. David Defour MC, HDR UPVD Directeur M. Guillaume Revy MC UPVD Codirecteur À la mémoire de ma grand-mère Françoise Lapergue et de Jos Perrot, marin-pêcheur bigouden.
    [Show full text]
  • Reconfigurable Embedded Control Systems: Problems and Solutions
    RECONFIGURABLE EMBEDDED CONTROL SYSTEMS: PROBLEMS AND SOLUTIONS By Dr.rer.nat.Habil. Mohamed Khalgui ⃝c Copyright by Dr.rer.nat.Habil. Mohamed Khalgui, 2012 v Martin Luther University, Germany Research Manuscript for Habilitation Diploma in Computer Science 1. Reviewer: Prof.Dr. Hans-Michael Hanisch, Martin Luther University, Germany, 2. Reviewer: Prof.Dr. Georg Frey, Saarland University, Germany, 3. Reviewer: Prof.Dr. Wolf Zimmermann, Martin Luther University, Germany, Day of the defense: Monday January 23rd 2012, Table of Contents Table of Contents vi English Abstract x German Abstract xi English Keywords xii German Keywords xiii Acknowledgements xiv Dedicate xv 1 General Introduction 1 2 Embedded Architectures: Overview on Hardware and Operating Systems 3 2.1 Embedded Hardware Components . 3 2.1.1 Microcontrollers . 3 2.1.2 Digital Signal Processors (DSP): . 4 2.1.3 System on Chip (SoC): . 5 2.1.4 Programmable Logic Controllers (PLC): . 6 2.2 Real-Time Embedded Operating Systems (RTOS) . 8 2.2.1 QNX . 9 2.2.2 RTLinux . 9 2.2.3 VxWorks . 9 2.2.4 Windows CE . 10 2.3 Known Embedded Software Solutions . 11 2.3.1 Simple Control Loop . 12 2.3.2 Interrupt Controlled System . 12 2.3.3 Cooperative Multitasking . 12 2.3.4 Preemptive Multitasking or Multi-Threading . 12 2.3.5 Microkernels . 13 2.3.6 Monolithic Kernels . 13 2.3.7 Additional Software Components: . 13 2.4 Conclusion . 14 3 Embedded Systems: Overview on Software Components 15 3.1 Basic Concepts of Components . 15 3.2 Architecture Description Languages . 17 3.2.1 Acme Language .
    [Show full text]
  • YANLI: a Powerful Natural Language Front-End Tool
    AI Magazine Volume 8 Number 1 (1987) (© AAAI) John C. Glasgow I1 YANLI: A Powerful Natural Language Front-End Tool An important issue in achieving acceptance of computer sys- Since first proposed by Woods (1970), ATNs have be- tems used by the nonprogramming community is the ability come a popular method of defining grammars for natural to communicate with these systems in natural language. Of- language parsing programs. This popularity is due to the ten, a great deal of time in the design of any such system is flexibility with which ATNs can be applied to hierarchically devoted to the natural language front end. An obvious way to describable phenomenon and to their power, which is that of simplify this task is to provide a portable natural language a universal Turing machine. As discussed later, a grammar front-end tool or facility that is sophisticated enough to allow in the form of an ATN (written in LISP) is more informative for a reasonable variety of input; allows modification; and, than a grammar in Backus-Naur notation. As an example, yet, is easy to use. This paper describes such a tool that is the first few lines of a grammar for an English sentence writ- based on augmented transition networks (ATNs). It allows ten in Backus-Naur notation might look like the following: for user input to be in sentence or nonsentence form or both, provides a detailed parse tree that the user can access, and sentence : := [subject] predicate also provides the facility to generate responses and save in- subject ::= noun-group formation.
    [Show full text]
  • Turing's Influence on Programming — Book Extract from “The Dawn of Software Engineering: from Turing to Dijkstra”
    Turing's Influence on Programming | Book extract from \The Dawn of Software Engineering: from Turing to Dijkstra" Edgar G. Daylight∗ Eindhoven University of Technology, The Netherlands [email protected] Abstract Turing's involvement with computer building was popularized in the 1970s and later. Most notable are the books by Brian Randell (1973), Andrew Hodges (1983), and Martin Davis (2000). A central question is whether John von Neumann was influenced by Turing's 1936 paper when he helped build the EDVAC machine, even though he never cited Turing's work. This question remains unsettled up till this day. As remarked by Charles Petzold, one standard history barely mentions Turing, while the other, written by a logician, makes Turing a key player. Contrast these observations then with the fact that Turing's 1936 paper was cited and heavily discussed in 1959 among computer programmers. In 1966, the first Turing award was given to a programmer, not a computer builder, as were several subsequent Turing awards. An historical investigation of Turing's influence on computing, presented here, shows that Turing's 1936 notion of universality became increasingly relevant among programmers during the 1950s. The central thesis of this paper states that Turing's in- fluence was felt more in programming after his death than in computer building during the 1940s. 1 Introduction Many people today are led to believe that Turing is the father of the computer, the father of our digital society, as also the following praise for Martin Davis's bestseller The Universal Computer: The Road from Leibniz to Turing1 suggests: At last, a book about the origin of the computer that goes to the heart of the story: the human struggle for logic and truth.
    [Show full text]
  • Computers Friday, February 12, 2021 11:00 AM
    1 Introduction: Computers Friday, February 12, 2021 11:00 AM Welcome! CMSC 240 - Principles of Computer Organization Class website: https://cs.brynmawr.edu/Courses/cs240/Spring2021/ What is a computer? A device with • A processor (CPU - Central Processing Unit) • Storage/memory (RAM, Disk, USB Stick) • A keyboard • A mouse • A monitor • A printer Not all computers have all of the above. Except the CPU and memory. Japan's Fugaku Supercomputer is one of the world's fastest computer as of Summer 2020. Performance is over 400 petaflops (over a million times faster than the desktop shown on the right). Question: What was the first ever computer? 240 Lectures Page 1 1 Computers - Old & New Friday, February 12, 2021 11:00 AM The Difference Engine #2: A Mechanical Computer ENIAC Electronic Numerical Integrator and Computer February 15, 1946. ENIAC Day is this week! https://eniacday.org/ Check it out. Question: What is the difference between the ENIAC, the Apple Mac, the Iphone, and the Fugaku??? 240 Lectures Page 2 1 Turing Machines Friday, February 12, 2021 11:00 AM 1937: Alan M. Turing Turing Machine [A mathematical abstraction of mechanical computation.] Turing Machines for adding and multiplying Universal Turing Machine Church-Turing Thesis (tl;dr) Anything that can be computed can be computed by a Turing machine. Key Idea: A computer is essentially a Turing Machine. A computer is a universal computing device. 240 Lectures Page 3 1 Put on Watch List… Friday, February 12, 2021 8:55 AM 240 Lectures Page 4 1 von Neumann Architecture Friday, February 12, 2021 11:00 AM John von Neumann, 1945 Stored Program Computers Aka von Neumann Architecture Most computers today are based on this architecture.
    [Show full text]
  • Universal Turing Machine
    15-251 Great Theoretical Ideas in Computer Science Lecture 21 - Dan Kilgallin Turing Machines Goals Describe the nature of computation Mathematically formalize the behavior of a program running on a computer system Compare the capabilities of different programming languages Turing Machines What can we do to make a DFA better? Idea: Give it some memory! How much memory? Infinite! What kind of memory? Sequential access (e. g. CD, hard drive) or RAM? An infinite amount of RAM requires remembering really big numbers and needlessly complicates proofs Turing Machines: Definition A Turing Machine consists of A DFA to store the machine state, called the controller An array that is infinitely long in both directions, called the tape A pointer to some particular cell in the array, called the head Operation The head begins at cell 0 on the tape The DFA begins in some initial state Symbols from some alphabet are written on a finite portion of the tape, beginning at cell 1 Operation At each step, the machine uses as input: The state of the controller The symbol written on the cell which the head is at Using this, the machine will: Transition to some state in the DFA (possibly the same state) Write some symbol (possibly the same symbol) on the tape Move the head left or right one cell Two Flavors! The machine will stop computation if the DFA enters one of a pre-defined set of "halting" states A "decision" machine will, if it reaches a halting state, output either "Yes" or "No" (i.e. there are "accepting" and "rejecting" halt states) A "function" machine will, if it reaches a halting state, have some string of symbols written on the tape.
    [Show full text]
  • Sources a Brief History of Computer Science ●Schneider and Gersting, an Invitation to Computer Science ●Primary Source CSCE 181, Yoonsuck Choe ●Slides from Prof
    * Sources A Brief History of Computer Science ●Schneider and Gersting, An Invitation to Computer Science ●primary source CSCE 181, Yoonsuck Choe ●Slides from Prof. John Keyser Slides with dark blue background header: Prof. Jennifer Welch’s slides ●American University’s Computing History Museum • ●http://www.computinghistorymuseum.org/ from Spring 2010 CSCE 181. ●Virginia Tech’s History of Computing website: ●http://ei.cs.vt.edu/~history Slides with blank background: Yoonsuck Choe • ●Computer History Museum ●http://www.computerhistory.org/ ●IEEE Annals of the History of Computing (Journal) ●http://www.computer.org/portal/site/annals/index.jsp ●Andrew Hodges’ website about Alan Turing ●http://http://www.turing.org.uk/turing/index.html * More Sources Early Mathematics & Computation ●Babylonians and Egyptians, > 3000 yrs ago James Burke, Connections, MacMillan: London, 1978. • ●numerical methods for generating tables of square Photos taken by Yoonsuck Choe at the Computer History roots, multiplication, trig • ●Applications: navigation, agriculture, taxation Museum in Mountainview, CA. December 2011. ●Greeks, > 3000 yrs ago ●geometry and logic ●Indians, ~ 600 AD ●started using placeholders and a decimal number system, similar to modern ●idea spread to Middle East ●Arabs and Persians ~ 800 AD ●algorithms * * A Famous Arab Mathematician Abu Jafar Mohammed Ibn Musa Al-Khowarizmi Early Computing Devices ●In early 800s AD ●Abacus ●Worked at center of learning in Baghdad ●About 3000 BC ●Wrote book: Hisab Al Jabr Wal- ●Different types, developed
    [Show full text]
  • Handout 5 Summary of This Handout: Multitape Machines — Multidimensional Machines — Universal Turing Machine — Turing Completeness — Church’S Thesis
    06-05934 Models of Computation The University of Birmingham Spring Semester 2009 School of Computer Science Volker Sorge February 16, 2009 Handout 5 Summary of this handout: Multitape Machines — Multidimensional Machines — Universal Turing Machine — Turing Completeness — Church’s Thesis III.5 Extending Turing Machines In this handout we will study a few alterations to the basic Turing machine model, which make pro- gramming with Turing machines simpler. At the same time, we will show that these alterations are for convenience only; they add nothing to the expressive power of the model. 44. Extending the tape alphabet. One extension that we have already seen in the previous handout is the extension of the tape alphabet, such that it contains more auxiliary symbols than just the blank. For example, for every input symbol x it can contain an auxiliary symbol x′. By overwriting a symbol with the corresponding primed version, we are able to mark fields on the tape without destroying their contents. However, extended alphabets do not really add anything to the power of Turing machines. If we only have the basic alphabets Σ = {a, b} and T = {a, b, }, then we can simulate a larger alphabet by grouping tape cells together, and by coding symbols from the larger alphabet as strings from the smaller. For example, if we group three cells together, then we have 3∗3∗3 = 27 possibilities for coding symbols. Given a Turing machine transition table for the large alphabet we can easily design an equivalent table for the original alphabet. Whenever the first machine makes one move, the simulating machine makes at least three moves, scanning the three cells used for coding individual symbols and remembering their contents in the state.
    [Show full text]
  • DNA Computing Based on Splicing: Universality Results
    DNA Computing Based on Splicing Universality Results Erzseb et CSUHAJVARJU Computer and Automation Institute Hungarian Academy of Sciences Kende u Budap est Hungary Rudolf FREUND Institute for Computer Languages Technical UniversityWien Resselgasse Wien Austria Lila KARI Department of Mathematics and Computer Science UniversityofWestern Ontario London Ontario NA B Canada Gheorghe PAUN Institute of Mathematics of the Romanian Academy PO Box Bucuresti Romania Abstract The pap er extends some of the most recently obtained results on the computational universality of sp ecic variants of H systems e g with regular sets of rules and proves that we can construct universal computers based on various typ es of H systems with a nite set of splicing rules as well as a nite set of axioms i e weshow the theoretical p ossibility to design programmable universal DNA computers based on the splicing op eration For H systems working in the multiset style where the numb ers of copies of all available strings are counted we elab orate howa Turing machine computing a partial recursive function can b e simulated by an equivalent H system com puting the same function in that way from a universal Turing machine we obtain a universal H system Considering H systems as language generating devices wehav e to add vari ous simple control mechanisms checking the presenceabsence of certain sym b ols in the spliced strings to systems with a nite set of splicing rules as well as with a nite set of axioms in order to obtain the full computational p ower i
    [Show full text]
  • Universal Memcomputing Machines Fabio L
    1 Universal Memcomputing Machines Fabio L. Traversa, Massimiliano Di Ventra Abstract—We introduce the notion of universal memcomputing however, all the processors have to communicate with each machines (UMMs): a class of brain-inspired general-purpose other to solve the whole problem, still requiring a substantial computing machines based on systems with memory, whereby amount of information transfer between them and their mem- processing and storing of information occur on the same physical location. We analytically prove that the memory properties of ories [6]. Overcoming this “information latency issue” would UMMs endow them with universal computing power—they are then require a fundamentally different way in which data are Turing-complete—, intrinsic parallelism, functional polymorphism, manipulated and stored. and information overhead, namely their collective states can Historically, the first alternative to the von Neumann ar- support exponential data compression directly in memory. We chitecture was the “Harvard architecture” developed by H. also demonstrate that a UMM has the same computational power as a non-deterministic Turing machine, namely it can solve NP– Aiken, concurrently with the ENIAC project that would be complete problems in polynomial time. However, by virtue of its using the von Neumann architecture [6]. Original Harvard information overhead, a UMM needs only an amount of memory architectures had separate memories for instructions and data. cells (memprocessors) that grows polynomially with the problem However, this term is used today to mean machines with size. As an example we provide the polynomial-time solution of a single main memory, but with separate instruction and the subset-sum problem and a simple hardware implementation of the same.
    [Show full text]
  • The CPU: Real Machines - Outline
    The CPU: real machines - Outline • computer architecture The CPU: – CPU instructions – interaction with memory real machines • caching: making things seem faster than they are • how chips are made • Moore's law • equivalence of all computers – von Neumann, Turing Real processors Typical instructions • multiple accumulators (called "registers") • move data of various kinds and sizes – load a register from value stored in memory • more instructions, though basically the same kinds – store register value into memory – typical CPU has dozens to few hundreds of instructions in • arithmetic of various kinds and sizes: repertoire – add, subtract, etc., usually operating on registers • comparison, branching • instructions and data usually occupy multiple memory locations – select next instruction based on results of computation – typically 2 - 8 bytes . change the normal sequential flow of instructions . normally the CPU just steps through instructions in • modern processors have several "cores" that are all CPUs successive memory locations on the same chip • control rest of computer Computer architecture Computer architecture, continued • what instructions does the CPU provide? – CPU design involves complicated tradeoffs among functionality, • what tricks do designers play to make it go faster? speed, complexity, programmability, power consumption, … – overlap fetch, decode, and execute so several instructions are in – Intel and PowerPC are unrelated, totally incompatible various stages of completion (pipeline) . Intel: lot more instructions, many of which do complex operations – do several instructions in parallel e.g., add two memory locations and store result in a third – do instructions out of order to avoid waiting . PowerPC: fewer instructions that do simpler things, but faster e.g., load, add, store to achieve same result – multiple "cores" (CPUs) in one package to compute in parallel • how is the CPU connected to the RAM • speed comparisons are hard, not very meaningful and rest of machine? – memory is the real bottleneck; RAM is slow (60-70 nsec to fetch) .
    [Show full text]
  • The Church-Turing Thesis and Turing-Completeness Michael T
    The Church-Turing Thesis and Turing-completeness Michael T. Goodrich Univ. of California, Irvine Alonzo Church (1903-1995) Alan Turing (1912-1954) Some slides adapted from David Evans, Univ. of Virginia, and Antony Galton, Univ. of Exeter Recall: Turing Machine Definition . FSM Infinite tape: Γ* Tape head: read current square on tape, write into current square, move one square left or right FSM: Finite-state machine: transitions also include direction (left/right) final accepting and rejecting states 2 Types of Turing Machines • Decider/acceptor: w (input string) Turing Machine yes/no M • Transducer (more general, computes a function): w (input string) Turing Machine y (output string) M 3 Church • Alonzo Church, 1936, “We … define the notion An unsolvable problem … of an effectively of elementary number calculable function of theory. positive integers by • Introduced recursive identifying it with the functions and l- notion of a recursive definable functions and function of positive proved these classes integers.” equivalent. 4 Turing • Alan Turing, 1936, On “The [Turing machine] computable numbers, computable numbers with an application to include all numbers the Entscheidungs- which could naturally problem. be regarded as • Introduced the idea of a computable.” Turing machine computable number 5 The Church-Turing Thesis “Every effectively calculable function can be computed by a Turing-machine transducer.” “Since a precise mathematical definition of the term effectively calculable (effectively decidable) has been wanting, we can take this thesis ... as a definition of it...” – Kleene, 1943. That is, for every definition of “effectively computable” functions that people have come up with so far, a Turing machine can compute all such such functions.
    [Show full text]