Foundations of Computation, Version 2.3.2 (Summer 2011)
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
19 Theory of Computation
19 Theory of Computation "You are about to embark on the study of a fascinating and important subject: the theory of computation. It com- prises the fundamental mathematical properties of computer hardware, software, and certain applications thereof. In studying this subject we seek to determine what can and cannot be computed, how quickly, with how much memory, and on which type of computational model." - Michael Sipser, "Introduction to the Theory of Computation", one of the driest computer science textbooks ever In which we go back to the basics with arcane, boring, and irrelevant set theory and counting. This week’s material is made challenging by two orthogonal issues. There’s a whole bunch of stuff to cover, and 95% of it isn’t the least bit interesting to a physical scientist. Nevertheless, being the starry-eyed optimist that I am, I’ll forge ahead through the mountainous bulk of knowledge. In other words, expect these notes to be long! But skim when necessary; if you look at the homework first (and haven’t entirely forgotten the lectures), you should be able to pick out the important parts. I understand if this type of stuff isn’t exactly your cup of tea, but bear with me while you can. In some sense, most of what we refer to as computer science isn’t computer science at all, any more than what an accountant does is math. Sure, modern economics takes some crazy hardcore theory to make it all work, but un- derlying the whole thing is a solid layer of applications and industrial moolah. -
Software for Numerical Computation
Purdue University Purdue e-Pubs Department of Computer Science Technical Reports Department of Computer Science 1977 Software for Numerical Computation John R. Rice Purdue University, [email protected] Report Number: 77-214 Rice, John R., "Software for Numerical Computation" (1977). Department of Computer Science Technical Reports. Paper 154. https://docs.lib.purdue.edu/cstech/154 This document has been made available through Purdue e-Pubs, a service of the Purdue University Libraries. Please contact [email protected] for additional information. SOFTWARE FOR NUMERICAL COMPUTATION John R. Rice Department of Computer Sciences Purdue University West Lafayette, IN 47907 CSD TR #214 January 1977 SOFTWARE FOR NUMERICAL COMPUTATION John R. Rice Mathematical Sciences Purdue University CSD-TR 214 January 12, 1977 Article to appear in the book: Research Directions in Software Technology. SOFTWARE FOR NUMERICAL COMPUTATION John R. Rice Mathematical Sciences Purdue University INTRODUCTION AND MOTIVATING PROBLEMS. The purpose of this article is to examine the research developments in software for numerical computation. Research and development of numerical methods is not intended to be discussed for two reasons. First, a reasonable survey of the research in numerical methods would require a book. The COSERS report [Rice et al, 1977] on Numerical Computation does such a survey in about 100 printed pages and even so the discussion of many important fields (never mind topics) is limited to a few paragraphs. Second, the present book is focused on software and thus it is natural to attempt to separate software research from numerical computation research. This, of course, is not easy as the two are intimately intertwined. -
Turing's Influence on Programming — Book Extract from “The Dawn of Software Engineering: from Turing to Dijkstra”
Turing's Influence on Programming | Book extract from \The Dawn of Software Engineering: from Turing to Dijkstra" Edgar G. Daylight∗ Eindhoven University of Technology, The Netherlands [email protected] Abstract Turing's involvement with computer building was popularized in the 1970s and later. Most notable are the books by Brian Randell (1973), Andrew Hodges (1983), and Martin Davis (2000). A central question is whether John von Neumann was influenced by Turing's 1936 paper when he helped build the EDVAC machine, even though he never cited Turing's work. This question remains unsettled up till this day. As remarked by Charles Petzold, one standard history barely mentions Turing, while the other, written by a logician, makes Turing a key player. Contrast these observations then with the fact that Turing's 1936 paper was cited and heavily discussed in 1959 among computer programmers. In 1966, the first Turing award was given to a programmer, not a computer builder, as were several subsequent Turing awards. An historical investigation of Turing's influence on computing, presented here, shows that Turing's 1936 notion of universality became increasingly relevant among programmers during the 1950s. The central thesis of this paper states that Turing's in- fluence was felt more in programming after his death than in computer building during the 1940s. 1 Introduction Many people today are led to believe that Turing is the father of the computer, the father of our digital society, as also the following praise for Martin Davis's bestseller The Universal Computer: The Road from Leibniz to Turing1 suggests: At last, a book about the origin of the computer that goes to the heart of the story: the human struggle for logic and truth. -
Quantum Hypercomputation—Hype Or Computation?
Quantum Hypercomputation—Hype or Computation? Amit Hagar,∗ Alex Korolev† February 19, 2007 Abstract A recent attempt to compute a (recursion–theoretic) non–computable func- tion using the quantum adiabatic algorithm is criticized and found wanting. Quantum algorithms may outperform classical algorithms in some cases, but so far they retain the classical (recursion–theoretic) notion of computability. A speculation is then offered as to where the putative power of quantum computers may come from. ∗HPS Department, Indiana University, Bloomington, IN, 47405. [email protected] †Philosophy Department, University of BC, Vancouver, BC. [email protected] 1 1 Introduction Combining physics, mathematics and computer science, quantum computing has developed in the past two decades from a visionary idea (Feynman 1982) to one of the most exciting areas of quantum mechanics (Nielsen and Chuang 2000). The recent excitement in this lively and fashionable domain of research was triggered by Peter Shor (1994) who showed how a quantum computer could exponentially speed–up classical computation and factor numbers much more rapidly (at least in terms of the number of computational steps involved) than any known classical algorithm. Shor’s algorithm was soon followed by several other algorithms that aimed to solve combinatorial and algebraic problems, and in the last few years the- oretical study of quantum systems serving as computational devices has achieved tremendous progress. According to one authority in the field (Aharonov 1998, Abstract), we now have strong theoretical evidence that quantum computers, if built, might be used as powerful computational tool, capable of per- forming tasks which seem intractable for classical computers. -
A Combinatorial Analysis of Finite Boolean Algebras
A Combinatorial Analysis of Finite Boolean Algebras Kevin Halasz [email protected] May 1, 2013 Copyright c Kevin Halasz. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license can be found at http://www.gnu.org/copyleft/fdl.html. 1 Contents 1 Introduction 3 2 Basic Concepts 3 2.1 Chains . .3 2.2 Antichains . .6 3 Dilworth's Chain Decomposition Theorem 6 4 Boolean Algebras 8 5 Sperner's Theorem 9 5.1 The Sperner Property . .9 5.2 Sperner's Theorem . 10 6 Extensions 12 6.1 Maximally Sized Antichains . 12 6.2 The Erdos-Ko-Rado Theorem . 13 7 Conclusion 14 2 1 Introduction Boolean algebras serve an important purpose in the study of algebraic systems, providing algebraic structure to the notions of order, inequality, and inclusion. The algebraist is always trying to understand some structured set using symbol manipulation. Boolean algebras are then used to study the relationships that hold between such algebraic structures while still using basic techniques of symbol manipulation. In this paper we will take a step back from the standard algebraic practices, and analyze these fascinating algebraic structures from a different point of view. Using combinatorial tools, we will provide an in-depth analysis of the structure of finite Boolean algebras. We will start by introducing several ways of analyzing poset substructure from a com- binatorial point of view. -
Mathematics and Computation
Mathematics and Computation Mathematics and Computation Ideas Revolutionizing Technology and Science Avi Wigderson Princeton University Press Princeton and Oxford Copyright c 2019 by Avi Wigderson Requests for permission to reproduce material from this work should be sent to [email protected] Published by Princeton University Press, 41 William Street, Princeton, New Jersey 08540 In the United Kingdom: Princeton University Press, 6 Oxford Street, Woodstock, Oxfordshire OX20 1TR press.princeton.edu All Rights Reserved Library of Congress Control Number: 2018965993 ISBN: 978-0-691-18913-0 British Library Cataloging-in-Publication Data is available Editorial: Vickie Kearn, Lauren Bucca, and Susannah Shoemaker Production Editorial: Nathan Carr Jacket/Cover Credit: THIS INFORMATION NEEDS TO BE ADDED WHEN IT IS AVAILABLE. WE DO NOT HAVE THIS INFORMATION NOW. Production: Jacquie Poirier Publicity: Alyssa Sanford and Kathryn Stevens Copyeditor: Cyd Westmoreland This book has been composed in LATEX The publisher would like to acknowledge the author of this volume for providing the camera-ready copy from which this book was printed. Printed on acid-free paper 1 Printed in the United States of America 10 9 8 7 6 5 4 3 2 1 Dedicated to the memory of my father, Pinchas Wigderson (1921{1988), who loved people, loved puzzles, and inspired me. Ashgabat, Turkmenistan, 1943 Contents Acknowledgments 1 1 Introduction 3 1.1 On the interactions of math and computation..........................3 1.2 Computational complexity theory.................................6 1.3 The nature, purpose, and style of this book............................7 1.4 Who is this book for?........................................7 1.5 Organization of the book......................................8 1.6 Notation and conventions..................................... -
A Boolean Algebra and K-Map Approach
Proceedings of the International Conference on Industrial Engineering and Operations Management Washington DC, USA, September 27-29, 2018 Reliability Assessment of Bufferless Production System: A Boolean Algebra and K-Map Approach Firas Sallumi ([email protected]) and Walid Abdul-Kader ([email protected]) Industrial and Manufacturing Systems Engineering University of Windsor, Windsor (ON) Canada Abstract In this paper, system reliability is determined based on a K-map (Karnaugh map) and the Boolean algebra theory. The proposed methodology incorporates the K-map technique for system level reliability, and Boolean analysis for interactions. It considers not only the configuration of the production line, but also effectively incorporates the interactions between the machines composing the line. Through the K-map, a binary argument is used for considering the interactions between the machines and a probability expression is found to assess the reliability of a bufferless production system. The paper covers three main system design configurations: series, parallel and hybrid (mix of series and parallel). In the parallel production system section, three strategies or methods are presented to find the system reliability. These are the Split, the Overlap, and the Zeros methods. A real-world case study from the automotive industry is presented to demonstrate the applicability of the approach used in this research work. Keywords: Series, Series-Parallel, Hybrid, Bufferless, Production Line, Reliability, K-Map, Boolean algebra 1. Introduction Presently, the global economy is forcing companies to have their production systems maintain low inventory and provide short delivery times. Therefore, production systems are required to be reliable and productive to make products at rates which are changing with the demand. -
2020 SIGACT REPORT SIGACT EC – Eric Allender, Shuchi Chawla, Nicole Immorlica, Samir Khuller (Chair), Bobby Kleinberg September 14Th, 2020
2020 SIGACT REPORT SIGACT EC – Eric Allender, Shuchi Chawla, Nicole Immorlica, Samir Khuller (chair), Bobby Kleinberg September 14th, 2020 SIGACT Mission Statement: The primary mission of ACM SIGACT (Association for Computing Machinery Special Interest Group on Algorithms and Computation Theory) is to foster and promote the discovery and dissemination of high quality research in the domain of theoretical computer science. The field of theoretical computer science is the rigorous study of all computational phenomena - natural, artificial or man-made. This includes the diverse areas of algorithms, data structures, complexity theory, distributed computation, parallel computation, VLSI, machine learning, computational biology, computational geometry, information theory, cryptography, quantum computation, computational number theory and algebra, program semantics and verification, automata theory, and the study of randomness. Work in this field is often distinguished by its emphasis on mathematical technique and rigor. 1. Awards ▪ 2020 Gödel Prize: This was awarded to Robin A. Moser and Gábor Tardos for their paper “A constructive proof of the general Lovász Local Lemma”, Journal of the ACM, Vol 57 (2), 2010. The Lovász Local Lemma (LLL) is a fundamental tool of the probabilistic method. It enables one to show the existence of certain objects even though they occur with exponentially small probability. The original proof was not algorithmic, and subsequent algorithmic versions had significant losses in parameters. This paper provides a simple, powerful algorithmic paradigm that converts almost all known applications of the LLL into randomized algorithms matching the bounds of the existence proof. The paper further gives a derandomized algorithm, a parallel algorithm, and an extension to the “lopsided” LLL. -
Count Down: Six Kids Vie for Glory at the World's Toughest Math
Count Down Six Kids Vie for Glory | at the World's TOUGHEST MATH COMPETITION STEVE OLSON author of MAPPING HUMAN HISTORY, National Book Award finalist $Z4- 00 ACH SUMMER SIX MATH WHIZZES selected from nearly a half million EAmerican teens compete against the world's best problem solvers at the Interna• tional Mathematical Olympiad. Steve Olson, whose Mapping Human History was a Na• tional Book Award finalist, follows the members of a U.S. team from their intense tryouts to the Olympiad's nail-biting final rounds to discover not only what drives these extraordinary kids but what makes them both unique and typical. In the process he provides fascinating insights into the creative process, human intelligence and learning, and the nature of genius. Brilliant, but defying all the math-nerd stereotypes, these athletes of the mind want to excel at whatever piques their cu• riosity, and they are curious about almost everything — music, games, politics, sports, literature. One team member is ardent about water polo and creative writing. An• other plays four musical instruments. For fun and entertainment during breaks, the Olympians invent games of mind-boggling difficulty. Though driven by the glory of winning this ultimate math contest, in many ways these kids are not so different from other teenagers, finding pure joy in indulging their personal passions. Beyond the Olympiad, Steve Olson sheds light on such questions as why Americans feel so queasy about math, why so few girls compete in the subject, and whether or not talent is innate. Inside the cavernous gym where the competition takes place, Count Down reveals a fascinating subculture and its engaging, driven inhabitants. -
Propositional Logic (PDF)
Mathematics for Computer Science Proving Validity 6.042J/18.062J Instead of truth tables, The Logic of can try to prove valid formulas symbolically using Propositions axioms and deduction rules Albert R Meyer February 14, 2014 propositional logic.1 Albert R Meyer February 14, 2014 propositional logic.2 Proving Validity Algebra for Equivalence The text describes a for example, bunch of algebraic rules to the distributive law prove that propositional P AND (Q OR R) ≡ formulas are equivalent (P AND Q) OR (P AND R) Albert R Meyer February 14, 2014 propositional logic.3 Albert R Meyer February 14, 2014 propositional logic.4 1 Algebra for Equivalence Algebra for Equivalence for example, The set of rules for ≡ in DeMorgan’s law the text are complete: ≡ NOT(P AND Q) ≡ if two formulas are , these rules can prove it. NOT(P) OR NOT(Q) Albert R Meyer February 14, 2014 propositional logic.5 Albert R Meyer February 14, 2014 propositional logic.6 A Proof System A Proof System Another approach is to Lukasiewicz’ proof system is a start with some valid particularly elegant example of this idea. formulas (axioms) and deduce more valid formulas using proof rules Albert R Meyer February 14, 2014 propositional logic.7 Albert R Meyer February 14, 2014 propositional logic.8 2 A Proof System Lukasiewicz’ Proof System Lukasiewicz’ proof system is a Axioms: particularly elegant example of 1) (¬P → P) → P this idea. It covers formulas 2) P → (¬P → Q) whose only logical operators are 3) (P → Q) → ((Q → R) → (P → R)) IMPLIES (→) and NOT. The only rule: modus ponens Albert R Meyer February 14, 2014 propositional logic.9 Albert R Meyer February 14, 2014 propositional logic.10 Lukasiewicz’ Proof System Lukasiewicz’ Proof System Prove formulas by starting with Prove formulas by starting with axioms and repeatedly applying axioms and repeatedly applying the inference rule. -
What Is Computerscience?
What is Computer Science? Computer Science Defined? • “computer science” —which, actually is like referring to surgery as “knife science” - Prof. Dr. Edsger W. Dijkstra • “A branch of science that deals with the theory of computation or the design of computers” - Webster Dictionary • Computer science "is the study of computation and information” - University of York • “Computer science is the study of process: how we or computers do things, how we specify what we do, and how we specify what the stuff is that we’re processing.” - Your Textbook Computer Science in Reality The study of using computers to solve problems. Fields of Computer Science • Software Engineering • Multimedia (Game Design, Animation, DataVisualization) • Web Development • Networking • Big Data / Machine Learning /AI • Bioinformatics • Robotics • Internet of Things • … Computers Rule the World! • Shopping • Communication / SocialMedia • Work • Entertainment • Vehicles • Appliances • Banking • … Overview of the Couse • Learn a programming language • Develop algorithms and write programs to implement them • Understand how computers store data and multimedia • Have fun! Programming Languages • How we communicate with computers in a way they understand • Lots of different languages, some with special purposes • How we write programs to implement algorithms What’s an Algorithm? Input Algorithm Output • An algorithm is a finite series of instructions applied to an input to produceoutput. • Computer programs are made up of algorithms. The “Recipe” Analogy Input Output Algorithm -
Sets, Propositional Logic, Predicates, and Quantifiers
COMP 182 Algorithmic Thinking Sets, Propositional Logic, Luay Nakhleh Computer Science Predicates, and Quantifiers Rice University !1 Reading Material ❖ Chapter 1, Sections 1, 4, 5 ❖ Chapter 2, Sections 1, 2 !2 ❖ Mathematics is about statements that are either true or false. ❖ Such statements are called propositions. ❖ We use logic to describe them, and proof techniques to prove whether they are true or false. !3 Propositions ❖ 5>7 ❖ The square root of 2 is irrational. ❖ A graph is bipartite if and only if it doesn’t have a cycle of odd length. ❖ For n>1, the sum of the numbers 1,2,3,…,n is n2. !4 Propositions? ❖ E=mc2 ❖ The sun rises from the East every day. ❖ All species on Earth evolved from a common ancestor. ❖ God does not exist. ❖ Everyone eventually dies. !5 ❖ And some of you might already be wondering: “If I wanted to study mathematics, I would have majored in Math. I came here to study computer science.” !6 ❖ Computer Science is mathematics, but we almost exclusively focus on aspects of mathematics that relate to computation (that can be implemented in software and/or hardware). !7 ❖Logic is the language of computer science and, mathematics is the computer scientist’s most essential toolbox. !8 Examples of “CS-relevant” Math ❖ Algorithm A correctly solves problem P. ❖ Algorithm A has a worst-case running time of O(n3). ❖ Problem P has no solution. ❖ Using comparison between two elements as the basic operation, we cannot sort a list of n elements in less than O(n log n) time. ❖ Problem A is NP-Complete.