Mathematical Foundations of Computing -1 / 74

Total Page:16

File Type:pdf, Size:1020Kb

Mathematical Foundations of Computing -1 / 74 Mathematical Foundations of Computing -1 / 74- Mathematical Foundations of Computing Preliminary Course Notes Keith Schwarz Spring 2012 This is a work-in-progress draft of what I hope will become a full set of course notes for CS103. Right now, the notes only cover up through the end of the first week. I hope that you find these notes useful! If you have any comments, criticisms, or suggestions, please email me at [email protected]. I'd love to make these notes as good as possible for future quarters. Mathematical Foundations of Computing -2 / 74- Table of Contents Mathematical Foundations of Computing.......................................................................................1 Chapter One: Set Theory and Cantor's Theorem.............................................................................4 What is a Set?..............................................................................................................................4 Operations on Sets.......................................................................................................................6 Special Sets...............................................................................................................................10 Set-Builder Notation.................................................................................................................12 Filtering Sets.........................................................................................................................12 Transforming Sets.................................................................................................................14 Relations on Sets.......................................................................................................................15 Set Equality..........................................................................................................................15 Subsets and Supersets...........................................................................................................16 The Empty Set and Vacuous Truths......................................................................................17 The Power Set...........................................................................................................................19 Cardinality.................................................................................................................................21 What is Cardinality?.............................................................................................................21 The Difficulty With Infinite Cardinalities............................................................................22 A Formal Definition of Cardinality......................................................................................24 Cantor's Theorem......................................................................................................................28 How Large is the Power Set?...............................................................................................28 Cantor's Diagonal Argument................................................................................................30 Formalizing the Diagonal Argument....................................................................................33 Proving Cantor's Theorem....................................................................................................35 Why Cantor's Theorem Matters................................................................................................36 The Limits of Computation.......................................................................................................37 What Does This Mean?........................................................................................................38 Chapter Summary......................................................................................................................39 Chapter Two: Introduction to Formal Proofs.................................................................................40 What is a Proof?........................................................................................................................40 What Can We Assume?........................................................................................................41 Direct Proofs.............................................................................................................................41 Proof by Cases......................................................................................................................44 Proofs about Sets..................................................................................................................46 Lemmas................................................................................................................................49 Proofs with Vacuous Truths..................................................................................................53 Indirect Proofs...........................................................................................................................55 Logical Implication..............................................................................................................55 Proof by Contradiction.........................................................................................................57 Rational and Irrational Numbers..........................................................................................61 Proof by Contrapositive........................................................................................................64 Chapter Three: Graphs, Functions, and Relations.........................................................................67 Chapter Four: The Pigeonhole Principle........................................................................................69 Chapter Five: Mathematical Induction..........................................................................................70 Chapter Six: Proofs about Programs..............................................................................................71 Mathematical Foundations of Computing -3 / 74- Chapter Seven: Formal Logic........................................................................................................72 Chapter One: Set Theory and Cantor's Theorem -4 / 74- Chapter One: Set Theory and Cantor's Theorem Our journey into the realm of mathematics begins with an exploration of a surprisingly nuanced concept: the set. Informally, a set is just a collection of things, whether it's a set of numbers, a set of clothes, a set of nodes in a network, or a set of other sets. Amazingly, given this very simple starting point, it is possible to prove a result known as Cantor's Theorem that provides a striking and profound limit on what problems a computer program can solve. In this introductory chapter, we'll build up some basic mathematical machinery around sets, then will see how the simple notion of asking how big a set can lead to incredible and shocking results. What is a Set? Let's begin with a simple definition: A set is an unordered collection of distinct elements. What exactly does this mean? Intuitively, you can think of a set as a group of things. Those things must be distinct, which means that you can't have multiple copies of the same object in a set. Additionally, those things are unordered, so there's no notion of a “first” thing in the group, a “second” thing in a group, etc. We need two additional pieces of terminology to talk about sets: An element is something contained within a set. To denote a set, we write the elements of the set within curly braces. For example, the set {1, 2, 3} is a set with three elements: 1, 2, and 3. The set { cat, dog } is a set containing the two elements “cat” and “dog.” Because sets are unordered collections, the order in which we list the elements of a set doesn't matter. This means that the sets {1, 2, 3}, {2, 1, 3}, and {3, 2, 1} are all descriptions of exactly the same set. Also, because sets are unordered collections of distinct elements, no element can appear more than once in the same set. In particular, this means that if we write out a set like {1, 1, 1, 1, 1}, it's completely equivalent to writing out the set {1}, since sets can't contain duplicates. Similarly, {1, 2, 2, 2, 3} and {3, 2, 1} are the same set, since ordering doesn't matter and duplicates are ignored. When working with sets, we are often interested in determining whether or not some object is an element of a set. We use the notation x ∈ S to denote that x is an element of the set S. For example, we would write that 1 ∈ {1, 2, 3}, or that cat ∈ { cat, dog }. If spoken aloud, you'd read x ∈ S as “x is an element of S.” Similarly, we use the notation x ∉ S to denote that x is not an element of S. So, we would have 1 ∉ {2, 3, 4}, dog ∉ {1, 2, 3}, and ibex ∉ {cat, dog}. You can read x ∉ S as “x is not an element of S.” Chapter One: Set Theory and Cantor's Theorem -5 / 74- Sets appear almost everywhere in mathematics because they capture the very simple notion of a group of things. If you'll notice, there aren't any requirements about what can be in a set. You can have sets of integers, set of real numbers, sets of lines, sets of programs, and even sets of other sets. Through the remainder of your mathematical career, you'll see sets used as building blocks for larger and more complicated objects. As we just mentioned, it's possible
Recommended publications
  • Is Uncountable the Open Interval (0, 1)
    Section 2.4:R is uncountable (0, 1) is uncountable This assertion and its proof date back to the 1890’s and to Georg Cantor. The proof is often referred to as “Cantor’s diagonal argument” and applies in more general contexts than we will see in these notes. Our goal in this section is to show that the setR of real numbers is uncountable or non-denumerable; this means that its elements cannot be listed, or cannot be put in bijective correspondence with the natural numbers. We saw at the end of Section 2.3 that R has the same cardinality as the interval ( π , π ), or the interval ( 1, 1), or the interval (0, 1). We will − 2 2 − show that the open interval (0, 1) is uncountable. Georg Cantor : born in St Petersburg (1845), died in Halle (1918) Theorem 42 The open interval (0, 1) is not a countable set. Dr Rachel Quinlan MA180/MA186/MA190 Calculus R is uncountable 143 / 222 Dr Rachel Quinlan MA180/MA186/MA190 Calculus R is uncountable 144 / 222 The open interval (0, 1) is not a countable set A hypothetical bijective correspondence Our goal is to show that the interval (0, 1) cannot be put in bijective correspondence with the setN of natural numbers. Our strategy is to We recall precisely what this set is. show that no attempt at constructing a bijective correspondence between It consists of all real numbers that are greater than zero and less these two sets can ever be complete; it can never involve all the real than 1, or equivalently of all the points on the number line that are numbers in the interval (0, 1) no matter how it is devised.
    [Show full text]
  • A Class of Symmetric Difference-Closed Sets Related to Commuting Involutions John Campbell
    A class of symmetric difference-closed sets related to commuting involutions John Campbell To cite this version: John Campbell. A class of symmetric difference-closed sets related to commuting involutions. Discrete Mathematics and Theoretical Computer Science, DMTCS, 2017, Vol 19 no. 1. hal-01345066v4 HAL Id: hal-01345066 https://hal.archives-ouvertes.fr/hal-01345066v4 Submitted on 18 Mar 2017 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Discrete Mathematics and Theoretical Computer Science DMTCS vol. 19:1, 2017, #8 A class of symmetric difference-closed sets related to commuting involutions John M. Campbell York University, Canada received 19th July 2016, revised 15th Dec. 2016, 1st Feb. 2017, accepted 10th Feb. 2017. Recent research on the combinatorics of finite sets has explored the structure of symmetric difference-closed sets, and recent research in combinatorial group theory has concerned the enumeration of commuting involutions in Sn and An. In this article, we consider an interesting combination of these two subjects, by introducing classes of symmetric difference-closed sets of elements which correspond in a natural way to commuting involutions in Sn and An. We consider the natural combinatorial problem of enumerating symmetric difference-closed sets consisting of subsets of sets consisting of pairwise disjoint 2-subsets of [n], and the problem of enumerating symmetric difference-closed sets consisting of elements which correspond to commuting involutions in An.
    [Show full text]
  • Two Sources of Explosion
    Two sources of explosion Eric Kao Computer Science Department Stanford University Stanford, CA 94305 United States of America Abstract. In pursuit of enhancing the deductive power of Direct Logic while avoiding explosiveness, Hewitt has proposed including the law of excluded middle and proof by self-refutation. In this paper, I show that the inclusion of either one of these inference patterns causes paracon- sistent logics such as Hewitt's Direct Logic and Besnard and Hunter's quasi-classical logic to become explosive. 1 Introduction A central goal of a paraconsistent logic is to avoid explosiveness { the inference of any arbitrary sentence β from an inconsistent premise set fp; :pg (ex falso quodlibet). Hewitt [2] Direct Logic and Besnard and Hunter's quasi-classical logic (QC) [1, 5, 4] both seek to preserve the deductive power of classical logic \as much as pos- sible" while still avoiding explosiveness. Their work fits into the ongoing research program of identifying some \reasonable" and \maximal" subsets of classically valid rules and axioms that do not lead to explosiveness. To this end, it is natural to consider which classically sound deductive rules and axioms one can introduce into a paraconsistent logic without causing explo- siveness. Hewitt [3] proposed including the law of excluded middle and the proof by self-refutation rule (a very special case of proof by contradiction) but did not show whether the resulting logic would be explosive. In this paper, I show that for quasi-classical logic and its variant, the addition of either the law of excluded middle or the proof by self-refutation rule in fact leads to explosiveness.
    [Show full text]
  • 1 Measurable Sets
    Math 4351, Fall 2018 Chapter 11 in Goldberg 1 Measurable Sets Our goal is to define what is meant by a measurable set E ⊆ [a; b] ⊂ R and a measurable function f :[a; b] ! R. We defined the length of an open set and a closed set, denoted as jGj and jF j, e.g., j[a; b]j = b − a: We will use another notation for complement and the notation in the Goldberg text. Let Ec = [a; b] n E = [a; b] − E. Also, E1 n E2 = E1 − E2: Definitions: Let E ⊆ [a; b]. Outer measure of a set E: m(E) = inffjGj : for all G open and E ⊆ Gg. Inner measure of a set E: m(E) = supfjF j : for all F closed and F ⊆ Eg: 0 ≤ m(E) ≤ m(E). A set E is a measurable set if m(E) = m(E) and the measure of E is denoted as m(E). The symmetric difference of two sets E1 and E2 is defined as E1∆E2 = (E1 − E2) [ (E2 − E1): A set is called an Fσ set (F-sigma set) if it is a union of a countable number of closed sets. A set is called a Gδ set (G-delta set) if it is a countable intersection of open sets. Properties of Measurable Sets on [a; b]: 1. If E1 and E2 are subsets of [a; b] and E1 ⊆ E2, then m(E1) ≤ m(E2) and m(E1) ≤ m(E2). In addition, if E1 and E2 are measurable subsets of [a; b] and E1 ⊆ E2, then m(E1) ≤ m(E2).
    [Show full text]
  • Cardinality of Sets
    Cardinality of Sets MAT231 Transition to Higher Mathematics Fall 2014 MAT231 (Transition to Higher Math) Cardinality of Sets Fall 2014 1 / 15 Outline 1 Sets with Equal Cardinality 2 Countable and Uncountable Sets MAT231 (Transition to Higher Math) Cardinality of Sets Fall 2014 2 / 15 Sets with Equal Cardinality Definition Two sets A and B have the same cardinality, written jAj = jBj, if there exists a bijective function f : A ! B. If no such bijective function exists, then the sets have unequal cardinalities, that is, jAj 6= jBj. Another way to say this is that jAj = jBj if there is a one-to-one correspondence between the elements of A and the elements of B. For example, to show that the set A = f1; 2; 3; 4g and the set B = {♠; ~; }; |g have the same cardinality it is sufficient to construct a bijective function between them. 1 2 3 4 ♠ ~ } | MAT231 (Transition to Higher Math) Cardinality of Sets Fall 2014 3 / 15 Sets with Equal Cardinality Consider the following: This definition does not involve the number of elements in the sets. It works equally well for finite and infinite sets. Any bijection between the sets is sufficient. MAT231 (Transition to Higher Math) Cardinality of Sets Fall 2014 4 / 15 The set Z contains all the numbers in N as well as numbers not in N. So maybe Z is larger than N... On the other hand, both sets are infinite, so maybe Z is the same size as N... This is just the sort of ambiguity we want to avoid, so we appeal to the definition of \same cardinality." The answer to our question boils down to \Can we find a bijection between N and Z?" Does jNj = jZj? True or false: Z is larger than N.
    [Show full text]
  • Georg Cantor English Version
    GEORG CANTOR (March 3, 1845 – January 6, 1918) by HEINZ KLAUS STRICK, Germany There is hardly another mathematician whose reputation among his contemporary colleagues reflected such a wide disparity of opinion: for some, GEORG FERDINAND LUDWIG PHILIPP CANTOR was a corruptor of youth (KRONECKER), while for others, he was an exceptionally gifted mathematical researcher (DAVID HILBERT 1925: Let no one be allowed to drive us from the paradise that CANTOR created for us.) GEORG CANTOR’s father was a successful merchant and stockbroker in St. Petersburg, where he lived with his family, which included six children, in the large German colony until he was forced by ill health to move to the milder climate of Germany. In Russia, GEORG was instructed by private tutors. He then attended secondary schools in Wiesbaden and Darmstadt. After he had completed his schooling with excellent grades, particularly in mathematics, his father acceded to his son’s request to pursue mathematical studies in Zurich. GEORG CANTOR could equally well have chosen a career as a violinist, in which case he would have continued the tradition of his two grandmothers, both of whom were active as respected professional musicians in St. Petersburg. When in 1863 his father died, CANTOR transferred to Berlin, where he attended lectures by KARL WEIERSTRASS, ERNST EDUARD KUMMER, and LEOPOLD KRONECKER. On completing his doctorate in 1867 with a dissertation on a topic in number theory, CANTOR did not obtain a permanent academic position. He taught for a while at a girls’ school and at an institution for training teachers, all the while working on his habilitation thesis, which led to a teaching position at the university in Halle.
    [Show full text]
  • Logic, Sets, and Proofs David A
    Logic, Sets, and Proofs David A. Cox and Catherine C. McGeoch Amherst College 1 Logic Logical Statements. A logical statement is a mathematical statement that is either true or false. Here we denote logical statements with capital letters A; B. Logical statements be combined to form new logical statements as follows: Name Notation Conjunction A and B Disjunction A or B Negation not A :A Implication A implies B if A, then B A ) B Equivalence A if and only if B A , B Here are some examples of conjunction, disjunction and negation: x > 1 and x < 3: This is true when x is in the open interval (1; 3). x > 1 or x < 3: This is true for all real numbers x. :(x > 1): This is the same as x ≤ 1. Here are two logical statements that are true: x > 4 ) x > 2. x2 = 1 , (x = 1 or x = −1). Note that \x = 1 or x = −1" is usually written x = ±1. Converses, Contrapositives, and Tautologies. We begin with converses and contrapositives: • The converse of \A implies B" is \B implies A". • The contrapositive of \A implies B" is \:B implies :A" Thus the statement \x > 4 ) x > 2" has: • Converse: x > 2 ) x > 4. • Contrapositive: x ≤ 2 ) x ≤ 4. 1 Some logical statements are guaranteed to always be true. These are tautologies. Here are two tautologies that involve converses and contrapositives: • (A if and only if B) , ((A implies B) and (B implies A)). In other words, A and B are equivalent exactly when both A ) B and its converse are true.
    [Show full text]
  • On the Analysis of Indirect Proofs: Contradiction and Contraposition
    On the analysis of indirect proofs: Contradiction and contraposition Nicolas Jourdan & Oleksiy Yevdokimov University of Southern Queensland [email protected] [email protected] roof by contradiction is a very powerful mathematical technique. Indeed, Premarkable results such as the fundamental theorem of arithmetic can be proved by contradiction (e.g., Grossman, 2009, p. 248). This method of proof is also one of the oldest types of proof early Greek mathematicians developed. More than two millennia ago two of the most famous results in mathematics: The irrationality of 2 (Heath, 1921, p. 155), and the infinitude of prime numbers (Euclid, Elements IX, 20) were obtained through reasoning by contradiction. This method of proof was so well established in Greek mathematics that many of Euclid’s theorems and most of Archimedes’ important results were proved by contradiction. In the 17th century, proofs by contradiction became the focus of attention of philosophers and mathematicians, and the status and dignity of this method of proof came into question (Mancosu, 1991, p. 15). The debate centred around the traditional Aristotelian position that only causality could be the base of true scientific knowledge. In particular, according to this traditional position, a mathematical proof must proceed from the cause to the effect. Starting from false assumptions a proof by contradiction could not reveal the cause. As Mancosu (1996, p. 26) writes: “There was thus a consensus on the part of these scholars that proofs by contradiction were inferior to direct Australian Senior Mathematics Journal vol. 30 no. 1 proofs on account of their lack of causality.” More recently, in the 20th century, the intuitionists went further and came to regard proof by contradiction as an invalid method of reasoning.
    [Show full text]
  • CSC 443 – Database Management Systems Data and Its Structure
    CSC 443 – Database Management Systems Lecture 3 –The Relational Data Model Data and Its Structure • Data is actually stored as bits, but it is difficult to work with data at this level. • It is convenient to view data at different levels of abstraction . • Schema : Description of data at some abstraction level. Each level has its own schema. • We will be concerned with three schemas: physical , conceptual , and external . 1 Physical Data Level • Physical schema describes details of how data is stored: tracks, cylinders, indices etc. • Early applications worked at this level – explicitly dealt with details. • Problem: Routines were hard-coded to deal with physical representation. – Changes to data structure difficult to make. – Application code becomes complex since it must deal with details. – Rapid implementation of new features impossible. Conceptual Data Level • Hides details. – In the relational model, the conceptual schema presents data as a set of tables. • DBMS maps from conceptual to physical schema automatically. • Physical schema can be changed without changing application: – DBMS would change mapping from conceptual to physical transparently – This property is referred to as physical data independence 2 Conceptual Data Level (con’t) External Data Level • In the relational model, the external schema also presents data as a set of relations. • An external schema specifies a view of the data in terms of the conceptual level. It is tailored to the needs of a particular category of users. – Portions of stored data should not be seen by some users. • Students should not see their files in full. • Faculty should not see billing data. – Information that can be derived from stored data might be viewed as if it were stored.
    [Show full text]
  • Some Set Theory We Should Know Cardinality and Cardinal Numbers
    SOME SET THEORY WE SHOULD KNOW CARDINALITY AND CARDINAL NUMBERS De¯nition. Two sets A and B are said to have the same cardinality, and we write jAj = jBj, if there exists a one-to-one onto function f : A ! B. We also say jAj · jBj if there exists a one-to-one (but not necessarily onto) function f : A ! B. Then the SchrÄoder-BernsteinTheorem says: jAj · jBj and jBj · jAj implies jAj = jBj: SchrÄoder-BernsteinTheorem. If there are one-to-one maps f : A ! B and g : B ! A, then jAj = jBj. A set is called countable if it is either ¯nite or has the same cardinality as the set N of positive integers. Theorem ST1. (a) A countable union of countable sets is countable; (b) If A1;A2; :::; An are countable, so is ¦i·nAi; (c) If A is countable, so is the set of all ¯nite subsets of A, as well as the set of all ¯nite sequences of elements of A; (d) The set Q of all rational numbers is countable. Theorem ST2. The following sets have the same cardinality as the set R of real numbers: (a) The set P(N) of all subsets of the natural numbers N; (b) The set of all functions f : N ! f0; 1g; (c) The set of all in¯nite sequences of 0's and 1's; (d) The set of all in¯nite sequences of real numbers. The cardinality of N (and any countable in¯nite set) is denoted by @0. @1 denotes the next in¯nite cardinal, @2 the next, etc.
    [Show full text]
  • Regularity Properties and Determinacy
    Regularity Properties and Determinacy MSc Thesis (Afstudeerscriptie) written by Yurii Khomskii (born September 5, 1980 in Moscow, Russia) under the supervision of Dr. Benedikt L¨owe, and submitted to the Board of Examiners in partial fulfillment of the requirements for the degree of MSc in Logic at the Universiteit van Amsterdam. Date of the public defense: Members of the Thesis Committee: August 14, 2007 Dr. Benedikt L¨owe Prof. Dr. Jouko V¨a¨an¨anen Prof. Dr. Joel David Hamkins Prof. Dr. Peter van Emde Boas Brian Semmes i Contents 0. Introduction............................ 1 1. Preliminaries ........................... 4 1.1 Notation. ........................... 4 1.2 The Real Numbers. ...................... 5 1.3 Trees. ............................. 6 1.4 The Forcing Notions. ..................... 7 2. ClasswiseConsequencesofDeterminacy . 11 2.1 Regularity Properties. .................... 11 2.2 Infinite Games. ........................ 14 2.3 Classwise Implications. .................... 16 3. The Marczewski-Burstin Algebra and the Baire Property . 20 3.1 MB and BP. ......................... 20 3.2 Fusion Sequences. ...................... 23 3.3 Counter-examples. ...................... 26 4. DeterminacyandtheBaireProperty.. 29 4.1 Generalized MB-algebras. .................. 29 4.2 Determinacy and BP(P). ................... 31 4.3 Determinacy and wBP(P). .................. 34 5. Determinacy andAsymmetric Properties. 39 5.1 The Asymmetric Properties. ................. 39 5.2 The General Definition of Asym(P). ............. 43 5.3 Determinacy and Asym(P). ................. 46 ii iii 0. Introduction One of the most intriguing developments of modern set theory is the investi- gation of two-player infinite games of perfect information. Of course, it is clear that applied game theory, as any other branch of mathematics, can be modeled in set theory. But we are talking about the converse: the use of infinite games as a tool to study fundamental set theoretic questions.
    [Show full text]
  • Logic and Proof Release 3.18.4
    Logic and Proof Release 3.18.4 Jeremy Avigad, Robert Y. Lewis, and Floris van Doorn Sep 10, 2021 CONTENTS 1 Introduction 1 1.1 Mathematical Proof ............................................ 1 1.2 Symbolic Logic .............................................. 2 1.3 Interactive Theorem Proving ....................................... 4 1.4 The Semantic Point of View ....................................... 5 1.5 Goals Summarized ............................................ 6 1.6 About this Textbook ........................................... 6 2 Propositional Logic 7 2.1 A Puzzle ................................................. 7 2.2 A Solution ................................................ 7 2.3 Rules of Inference ............................................ 8 2.4 The Language of Propositional Logic ................................... 15 2.5 Exercises ................................................. 16 3 Natural Deduction for Propositional Logic 17 3.1 Derivations in Natural Deduction ..................................... 17 3.2 Examples ................................................. 19 3.3 Forward and Backward Reasoning .................................... 20 3.4 Reasoning by Cases ............................................ 22 3.5 Some Logical Identities .......................................... 23 3.6 Exercises ................................................. 24 4 Propositional Logic in Lean 25 4.1 Expressions for Propositions and Proofs ................................. 25 4.2 More commands ............................................
    [Show full text]