Complexity of Equivalence Relations and Preorders from Computability Theory
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Computational Complexity Theory Introduction to Computational
31/03/2012 Computational complexity theory Introduction to computational complexity theory Complexity (computability) theory theory deals with two aspects: Algorithm’s complexity. Problem’s complexity. References S. Cook, « The complexity of Theorem Proving Procedures », 1971. Garey and Johnson, « Computers and Intractability, A guide to the theory of NP-completeness », 1979. J. Carlier et Ph. Chrétienne « Problèmes d’ordonnancements : algorithmes et complexité », 1988. 1 31/03/2012 Basic Notions • Some problem is a “question” characterized by parameters and needs an answer. – Parameters description; – Properties that a solutions must satisfy; – An instance is obtained when the parameters are fixed to some values. • An algorithm: a set of instructions describing how some task can be achieved or a problem can be solved. • A program : the computational implementation of an algorithm. Algorithm’s complexity (I) • There may exists several algorithms for the same problem • Raised questions: – Which one to choose ? – How they are compared ? – How measuring the efficiency ? – What are the most appropriate measures, running time, memory space ? 2 31/03/2012 Algorithm’s complexity (II) • Running time depends on: – The data of the problem, – Quality of program..., – Computer type, – Algorithm’s efficiency, – etc. • Proceed by analyzing the algorithm: – Search for some n characterizing the data. – Compute the running time in terms of n. – Evaluating the number of elementary operations, (elementary operation = simple instruction of a programming language). Algorithm’s evaluation (I) • Any algorithm is composed of two main stages: initialization and computing one • The complexity parameter is the size data n (binary coding). Definition: Let be n>0 andT(n) the running time of an algorithm expressed in terms of the size data n, T(n) is of O(f(n)) iff n0 and some constant c such that: n n0, we have T(n) c f(n). -
On the Randomness Complexity of Interactive Proofs and Statistical Zero-Knowledge Proofs*
On the Randomness Complexity of Interactive Proofs and Statistical Zero-Knowledge Proofs* Benny Applebaum† Eyal Golombek* Abstract We study the randomness complexity of interactive proofs and zero-knowledge proofs. In particular, we ask whether it is possible to reduce the randomness complexity, R, of the verifier to be comparable with the number of bits, CV , that the verifier sends during the interaction. We show that such randomness sparsification is possible in several settings. Specifically, unconditional sparsification can be obtained in the non-uniform setting (where the verifier is modelled as a circuit), and in the uniform setting where the parties have access to a (reusable) common-random-string (CRS). We further show that constant-round uniform protocols can be sparsified without a CRS under a plausible worst-case complexity-theoretic assumption that was used previously in the context of derandomization. All the above sparsification results preserve statistical-zero knowledge provided that this property holds against a cheating verifier. We further show that randomness sparsification can be applied to honest-verifier statistical zero-knowledge (HVSZK) proofs at the expense of increasing the communica- tion from the prover by R−F bits, or, in the case of honest-verifier perfect zero-knowledge (HVPZK) by slowing down the simulation by a factor of 2R−F . Here F is a new measure of accessible bit complexity of an HVZK proof system that ranges from 0 to R, where a maximal grade of R is achieved when zero- knowledge holds against a “semi-malicious” verifier that maliciously selects its random tape and then plays honestly. -
Submitted Thesis
Saarland University Faculty of Mathematics and Computer Science Bachelor’s Thesis Synthetic One-One, Many-One, and Truth-Table Reducibility in Coq Author Advisor Felix Jahn Yannick Forster Reviewers Prof. Dr. Gert Smolka Prof. Dr. Markus Bläser Submitted: September 15th, 2020 ii Eidesstattliche Erklärung Ich erkläre hiermit an Eides statt, dass ich die vorliegende Arbeit selbstständig ver- fasst und keine anderen als die angegebenen Quellen und Hilfsmittel verwendet habe. Statement in Lieu of an Oath I hereby confirm that I have written this thesis on my own and that I have not used any other media or materials than the ones referred to in this thesis. Einverständniserklärung Ich bin damit einverstanden, dass meine (bestandene) Arbeit in beiden Versionen in die Bibliothek der Informatik aufgenommen und damit veröffentlicht wird. Declaration of Consent I agree to make both versions of my thesis (with a passing grade) accessible to the public by having them added to the library of the Computer Science Department. Saarbrücken, September 15th, 2020 Abstract Reducibility is an essential concept for undecidability proofs in computability the- ory. The idea behind reductions was conceived by Turing, who introduced the later so-called Turing reduction based on oracle machines. In 1944, Post furthermore in- troduced with one-one, many-one, and truth-table reductions in comparison to Tur- ing reductions more specific reducibility notions. Post then also started to analyze the structure of the different reducibility notions and their computability degrees. Most undecidable problems were reducible from the halting problem, since this was exactly the method to show them undecidable. However, Post was able to con- struct also semidecidable but undecidable sets that do not one-one, many-one, or truth-table reduce from the halting problem. -
Module 34: Reductions and NP-Complete Proofs
Module 34: Reductions and NP-Complete Proofs This module 34 focuses on reductions and proof of NP-Complete problems. The module illustrates the ways of reducing one problem to another. Then, the module illustrates the outlines of proof of NP- Complete problems with some examples. The objectives of this module are To understand the concept of Reductions among problems To Understand proof of NP-Complete problems To overview proof of some Important NP-Complete problems. Computational Complexity There are two types of complexity theories. One is related to algorithms, known as algorithmic complexity theory and another related to complexity of problems called computational complexity theory [2,3]. Algorithmic complexity theory [3,4] aims to analyze the algorithms in terms of the size of the problem. In modules 3 and 4, we had discussed about these methods. The size is the length of the input. It can be recollected from module 3 that the size of a number n is defined to be the number of binary bits needed to write n. For example, Example: b(5) = b(1012) = 3. In other words, the complexity of the algorithm is stated in terms of the size of the algorithm. Asymptotic Analysis [1,2] refers to the study of an algorithm as the input size reaches a limit and analyzing the behaviour of the algorithms. The asymptotic analysis is also science of approximation where the behaviour of the algorithm is expressed in terms of notations such as big-oh, Big-Omega and Big- Theta. Computational complexity theory is different. Computational complexity aims to determine complexity of the problems itself. -
NP-Completeness Part I
NP-Completeness Part I Outline for Today ● Recap from Last Time ● Welcome back from break! Let's make sure we're all on the same page here. ● Polynomial-Time Reducibility ● Connecting problems together. ● NP-Completeness ● What are the hardest problems in NP? ● The Cook-Levin Theorem ● A concrete NP-complete problem. Recap from Last Time The Limits of Computability EQTM EQTM co-RE R RE LD LD ADD HALT ATM HALT ATM 0*1* The Limits of Efficient Computation P NP R P and NP Refresher ● The class P consists of all problems solvable in deterministic polynomial time. ● The class NP consists of all problems solvable in nondeterministic polynomial time. ● Equivalently, NP consists of all problems for which there is a deterministic, polynomial-time verifier for the problem. Reducibility Maximum Matching ● Given an undirected graph G, a matching in G is a set of edges such that no two edges share an endpoint. ● A maximum matching is a matching with the largest number of edges. AA maximummaximum matching.matching. Maximum Matching ● Jack Edmonds' paper “Paths, Trees, and Flowers” gives a polynomial-time algorithm for finding maximum matchings. ● (This is the same Edmonds as in “Cobham- Edmonds Thesis.) ● Using this fact, what other problems can we solve? Domino Tiling Domino Tiling Solving Domino Tiling Solving Domino Tiling Solving Domino Tiling Solving Domino Tiling Solving Domino Tiling Solving Domino Tiling Solving Domino Tiling Solving Domino Tiling The Setup ● To determine whether you can place at least k dominoes on a crossword grid, do the following: ● Convert the grid into a graph: each empty cell is a node, and any two adjacent empty cells have an edge between them. -
Decidable. (Recall It’S Not “Regular”.)
15-251: Great Theoretical Ideas in Computer Science Fall 2016 Lecture 6 September 15, 2016 Turing & the Uncomputable Comparing the cardinality of sets 퐴 ≤ 퐵 if there is an injection (one-to-one map) from 퐴 to 퐵 퐴 ≥ 퐵 if there is a surjection (onto map) from 퐴 to 퐵 퐴 = 퐵 if there is a bijection from 퐴 to 퐵 퐴 > |퐵| if there is no surjection from 퐵 to 퐴 (or equivalently, there is no injection from 퐴 to 퐵) Countable and uncountable sets countable countably infinite uncountable One slide guide to countability questions You are given a set 퐴 : is it countable or uncountable 퐴 ≤ |ℕ| or 퐴 > |ℕ| 퐴 ≤ |ℕ| : • Show directly surjection from ℕ to 퐴 • Show that 퐴 ≤ |퐵| where 퐵 ∈ {ℤ, ℤ x ℤ, ℚ, Σ∗, ℚ[x], …} 퐴 > |ℕ| : • Show directly using a diagonalization argument • Show that 퐴 ≥ | 0,1 ∞| Proving sets countable using computation For example, f(n) = ‘the nth prime’. You could write a program (Turing machine) to compute f. So this is a well-defined rule. Or: f(n) = the nth rational in our listing of ℚ. (List ℤ2 via the spiral, omit the terms p/0, omit rationals seen before…) You could write a program to compute this f. Poll Let 퐴 be the set of all languages over Σ = 1 ∗ Select the correct ones: - A is finite - A is infinite - A is countable - A is uncountable Another thing to remember from last week Encoding different objects with strings Fix some alphabet Σ . We use the ⋅ notation to denote the encoding of an object as a string in Σ∗ Examples: is the encoding a TM 푀 is the encoding a DFA 퐷 is the encoding of a pair of TMs 푀1, 푀2 is the encoding a pair 푀, 푥, where 푀 is a TM, and 푥 ∈ Σ∗ is an input to 푀 Uncountable to uncomputable The real number 1/7 is “computable”. -
Theory of Computation
A Universal Program (4) Theory of Computation Prof. Michael Mascagni Florida State University Department of Computer Science 1 / 33 Recursively Enumerable Sets (4.4) A Universal Program (4) The Parameter Theorem (4.5) Diagonalization, Reducibility, and Rice's Theorem (4.6, 4.7) Enumeration Theorem Definition. We write Wn = fx 2 N j Φ(x; n) #g: Then we have Theorem 4.6. A set B is r.e. if and only if there is an n for which B = Wn. Proof. This is simply by the definition ofΦ( x; n). 2 Note that W0; W1; W2;::: is an enumeration of all r.e. sets. 2 / 33 Recursively Enumerable Sets (4.4) A Universal Program (4) The Parameter Theorem (4.5) Diagonalization, Reducibility, and Rice's Theorem (4.6, 4.7) The Set K Let K = fn 2 N j n 2 Wng: Now n 2 K , Φ(n; n) #, HALT(n; n) This, K is the set of all numbers n such that program number n eventually halts on input n. 3 / 33 Recursively Enumerable Sets (4.4) A Universal Program (4) The Parameter Theorem (4.5) Diagonalization, Reducibility, and Rice's Theorem (4.6, 4.7) K Is r.e. but Not Recursive Theorem 4.7. K is r.e. but not recursive. Proof. By the universality theorem, Φ(n; n) is partially computable, hence K is r.e. If K¯ were also r.e., then by the enumeration theorem, K¯ = Wi for some i. We then arrive at i 2 K , i 2 Wi , i 2 K¯ which is a contradiction. -
Glossary of Complexity Classes
App endix A Glossary of Complexity Classes Summary This glossary includes selfcontained denitions of most complexity classes mentioned in the b o ok Needless to say the glossary oers a very minimal discussion of these classes and the reader is re ferred to the main text for further discussion The items are organized by topics rather than by alphab etic order Sp ecically the glossary is partitioned into two parts dealing separately with complexity classes that are dened in terms of algorithms and their resources ie time and space complexity of Turing machines and complexity classes de ned in terms of nonuniform circuits and referring to their size and depth The algorithmic classes include timecomplexity based classes such as P NP coNP BPP RP coRP PH E EXP and NEXP and the space complexity classes L NL RL and P S P AC E The non k uniform classes include the circuit classes P p oly as well as NC and k AC Denitions and basic results regarding many other complexity classes are available at the constantly evolving Complexity Zoo A Preliminaries Complexity classes are sets of computational problems where each class contains problems that can b e solved with sp ecic computational resources To dene a complexity class one sp ecies a mo del of computation a complexity measure like time or space which is always measured as a function of the input length and a b ound on the complexity of problems in the class We follow the tradition of fo cusing on decision problems but refer to these problems using the terminology of promise problems -
Computability on the Integers
Computability on the integers Laurent Bienvenu ( LIAFA, CNRS & Université de Paris 7 ) EJCIM 2011 Amiens, France 30 mars 2011 1. Basic objects of computability The formalization and study of the notion of computable function is what computability theory is about. As opposed to complexity theory, we do not care about efficiency, just about feasibility. Computable. functions What does it means for a function f : N ! N to be computable? 1. Basic objects of computability 3/79 As opposed to complexity theory, we do not care about efficiency, just about feasibility. Computable. functions What does it means for a function f : N ! N to be computable? The formalization and study of the notion of computable function is what computability theory is about. 1. Basic objects of computability 3/79 Computable. functions What does it means for a function f : N ! N to be computable? The formalization and study of the notion of computable function is what computability theory is about. As opposed to complexity theory, we do not care about efficiency, just about feasibility. 1. Basic objects of computability 3/79 But for us, it is now obvious that computable = realizable by a program / algorithm. Surprisingly, the first acceptable formalization (Turing machines) is still one of the best (if not the best) we know today. The. intuition At the time these questions were first considered (1930’s), computers did not exist (at least in the modern sense). 1. Basic objects of computability 4/79 Surprisingly, the first acceptable formalization (Turing machines) is still one of the best (if not the best) we know today. -
Computability Theory
CSC 438F/2404F Notes (S. Cook and T. Pitassi) Fall, 2019 Computability Theory This section is partly inspired by the material in \A Course in Mathematical Logic" by Bell and Machover, Chap 6, sections 1-10. Other references: \Introduction to the theory of computation" by Michael Sipser, and \Com- putability, Complexity, and Languages" by M. Davis and E. Weyuker. Our first goal is to give a formal definition for what it means for a function on N to be com- putable by an algorithm. Historically the first convincing such definition was given by Alan Turing in 1936, in his paper which introduced what we now call Turing machines. Slightly before Turing, Alonzo Church gave a definition based on his lambda calculus. About the same time G¨odel,Herbrand, and Kleene developed definitions based on recursion schemes. Fortunately all of these definitions are equivalent, and each of many other definitions pro- posed later are also equivalent to Turing's definition. This has lead to the general belief that these definitions have got it right, and this assertion is roughly what we now call \Church's Thesis". A natural definition of computable function f on N allows for the possibility that f(x) may not be defined for all x 2 N, because algorithms do not always halt. Thus we will use the symbol 1 to mean “undefined". Definition: A partial function is a function n f :(N [ f1g) ! N [ f1g; n ≥ 0 such that f(c1; :::; cn) = 1 if some ci = 1. In the context of computability theory, whenever we refer to a function on N, we mean a partial function in the above sense. -
A Study of the NEXP Vs. P/Poly Problem and Its Variants by Barıs
A Study of the NEXP vs. P/poly Problem and Its Variants by Barı¸sAydınlıoglu˘ A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy (Computer Sciences) at the UNIVERSITY OF WISCONSIN–MADISON 2017 Date of final oral examination: August 15, 2017 This dissertation is approved by the following members of the Final Oral Committee: Eric Bach, Professor, Computer Sciences Jin-Yi Cai, Professor, Computer Sciences Shuchi Chawla, Associate Professor, Computer Sciences Loris D’Antoni, Asssistant Professor, Computer Sciences Joseph S. Miller, Professor, Mathematics © Copyright by Barı¸sAydınlıoglu˘ 2017 All Rights Reserved i To Azadeh ii acknowledgments I am grateful to my advisor Eric Bach, for taking me on as his student, for being a constant source of inspiration and guidance, for his patience, time, and for our collaboration in [9]. I have a story to tell about that last one, the paper [9]. It was a late Monday night, 9:46 PM to be exact, when I e-mailed Eric this: Subject: question Eric, I am attaching two lemmas. They seem simple enough. Do they seem plausible to you? Do you see a proof/counterexample? Five minutes past midnight, Eric responded, Subject: one down, one to go. I think the first result is just linear algebra. and proceeded to give a proof from The Book. I was ecstatic, though only for fifteen minutes because then he sent a counterexample refuting the other lemma. But a third lemma, inspired by his counterexample, tied everything together. All within three hours. On a Monday midnight. I only wish that I had asked to work with him sooner. -
A New Point of NP-Hardness for Unique Games
A new point of NP-hardness for Unique Games Ryan O'Donnell∗ John Wrighty September 30, 2012 Abstract 1 3 We show that distinguishing 2 -satisfiable Unique-Games instances from ( 8 + )-satisfiable instances is NP-hard (for all > 0). A consequence is that we match or improve the best known c vs. s NP-hardness result for Unique-Games for all values of c (except for c very close to 0). For these c, ours is the first hardness result showing that it helps to take the alphabet size larger than 2. Our NP-hardness reductions are quasilinear-size and thus show nearly full exponential time is required, assuming the ETH. ∗Department of Computer Science, Carnegie Mellon University. Supported by NSF grants CCF-0747250 and CCF-0915893, and by a Sloan fellowship. Some of this research performed while the author was a von Neumann Fellow at the Institute for Advanced Study, supported by NSF grants DMS-083537 and CCF-0832797. yDepartment of Computer Science, Carnegie Mellon University. 1 Introduction Thanks largely to the groundbreaking work of H˚astad[H˚as01], we have optimal NP-hardness of approximation results for several constraint satisfaction problems (CSPs), including 3Lin(Z2) and 3Sat. But for many others | including most interesting CSPs with 2-variable constraints | we lack matching algorithmic and NP-hardness results. Take the 2Lin(Z2) problem for example, in which there are Boolean variables with constraints of the form \xi = xj" and \xi 6= xj". The largest approximation ratio known to be achievable in polynomial time is roughly :878 [GW95], whereas it 11 is only known that achieving ratios above 12 ≈ :917 is NP-hard [H˚as01, TSSW00].