DOCSLIB.ORG

Np-Complete-4Up.Pdf

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Np-Complete-4Up.Pdf Properties of Algorithms A given problem can be solved by many different algorithms. Which NP-Completeness ALGORITHMS will be useful in practice? A working definition: (Jack Edmonds, 1962) ■ Efficient: polynomial time for ALL inputs. ■ Inefficient: "exponential time" for SOME inputs. Robust definition has led to explosion of useful algorithms for wide spectrum of problems. ■ Notable exception: simplex algorithm. Princeton University • COS 423 • Theory of Algorithms • Spring 2001 • Kevin Wayne 2 Exponential Growth Properties of Problems Exponential growth dwarfs technological change. Which PROBLEMS will we be able to solve in practice? ■ Suppose each electron in the universe had power of today’s ■ Those with efficient algorithms. supercomputers. ■ How can I tell if I am trying to solve such a problem? ■ And each works for the life of the universe in an effort to solve TSP ! Theory of NP-completeness helps. problem using N! algorithm. Yes Probably No Unknown Some Numbers Shortest path Longest path Primality Quantity Number Euler cycle Hamiltonian cycle Factoring Home PC instructions / second 109 Min cut Max cut Graph isomorphism Supercomputer instructions / second 1012 † Estimated 2-SAT 3-SAT Seconds per year 109 PLANAR-2-COLOR PLANAR-3-COLOR Age of universe † 1013 PLANAR-4-COLOR PLANAR-3-COLOR Electrons in universe † 1079 Matching 3D-Matching Baseball elimination Soccer elimination ■ Will not succeed for 1,000 city TSP! 1000! >> 101000 >> 1079 × 1013 × 109 × 1012 Bipartite vertex cover Vertex cover 3 4 P Strong Church-Turing Thesis Decision problem X. Definition of P fundamental because of SCT. ■ X is a (possibly infinite) set of binary strings. ■ Instance: finite binary string s, of length |s|. Strong Church-Turing thesis: ⇔ ∈ ■ Algorithm A solves X if A(s) = YES s X. ■ P is the set of decision problems solvable in polynomial time on REAL computers. Polynomial time. ■ Algorithm A runs in polynomial-time if for every instance s, A Evidence supporting thesis: terminates in at most p(s) "steps", where p is some polynomial. ■ True for all physical computers. ■ Can create deterministic TM that efficiently simulates any real Definition of P. general-purpose machine (and vice versa). ■ Set of all decision problems solvable in polynomial time on a deterministic Turing machine. Possible exception? ■ Quantum computers: no conventional gates. Examples: ■ MULTIPLE: Is the integer y a multiple of x? ■ RELPRIME: Are the integers x and y relatively prime? ■ PERFECT-MATCHING: Given graph G, is there a perfect matching? 5 6 Efficient Certification Certifiers and Certificates Certification algorithm. COMPOSITE: Given integer s, is s composite? ■ Design an algorithm that checks whether proposed solution is a YES instance. Observation. s is composite ⇔ there exists an integer 1 < t < s such that s is a multiple of t. Input s: Certificate t: Algorithm C is an efficient certifier for X if: 437,669 541 ■ YES instance: s = 437,669. ■ C is a polynomial-time algorithm that takes two inputs s and t. – certificate t = 541 or 809 (a factor) ■ There exists a polynomial p( ) so that for every string s, s ∈ X ⇔ there exists a string t such that |t| ≤ p(|s|) and C(s, t) = YES. Intuition. Certifier: Is s a multiple of t? ■ Efficient certifier views things from "managerial" viewpoint. ■ It doesn't determine whether s ∈ X on its own. YES NO ■ Rather, it evaluates a proposed proof t that s ∈ X. ■ Accepts if and only if given a "short" proof of this fact. s is a YES instance no conclusion 7 8 Certifiers and Certificates Certifiers and Certificates COMPOSITE: Given integer s, is s composite? CLIQUE: Given an undirected graph, is there a subset S of k nodes such that there is an arc connecting every pair of nodes in S? Observation. s is composite ⇔ there exists an integer 1 < t < s k = 4 Input s: Certificate t: such that s is a multiple of t. Input s: Certificate t: u v 437,677 ??? {u, v, w, x} ■ YES instance: s = 437,669. z w – certificate t = 541 or 809 (a factor) y x ■ NO instance: s = 437,677. Certifier: – no witness can fool verifier Certifier: 1. For all pairs of nodes v and w in t, into saying YES Is s a multiple of t? check that (v, w) is an edge in the graph. 2. Check that number of nodes in t ≤ k. ∈ ■ Conclusion: COMPOSITE NP. YES NO YES NO CLIQUE ∈ NP. s is a YES instance no conclusion s is a YES instance no conclusion 9 10 Certifiers and Certificates NP 3-COLOR: Given planar map, can it be colored with 3 colors? Definition of NP: ■ Does NOT mean "not polynomial." Input s: Certificate t: Definition of NP: ■ Set of all decision problems for which there exists an efficient certifier. ■ Definition important because it links many fundamental problems. Certifier: Claim: P ⊆ NP. 1. Check that s and t describe same map. Proof: Consider problem X ∈ P. 2. Count number of distinct colors in t. ■ Then, there exists efficient algorithm A(s) that solves X. 3. Check all pairs of adjacent states. ■ Efficient certifier B(s, t): return A(s). YES NO 3-COLOR ∈ NP. s is a YES instance no conclusion 11 12 NP The Main Question Definition of EXP: Does P = NP? (Edmonds, 1962) ■ Set of all decision problems solvable in exponential time on a ■ Is the original DECISION problem as easy as CERTIFICATION? deterministic Turing machine. ■ Does nondeterminism help you solve problems faster? Claim: NP ⊆ EXP. Most important open problem in computer science. Proof: Consider problem X ∈ NP. ■ If yes, staggering practical significance. ■ Then, there exists efficient certifier C(s, t) for X. ■ Clay Foundation Millennium $1 million prize. ■ To solve input s, run C(s, t) on all strings t with |t| ≤ p(|s|). ■ Return YES, if C(s, t) returns YES for any of these. Useful alternate definition of NP: EXP NP EXP ■ Set of all decision problems solvable in polynomial time on a NONDETERMINISTIC Turing machine. P = NP P ■ Intuition: act of searching for t is viewed as a non-deterministic search over the space of possible proofs. Nondeterministic TM can try all possible solutions in parallel. If P ≠ NP If P = NP 13 14 The Main Question The Main Question Generator (P) Certifier (NP) Does P = NP? ■ Factor integer s. n Is s a multiple of t? ■ Is the original DECISION problem as easy as CERTIFICATION? ■ Color a map with minimum # colors. n Check if all adjacent regions have different colors. If yes, then: n ■ Design airfoil of minimum drag. Compute drag of airfoil. ■ Efficient algorithms for 3-COLOR, TSP, FACTOR, . n ■ Prove a beautiful theorem. Understand its proof. ■ Cryptography is impossible (except for one-time pads) on ■ Write a beautiful sonnet. n Appreciate it. conventional machines. ■ Devise a good joke. n Laugh at it. ■ Modern banking system will collapse. ■ Vinify fine wine. n Be a wine snob. ■ Harmonial bliss. ■ Orate a good lecture. n Know when you've heard one. ■ Ace an exam. n Verify TA's solutions. If no, then: ■ Can't hope to write efficient algorithm for TSP. ■ But maybe efficient algorithm still exists for FACTOR . Imagine the wealth of a society that produces optimal planes, bridges, rockets, theorems, art, music, wine, jokes. 15 16 The Main Question Polynomial Transformation ≤ Does P = NP? Problem X polynomial reduces (Cook-Turing) to problem Y (X P Y) if arbitrary instances of problem X can be solved using: ■ Is the original DECISION problem as easy as CERTIFICATION? ■ Polynomial number of standard computational steps, plus Probably no, since: ■ Polynomial number of calls to oracle that solves problem Y. ■ Thousands of researchers have spent four frustrating decades in search of polynomial algorithms for many fundamental NP Problem X polynomial transforms (Karp) to problem Y if given any problems without success. input x to X, we can construct an input y such that x is a YES instance of X if and only if y is a YES instance of Y. ■ Consensus opinion: P ≠ NP. ■ We require |y| to be of size polynomial in |x|. But maybe yes, since: Polynomial transformation is polynomial reduction with just one call ■ No success in proving P ≠ NP either. to oracle for Y, exactly at the end of the algorithm for X. Note: all previous reductions were of this form! 17 18 NP-Complete NP-Complete Definition of NP-complete: Definition of NP-complete: ■ A problem Y in NP with the property that for every problem X in NP, ■ A problem Y in NP with the property that for every problem X in NP, X polynomial transforms to Y. X polynomial transforms to Y. ■ "Hardest computational problems" in NP. Significance. ■ Efficient algorithm for any NP-complete problem ⇒ efficient algorithm for every other problem in NP. ■ Links together a huge and diverse number of fundamental EXP NP EXP problems: NP- – TSP, 3-COLOR, CNF-SAT, CLIQUE, . P P = NP complete ■ Can implement any computer program in 3-COLOR. Notorious complexity class. If P ≠ NP If P = NP ■ Only exponential algorithms known for these problems. ■ Called "intractable" - unlikely that they can be solved given limited computing resources. 19 20 Some NP-Complete Problems The "World's First" NP-Complete Problem Most natural problems in NP are either in P or NP-complete. CNF-SAT is NP-complete. (Cook-Levin, 1960’s) Six basic genres and paradigmatic examples of NP-complete Idea of proof: problems. ■ Given problem X in NP, by definition, there exists ■ Packing problems: SET-PACKING, INDEPENDENT-SET. nondeterministic TM M that solves X in polynomial time. ■ Covering problems: SET-COVER, VERTEX-COVER. ■ Possible execution of M on input string s forms a ■ Sequencing problems: HAMILTONIAN-CYCLE, TSP. branching tree of configurations, where each configuration ■ Partitioning problems: 3-COLOR, CLIQUE.
Load more

Recommended publications
  • Computational Complexity: a Modern Approach
    i Computational Complexity: A Modern Approach Draft of a book: Dated January 2007 Comments welcome! Sanjeev Arora and Boaz Barak Princeton University [email protected] Not to be reproduced or distributed without the authors’ permission This is an Internet draft. Some chapters are more finished than others. References and attributions are very preliminary and we apologize in advance for any omissions (but hope you will nevertheless point them out to us). Please send us bugs, typos, missing references or general comments to [email protected] — Thank You!! DRAFT ii DRAFT Chapter 9 Complexity of counting “It is an empirical fact that for many combinatorial problems the detection of the existence of a solution is easy, yet no computationally efficient method is known for counting their number.... for a variety of problems this phenomenon can be explained.” L. Valiant 1979 The class NP captures the difficulty of finding certificates. However, in many contexts, one is interested not just in a single certificate, but actually counting the number of certificates. This chapter studies #P, (pronounced “sharp p”), a complexity class that captures this notion. Counting problems arise in diverse fields, often in situations having to do with estimations of probability. Examples include statistical estimation, statistical physics, network design, and more. Counting problems are also studied in a field of mathematics called enumerative combinatorics, which tries to obtain closed-form mathematical expressions for counting problems. To give an example, in the 19th century Kirchoff showed how to count the number of spanning trees in a graph using a simple determinant computation. Results in this chapter will show that for many natural counting problems, such efficiently computable expressions are unlikely to exist.
    [Show full text]
  • Lecture 10: Space Complexity III
    Space Complexity Classes: NL and L Reductions NL-completeness The Relation between NL and coNL A Relation Among the Complexity Classes Lecture 10: Space Complexity III Arijit Bishnu 27.03.2010 Space Complexity Classes: NL and L Reductions NL-completeness The Relation between NL and coNL A Relation Among the Complexity Classes Outline 1 Space Complexity Classes: NL and L 2 Reductions 3 NL-completeness 4 The Relation between NL and coNL 5 A Relation Among the Complexity Classes Space Complexity Classes: NL and L Reductions NL-completeness The Relation between NL and coNL A Relation Among the Complexity Classes Outline 1 Space Complexity Classes: NL and L 2 Reductions 3 NL-completeness 4 The Relation between NL and coNL 5 A Relation Among the Complexity Classes Definition for Recapitulation S c NPSPACE = c>0 NSPACE(n ). The class NPSPACE is an analog of the class NP. Definition L = SPACE(log n). Definition NL = NSPACE(log n). Space Complexity Classes: NL and L Reductions NL-completeness The Relation between NL and coNL A Relation Among the Complexity Classes Space Complexity Classes Definition for Recapitulation S c PSPACE = c>0 SPACE(n ). The class PSPACE is an analog of the class P. Definition L = SPACE(log n). Definition NL = NSPACE(log n). Space Complexity Classes: NL and L Reductions NL-completeness The Relation between NL and coNL A Relation Among the Complexity Classes Space Complexity Classes Definition for Recapitulation S c PSPACE = c>0 SPACE(n ). The class PSPACE is an analog of the class P. Definition for Recapitulation S c NPSPACE = c>0 NSPACE(n ).
    [Show full text]
  • Computational Complexity: a Modern Approach
    i Computational Complexity: A Modern Approach Draft of a book: Dated January 2007 Comments welcome! Sanjeev Arora and Boaz Barak Princeton University [email protected] Not to be reproduced or distributed without the authors’ permission This is an Internet draft. Some chapters are more finished than others. References and attributions are very preliminary and we apologize in advance for any omissions (but hope you will nevertheless point them out to us). Please send us bugs, typos, missing references or general comments to [email protected] — Thank You!! DRAFT ii DRAFT Chapter 5 The Polynomial Hierarchy and Alternations “..synthesizing circuits is exceedingly difficulty. It is even more difficult to show that a circuit found in this way is the most economical one to realize a function. The difficulty springs from the large number of essentially different networks available.” Claude Shannon 1949 This chapter discusses the polynomial hierarchy, a generalization of P, NP and coNP that tends to crop up in many complexity theoretic investigations (including several chapters of this book). We will provide three equivalent definitions for the polynomial hierarchy, using quantified predicates, alternating Turing machines, and oracle TMs (a fourth definition, using uniform families of circuits, will be given in Chapter 6). We also use the hierarchy to show that solving the SAT problem requires either linear space or super-linear time. p p 5.1 The classes Σ2 and Π2 To understand the need for going beyond nondeterminism, let’s recall an NP problem, INDSET, for which we do have a short certificate of membership: INDSET = {hG, ki : graph G has an independent set of size ≥ k} .
    [Show full text]
  • 1 the Class Conp
    80240233: Computational Complexity Lecture 3 ITCS, Tsinghua Univesity, Fall 2007 16 October 2007 Instructor: Andrej Bogdanov Notes by: Jialin Zhang and Pinyan Lu In this lecture, we introduce the complexity class coNP, the Polynomial Hierarchy and the notion of oracle. 1 The class coNP The complexity class NP contains decision problems asking this kind of question: On input x, ∃y : |y| = p(|x|) s.t.V (x, y), where p is a polynomial and V is a relation which can be computed by a polynomial time Turing Machine (TM). Some examples: SAT: given boolean formula φ, does φ have a satisfiable assignment? MATCHING: given a graph G, does it have a perfect matching? Now, consider the opposite problems of SAT and MATCHING. UNSAT: given boolean formula φ, does φ have no satisfiable assignment? UNMATCHING: given a graph G, does it have no perfect matching? This kind of problems are called coNP problems. Formally we have the following definition. Definition 1. For every L ⊆ {0, 1}∗, we say that L ∈ coNP if and only if L ∈ NP, i.e. L ∈ coNP iff there exist a polynomial-time TM A and a polynomial p, such that x ∈ L ⇔ ∀y, |y| = p(|x|) A(x, y) accepts. Then the natural question is how P, NP and coNP relate. First we have the following trivial relationships. Theorem 2. P ⊆ NP, P ⊆ coNP For instance, MATCHING ∈ coNP. And we already know that SAT ∈ NP. Is SAT ∈ coNP? If it is true, then we will have NP = coNP. This is the following theorem. Theorem 3. If SAT ∈ coNP, then NP = coNP.
    [Show full text]
  • Descriptive Complexity Theories
    Descriptive Complexity Theories Joerg FLUM ABSTRACT: In this article we review some of the main results of descriptive complexity theory in order to make the reader familiar with the nature of the investigations in this area. We start by presenting the characterization of automata recognizable languages by monadic second-order logic. Afterwards we explain the characteri- zation of various logics by fixed-point logics. We assume familiarity with logic but try to keep knowledge of complexity theory to a minimum. Keywords: Computational complexity theory, complexity classes, descriptive characterizations, monadic second-order logic, fixed-point logic, Turing machine. Complexity theory or more precisely, computational complexity theory (cf. Papadimitriou 1994), tries to classify problems according to the complexity of algorithms solving them. Of course, we can think of various ways of measuring the complexity of an al- gorithm, but the most important and relevant ones are time and space. That is, we think we have a type of machine capable, in principle, to carry out any algorithm, a so-called general purpose machine (or, general purpose computer), and we measure the com- plexity of an algorithm in terms of the time or the number of steps needed to carry out this algorithm. By space, we mean the amount of memory the algorithm uses. Time bounds yield (time) complexity classes consisting of all problems solvable by an algorithm keeping to the time bound. Similarly, space complexity classes are obtained. It turns out that these definitions are quite robust in the sense that, for reasonable time or space bounds, the corresponding complexity classes do not depend on the special type of machine model chosen.
    [Show full text]
  • Descriptive Complexity: a Logicians Approach to Computation
    Descriptive Complexity: A Logician’s Approach to Computation N. Immerman basic issue in computer science is there are exponentially many possibilities, the complexity of problems. If one is but in this case no known algorithm is faster doing a calculation once on a than exponential time. medium-sized input, the simplest al- Computational complexity measures how gorithm may be the best method to much time and/or memory space is needed as Ause, even if it is not the fastest. However, when a function of the input size. Let TIME[t(n)] be the one has a subproblem that will have to be solved set of problems that can be solved by algorithms millions of times, optimization is important. A that perform at most O(t(n)) steps for inputs of fundamental issue in theoretical computer sci- size n. The complexity class polynomial time (P) ence is the computational complexity of prob- is the set of problems that are solvable in time lems. How much time and how much memory at most some polynomial in n. space is needed to solve a particular problem? ∞ Here are a few examples of such problems: P= TIME[nk] 1. Reachability: Given a directed graph and k[=1 two specified points s,t, determine if there Even though the class TIME[t(n)] is sensitive is a path from s to t. A simple, linear-time to the exact machine model used in the com- algorithm marks s and then continues to putations, the class P is quite robust. The prob- mark every vertex at the head of an edge lems Reachability and Min-triangulation are el- whose tail is marked.
    [Show full text]
  • Complexity Theory - Tutorial
    Complexity Theory - Tutorial Ivan Gavran January 31st, 2017 Part 1 1. Decide whether the following statements are true or false and justify your decision. (a) For every class C and A 2 C; if A is C-complete under Karp reduc- tions, then C ⊂ P A Solution True. Any B 2 C can be transformed into instance of A. But this - by the definition - means that B can be decided by polynomial computation (do the transformation into an instance of A) and then asking oracle A. (b) If L is NP-complete and L0 is coNP complete, then L \ L0 is NP \ coNP complete. Solution False. SAT is NP-complete. NOSAT is coNP-complete. Their intersection is empty (so that language would trivially always return false, but we know that there are non-trivial languages in NP \ coNP , primality, for example.). (c) If PH=PSPACE, then PH collapses to some level Σk Solution True. There is a complete problem for PSPACE (TQBF, for example). Since PH = PSPACE, this problem is in PH and therefore it is in Σk, for some k. But now all the problems in PH can be in polynomial time reduced to that one. Therefore, PH collapses to Σk. (d) There is an undecidable language in P=poly Solution True All unary languages are in P/poly, unary variant of halting problem is in P/poly. (e) If P=NP, then NP=coNP. Solution True Since NP = P and P ⊂ coNP it is clear that NP ⊂ coNP . Take L 2 coNP . This means that L¯ 2 NP = P .
    [Show full text]
  • 6.080 / 6.089 Great Ideas in Theoretical Computer Science Spring 2008
    MIT OpenCourseWare http://ocw.mit.edu 6.080 / 6.089 Great Ideas in Theoretical Computer Science Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 6.080/6.089 GITCS DATE Lecture 12 Lecturer: Scott Aaronson Scribe: Mergen Nachin 1 Review of last lecture • NP-completeness in practice. We discussed many of the approaches people use to cope with NP-complete problems in real life. These include brute-force search (for small instance sizes), cleverly-optimized backtrack search, fixed-parameter algorithms, approximation algorithms, and heuristic algorithms like simulated annealing (which don’t always work but often do pretty well in practice). • Factoring, as an intermediate problem between P and NP-complete. We saw how factoring, though believed to be hard for classical computers, has a special structure that makes it different from any known NP-complete problem. • coNP. 2 Space complexity Now we will categorize problems in terms of how much memory they use. Definition 1 L is in PSPACE if there exists a poly-space Turing machine M such that for all x, x is in L if and only if M(x) accepts. Just like with NP, we can define PSPACE-hard and PSPACE-complete problems. An interesting example of a PSPACE-complete problem is n-by-n chess: Given an arrangement of pieces on an n-by-n chessboard, and assuming a polynomial upper bound on the number of moves, decide whether White has a winning strategy. (Note that we need to generalize chess to an n-by-n board, since standard 8-by-8 chess is a finite game that’s completely solvable in O(1) time.) Let’s now define another complexity class called EXP, which is apparently even bigger than PSPACE.
    [Show full text]
  • Disjunctive Normal Form for Multi-Agent Modal Logics Based on Logical Separability
    The Thirty-Third AAAI Conference on Artificial Intelligence (AAAI-19) Disjunctive Normal Form for Multi-Agent Modal Logics Based on Logical Separability Liangda Fang,1 Kewen Wang,2 Zhe Wang,2 Ximing Wen3 1Department of Computer Science, Jinan University, China 2School of Information and Communication Technology, Griffith University, Australia 3Guangdong Institute of Public Administration, Guangzhou, China [email protected], fk.wang,zhe.wangg@griffith.edu.au, [email protected] Abstract and the action preconditions. If a normal form is defined such that its entailment check, bounded conjunction and for- Modal logics are primary formalisms for multi-agent systems getting are tractable, then both progression and entailment but major reasoning tasks in such logics are intractable, which check in the normal form are tractable (Bienvenu, Fargier, impedes applications of multi-agent modal logics such as au- tomatic planning. One technique of tackling the intractabil- and Marquis 2010). As a result, in the normal form, an ef- ity is to identify a fragment called a normal form of multi- fective search algorithm is obtained. In the case of proposi- agent logics such that it is expressive but tractable for reason- tional logic, a normal form can be disjunctive normal form ing tasks such as entailment checking, bounded conjunction (DNF), conjunctive normal form (CNF) or prime implicate. transformation and forgetting. For instance, DNF of proposi- Usually, a planner based on DNF is faster than those based tional logic is tractable for these reasoning tasks. In this pa- on CNF and prime implicate (To, Pontelli, and Son 2011; per, we first introduce a notion of logical separability and then To, Son, and Pontelli 2011).
    [Show full text]
  • Complexity Classes
    CHAPTER Complexity Classes In an ideal world, each computational problem would be classified at least approximately by its use of computational resources. Unfortunately, our ability to so classify some important prob- lems is limited. We must be content to show that such problems fall into general complexity classes, such as the polynomial-time problems P, problems whose running time on a determin- istic Turing machine is a polynomial in the length of its input, or NP, the polynomial-time problems on nondeterministic Turing machines. Many complexity classes contain “complete problems,” problems that are hardest in the class. If the complexity of one complete problem is known, that of all complete problems is known. Thus, it is very useful to know that a problem is complete for a particular complexity class. For example, the class of NP-complete problems, the hardest problems in NP, contains many hundreds of important combinatorial problems such as the Traveling Salesperson Prob- lem. It is known that each NP-complete problem can be solved in time exponential in the size of the problem, but it is not known whether they can be solved in polynomial time. Whether ? P and NP are equal or not is known as the P = NP question. Decades of research have been devoted to this question without success. As a consequence, knowing that a problem is NP- complete is good evidence that it is an exponential-time problem. On the other hand, if one such problem were shown to be in P, all such problems would be been shown to be in P,a result that would be most important.
    [Show full text]
  • Notes for Lecture 3 1 Space-Bounded Complexity Classes
    U.C. Berkeley — CS278: Computational Complexity Handout N3 Professor Luca Trevisan 9/6/2004 Notes for Lecture 3 Revised 10/6/04 1 Space-Bounded Complexity Classes A machine solves a problem using space s(·) if, for every input x, the machine outputs the correct answer and uses only the first s(|x|) cells of the tape. For a standard Turing machine, we can’t do better than linear space since x itself must be on the tape. So we will often consider a machine with multiple tapes: a read-only “input” tape, a read/write “work” or “memory” tape, and possibly a write-once “output” tape. Then we can say the machine uses space s if for input x, it uses only the first s(|x|) cells of the work tape. We denote by L the set of decision problems solvable in O(log n) space. We denote by PSPACE the set of decision problems solvable in polynomial space. A first observation is that a space-efficient machine is, to a certain extent, also a time-efficient one. In general we denote by SPACE(s(n)) the set of decision problems that can be solved using space at most s(n) on inputs of length n. Theorem 1 If a machine always halts, and uses s(·) space, with s(n) ≥ log n, then it runs in time 2O(s(n)). Proof: Call the “configuration” of a machine M on input x a description of the state of M, the position of the input tape, and the contents of the work tape at a given time.
    [Show full text]
  • Complexity Classes De Ned by Counting Quanti Ers*
    Complexity classes dened by counting quantiers Jacob o Toran Dept LSI Universidad Politecnica de Cataluna Pau Gargallo Barcelona Spain Abstract We study the p olynomial time counting hierarchy a hierarchy of complexity classes related to the notion of counting We investigate some of their structural prop erties settling many op en questions dealing with oracle characterizations closure under b o olean op erations and relations with other complexity classes We develop a new combinatorial technique to obtain relativized separations for some of the studied classes which imply absolute separations for some logarithmic time b ounded complexity classes Intro duction One of the main goals of complexity theory is the classication of computational problems in complexity classes according to the amount of resources these problems need Probably the b est known complexity classes are P and NP since b oth of them capture the complexity of many natural problems and also b ecause the long standing op en question P NP has motivated most of the research in the area The similarities in the denitions of the class NP and the recursiontheoretic class of the recursively enumerable sets b oth can b e characterized by an existential quantier provoked the translation of other recursion theoretic notions into the eld of complexity theory and the analogous concept to the arithmetic hierarchy the p olynomial time hierarchy St was dened The idea is a natural generalization of the class NP and provided a go o d to ol to classify more complex problems It was
    [Show full text]