The Quantitative Structure of Exponential Time Jack H

Total Page:16

File Type:pdf, Size:1020Kb

The Quantitative Structure of Exponential Time Jack H Computer Science Technical Reports Computer Science 1996 The Quantitative Structure of Exponential Time Jack H. Lutz Follow this and additional works at: http://lib.dr.iastate.edu/cs_techreports Part of the Theory and Algorithms Commons Recommended Citation Lutz, Jack H., "The Quantitative Structure of Exponential Time" (1996). Computer Science Technical Reports. 115. http://lib.dr.iastate.edu/cs_techreports/115 This Article is brought to you for free and open access by the Computer Science at Iowa State University Digital Repository. It has been accepted for inclusion in Computer Science Technical Reports by an authorized administrator of Iowa State University Digital Repository. For more information, please contact [email protected]. The Quantitative Structure of Exponential Time Abstract Department of Computer Science Iowa State University Ames, Iowa 50010 Recent results on the internal, measure-theoretic structure of the exponential time complexity classes linear polynomial E = DTIME(2 ) and E = DTIME(2 ) 2 are surveyed. The measure structure of these classes is seen to interact in informative ways with bi-immunity, complexity cores, polynomial-time many-one reducibility, circuit-size complexity, Kolmogorov complexity, and the density of hard languages. Possible implications for the structure of NP are also discussed. Disciplines Theory and Algorithms This article is available at Iowa State University Digital Repository: http://lib.dr.iastate.edu/cs_techreports/115 This is page 1 Printer: Opaque this The Quantitative Structure of Exp onential Time 1 Jack H. Lutz ABSTRACT Recent results on the internal, measure-theoretic structure of the exp onential time complexity classes E and EXP are surveyed. The mea- sure structure of these classes is seen to interact in informativeways with bi-immunity, complexity cores, p olynomial-time reductions, completeness, circuit-size complexity, Kolmogorov complexity, natural pro ofs, pseudoran- dom generators, the density of hard languages, randomized complexity, and lowness. Possible implications for the structure of NP are also discussed. 1 Intro duction In the past veyears, new developments in resource-b ounded measure have op ened the way for a systematic investigation of the internal, measure- theoretic structure of the exp onential time complexity classes E and EXP. The investigation is very far from complete, but it has already yielded a number of interesting insights and results. This pap er surveys the motiva- tions, ideas, and results of the earliest phase of the investigation, i.e., the part completed by mid-1995. It should b e emphasized that the material surveyed here is the work of several investigators. The ongoing e orts of these investigators, together with the e orts of more recent participants, virtually guarantee that this survey will be incomplete by the time it app ears. At the time of this writing, there are already several pap ers in review and manuscripts in cir- culation that app ear to extend the body of knowledge presented here. Nevertheless, it is to b e hop ed that the \organized snapshot" provided by this survey will provide context and motivation for future research. There are three reasons for our interest in the complexity classes E and EXP. i E and EXP have rich, apparently well-b ehaved, internal structures. These structures have manyinteracting facets, including a varietyof 1 Departmentof Computer Science, Iowa State University, Ames, IA 50011. E-mail: [email protected]. This research was supp orted in part by National Science Foundation Grant CCR-9157382, with matching funds from Ro ckwell International, Microware Systems Corp oration, and Amo co Foundation. 1. The Quantitative Structure of Exp onential Time 2 reducibilities [LLS75], complete languages under these reducibilities [SC79, Wat87b], measure structure [Lut92], and category structure [Lut90,Fen91,Fen95]. ii EXP is the smallest deterministic time complexity class known to contain NP. It also contains PSPACE, and hence the p olynomial-time hierarchy and many other classes of interest in complexity theory.E is a prop er subset of EXP, but it contains P and \the essential part of NP" [Wat87b], i.e., many NP-complete problems. iii E and EXP have b een proven to contain intractable problems [HS65]. From the standp oint of complexity theory, this existence of intractabil- ityisavaluable resource. This is b ecause, in practice, a pro of that a sp eci c language A is intractable pro ceeds by inferring the in- tractabilityof A from the intractability of some language B chosen or constructed for this purp ose. Taken together, i, ii, and iii suggest E and EXP as appropriate spaces in whichtoinvestigate emb ed problems involving NP, PH, PSPACE, and other classes in this range. Until recently, the issues addressed by research on the structure of com- plexity classes have b een largely qualitative rather than quantitative. In- deed, the intro duction to [Sch86b] o ered \qualitative" as a synonym for \structural." This seemed to be an inevitable asp ect of the sub ject. A problem is, or is not, complete for a complexity class. One complexity class is, or is not, contained in another. This was unfortunate, since the ob jec- tive of complexity theory is a quantitative theory of computation. However, since the sets of interest are all countably in nite, there app eared to b e no p ossibility of making quantitativeversions of these judgments. The main ob jective of the work surveyed here is to remedy this situation. Supp ose that a language A f0; 1g is chosen by a random exp eri- ment in which an indep endent toss of a fair coin is used to decide whether each string is in A. Then classical Leb esgue measure theory describ ed in [Hal50, Oxt80], for example identi es certain measurable sets of lan- guages also called events and assigns to each measurable set X a mea- sure X , which is the probability that A 2 X in this exp eriment. A set X of languages is then small in the sense of measure if it has measure 0. E ective measure theory, whichsays what it means for a set of decidable languages to have measure 0 as a subset of the set of all such languages, has b een investigated byFreidzon [Fre72], Mehlhorn [Meh74], and others. The resource-bounded measure theory intro duced by Lutz [Lut92, Lutb] has the classical and e ective theories as sp ecial cases, but also de nes measurabil- ity and measure for subsets of many complexity classes. The smal l subsets of such a complexity class are then the measure 0 sets; the large subsets are the measure 1 sets complements of measure 0 sets. We say that almost 1. The Quantitative Structure of Exp onential Time 3 every language in a complexity class C has a given prop ertyif the set of languages in C exhibiting the prop erty is a measure 1 subset of C . Thus, resource-b ounded measure provides a means of investigating the sizes of various subsets of E and EXP. This is a priori a hop eful devel- opment, b oth b ecause quantitative results are more informative and be- cause Leb esgue measure has b een so useful in analysis, probability, and mathematical physics. However, much of the ongoing motivation for this work arises not from a priori considerations, but rather from the fact that resource-b ounded measure turns out to interact informatively with many prop erties of interest in computational complexity. Suchinteractions sur- veyed in this pap er involve bi-immunity section 4, complexity cores sec- tions 5, 7, and 8, the structure of E and EXP under p olynomial-time reductions sections 6,7, and 8, circuit-size complexity and time-b ounded Kolmogorov complexity section 9, natural pro ofs and pseudorandom gen- erators section 9, the densityof hard languages section 11, and other prop erties that had b een extensively studied prior to the advent of resource- b ounded measure. It is to b e hop ed that sustained, systematic investigation along these lines will lead to a detailed, quantitative understanding of E and EXP. From the standp oint of classical mathematics and recursion theory, classes likeP,NP, PH, and PSPACE are all negligibly small, hence dicult to dis- tinguish by quantitative structural means. From the standp oint of E and EXP, matters maybevery di erent. If EXP is, indeed, the smallest deter- ministic time class containing NP, then there maywell b e a natural \notion of smallness" for subsets of EXP such that P is a small subset of EXP, but NP is not. Similarly, it may be that P is a small subset of E, but that NP \ E is not. It is p ossible that resource-b ounded measure already provides such a notion of smallness. It is certainly the case that P has measure 0 in E and EXP [Lut92]. In section 12 we discuss the reasonableness and known consequences of the hyp othesis that NP is not small in this sense. This is a very strong hyp othesis that app ears to havemuch more explanatory p ower than traditional, qualitativehyp otheses, suchasP6= NP or the separation of the p olynomial-time hierarchy. Only further investigation will determine whether this hyp othesis is reasonable. 2 Preliminaries In this pap er, [[ ]] denotes the Boolean value of the condition , i.e., [[ ]]= if then 1 else 0. All languages here are sets of binary strings, i.e., sets A f0; 1g . We 1 identify each language A with its characteristic sequence 2 f0; 1g A 1. The Quantitative Structure of Exp onential Time 4 de ned by =[[s 2 A]][[s 2 A]][[s 2 A]]:::; A 0 1 2 where s = , s = 0, s = 1, s = 00; ::: is the standard enumeration 0 1 2 3 1 of f0; 1g .
Recommended publications
  • The Complexity Zoo
    The Complexity Zoo Scott Aaronson www.ScottAaronson.com LATEX Translation by Chris Bourke [email protected] 417 classes and counting 1 Contents 1 About This Document 3 2 Introductory Essay 4 2.1 Recommended Further Reading ......................... 4 2.2 Other Theory Compendia ............................ 5 2.3 Errors? ....................................... 5 3 Pronunciation Guide 6 4 Complexity Classes 10 5 Special Zoo Exhibit: Classes of Quantum States and Probability Distribu- tions 110 6 Acknowledgements 116 7 Bibliography 117 2 1 About This Document What is this? Well its a PDF version of the website www.ComplexityZoo.com typeset in LATEX using the complexity package. Well, what’s that? The original Complexity Zoo is a website created by Scott Aaronson which contains a (more or less) comprehensive list of Complexity Classes studied in the area of theoretical computer science known as Computa- tional Complexity. I took on the (mostly painless, thank god for regular expressions) task of translating the Zoo’s HTML code to LATEX for two reasons. First, as a regular Zoo patron, I thought, “what better way to honor such an endeavor than to spruce up the cages a bit and typeset them all in beautiful LATEX.” Second, I thought it would be a perfect project to develop complexity, a LATEX pack- age I’ve created that defines commands to typeset (almost) all of the complexity classes you’ll find here (along with some handy options that allow you to conveniently change the fonts with a single option parameters). To get the package, visit my own home page at http://www.cse.unl.edu/~cbourke/.
    [Show full text]
  • Glossary of Complexity Classes
    App endix A Glossary of Complexity Classes Summary This glossary includes selfcontained denitions of most complexity classes mentioned in the b o ok Needless to say the glossary oers a very minimal discussion of these classes and the reader is re ferred to the main text for further discussion The items are organized by topics rather than by alphab etic order Sp ecically the glossary is partitioned into two parts dealing separately with complexity classes that are dened in terms of algorithms and their resources ie time and space complexity of Turing machines and complexity classes de ned in terms of nonuniform circuits and referring to their size and depth The algorithmic classes include timecomplexity based classes such as P NP coNP BPP RP coRP PH E EXP and NEXP and the space complexity classes L NL RL and P S P AC E The non k uniform classes include the circuit classes P p oly as well as NC and k AC Denitions and basic results regarding many other complexity classes are available at the constantly evolving Complexity Zoo A Preliminaries Complexity classes are sets of computational problems where each class contains problems that can b e solved with sp ecic computational resources To dene a complexity class one sp ecies a mo del of computation a complexity measure like time or space which is always measured as a function of the input length and a b ound on the complexity of problems in the class We follow the tradition of fo cusing on decision problems but refer to these problems using the terminology of promise problems
    [Show full text]
  • Quantum Computational Complexity Theory Is to Un- Derstand the Implications of Quantum Physics to Computational Complexity Theory
    Quantum Computational Complexity John Watrous Institute for Quantum Computing and School of Computer Science University of Waterloo, Waterloo, Ontario, Canada. Article outline I. Definition of the subject and its importance II. Introduction III. The quantum circuit model IV. Polynomial-time quantum computations V. Quantum proofs VI. Quantum interactive proof systems VII. Other selected notions in quantum complexity VIII. Future directions IX. References Glossary Quantum circuit. A quantum circuit is an acyclic network of quantum gates connected by wires: the gates represent quantum operations and the wires represent the qubits on which these operations are performed. The quantum circuit model is the most commonly studied model of quantum computation. Quantum complexity class. A quantum complexity class is a collection of computational problems that are solvable by a cho- sen quantum computational model that obeys certain resource constraints. For example, BQP is the quantum complexity class of all decision problems that can be solved in polynomial time by a arXiv:0804.3401v1 [quant-ph] 21 Apr 2008 quantum computer. Quantum proof. A quantum proof is a quantum state that plays the role of a witness or certificate to a quan- tum computer that runs a verification procedure. The quantum complexity class QMA is defined by this notion: it includes all decision problems whose yes-instances are efficiently verifiable by means of quantum proofs. Quantum interactive proof system. A quantum interactive proof system is an interaction between a verifier and one or more provers, involving the processing and exchange of quantum information, whereby the provers attempt to convince the verifier of the answer to some computational problem.
    [Show full text]
  • Contributions to the Study of Resource-Bounded Measure
    Contributions to the Study of ResourceBounded Measure Elvira Mayordomo Camara Barcelona abril de Contributions to the Study of ResourceBounded Measure Tesis do ctoral presentada en el Departament de Llenguatges i Sistemes Informatics de la Universitat Politecnica de Catalunya para optar al grado de Do ctora en Ciencias Matematicas por Elvira Mayordomo Camara Dirigida p or el do ctor Jose Luis Balcazar Navarro Barcelona abril de This dissertation was presented on June st in the Departament de Llenguatges i Sistemes Informatics Universitat Politecnica de Catalunya The committee was formed by the following members Prof Ronald V Bo ok University of California at Santa Barbara Prof Ricard Gavalda Universitat Politecnica de Catalunya Prof Mario Ro drguez Universidad Complutense de Madrid Prof Marta Sanz Universitat Central de Barcelona Prof Jacob o Toran Universitat Politecnica de Catalunya Acknowledgements Iwant to thank sp ecially two p eople Jose Luis Balcazar and Jack Lutz Without their help and encouragement this dissertation would never have b een written Jose Luis Balcazar was my advisor and taughtmemostofwhatIknow ab out Structural Complexity showing me with his example how to do research I visited Jack Lutz in Iowa State University in several o ccasions from His patience and enthusiasm in explaining to me the intuition behind his theory and his numerous ideas were the starting p ointofmostoftheresults in this dissertation Several coauthors have collab orated in the publications included in the dierent chapters Jack Lutz Steven
    [Show full text]
  • Complexity Classes
    CHAPTER Complexity Classes In an ideal world, each computational problem would be classified at least approximately by its use of computational resources. Unfortunately, our ability to so classify some important prob- lems is limited. We must be content to show that such problems fall into general complexity classes, such as the polynomial-time problems P, problems whose running time on a determin- istic Turing machine is a polynomial in the length of its input, or NP, the polynomial-time problems on nondeterministic Turing machines. Many complexity classes contain “complete problems,” problems that are hardest in the class. If the complexity of one complete problem is known, that of all complete problems is known. Thus, it is very useful to know that a problem is complete for a particular complexity class. For example, the class of NP-complete problems, the hardest problems in NP, contains many hundreds of important combinatorial problems such as the Traveling Salesperson Prob- lem. It is known that each NP-complete problem can be solved in time exponential in the size of the problem, but it is not known whether they can be solved in polynomial time. Whether ? P and NP are equal or not is known as the P = NP question. Decades of research have been devoted to this question without success. As a consequence, knowing that a problem is NP- complete is good evidence that it is an exponential-time problem. On the other hand, if one such problem were shown to be in P, all such problems would be been shown to be in P,a result that would be most important.
    [Show full text]
  • Computation Times of Np Sets of Different Densities
    Theoretical Computer Science 34 ( 1984) 17-X 17 North-Holland COMPUTATION TIMES OF NP SETS OF DIFFERENT DENSITIES J. HARTMANIS* and Y. YESHA** Lkpurtment of Computer Science, Cornell University, Ithaca, NY 14853, U.S.A. Abstract. In this paper we study the computational complexity of sets of different densities in NP. We show that the detemlinistic computation time for sets in NP can depend on their density if and only if there is a collapse or partial collapse of the corresponding higher nondeterministic and deterministic time bounded complexity classes. We show also that for NP sets of different densities there exist complrete sets of the corresponding density under polynomial time Turing reductions. Finally, we qhow that these results can be interpreted as results about the complexity of theorem proving and proof presentation in axtomatized mathematical systems. This interpreta- tion relate5 fundamental questIons about the complexity of our intellectual tools to basic structural problems aboLt P, NP, CoNP and PSPA~T, discussed in this paper. Iatrductifm The general motivation for this work is the Aleed and desire to understand what makes the solution of NP problems hard, provided Pf NP. The fundamental question is whether the deterministic computation time required to solve NP prob- lems could depend on the density of the set of problems under consideration. In other words, is the problem of finding satisfying assignments for Boolean formulas in conjunotive normal form, SAT, computationally hard because there are exponen- tially many formulas up to size n and that no one single method can solve them all easily? Or is the satisfiability problem still hard if we consider only ‘thinned out’ sets of formulas whose density is much lower than exponential? It has been shown recently that the structural properties of lower density sets in NP are directly determined by the relations between tke corresponding higher deterministic and nondeterministic time bounded complexity classes.
    [Show full text]
  • The Strong Exponential Hierarchy Collapses*
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector JOURNAL OF COMPUTEK AND SYSTEM SCIENCES 39, 299-322 (1989) The Strong Exponential Hierarchy Collapses* LANE A. HEMACHANDRA~ Department of Cornpurer Science, Cornell University, Ithaca, New York 14853 Received April 20, 1988; revised October 15, 1988 Composed of the levels E (i.e., IJ, DTIME[Z’“]), NE, PNE, NPNE, etc., the strong exponen- tial hierarchy is an exponential-time analogue of the polynomial-time hierarchy. This paper shows that the strong exponential hierarchy collapses to PNE, its A2 level. E#P NE=NpNEyNPNPhtU . .._ The proof stresses the use of partial census information and the exploitation of nondeter- minism. Extending these techniques, we derive new quantitative relativization results: if the weak exponential hierarchy’s A, + , and Z, + , levels, respectively E’; and NE’;, do separate, this is due to the large number of queries NE makes to its ZP database. Our techniques provide a successful method of proving the collapse of certain complexity classes. ( 19x9 Academic Pres. Inc 1. INTR~DUCTI~N 1.1. Background During 1986 and 1987, many structurally defined complexity hierarchies collap- sed. The proofs of collapse shared a technique, the use of census functions, and shared a background, the previous work on quantitative relativizations of Mahaney [Mah82], Book, Long, and Selman [BLS84], and Long [Lon85]. These three papers use the idea that if you know the strings in a set, you implicitly know the strings in the complement. Thus, Mahaney shows that: THEOREM 1 .l [ Mah82]. IfNP has a sparse Turing complete set (i.e., if there is a sparse set SE NP such that NP c P”), then the polynomial hierarchy collapses to PNP, by showing that for any polynomial p( ), a PNP machine can, on input X, explicitly find all strings of length at most p( 1x1) that are in S.
    [Show full text]
  • Computational Complexity Theory
    Computational Complexity Theory Laura Galli October 3, 2017 What is the goal of computational complexity theory? • To provide a method of quantifying problem difficulty in an absolute sense. • To provide a method for comparing the relative difficulty of two different problems. • We would like to be able to rigorously define the meaning of efficient algorithm... • ...and we would like to state that one algorithm is \better" than another. • Complexity theory is built on a basic set of assumptions called the model of computation (e.g., Turing Machine). But, we will not concern ourselves too much with the details of a particular model here. The ingredients that we need to build a theory of computational complexity for prob- lem classification are the following...it's a 4 ingredient recipe! 1. A class C of problems to which the theory applies. 2. A (nonempty) subclass CE ⊆ C of \easy" problems. 3. A (nonempty) subclass CH ⊆ C of \hard" problems. 4. A relation C \not more difficult than" between problems. Our goal is just to put some theory around this machinery: • Q 2 CE ;P C Q =) P 2 CE • P 2 CH;P C Q =) Q 2 CH What is the difference between problem and (problem) instance? • A problem is an infinite family of instances whose objective function and constraints have a specific structure. 1 How to measure the difficulty of an instance? • The difficulty of a problem instance is easy to judge. • Try to solve it and see how long it takes. • Note that this inherently depends on the algorithm and the computing platform.
    [Show full text]
  • Results on Resource-Bounded Measure
    Results on ResourceBounded Measure Harry Buhrman and Stephen Fenner and Lance Fortnow 1 Centrum vo or Wiskunde en Informatica 2 University of Southern Maine 3 CWI The University of Chicago Abstract We construct an oracle relative to which NP has pmeasure p but D has measure in EXP This gives a strong relativized negative answer to a question p osed by Lutz Lut Secondly we give strong evidence that BPP is small We show that BPP has pmeasure unless EXP MA and thus the p olynomialtime hierarchy collapses This con trasts with the work of Regan et al RSC where it is shown that Ppol y do es not have pmeasure if exp onentially strong pseudorandom generators exist Intro duction Since the intro duction of resourceb ounded measure by Lutz Lut many re searchers investigated the size measure of complexity classes in exp onential time EXP A particular p oint of interest is the hypothesis that NP do es not have pmeasure Recent results have shown that many reasonable conjectures in computational complexity theory follow from the hyp othesis that NP is not small ie NP and hence it seems to b e a plausible scientic hyp oth p esis LM Lut P He shows In Lut Lutz shows that if NP then BPP is low for p P that this even follows from the seemingly weaker hyp othesis that p He asks whether the latter assumption is weaker or equivalent to NP p In this pap er we show that relative to some oracle the two assumptions are not equivalent p We show a relativized world where D EXP whereas NP has no Pbi immune sets This immediately
    [Show full text]
  • Introduction to Computational Complexity∗ — Mathematical Programming Glossary Supplement —
    Introduction to Computational Complexity∗ — Mathematical Programming Glossary Supplement — Magnus Roos and J¨org Rothe Institut f¨ur Informatik Heinrich-Heine-Universit¨at D¨usseldorf 40225 D¨usseldorf, Germany {roos,rothe}@cs.uni-duesseldorf.de March 24, 2010 Abstract This supplement is a brief introduction to the theory of computational complexity, which in particular provides important notions, techniques, and results to classify problems in terms of their complexity. We describe the foundations of complexity theory, survey upper bounds on the time complexity of selected problems, define the notion of polynomial-time many- one reducibility as a means to obtain lower bound (i.e., hardness) results, and discuss NP- completeness and the P-versus-NP question. We also present the polynomial hierarchy and the boolean hierarchy over NP and list a number of problems complete in the higher levels of these two hierarchies. 1 Introduction Complexity theory is an ongoing area of algorithm research that has demonstrated its practical value by steering us away from inferior algorithms. It also gives us an understanding about the level of inherent algorithmic difficulty of a problem, which affects how much effort we spend on developing sharp models that mitigate the computation time. It has also spawned approximation algorithms that, unlike metaheuristics, provide a bound on the quality of solution obtained in polynomial time. This supplement is a brief introduction to the theory of computational complexity, which in particular provides important notions, techniques, and results to classify problems in terms of their complexity. For a more detailed and more comprehensive introduction to this field, we refer to the textbooks by Papadimitriou [Pap94], Rothe [Rot05], and Wilf [Wil94], and also to Tovey’s tutorial [Tov02].
    [Show full text]
  • A. Definitions of Reductions and Complexity Classes, and Notation List
    A. Definitions of Reductions and Complexity Classes, and N otation List A.I Reductions Below, in naming the reductions, "polynomial-time" is implicit unless ot her­ wise noted, e.g., "many-one reduction" means "many-one polynomial-time reduction." This list sorts among t he :Sb first by b, and in the case of identical b's, bya. :S -y - Gamma reduction. -A :S -y B if there is a nondeterministic polynomial-time machine N such that (a) for each st ring x, N(x) has at least one accepting path, and (b) for each string x and each accepting path p of N(x) it holds that: x E A if and only if the output of N(x) on path p is an element of B. :S ~ - Many-one reduction. -A :S~ B if (3f E FP)(Vx)[x E A {=} f(x) EB] . :S~ o s - (Globally) Positive Turing reduction. -A :S~o s B if there is a deterministic Turing machine Mand a polyno­ mial q such that 1. (VD)[runtimeMD(x):s q(lxl)], B 2. A = L(M ), and 3. (VC, D)[C ç D =} L(MC) ç L(MD)]. :S:08 - Locally positive Turing reduction. -A :S:os B if there is a deterministic polynomial-time Turing machine M such that 1. A = L(MB), 2. (VC)[L(M BUC) :2 L(MB)] , and 3. (VC)[L(M B- C) ç L(MB)] . :ST - Exponential-time Turing reduction. -A :ST B if A E EB. If A E EB via an exponential-time machine, M, having the property that on each input of length n it holds that M makes at most g(n) queries to its orade, we write A :S~ ( n ) - T B.
    [Show full text]
  • Complexity Hierarchies Beyond Elementary
    COMPLEXITY HIERARCHIES BEYOND ELEMENTARY SYLVAIN SCHMITZ Abstract. We introduce a hierarchy of fast-growing complexity classes and show its suitability for completeness statements of many non ele- mentary problems. This hierarchy allows the classification of many deci- sion problems with a non-elementary complexity, which occur naturally in logic, combinatorics, formal languages, verification, etc., with com- plexities ranging from simple towers of exponentials to Ackermannian and beyond. Key Words. Fast-growing complexity, subrecursion, well-quasi-order 1. Introduction Complexity classes, along with the associated notions of reductions and completeness, provide our best theoretical tools to classify and compare computational problems. The richness and liveness of this field can be ex- perienced by taking a guided tour of the Complexity Zoo,1 which presents succinctly most of the known specimens. The visitor will find there a wealth of classes at the frontier between tractability and intractability, starring the classes P and NP, as they help in understanding what can be solved efficiently by algorithmic means. From this tractability point of view, it is not so surprising to find much less space devoted to the \truly intractable" classes, in the exponential hier- archy and beyond. Such classes are nevertheless quite useful for classifying problems, and employed routinely in logic, combinatorics, formal languages, verification, etc. since the 70's and the exponential lower bounds proven by Meyer and Stockmeyer [66, 87]. arXiv:1312.5686v3 [cs.CC] 4 Feb 2016 Non Elementary Problems. Actually, these two seminal articles go further than mere exponential lower bounds: they show respectively that satisfia- bility of the weak monadic theory of one successor (WS1S) and equivalence of star-free expressions (SFEq) are non elementary, as they require space bounded above and below by towers of exponentials of height depending (ele- mentarily) on the size of the input.
    [Show full text]