Decidability

Total Page:16

File Type:pdf, Size:1020Kb

Decidability Decidability Introduction Recall that a predicate function is a function M(x) whose range is f0; 1g. Moreover, predicate M(x) is decidable iff it is total computable. When a predicate function is not computable, then it is called undecidable. Predicate functions are often associated with properties of natural numbers. For example, consider the property of a natural number being prime. Then we may define that property using the predicate function 1 if x is prime M(x) = 0 otherwise In this case we say that the property of being prime is decidable, since its associated predicate function is decidable. Moreover, since every natural number x is associated with a computable function φx, and a program Px, then we may also discuss whether or not a property of computable functions (respectively, a property of programs) is decidable. For example, one consequence of the existence of universal programs is that the predicate function 1 if φ is total M(x) = x 0 otherwise is undecidable, and hence the property of a computable function being total is undecidable. In general, a decision problem is any problem that involves deciding if some entity has a given property. In this lecture we show that many properties of computable functions are undecidable. We also state some problems in other areas of mathematics that have been shown to be undecidable, as well as a few decidable problems that might not seem so obviously decidable. Finally, we define what it means for a predicate function to be partially decidable, and introduce the notions of recursive and recursively enumerable sets. 1 The Self-Defined Property is Undecidable Program P is said to have the self-defined property iff P (x) is defined, where x is the Godel number of P . A more succinct way of describing this property is that Px has the self-defined property iff x 2 Wx. Theorem 1. The self-defined property is undecidable. Proof Theorem 1. Suppose by way of contradiction that the self-defined property is decidable. Then the function 1 if x 2 W M(x) = x 0 otherwise is total computable. Now define the function g(x) as 1 if M(x) = 0 g(x) = undefined otherwise To see that g(x) is computable, consider a description of the a program P for computing g. On input x the program first executes the program PM that computes M(x). If PM (x) = 0, then P returns 1. Otherwise, P enters an infinite loop, so that g(x) is undefined. We leave it as an exercise to provide an abstract URM program that represents P . Now, since g(x) is computable, there is an index e, such that g(x) = φe(x) for all x 2 N . In particular g(e) = φe(e). Now suppose g(e) is defined. Then φe(e) is defined, meaning that e 2 We, which implies that M(e) = 1, which in turn (by definition of g) implies that g(e) is undefined, a contradiction. On the other hand, if g(e) is undefined, then φe(e) is undefined, meaning that e 62 We, which implies that M(e) = 0, which in turn (by definition of g) implies that g(e) = 1 is defined, a contradiction. Therefore, the self-defined property is undecidable. Corollary 1. The Halting Problem is the problem of deciding if φx(y) is defined, for given x; y 2 N . Moreover, the Halting Problem is undecidable. Proof of Corollary 1. If the Haltng Problem were decidable, say by a total computable predi- cate function M(x; y). Then x 2 Wx iff φx(x) is defined, iff M(x; x) = 1, which contradicts the undecidability of the self-defined property. 2 The following table suggests that the above proof can be understood as another diagonalization argument. The red values in the table are the outputs being assigned to g based on the values of M(x). indexninput n 0 1 2 ··· e ··· self defined? φ0(n) 2 !" 7 4 ··· 18 ··· yes φ1(n) " "! 17 ···"··· no φ2(n) 7 5 9 !"··· 36 ··· yes . .. g(n)= φe(n) " 1 "··· 1 !"··· yes/no . .. g(0) =", g(1) = 1, g(2) =", :::, g(e) =? (1 or "?). The original table states that g(e) = 1, but the changing of values along the diagonal in order to define g implies that g is undefined, a contradiction. 3 Using Reducibility to Prove Undecidability Given a total (not necessarily computable) predicate function M(x) and an integer x, we call x a positive instance of M, iff M(x) = 1. Similarly, x a negative instance iff M(x) = 0. For example, if M(x) is the predicate function for deciding if x is even, then 2 is a positive instance of M, while 3 is a negative instance. Let M(x) and N(x) be two total but not necessarily computable predicate functions. We say that M is many-to-one reducible (also referred to as functional reducible) to N, written as M ≤m N, iff there exists a total computable function f(x) for which M(x) = N(f(x)). Example 1. If M(x) is the predicate function for deciding if x is even, and N(x) is the predicate function for deciding if x is odd, then M ≤m N via the function f(x) = x + 1. In other words, M(x) = N(f(x)) = N(x + 1). The following theorem shows how to use functional reducibility to establish both decidability and undecidability. Theorem 2. Given predicate functions M(x) and N(x) with M ≤m N, if N is decidable then so is M. Contrapositively, if M is undecidable, then so is N. Proof Theorem 2. Suppose N is decidable and M ≤m N via total computable reducing function f(x). Then N(f(x)) is total computable, since both N and f are total computable. Therefore, since M(x) = N(f(x)), it follows that M is also total computable, and hence decidable. Theorem 1 may be used to show the undecidability of a predicate function by functionally reducing a known undecidable predicate function to the predicate function in question. Moreover, the s-m-n theorem can prove very useful for finding the necessary reducing function. 4 Example 2. We use Theorem 1 and the s-m-n theorem to prove that the \zero property", namely \φx(y) equals the zero function" is undecidable. To do this we define the function 0 if x 2 W g(x; y) = x undefined otherwise Then by the s-m-n theorem there is a total computable function f(x) for which φf(x) = g(x; y) for all x 2 N . Moreover, x 2 Wx iff φf(x)(y) = 0 forall y; meaning that x has the self-defined property iff f(x) has the zero property. Therefore, since the self-defined property is undecidable, then so is the zero property. 5 Example 3. Consider the predicate function E(z) which evaluates to 1 iff φπ1(z) = φπ2(z). Prove that E is undecidable by reducing SD to E. 6 Rice's Theorem. Let C1 denote the set of unary computable functions, and B be a nonempty proper subset of C1. Then the predicate function 1 if φ 2 B B(x) = x 0 otherwise is undecidable. Proof of Rice's Theorem. Let f; denote the computable function that is nowhere defined. Without loss of generality, assume f; 62 B. Let g(y) 2 B be fixed, and consider the function g(y) if x 2 W h(x; y) = x undefined otherwise Then h is certainly computable, since one first computes U (x; x) and, assuming it is defined, then computes g(y). Therefore, by the s-m-n theorem, there exists a total computable function k(x) for which φk(x)(y) = g(y) if x 2 Wx, and φk(x)(y) = f; otherwise. Therefore, we have x 2 Wx iff B(k(x)), showing that the self-defined property is many-to-one reducible to B. Therefore, since the self-defined property is undecidable, then so is B. 7 Partially Decidable Predicates A predicate function P (x) is partially decidable iff there is a computable function f, such that 1 if P (x) = 1 f(x) = undefined otherwise Theorem 3. P is a partially-decidable predicate function iff there exists a decidable predicate function R(x; y) for which P (x) = 1 iff 9yR(x; y) is true. Theorem 3. First suppose P is partially decidable. Then by definition there is an index e for which φe(x) = 1 if P (x) = 1, and is undefined otherwise. Moreover, recall that there is a primitve-recursive decidable predicate s(e; x; 1; t) that evaluates to 1 iff φe(x) # 1 in t or fewer steps. Therefore, P (x) = 1 iff 9ys(e; x; 1; y). Therefore, we may define R(x; y) = s(e; x; 1; y), which is decidable. Conversely, suppose there exists a decidable predicate R(x; y) for which P (x) = 1 iff 9yR(x; y) is true. Then letting f(x) = sgn(µy(R(x; y) = 0) + 1), it follows that P (x) = 1 iff f(x) = 1, and that P (x) is undefined iff f(x) is undefined. Therefore, P is partially decidable. A subset W ⊆ N is said to be recursive iff there is a decidable predicate M(x) for which x 2 W iff M(x) = 1. Similary, W is recursively enumerable (r.e.) iff there is a partially decidable predicate M(x) for which x 2 W iff M(x) = 1.
Recommended publications
  • NP-Completeness (Chapter 8)
    CSE 421" Algorithms NP-Completeness (Chapter 8) 1 What can we feasibly compute? Focus so far has been to give good algorithms for specific problems (and general techniques that help do this). Now shifting focus to problems where we think this is impossible. Sadly, there are many… 2 History 3 A Brief History of Ideas From Classical Greece, if not earlier, "logical thought" held to be a somewhat mystical ability Mid 1800's: Boolean Algebra and foundations of mathematical logic created possible "mechanical" underpinnings 1900: David Hilbert's famous speech outlines program: mechanize all of mathematics? http://mathworld.wolfram.com/HilbertsProblems.html 1930's: Gödel, Church, Turing, et al. prove it's impossible 4 More History 1930/40's What is (is not) computable 1960/70's What is (is not) feasibly computable Goal – a (largely) technology-independent theory of time required by algorithms Key modeling assumptions/approximations Asymptotic (Big-O), worst case is revealing Polynomial, exponential time – qualitatively different 5 Polynomial Time 6 The class P Definition: P = the set of (decision) problems solvable by computers in polynomial time, i.e., T(n) = O(nk) for some fixed k (indp of input). These problems are sometimes called tractable problems. Examples: sorting, shortest path, MST, connectivity, RNA folding & other dyn. prog., flows & matching" – i.e.: most of this qtr (exceptions: Change-Making/Stamps, Knapsack, TSP) 7 Why "Polynomial"? Point is not that n2000 is a nice time bound, or that the differences among n and 2n and n2 are negligible. Rather, simple theoretical tools may not easily capture such differences, whereas exponentials are qualitatively different from polynomials and may be amenable to theoretical analysis.
    [Show full text]
  • Computability (Section 12.3) Computability
    Computability (Section 12.3) Computability • Some problems cannot be solved by any machine/algorithm. To prove such statements we need to effectively describe all possible algorithms. • Example (Turing Machines): Associate a Turing machine with each n 2 N as follows: n $ b(n) (the binary representation of n) $ a(b(n)) (b(n) split into 7-bit ASCII blocks, w/ leading 0's) $ if a(b(n)) is the syntax of a TM then a(b(n)) else (0; a; a; S,halt) fi • So we can effectively describe all possible Turing machines: T0; T1; T2;::: Continued • Of course, we could use the same technique to list all possible instances of any computational model. For example, we can effectively list all possible Simple programs and we can effectively list all possible partial recursive functions. • If we want to use the Church-Turing thesis, then we can effectively list all possible solutions (e.g., Turing machines) to every intuitively computable problem. Decidable. • Is an arbitrary first-order wff valid? Undecidable and partially decidable. • Does a DFA accept infinitely many strings? Decidable • Does a PDA accept a string s? Decidable Decision Problems • A decision problem is a problem that can be phrased as a yes/no question. Such a problem is decidable if an algorithm exists to answer yes or no to each instance of the problem. Otherwise it is undecidable. A decision problem is partially decidable if an algorithm exists to halt with the answer yes to yes-instances of the problem, but may run forever if the answer is no.
    [Show full text]
  • Homework 4 Solutions Uploaded 4:00Pm on Dec 6, 2017 Due: Monday Dec 4, 2017
    CS3510 Design & Analysis of Algorithms Section A Homework 4 Solutions Uploaded 4:00pm on Dec 6, 2017 Due: Monday Dec 4, 2017 This homework has a total of 3 problems on 4 pages. Solutions should be submitted to GradeScope before 3:00pm on Monday Dec 4. The problem set is marked out of 20, you can earn up to 21 = 1 + 8 + 7 + 5 points. If you choose not to submit a typed write-up, please write neat and legibly. Collaboration is allowed/encouraged on problems, however each student must independently com- plete their own write-up, and list all collaborators. No credit will be given to solutions obtained verbatim from the Internet or other sources. Modifications since version 0 1. 1c: (changed in version 2) rewored to showing NP-hardness. 2. 2b: (changed in version 1) added a hint. 3. 3b: (changed in version 1) added comment about the two loops' u variables being different due to scoping. 0. [1 point, only if all parts are completed] (a) Submit your homework to Gradescope. (b) Student id is the same as on T-square: it's the one with alphabet + digits, NOT the 9 digit number from student card. (c) Pages for each question are separated correctly. (d) Words on the scan are clearly readable. 1. (8 points) NP-Completeness Recall that the SAT problem, or the Boolean Satisfiability problem, is defined as follows: • Input: A CNF formula F having m clauses in n variables x1; x2; : : : ; xn. There is no restriction on the number of variables in each clause.
    [Show full text]
  • Lambda Calculus and the Decision Problem
    Lambda Calculus and the Decision Problem William Gunther November 8, 2010 Abstract In 1928, Alonzo Church formalized the λ-calculus, which was an attempt at providing a foundation for mathematics. At the heart of this system was the idea of function abstraction and application. In this talk, I will outline the early history and motivation for λ-calculus, especially in recursion theory. I will discuss the basic syntax and the primary rule: β-reduction. Then I will discuss how one would represent certain structures (numbers, pairs, boolean values) in this system. This will lead into some theorems about fixed points which will allow us have some fun and (if there is time) to supply a negative answer to Hilbert's Entscheidungsproblem: is there an effective way to give a yes or no answer to any mathematical statement. 1 History In 1928 Alonzo Church began work on his system. There were two goals of this system: to investigate the notion of 'function' and to create a powerful logical system sufficient for the foundation of mathematics. His main logical system was later (1935) found to be inconsistent by his students Stephen Kleene and J.B.Rosser, but the 'pure' system was proven consistent in 1936 with the Church-Rosser Theorem (which more details about will be discussed later). An application of λ-calculus is in the area of computability theory. There are three main notions of com- putability: Hebrand-G¨odel-Kleenerecursive functions, Turing Machines, and λ-definable functions. Church's Thesis (1935) states that λ-definable functions are exactly the functions that can be “effectively computed," in an intuitive way.
    [Show full text]
  • NP-Completeness General Problems, Input Size and Time Complexity
    NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and Johnson, W.H. Freeman and Company, 1979. Young CS 331 NP-Completeness 1 D&A of Algo. General Problems, Input Size and Time Complexity • Time complexity of algorithms : polynomial time algorithm ("efficient algorithm") v.s. exponential time algorithm ("inefficient algorithm") f(n) \ n 10 30 50 n 0.00001 sec 0.00003 sec 0.00005 sec n5 0.1 sec 24.3 sec 5.2 mins 2n 0.001 sec 17.9 mins 35.7 yrs Young CS 331 NP-Completeness 2 D&A of Algo. 1 “Hard” and “easy’ Problems • Sometimes the dividing line between “easy” and “hard” problems is a fine one. For example – Find the shortest path in a graph from X to Y. (easy) – Find the longest path in a graph from X to Y. (with no cycles) (hard) • View another way – as “yes/no” problems – Is there a simple path from X to Y with weight <= M? (easy) – Is there a simple path from X to Y with weight >= M? (hard) – First problem can be solved in polynomial time. – All known algorithms for the second problem (could) take exponential time . Young CS 331 NP-Completeness 3 D&A of Algo. • Decision problem: The solution to the problem is "yes" or "no". Most optimization problems can be phrased as decision problems (still have the same time complexity). Example : Assume we have a decision algorithm X for 0/1 Knapsack problem with capacity M, i.e. Algorithm X returns “Yes” or “No” to the question “Is there a solution with profit P subject to knapsack capacity M?” Young CS 331 NP-Completeness 4 D&A of Algo.
    [Show full text]
  • COT5310: Formal Languages and Automata Theory
    COT5310: Formal Languages and Automata Theory Lecture Notes #1: Computability Dr. Ferucio Laurent¸iu T¸iplea Visiting Professor School of Computer Science University of Central Florida Orlando, FL 32816 E-mail: [email protected] http://www.cs.ucf.edu/~tiplea Computability 1. Introduction to computability 2. Basic models of computation 2.1. Recursive functions 2.2. Turing machines 2.3. Properties of recursive functions 3. Other models of computation UCF-SCS/COT5310/Fall 2005/F.L. Tiplea 1 1. Introduction to Computability Questions and problems • Computation (What-) problems and decision problems • Problems and algorithms • Hilbert’s problems • Hilbert’s program • Algorithms and functions • The theory of computation • UCF-SCS/COT5310/Fall 2005/F.L. Tiplea 2 Questions and Problems Questions: For what real number x is 2x2 + 36x + 25 = 0? • What is the smallest prime number greater than 20? • Is 257 a prime number? • A problem is a class of questions. Each question in the class is an instance of the problem. Examples of problems: Find the real roots of the equation ax2+bx+c = 0, where • a, b, and c are real numbers. If we substitute a, b, and c by real values, we get an instance of this problem; Does the equation ax2 + bx + c = 0, where a, b, and c are • real numbers, have positive (real) roots? If we substitute a, b, and c by real values, we get an instance of this problem. UCF-SCS/COT5310/Fall 2005/F.L. Tiplea 3 Computation and Decision Problems Most problems in mathematical sciences are of two kinds: computation (what-) problems - such a problem is to • obtain the value of a function for a given argument.
    [Show full text]
  • The Single-Person Decision Problem
    © Copyright, Princeton University Press. No part of this book may be distributed, posted, or reproduced in any form by digital or mechanical means without prior written permission of the publisher. 1 The Single-Person Decision Problem magine yourself in the morning, all dressed up and ready to have breakfast. You Imight be lucky enough to live in a nice undergraduate dormitory with access to an impressive cafeteria, in which case you have a large variety of foods from which to choose. Or you might be a less-fortunate graduate student, whose studio cupboard offers the dull options of two half-empty cereal boxes. Either way you face the same problem: what should you have for breakfast? This trivial yet ubiquitous situation is an example of a decision problem. Decision problems confront us daily, as individuals and as groups (such as firms and other organizations). Examples include a division manager in a firm choosing whether or not to embark on a new research and development project; a congressional representative deciding whether or not to vote for a bill; an undergraduate student deciding on a major; a baseball pitcher contemplating what kind of pitch to deliver; or a lost group of hikers confused about which direction to take. The list is endless. Some decision problems are trivial, such as choosing your breakfast. For example, if Apple Jacks and Bran Flakes are the only cereals in your cupboard, and if you hate Bran Flakes (they belong to your roommate), then your decision is obvious: eat the Apple Jacks. In contrast, a manager’s choice of whether or not to embark on a risky research and development project or a lawmaker’s decision on a bill are more complex decision problems.
    [Show full text]
  • The Entscheidungsproblem and Alan Turing
    The Entscheidungsproblem and Alan Turing Author: Laurel Brodkorb Advisor: Dr. Rachel Epstein Georgia College and State University December 18, 2019 1 Abstract Computability Theory is a branch of mathematics that was developed by Alonzo Church, Kurt G¨odel,and Alan Turing during the 1930s. This paper explores their work to formally define what it means for something to be computable. Most importantly, this paper gives an in-depth look at Turing's 1936 paper, \On Computable Numbers, with an Application to the Entscheidungsproblem." It further explores Turing's life and impact. 2 Historic Background Before 1930, not much was defined about computability theory because it was an unexplored field (Soare 4). From the late 1930s to the early 1940s, mathematicians worked to develop formal definitions of computable functions and sets, and applying those definitions to solve logic problems, but these problems were not new. It was not until the 1800s that mathematicians began to set an axiomatic system of math. This created problems like how to define computability. In the 1800s, Cantor defined what we call today \naive set theory" which was inconsistent. During the height of his mathematical period, Hilbert defended Cantor but suggested an axiomatic system be established, and characterized the Entscheidungsproblem as the \fundamental problem of mathemat- ical logic" (Soare 227). The Entscheidungsproblem was proposed by David Hilbert and Wilhelm Ackerman in 1928. The Entscheidungsproblem, or Decision Problem, states that given all the axioms of math, there is an algorithm that can tell if a proposition is provable. During the 1930s, Alonzo Church, Stephen Kleene, Kurt G¨odel,and Alan Turing worked to formalize how we compute anything from real numbers to sets of functions to solve the Entscheidungsproblem.
    [Show full text]
  • K-Center Hardness and Max-Coverage (Greedy)
    IOE 691: Approximation Algorithms Date: 01/11/2017 Lecture Notes: K-center Hardness and Max-Coverage (Greedy) Instructor: Viswanath Nagarajan Scribe: Sentao Miao 1 Overview In this lecture, we will talk about the hardness of a problem and some properties of problem reduction (a technique usually used to show some problem is NP-hard). Then using this technique, we will show that K-center problem is NP-hard for any approximation ratio less than 2. Another topic is to develop an approximation algorithm with ratio 1−1=e for the maximum coverage problem. 2 Hardness of a Problem Consider we have a problem P , it can be either a decision problem (if the output is yes or no) or an optimization problem (if the output is the maximum or minimum of the problem instance). However, we generally only consider the decision problem because decision and optimization problems are somehow \equivalent". More specifically, think about the K-center problem. A decision problem of K-center is that given some bound B, whether there exists a solution whose objective is less or equal to B; the optimization problem of K-center is simply to minimize the objective. Obviously, if we know how to solve the optimization problem, we can immediately answer the decision problem. On the other hand, if we can answer any decision problem with any B, using a polynomial-time routine (e.g. binary search), we can find the optimal value of the optimization problem as well. So consider a decision problem, how do we identify its hardness rigorously? There are two main classes of decision problems based on its hardness.
    [Show full text]
  • The Complexity Classes P and NP Andreas Klappenecker [Partially Based on Slides by Professor Welch] P Polynomial Time Algorithms
    The Complexity Classes P and NP Andreas Klappenecker [partially based on slides by Professor Welch] P Polynomial Time Algorithms Most of the algorithms we have seen so far run in time that is upper bounded by a polynomial in the input size • sorting: O(n2), O(n log n), … 3 log 7 • matrix multiplication: O(n ), O(n 2 ) • graph algorithms: O(V+E), O(E log V), … In fact, the running time of these algorithms are bounded by small polynomials. Categorization of Problems We will consider a computational problem tractable if and only if it can be solved in polynomial time. Decision Problems and the class P A computational problem with yes/no answer is called a decision problem. We shall denote by P the class of all decision problems that are solvable in polynomial time. Why Polynomial Time? It is convenient to define decision problems to be tractable if they belong to the class P, since - the class P is closed under composition. - the class P is nearly independent of the computational model. [Of course, no one will consider a problem requiring an Ω(n100) algorithm as efficiently solvable. However, it seems that most problems in P that are interesting in practice can be solved fairly efficiently. ] NP Efficient Certification An efficient certifier for a decision problem X is a polynomial time algorithm that takes two inputs, an putative instance i of X and a certificate c and returns either yes or no. there is a polynomial such that for every string i, the string i is an instance of X if and only if there exists a string c such that c <= p(|i|) and B(d,c) = yes.
    [Show full text]
  • A Gentle Introduction to Computational Complexity Theory, and a Little Bit More
    A GENTLE INTRODUCTION TO COMPUTATIONAL COMPLEXITY THEORY, AND A LITTLE BIT MORE SEAN HOGAN Abstract. We give the interested reader a gentle introduction to computa- tional complexity theory, by providing and looking at the background leading up to a discussion of the complexity classes P and NP. We also introduce NP-complete problems, and prove the Cook-Levin theorem, which shows such problems exist. We hope to show that study of NP-complete problems is vi- tal to countless algorithms that help form a bridge between theoretical and applied areas of computer science and mathematics. Contents 1. Introduction 1 2. Some basic notions of algorithmic analysis 2 3. The boolean satisfiability problem, SAT 4 4. The complexity classes P and NP, and reductions 8 5. The Cook-Levin Theorem (NP-completeness) 10 6. Valiant's Algebraic Complexity Classes 13 Appendix A. Propositional logic 17 Appendix B. Graph theory 17 Acknowledgments 18 References 18 1. Introduction In \computational complexity theory", intuitively the \computational" part means problems that can be modeled and solved by a computer. The \complexity" part means that this area studies how much of some resource (time, space, etc.) a problem takes up when being solved. We will focus on the resource of time for the majority of the paper. The motivation of this paper comes from the author noticing that concepts from computational complexity theory seem to be thrown around often in casual discus- sions, though poorly understood. We set out to clearly explain the fundamental concepts in the field, hoping to both enlighten the audience and spark interest in further study in the subject.
    [Show full text]
  • Lecture 19 1 Decision Problems 2 Polynomial Time Reductions
    CS31 (Algorithms), Spring 2020 : Lecture 19 Date: Topic: P, NP, and all that Jazz! Disclaimer: These notes have not gone through scrutiny and in all probability contain errors. Please discuss in Piazza/email errors to [email protected] The main goal of this lecture is to introduce the notions of NP and NP-hardness and NP-completeness, and to understand what the P vs NP question is. Our treatment would be semi-formal; for a formal and much more in-depth treatment I suggest taking CS 39. We start with decision problems. 1 Decision Problems Definition 1. Informally, any problem Π is a decision problem if its solutions are either YES or NO. For- mally, a problem Π is a decision problem if all instances I ∈ Π can be partitioned into two classes YES- Instances and NO-instances, and given an instance I, the objective is to figure out which class it lies in. Example 1. We have seen many examples of decision problems in this course. 1. (Subset Sum) Given a1; : : : ; an; B decided whether or not there exists a subset of these numbers which sum to exactly B? 2. (Reachability) Given a graph G = (V; E) and two vertices s; t, is there a path from s to t in G? 3. (Strongly Connected) Given a directed graph G = (V; E), is it strongly connected? Not all problems are decision problems. There are optimization problems which ask us to maximize or minimize things. For example, find the largest independent set in a graph; given an array, find the maximum range sub-array; given a knapsack instance, find the largest profit subset that fits in the knapsack.
    [Show full text]