Combinatorial Approximation Algorithms
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Approximation Algorithms for 2-Stage Stochastic Optimization Problems
Algorithms Column: Approximation Algorithms for 2-Stage Stochastic Optimization Problems Chaitanya Swamy∗ David B. Shmoys† February 5, 2006 1 Column editor’s note This issue’s column is written by guest columnists, David Shmoys and Chaitanya Swamy. I am delighted that they agreed to write this timely column on the topic related to stochastic optimization that has received much attention recently. Their column introduces the reader to several recent results and provides references for further readings. Samir Khuller 2 Introduction Uncertainty is a facet of many decision environments and might arise for various reasons, such as unpredictable information revealed in the future, or inherent fluctuations caused by noise. Stochastic optimization provides a means to handle uncertainty by modeling it by a probability distribution over possible realizations of the actual data, called scenarios. The field of stochastic optimization, or stochastic programming, has its roots in the work of Dantzig [4] and Beale [1] in the 1950s, and has since increasingly found application in a wide variety of areas, including transportation models, logistics, financial instruments, and network design. An important and widely-used model in stochastic programming is the 2- stage recourse model: first, given only distributional information about (some of) the data, one commits on initial (first-stage) actions. Then, once the actual data is realized according to the distribution, further recourse actions can be taken (in the second stage) to augment the earlier solution and satisfy the revealed requirements. The aim is to choose the initial actions so as to minimize the expected total cost incurred. The recourse actions typically entail making decisions in rapid reaction to the observed scenario, and are therefore more costly than decisions made ahead of time. -
Approximation Algorithms
In Introduction to Optimization, Decision Support and Search Methodologies, Burke and Kendall (Eds.), Kluwer, 2005. (Invited Survey.) Chapter 18 APPROXIMATION ALGORITHMS Carla P. Gomes Department of Computer Science Cornell University Ithaca, NY, USA Ryan Williams Computer Science Department Carnegie Mellon University Pittsburgh, PA, USA 18.1 INTRODUCTION Most interesting real-world optimization problems are very challenging from a computational point of view. In fact, quite often, finding an optimal or even a near-optimal solution to a large-scale optimization problem may require com- putational resources far beyond what is practically available. There is a sub- stantial body of literature exploring the computational properties of optimiza- tion problems by considering how the computational demands of a solution method grow with the size of the problem instance to be solved (see e.g. Aho et al., 1979). A key distinction is made between problems that require compu- tational resources that grow polynomially with problem size versus those for which the required resources grow exponentially. The former category of prob- lems are called efficiently solvable, whereas problems in the latter category are deemed intractable because the exponential growth in required computational resources renders all but the smallest instances of such problems unsolvable. It has been determined that a large class of common optimization problems are classified as NP-hard. It is widely believed—though not yet proven (Clay Mathematics Institute, 2003)—that NP-hard problems are intractable, which means that there does not exist an efficient algorithm (i.e. one that scales poly- nomially) that is guaranteed to find an optimal solution for such problems. -
David B. Shmoys
CURRICULUM VITAE David B. Shmoys 231 Rhodes Hall 312 Comstock Road Cornell University Ithaca, NY 14850 Ithaca, NY 14853 (607)-257-7404 (607)-255-9146 [email protected] Education Ph.D., Computer Science, University of California, Berkeley, June 1984. Thesis: Approximation Algorithms for Problems in Scheduling, Sequencing & Network Design Thesis Committee: Eugene L. Lawler (chair), Dorit S. Hochbaum, Richard M. Karp. B.S.E., Electrical Engineering and Computer Science, Princeton University, June 1981. Graduation with Highest Honors, Phi Beta Kappa, Tau Beta Pi. Thesis: Perfect Graphs & the Strong Perfect Graph Conjecture Research Advisors: H. W. Kuhn, K. Steiglitz and D. B. West Professional Employment Laibe/Acheson Professor of Business Management & Leadership Studies, Cornell, 2013–present. Tang Visiting Professor, Department of Ind. Eng. & Operations Research, Columbia, Spring 2019. Visiting Scientist, Simons Institute for the Theory of Computing, University of California, Berkeley, Spring 2018. Director, School of Operations Research & Information Engineering, Cornell University, 2013–2017. Professor of Operations Research & Information Engineering and of Computer Science, Cornell, 2007–present. Visiting Professor, Sloan School of Management, MIT, 2010–2011, Summer 2015. Visiting Research Scientist, New England Research & Development Center, Microsoft, 2010–2011. Professor of Operations Research & Industrial Engineering and of Computer Science, Cornell University, 1997–2006. Visiting Research Scientist, Computer Science Division, EECS, University of California, Berkeley, 1999–2000. Associate Professor of Operations Research & Industrial Engineering and of Computer Science, Cor- nell University, 1996–1997. Associate Professor of Operations Research & Industrial Engineering, Cornell University, 1992–1996. 1 Visiting Research Scientist, Department of Computer Science, Eotv¨ os¨ University, Fall 1993. Visiting Research Scientist, Department of Computer Science, Princeton University, Spring 1993. -
K-Medians, Facility Location, and the Chernoff-Wald Bound
86 K-Medians, Facility Location, and the Chernoff-Wald Bound Neal E. Young* Abstract minimizez d + k We study the general (non-metric) facility-location and weighted k-medians problems, as well as the fractional cost(x) < k facility-location and k-medians problems. We describe a dist(x) S d natural randomized rounding scheme and use it to derive approximation algorithms for all of these problems. subject to ~-~/x(f,c) = 1 (Vc) For facility location and weighted k-medians, the re- =(f,c) < x(f) (vf, c) spective algorithms are polynomial-time [HAk + d]- and [(1 + e)d; In(n + n/e)k]-approximation algorithms. These x(f,c) >_ 0 (vf, c) performance guarantees improve on the best previous per- x(f) E {0,1} (vf) formance guarantees, due respectively to Hochbaum (1982) and Lin and Vitter (1992). For fractional k-medians, the al- gorithm is a new, Lagrangian-relaxation, [(1 + e)d, (1 + e)k]- Figure 1: The facility-location IP. Above d, k, x(f) and approximation algorithm. It runs in O(kln(n/e)/e 2) linear- x(f, c) are variables, dist(x), the assignment cost of x, time iterations. is ~-~Ic x(f, c)disz(f, c), and cost(x), the facility cost of For fractional facilities-location (a generalization of frac- tional weighted set cover), the algorithm is a Lagrangian- relaxation, ~(1 + e)k]-approximation algorithm. It runs in O(nln(n)/e ~) linear-time iterations and is essentially the The weighted k-medians problem is the same same as an unpublished Lagrangian-relaxation algorithm as the facility location problem except for the following: due to Garg (1998). -
Exact and Approximate Algorithms for Some Combinatorial Problems
EXACT AND APPROXIMATE ALGORITHMS FOR SOME COMBINATORIAL PROBLEMS A Dissertation Presented to the Faculty of the Graduate School of Cornell University in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy by Soroush Hosseini Alamdari May 2018 c 2018 Soroush Hosseini Alamdari ALL RIGHTS RESERVED EXACT AND APPROXIMATE ALGORITHMS FOR SOME COMBINATORIAL PROBLEMS Soroush Hosseini Alamdari, Ph.D. Cornell University 2018 Three combinatorial problems are studied and efficient algorithms are pre- sented for each of them. The first problem is concerned with lot-sizing, the second one arises in exam-scheduling, and the third lies on the intersection of the k-median and k-center clustering problems. BIOGRAPHICAL SKETCH Soroush Hosseini Alamdari was born in Malayer, a town in Hamedan province of Iran right on the outskirts of Zagros mountains. After receiving a gold medal in the Iranian National Olympiad in Informatics he went to Sharif University of Technology in Tehran to study Computer Engineering. After completing his BSc he went to the University of Waterloo and received his MMath in computer science. Then after a short period of working in industry, he came back to com- plete his PhD in computer science here at the Cornell University. iii ACKNOWLEDGEMENTS First and foremost I would like to thank my Adviser Prof. David Shmoys who accepted me as a student, taught me so many fascinating things, and supported me in whatever endeavor I took on. Without his care and attention this docu- ment would simply not be possible. I would also like to thank all my friends, colleagues and co-authors. -
Approximation Algorithms for NP-Hard Optimization Problems
Approximation algorithms for NP-hard optimization problems Philip N. Klein Neal E. Young Department of Computer Science Department of Computer Science Brown University Dartmouth College Chapter 34, Algorithms and Theory of Computation Handbook c 2010 Chapman & Hall/CRC 1 Introduction In this chapter, we discuss approximation algorithms for optimization problems. An optimization problem consists in finding the best (cheapest, heaviest, etc.) element in a large set P, called the feasible region and usually specified implicitly, where the quality of elements of the set are evaluated using a func- tion f(x), the objective function, usually something fairly simple. The element that minimizes (or maximizes) this function is said to be an optimal solution of the objective function at this element is the optimal value. optimal value = minff(x) j x 2 Pg (1) A example of an optimization problem familiar to computer scientists is that of finding a minimum-cost spanning tree of a graph with edge costs. For this problem, the feasible region P, the set over which we optimize, consists of spanning trees; recall that a spanning tree is a set of edges that connect all the vertices but forms no cycles. The value f(T ) of the objective function applied to a spanning tree T is the sum of the costs of the edges in the spanning tree. The minimum-cost spanning tree problem is familiar to computer scientists because there are several good algorithms for solving it | procedures that, for a given graph, quickly determine the minimum-cost spanning tree. No matter what graph is provided as input, the time required for each of these algorithms is guaranteed to be no more than a slowly growing function of the number of vertices n and edges m (e.g. -
Lecture Notes
Chapter 1 An introduction to approximation algorithms These lecture notes are for the course Advanced Algo- rithms (2016-2017) and are supplementary to the book `The design of approxiation algorithms' by David Shmoys and David Williamson. See the book for missing definitions. These notes only cover a part of the sections of the book. If you find an error/typo please let me know ([email protected]) and I will update de file. Contents 1 An introduction to approximation algorithms 3 1.1 Approximation Algorithms . .3 1.2 Introduction to techniques of LP . .3 1.3 A deterministic rounding algorithm . .6 1.4 Rounding a dual solution . .8 1.5 The primal-dual method . .9 1.6 A greedy algorithm . 11 1.7 A randomized rounding algorithm . 14 2 Greedy and Local search 17 2.1 Single machine scheduling . 17 2.2 The k-center problem. 18 2.3 Parallel machine scheduling. 19 2.4 The traveling salesman problem. 22 3 Rounding data and dynamic programming 26 3.1 The knapsack problem . 27 3.2 Scheduling on identical machines . 29 4 Deterministic rounding of linear programs 34 4.1 Sum of completion times on a single machine. 34 4.2 Weighted sum of completion times. 35 4.3 Using the ellipsoid method . 38 4.4 Prize-collecting Steiner Tree . 39 4.5 Uncapacitated facility location . 41 1 Chapter 1 An introduction to approximation algorithms 5 Random sampling and randomized rounding of LP's 44 5.1 Max Sat and Max Cut . 44 5.2 Derandomization. 47 5.3 Flipping biased coins . -
On the Complexity of Linear Programming
CHAPTER 6 On the complexity of linear programming Nimrod Megiddo Abstract: This is a partial survey of results on the complexity of the lin- ear programming problem since the ellipsoid method. The main topics are polynomial and strongly polynomial algorithms, probabilistic analy- sis of simplex algorithms, and recent interior point methods. 1 Introduction Our purpose here is to survey theoretical developments in linear program- ming, starting from the ellipsoid method, mainly from the viewpoint of computational comp1exity.l The survey does not attempt to be complete and naturally reflects the author's perspective, which may differ from the viewpoints of others. Linear programming is perhaps the most successful discipline of Oper- ations Research. The standard form of the linear programming problem is to maximize a linear function cTx (c,x E Rn)over all vectors x such that Ax = b and x r 0. We denote such a problem by (A,b, c).Currently, the main tool for solving the linear programming problem in practice is the class of simplex algorithms proposed and developed by Dantzig [43]. However, applications of nonlinear programming methods, inspired by Karmarkar's work [79], may also become practical tools for certain classes of linear programming problems. Complexity-based questions about linear programming and related parameters of polyhedra (see, e.g., [661) have been raised since the 1950s, before the field of computational complexity The author thanks Jetfrey Lagarias, David Shmoys, and Robert Wilson for helpful com- ments. ' The topic of linear programming has been interesting to economists not only due to its applicability to practical economic systems but also because of the many economic in- sights provided by the theory of linear programming. -
The Primal-Dual Method for Approximation Algorithms
Math. Program., Ser. B 91: 447–478 (2002) Digital Object Identifier (DOI) 10.1007/s101070100262 David P. Williamson The primal-dual method for approximation algorithms Received: June 19, 2000 / Accepted: February 7, 2001 Published online October 2, 2001 – Springer-Verlag 2001 Abstract. In this survey, we give an overview of a technique used to design and analyze algorithms that provide approximate solutions to NP-hard problems in combinatorial optimization. Because of parallels with the primal-dual method commonly used in combinatorial optimization, we call it the primal-dual method for approximation algorithms. We show how this technique can be used to derive approximation algorithms for a number of different problems, including network design problems, feedback vertex set problems, and facility location problems. 1. Introduction Many problems of interest in combinatorial optimization are considered unlikely to have efficient algorithms; most of these problems are NP-hard, and unless P = NP they do not have polynomial-time algorithms to find an optimal solution. Researchers in combinatorial optimization have considered several approaches to deal with NP-hard problems. These approaches fall into one of two classes. The first class contains al- gorithms that find the optimal solution but do not run in polynomial time. Integer programming is an example of such an approach. Integer programmers attempt to de- velop branch-and-bound (or branch-and-cut, etc.) algorithms for dealing with particular problems such that the algorithm runs quickly enough in practice for instances of in- terest, although the algorithm is not guaranteed to be efficient for all instances. The second class contains algorithms that run in polynomial time but do not find the optimal solution for all instances. -
Contents U U U
Contents u u u ACM Awards Reception and Banquet, June 2018 .................................................. 2 Introduction ......................................................................................................................... 3 A.M. Turing Award .............................................................................................................. 4 ACM Prize in Computing ................................................................................................. 5 ACM Charles P. “Chuck” Thacker Breakthrough in Computing Award ............. 6 ACM – AAAI Allen Newell Award .................................................................................. 7 Software System Award ................................................................................................... 8 Grace Murray Hopper Award ......................................................................................... 9 Paris Kanellakis Theory and Practice Award ...........................................................10 Karl V. Karlstrom Outstanding Educator Award .....................................................11 Eugene L. Lawler Award for Humanitarian Contributions within Computer Science and Informatics ..........................................................12 Distinguished Service Award .......................................................................................13 ACM Athena Lecturer Award ........................................................................................14 Outstanding Contribution -
Approximation Algorithms for Edge Partitioned Vertex Cover Problems
Approximation Algorithms for the Partition Vertex Cover Problem Suman K. Bera1, Shalmoli Gupta2, Amit Kumar3, and Sambuddha Roy1 1 IBM India Research Lab, New Delhi 2 University of Illinois at Urbana-Champaign 3 Indian Institute of Technology Delhi Abstract. We consider a natural generalization of the Partial Vertex Cover problem. Here an instance consists of a graph G = (V,E), a cost + function c : V → Z , a partition P1,...,Pr of the edge set E, and a parameter ki for each partition Pi. The goal is to find a minimum cost set of vertices which cover at least ki edges from the partition Pi. We call this the Partition-VC problem. In this paper, we give matching upper and lower bound on the approximability of this problem. Our algorithm is based on a novel LP relaxation for this problem. This LP relaxation is obtained by adding knapsack cover inequalities to a natural LP relaxation of the problem. We show that this LP has integrality gap of O(log r), where r is the number of sets in the partition of the edge set. We also extend our result to more general settings. 1 Introduction The Vertex Cover problem is one of the most fundamental NP-hard problems and has been widely studied in the context of approximation algorithms [21, 10]. In this problem, we are given an undirected graph G = (V, E) and a cost function c : V → Z+. The goal is to find a minimum cost set of vertices which cover all the edges in E : a set of vertices S covers an edge e if S contains at least one of the end-points of e. -
Approximation Algorithms for Demand-Robust Covering Problems∗
How to Pay, Come What May: Approximation Algorithms for Demand-Robust Covering Problems∗ Kedar Dhamdhere† Vineet Goyal R. Ravi Google Inc. Tepper School of Business Tepper School of Business Mountain View, CA 94043 Carnegie Mellon University Carnegie Mellon University [email protected] Pittsburgh, PA 15213 Pittsburgh, PA 15213 [email protected] [email protected] Mohit Singh Tepper School of Business Carnegie Mellon University Pittsburgh, PA 15213 [email protected] Abstract 1 Introduction Robust optimization has traditionally focused on uncer- Robust optimization has roots in both Decision The- tainty in data and costs in optimization problems to formu- ory [14, 16] as well as Mathematical Programming [4]. late models whose solutions will be optimal in the worst- While minmax regret approaches were advanced in the for- case among the various uncertain scenarios in the model. mer field as conservative decision rules, robust optimization While these approaches may be thought of defining data- or was discussed along with stochastic programming [3] as an cost-robust problems, we formulate a new “demand-robust” alternate way of tackling data uncertainty. model motivated by recent work on two-stage stochastic op- More recent attempts at capturing the concept of ro- timization problems. We propose this in the framework of bust solutions in optimization problems include the work of general covering problems and prove a general structural Rosenblatt and Lee [21] in facility design problem, Mulvey lemma about special types of first-stage solutions for such et al. [17] in mathematical programming, and most recently, problems: there exists a first-stage solution that is a mini- Kouvelis and Yu [12] in combinatorial optimization; here mal feasible solution for the union of the demands for some robust means “good in all or most versions”, a version be- subset of the scenarios and its objective function value is ing a plausible set of values for the data in the model.