Arxiv:Cs/0205036V1 [Cs.DS] 18 May 2002 Introduction 1 Games
Total Page:16
File Type:pdf, Size:1020Kb
Randomized Rounding without Solving the Linear Program ((c) Sixth ACM-SIAM Symposium on Discrete Algorithms (SODA95)) Neal E. Young∗ Abstract achieve the independence. We introduce a new technique called oblivious rounding — Generalized Packing and Covering: The re- a variant of randomized rounding that avoids the bottleneck sulting algorithms find the approximate solution with- of first solving the linear program. Avoiding this bottle- out first computing the optimal solution. This allows neck yields more efficient algorithms and brings probabilistic randomized rounding to give simpler and more efficient methods to bear on a new class of problems. We give obliv- algorithms and makes it applicable for integer and non- ious rounding algorithms that approximately solve general integer linear programming. To demonstrate this, we packing and covering problems, including a parallel algo- give approximation algorithms for general packing and rithm to find sparse strategies for matrix games. covering problems corresponding to integer and non- integer linear programs of small width, including a paral- 1 Introduction lel algorithm for finding sparse, near-optimal strategies for zero-sum games. Randomized Rounding: Randomized rounding Packing and covering problems have been exten- [18] is a probabilistic method [20, 1] for the design of sively studied (see 2). For example, Plotkin, Shmoys, approximation algorithms. Typically, one formulates and Tardos [16]§ approached these problems using an NP-hard problem as an integer linear program, dis- Lagrangian-relaxation techniques directly. Their algo- regards the integrality constraints, solves the resulting rithms and ours share the following features: (1) they linear program, and randomly rounds each coordinate depend similarly on the width, (2) they are Lagrangian- of the solution up or down with probability depending relaxation algorithms, (3) they allow the packing or cov- on the fractional part. One shows that, with non-zero ering set to be given by a (possibly approximate) sub- probability, the rounded solution approximates the op- routine for optimizing over it, (4) they produce dual timal solution. This yields a randomized algorithm; in solutions that prove near-optimality, and (5) they can most cases it can be derandomized by the method of provide integer solutions comparable to those obtain- conditional probabilities [17]. The probabilistic analy- able by randomized rounding. Our approach shows a ses are often simple, relying on just a few basic tech- strong connection between probabilistic techniques and arXiv:cs/0205036v1 [cs.DS] 18 May 2002 niques. Yet for many NP-hard problems, randomized Lagrangian relaxation. Our algorithms are also rela- rounding yields the best approximation known by any tively simple, although they are not as effective for some polynomial time algorithm [3]. problems of large width. Oblivious Rounding: Derandomized or not, a Flavor of Oblivious Rounding Algorithms: main drawback of randomized rounding algorithms has For the (integer) set cover problem, oblivious rounding been that they first solve a linear program to find a solu- yields the greedy set cover algorithm [10, 14]. For the tion to round. We show that this bottleneck can some- fractional set cover problem, it yields an algorithm that times be avoided as follows: (1) show that randomly repeatedly chooses a set whose elements have the largest rounding an optimal solution (possibly to smaller-than- net weight, where the weight of an element is initially 1 integer units) yields an approximate solution; (2) ap- and is multiplied by 1 ǫ each time a set containing it ply the method of conditional probabilities, finding pes- is chosen. To obtain the− final cover, each set is assigned simistic estimators [17] that are essentially independent a weight proportional to the number of times it was of the optimal solution. The method of conditional chosen (this is similar in spirit to [4] and related works). probabilities is used not to derandomize per se, but to For multicommodity flow, it yields algorithms that repeatedly augment flow along a shortest path, where ∗AT&T Bell Labs, rm. 2D-145, 600 Mountain Ave., Mur- the length of an edge is initially 1 and is multiplied by ray Hill, NJ 07974. Part of this research was done while at 1+ǫc/c(e) each time the edge is used (c(e) is the capacity School of ORIE, Cornell University, Ithaca NY 14853 and sup- ported by Eva´ Tardos’ NSF PYI grant DDM-9157199. E-mail: of the edge and c is the minimum edge capacity). [email protected]. 1 2 Young ω2 ln(m) Problem Definitions: Let P be a convex set in generalized packing: IRn and let f be a linear function (not nec. homogenous) 2ǫ2 m from P to IR . The width of P with respect to f is (1 + ǫ)ω ln(m) packing: ω = maxj,x fj(x) L, where L = minj,x fj (x). λ∗b(ǫ) The generalized− packing problem is to compute λ∗ = ω ln(m) minx∈P maxj fj(x). The packing problem occurs when covering: f is non-negative on P . The covering problem is to λ∗b( ǫ) ∗ − compute λ = maxx∈P minj fj (x), assuming f is non- b(ǫ) := (1 + ǫ) ln(1 + ǫ) ǫ; 2 −2 negative. (This is equivalent to the generalized packing b( ǫ) > ǫ >b(ǫ) > 2ǫ . problem with the restriction that f is non-positive.) − 2 4.2+ǫ Our algorithms assume an optimization oracle for P and f — given non-negative y R , the oracle Table 1: Number of iterations. Each iteration requires ∈ m returns x and f(x), where x minimizes j yjfj (x). O(log m) time and O(m) operations (on an EREW- (This models, e.g., packing source-sink pathsP subject to PRAM), plus one oracle call. For an explicitly given edge constraints; in this case the oracle would compute problem (no oracle), each iteration requires O(log nm) a shortest path for given non-negative edge lengths.) time and O(nm) operations. For covering, the oracle must maximize the sum. Quality of Solutions: Given the oracle, n, m, ω, L, and ǫ > 0, our algorithms return ǫ-approximate Each iteration chooses the best pure strategy given solutions. For generalized packing, ǫ is the additive that the opponent plays the mixed strategy represented ∗ by y. The final solution returned is a mixed strategy error with respect to λ . For packing and covering, the 2 ω ln m error is a factor of 1 ǫ. that plays uniformly from 2ǫ2 pure strategies, one Complexity: Table± 1 shows the number of itera- for each iteration. (The opponent has m pure strategies; tions required and the complexity per iteration. In that ω is the maximum minus the minimum payoff.) The caption, “explicitly given” means that f(x) = Ax + b, existence of such sparse, near-optimal strategies was where A and b are, respectively, an explicitly given ma- shown probabilistically [2, 13]; our existence proof of trix and vector, while P = x IRn : x 0; x =1 . the approximate solution for generalized packing is a { ∈ ≥ i } Granularity: The oracle is called onceP in each generalization of the proof in [13]. iteration of the algorithm; the algorithm returns the average of the solutions returned by the oracle. Thus, 2 Related Work the granularity of the final solution is the granularity Plotkin, Shmoys, and Tardos [16] (generalizing a series of the solutions returned by the oracle, divided by the of works on multicommodity flow [19, 11, 12]) gave ap- number of iterations. For the abstract problems we proximation algorithms for general packing and covering consider, this can provide integer solutions comparable problems similar to those we consider. For these ab- to those obtainable by other techniques. stract problems, their results are comparable to those Dual Solutions: Our algorithms maintain a dual in this paper, but for many problems their results are solution, represented by a vector y, initially uniform. stronger. Most importantly, they give techniques for re- In each iteration, each yj is multiplied by a factor ducing the effective width of a linear program and tech- depending on fj (x) where x is the solution returned niques for problems (such as concurrent multicommod- by the oracle (e.g., for packing, yj is multiplied by ity flow) when the packing or covering set is a Cartesian 1+ ǫfj(x)/ω). The average over all iterations of the product. values of these dual solutions is ǫ-optimal with respect Luby and Nisan [15] give a parallel approximation to the value of the final (primal) solution. algorithm for positive linear programming — the special Sparse Strategies for Zero-Sum Games: The cases of linear programming of the form maxx c x : explicitly given general packing problem generalizes the Ax b; x 0 (a packing problem), or the{ · dual ≤ ≥ T } problem of finding near-optimal strategies for zero-sum miny b y : A y c; y 0 (a covering problem), matrix games: P is the set of mixed strategies for one where{ A·, b, and c have≥ non-negative≥ } coefficients. Here player, fj(x) is the expected payoff if the player plays A, b, and c are explicitly given. according to x and the opponent plays the pure strategy Previous algorithms applicable to zero-sum games j, and λ∗ is the value of the game. An approximate either required the solution of a linear program [8] or solution is a mixed strategy x guaranteeing an expected did not provide sparse strategies [5, 6, 15]. payoff within an additive ǫ of optimal. Randomized Rounding without Solving the Linear Program 3 3 Introductory Example: Set Cover Achieving Obliviousness: Because an uncovered ∗ To introduce oblivious rounding, we give a simple element that occurs in several sets in C contributes less example. The set cover problem is the following: to Φ, the above algorithm depends on the number of times each element is covered by C∗.