Computational Integer Programming Lecture 8: Branch and Bound

Total Page:16

File Type:pdf, Size:1020Kb

Computational Integer Programming Lecture 8: Branch and Bound Computational Integer Programming Lecture 8: Branch and Bound Dr. Ted Ralphs Computational MILP Lecture 8 1 Reading for This Lecture Nemhauser and Wolsey Sections II.3.1, II.3.6, II.4.1, II.4.2, II.5.4 • Wolsey Chapter 7 • 1 Computational MILP Lecture 8 2 Computational Integer Optimization We now turn to the details of how integer optimization problems are • solved in practice. Computationally, the most important aspects of solving integer • optimization problems are { A method for obtaining good bounds on the value of the optimal solution (usually by solving a relaxation or dual; and { A method for generating valid disjunctions violated by a given (infeasible) solution. In this lecture, we will motivate this fact by introducing the branch and • bound algorithm. We will then look at various methods of obtaining bounds. • Later, we will examine branch and bound in more detail. • 2 Computational MILP Lecture 8 3 Integer Optimization and Disjunction As we know, the difficulty in solving an integer optimization problem • arises from the requirement that certain variables take on integer values. Such requirements can be described in terms of logical disjunctions, • constraints of the form [ x Xi 2 1≤i≤k n for Xi R ; i 1; : : : ; k. ⊆ 2 The integer variables in a given formulation may represent logical • conditions that were originally expressed in terms of disjunction. In fact, the MILP Representability Theorem tells us that any MILP can • be re-formulated as an optimization problem whose feasible region is k [ 1 t = i + intcone r ; : : : ; r F P f g i=1 is the disjunctive set defined above, for some appropriately chosen F 1 t n polytopes 1;:::; k and vectors r ; : : : ; r Z . P P 2 3 Computational MILP Lecture 8 4 Two Conceptual Reformulations From what we have seen so far, we have to two conceptual reformulations • of a given integer optimization problem. The first is in terms of disjunction: • ( k !) > [ 1 t max c x x i + intcone r ; : : : ; r (DIS) j 2 P f g i=1 The second is in terms of valid inequalities: • max c>x x conv( ) (CP) j 2 S where is the feasible region. S In principle, if we had a method for generating either of these • reformulations, this would lead to a practical method of solution. Unfortunately, these reformulations are necessarily of exponential size in • general, so there can be no way of generating them efficiently. 4 Computational MILP Lecture 8 5 Valid Disjunctions In practice, we dynamically generate parts of the reformulations (CP) and • (DIS) in order to obtain a proof of optimality for a particular instance. The concept of valid disjunction, arises from a desire to approximate the • feasible region of (DIS). k n Definition 1. Let Xi i=1 be a collection of subset of R . Then if S f g k 1≤i≤k Xi , the disjunction associated with Xi i=1 is said to be valid for an⊇ MILP S with feasible set . f g S k Definition 2. If Xi i=1 is a disjunction valid for and Xi is polyhedral for all i 1; : : : ;f k ,g then we say the disjunction isS linear. 2 f g k Definition 3. If Xi i=1 is a disjunction valid for and Xi Xj = for all i; j 1; : : :f ; k g, we say the disjunction is partitiveS . \ ; 2 f g k Definition 4. If Xi i=1 is a disjunction valid for that is both linear and partitive, we callf itg admissible. S 5 Computational MILP Lecture 8 6 Valid Inequalities Likewise, we can think of the concept of a valid inequality as arising from • our desire to approximate conv( ) (the feasible region of (CP)). S The inequality denoted by (π; π0) is called a valid inequality for if • π>x π x . S ≤ 0 8 2 S n > Note (π; π0) is a valid inequality if and only if x R π x π0 . • S ⊆ f 2 j ≤ g 6 Computational MILP Lecture 8 7 Optimality Conditions p Let us now consider an MILP (A; b; c; p) with feasible set = (Z+ • n−p S P\ × R ), where is the given formulation. + P k Further, let Xi i=1 be a linear disjunction valid for this MILP so that • nf g Xi R is polyhedral. \ P ⊆ > Then maxX \S c x is an MILP for all i 1; : : : ; k. • i 2 For each i = 1; : : : ; k, let i be a polyhedron such that Xi i • P \ S ⊆ P ⊆ Xi. P\ In other words, i is a valid formulation for subproblem i, possibly • strengthened by additionalP valid inequalities. k Note that i is itself a valid linear disjunction. • fP gi=1 We will see why there is a distinction between Xi and i later on. • P Conceptually, we are combining and relaxing the formulations (CP) and • (DIS). 7 Computational MILP Lecture 8 8 Optimality Conditions (cont'd) From the disjunction on the previous slide, we obtain a relaxation of a • general MILP. This relaxation yields a practical set of optimality conditions. • In particular, • > (1) max max n c x zIP ; i21;:::;k x2Pi\R+ ≥ which implies that if we have x∗ such that 2 S > > ∗ (OPT) max max n c x = c x ; i21;:::;k x2Pi\R+ then x∗ must be optimal. 8 Computational MILP Lecture 8 9 More on Optimality Conditions Although it is not obvious, these optimality conditions can be seen as a • generalization of those from LP. They are also the optimality conditions implicitly underlying many • advanced algorithms. There is an associated duality theory that we will see later. • By parameterizing (1), we obtain a \dual function" that is the solution • to a dual that generalizes the LP dual. 9 Computational MILP Lecture 8 10 Branch and Bound Branch and bound is the most commonly-used algorithm for solving • MILPs. It is a recursive, divide-and-conquer approach. • Suppose is the feasible set for an MILP and we wish to compute • S> maxx2S c x. Consider a partition of into subsets ;::: k. Then • S S1 S max c>x = max max c>x x2S f1≤i≤kgfx2Si g . In other words, we can optimize over each subset separately. • Idea: If we can't solve the original problem directly, we might be able to • solve the smaller subproblems recursively. Dividing the original problem into subproblems is called branching. • Taken to the extreme, this scheme is equivalent to complete enumeration. • 10 Computational MILP Lecture 8 11 Branching in Branch and Bound k Branching is achieved by selecting an admissible disjunction Xi and • f gi=1 using it to partition , e.g., i = Xi. S S S\ We only consider linear disjunctions so that the subproblem remain • MILPs after branching. The reason for choosing partitive disjunctions is self-evident. • The way this disjunction is selected is called the branching method and • is a topic we will examine in some depth. ∗ ∗ Generally speaking, we want x 1≤i≤kXi, where x is the (infeasible) • solution produced by solving the62 [bounding problem associated with a given subproblem. A typical disjunction is • ∗ X = xj x ; (2) 1 f ≤ b j cg ∗ X = xj x ; (3) 2 f ≥ d j eg where x∗ argmax c>x. 2 x2P 11 Computational MILP Lecture 8 12 Bounding in Branch and Bound The bounding problem is a problem solved to obtain a bound on the • > optimal solution value of a subproblem maxSi c x. Typically, the bounding problem is either a relaxation or a dual of the • subproblem (these concepts will be defined formally in Lecture 7). Solving the bounding problem serves two purposes. • { In some cases, the solution x∗ to the relaxation may actually be a feasible solution (x∗ , in which case c>x∗ is a global lower bound l( ). 2 S S { Bounding enables us to inexpensively a bound b( i) on the optimal solution value of subproblem i. S If b( i) l( ), then i can't contain a solution strictly better than the • bestS one≤ foundS so far.S Thus, we may discard or prune subproblem i. • 12 Computational MILP Lecture 8 13 Constructing a Bounding Problem There are many ways to construct a bounding problem and this will be • the topic of later lectures. The easiest of the these is to form the LP relaxation max n , P\R+\Xi • obtained by dropping the integrality constraints. For the rest of the lecture, assume all variables have finite upper and • lower bounds. 13 Computational MILP Lecture 8 14 LP-based Branch and Bound: Initial Subproblem In LP-based branch and bound, we first solve the LP relaxation of the • original problem. The result is one of the following: 1. The LP is infeasible MILP is infeasible. 2. We obtain a feasible) solution for the MILP optimal solution. 3. We obtain an optimal solution to the LP that) is not feasible for the MILP upper bound. ) In the first two cases, we are finished. • In the third case, we must branch and recursively solve the resulting • subproblems. 14 Computational MILP Lecture 8 15 Branching in LP-based Branch and Bound In LP-based branch and bound, the most commonly used disjunctions • are the variable disjunctions, imposed as follows: { Select a variable i whose value x^i is fractional in the LP solution. { Create two subproblems. In one subproblem, impose the constraint xi x^i . ∗ ≤ b c In the other subproblem, impose the constraint xi x^i . ∗ ≥ d e What does it mean in a 0-1 problem? • 15 Computational MILP Lecture 8 16 The Geometry of Branching Figure 1: The original feasible region 16 Computational MILP Lecture 8 17 The Geometry of Branching (cont'd) Figure 2: Branching on disjunction x 2 OR x 3 1 ≤ 1 ≥ 17 Computational MILP Lecture 8 18 Continuing the Algorithm After Branching After branching, we solve each of the subproblems recursively.
Recommended publications
  • A Branch-And-Price Approach with Milp Formulation to Modularity Density Maximization on Graphs
    A BRANCH-AND-PRICE APPROACH WITH MILP FORMULATION TO MODULARITY DENSITY MAXIMIZATION ON GRAPHS KEISUKE SATO Signalling and Transport Information Technology Division, Railway Technical Research Institute. 2-8-38 Hikari-cho, Kokubunji-shi, Tokyo 185-8540, Japan YOICHI IZUNAGA Information Systems Research Division, The Institute of Behavioral Sciences. 2-9 Ichigayahonmura-cho, Shinjyuku-ku, Tokyo 162-0845, Japan Abstract. For clustering of an undirected graph, this paper presents an exact algorithm for the maximization of modularity density, a more complicated criterion to overcome drawbacks of the well-known modularity. The problem can be interpreted as the set-partitioning problem, which reminds us of its integer linear programming (ILP) formulation. We provide a branch-and-price framework for solving this ILP, or column generation combined with branch-and-bound. Above all, we formulate the column gen- eration subproblem to be solved repeatedly as a simpler mixed integer linear programming (MILP) problem. Acceleration tech- niques called the set-packing relaxation and the multiple-cutting- planes-at-a-time combined with the MILP formulation enable us to optimize the modularity density for famous test instances in- cluding ones with over 100 vertices in around four minutes by a PC. Our solution method is deterministic and the computation time is not affected by any stochastic behavior. For one of them, column generation at the root node of the branch-and-bound tree arXiv:1705.02961v3 [cs.SI] 27 Jun 2017 provides a fractional upper bound solution and our algorithm finds an integral optimal solution after branching. E-mail addresses: (Keisuke Sato) [email protected], (Yoichi Izunaga) [email protected].
    [Show full text]
  • Linear Programming Notes X: Integer Programming
    Linear Programming Notes X: Integer Programming 1 Introduction By now you are familiar with the standard linear programming problem. The assumption that choice variables are infinitely divisible (can be any real number) is unrealistic in many settings. When we asked how many chairs and tables should the profit-maximizing carpenter make, it did not make sense to come up with an answer like “three and one half chairs.” Maybe the carpenter is talented enough to make half a chair (using half the resources needed to make the entire chair), but probably she wouldn’t be able to sell half a chair for half the price of a whole chair. So, sometimes it makes sense to add to a problem the additional constraint that some (or all) of the variables must take on integer values. This leads to the basic formulation. Given c = (c1, . , cn), b = (b1, . , bm), A a matrix with m rows and n columns (and entry aij in row i and column j), and I a subset of {1, . , n}, find x = (x1, . , xn) max c · x subject to Ax ≤ b, x ≥ 0, xj is an integer whenever j ∈ I. (1) What is new? The set I and the constraint that xj is an integer when j ∈ I. Everything else is like a standard linear programming problem. I is the set of components of x that must take on integer values. If I is empty, then the integer programming problem is a linear programming problem. If I is not empty but does not include all of {1, . , n}, then sometimes the problem is called a mixed integer programming problem.
    [Show full text]
  • Integer Linear Programming
    Introduction Linear Programming Integer Programming Integer Linear Programming Subhas C. Nandy ([email protected]) Advanced Computing and Microelectronics Unit Indian Statistical Institute Kolkata 700108, India. Introduction Linear Programming Integer Programming Organization 1 Introduction 2 Linear Programming 3 Integer Programming Introduction Linear Programming Integer Programming Linear Programming A technique for optimizing a linear objective function, subject to a set of linear equality and linear inequality constraints. Mathematically, maximize c1x1 + c2x2 + ::: + cnxn Subject to: a11x1 + a12x2 + ::: + a1nxn b1 ≤ a21x1 + a22x2 + ::: + a2nxn b2 : ≤ : am1x1 + am2x2 + ::: + amnxn bm ≤ xi 0 for all i = 1; 2;:::; n. ≥ Introduction Linear Programming Integer Programming Linear Programming In matrix notation, maximize C T X Subject to: AX B X ≤0 where C is a n≥ 1 vector |- cost vector, A is a m× n matrix |- coefficient matrix, B is a m × 1 vector |- requirement vector, and X is an n× 1 vector of unknowns. × He developed it during World War II as a way to plan expenditures and returns so as to reduce costs to the army and increase losses incurred by the enemy. The method was kept secret until 1947 when George B. Dantzig published the simplex method and John von Neumann developed the theory of duality as a linear optimization solution. Dantzig's original example was to find the best assignment of 70 people to 70 jobs subject to constraints. The computing power required to test all the permutations to select the best assignment is vast. However, the theory behind linear programming drastically reduces the number of feasible solutions that must be checked for optimality.
    [Show full text]
  • IEOR 269, Spring 2010 Integer Programming and Combinatorial Optimization
    IEOR 269, Spring 2010 Integer Programming and Combinatorial Optimization Professor Dorit S. Hochbaum Contents 1 Introduction 1 2 Formulation of some ILP 2 2.1 0-1 knapsack problem . 2 2.2 Assignment problem . 2 3 Non-linear Objective functions 4 3.1 Production problem with set-up costs . 4 3.2 Piecewise linear cost function . 5 3.3 Piecewise linear convex cost function . 6 3.4 Disjunctive constraints . 7 4 Some famous combinatorial problems 7 4.1 Max clique problem . 7 4.2 SAT (satisfiability) . 7 4.3 Vertex cover problem . 7 5 General optimization 8 6 Neighborhood 8 6.1 Exact neighborhood . 8 7 Complexity of algorithms 9 7.1 Finding the maximum element . 9 7.2 0-1 knapsack . 9 7.3 Linear systems . 10 7.4 Linear Programming . 11 8 Some interesting IP formulations 12 8.1 The fixed cost plant location problem . 12 8.2 Minimum/maximum spanning tree (MST) . 12 9 The Minimum Spanning Tree (MST) Problem 13 i IEOR269 notes, Prof. Hochbaum, 2010 ii 10 General Matching Problem 14 10.1 Maximum Matching Problem in Bipartite Graphs . 14 10.2 Maximum Matching Problem in Non-Bipartite Graphs . 15 10.3 Constraint Matrix Analysis for Matching Problems . 16 11 Traveling Salesperson Problem (TSP) 17 11.1 IP Formulation for TSP . 17 12 Discussion of LP-Formulation for MST 18 13 Branch-and-Bound 20 13.1 The Branch-and-Bound technique . 20 13.2 Other Branch-and-Bound techniques . 22 14 Basic graph definitions 23 15 Complexity analysis 24 15.1 Measuring quality of an algorithm .
    [Show full text]
  • A Branch-And-Bound Algorithm for Zero-One Mixed Integer
    A BRANCH-AND-BOUND ALGORITHM FOR ZERO- ONE MIXED INTEGER PROGRAMMING PROBLEMS Ronald E. Davis Stanford University, Stanford, California David A. Kendrick University of Texas, Austin, Texas and Martin Weitzman Yale University, New Haven, Connecticut (Received August 7, 1969) This paper presents the results of experimentation on the development of an efficient branch-and-bound algorithm for the solution of zero-one linear mixed integer programming problems. An implicit enumeration is em- ployed using bounds that are obtained from the fractional variables in the associated linear programming problem. The principal mathematical result used in obtaining these bounds is the piecewise linear convexity of the criterion function with respect to changes of a single variable in the interval [0, 11. A comparison with the computational experience obtained with several other algorithms on a number of problems is included. MANY IMPORTANT practical problems of optimization in manage- ment, economics, and engineering can be posed as so-called 'zero- one mixed integer problems,' i.e., as linear programming problems in which a subset of the variables is constrained to take on only the values zero or one. When indivisibilities, economies of scale, or combinatoric constraints are present, formulation in the mixed-integer mode seems natural. Such problems arise frequently in the contexts of industrial scheduling, investment planning, and regional location, but they are by no means limited to these areas. Unfortunately, at the present time the performance of most compre- hensive algorithms on this class of problems has been disappointing. This study was undertaken in hopes of devising a more satisfactory approach. In this effort we have drawn on the computational experience of, and the concepts employed in, the LAND AND DoIGE161 Healy,[13] and DRIEBEEKt' I algorithms.
    [Show full text]
  • Matroid Partitioning Algorithm Described in the Paper Here with Ray’S Interest in Doing Ev- Erything Possible by Using Network flow Methods
    Chapter 7 Matroid Partition Jack Edmonds Introduction by Jack Edmonds This article, “Matroid Partition”, which first appeared in the book edited by George Dantzig and Pete Veinott, is important to me for many reasons: First for per- sonal memories of my mentors, Alan J. Goldman, George Dantzig, and Al Tucker. Second, for memories of close friends, as well as mentors, Al Lehman, Ray Fulker- son, and Alan Hoffman. Third, for memories of Pete Veinott, who, many years after he invited and published the present paper, became a closest friend. And, finally, for memories of how my mixed-blessing obsession with good characterizations and good algorithms developed. Alan Goldman was my boss at the National Bureau of Standards in Washington, D.C., now the National Institutes of Science and Technology, in the suburbs. He meticulously vetted all of my math including this paper, and I would not have been a math researcher at all if he had not encouraged it when I was a university drop-out trying to support a baby and stay-at-home teenage wife. His mentor at Princeton, Al Tucker, through him of course, invited me with my child and wife to be one of the three junior participants in a 1963 Summer of Combinatorics at the Rand Corporation in California, across the road from Muscle Beach. The Bureau chiefs would not approve this so I quit my job at the Bureau so that I could attend. At the end of the summer Alan hired me back with a big raise. Dantzig was and still is the only historically towering person I have known.
    [Show full text]
  • Introduction to Approximation Algorithms
    CSC 373 - Algorithm Design, Analysis, and Complexity Summer 2016 Lalla Mouatadid Introduction to Approximation Algorithms The focus of these last two weeks of class will be on how to deal with NP-hard problems. If we don't know how to solve them, what would be the first intuitive way to tackle them? One well studied method is approximation algorithms; algorithms that run in polynomial time that can approximate the solution within a constant factor of the optimal solution. How well can we approximate these solutions? And can we approximate all NP-hard problems? Before we try to answer any of these questions, let's formally define what we mean by approximating a solution. Notice first that if we're considering how \good" a solution is, then we must be dealing with opti- mization problems, instead of decision problems. Recall that when dealing with an optimization problem, the goal is minimize or maximize some objective function. For instance, maximizing the size of an indepen- dent set or minimizing the size of a vertex cover. Since these problems are NP-hard, we focus on polynomial time algorithms that give us an approximate solution. More formally: Let P be an optimization problem.For every input x of P , let OP T (x) denote the optimal value of the solution for x. Let A be an algorithm and c a constant such that c ≥ 1. 1. Suppose P is a minimization problem. We say that A is a c-approximation for P if for every input x of P : OP T (x) ≤ A(x) ≤ c · OP T (x) 2.
    [Show full text]
  • Generic Branch-Cut-And-Price
    Generic Branch-Cut-and-Price Diplomarbeit bei PD Dr. M. L¨ubbecke vorgelegt von Gerald Gamrath 1 Fachbereich Mathematik der Technischen Universit¨atBerlin Berlin, 16. M¨arz2010 1Konrad-Zuse-Zentrum f¨urInformationstechnik Berlin, [email protected] 2 Contents Acknowledgments iii 1 Introduction 1 1.1 Definitions . .3 1.2 A Brief History of Branch-and-Price . .6 2 Dantzig-Wolfe Decomposition for MIPs 9 2.1 The Convexification Approach . 11 2.2 The Discretization Approach . 13 2.3 Quality of the Relaxation . 21 3 Extending SCIP to a Generic Branch-Cut-and-Price Solver 25 3.1 SCIP|a MIP Solver . 25 3.2 GCG|a Generic Branch-Cut-and-Price Solver . 27 3.3 Computational Environment . 35 4 Solving the Master Problem 39 4.1 Basics in Column Generation . 39 4.1.1 Reduced Cost Pricing . 42 4.1.2 Farkas Pricing . 43 4.1.3 Finiteness and Correctness . 44 4.2 Solving the Dantzig-Wolfe Master Problem . 45 4.3 Implementation Details . 48 4.3.1 Farkas Pricing . 49 4.3.2 Reduced Cost Pricing . 52 4.3.3 Making Use of Bounds . 54 4.4 Computational Results . 58 4.4.1 Farkas Pricing . 59 4.4.2 Reduced Cost Pricing . 65 5 Branching 71 5.1 Branching on Original Variables . 73 5.2 Branching on Variables of the Extended Problem . 77 5.3 Branching on Aggregated Variables . 78 5.4 Ryan and Foster Branching . 79 i ii Contents 5.5 Other Branching Rules . 82 5.6 Implementation Details . 85 5.6.1 Branching on Original Variables . 87 5.6.2 Ryan and Foster Branching .
    [Show full text]
  • Lecture 11: Integer Programming and Branch and Bound 1.12.2010 Lecturer: Prof
    Optimization Methods in Finance (EPFL, Fall 2010) Lecture 11: Integer programming and Branch and Bound 1.12.2010 Lecturer: Prof. Friedrich Eisenbrand Scribe: Boris Oumow 1 Integer Programming Definition 1. An integer program (IP) is a problem of the form: maxcT x s.t. Ax b x 2 Zn If we drop the last constraint x 2 Zn, the linear program obtained is called the LP-relaxation of (IP). Example 2 (Combinatorial auctions). A combinatorial auction is a type of smart market in which participants can place bids on combinations of discrete items, or “packages”, rather than just in- dividual items or continuous quantities. In many auctions, the value that a bidder has for a set of items may not be the sum of the values that he has for individual items. It may be more or it may be less. In other words, let M = f1;:::;mg be the set of items that the auctioneer has to sell. A bid is a pair B j = (S j; p j) where S j M is a nonempty subset of the items and p j is the price for this set. We suppose that the auctioneer has received n items B j, j = 1;:::;n. Question: How should the auctioneer determine the winners and the loosers of bidding in order to maximize his revenue? In lecture 10, we have seen a numerical example of this problem. Let’s see now its generaliza- tion. The (IP) for this problem is: n max∑ j=1 p jx j s.t. Ax 1 0 x 1 x 2 Zn where A 2 f0;1gm¢n is the matrix defined by ( 1 if i 2 S j Ai j = 0 otherwise 1 L.A Pittsburgh Boston Houston West 60 120 180 180 Midwest 48 24 60 60 East 216 180 72 180 South 126 90 108 54 Table 1: Lost interest in thousand of $ per year.
    [Show full text]
  • An Efficient Solution Methodology for Mixed-Integer Programming Problems Arising in Power Systems" (2016)
    University of Connecticut OpenCommons@UConn Doctoral Dissertations University of Connecticut Graduate School 12-15-2016 An Efficient Solution Methodology for Mixed- Integer Programming Problems Arising in Power Systems Mikhail Bragin University of Connecticut - Storrs, [email protected] Follow this and additional works at: https://opencommons.uconn.edu/dissertations Recommended Citation Bragin, Mikhail, "An Efficient Solution Methodology for Mixed-Integer Programming Problems Arising in Power Systems" (2016). Doctoral Dissertations. 1318. https://opencommons.uconn.edu/dissertations/1318 An Efficient Solution Methodology for Mixed-Integer Programming Problems Arising in Power Systems Mikhail Bragin, PhD University of Connecticut, 2016 For many important mixed-integer programming (MIP) problems, the goal is to obtain near- optimal solutions with quantifiable quality in a computationally efficient manner (within, e.g., 5, 10 or 20 minutes). A traditional method to solve such problems has been Lagrangian relaxation, but the method suffers from zigzagging of multipliers and slow convergence. When solving mixed-integer linear programming (MILP) problems, the recently adopted branch-and-cut may also suffer from slow convergence because when the convex hull of the problems has complicated facial structures, facet- defining cuts are typically difficult to obtain, and the method relies mostly on time-consuming branching operations. In this thesis, the novel Surrogate Lagrangian Relaxation method is developed and its convergence is proved to the optimal multipliers, without the knowledge of the optimal dual value and without fully optimizing the relaxed problem. Moreover, for practical implementations a stepsizing formula, that guarantees convergence without requiring the optimal dual value, has been constructively developed. The key idea is to select stepsizes in a way that distances between Lagrange multipliers at consecutive iterations decrease, and as a result, Lagrange multipliers converge to a unique limit.
    [Show full text]
  • Matroid Intersection and Its Application to a Multiple Depot, Multiple TSP
    Institute of Transportation Studies University of California at Berkeley Matroid Intersection and its application to a Multiple Depot, Multiple TSP Sivakumar Rathinam and Raja Sengupta RESEARCH REPORT UCB-ITS-RR-2006-3 May 2006 ISSN 0192 4095 1 Matroid Intersection and its application to a Multiple Depot, Multiple TSP Sivakumar Rathinam1, Raja Sengupta2 Abstract This paper extends the Held-Karp’s lower bound available for a single Travelling Salesman Problem to the following symmetric Multiple Depot, Multiple Travelling Salesman Problem (MDMTSP): Given k salesman that start at different depots, k terminals and n destinations, the problem is to choose paths for each of the salesmen so that (1) each vehicle starts at its respective depot, visits atleast one destination and reaches any one of the terminals not visited by other vehicles, (2) each destination is visited by exactly one vehicle and (3) the cost of the paths is a minimum among all possible paths for the salesmen. The criteria for the cost of paths considered is the total cost of the edges travelled by the entire collection. This MDMTSP is formulated as a minimum cost constrained forest problem subject to side constraints. By perturbing the costs of each edge from Cij to Cij := Cij +πi +πj, one obtains an infinite family of lower bounds, denoted by w(π), for the MDMTSP. Each lower bound, w(π), involves calculating a minimum cost constrained forest. The minimum cost constrained forest problem is posed as a weighted two matroid intersection problem and hence can be solved in polynomial time. Since the polyhedra corresponding to the matroid intersection problem has the integrality property, it follows that the optimal cost corresponding to the LP relaxation of the MDMTSP is actually equal to maxπ w(π).
    [Show full text]
  • Matrices of Optimal Tree-Depth and Row-Invariant Parameterized Algorithm for Integer Programming Timothy F
    Matrices of Optimal Tree-Depth and Row-Invariant Parameterized Algorithm for Integer Programming Timothy F. N. Chan School of Mathematical Sciences, Monash University, Melbourne, Australia Mathematics Institute and DIMAP, University of Warwick, Coventry, UK [email protected] Jacob W. Cooper Faculty of Informatics, Masaryk University, Brno, Czech Republic [email protected] Martin Koutecký Computer Science Institute, Charles University, Prague, Czech Republic [email protected]ff.cuni.cz Daniel Král’ Faculty of Informatics, Masaryk University, Brno, Czech Republic Mathematics Institute, DIMAP and Department of Computer Science, University of Warwick, Coventry, UK dkral@fi.muni.cz Kristýna Pekárková Faculty of Informatics, Masaryk University, Brno, Czech Republic [email protected] Abstract A long line of research on fixed parameter tractability of integer programming culminated with showing that integer programs with n variables and a constraint matrix with tree-depth d and largest entry ∆ are solvable in time g(d, ∆)poly(n) for some function g, i.e., fixed parameter tractable when parameterized by tree-depth d and ∆. However, the tree-depth of a constraint matrix depends on the positions of its non-zero entries and thus does not reflect its geometric structure. In particular, tree-depth of a constraint matrix is not preserved by row operations, i.e., a given integer program can be equivalent to another with a smaller dual tree-depth. We prove that the branch-depth of the matroid defined by the columns of the constraint matrix is equal to the minimum tree-depth of a row-equivalent matrix. We also design a fixed parameter algorithm parameterized by an integer d and the entry complexity of an input matrix that either outputs a matrix with the smallest dual tree-depth that is row-equivalent to the input matrix or outputs that there is no matrix with dual tree-depth at most d that is row-equivalent to the input matrix.
    [Show full text]