On the Trade-Offs Between Modeling Power and Algorithmic Complexity

Total Page:16

File Type:pdf, Size:1020Kb

On the Trade-Offs Between Modeling Power and Algorithmic Complexity On the Trade-offs between Modeling Power and Algorithmic Complexity Chun Ye Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate School of Arts and Sciences COLUMBIA UNIVERSITY 2016 c 2016 Chun Ye All Rights Reserved ABSTRACT On the Trade-offs between Modeling Power and Algorithmic Complexity Chun Ye Mathematical modeling is a central component of operations research. Most of the academic research in our field focuses on developing algorithmic tools for solving various mathematical problems arising from our models. However, our procedure for selecting the best model to use in any particular application is ad hoc. This dissertation seeks to rigorously quantify the trade-offs between various design criteria in model construction through a series of case studies. The hope is that a better understanding of the pros and cons of different models (for the same application) can guide and improve the model selection process. In this dissertation, we focus on two broad types of trade-offs. The first type arises naturally in mechanism or market design, a discipline that focuses on developing optimization models for complex multi-agent systems. Such systems may require satisfying multiple objectives that are potentially in conflict with one another. Hence, finding a solution that simultaneously satisfies several design requirements is challenging. The second type addresses the dynamics between model complexity and computational tractability in the context of approximation algorithms for some discrete optimization problems. The need to study this type of trade-offs is motivated by certain industry problems where the goal is to obtain the best solution within a reasonable time frame. Hence, being able to quantify and compare the degree of sub-optimality of the solution obtained under different models is helpful. Chapters 2-5 of the dissertation focus on trade-offs of the first type and Chapters 6-7 the second type. Table of Contents List of Figures vi List of Tables vii 1 Introduction 1 1.1 Trade-offs in Multi-Agent Optimization Models . .2 1.2 Model Predictive Power versus Computational Tractability Trade-offs . .8 2 A Note on the Assignment Problem with Uniform Preferences 11 2.1 Introduction . 11 2.1.1 Related Literature . 13 2.2 Preliminaries . 14 2.2.1 Model and Definitions . 14 2.2.2 Desirable Properties . 15 2.2.3 The Extended Probabilistic Serial Mechanism . 17 2.3 Main Results . 18 2.3.1 Non-uniqueness of Ordinally Efficient and Envy Free Assignments . 18 2.3.2 Impossibility Results . 19 3 Cake Cutting Algorithms for Piecewise Constant and Piecewise Uniform Valua- tions 25 3.1 Introduction . 25 3.1.1 Related Work . 29 i 3.2 Preliminaries . 31 3.2.1 Model . 31 3.2.2 Properties of Allocations . 32 3.2.3 Properties of Cake Cutting Algorithms . 33 3.2.4 Relationship between the Properties . 34 3.2.5 The Free Disposal Assumption . 34 3.2.6 The (Random) Assignment Problem and its Relationship to Cake Cutting . 35 3.3 CCEA | Controlled Cake Eating Algorithm . 37 3.3.1 CCEA for Piecewise Uniform Valuations . 40 3.4 MEA | Market Equilibrium Algorithm . 41 3.4.1 MEA for Piecewise Uniform Valuations . 44 3.5 MCSD | Mixed Constrained Serial Dictatorship Algorithm . 46 3.6 Discussion . 51 4 A Generalization of the Probabilistic Serial Mechanism and its Relationship to the Leximin Allocation 55 4.1 Introduction . 55 4.1.1 Our Contributions . 57 4.1.2 Related Work . 57 4.1.3 Model and Notation . 59 4.1.4 The Generalized Leximin Allocation Vector . 60 4.2 Computing a Generalized Leximin Allocation . 61 4.3 The Equivalence between the Generalized Probablistic Serial (GPS) Mechanism and the Generalized Leximin Mechanism . 63 4.3.1 Dichotomous Preference Domain . 65 4.3.2 Full Preference Domain . 68 4.4 Properties of the Generalized Leximin Mechanism . 71 4.5 Discussion . 75 5 Approximately Optimal Mechanisms for Strategyproof Facility Location: Minimiz- ing Lp Norm of Costs 76 ii 5.1 Introduction . 76 5.2 Model . 80 5.3 The Median Mechanism . 82 5.4 Randomized Mechanisms . 86 5.4.1 Mixing Dictatorships and Generalized Medians with the Optimal Location . 86 5.4.2 Optimality of the LRM Mechanism for 2 Agents . 89 5.5 Discussion . 94 6 Approximation Algorithms for the Incremental Knapsack Problem 95 6.1 Introduction . 95 6.1.1 Scheduling Interpretation . 97 6.1.2 Related Work . 98 6.1.3 Our Contributions . 99 6.2 Hardness Results for ................................... 101 DIK 6.3 A Constant Factor Approximation Algorithm . 104 6.3.1 Improving the Approximation Guarantee . 106 6.4 A PTAS for ....................................... 107 DIIK 6.4.1 Discussion . 111 6.5 Continuous Knapsack with Linear Capacity . 111 6.5.1 Incremental Subset Sum with Linear Capacity . 115 6.5.2 Discussion . 117 6.6 Piecewise Linear Capacity function . 117 6.6.1 Discussion . 118 7 Capacity Constrained Assortment Optimization under the Markov Chain based Choice Model 119 7.1 Introduction . 119 7.1.1 Our Contributions . 121 7.1.2 The Markov Chain Model and Notations . 123 7.1.3 Outline . 124 7.2 Hardness of Approximation . 124 iii 7.2.1 APX-hardness for Cardinality Constraint with Uniform Prices . 124 7.2.2 Totally-Unimodular Constraints . 125 7.3 Special Case: Uniform Price Items . 126 7.3.1 Constant Factor Approximation Algorithm . 126 7.3.2 Bad Examples for Arbitrary Prices . 128 7.4 Local Ratio based Algorithm Design . 131 7.4.1 High-Level Ideas . 131 7.4.2 Instance Update in Local Ratio Algorithm . 132 7.4.3 Structural Properties of the Updates . 134 7.4.4 Warm-up: Exact algorithm for the Unconstrained Problem . 135 7.5 Cardinality Constrained Assortment Optimization for General Case . 137 7.5.1 Technical Lemmas . 138 7.5.2 Analysis of the Local-Ratio Algorithm . 141 7.6 Capacity Constrained Assortment Optimization for General Case . 143 7.6.1 Analysis . 144 7.7 Computational Experiments . 147 7.7.1 A Mixed-Integer Programming Formulation . 148 7.7.2 Settings Tested . 148 7.7.3 Results . 149 7.8 Discussion . 151 I Bibliography 154 Bibliography 155 II Appendices 167 A Cake Cutting Algorithms for Piecewise Constant and Piecewise Uniform Valua- tions 168 iv B Approximately Optimal Mechanisms for Strategyproof Facility Location: Minimiz- ing Lp Norm of Costs 177 B.1 An Alternative Definition of Individual Cost . 177 B.2 Omitted Proofs from Section 4.2 . 178 B.3 Alternative Assumptions in Section 4.2 . 183 C Approximation Algorithms for the Incremental Knapsack Problem 185 C.1 Proof of Proposition 6.2 . 185 C.2 Proof of Lemma C.2 . 186 C.3 Proof of Proposition 6.5 . 189 C.4 Proof of Proposition 6.4 . ..
Recommended publications
  • Curriculum Vitæ
    Aleksandr M. Kazachkov May 30, 2021 Contact Department of Industrial and Systems Engineering Website akazachk.github.io Information Herbert Wertheim College of Engineering Email akazachkov@ufl.edu 303 Weil Hall, P.O. Box 116595 Office 401B Weil Hall Gainesville, FL 32611-6595, USA Phone +1.352.273.4902 Research Discrete optimization, including theoretical, methodological, and applied aspects, with an emphasis on devel- Interests oping better cutting plane techniques and open-source computational contributions Computational economics, particularly on the fair allocation of indivisible resources and fair mechanism design Social good applications, such as humanitarian logistics and donation distribution Academic University of Florida, Department of Industrial and Systems Engineering, Gainesville, FL, USA Positions Assistant Professor January 2021 – Present Courtesy Assistant Professor March 2020 – December 2020 Polytechnique Montréal, Department of Mathematics and Industrial Engineering, Montréal, QC, Canada Postdoctoral Researcher under Andrea Lodi May 2018 – December 2020 Education Carnegie Mellon University, Tepper School of Business, Pittsburgh, PA, USA Ph.D. in Algorithms, Combinatorics, and Optimization under Egon Balas May 2018 Dissertation: Non-Recursive Cut Generation M.S. in Algorithms, Combinatorics, and Optimization May 2013 Cornell University, College of Engineering, Ithaca, NY, USA B.S. in Operations Research and Engineering with Honors, Magna Cum Laude May 2011 Publications [1] P.I. Frazier and A.M. Kazachkov. “Guessing Preferences: A New Approach to Multi-Attribute Ranking and Selection”, Winter Simulation Conference, 2011. [2] J. Karp, A.M. Kazachkov, and A.D. Procaccia. “Envy-Free Division of Sellable Goods”, AAAI Conference on Artificial Intelligence, 2014. [3] J.P. Dickerson, A.M. Kazachkov, A.D. Procaccia, and T.
    [Show full text]
  • 2019 Contents 2019
    mathematical sciences news 2019 contents 2019 Editor-in-Chief Tom Bohman Contributing Writers Letter from Department 03 Tom Bohman Head, Tom Bohman Jocelyn Duffy Bruce Gerson Florian Frick 04 Ben Panko Emily Payne Faculty Notes Ann Lyon Ritchie Franziska Weber Graphic Design and Photography 10 Carnegie Mellon University Expanding the Boundaries on Marketing & Communications Summer Undergraduate Research Mellon College of Science Communications 14 Carnegie Mellon University Frick's Fellowship Department of Mathematical Sciences Wean Hall 6113 Pittsburgh, PA 15213 20 cmu.edu/math In Memorium Carnegie Mellon University does not discriminate in admission, employment, or administration of its programs or activities on the basis of race, color, national origin, sex, 24 handicap or disability, age, sexual orientation, gender identity, religion, creed, ancestry, belief, veteran status, or genetic information. Furthermore, Carnegie Mellon University does Alumni News not discriminate and is required not to discriminate in violation of federal, state, or local laws or executive orders. Inquiries concerning the application of and compliance with this statement should be directed to the university ombudsman, Carnegie Mellon University, 5000 Forbes 26 Avenue, Pittsburgh, PA 15213, telephone 412-268-1018. Obtain general information about Carnegie Mellon University Student News by calling 412-268-2000. Produced for the Department of Mathematical Sciences by Marketing & Communications, November, 2019, 20-137. ©2019 Carnegie Mellon University, All rights reserved. No 30 part of this publication may be reproduced in any form without written permission from Carnegie Mellon University's Department of Mathematical Sciences. Class of 2019 1 Letter from Mathematics Department Head, Tom Bohman Undergraduate research has become a hallmark of a Carnegie Mellon University education, with students citing that it has helped to prepare them for their futures in academia and the workforce.
    [Show full text]
  • On the Depth of Cutting Planes
    On the depth of cutting planes Laurent Poirrier, James Yu∗ flpoirrier,[email protected] March 12, 2019 Abstract We introduce a natural notion of depth that applies to individual cutting planes as well as entire families. This depth has nice properties that make it easy to work with theoretically, and we argue that it is a good proxy for the practical strength of cutting planes. In particular, we show that its value lies in a well-defined interval, and we give parametric upper bounds on the depth of two prominent types of cutting planes: split cuts and intersection cuts from a simplex tableau. Interestingly, these parametric bounds can help explain behaviors that have been observed computationally. For polyhedra, the depth of an individual cutting plane can be computed in polynomial time through an LP formulation, and we show that it can be computed in closed form in the case of corner polyhedra. 1 Introduction Cutting planes (also called valid inequalities or cuts) have proven computationally useful since the very early history of Integer Programming (IP). In the pioneering work of Dantzig, Fulkerson and Johnson [10] on the traveling salesman problem, cutting planes were the main computational tool alongside the simplex method. They were initially less successful for general IP problems, where they were largely outperformed by Land and Doig's branch-and-bound method [23]. However, in the mid-nineties, Balas, Ceria and Cornu´ejols[2] proposed combining the two: first adding a few rounds of cuts, before resorting to branch-and-bound. Since then, cutting planes have become a central component of IP solvers [3], the most effective single families of cuts being Gomory's Mixed-Integer (GMI) cuts [19], and Nemhauser and Wolsey's Mixed-Integer Rounding (MIR) cuts [24, 25].
    [Show full text]
  • A New Column for Optima Structure Prediction and Global Optimization
    76 o N O PTIMA Mathematical Programming Society Newsletter MARCH 2008 Structure Prediction and A new column Global Optimization for Optima by Alberto Caprara Marco Locatelli Andrea Lodi Dip. Informatica, Univ. di Torino (Italy) Katya Scheinberg Fabio Schoen Dip. Sistemi e Informatica, Univ. di Firenze (Italy) This is the first issue of 2008 and it is a very dense one with a Scientific February 26, 2008 contribution on computational biology, some announcements, reports of “Every attempt to employ mathematical methods in the study of chemical conferences and events, the MPS Chairs questions must be considered profoundly irrational and contrary to the spirit in chemistry. If mathematical analysis should ever hold a prominent place Column. Thus, the extra space is limited in chemistry — an aberration which is happily almost impossible — it but we like to use few additional lines would occasion a rapid and widespread degeneration of that science.” for introducing a new feature we are — Auguste Comte particularly happy with. Starting with Cours de philosophie positive issue 76 there will be a Discussion Column whose content is tightly related “It is not yet clear whether optimization is indeed useful for biology — surely biology has been very useful for optimization” to the Scientific contribution, with ­ — Alberto Caprara a purpose of making every issue of private communication Optima recognizable through a special topic. The Discussion Column will take the form of a comment on the Scientific 1 Introduction contribution from some experts in Many new problem domains arose from the study of biological and the field other than the authors or chemical systems and several mathematical programming models an interview/discussion of a couple as well as algorithms have been developed.
    [Show full text]
  • Can Be Formulated As
    MIXED INTEGER SECOND ORDER CONE PROGRAMMING SARAH DREWES∗ AND STEFAN ULBRICH † Abstract. This paper deals with solving strategies for mixed integer second order cone problems. We present different lift-and-project based linear and convex quadratic cut generation techniques for mixed 0-1 second-order cone problems and present a new convergent outer approximation based approach to solve mixed integer SOCPs. The latter is an extension of outer approximation based approaches for continuously differ- entiable problems to subdifferentiable second order cone constraint functions. We give numerical results for some application problems, where the cuts are applied in the context of a nonlinear branch-and-cut method and the branch-and-bound based outer approximation algorithm. The different approaches are compared to each other. Key words. Mixed Integer Nonlinear Programming, Second Orde Cone Program- ming, Outer Approximation, Cuts AMS(MOS) subject classifications. 90C11 1. Introduction. Mixed Integer Second Order Cone Programs (MIS- OCP) can be formulated as min cT x s.t. Ax = b x º 0 (1.1) xj ∈ [lj ,uj ] (j ∈ J), xj ∈ Z (j ∈ J), n m,n m n where c ∈ R , A ∈ R , b ∈ R , lj ,uj ∈ R and x º 0 denotes that x ∈ R ki consists of noc part vectors xi ∈ R lying in second order cones defined by T T R Rki−1 Ki = {xi = (xi0,xi1) ∈ × : kxi1k2 ≤ xi0}. Mixed integer second order cone problems have various applications in fi- nance or engineering, for example turbine balancing problems, cardinality- constrained portfolio optimization (cf. Bertsimas and Shioda in [12]) or the problem of finding a minimum length connection network also known as the Euclidian Steiner Tree Problem (ESTP) (cf.
    [Show full text]
  • Disjunctive Programming
    Chapter 10 Disjunctive Programming Egon Balas Introduction by Egon Balas In April 1967 I and my family arrived into the US as fresh immigrants from be- hind the Iron Curtain. After a fruitful semester spent with George Dantzig’s group in Stanford, I started working at CMU. My debut in integer programming and entry ticket into Academia was the additive algorithm for 0-1 programming [B65], an im- plicit enumeration procedure based on logical tests akin to what today goes under the name of constraint propagation. As it used only additions and comparisons, it was easy to implement and was highly popular for a while. However, I was aware of its limitations and soon after I joined CMU I started investigating cutting plane procedures, trying to use for this purpose the tools of convex analysis: support func- tions and their level sets, maximal convex extensions, polarity, etc. During the five years starting in 1969, I proposed a number of procedures based on the central idea of intersection cuts [2] (numbered references are to those at the end of the paper, whereas mnemonicized ones are to the ones listed at the end of this introduction): Given any convex set S containing the LP optimum of a mixed integer program (MIP) but containing no feasible integer point in its interior, one can generate a valid cut by intersecting the boundary of S with the extreme rays of the cone defined by the optimal solution to the linear programming relaxation of the MIP and tak- ing the hyperplane defined by the intersection points as the cut.
    [Show full text]
  • History of Operations Research
    INFORMS 2011 c 2011 INFORMS j isbn 978-0-9843378-2-8 doi: http://dx.doi.org/10.1287/educ.1110.0084 History of Operations Research Saul I. Gass University of Maryland, College Park, Maryland 20742, [email protected] Arjang A. Assad School of Management, State University of New York at Buffalo, Buffalo, New York 14260, aassad@buffalo.edu Abstract We discuss the history of operations research (OR) from the following perspectives: the origins and people of OR; the major sites of early United States OR research; the best stories from contributors to early OR; and lessons learned, or how history informs OR today. Keywords operations research; history; perspectives Tutorial Outline Part I: Origins and People of Operations Research (OR)|A Quick Tour Part II: The Major Sites of Early U.S. OR Research Part III: The Best Stories from Contributors to Early OR Part IV: Lessons Learned, or How History Informs OR Today Prologue Over the last 10 years, we have taken intersecting paths along the complex network that defines the background, development, and worldwide acceptation of OR as a scientific-based profession that is directed at resolving decision problems in business, government, industry, and society. Prior to these travels, we both spent our careers (and still are) in consulting, teaching, and related research. So, it is fitting to ask, what do we find in the pursuit of the historical aspects of OR that make it of interest to us and, we hope, of interest to you? But first, we discuss some brief background on the origins of OR and how we became interested in that area: OR had its origins in the late 1930s when a group of British Royal Air Force officers and civilian scientists were asked to determine how recently developed radar technology could be used for controlled interception of enemy aircraft.
    [Show full text]
  • Linear Programming
    LINEAR PROGRAMMING GEORGE B. DANTZIG Department of Management Science and Engineering, Stanford University, Stanford, California 94305-4023 The Story About How It Began: Some legends, a little the transportation problem was also overlooked until after about its historical significance, and comments about where others in the late 1940’s and early 1950’s had independently its many mathematical programming extensions may be rediscovered its properties. headed. What seems to characterize the pre-1947 era was lack of any interest in trying to optimize. T. Motzkin in his schol- inear programming can be viewed as part of a great arly thesis written in 1936 cites only 42 papers on linear Lrevolutionary development which has given mankind inequality systems, none of which mentioned an objective the ability to state general goals and to lay out a path of function. detailed decisions to take in order to “best” achieve its goals The major influences of the pre-1947 era were Leon- when faced with practical situations of great complexity. tief’s work on the Input-Output Model of the Economy Our tools for doing this are ways to formulate real-world (1933), an important paper by von Neumann on Game The- problems in detailed mathematical terms (models), tech- ory (1928), and another by him on steady economic growth niques for solving the models (algorithms), and engines for (1937). executing the steps of algorithms (computers and software). My own contributions grew out of my World War II This ability began in 1947, shortly after World War II, experience in the Pentagon. During the war period (1941– and has been keeping pace ever since with the extraordinary 45), I had become an expert on programming-planning growth of computing power.
    [Show full text]
  • Newsletter 18 of EUROPT
    Newsletter 18 of EUROPT EUROPT - The Continuous Optimization Working Group of EURO http://www.iam.metu.edu.tr/EUROPT/ January 2010 1 In this issue: ² Words from the chair ² Forthcoming Events ² Awards and Nominations ² Job opportunities ² Invited Short Note: "Simple bounds for boolean quadratic problems", by Yu. Nesterov ² Editor’s personal comments 2 Words from the chair Dear Members of EUROPT, dear Friends, It is once again my great pleasure to insert some salutation words in this new issue of our Newsletter. In these special days, I would like to express to all of you my best wishes for a Happy New Year 2010, and my deep thanks to the Members of the Managing Board (MB) for their permanent support and expert advice. This is also time for remembering the many important scientific events to take place during this year. They are of great interest, and I am sure of meeting most of you in some of them. I would like to express my gratitude to those members of EUROPT who are involved in the organization of these activities and, according the experience of the last years, all of them will be successfully organized. I would like to start by calling your attention on our 8th EUROPT Workshop "Advances in Continuous Optimization" (www.europt2010.com), to be held in University of Aveiro, Portugal, in July 9-10, the days previous to EURO XXIV 2010, in Lisbon (http://euro2010lisbon.org/). We kindly invite you to participate in this meeting, which is the annual meeting of our EU- ROPT group and that, in this occasion, has many additional points of interest.
    [Show full text]
  • Pioneers and Innovators (International Series in Operations
    Contents Chapter 1. PATRICK BLACKETT (1897) ................................................01 by Maurice W. Kirby, Lancaster University Jonathan Rosenhead, London School of Economics Chapter 2. STEVEN VAJDA (1901) .............................................................31 by Jakob Krarup, University of Copenhagen Chapter 3. PHILIP McCORD MORSE (1903) .........................................45 by Robert M. Oliver, University of California, Berkeley Chapter 4. JOHN von NEUMANN (1903)..................................................69 by Saul I. Gass, University of Maryland, College Park Chapter 5. CHARLES FREDERICK GOODEVE (1904).....................83 by Maurice W. Kirby, Lancaster University Chapter 6. ALBERT W. TUCKER (1905)..................................................95 by Saul I. Gass, University of Maryland, College Park XV xvi Contents Chapter 7. JACINTO STEINHARDT (1906) ......................................... 113 by Saul I. Gass, University of Maryland, College Park Chapter 8. GEORGE E. KIMBALL (1906) ............................................ 123 by John F. Magee, Arthur D. Little, Inc. (retired) Chapter 9. ELLIS A. JOHNSON (1906)................................................... 143 by Saul I. Gass, University of Maryland, College Park Chapter 10. LEONID VITAL’EVICH KANTOROVICH (1912).... 157 by Saul I. Gass, University of Maryland, College Park Jonathan Rosenhead, London School of Economics Chapter 11. C. WEST CHURCHMAN (1913)........................................ 171 by Arjang A. Assad, University at Buffalo,
    [Show full text]
  • Tight Approximations of Dynamic Risk Measures
    Tight Approximations of Dynamic Risk Measures Dan A. Iancu˚ Marek Petrik: Dharmashankar Subramanian: November 9, 2012 Abstract This paper compares two different frameworks recently introduced in the literature for measuring risk in a multi-period setting. The first corresponds to applying a single coherent risk measure to the cumulative future costs, while the second involves applying a composition of one-step coherent risk mappings. We summarize the relative strengths of the two methods, characterize several necessary and sufficient conditions under which one of the measurements always dominates the other, and introduce a metric to quantify how close the two risk measures are. Using this notion, we address the question of how tightly a given coherent measure can be approx- imated by lower or upper-bounding compositional measures. We exhibit an interesting asymmetry between the two cases: the tightest possible upper-bound can be exactly characterized, and corre- sponds to a popular construction in the literature, while the tightest-possible lower bound is not readily available. We show that testing domination and computing the approximation factors is gen- erally NP-hard, even when the risk measures in question are comonotonic and law-invariant. However, we characterize conditions and discuss several examples where polynomial-time algorithms are possible. One such case is the well-known Conditional Value-at-Risk measure, which is further explored in our companion paper Huang et al.[2012]. Our theoretical and algorithmic constructions exploit interesting connections between the study of risk measures and the theory of submodularity and combinatorial optimization, which may be of independent interest. 1 Introduction.
    [Show full text]
  • Lagrangian Relaxation for Integer Programming
    Chapter 9 Lagrangian Relaxation for Integer Programming Arthur M. Geoffrion Introduction by Arthur M. Geoffrion It is a pleasure to write this commentary because it offers an opportunity to ex- press my gratitude to several people who helped me in ways that turned out to be essential to the birth of [8]. They also had a good deal to do with shaping my early career and, consequently, much of what followed. The immediate event that triggered my interest in this topic occurred early in 1971 in connection with a consulting project I was doing for Hunt-Wesson Foods (now part of ConAgra Foods) with my colleague Glenn Graves. It was a distribution system design problem: how many distribution centers should there be and where, how should plant outputs flow through the DCs to customers, and related questions. We had figured out how to solve this large-scale MILP problem optimally via Ben- ders Decomposition, a method that had been known for about a decade but had not yet seen practical application to our knowledge. This involved repeatedly solving a large 0-1 integer linear programming master problem in alternation with as many pure classical transportation subproblems as there were commodity classes. The master problem was challenging, and one day Glenn, who did all the implementa- tion, came up with a new way to calculate conditional “penalties” to help decide which variable to branch on in our LP-based branch-and-bound approach. I regularly taught a doctoral course in those days that covered, inter alia, the main types of penalties used by branch-and-bound algorithms.
    [Show full text]