The Simplex Method for Linear Programming Problems

Total Page:16

File Type:pdf, Size:1020Kb

The Simplex Method for Linear Programming Problems Appendix A THE SIMPLEX METHOD FOR LINEAR PROGRAMMING PROBLEMS A.l Introduction This introduction to the simplex method is along the lines given by Chvatel (1983). Here consider the maximization problem: maximize Z = c-^x such that Ax < b, A an m x n matrix (A.l) 3:^2 > 0, i = 1,2, ...,n. Note that Ax < b is equivalent to ^1^=1 ^ji^i ^ ^j? j = 1, 2,..., m. Introduce slack variables Xn-^i,Xn-^2^ "",Xn-j-m > 0 to transform the in- 234 APPENDIX A. equality constraints to equality constraints: aiiXi + . + ainXn + Xn+l = ^1 a2lXi + . + a2nXn + Xn-\-2 = h (A.2) or [A;I]x = b where x = [a;i,a;2, ...,Xn+m]^,b = [^i, 62, ...,öm]^, and xi, 0:2,..., Xn > 0 are the original decision variables and Xn-\-i^Xn-\-2^ "">^n-\-m ^ 0 the slack variables. Now assume that bi > 0 for all i, To start the process an initial feasible solution is then given by: Xn+l = bi Xn+2 = b2 with xi = X2 = " ' = Xn = 0. In this case we have a feasible origin. We now write system (A.2) in the so called standard tableau format: Xn-^l = 61 - anXi - ... - ainXn > 0 (A.3) Z = CiXi + C2X2 + . + Cn^n The left side contains the basic variables^ in general 7^ 0, and the right side the nonbasic variables^ all = 0. The last line Z denotes the objective function (in terms of nonbasic variables). SIMPLEX METHOD FOR LP PROBLEMS 235 In a more general form the tableau can be written as XB2 = b2- a2lXNl - ... - a2nXNn > 0 (A.4) XBm = bm- amlXNl "... - amn^Nn > 0 Z = CNlXNl + CN2XN2 + • . + CjsfnXNn The > at the right serves to remind us that Xßj > 0 is a necessary condition, even when the values of Xjvi change from their zero values. Xß = vector of basic variables and x^v = vector of nonbasic variables represent a basic feasible solution. A.2 Pivoting for increase in objective function Clearly if any c^vp > 0, then Z increases if we increase x^p^ with the other xjsfi = 0,2 /p. Assume further that cjsfp > 0 and cjsfp > cjsn^i = 1, 2,..., n, then we decide to increase xjsfp. But xjsfp can not be increased indefinitely because of the constraint x^ > 0 in tableau (A.4). Every entry i in the tableau, with aip > 0, yields a constraint on XNp of the form: 0 < xj^p <—^ = di, i = l,2, ...,m. (A.5) Assume now that i = k yields the strictest constraint, then let Xßk = 0 and xjsfp — d^. Now XBk{= 0) is the outgoing variable (out of the base), and xjsfp = dk{^ 0) the incoming variable. The k-th. entry in tableau (A.4) changes to XNp = dk- 22'^kiXNi - äkkXBk (A.6) iy^k with äki = Clki/(^kpi Ö^kk = ^/(^kp' Replace XNp by (A.6) in each of the remaining m — 1 entries in tableau (A.4) as well as in the objective function Z. With (A.6) as the first entry this gives the new tableau in terms of the new basic variables: XBi, XB2,. • •, XNp,..., XBm (left side) 7^ 0 236 APPENDIX A. and nonbasic variables: ^ivi, ^iV2,. •., XBk,. •., XNn (right side) = 0. As xjsfp has increased with dj^, the objective function has also increased by cj^pdk' The objective function (last) entry is thus of the form Z = CNpdk + CNlXjSfl + CN2XN2 H ^" CNm^Nm where the Xjvi now denotes the new nonbasic variables and cj^i the new associated coefficients. This completes the first pivoting iteration. Repeat the procedure above until a tableau is obtain such that Z = Z* + CNIXNI H h CNmXNm with CNi < 0, i = 1, 2, ..., m. The optimal value of the objective function is then Z — Z"" (no further increase is possible). A. 3 Example maximize Z = 5xi -{- 4x2 + ^^s such that 2x1 + 3x2 + X3 < 5 4x1 H-^2 4-2x3 < 11 3x1 -f 4x2 4- 2x3 < 8 3^1,2:2,3:3 > 0. This problem has a> feasible origin. Introduce slack variables X4,X5 and XQ and then the first tableau is given by: I: X4 = 5 -- 2x1 - 3X2 - X3 >o XI < 5/2(5) X5 — 11 -- 4xi - X2 - 2X3 >o xi < 11/4 xe — 8 -- 3x1 - 4X2 - 2X3 >o xi < 8/3 Z = 5x1 T~ 4X2 ~T~ 3X3 Here 5 > 0 and 5 > 4 > 3. Choose thus xi as incoming variable. To find the outgoing variable, calculate the constraints on xi for all the entries SIMPLEX METHOD FOR LP PROBLEMS 237 (see right side). The strictest {s) constraint is given by the first entry, and thus the outgoing variable is 0:4. The first entry in the next tableau is 1, Xi = \-\X2- ^X3 )x^. Replace this expression for xi in all other entries to find the next tableau: 5 3 1 1 dj\ — 2 52 9*^3 94 >0 X5 = II - A{\ - 1x2 - \X2, - \X4) — X2 — 2X3 ^ 0 4x4) — x4x2 — 2x3 > 0 XQ = 8-3(f - |X2- ^X3- 5(1 "pr 2^3 ^X4) 4- 4X2 + 3X3 After simplification we obtain the second tableau in standard format: II: 5 Xl — 2 - 1X2 - ^xs - 2X4 >o X3 < 5 ^5 = 1 + 5X2 + 2X4 >o no bound 1 X6 = + |X2 - hs H- 2X4 >o X3 < 1(5) 25 - - 2X4 z = 5 2^2 + 2^3 This completes the first iteration. For the next step it is clear that X3 is the incoming variable and consequently the outgoing variable is XQ. The first entry for the next tableau is thus X3 = 1 + X2 + 3x4 ~ 2x6 (3-rd entry in previous tableau). Replace this expression for X3 in all the remaining entries of tableau II. After simplification we obtain the third tableau: III: ^3 = 1 + X2 -f- 3x4 — 2x6 ^ 0 Xl = 2 — 2X2 — 2X4 + ^6^0 X5 z= 1 + 5X2 + 2X4 > 0 Z - 13 3X2 X4 X6 In the last entry all the coefficients of the nonbasic variables are negative. Consequently it is not possible to obtain a further increase in Z by increasing one of the nonbasic variables. The optimal value of Z is thus Z* = 13 with x\ = 2 ; X2 = 0 ; X3 = 1. 238 APPENDIX A. Assignment A.l Solve by using the simplex method: maximize z = 3xi + 2x2 + 4x3 such that 2x1 4- 3x3 < 5 2x1 + X2 + 3x3 < 7 3:i,X2,X3 > 0. A-4 The auxiliary problem for problem with in- feasible origin In the previous example it is possible to find the solution using the simplex method only because hi > 0 for all i and an initial solution x^ = 0 , i = 1, 2, ...n with Xn-{-j = ^j, j — 1, 2,..., m was thus feasible, that is, the origin is a feasible initial solution. If the LP problem does not have a feasible origin we first solve the so called auxiliary problem: Phase 1: maximize W = —XQ such that X^^,=i cijiXi — XQ < hj, j = 1, 2,..., m (A-.7) Xi >0^ 2 = 0,1,2, ...n where XQ is called the new artificial variable. By setting Xi = 0 for i = 1, 2, ...n and choosing XQ large enough, we can always find a feasible solution. The original problem clearly has a feasible solution if and only if the auxiliary problem has a feasible solution with XQ = 0 or, in other words, the original problem has a feasible solution if and only if the optimal value of the auxiliary problem is zero. The original problem is now solved using the simplex method, as described in the previous sections. This solution is called Phase 2. SIMPLEX METHOD FOR LP PROBLEMS 239 A.5 Example of auxiliary problem solution Consider the LP: maximize Z •= xi — X2 + x^, such that 2x1 - X2 + 0:3 < 4 2xi — 3x2 -f 3:3 < -5 -xi -\- X2- 2x3 < -1 Xi,X2,X2, > 0. Clearly this problem does not have a feasible origin. We first perform Phase 1: Consider the auxiliary problem: maximize W = —XQ such that 2x1 - X2-{- 2x3 - a^o < 4 2xi — 3x2 4- X3 — xo < —5 -xi + X2 - 2x3 - ^0 < -1 Xo,Xi,X2,X3 > 0. Introduce the slack variables X4, X5 and xe, which gives the tableau (not yet in standard form): X4 = 4 - 2x1 + X2 - 2X3 + Xo > 0 Xo > -4 X5 = -5 - 2x1 + 3X2 - X3 + xo > 0 Xo > 5(5) XQ = -1 + __Xl_ - ^2 -f- 2X3 + _Xo_ > 0 Xo > 1 w = - xo This is not in standard form as XQ on the right is not zero. With xi = 0:2 = X3 = 0 then X4, X5, X6 > 0 if Xo > max{—4; 5; 1}. Choose Xo = 5, as prescribed by the second (strictest) entry. This gives X5 = 0, X4 = 9 and XQ = 4. Thus xo is a basic variable (f^ 0) and X5 a nonbasic variable. The first standard tableau can now be write as I: 240 APPENDIX A. Xo — 5 + 2x1 - 3X2 + ^z + ^5 > 0 X2<| 0:4 — 9 - 2x2 - ^3 + 2:5 > 0 X2< 1 x^ — 4 + 3x1 - 4x2 + 3X3 + ^5 > 0 X2 < 1(5) W = -5 - 2x1 + 3X2 - a^3 - X5 Now apply the simplex method. From the last entry it is clear that W increases as X2 increases. Thus X2 is the incoming variable. With the strictest bound X2 < 1 as prescribed by the third entry the outgoing variable is XQ. The second tableau is given by: II: X2 = 1 + 0.75x1+ 0.75x3+ 0.25x5- 0.25x6> 0 no bound Xo = 2- 0.25x1- 1.25x3+ 0.25x5- 0.75x6> 0 X4 = 7- 1.5x1 — 2.5x3+ 0.5X5+ 0.5x6> 0 W = -2+ 0.25x1+ 1.25x3- 0.25x5- 0.75x6 The new incoming variable is X3 and the outgoing variable XQ.
Recommended publications
  • A Generalized Dual Phase-2 Simplex Algorithm1
    A Generalized Dual Phase-2 Simplex Algorithm1 Istvan´ Maros Department of Computing, Imperial College, London Email: [email protected] Departmental Technical Report 2001/2 ISSN 1469–4174 January 2001, revised December 2002 1This research was supported in part by EPSRC grant GR/M41124. I. Maros Phase-2 of Dual Simplex i Contents 1 Introduction 1 2 Problem statement 2 2.1 The primal problem . 2 2.2 The dual problem . 3 3 Dual feasibility 5 4 Dual simplex methods 6 4.1 Traditional algorithm . 7 4.2 Dual algorithm with type-1 variables present . 8 4.3 Dual algorithm with all types of variables . 9 5 Bound swap in dual 11 6 Bound Swapping Dual (BSD) algorithm 14 6.1 Step-by-step description of BSD . 14 6.2 Work per iteration . 16 6.3 Degeneracy . 17 6.4 Implementation . 17 6.5 Features . 18 7 Two examples for the algorithmic step of BSD 19 8 Computational experience 22 9 Summary 24 10 Acknowledgements 25 Abstract Recently, the dual simplex method has attracted considerable interest. This is mostly due to its important role in solving mixed integer linear programming problems where dual feasible bases are readily available. Even more than that, it is a realistic alternative to the primal simplex method in many cases. Real world linear programming problems include all types of variables and constraints. This necessitates a version of the dual simplex algorithm that can handle all types of variables efficiently. The paper presents increasingly more capable dual algorithms that evolve into one which is based on the piecewise linear nature of the dual objective function.
    [Show full text]
  • Practical Implementation of the Active Set Method for Support Vector Machine Training with Semi-Definite Kernels
    PRACTICAL IMPLEMENTATION OF THE ACTIVE SET METHOD FOR SUPPORT VECTOR MACHINE TRAINING WITH SEMI-DEFINITE KERNELS by CHRISTOPHER GARY SENTELLE B.S. of Electrical Engineering University of Nebraska-Lincoln, 1993 M.S. of Electrical Engineering University of Nebraska-Lincoln, 1995 A dissertation submitted in partial fulfilment of the requirements for the degree of Doctor of Philosophy in the Department of Electrical Engineering and Computer Science in the College of Engineering and Computer Science at the University of Central Florida Orlando, Florida Spring Term 2014 Major Professor: Michael Georgiopoulos c 2014 Christopher Sentelle ii ABSTRACT The Support Vector Machine (SVM) is a popular binary classification model due to its superior generalization performance, relative ease-of-use, and applicability of kernel methods. SVM train- ing entails solving an associated quadratic programming (QP) that presents significant challenges in terms of speed and memory constraints for very large datasets; therefore, research on numer- ical optimization techniques tailored to SVM training is vast. Slow training times are especially of concern when one considers that re-training is often necessary at several values of the models regularization parameter, C, as well as associated kernel parameters. The active set method is suitable for solving SVM problem and is in general ideal when the Hessian is dense and the solution is sparse–the case for the `1-loss SVM formulation. There has recently been renewed interest in the active set method as a technique for exploring the entire SVM regular- ization path, which has been shown to solve the SVM solution at all points along the regularization path (all values of C) in not much more time than it takes, on average, to perform training at a sin- gle value of C with traditional methods.
    [Show full text]
  • Towards a Practical Parallelisation of the Simplex Method
    Towards a practical parallelisation of the simplex method J. A. J. Hall 23rd April 2007 Abstract The simplex method is frequently the most efficient method of solv- ing linear programming (LP) problems. This paper reviews previous attempts to parallelise the simplex method in relation to efficient serial simplex techniques and the nature of practical LP problems. For the major challenge of solving general large sparse LP problems, there has been no parallelisation of the simplex method that offers significantly improved performance over a good serial implementation. However, there has been some success in developing parallel solvers for LPs that are dense or have particular structural properties. As an outcome of the review, this paper identifies scope for future work towards the goal of developing parallel implementations of the simplex method that are of practical value. Keywords: linear programming, simplex method, sparse, parallel comput- ing MSC classification: 90C05 1 Introduction Linear programming (LP) is a widely applicable technique both in its own right and as a sub-problem in the solution of other optimization problems. The simplex method and interior point methods are the two main approaches to solving LP problems. In a context where families of related LP problems have to be solved, such as integer programming and decomposition methods, and for certain classes of single LP problems, the simplex method is usually more efficient. 1 The application of parallel and vector processing to the simplex method for linear programming has been considered since the early 1970's. However, only since the beginning of the 1980's have attempts been made to develop implementations, with the period from the late 1980's to the late 1990's seeing the greatest activity.
    [Show full text]
  • GOPALAN COLLEGE of ENGINEERING and MANAGEMENT Department of Computer Science and Engineering
    Appendix - C GOPALAN COLLEGE OF ENGINEERING AND MANAGEMENT Department of Computer Science and Engineering Academic Year: 2016-17 Semester: EVEN COURSE PLAN Semester: VI Subject Code& Name: 10CS661 & OPERATIONS RESERACH Name of Subject Teacher: J.SOMASEKAR Name of Subject Expert (Reviewer): SUPARNA For the Period: From: 13-02-17 to 02-06-17 Details of Book to be referred: Text Books T1: Frederick S. Hillier and Gerald J. Lieberman, Introduction to Operations Research, 8thEdition, Tata McGraw Hill, 2005. Reference Books R1: S.Kalavathy, Operations Research, 4th edition, vikas publishing house Pvt.Ltd. R2: Hamdy A Taha: Operations Research: An Introduction, 8th edition, pearson education, 2007. Practical Deviation How Made Remarks Book Lecture Applications & Brief Planned Executed Reasons Good / by HOD Topic Planned refereed with No objectives Date Date thereof Reciprocate page no. arrangement Introduction to the subject OR Objective: Introduce UNIT-1 : the concept of Linear T1:1-2 1. 13-02-17 Linear Programming : programming and Introduction solving by using graphical method. Scope and limitations of Also formulation of T1: 1-4 2. OR. Also applications of LPP for the data T2:2,4 14-02-17 OR provided by the Mathematical model of organization for T1: 27-35 3. LPP and solution by optimization T2:19-23 15-02-17 graphical method Application: minimization of T1: 27-33 4. LPP problems solutions by 16-02-17 graphical method. product cost, T2:21-24 Special cases of graphical maximization of T1: 27-33 method solution namely profit in company T2:25-26 5. unbound solution, no (or) industry 20-02-17 feasible solution and multiple solutions.
    [Show full text]
  • Operations Research 10CS661 OPERATIONS RESEARCH Subject
    Operations Research 10CS661 OPERATIONS RESEARCH Subject Code: 10CS661 I.A. Marks : 25 Hours/Week : 04 Exam Hours: 03 Total Hours : 52 Exam Marks: 100 PART - A UNIT – 1 6 Hours Introduction, Linear Programming – 1: Introduction: The origin, nature and impact of OR; Defining the problem and gathering data; Formulating a mathematical model; Deriving solutions from the model; Testing the model; Preparing to apply the model; Implementation . Introduction to Linear Programming: Prototype example; The linear programming (LP) model. UNIT – 2 7 Hours LP – 2, Simplex Method – 1: Assumptions of LP; Additional examples. The essence of the simplex method; Setting up the simplex method; Algebra of the simplex method; the simplex method in tabular form; Tie breaking in the simplex method UNIT – 3 6 Hours Simplex Method – 2: Adapting to other model forms; Post optimality analysis; Computer implementation Foundation of the simplex method. UNIT – 4 7Hours Simplex Method – 2, Duality Theory: The revised simplex method, a fundamental insight. The essence of duality theory; Economic interpretation of duality, Primal dual relationship; Adapting to other primal forms PART - B UNIT – 5 7 Hours Duality Theory and Sensitivity Analysis, Other Algorithms for LP : The role of duality in sensitive analysis; The essence of sensitivity analysis; Applying sensitivity analysis. The dual simplex method; Parametric linear programming; The upper bound technique. UNIT – 6 7 Hours Transportation and Assignment Problems: The transportation problem; A streamlined simplex method for the transportation problem; The assignment problem; A special algorithm for the assignment problem. DEPT. OF CSE, SJBIT 1 Operations Research 10CS661 UNIT – 7 6 Hours Game Theory, Decision Analysis: Game Theory: The formulation of two persons, zero sum games; Solving simple games- a prototype example; Games with mixed strategies; Graphical solution procedure; Solving by linear programming, Extensions.
    [Show full text]
  • The Simplex Method
    Chapter 2 The simplex method The graphical solution can be used to solve linear models defined by using only two or three variables. In Chapter 1 the graphical solution of two variable linear models has been analyzed. It is not possible to solve linear models of more than three variables by using the graphical solution, and therefore, it is necessary to use an algebraic procedure. In 1949, George B. Dantzig developed the simple# method for solving linear programming problems. The simple# method is designed to be applied only after the linear model is expressed in the following form$ Standard form. % linear model is said to be in standard form if all constraints are equalities, and each one of the values in vectorb and all variables in the model are nonnegative. max(min)z=c T x subject to Ax=b x≥0 If the objective is to maximize, then it is said that the model is in maximization standard form. Otherwise, the model is said to be in minimization standard form. 2.1 Model manipulation Linear models need to be written in standard form to be solved by using the sim- ple# method. By simple manipulations, any linear model can be transformed into 19 +, Chapter 2. The simple# method an equivalent one written in standard form. The objective function, the constraints and the variables can be transformed as needed. 1. The objective function. Computing the minimum value of functionz is equivalent to computing the maximum value of function−z, n n minz= cjxj ⇐⇒ max (−z)= −cjxj �j=1 �j=1 -or instance, minz=3x 1 −5x 2 and max (−z) =−3x 1 + 5x2 are equivalent; values of variablesx 1 andx 2 that make the value ofz minimum and−z maximum are the same.
    [Show full text]
  • Linear Programming Computer Interactive Course
    Innokenti V. Semoushin Linear Programming Computer Interactive Course Shake Verlag 2002 Gerhard Mercator University Duisburg Innokenti V. Semoushin Linear Programming Computer Interactive Course Shake Verlag 2002 Reviewers: Prof. Dr. Gerhard Freiling Prof. Dr. Ruediger Schultz Als Habilitationsschrift auf Empfehlung des Fachbereiches 11 - Mathematik Universitaet Duisburg gedruckt. Innokenti V. Semoushin Linear Programming: Computer Interactive Course Shake Verlag, 2002.- 125p. ISBN x-xxxxx-xxx-x The book contains some fundamental facts of Linear Programming the- ory and 70 simplex method case study assignments o®ered to students for implementing in their own software products. For students in Applied Mathematics, Mathematical Information Technology and others who wish to acquire deeper knowledge of the simplex method through designing their study projects and making wide range numerical experiments with them. ISBN x-xxxxx-xxx-x c Shake Verlag, 2002 Contents Preface 5 1. General De¯nitions 10 2. A Standard Linear Programming Problem 14 2.1. Problem statement . 14 2.2. Convexity of the set of feasible solutions . 15 2.3. Existence of feasible basic solutions (FBS) . 15 2.4. Identity of feasible basic solutions with vertices of the feasible region . 19 2.5. Coincidence of the LP problem solution with a vertex of feasible region . 20 3. The Simplex Method 22 3.1. Reduction of a linear programming problem to the canonical form for a basis 22 3.2. The simplex method for the case of obvious basic feasible solution . 24 3.3. Algorithm of the simplex method for the case of obvious basic feasible solution . 26 3.4. Computational aspects of the simplex method with the obvious basic solution 30 3.5.
    [Show full text]
  • George B. Dantzig Papers SC0826
    http://oac.cdlib.org/findaid/ark:/13030/c8s75gwd No online items Guide to the George B. Dantzig Papers SC0826 Daniel Hartwig & Jenny Johnson Department of Special Collections and University Archives March 2012 Green Library 557 Escondido Mall Stanford 94305-6064 [email protected] URL: http://library.stanford.edu/spc Guide to the George B. Dantzig SC0826 1 Papers SC0826 Language of Material: English Contributing Institution: Department of Special Collections and University Archives Title: George B. Dantzig papers creator: Dantzig, George Bernard, 1914-2005 Identifier/Call Number: SC0826 Physical Description: 91 Linear Feet Date (inclusive): 1937-1999 Special Collections and University Archives materials are stored offsite and must be paged 36-48 hours in advance. For more information on paging collections, see the department's website: http://library.stanford.edu/depts/spc/spc.html. Information about Access The materials are open for research use. Audio-visual materials are not available in original format, and must be reformatted to a digital use copy. Ownership & Copyright All requests to reproduce, publish, quote from, or otherwise use collection materials must be submitted in writing to the Head of Special Collections and University Archives, Stanford University Libraries, Stanford, California 94305-6064. Consent is given on behalf of Special Collections as the owner of the physical items and is not intended to include or imply permission from the copyright owner. Such permission must be obtained from the copyright owner, heir(s) or assigns. See: http://library.stanford.edu/depts/spc/pubserv/permissions.html. Restrictions also apply to digital representations of the original materials. Use of digital files is restricted to research and educational purposes.
    [Show full text]
  • Accelerating Revised Simplex Method Using GPU-Based Basis Update IEEE Access, 8: 52121-52138
    http://www.diva-portal.org This is the published version of a paper published in IEEE Access. Citation for the original published paper (version of record): Ali Shah, U., Yousaf, S., Ahmad, I., Ur Rehman, S., Ahmad, M O. (2020) Accelerating Revised Simplex Method using GPU-based Basis Update IEEE Access, 8: 52121-52138 https://doi.org/10.1109/ACCESS.2020.2980309 Access to the published version may require subscription. N.B. When citing this work, cite the original published paper. This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/ Permanent link to this version: http://urn.kb.se/resolve?urn=urn:nbn:se:kau:diva-77314 Received February 3, 2020, accepted March 2, 2020, date of publication March 12, 2020, date of current version March 25, 2020. Digital Object Identifier 10.1109/ACCESS.2020.2980309 Accelerating Revised Simplex Method Using GPU-Based Basis Update USMAN ALI SHAH 1, SUHAIL YOUSAF 1,2, IFTIKHAR AHMAD 1, SAFI UR REHMAN 3, AND MUHAMMAD OVAIS AHMAD 4 1Department of Computer Science and Information Technology, University of Engineering and Technology at Peshawar, Peshawar 25120, Pakistan 2Intelligent Systems Design Lab, National Center of Artificial Intelligence, University of Engineering and Technology at Peshawar, Peshawar 25120, Pakistan 3Department of Mining Engineering, Karakoram International University, Gilgit 15100, Pakistan 4Department of Mathematics and Computer Science, Karlstad University, 65188 Karlstad, Sweden Corresponding author: Muhammad Ovais Ahmad ([email protected]) ABSTRACT Optimization problems lie at the core of scientific and engineering endeavors. Solutions to these problems are often compute-intensive.
    [Show full text]
  • Ece6108 Course Outline
    The University of Connecticut Spring 2016 Dept. of ECE KRP ECE6108 Linear Programming and Network Flows General Information Instructor: Krishna R. Pattipati Room No.: ITE 350 Phone/Fax: 486-2890/5585 E-mail: [email protected] (best way to contact) Office hours: Thursday 10:00 AM -12:00 Noon or by appointment. Classes: Time: Monday, 6PM-9PM, Location: OAK 110 Text and Major References: Text: Dimitris Bertsimas and John N. Tsisiklis, Introduction to Linear Optimization, Athena Scientific, Belmont, MA, 1997. Major References: [BER] D. P. Bertsekas, Network Optimization, Athena Scientific, Belmont, MA, 1998. [AMO] R.K. Ahuja, T.L. Magnanti and J.B. Orlin, Network Flows, Prentice-Hall, New York, 1993. Course Objective This course is designed to provide students with a thorough understanding of concepts and methods for several important classes of Linear Programming (LP) and Network Flow problems, as well as the implementation and testing of these methods in software. Course Outline 1. Introduction. Classification of optimization problems, Measures of complexity of algorithms, Background on Matrix Algebra, Convex Analysis, Convex Programming Problem, LP as a special case of convex programming problem Reference: Text: Secs. 1.3, 1.5-1.6, 2.1-2.2; One week. 2. Linear Programming Problems. Examples, Graphical representation and solution, Standard, Canonical, and General forms of LP, Properties of LP Reference: Text: Secs. 2.3-2.6, 3.1; one week. 3. The Revised Simplex Method. Development of the Revised Simplex Method; Basis Updates, Storage Schemes, Round-off Errors, Decomposition Methods. Reference: Text: Secs. 3.2-3.8; 6.1-6.5; one and a half weeks 1 4.
    [Show full text]
  • Variants of the Simplex Algorithm in Linear Programming Problems with a Special Structure Carmen Recio Valcarce Trabajo De Fin D
    Variants of the simplex algorithm in linear programming problems with a special structure Carmen Recio Valcarce Trabajo de fin de grado en Matemáticas Universidad de Zaragoza Directora del trabajo: Herminia I. Calvete Fernández 12 de julio de 2017 Prologue Operations Research is the discipline that deals with the application of advanced analytical methods to help make better decisions. Mathematical models are used in order to represent real situations abstractly. Among these models we find optimization models, which are those that try to identify the optimal values of the decision variables for an objective function in the set of all the values of the variables that satisfy a set of given conditions. Based on the functions and variables properties we may classify the optimization problem as a linear, nonlinear, quadratic, integer, etc, optimization problem. Linear optimization problems satisfy: • The objective function is a linear function of the decision variables. • Every restriction can be written as a linear equation or inequation. The simplex algorithm gives us a systematic method for solving feasible linear optimization prob- lems. This algorithm has become very important due to the several areas of application, its extraordinary efficiency, and because not only does it solve problems numerically, but it also allows us to learn about the use of sensitivity analysis and duality theory. In this project we will describe some special implementations and variants of the simplex algorithm. These variants try to enhance some aspects such as computational cost or numerical stability. They are also used for solving large linear programming problems and integer optimization problems. Specif- ically, we will explain the revised simplex method, the case of problems with bounded variables, the decomposition principle and the column generation method.
    [Show full text]
  • High Performance Simplex Solver
    High performance simplex solver Qi Huangfu Doctor of Philosophy University of Edinburgh 2013 Abstract The dual simplex method is frequently the most efficient technique for solving linear program- ming (LP) problems. This thesis describes an efficient implementation of the sequential dual simplex method and the design and development of two parallel dual simplex solvers. In serial, many advanced techniques for the (dual) simplex method are implemented, includ- ing sparse LU factorization, hyper-sparse linear system solution technique, efficient approaches to updating LU factors and sophisticated dual simplex pivoting rules. These techniques, some of which are novel, lead to serial performance which is comparable with the best public domain dual simplex solver, providing a solid foundation for the simplex parallelization. During the implementation of the sequential dual simplex solver, the study of classic LU factor update techniques leads to the development of three novel update variants. One of them is comparable to the most efficient established approach but is much simpler in terms of im- plementation, and the other two are specially useful for one of the parallel simplex solvers. In addition, the study of the dual simplex pivoting rules identifies and motivates further investi- gation of how hyper-sparsity maybe promoted. In parallel, two high performance simplex solvers are designed and developed. One approach, based on a less-known dual pivoting rule called suboptimization, exploits parallelism across multiple iterations (PAMI). The other, based on the regular dual pivoting rule, exploits purely single iteration parallelism (SIP). The performance of PAMI is comparable to a world-leading commercial simplex solver. SIP is frequently complementary to PAMI in achieving speedup when PAMI results in slowdown.
    [Show full text]