Linear MPC • Linear Time-Varying and Nonlinear MPC • Quadratic Programming (QP) and Explicit MPC • Hybrid MPC, Stochastic MPC, Data-Driven MPC

Total Page:16

File Type:pdf, Size:1020Kb

Linear MPC • Linear Time-Varying and Nonlinear MPC • Quadratic Programming (QP) and Explicit MPC • Hybrid MPC, Stochastic MPC, Data-Driven MPC Model Predictive Control Alberto Bemporad imt.lu/ab Course page: http://cse.lab.imtlucca.it/~bemporad/mpc_course.html Course structure • Basic concepts of model predictive control (MPC) and linear MPC • Linear time-varying and nonlinear MPC • Quadratic programming (QP) and explicit MPC • Hybrid MPC, stochastic MPC, data-driven MPC • Numerical examples: – MPC Toolbox for MATLAB (linear/explicit/parameter-varying MPC) – Hybrid Toolbox for MATLAB (explicit MPC, hybrid systems) For additional background on linear systems and numerical optimization: http://cse.lab.imtlucca.it/~bemporad/intro_control_course.html http://cse.lab.imtlucca.it/~bemporad/optimization_course.html "Model Predictive Control" - © A. Bemporad. All rights reserved. 2/132 Model Predictive Control: Basic Concepts Model Predictive Control (MPC) optimization prediction model algorithm model-based optimizer process set-points inputs outputs r(t) u(t) y(t) measurements simplified likely Use a dynamical model of the process to predict its future evolution and choose-------------------- the “best” control action a good "Model Predictive Control" - © A. Bemporad. All rights reserved. 3/132 Model Predictive Control (MPC) • Goal: find the best control sequence over a future horizon of N steps past future r(t) N−1 y X k predicted outputs k y − k2 k u − k2 min W (yk r(t)) 2 + W (uk ur(t)) 2 uk k=0 manipulated inputs s:t: xk+1 = f(xk; uk) prediction model yk = g(xk) t t+k t+N umin ≤ uk ≤ umax constraints ymin ≤ yk ≤ ymax x0 = x(t) state feedback numerical optimization problem t+1 t+1+k t+N+1 • At each time t: – get new measurements to update the estimate of the current state x(t) – solve the optimization problem with respect to fu0; : : : ; uN−1g ∗ – apply only the first optimal move u(t) = u0, discard the remaining samples "Model Predictive Control" - © A. Bemporad. All rights reserved. 4/132 Daily-life examples of MPC • MPC is like playing chess ! • On-line (event-based) re-planning used in GPS navigation • You use MPC too when you drive ! "Model Predictive Control" - © A. Bemporad. All rights reserved. 5/132 MPC in industry • The MPC concept dates back to the 60’s (Rafal, Stevens, AiChE Journal, 1968) (Propoi, 1963) • MPC used in the process industries since the 80’s (Qin, Badgewell, 2003) (Bauer, Craig, 2008) Today APC (advanced process control) = MPC ©SimulateLive.com "Model Predictive Control" - © A. Bemporad. All rights reserved. 6/132 3 MPC in industry (Qin, Badgewell, 2003) S.J. Qin, T.A. Badgwell / Control Engineering Practice 11 (2003) 733–764 745 Table 6 • IndustrialSummary of linear survey MPC applications of MPC by areas applications (estimates based on vendor conducted survey; estimates in do mid not include 1999 applications by companies who have licensed vendor technology)a Area Aspen Honeywell Adersab Invensys SGSc Total Technology Hi-Spec Refining 1200 480 280 25 1985 Petrochemicals 450 80 — 20 550 Chemicals 100 20 3 21 144 Pulp and paper 18 50 — — 68 Air & Gas — 10 — — 10 Utility — 10 — 4 14 Mining/Metallurgy 8 6 7 16 37 Food Processing — — 41 10 51 Polymer 17 — — — 17 Furnaces — — 42 3 45 Aerospace/Defense — — 13 — 13 Automotive — — 7 — 7 Unclassified 40 40 1045 26 450 1601 Total 1833 696 1438 125 450 4542 First App. DMC:1985 PCT:1984 IDCOM:1973 IDCOM-M:1987 RMPCT:1991 HIECON:1986 1984 1985 OPC:1987 Largest App. 603 Â 283 225 Â 85 — 31 Â 12 — a The numbers reflect a snapshot survey conducted in mid-1999 and should not be read as static. A recent update by one vendor showed 80% increase in the number of applications. b Adersa applications through January 1, 1996 are reported here. Since there are many embedded Adersa applications, it is difficult to accurately Estimatesreport their number based or distribution. on vendor Adersa’s survey product literature indicates over 1000 applications of PFC alone by January 1, 1996. c The number of applications of SMOC includes in-house applications by Shell, which are unclassified. Therefore, only a total number is estimated here. "Model Predictive Control" - © A. Bemporad. All rights reserved. 7/132 Nonlinear The PFC algorithm can be used with several different model types. The most general of these is a discrete-time Aspen Target first-principles model that can be derived from 8 by PFC MVC NOVA-NLC integrating across the sample time: Process Perfecter xkþ1 ¼ fðxk; u k; vk; wkÞ; ð9aÞ First Empirical Principles y ¼ g ðxk; u kÞþn ; ð9bÞ DMCplus k k HIECON RMPCT although special care should be taken for stiff systems. PFC Connoisseur SMOC 3.2.2. Linear empirical models Linear Linear empirical models have been used in the majority of MPC applications to date, so it is no Fig. 4. Classification of model types used in industrial MPC surprise that most of the current MPC products are algorithms. based on this model type. A wide variety of model forms are used, but they can all be derived from 9 by linearizing about an operating point to get: x þ1 ¼ Ax þ B u þ B v þ B w ; ð10aÞ 3.2.1. Nonlinear first-principles models k k u k v k w k Nonlinear first-principles models used by the NOVA- y ¼ Cxk þ Du k þ n : ð10bÞ NLC algorithm are derived from mass and energy k k balances, and take exactly the form shown above in 8. The SMOC and PFC algorithms can use this model Unknown model parameters such as heat transfer form. An equivalent discrete-time transfer function coefficients and reaction kinetic constants are either model can be written in the form of a matrix fraction estimated off-line from test data or on-line using an description (Kailath, 1980): extended Kalman filter (EKF). In a typical application À 1 À 1 À 1 À 1 y ¼½I À Uy ðq Þ ½Uuðq Þu k þ Uvðq Þvk the process model has between 10 and 100 differential k À 1 algebraic equations. þ Uwðq Þwkþnk; ð11Þ MPC in industry M. Bauer, I.K. Craig / Journal of Process Control 18 (2008) 2–18 5 (Bauer, Craig, 2008) • EconomicM. assessment Bauer, I.K. Craig / Journal of ofAdvanced Process Control 18 (2008) Process 2–18 Control (APC) 5 Petrochemical North America Petrochemical North America Chemicals Africa Chemicals Africa Petroleum refining Europe Petroleum refining Europe Mineralsprocessing Mineralsprocessing Asia Pacific Asia Pacific Oil & Gas Oil & Gas South America South America Power & utilities Power & utilities 0% 10% 20% 30% Pulp & paper 0% 10% 20% 30% Pulp & paper M. Bauer,M. Bauer, I.K. Craig I.K. Craig / Journal / Journal of Process of Process Control Control 18 18 (2008) (2008) 2–18 2–18 7 7 Industrial gasesIndustrial gases Coal products Model predictive control Coal products Suppliers Suppliers Model predictive control StandardStandard Water & wastewaterWater & wastewater Users Users ConstraintConstraint control control FrequentlyFrequently Other Other Split-rangeSplit-range control control RarelyRarely Linear programming (LP) NeverNever 0% 20%0% 40% 20% 60% 40% 80% 60% 100% 80% 100% Linear programming (LP) Don't know Nonlinear control algorithms or models Don't know Fig. 2. Participants of APC survey by industry and by continent (total: 66 participants).Nonlinear Several answers control werealgorithms allowed or formodels industry sectors. Fig. 2. Participants of APC survey by industry and by continent (total: 66 participants). Several answers were allowedDead-time for industry compensation sectors. participants of APC survey by industry (worldwide) Dead-time compensation sections identify the respondent and capture the size of the the estimation of qualitative,Statistical non-monetary process control benefits sections identify the respondent and capture the size of the the estimation of qualitative,Statistical non-monetary process control benefits plant as well as the use of control technology within the (15%) as well as rules of thumb [47], such as that a new con- plant as well as the use of control technology within the (15%) as well as rules of thumb [47]Neural, suchnetworks as based that control a new con- organization. The third section queries the use of APC trol scheme will increaseNeural the networks throughput based control by a fixed percent- organization. The third section queries the use of APC trol scheme will increase the throughputExpert system by based a fixed control percent- technology and tools. Sections four to six are key to the age (7%). For the waterExpert and system waste-water based control industries, Lant technologyeconomic and tools. assessment Sections four process. to six While are Section key tofour the coversage (7%).and For Steff theens water[48] provide and waste-water a qualitativeFuzzy self-assessmentindustries,logic control Lant form Fuzzy logic control economic assessmentthe managerial process. process While by asking Section about four reporting, covers decisionand Stetoffens establish[48] provide how good a qualitative the processInternal model self-assessment control control is. (IMC) The disadvan- form Internal model control (IMC) the managerialmaking process and by budgeting, asking about Section reporting, five is concerned decision withto the establishtage ofhow such good a table the processis thatAdaptive it control is industry / selftuning is. The related control disadvan- and has to making andengineering budgeting, process Section and five the is estimation concerned of withcost and the benefits.tage ofbe such updated a table with is that the developmentAdaptive it is industry / selftuningDirectsynthesis of related newcontrol technologies. and(DS) has to engineeringSection process sixand requests the estimation the respondents of cost and opinion benefits. aboutbe the updatedThe with questionnaire the development resultsDirectsynthesis ofsupport new technologies. the (DS) industry–univer- Section sixaccuracy, requests importance the respondents and satisfaction opinion with about the current the esti-Thesity questionnaire study by Marlin results and support co-workers the industry–univer-[49], which0% high- 20% 40% 60% 80% 100% accuracy, importancemation process and satisfaction in place as well with as the about current future esti- trends.sity studylighted by theMarlin importance and co-workers of determiningFig.[49] 4., Industrial which the0% base high-use 20% of case APC 40% methods: 60% survey 80% results.
Recommended publications
  • Xpress Nonlinear Manual This Material Is the Confidential, Proprietary, and Unpublished Property of Fair Isaac Corporation
    R FICO Xpress Optimization Last update 01 May, 2018 version 33.01 FICO R Xpress Nonlinear Manual This material is the confidential, proprietary, and unpublished property of Fair Isaac Corporation. Receipt or possession of this material does not convey rights to divulge, reproduce, use, or allow others to use it without the specific written authorization of Fair Isaac Corporation and use must conform strictly to the license agreement. The information in this document is subject to change without notice. If you find any problems in this documentation, please report them to us in writing. Neither Fair Isaac Corporation nor its affiliates warrant that this documentation is error-free, nor are there any other warranties with respect to the documentation except as may be provided in the license agreement. ©1983–2018 Fair Isaac Corporation. All rights reserved. Permission to use this software and its documentation is governed by the software license agreement between the licensee and Fair Isaac Corporation (or its affiliate). Portions of the program may contain copyright of various authors and may be licensed under certain third-party licenses identified in the software, documentation, or both. In no event shall Fair Isaac Corporation or its affiliates be liable to any person for direct, indirect, special, incidental, or consequential damages, including lost profits, arising out of the use of this software and its documentation, even if Fair Isaac Corporation or its affiliates have been advised of the possibility of such damage. The rights and allocation of risk between the licensee and Fair Isaac Corporation (or its affiliates) are governed by the respective identified licenses in the software, documentation, or both.
    [Show full text]
  • Solving Mixed Integer Linear and Nonlinear Problems Using the SCIP Optimization Suite
    Takustraße 7 Konrad-Zuse-Zentrum D-14195 Berlin-Dahlem fur¨ Informationstechnik Berlin Germany TIMO BERTHOLD GERALD GAMRATH AMBROS M. GLEIXNER STEFAN HEINZ THORSTEN KOCH YUJI SHINANO Solving mixed integer linear and nonlinear problems using the SCIP Optimization Suite Supported by the DFG Research Center MATHEON Mathematics for key technologies in Berlin. ZIB-Report 12-27 (July 2012) Herausgegeben vom Konrad-Zuse-Zentrum f¨urInformationstechnik Berlin Takustraße 7 D-14195 Berlin-Dahlem Telefon: 030-84185-0 Telefax: 030-84185-125 e-mail: [email protected] URL: http://www.zib.de ZIB-Report (Print) ISSN 1438-0064 ZIB-Report (Internet) ISSN 2192-7782 Solving mixed integer linear and nonlinear problems using the SCIP Optimization Suite∗ Timo Berthold Gerald Gamrath Ambros M. Gleixner Stefan Heinz Thorsten Koch Yuji Shinano Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany, fberthold,gamrath,gleixner,heinz,koch,[email protected] July 31, 2012 Abstract This paper introduces the SCIP Optimization Suite and discusses the ca- pabilities of its three components: the modeling language Zimpl, the linear programming solver SoPlex, and the constraint integer programming frame- work SCIP. We explain how these can be used in concert to model and solve challenging mixed integer linear and nonlinear optimization problems. SCIP is currently one of the fastest non-commercial MIP and MINLP solvers. We demonstrate the usage of Zimpl, SCIP, and SoPlex by selected examples, give an overview of available interfaces, and outline plans for future development. ∗A Japanese translation of this paper will be published in the Proceedings of the 24th RAMP Symposium held at Tohoku University, Miyagi, Japan, 27{28 September 2012, see http://orsj.or.
    [Show full text]
  • Numericaloptimization
    Numerical Optimization Alberto Bemporad http://cse.lab.imtlucca.it/~bemporad/teaching/numopt Academic year 2020-2021 Course objectives Solve complex decision problems by using numerical optimization Application domains: • Finance, management science, economics (portfolio optimization, business analytics, investment plans, resource allocation, logistics, ...) • Engineering (engineering design, process optimization, embedded control, ...) • Artificial intelligence (machine learning, data science, autonomous driving, ...) • Myriads of other applications (transportation, smart grids, water networks, sports scheduling, health-care, oil & gas, space, ...) ©2021 A. Bemporad - Numerical Optimization 2/102 Course objectives What this course is about: • How to formulate a decision problem as a numerical optimization problem? (modeling) • Which numerical algorithm is most appropriate to solve the problem? (algorithms) • What’s the theory behind the algorithm? (theory) ©2021 A. Bemporad - Numerical Optimization 3/102 Course contents • Optimization modeling – Linear models – Convex models • Optimization theory – Optimality conditions, sensitivity analysis – Duality • Optimization algorithms – Basics of numerical linear algebra – Convex programming – Nonlinear programming ©2021 A. Bemporad - Numerical Optimization 4/102 References i ©2021 A. Bemporad - Numerical Optimization 5/102 Other references • Stephen Boyd’s “Convex Optimization” courses at Stanford: http://ee364a.stanford.edu http://ee364b.stanford.edu • Lieven Vandenberghe’s courses at UCLA: http://www.seas.ucla.edu/~vandenbe/ • For more tutorials/books see http://plato.asu.edu/sub/tutorials.html ©2021 A. Bemporad - Numerical Optimization 6/102 Optimization modeling What is optimization? • Optimization = assign values to a set of decision variables so to optimize a certain objective function • Example: Which is the best velocity to minimize fuel consumption ? fuel [ℓ/km] velocity [km/h] 0 30 60 90 120 160 ©2021 A.
    [Show full text]
  • Benchmarks for Current Linear and Mixed Integer Optimization Solvers
    ACTA UNIVERSITATIS AGRICULTURAE ET SILVICULTURAE MENDELIANAE BRUNENSIS Volume 63 207 Number 6, 2015 http://dx.doi.org/10.11118/actaun201563061923 BENCHMARKS FOR CURRENT LINEAR AND MIXED INTEGER OPTIMIZATION SOLVERS Josef Jablonský1 1 Department of Econometrics, Faculty of Informatics and Statistics, University of Economics, Prague, nám. W. Churchilla 4, 130 67 Praha 3, Czech Republic Abstract JABLONSKÝ JOSEF. 2015. Benchmarks for Current Linear and Mixed Integer Optimization Solvers. Acta Universitatis Agriculturae et Silviculturae Mendelianae Brunensis, 63(6): 1923–1928. Linear programming (LP) and mixed integer linear programming (MILP) problems belong among very important class of problems that fi nd their applications in various managerial consequences. The aim of the paper is to discuss computational performance of current optimization packages for solving large scale LP and MILP optimization problems. Current market with LP and MILP solvers is quite extensive. Probably among the most powerful solvers GUROBI 6.0, IBM ILOG CPLEX 12.6.1, and XPRESS Optimizer 27.01 belong. Their attractiveness for academic research is given, except their computational performance, by their free availability for academic purposes. The solvers are tested on the set of selected problems from MIPLIB 2010 library that contains 361 test instances of diff erent hardness (easy, hard, and not solved). Keywords: benchmark, linear programming, mixed integer linear programming, optimization, solver INTRODUCTION with integer variables need not be solved even Solving linear and mixed integer linear in case of a very small size of the given problem. optimization problems (LP and MILP) that Real-world optimization problems have usually belong to one of the most o en modelling tools, many thousands of variables and/or constraints.
    [Show full text]
  • Computational Aspects of Infeasibility Analysis in Mixed Integer Programming
    Takustr. 7 Zuse Institute Berlin 14195 Berlin Germany JAKOB WITZIG TIMO BERTHOLD STEFAN HEINZ Computational Aspects of Infeasibility Analysis in Mixed Integer Programming ZIB Report 19-54 (November 2019) Zuse Institute Berlin Takustr. 7 14195 Berlin Germany Telephone: +49 30-84185-0 Telefax: +49 30-84185-125 E-mail: [email protected] URL: http://www.zib.de ZIB-Report (Print) ISSN 1438-0064 ZIB-Report (Internet) ISSN 2192-7782 Computational Aspects of Infeasibility Analysis in Mixed Integer Programming Jakob Witzig,1 Timo Berthold,2 and Stefan Heinz3 1Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany [email protected] 2Fair Isaac Germany GmbH, Stubenwald-Allee 19, 64625 Bensheim, Germany [email protected] 3Gurobi GmbH, Ulmenstr. 37–39, 60325 Frankfurt am Main, Germany [email protected] November 6, 2019 Abstract The analysis of infeasible subproblems plays an important role in solv- ing mixed integer programs (MIPs) and is implemented in most major MIP solvers. There are two fundamentally different concepts to gener- ate valid global constraints from infeasible subproblems. The first is to analyze the sequence of implications, obtained by domain propagation, that led to infeasibility. The result of this analysis is one or more sets of contradicting variable bounds from which so-called conflict constraints can be generated. This concept is called conflict graph analysis and has its origin in solving satisfiability problems and is similarly used in con- straint programming. The second concept is to analyze infeasible linear programming (LP) relaxations. Every ray of the dual LP provides a set of multipliers that can be used to generate a single new globally valid linear constraint.
    [Show full text]
  • FICO Xpress Optimization Suite Webinar
    FICO Xpress Optimization Suite Webinar Oliver Bastert Senior Manager Xpress Product Management September 22 2011 Confidential. This presentation is provided for the recipient only and cannot be reproduced or shared without Fair Isaac Corporation's express consent. 1 © 2011 Fair Isaac Corporation. Agenda » Introduction to FICO » Introduction to FICO Xpress Optimization Suite » Performance » Distributed Modelling and Solving » Case Q&A 2 © 2011 Fair Isaac Corporation. Confidential.© 2011 Fair Isaac Corporation. Confidential. Introduction to FICO 3 © 2011 Fair Isaac Corporation. Confidential. FICO Snapshot The leader in predictive analytics for decision management Founded: 1956 Profile NYSE: FICO Revenues: $605 million (fiscal 2010) Scores and related analytic models Products Analytic applications for risk management, fraud, marketing and Services Tools for decision management Clients and 5,000+ clients in 80 countries Markets Industry focus: Banking, insurance, retail, health care #1 in services operations analytics (IDC) Recent #7 in worldwide business analytics software (IDC) Rankings #26 in the FinTech 100 (American Banker) 20+ offices worldwide, HQ in Minneapolis, USA Offices 2,200 employees Regional Hubs: San Rafael (CA), New York, London, Birmingham (UK), Munich, Madrid, Sao Paulo, Bangalore, Beijing, Singapore 4 © 2011 Fair Isaac Corporation. Confidential. FICO delivers superior predictive analytic solutions that drive smarter decisions. Thousands of businesses worldwide, including 9 of the top Fortune 10, rely on FICO to make every
    [Show full text]
  • CME 338 Large-Scale Numerical Optimization Notes 2
    Stanford University, ICME CME 338 Large-Scale Numerical Optimization Instructor: Michael Saunders Spring 2019 Notes 2: Overview of Optimization Software 1 Optimization problems We study optimization problems involving linear and nonlinear constraints: NP minimize φ(x) n x2R 0 x 1 subject to ` ≤ @ Ax A ≤ u; c(x) where φ(x) is a linear or nonlinear objective function, A is a sparse matrix, c(x) is a vector of nonlinear constraint functions ci(x), and ` and u are vectors of lower and upper bounds. We assume the functions φ(x) and ci(x) are smooth: they are continuous and have continuous first derivatives (gradients). Sometimes gradients are not available (or too expensive) and we use finite difference approximations. Sometimes we need second derivatives. We study algorithms that find a local optimum for problem NP. Some examples follow. If there are many local optima, the starting point is important. x LP Linear Programming min cTx subject to ` ≤ ≤ u Ax MINOS, SNOPT, SQOPT LSSOL, QPOPT, NPSOL (dense) CPLEX, Gurobi, LOQO, HOPDM, MOSEK, XPRESS CLP, lp solve, SoPlex (open source solvers [7, 34, 57]) x QP Quadratic Programming min cTx + 1 xTHx subject to ` ≤ ≤ u 2 Ax MINOS, SQOPT, SNOPT, QPBLUR LSSOL (H = BTB, least squares), QPOPT (H indefinite) CLP, CPLEX, Gurobi, LANCELOT, LOQO, MOSEK BC Bound Constraints min φ(x) subject to ` ≤ x ≤ u MINOS, SNOPT LANCELOT, L-BFGS-B x LC Linear Constraints min φ(x) subject to ` ≤ ≤ u Ax MINOS, SNOPT, NPSOL 0 x 1 NC Nonlinear Constraints min φ(x) subject to ` ≤ @ Ax A ≤ u MINOS, SNOPT, NPSOL c(x) CONOPT, LANCELOT Filter, KNITRO, LOQO (second derivatives) IPOPT (open source solver [30]) Algorithms for finding local optima are used to construct algorithms for more complex optimization problems: stochastic, nonsmooth, global, mixed integer.
    [Show full text]
  • Parallel Solvers for Mixed Integer Linear Optimization
    Industrial and Systems Engineering Parallel Solvers for Mixed Integer Linear Optimization Ted Ralphs Lehigh University, Bethlehem, PA, USA Yuji Shinano Zuse Institute Berlin, Takustraße 7, 14195 Berlin, Germany Timo Berthold Fair Isaac Germany GmbH, Germany, Takustraße 7, 14195 Berlin, Germany Thorsten Koch Zuse Institute Berlin, Takustraße 7, 14195 Berlin, Germany COR@L Technical Report 16T-014-R3 Parallel Solvers for Mixed Integer Linear Optimization Ted Ralphs∗1, Yuji Shinanoy2, Timo Bertholdz3, and Thorsten Kochx4 1Lehigh University, Bethlehem, PA, USA 2Zuse Institute Berlin, Takustraße 7, 14195 Berlin, Germany 3Fair Isaac Germany GmbH, Germany, Takustraße 7, 14195 Berlin, Germany 4Zuse Institute Berlin, Takustraße 7, 14195 Berlin, Germany Original Publication: December 30, 2016 Last Revised: May 4, 2017 Abstract In this article, we provide an overview of the current state of the art with respect to solution of mixed integer linear optimization problems (MILPS) in parallel. Sequential algorithms for solving MILPs have improved substantially in the last two decades and commercial MILP solvers are now considered effective off-the-shelf tools for optimization. Although concerted development of parallel MILP solvers has been underway since the 1990s, the impact of improvements in sequential solution algorithms has been much greater than that which came from the application of parallel computing technologies. As a result, parallelization efforts have met with only relatively modest success. In addition, improvements to the underlying sequential solution technologies have actually been somewhat detrinental with respect to the goal of creating scalable parallel algorithms. This has made efforts at parallelization an even greater challenge in recent years. With the pervasiveness of multi-core CPUs, current state-of-the-art MILP solvers have now all been parallelized and research on parallelization is once again gaining traction.
    [Show full text]
  • GAMS W/ NEOS and Economic Equilibrium Modeling with Julia/Jump Adam Christensen All the Best Presentations Begin with an Outline
    GAMS w/ NEOS and Economic Equilibrium Modeling with Julia/JuMP Adam Christensen All the best presentations begin with an outline... ● Our goals ● Building out GAMS/NEOS capabilities ● NEOS Demo ● Extended Economic Modeling ● End-to-End Value Proposition ● Experimental Projects Our Goals ● 100% open source economic database ● Members can execute full build stream ● Source of canonical models ● Knowledge base for extended economic modeling ○ Model library for multiple languages ○ Helper tools/data handling ● End-to-End Value Add ○ Data pre-processing tools ○ Model output reduction ○ Visualization ● Economic Software Incubator Gettin’ the Goods... ● windc.wisc.edu ○ Click on “Downloads” ● WiNDC Flavors ○ Precompiled GDX ○ JSON (download as a zip archive) ○ Re-build your own GDX from source (windc.zip) ○ All original data source files are available (datasources.zip) Releases going forward... ● Platform independent (Windows, Mac) ● Releases will occur ~1-2 times per year ● Data updates and bug reports will be available ● WiNDC releases will always be tested against different versions of GAMS ● Releases will be numbered Releases going forward... ● Platform independent (Windows, Mac) ● Releases will occur ~1-2 times per year ● Data updates and bug reports will be available ● WiNDC releases will always be tested against different versions of GAMS ● Releases will be numbered In a nutshell… we want to make it easy for researchers to reference this database in their own publications GAMS/NEOS Capabilities What is NEOS? ● Network Enabled Optimization System ● neos-server.org ● Online access to algorithms that solve many classes of optimization problems ● Jobs can be submitted online through a webform ● KESTREL brings your GAMS job to NEOS ● GDX results return as expected hi folks.
    [Show full text]
  • Learning to Scale Mixed-Integer Programs
    Learning To Scale Mixed-Integer Programs Timo Berthold, Gregor Hendel* December 18, 2020 Abstract Many practical applications require the solution of numerically chal- lenging linear programs (LPs) and mixed integer programs (MIPs). Scal- ing is a widely used preconditioning technique that aims at reducing the error propagation of the involved linear systems, thereby improving the numerical behavior of the dual simplex algorithm and, consequently, LP- based branch-and-bound. A reliable scaling method often makes the differ- ence whether these problems can be solved correctly or not. In this paper, we investigate the use of machine learning to choose at the beginning of the solution process between two common scaling methods: Standard scaling and Curtis-Reid scaling. The latter often, but not always, leads to a more robust solution process, but may suffer from longer solution times. Rather than training for overall solution time, we propose to use the attention level of a MIP solution process as a learning label. We evaluate the predictive power of a random forest approach and a linear regressor that learns the (square root of the) difference in attention level. It turns out that the resulting classification not only reduces various types of nu- merical errors by large margins, but it also improves the performance of the dual simplex algorithm. The learned model has been implemented within the FICO Xpress MIP solver and it is used by default since release 8.9, May 2020, to determine the scaling algorithm Xpress applies before solving an LP or a MIP. Introduction Numerics play an important role in solving linear and mixed integer programs (LPs and MIPs) [25].
    [Show full text]
  • Computational Integer Programming Lecture 3
    Computational Integer Programming Lecture 3: Software Dr. Ted Ralphs Computational MILP Lecture 3 1 Introduction to Software (Solvers) • There is a wealth of software available for modeling, formulation, and solution of MILPs. • Commercial solvers { IBM CPLEX { FICO XPress { Gurobi • Open Source and Free for Academic Use { COIN-OR Optimization Suite (Cbc, SYMPHONY, Dip) { SCIP { lp-solve { GLPK { MICLP { Constraint programming systems 1 Computational MILP Lecture 3 2 Introduction to Software (Modeling) • There are two main categories of modeling software. { Algebraic Modeling Languages (AMLs) { Constraint Programming Systems (CPSs) • According to our description of the modeling process, AMLs should probably be called \formulation languages". • AMLs assume the problem will be formulated as a mathematical optimization problem. • Although AMLs make the formulation process more convenient, the user must provide an initial \formulation" and decide on an appropriate solver. • Solvers do some internal reformulation, but this is limited. • Constraint programming systems use a much higher level description of the model itself. • Reformulation is done internally before automatically passing the problem to the most appropriate of a number of solvers. 2 Computational MILP Lecture 3 3 Algebraic Modeling Languages • A key concept is the separation of \model" (formulation, really) from \data." • Generally speaking, we follow a four-step process in modeling with AMLs. { Develop an \abstract model" (more like a formulation). { Populate the formulation with data. { Solve the Formulation. { Analyze the results. • These four steps generally involve different pieces of software working in concert. • For mathematical optimization problems, the modeling is often done with an algebraic modeling system. • Data can be obtained from a wide range of sources, including spreadsheets.
    [Show full text]
  • New MIP Modeling Constructs in Xpress Mosel to Handle Logical Relations and Certain Nonlinear Constraints
    New MIP modeling constructs in Xpress Mosel to handle logical relations and certain nonlinear constraints Susanne Heipcke1, Yves Colombani1, Sébastien Lannez1 Xpress Optimization, FICO, FICO House, Starley Way, Birmingham B37 7GN, UK {SusanneHeipcke,YvesColombani,SebastienLannez}@fico.com Mots-clés : Mathematical modeling, Mixed-Integer Programming, linearization 1 Introduction The formulation of mathematical optimization models often involves certain nonlinear con- structs, such as absolute values or logical relations. A widely used approach to handle such cases consists in linearizing the nonlinear expressions to make the model suitable for solving via a MIP solver, which may come at the expense of solution speed or quality. Since the introduction of Special Ordered Sets (SOS), semi-continuous and partial integer variables in the late 1980s [1] an increasing number of special modeling constructs have been introduced into MIP solvers. In this talk we are going to take a look at a set of recent addi- tions to the FICO Xpress Optimizer known as General Constraints, including a discussion of formulation alternatives via binary variables or indicator constraints, and their use in model formulation with Xpress Mosel. 2 General Constraints General constraints are specific nonlinear expressions that are recognized by MIP solvers : — absolute value, minimum or maximum value of discrete or continuous decision variables — logical constraints : ‘and’ and ‘or’ over binary variables — piecewise linear : can be used in place of SOS-2 formulations The solver chooses the most appropriate representation and applies presolving to these constructs. Structural information that is available on the modeling level can thus be passed directly to the solver instead of having to apply transformations during matrix generation (e.g.
    [Show full text]