Stochastic Optimization: Solvers and Tools
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
MIE 1612: Stochastic Programming and Robust Optimization
MIE 1612: Stochastic Programming and Robust Optimization Fall 2019 Syllabus Instructor: Prof. Merve Bodur Office: BA8106 Office hour: Wednesday 2-3pm (or by appointment) E-mail: [email protected] P.S. Please include course code (MIE 1612) in your email subject TA: Maryam Daryalal Office hour: Monday 2:30-3:30pm, in BA8119 (or by appointment) E-mail: [email protected] P.S. Please include course code (MIE 1612) in your email subject Lectures: Monday 4-6pm (GB119) and Wednesday 1-2pm (GB303) Suggested texts: Lectures on Stochastic Programming { Modeling and Theory, SIAM, Shapiro, Dentcheva, and Ruszczy´nski,2009. Introduction to Stochastic Programming, Springer-Verlag, Birge and Louveaux, 2011. Stochastic Programming, Wiley, Kall and Wallace, 1994. Stochastic Programming, Handbooks in OR and MS, Elsevier, Ruszczy´nskiand Shapiro, 2003. Robust Optimization, Princeton University Press, Ben-Tal, El Ghaoui, and Nemirovski, 2009. Course web pages: Quercus, Piazza Official course description: Stochastic programming and robust optimization are optimization tools deal- ing with a class of models and algorithms in which data is affected by uncertainty, i.e., some of the input data are not perfectly known at the time the decisions are made. Topics include modeling uncertainty in optimization problems, two-stage and multistage stochastic programs with recourse, chance constrained pro- grams, computational solution methods, approximation and sampling methods, and applications. Knowledge of linear programming, probability and statistics are required, while programming ability and knowledge of integer programming are helpful. Prerequisite: MIE262, APS1005 or equivalent, and MIE231, APS106S or equivalent. 1 Overview The aim of stochastic programming and robust optimization is to find optimal decisions in problems which involve uncertain data. -
A Review on the Performance of Linear and Mixed Integer Two-Stage Stochastic Programming Algorithms and Software
Noname manuscript No. (will be inserted by the editor) A Review on the Performance of Linear and Mixed Integer Two-Stage Stochastic Programming Algorithms and Software Juan J. Torres · Can Li · Robert M. Apap · Ignacio E. Grossmann Received: date / Accepted: date Abstract This paper presents a tutorial on the state-of-the-art methodologies for the solution of two-stage (mixed-integer) linear stochastic programs and provides a list of software designed for this purpose. The methodologies are classified according to the decomposition alternatives and the types of the vari- ables in the problem. We review the fundamentals of Benders Decomposition, Dual Decomposition and Progressive Hedging, as well as possible improve- ments and variants. We also present extensive numerical results to underline the properties and performance of each algorithm using software implemen- tations including DECIS, FORTSP, PySP, and DSP. Finally, we discuss the strengths and weaknesses of each methodology and propose future research directions. Keywords Stochastic programming · L-shaped method · Scenario Decom- position · Software benchmark Juan J. Torres Universit´eParis 13, Sorbonne Paris Cit´e,LIPN, CNRS, (UMR 7030), France E-mail: torresfi[email protected] Can Li Department of Chemical Engineering, Carnegie Mellon University, 5000 Forbes Ave, Pitts- burgh, PA 15213, USA E-mail: [email protected] Robert M. Apap Department of Chemical Engineering, Carnegie Mellon University, 5000 Forbes Ave, Pitts- burgh, PA 15213, USA Ignacio E. Grossmann Department of Chemical Engineering, Carnegie Mellon University, 5000 Forbes Ave, Pitts- burgh, PA 15213, USA E-mail: [email protected] 2 Juan J. Torres et al. 1 Introduction In the modeling and optimization of real-world problems, there is usually a level of uncertainty associated with the input parameters and their future outcomes. -
Extending Algebraic Modelling Languages for Stochastic Programming
Extending algebraic modelling languages for Stochastic Programming Christian Valente, Gautam Mitra, Mustapha Sadki CARISMA, Brunel University and OptiRisk Systems Uxbridge, Middlesex, UK Robert Fourer Northwestern University, Evanston, IL Abstract Algebraic modelling languages (AML) have gained wide acceptance and use in Mathematical Programming by researchers and practitioners. At a basic level, stochastic programming models can be defined using these languages by constructing their deterministic equivalent. Unfortunately, this leads to very large model data instances. We propose a direct approach in which the random values of the model coefficients and the stage structure of the decision variables and constraints are "overlaid" on the underlying deterministic (core) model of the SP problems. This leads not only to a natural definition of the SP model, the resulting generated instance is also a compact representation of the otherwise large problem data. The proposed constructs enable the formulation of two stage and multistage scenario based recourse problems. The design is presented as a stochastic extension of the AMPL language which we call SAMPL; this in turn is embedded in an environment called SPInE (Stochastic Programming Integrated Environment) which facilitates modelling and investigation of SP problems. Table of Contents 1 Introduction.............................................................................................................2 1.1 Background .................................................................................................................2 -
Optimization of Conditional Value-At-Risk
Implemented in Portfolio Safeguard by AORDA.com Optimization of conditional value-at-risk R. Tyrrell Rockafellar Department of Applied Mathematics, University of Washington, 408 L Guggenheim Hall, Box 352420, Seattle, Washington 98195-2420, USA Stanislav Uryasev Department of Industrial and Systems Engineering, University of Florida, PO Box 116595, 303 Weil Hall, Gainesville, Florida 32611-6595, USA A new approach to optimizing or hedging a portfolio of ®nancial instruments to reduce risk is presented and tested on applications. It focuses on minimizing conditional value-at-risk CVaR) rather than minimizing value-at-risk VaR),but portfolios with low CVaR necessarily have low VaR as well. CVaR,also called mean excess loss,mean shortfall,or tail VaR,is in any case considered to be a more consistent measure of risk than VaR. Central to the new approach is a technique for portfolio optimization which calculates VaR and optimizes CVaR simultaneously. This technique is suitable for use by investment companies,brokerage ®rms,mutual funds, and any business that evaluates risk. It can be combined with analytical or scenario- based methods to optimize portfolios with large numbers of instruments,in which case the calculations often come down to linear programming or nonsmooth programming. The methodology can also be applied to the optimization of percentiles in contexts outside of ®nance. 1. INTRODUCTION This paper introduces a new approach to optimizing a portfolio so as to reduce the risk of high losses. Value-at-risk VaR) has a role in the approach, but the emphasis is on conditional value-at-risk CVaR), which is also known as mean excess loss, mean shortfall, or tail VaR. -
Mean-Risk Objectives in Stochastic Programming
Shabbir Ahmed Mean-risk objectives in stochastic programming April 20, 2004 Abstract. Traditional stochastic programming is risk neutral in the sense that it is concerned with the optimization of an expectation criterion. A common approach to addressing risk in decision making problems is to consider a weighted mean-risk objective, where some dispersion statistic is used as a measure of risk. We investigate the computational suitability of various mean-risk objective functions in addressing risk in stochastic programming models. We prove that the classical mean-variance criterion leads to computational intractability even in the simplest stochastic programs. On the other hand, a number of alternative mean-risk functions are shown to be computationally tractable using slight variants of existing stochastic program- ming decomposition algorithms. We propose a parametric cutting plane algorithm to generate the entire mean-risk efficient frontier for a particular mean-risk objective. Key words. Stochastic programming, mean-risk objectives, computational complexity, cut- ting plane algorithms. 1. Introduction This paper is concerned with stochastic programming problems of the form minf E[f(x; !)] : x 2 Xg; (1) where x 2 Rn is a vector of decision variables; X ⊂ Rn is a non-empty set of feasible decisions; (Ω; F; P ) is a probability space with elements !; and f : Rn × Ω 7! R is a cost function such that f(·; !) is convex for all ! 2 Ω, and f(x; ·) is F-measurable and P -integrable for all x 2 Rn. Of particular interest are instances of (1) corresponding to two-stage stochastic linear programs (cf. [1, 13]), where X is a polyhedron and f(x; !) = cT x + Q(x; ξ(!)) (2) with Q(x; ξ) = minfqT y : W y = h + T x; y ≥ 0g: (3) Here ξ = (q; W; h; T ) represents a particular realization of the random data ξ(!) for the linear program in (3). -
Computational Optimization and Applications
Computational Optimization and Applications A Review on the Performance of Linear and Mixed Integer Two-Stage Stochastic Programming Algorithms and Software --Manuscript Draft-- Manuscript Number: Full Title: A Review on the Performance of Linear and Mixed Integer Two-Stage Stochastic Programming Algorithms and Software Article Type: Manuscript Keywords: Stochastic programming; L-shaped method; Scenario Decomposition; Software benchmark Corresponding Author: I. Grossmann Carnegie-Mellon University Pittsburgh,, PA UNITED STATES Corresponding Author Secondary Information: Corresponding Author's Institution: Carnegie-Mellon University Corresponding Author's Secondary Institution: First Author: Juan J Torres First Author Secondary Information: Order of Authors: Juan J Torres Can Li Robert M Apap I. Grossmann Order of Authors Secondary Information: Funding Information: Powered by Editorial Manager® and ProduXion Manager® from Aries Systems Corporation Manuscript Click here to access/download;Manuscript;TwoStage.pdf Click here to view linked References Noname manuscript No. (will be inserted by the editor) 1 2 3 4 5 A Review on the Performance of Linear and 6 Mixed Integer Two-Stage Stochastic Programming 7 Algorithms and Software 8 9 10 Juan J. Torres · Can Li · Robert M. 11 Apap · Ignacio E. Grossmann 12 13 14 15 16 Received: date / Accepted: date 17 18 19 Abstract This paper presents a tutorial on the state-of-the-art methodologies 20 for the solution of two-stage (mixed-integer) linear stochastic programs and 21 provides a list of software designed for this purpose. The methodologies are 22 classified according to the decomposition alternatives and the types of the vari- 23 ables in the problem. We review the fundamentals of Benders Decomposition, 24 Dual Decomposition and Progressive Hedging, as well as possible improve- 25 26 ments and variants. -
A Modeling Language for Mathematical Programming
AMPL A Modeling Language for Mathematical Programming Second Edition AMPL A Modeling Language for Mathematical Programming Second Edition Robert Fourer Northwestern University David M. Gay AMPL Optimization LLC Brian W. Kernighan Princeton University DUXBURY ———————————————— THOMSON ________________________________________________________________________________ Australia • Canada • Mexico • Singapore • Spain • United Kingdom • United States This book was typeset (grap|pic|tbl|eqn|troff -mpm) in Times and Courier by the authors. Copyright 2003 by Robert Fourer, David M. Gay and Brian Kernighan. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, without the prior written permission of the publisher. Printed in the United States of America. Published simultaneously in Canada. About the authors: Robert Fourer received his Ph.D. in operations research from Stanford University in 1980, and is an active researcher in mathematical programming and modeling language design. He joined the Department of Industrial Engineering and Management Sciences at Northwestern University in 1979, and served as chair of the department from 1989 to 1995. David M. Gay received his Ph.D. in computer science from Cornell University in 1975, and was in the Computing Science Research Center at Bell Laboratories from 1981 to 2001; he is now CEO of AMPL Optimization LLC. His research interests include numerical analysis, optimization, and scientific computing. Brian Kernighan received his Ph.D. in electrical engineering from Princeton University in 1969. He was in the Computing Science Research Center at Bell Laboratories from 1969 to 2000, and now teaches in the Computer Science department at Princeton. -
Stochastic Optimization: Recent Enhancements in Algebraic Modeling Systems
Stochastic Optimization: Recent Enhancements in Algebraic Modeling Systems Lutz Westermann [email protected] GAMS Software GmbH http://www.gams.de 24th EUROPEAN CONFERENCE ON OPERATIONAL RESEARCH 1 Lisbon, Portugal, July 11-14, 2010 GAMS at a Glance General Algebraic Modeling System: Algebraic Modeling Language, Integrated Solver, Model Libraries, Connectivity- & Productivity Tools Design Principles: • Balanced mix of declarative and procedural elements • Open architecture and interfaces to other systems • Different layers with separation of: – model and data – model and solution methods – model and operating system – model and interface 2 An introducing Example • The Newsboy (Newsvendor) Problem: – A newsboy purchases newspapers for a price C – He is faced with uncertain demand D – He has to satisfy his customers demand or has to pay a penalty Q>C per newspaper • Decisions to make: – How much newspaper should he buy “here and now” (without knowing the outcome of the uncertain demand)? => First-stage decision – How much customers have to be dropped after the outcome becomes known? => Second-stage or recourse decision – Recourse decisions can be seen as • penalties for bad first-stage decisions • variables to keep the problem feasible 3 Some Stochastic Programming Classes Source: G. Mitra 4 Stochastic Programming Claims and ‘Facts' • Lots of application areas (Finance, Energy, Telecommunication) • Mature field (Dantzig ’55) • Variety of SP problem classes with specialized solution algorithms (e.g. Bender’s Decomposition) • Compared to deterministic mathematical programming (MP) small fraction • Only ~0.1% of NEOS submission to SP solvers • Few commercially supported solvers for SP • Various frustrations with industrial SP projects 5 Stochastic Programming Solvers • LP solver – Interior point methods seem to be better than simplex • Other ready to use solver (e.g. -
Extending Algebraic Modelling Languages for Stochastic Programming
Centre for the Analysis of Risk and Optimisation Modelling Applications A multi-disciplinary research centre focussed on understanding, modelling, quantification, management and control of RISK TECHNICAL REPORT CTR/09/03 November Extending algebraic modelling languages for Stochastic Programming Patrick Valente, Gautam Mitra and M Sadki Brunel University, Uxbridge, Middlesex R Fourer Northwester University, Evanston, IL Department of Mathematical Sciences and Department of Economics and Finance Brunel University, Uxbridge, Middlesex, UB8 3PH www.carisma.brunel.ac.uk Extending algebraic modelling languages for Stochastic Programming P. Valente, G. Mitra, M. Sadki Brunel University, Uxbridge, Middlesex, UK R. Fourer Northwestern University, Evanston, IL Abstract The algebraic modelling languages (AML) have gained wide acceptance and use in Mathematical Programming by researchers and practitioners. At a basic level, stochastic programming models can be defined using these languages by constructing their deterministic equivalent. Unfortunately, this leads to very large model data instances. We propose a direct approach in which the random values of the model coefficients and the stage structure of the decision variables and constraints are "overlaid" on the underlying deterministic (core) model of the SP problems. This leads not only to a natural definition of the SP model: the resulting generated instance is also a compact representation of the otherwise large problem data. The proposed constructs enable the formulation of two stage and -
Aimms Language Reference Provides a Complete Description of the Aimms Reference Modeling Language, Its Underlying Data Structures and Advanced Language Con- Structs
AIMMS The Language Reference AIMMS 4 AIMMS The Language Reference AIMMS Marcel Roelofs Johannes Bisschop Copyright c 1993–2019 by AIMMS B.V. All rights reserved. Email: [email protected] WWW: www.aimms.com ISBN 978–0–557–06379–6 Aimms is a registered trademark of AIMMS B.V. IBM ILOG CPLEX and CPLEX is a registered trademark of IBM Corporation. GUROBI is a registered trademark of Gurobi Optimization, Inc. Knitro is a registered trademark of Artelys. Windows and Excel are registered trademarks of Microsoft Corporation. TEX, LATEX, and AMS-LATEX are trademarks of the American Mathematical Society. Lucida is a registered trademark of Bigelow & Holmes Inc. Acrobat is a registered trademark of Adobe Systems Inc. Other brands and their products are trademarks of their respective holders. Information in this document is subject to change without notice and does not represent a commitment on the part of AIMMS B.V. The software described in this document is furnished under a license agreement and may only be used and copied in accordance with the terms of the agreement. The documentation may not, in whole or in part, be copied, photocopied, reproduced, translated, or reduced to any electronic medium or machine-readable form without prior consent, in writing, from AIMMS B.V. AIMMS B.V. makes no representation or warranty with respect to the adequacy of this documentation or the programs which it describes for any particular purpose or with respect to its adequacy to produce any particular result. In no event shall AIMMS B.V., its employees, its contractors or the authors of this documentation be liable for special, direct, indirect or consequential damages, losses, costs, charges, claims, demands, or claims for lost profits, fees or expenses of any nature or kind. -
A Stochastic Programming Integrated Environment (Spine)
TR/10/01 August 2001 Software tools for Stochastic Programming: A Stochastic Programming Integrated Environment (SPInE). P Valente, G Mitra, C Poojari, T Kyriakis. Department of Mathematical Sciences Brunel University, Uxbridge, UB8 3PH 1 Software tools for Stochastic Programming: A Stochastic Programming Integrated Environment (SPInE) Patrick Valente, Gautam Mitra, Chandra A. Poojari, Triphonas Kyriakis Department of Mathematical Sciences, Brunel University, West London, UK. Abstract SP models combine the paradigm of dynamic linear programming with modelling of random parameters, providing optimal decisions which hedge against future uncertainties. Advances in hardware as well as software techniques and solution methods have made SP a viable optimisation tool. We identify a growing need for modelling systems which support the creation and investigation of SP problems. Our SPInE system integrates a number of components which include a flexible modelling tool (based on stochastic extensions of the algebraic modelling languages AMPL and MPL), stochastic solvers, as well as special purpose scenario generators and database tools. We introduce an asset/liability management model and illustrate how SPInE can be used to create and process this model as a multistage SP application. 2 1 Introduction and background ............................................................................ 4 2 Problem statement.............................................................................................. 8 2.1 Classes of Stochastic Programming -
Two-Stage Stochastic Optimization for the Strategic Bidding of a Generation Company Considering Wind Power Uncertainty
energies Article Two-Stage Stochastic Optimization for the Strategic Bidding of a Generation Company Considering Wind Power Uncertainty Gejirifu De 1,2,*, Zhongfu Tan 1,2,3, Menglu Li 1,2, Liling Huang 1,2 and Xueying Song 1,2 1 School of Economics and Management, North China Electric Power University, Beijing 102206, China; [email protected] (Z.T.); [email protected] (M.L.); [email protected] (L.H.); [email protected] (X.S.) 2 Beijing Key Laboratory of New Energy and Low-Carbon Development, North China Electric Power University, Beijing 102206, China 3 School of Economics and Management, Yan’an University, Yan’an 716000, China * Correspondence: [email protected]; Tel.: +86-181-0103-9610 Received: 13 November 2018; Accepted: 13 December 2018; Published: 18 December 2018 Abstract: With the deregulation of electricity market, generation companies must take part in strategic bidding by offering its bidding quantity and bidding price in a day-ahead electricity wholesale market to sell their electricity. This paper studies the strategic bidding of a generation company with thermal power units and wind farms. This company is assumed to be a price-maker, which indicates that its installed capacity is high enough to affect the market-clearing price in the electricity wholesale market. The relationship between the bidding quantity of the generation company and market-clearing price is then studied. The uncertainty of wind power is considered and modeled through a set of discrete scenarios. A scenario-based two-stage stochastic bidding model is then provided. In the first stage, the decision-maker determines the bidding quantity in each time period.