DOCSLIB.ORG

INFORMS OS Today 5(1)

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
INFORMS OS Today 5(1) INFORMS OS Today The Newsletter of the INFORMS Optimization Society Volume 5 Number 1 May 2015 Contents Chair’s Column Chair’s Column .................................1 Nominations for OS Prizes .....................25 Suvrajeet Sen Nominations for OS Officers ...................26 University of Southern California [email protected] Featured Articles A Journey through Optimization Dear Fellow IOS Members: Dimitri P. Bertsekas .............................3 It is my pleasure to assume the role of Chair of Optimizing in the Third World the IOS, one of the largest, and most scholarly Cl´ovis C. Gonzaga . .5 groups within INFORMS. This year marks the From Lov´asz ✓ Function and Karmarkar’s Algo- Twentieth Anniversary of the formation of the rithm to Semidefinite Programming INFORMS Optimization Section, which started Farid Alizadeh ..................................9 with 50 signatures petitioning the Board to form a section. As it stands today, the INFORMS Local Versus Global Conditions in Polynomial Optimization Society has matured to become one of Optimization the larger Societies within INFORMS. With seven Jiawang Nie ....................................15 active special interest groups, four highly coveted Convergence Rate Analysis of Several Splitting awards, and of course, its strong presence in every Schemes INFORMS Annual Meeting, this Society is on a Damek Davis ...................................20 roll. In large part, this vibrant community owes a lot to many of the past officer bearers, without whose hard work, this Society would not be as strong as it is today. For the current health of our Society, I wish to thank my predecessors, and in particular, my immediate predecessor Sanjay Mehrotra under whose leadership, we gathered the momentum for our conferences, a possible new journal, and several other initiatives. I also take this opportunity to express my gratitude to Jim Luedtke, Send your comments and feedback to the Editor: Secretary/Treasurer, whose soft-spoken assurance, and attention to detail keeps the society humming. Shabbir Ahmed Another person whose support is instrumental to School of Industrial & Systems Engineering many communications is our Web Editor: Pietro Georgia Tech, Atlanta, GA 30332 Belotti; thanks Pietro. [email protected] The major agenda item in the upcoming years is the possibility of a new journal, sponsored by 2 INFORMS Optimization Society Newsletter the Society. Because of the growth in a variety titans of optimization have made multi-faceted con- of applications in Communications and Control, tributions. Data Science, and Machine Learning, there has Bertsekas was awarded for his pioneering role in been an explosive growth in Optimization. This • field has always attracted advanced applications dynamic programming (with uncountable state such as Energy, Finance, Health Care and others. spaces, approximate, neuro-dynamic and ap- What is remarkable today is that as the area ma- proximate dynamic programming), Lagrangean tures, many advanced applications are motivating methods, dual-based bounds for nonconvex new optimization concepts, including fundamental problems, network optimization, and applica- mathematical breakthroughs (e.g., the mathematics tions in communications, power, transportation of risk), algorithmic speed-ups and robust software and others. Moreover his books on many of (e.g., convex, and mixed-integer optimization), as these topics have been adopted at many uni- well as new modeling paradigms (e.g., multi-agent versities, world-wide. Gonzaga for his leadership in interior point and data driven optimization). These are but a few • of the promising directions today, and there are too methods (IPM), augmented Lagrangean meth- many more to mention in this column. ods, on filter methods for constrained non-linear optimization, and on fast steepest descent meth- ods. He has recently developed steepest de- Given the above backdrop, it is no surprise that scent algorithms for the minimization of convex our Society has shown overwhelming support for a quadratic functions with the same performance new INFORMS journal devoted to Optimization. bound as Krylov space methods. He is also the Exactly what the focus of such a journal should author of several influential reviews which have be is not clear at this point. There are other open introduced IPMs to scores of young researchers. questions, and we hope to resolve them as the year progresses. Our plan is to start a dialogue using The 2014 Farkas’ Prize was awarded to Farid INFORMS Connect as a platform for discussion, Alizadeh (Rutgers) who laid the groundwork for and we may even hold some meetings at affiliated the field of semidefinite programming (SDP), which conferences, such as at the International Symposium has grown quickly and steadily over the past 25 on Mathematical Programming in Pittsburgh this years. The citation continues the description of summer. Please be on the lookout for our calls at his contributions via connections between SDP conferences of these affiliated groups. and combinatorial optimization, complementarity, non-degeneracy and algorithmic methodology. Our Society is at the heart of INFORMS, and it draws tremendous strength from this sense of lead- The 2014 Prize for Young Researchers was awarded ership. There is another source of strength: the to Jiawang Nie (UC - San Diego) for this paper caliber of scholars that the IOS attracts. In or- “Optimality conditions and finite convergence of der to celebrate the accomplishments of our re- Lasserre’s hierarchy,” Mathematical Programming, searchers, the IOS awards four highly coveted prizes: Ser. A (2014) 146:97-121, DOI: 10.1007/s10107-013- the Khachiyan Prize, the Farkas Prize, the Young- 0680-x. Prior to this proof of finite convergence, the Researcher Prize, and the Student-paper Prize. This existing theory could only establish the convergence newsletter provides a glimpse of the personal stories of this family of relaxations in the limit. No proof of of the award winners, and their unique perspectives finite convergence had been previously found in spite on optimization. The awards committees for these of the significant numerical evidence for finite con- prizes showed impeccable taste in their choices, and vergence that had been collected over a decade or so. I wish to thank all members of these committees for their diligence with the process. The winners for The winner of the 2014 Student Paper Prize was the year 2014 Khachiyan Prize were Dimitris Bert- Damek Davis (UCLA) for his paper “Convergence sekas (MIT) and Clovis Gonzaga (Federal University rate analysis of several splitting schemes,” arXiv of Santa Catarina, Florian´opolis, Brazil). These two preprint arXiv:1406.4834 (2014), with Wotao Yin. Volume 5 Number 1 May 2015 3 This paper “makes a very significant contribution to the theory of optimization by using a rigorous and unified convergence rate analysis of important A Journey through splitting schemes.” Optimization Dimitri P. Bertsekas The awards committees for this year have been Lab. for Information and Decision Sciences appointed, and they are listed elsewhere in this Massachusetts Institute of Tech., Cambridge, MA 02139 newsletter. I encourage the optimization community [email protected] to identify strong candidates for these awards by sending forth nominations in each of the categories I feel honored and grateful for being awarded the mentioned above. Khachiyan Prize. It is customary in such circum- stances to thank one’s institutions, mentors, and col- Finally, I wish to welcome our newly elected Vice laborators, and I have many to thank. I was fortu- Chairs: Aida Khajavirad (Global Optimization), nate to be surrounded by first class students and col- Warren Powell (Optimization Under Uncertainty), leagues, at high quality institutions, which gave me and Daniel Robinson (Nonlinear Optimization). space and freedom to work in any direction I wished They are joining the continuing team of Vice Chairs: to go. It is also customary to chart one’s intellectual Vladimir Boginski (Network Optimization),John roots and journey, and I will not depart from this Mitchell (Linear and Conic Optimization), Imre tradition. Polik (Computational Optimization and Software), We commonly advise scholarly Ph.D. students and Juan Pablo Vielma (Integer and Discrete Op- in optimization to take the time to get a broad timization). These individuals are truly the reason many-course education, with substantial mathemat- for the strong presence of IOS at the INFORMS ical content, and special depth in their research area. Annual Conferences, and I thank them for their Then upon graduation, to use their Ph.D. research leadership. area as the basis and focus for further research, while gradually branching out into neighboring fields, and Before I close, I wish to also express my sin- networking within the profession. This is good ad- cere appreciation for the work and leadership of vice, which I often give, but this is not how it worked Shabbir Ahmed. He has taken our newsletter for me! to a whole new level, and provided it continuity I came from Greece with an undergraduate de- for the past four years. Such dedication to the gree in mechanical engineering, got my MS in con- Society is what makes IOS tick. Thank you Shabbir! trol theory at George Washington University in three semesters, while holding a full-time job in an unre- I hope my enthusiasm for our society is palpable in lated field, and finished two years later my Ph.D. this column, and hope that you will all get involved thesis
Load more

Recommended publications
  • Reinforcement Learning and Optimal Control
    Reinforcement Learning and Optimal Control by Dimitri P. Bertsekas Massachusetts Institute of Technology WWW site for book information and orders http://www.athenasc.com Athena Scientific, Belmont, Massachusetts Athena Scientific Post Office Box 805 Nashua, NH 03060 U.S.A. Email: [email protected] WWW: http://www.athenasc.com Cover photography: Dimitri Bertsekas c 2019 Dimitri P. Bertsekas All rights reserved. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher. Publisher’s Cataloging-in-Publication Data Bertsekas, Dimitri P. Reinforcement Learning and Optimal Control Includes Bibliography and Index 1. Mathematical Optimization. 2. Dynamic Programming. I. Title. QA402.5.B4652019 519.703 00-91281 ISBN-10: 1-886529-39-6, ISBN-13: 978-1-886529-39-7 ABOUT THE AUTHOR Dimitri Bertsekas studied Mechanical and Electrical Engineering at the National Technical University of Athens, Greece, and obtained his Ph.D. in system science from the Massachusetts Institute of Technology. He has held faculty positions with the Engineering-Economic Systems Department, Stanford University, and the Electrical Engineering Department of the Uni- versity of Illinois, Urbana. Since 1979 he has been teaching at the Electrical Engineering and Computer Science Department of the Massachusetts In- stitute of Technology (M.I.T.), where he is currently McAfee Professor of Engineering. Starting in August 2019, he will also be Fulton Professor of Computational Decision Making at the Arizona State University, Tempe, AZ. Professor Bertsekas’ teaching and research have spanned several fields, including deterministic optimization, dynamic programming and stochas- tic control, large-scale and distributed computation, and data communi- cation networks.
    [Show full text]
  • The Bibliography
    Referenced Books [Ach92] N. I. Achieser. Theory of Approximation. Dover Publications Inc., New York, 1992. Reprint of the 1956 English translation of the 1st Rus- sian edition; the 2nd augmented Russian edition is available, Moscow, Nauka, 1965. [AH05] Kendall Atkinson and Weimin Han. Theoretical Numerical Analysis: A Functional Analysis Framework, volume 39 of Texts in Applied Mathe- matics. Springer, New York, second edition, 2005. [Atk89] Kendall E. Atkinson. An Introduction to Numerical Analysis. John Wiley & Sons Inc., New York, second edition, 1989. [Axe94] Owe Axelsson. Iterative Solution Methods. Cambridge University Press, Cambridge, 1994. [Bab86] K. I. Babenko. Foundations of Numerical Analysis [Osnovy chislennogo analiza]. Nauka, Moscow, 1986. [Russian]. [BD92] C. A. Brebbia and J. Dominguez. Boundary Elements: An Introductory Course. Computational Mechanics Publications, Southampton, second edition, 1992. [Ber52] S. N. Bernstein. Collected Works. Vol. I. The Constructive Theory of Functions [1905–1930]. Izdat. Akad. Nauk SSSR, Moscow, 1952. [Russian]. [Ber54] S. N. Bernstein. Collected Works. Vol. II. The Constructive Theory of Functions [1931–1953]. Izdat. Akad. Nauk SSSR, Moscow, 1954. [Russian]. [BH02] K. Binder and D. W. Heermann. Monte Carlo Simulation in Statistical Physics: An Introduction, volume 80 of Springer Series in Solid-State Sciences. Springer-Verlag, Berlin, fourth edition, 2002. [BHM00] William L. Briggs, Van Emden Henson, and Steve F. McCormick. A Multigrid Tutorial. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, second edition, 2000. [Boy01] John P. Boyd. Chebyshev and Fourier Spectral Methods. Dover Publi- cations Inc., Mineola, NY, second edition, 2001. [Bra84] Achi Brandt. Multigrid Techniques: 1984 Guide with Applications to Fluid Dynamics, volume 85 of GMD-Studien [GMD Studies].
    [Show full text]
  • UCLA Electronic Theses and Dissertations
    UCLA UCLA Electronic Theses and Dissertations Title Algorithms for Optimal Paths of One, Many, and an Infinite Number of Agents Permalink https://escholarship.org/uc/item/3qj5d7dj Author Lin, Alex Tong Publication Date 2020 Peer reviewed|Thesis/dissertation eScholarship.org Powered by the California Digital Library University of California UNIVERSITY OF CALIFORNIA Los Angeles Algorithms for Optimal Paths of One, Many, and an Infinite Number of Agents A dissertation submitted in partial satisfaction of the requirements for the degree Doctor of Philosophy in Mathematics by Alex Tong Lin 2020 c Copyright by Alex Tong Lin 2020 ABSTRACT OF THE DISSERTATION Algorithms for Optimal Paths of One, Many, and an Infinite Number of Agents by Alex Tong Lin Doctor of Philosophy in Mathematics University of California, Los Angeles, 2020 Professor Stanley J. Osher, Chair In this dissertation, we provide efficient algorithms for modeling the behavior of a single agent, multiple agents, and a continuum of agents. For a single agent, we combine the modeling framework of optimal control with advances in optimization splitting in order to efficiently find optimal paths for problems in very high-dimensions, thus providing allevia- tion from the curse of dimensionality. For a multiple, but finite, number of agents, we take the framework of multi-agent reinforcement learning and utilize imitation learning in order to decentralize a centralized expert, thus obtaining optimal multi-agents that act in a de- centralized fashion. For a continuum of agents, we take the framework of mean-field games and use two neural networks, which we train in an alternating scheme, in order to efficiently find optimal paths for high-dimensional and stochastic problems.
    [Show full text]
  • Boundary Value Problems for Systems That Are Not Strictly
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector Applied Mathematics Letters 24 (2011) 757–761 Contents lists available at ScienceDirect Applied Mathematics Letters journal homepage: www.elsevier.com/locate/aml On mixed initial–boundary value problems for systems that are not strictly hyperbolic Corentin Audiard ∗ Institut Camille Jordan, Université Claude Bernard Lyon 1, Villeurbanne, Rhone, France article info a b s t r a c t Article history: The classical theory of strictly hyperbolic boundary value problems has received several Received 25 June 2010 extensions since the 70s. One of the most noticeable is the result of Metivier establishing Received in revised form 23 December 2010 Majda's ``block structure condition'' for constantly hyperbolic operators, which implies Accepted 28 December 2010 well-posedness for the initial–boundary value problem (IBVP) with zero initial data. The well-posedness of the IBVP with non-zero initial data requires that ``L2 is a continuable Keywords: initial condition''. For strictly hyperbolic systems, this result was proven by Rauch. We Boundary value problem prove here, by using classical matrix theory, that his fundamental a priori estimates are Hyperbolicity Multiple characteristics valid for constantly hyperbolic IBVPs. ' 2011 Elsevier Ltd. All rights reserved. 1. Introduction In his seminal paper [1] on hyperbolic initial–boundary value problems, H.O. Kreiss performed the algebraic construction of a tool, now called the Kreiss symmetrizer, that leads to a priori estimates. Namely, if u is a solution of 8 d X C >@ u C A .x; t/@ u D f ;.t; x/ 2 × Ω; <> t j xj R jD1 (1) C >Bu D g;.t; x/ 2 @ × @Ω; :> R ujtD0 D 0; C Pd where the operator @t jD1 Aj@xj is assumed to be strictly hyperbolic and B satisfies the uniform Lopatinski˘ı condition, there is some γ0 > 0 such that u satisfies the a priori estimate p γ kuk 2 C C kuk 2 C ≤ C kf k 2 C C kgk 2 C ; (2) Lγ .R ×Ω/ Lγ .R ×@Ω/ Lγ .R ×Ω/ Lγ .R ×@Ω/ 2 2 −γ t for γ ≥ γ0.
    [Show full text]
  • Sampling and Inference in Complex Networks Jithin Kazhuthuveettil Sreedharan
    Sampling and inference in complex networks Jithin Kazhuthuveettil Sreedharan To cite this version: Jithin Kazhuthuveettil Sreedharan. Sampling and inference in complex networks. Other [cs.OH]. Université Côte d’Azur, 2016. English. NNT : 2016AZUR4121. tel-01485852 HAL Id: tel-01485852 https://tel.archives-ouvertes.fr/tel-01485852 Submitted on 9 Mar 2017 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. École doctorale STIC Sciences et Technologies de l’Information et de la Communication Unité de recherche: INRIA (équipe Maestro) Thèse de doctorat Présentée en vue de l’obtention du grade de Docteur en Sciences de l’UNIVERSITE COTE D’AZUR Mention : Informatique par Jithin Kazhuthuveettil Sreedharan Sampling and Inference in Complex Networks (Échantillonnage et Inférence dans Réseaux Complexes) Dirigé par Konstantin Avrachenkov Soutenue le 2 décembre 2016 Devant le jury composé de: Konstantin Avrachenkov - Inria, France Directeur Nelly Litvak - University of Twente, The Netherlands Rapporteur Don Towsley - University of Massachusetts, USA Rapporteur Philippe Jacquet - Nokia Bell Labs, France Examinateur Alain Jean-Marie - Inria, France Président Abstract The recent emergence of large evolving networks, mainly due to the rise of Online Social Networks (OSNs), brought out the difficulty to gather a complete picture of a network and it opened up the development of new distributed techniques.
    [Show full text]
  • Society Reports USNC/TAM
    Appendix J 2008 Society Reports USNC/TAM Table of Contents J.1 AAM: Ravi-Chandar.............................................................................................. 1 J.2 AIAA: Chen............................................................................................................. 2 J.3 AIChE: Higdon ....................................................................................................... 3 J.4 AMS: Kinderlehrer................................................................................................. 5 J.5 APS: Foss................................................................................................................. 5 J.6 ASA: Norris............................................................................................................. 6 J.7 ASCE: Iwan............................................................................................................. 7 J.8 ASME: Kyriakides.................................................................................................. 8 J.9 ASTM: Chona ......................................................................................................... 9 J.10 SEM: Shukla ....................................................................................................... 11 J.11 SES: Jasiuk.......................................................................................................... 13 J.12 SIAM: Healey...................................................................................................... 14 J.13 SNAME: Karr....................................................................................................
    [Show full text]
  • Madeleine Udell's Thesis
    GENERALIZED LOW RANK MODELS A DISSERTATION SUBMITTED TO THE INSTITUTE FOR COMPUTATIONAL AND MATHEMATICAL ENGINEERING AND THE COMMITTEE ON GRADUATE STUDIES OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY Madeleine Udell May 2015 c Copyright by Madeleine Udell 2015 All Rights Reserved ii I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. (Professor Stephen Boyd) Principal Adviser I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. (Professor Ben Van Roy) I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. (Professor Lester Mackey) Approved for the Stanford University Committee on Graduate Studies iii Abstract Principal components analysis (PCA) is a well-known technique for approximating a tabular data set by a low rank matrix. This dissertation extends the idea of PCA to handle arbitrary data sets consisting of numerical, Boolean, categorical, ordinal, and other data types. This framework encompasses many well known techniques in data analysis, such as nonnegative matrix factorization, matrix completion, sparse and robust PCA, k-means, k-SVD, and maximum margin matrix factorization. The method handles heterogeneous data sets, and leads to coherent schemes for compress- ing, denoising, and imputing missing entries across all data types simultaneously.
    [Show full text]
  • Nash Q-Learning for General-Sum Stochastic Games
    Journal of Machine Learning Research 4 (2003) 1039-1069 Submitted 11/01; Revised 10/02; Published 11/03 Nash Q-Learning for General-Sum Stochastic Games Junling Hu [email protected] Talkai Research 843 Roble Ave., 2 Menlo Park, CA 94025, USA Michael P. Wellman [email protected] Artificial Intelligence Laboratory University of Michigan Ann Arbor, MI 48109-2110, USA Editor: Craig Boutilier Abstract We extend Q-learning to a noncooperative multiagent context, using the framework of general- sum stochastic games. A learning agent maintains Q-functions over joint actions, and performs updates based on assuming Nash equilibrium behavior over the current Q-values. This learning protocol provably converges given certain restrictions on the stage games (defined by Q-values) that arise during learning. Experiments with a pair of two-player grid games suggest that such restric- tions on the game structure are not necessarily required. Stage games encountered during learning in both grid environments violate the conditions. However, learning consistently converges in the first grid game, which has a unique equilibrium Q-function, but sometimes fails to converge in the second, which has three different equilibrium Q-functions. In a comparison of offline learn- ing performance in both games, we find agents are more likely to reach a joint optimal path with Nash Q-learning than with a single-agent Q-learning method. When at least one agent adopts Nash Q-learning, the performance of both agents is better than using single-agent Q-learning. We have also implemented an online version of Nash Q-learning that balances exploration with exploitation, yielding improved performance.
    [Show full text]
  • LIDS – a BRIEF HISTORY Alan S
    LIDS – A BRIEF HISTORY Alan S. Willsky The Laboratory for Information and Decision Systems (LIDS) is MIT’s oldest laboratory and has evolved in scope and changed its name several times during its long and rich history. For a more detailed account of its early years, see From Servo Loops to Fiber Nets, a document produced in 1990 by then-co-directors Sanjoy K. Mitter and Robert G. Gallager as part LIDS’ 50th anniversary celebration. The 1940s into the 1950s The Servomechanism Laboratory was established in 1940 by Professor Gordon Brown, one year before the United States entered World War II. At that time, the concepts of feedback control and servomechanisms were being codified and recognized as important disciplines, and the need for advances – initially driven by military challenges and later by industrial automation – were substantial. Indeed, the first electrical engineering department courses in servomechanisms were created only in 1939 and were codified in the classic 1948 textbook Principles of Servomechanisms by Gordon Brown and Donald Campbell. Wartime applications such as servo controls for the pointing of guns pushed the application and the foundational methodology and theory of servomechanisms and control. On the theoretical/methodological side, this push led to the 1957 text Analytical Design of Linear Feedback Controls, by George Newton, Leonard Gould, and James Kaiser, which combined Norbert Wiener’s theory of estimation of time series and the principles of servomechanisms to create new approaches to control design and the understanding of fundamental limits of performance. On the applications side, military and industrial post-war challenges led to major programs and contributions by researchers in the Lab.
    [Show full text]
  • Mathematics People
    NEWS Mathematics People or up to ten years post-PhD, are eligible. Awardees receive Braverman Receives US$1 million distributed over five years. NSF Waterman Award —From an NSF announcement Mark Braverman of Princeton University has been selected as a Prizes of the Association cowinner of the 2019 Alan T. Wa- terman Award of the National Sci- for Women in Mathematics ence Foundation (NSF) for his work in complexity theory, algorithms, The Association for Women in Mathematics (AWM) has and the limits of what is possible awarded a number of prizes in 2019. computationally. According to the Catherine Sulem of the Univer- prize citation, his work “focuses on sity of Toronto has been named the Mark Braverman complexity, including looking at Sonia Kovalevsky Lecturer for 2019 by algorithms for optimization, which, the Association for Women in Math- when applied, might mean planning a route—how to get ematics (AWM) and the Society for from point A to point B in the most efficient way possible. Industrial and Applied Mathematics “Algorithms are everywhere. Most people know that (SIAM). The citation states: “Sulem every time someone uses a computer, algorithms are at is a prominent applied mathemati- work. But they also occur in nature. Braverman examines cian working in the area of nonlin- randomness in the motion of objects, down to the erratic Catherine Sulem ear analysis and partial differential movement of particles in a fluid. equations. She has specialized on “His work is also tied to algorithms required for learning, the topic of singularity development in solutions of the which serve as building blocks to artificial intelligence, and nonlinear Schrödinger equation (NLS), on the problem of has even had implications for the foundations of quantum free surface water waves, and on Hamiltonian partial differ- computing.
    [Show full text]
  • Value and Policy Iteration in Optimal Control and Adaptive Dynamic Programming
    May 2015 Report LIDS-P-3174 Value and Policy Iteration in Optimal Control and Adaptive Dynamic Programming Dimitri P. Bertsekasy Abstract In this paper, we consider discrete-time infinite horizon problems of optimal control to a terminal set of states. These are the problems that are often taken as the starting point for adaptive dynamic programming. Under very general assumptions, we establish the uniqueness of solution of Bellman's equation, and we provide convergence results for value and policy iteration. 1. INTRODUCTION In this paper we consider a deterministic discrete-time optimal control problem involving the system xk+1 = f(xk; uk); k = 0; 1;:::; (1.1) where xk and uk are the state and control at stage k, lying in sets X and U, respectively. The control uk must be chosen from a constraint set U(xk) ⊂ U that may depend on the current state xk. The cost for the kth stage is g(xk; uk), and is assumed nonnnegative and real-valued: 0 ≤ g(xk; uk) < 1; xk 2 X; uk 2 U(xk): (1.2) We are interested in feedback policies of the form π = fµ0; µ1;:::g, where each µk is a function mapping every x 2 X into the control µk(x) 2 U(x). The set of all policies is denoted by Π. Policies of the form π = fµ, µ, : : :g are called stationary, and for convenience, when confusion cannot arise, will be denoted by µ. No restrictions are placed on X and U: for example, they may be finite sets as in classical shortest path problems involving a graph, or they may be continuous spaces as in classical problems of control to the origin or some other terminal set.
    [Show full text]
  • 19880014833.Pdf
    ;V,45Il t'£- /?~ ~f5-6 NASA Contractor Report 181656 lCASE REPORT NO. 88-24 NASA-CR-181656 19880014833 I I .t. ICASE EFFICIENT IMPLEMENTATION OF ESSENTIALLY NON-DSCILLATORY SHOCK CAPTURING SCHEMES, II Chi-nang Shu Stanley Osher Contract No. NASI-18ID7 April 1988 INSTITUTE FOR COMPUTER APPLICATIONS IN SCIENCE AND ENGINEERING NASA Langley Research Center, Hampton, Virginia 23665 Operated by the Universities Space Research Association ~r:l·l~~~ H"~) r~R·'-:.v _ ~,1\Uf'i::f},~ . ..... L .... ~ b,i' ~ L 'u~l 1 .,' \c.~:~ NI\SI\ J , "l/\..~' National Aeronautics and L\~!~L::Y nEsr,",I'.:-'~ c~~~~~:" Space Administration I !t ~~~ e," ,I' i \ ~ Langley Research Center Hampton. Virginia 23665 llllmnllllllmrllllllillmlllllllilif NF00885 4B~ EM3287.PRT DISPLAY 22/2/2 88N24217*t ISSUE 17 PAGE 2392 CATEGORY 64 RPT#: NASA-CR-181656 ICASE-88-24 NAS 1.26:181656 CNTt: NAS1-18107 NAGl-270 88/04/00 64 PAGES UNCLASSIFIED DOCUMENT UTTL: Efficient implementation of essentially non-oscillatory shock capturing schemes, 2 TLSP: Final Report AUTH: A/SHU, CHI-WANG; B/OSHER, STANLEY PAA: B/(California Univ., Los Angeles.) CORP: National Aeronautics and Space Administration. Langley Research Center, Hampton, Va. SAP: Avail: NTIS HC A04/MF A01 cro: UNITED STATES Submitted for publication Sponsored in part by Defense Advanced Research Projects Agency, Arlington, Va. MAJS: /*NUMERICAL FLOW VISUALIZATION/*OSCILLATIONS/*SHOCK WAVES MINS: I CONSERVATION LAWS/ EULER EQUATIONS OF MOTION/ RUNGE-KUTTA METHOD ABA: Author ABS: Earlier work on the efficient implementation of ENO (essentially non-oscillatory) shock capturing schemes is continued. Anew simplified expression is provided for the ENa construction procedure based again on numerical fluxes rather than cell averages.
    [Show full text]