Reinterpreting Mixed Strategy Equilibria: a Unification of The
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Lecture 4 Rationalizability & Nash Equilibrium Road
Lecture 4 Rationalizability & Nash Equilibrium 14.12 Game Theory Muhamet Yildiz Road Map 1. Strategies – completed 2. Quiz 3. Dominance 4. Dominant-strategy equilibrium 5. Rationalizability 6. Nash Equilibrium 1 Strategy A strategy of a player is a complete contingent-plan, determining which action he will take at each information set he is to move (including the information sets that will not be reached according to this strategy). Matching pennies with perfect information 2’s Strategies: HH = Head if 1 plays Head, 1 Head if 1 plays Tail; HT = Head if 1 plays Head, Head Tail Tail if 1 plays Tail; 2 TH = Tail if 1 plays Head, 2 Head if 1 plays Tail; head tail head tail TT = Tail if 1 plays Head, Tail if 1 plays Tail. (-1,1) (1,-1) (1,-1) (-1,1) 2 Matching pennies with perfect information 2 1 HH HT TH TT Head Tail Matching pennies with Imperfect information 1 2 1 Head Tail Head Tail 2 Head (-1,1) (1,-1) head tail head tail Tail (1,-1) (-1,1) (-1,1) (1,-1) (1,-1) (-1,1) 3 A game with nature Left (5, 0) 1 Head 1/2 Right (2, 2) Nature (3, 3) 1/2 Left Tail 2 Right (0, -5) Mixed Strategy Definition: A mixed strategy of a player is a probability distribution over the set of his strategies. Pure strategies: Si = {si1,si2,…,sik} σ → A mixed strategy: i: S [0,1] s.t. σ σ σ i(si1) + i(si2) + … + i(sik) = 1. If the other players play s-i =(s1,…, si-1,si+1,…,sn), then σ the expected utility of playing i is σ σ σ i(si1)ui(si1,s-i) + i(si2)ui(si2,s-i) + … + i(sik)ui(sik,s-i). -
Learning and Equilibrium
Learning and Equilibrium Drew Fudenberg1 and David K. Levine2 1Department of Economics, Harvard University, Cambridge, Massachusetts; email: [email protected] 2Department of Economics, Washington University of St. Louis, St. Louis, Missouri; email: [email protected] Annu. Rev. Econ. 2009. 1:385–419 Key Words First published online as a Review in Advance on nonequilibrium dynamics, bounded rationality, Nash equilibrium, June 11, 2009 self-confirming equilibrium The Annual Review of Economics is online at by 140.247.212.190 on 09/04/09. For personal use only. econ.annualreviews.org Abstract This article’s doi: The theory of learning in games explores how, which, and what 10.1146/annurev.economics.050708.142930 kind of equilibria might arise as a consequence of a long-run non- Annu. Rev. Econ. 2009.1:385-420. Downloaded from arjournals.annualreviews.org Copyright © 2009 by Annual Reviews. equilibrium process of learning, adaptation, and/or imitation. If All rights reserved agents’ strategies are completely observed at the end of each round 1941-1383/09/0904-0385$20.00 (and agents are randomly matched with a series of anonymous opponents), fairly simple rules perform well in terms of the agent’s worst-case payoffs, and also guarantee that any steady state of the system must correspond to an equilibrium. If players do not ob- serve the strategies chosen by their opponents (as in extensive-form games), then learning is consistent with steady states that are not Nash equilibria because players can maintain incorrect beliefs about off-path play. Beliefs can also be incorrect because of cogni- tive limitations and systematic inferential errors. -
Best Experienced Payoff Dynamics and Cooperation in the Centipede Game
Theoretical Economics 14 (2019), 1347–1385 1555-7561/20191347 Best experienced payoff dynamics and cooperation in the centipede game William H. Sandholm Department of Economics, University of Wisconsin Segismundo S. Izquierdo BioEcoUva, Department of Industrial Organization, Universidad de Valladolid Luis R. Izquierdo Department of Civil Engineering, Universidad de Burgos We study population game dynamics under which each revising agent tests each of his strategies a fixed number of times, with each play of each strategy being against a newly drawn opponent, and chooses the strategy whose total payoff was highest. In the centipede game, these best experienced payoff dynamics lead to co- operative play. When strategies are tested once, play at the almost globally stable state is concentrated on the last few nodes of the game, with the proportions of agents playing each strategy being largely independent of the length of the game. Testing strategies many times leads to cyclical play. Keywords. Evolutionary game theory, backward induction, centipede game, computational algebra. JEL classification. C72, C73. 1. Introduction The discrepancy between the conclusions of backward induction reasoning and ob- served behavior in certain canonical extensive form games is a basic puzzle of game the- ory. The centipede game (Rosenthal (1981)), the finitely repeated prisoner’s dilemma, and related examples can be viewed as models of relationships in which each partic- ipant has repeated opportunities to take costly actions that benefit his partner and in which there is a commonly known date at which the interaction will end. Experimen- tal and anecdotal evidence suggests that cooperative behavior may persist until close to William H. -
Lecture Notes
GRADUATE GAME THEORY LECTURE NOTES BY OMER TAMUZ California Institute of Technology 2018 Acknowledgments These lecture notes are partially adapted from Osborne and Rubinstein [29], Maschler, Solan and Zamir [23], lecture notes by Federico Echenique, and slides by Daron Acemoglu and Asu Ozdaglar. I am indebted to Seo Young (Silvia) Kim and Zhuofang Li for their help in finding and correcting many errors. Any comments or suggestions are welcome. 2 Contents 1 Extensive form games with perfect information 7 1.1 Tic-Tac-Toe ........................................ 7 1.2 The Sweet Fifteen Game ................................ 7 1.3 Chess ............................................ 7 1.4 Definition of extensive form games with perfect information ........... 10 1.5 The ultimatum game .................................. 10 1.6 Equilibria ......................................... 11 1.7 The centipede game ................................... 11 1.8 Subgames and subgame perfect equilibria ...................... 13 1.9 The dollar auction .................................... 14 1.10 Backward induction, Kuhn’s Theorem and a proof of Zermelo’s Theorem ... 15 2 Strategic form games 17 2.1 Definition ......................................... 17 2.2 Nash equilibria ...................................... 17 2.3 Classical examples .................................... 17 2.4 Dominated strategies .................................. 22 2.5 Repeated elimination of dominated strategies ................... 22 2.6 Dominant strategies .................................. -
The Monty Hall Problem in the Game Theory Class
The Monty Hall Problem in the Game Theory Class Sasha Gnedin∗ October 29, 2018 1 Introduction Suppose you’re on a game show, and you’re given the choice of three doors: Behind one door is a car; behind the others, goats. You pick a door, say No. 1, and the host, who knows what’s behind the doors, opens another door, say No. 3, which has a goat. He then says to you, “Do you want to pick door No. 2?” Is it to your advantage to switch your choice? With these famous words the Parade Magazine columnist vos Savant opened an exciting chapter in mathematical didactics. The puzzle, which has be- come known as the Monty Hall Problem (MHP), has broken the records of popularity among the probability paradoxes. The book by Rosenhouse [9] and the Wikipedia entry on the MHP present the history and variations of the problem. arXiv:1107.0326v1 [math.HO] 1 Jul 2011 In the basic version of the MHP the rules of the game specify that the host must always reveal one of the unchosen doors to show that there is no prize there. Two remaining unrevealed doors may hide the prize, creating the illusion of symmetry and suggesting that the action does not matter. How- ever, the symmetry is fallacious, and switching is a better action, doubling the probability of winning. There are two main explanations of the paradox. One of them, simplistic, amounts to just counting the mutually exclusive cases: either you win with ∗[email protected] 1 switching or with holding the first choice. -
More Experiments on Game Theory
More Experiments on Game Theory Syngjoo Choi Spring 2010 Experimental Economics (ECON3020) Game theory 2 Spring2010 1/28 Playing Unpredictably In many situations there is a strategic advantage associated with being unpredictable. Experimental Economics (ECON3020) Game theory 2 Spring2010 2/28 Playing Unpredictably In many situations there is a strategic advantage associated with being unpredictable. Experimental Economics (ECON3020) Game theory 2 Spring2010 2/28 Mixed (or Randomized) Strategy In the penalty kick, Left (L) and Right (R) are the pure strategies of the kicker and the goalkeeper. A mixed strategy refers to a probabilistic mixture over pure strategies in which no single pure strategy is played all the time. e.g., kicking left with half of the time and right with the other half of the time. A penalty kick in a soccer game is one example of games of pure con‡icit, essentially called zero-sum games in which one player’s winning is the other’sloss. Experimental Economics (ECON3020) Game theory 2 Spring2010 3/28 The use of pure strategies will result in a loss. What about each player playing heads half of the time? Matching Pennies Games In a matching pennies game, each player uncovers a penny showing either heads or tails. One player takes both coins if the pennies match; otherwise, the other takes both coins. Left Right Top 1, 1, 1 1 Bottom 1, 1, 1 1 Does there exist a Nash equilibrium involving the use of pure strategies? Experimental Economics (ECON3020) Game theory 2 Spring2010 4/28 Matching Pennies Games In a matching pennies game, each player uncovers a penny showing either heads or tails. -
Modeling Strategic Behavior1
Modeling Strategic Behavior1 A Graduate Introduction to Game Theory and Mechanism Design George J. Mailath Department of Economics, University of Pennsylvania Research School of Economics, Australian National University 1September 16, 2020, copyright by George J. Mailath. World Scientific Press published the November 02, 2018 version. Any significant correc- tions or changes are listed at the back. To Loretta Preface These notes are based on my lecture notes for Economics 703, a first-year graduate course that I have been teaching at the Eco- nomics Department, University of Pennsylvania, for many years. It is impossible to understand modern economics without knowl- edge of the basic tools of game theory and mechanism design. My goal in the course (and this book) is to teach those basic tools so that students can understand and appreciate the corpus of modern economic thought, and so contribute to it. A key theme in the course is the interplay between the formal development of the tools and their use in applications. At the same time, extensions of the results that are beyond the course, but im- portant for context are (briefly) discussed. While I provide more background verbally on many of the exam- ples, I assume that students have seen some undergraduate game theory (such as covered in Osborne, 2004, Tadelis, 2013, and Wat- son, 2013). In addition, some exposure to intermediate microeco- nomics and decision making under uncertainty is helpful. Since these are lecture notes for an introductory course, I have not tried to attribute every result or model described. The result is a somewhat random pattern of citations and references. -
Comparing Auction Designs Where Suppliers Have Uncertain Costs and Uncertain Pivotal Status
RAND Journal of Economics Vol. 00, No. 0, Winter 2018 pp. 1–33 Comparing auction designs where suppliers have uncertain costs and uncertain pivotal status ∗ Par¨ Holmberg and ∗∗ Frank A. Wolak We analyze how market design influences bidding in multiunit procurement auctions where suppliers have asymmetric information about production costs. Our analysis is particularly relevant to wholesale electricity markets, because it accounts for the risk that a supplier is pivotal; market demand is larger than the total production capacity of its competitors. With constant marginal costs, expected welfare improves if the auctioneer restricts offers to be flat. We identify circumstances where the competitiveness of market outcomes improves with increased market transparency. We also find that, for buyers, uniform pricing is preferable to discriminatory pricing when producers’ private signals are affiliated. 1. Introduction Multiunit auctions are used to trade commodities, securities, emission permits, and other divisible goods. This article focuses on electricity markets, where producers submit offers before the level of demand and amount of available production capacity are fully known. Due to demand shocks, unexpected outages, transmission-constraints, and intermittent output from renewable energy sources, it often arises that an electricity producer is pivotal, that is, that realized demand is larger than the realized total production capacity of its competitors. A producer that is certain to be pivotal possess a substantial ability to exercise market power because it can withhold output ∗ Research Institute of Industrial Economics (IFN), Associate Researcher of the Energy Policy Research Group (EPRG), University of Cambridge; [email protected]. ∗∗ Program on Energy and Sustainable Development (PESD) and Stanford University; [email protected]. -
Comparative Statics and Perfect Foresight in Infinite Horizon Economies
Digitized by the Internet Archive in 2011 with funding from Boston Library Consortium IVIember Libraries http://www.archive.org/details/comparativestatiOOkeho working paper department of economics Comparative Statics And Perfect Foresight in Infinite Horizon Economies Timothy J. Kehoe David K. Levine* Number 312 December 1982 massachusetts institute of technology 50 memorial drive Cambridge, mass. 02139 Comparative Statics And Perfect Foresight in Infinite Horizon Economies Timothy J. Kehoe David K. Levine* Number 312 December 1982 Department of Economics, M.I.T. and Department of Economics, U.C.L.A., respectively. Abstract This paper considers whether infinite horizon economies have determinate perfect foresight equilibria. ¥e consider stationary pure exchange economies with both finite and infinite numbers of agents. When there is a finite number of infinitely lived agents, we argue that equilibria are generically determinate. This is because the number of equations determining the equilibria is not infinite, but is equal to the number of agents minus one and must determine the marginal utility of income for all but one agent. In an overlapping generations model with infinitely many finitely lived agents, this reasoning breaks down. ¥e ask whether the initial conditions together with the requirement of convergence to a steady state locally determine an equilibrium price path. In this framework there are many economies with isolated equilibria, many with continue of equilibria, and many with no equilibria at all. With two or more goods in every period not only can the price level be indeterminate but relative prices as well. Furthermore, such indeterminacy can occur whether or not there is fiat money in the economy. -
Incomplete Information I. Bayesian Games
Bayesian Games Debraj Ray, November 2006 Unlike the previous notes, the material here is perfectly standard and can be found in the usual textbooks: see, e.g., Fudenberg-Tirole. For the examples in these notes (except for the very last section), I draw heavily on Martin Osborne’s excellent recent text, An Introduction to Game Theory, Oxford University Press. Obviously, incomplete information games — in which one or more players are privy to infor- mation that others don’t have — has enormous applicability: credit markets / auctions / regulation of firms / insurance / bargaining /lemons / public goods provision / signaling / . the list goes on and on. 1. A Definition A Bayesian game consists of 1. A set of players N. 2. A set of states Ω, and a common prior µ on Ω. 3. For each player i a set of actions Ai and a set of signals or types Ti. (Can make actions sets depend on type realizations.) 4. For each player i, a mapping τi :Ω 7→ Ti. 5. For each player i, a vN-M payoff function fi : A × Ω 7→ R, where A is the product of the Ai’s. Remarks A. Typically, the mapping τi tells us player i’s type. The easiest case is just when Ω is the product of the Ti’s and τi is just the appropriate projection mapping. B. The prior on states need not be common, but one view is that there is no loss of generality in assuming it (simply put all differences in the prior into differences in signals and redefine the state space and si-mappings accordingly). -
8. Maxmin and Minmax Strategies
CMSC 474, Introduction to Game Theory 8. Maxmin and Minmax Strategies Mohammad T. Hajiaghayi University of Maryland Outline Chapter 2 discussed two solution concepts: Pareto optimality and Nash equilibrium Chapter 3 discusses several more: Maxmin and Minmax Dominant strategies Correlated equilibrium Trembling-hand perfect equilibrium e-Nash equilibrium Evolutionarily stable strategies Worst-Case Expected Utility For agent i, the worst-case expected utility of a strategy si is the minimum over all possible Husband Opera Football combinations of strategies for the other agents: Wife min u s ,s Opera 2, 1 0, 0 s-i i ( i -i ) Football 0, 0 1, 2 Example: Battle of the Sexes Wife’s strategy sw = {(p, Opera), (1 – p, Football)} Husband’s strategy sh = {(q, Opera), (1 – q, Football)} uw(p,q) = 2pq + (1 – p)(1 – q) = 3pq – p – q + 1 We can write uw(p,q) For any fixed p, uw(p,q) is linear in q instead of uw(sw , sh ) • e.g., if p = ½, then uw(½,q) = ½ q + ½ 0 ≤ q ≤ 1, so the min must be at q = 0 or q = 1 • e.g., minq (½ q + ½) is at q = 0 minq uw(p,q) = min (uw(p,0), uw(p,1)) = min (1 – p, 2p) Maxmin Strategies Also called maximin A maxmin strategy for agent i A strategy s1 that makes i’s worst-case expected utility as high as possible: argmaxmin ui (si,s-i ) si s-i This isn’t necessarily unique Often it is mixed Agent i’s maxmin value, or security level, is the maxmin strategy’s worst-case expected utility: maxmin ui (si,s-i ) si s-i For 2 players it simplifies to max min u1s1, s2 s1 s2 Example Wife’s and husband’s strategies -
Natural Games
Ntur J A a A A ,,,* , a Department of Biosciences, FI-00014 University of Helsinki, Finland b Institute of Biotechnology, FI-00014 University of Helsinki, Finland c Department of Physics, FI-00014 University of Helsinki, Finland ABSTRACT Behavior in the context of game theory is described as a natural process that follows the 2nd law of thermodynamics. The rate of entropy increase as the payoff function is derived from statistical physics of open systems. The thermodynamic formalism relates everything in terms of energy and describes various ways to consume free energy. This allows us to associate game theoretical models of behavior to physical reality. Ultimately behavior is viewed as a physical process where flows of energy naturally select ways to consume free energy as soon as possible. This natural process is, according to the profound thermodynamic principle, equivalent to entropy increase in the least time. However, the physical portrayal of behavior does not imply determinism. On the contrary, evolutionary equation for open systems reveals that when there are three or more degrees of freedom for behavior, the course of a game is inherently unpredictable in detail because each move affects motives of moves in the future. Eventually, when no moves are found to consume more free energy, the extensive- form game has arrived at a solution concept that satisfies the minimax theorem. The equilibrium is Lyapunov-stable against variation in behavior within strategies but will be perturbed by a new strategy that will draw even more surrounding resources to the game. Entropy as the payoff function also clarifies motives of collaboration and subjective nature of decision making.