Multiple Strategies in Structured Populations

Total Page:16

File Type:pdf, Size:1020Kb

Multiple Strategies in Structured Populations Multiple strategies in structured populations Corina E. Tarnitaa,b,c,1,2, Nicholas Wagea,b,1, and Martin A. Nowaka,b,d aProgram for Evolutionary Dynamics, bDepartment of Mathematics, dDepartment of Organismic and Evolutionary Biology, and cHarvard Society of Fellows, Harvard University, Cambridge, MA 02138 Edited* by Clifford H. Taubes, Harvard University, Cambridge, MA, and approved December 20, 2010 (received for review October 28, 2010) Many specific models have been proposed to study evolutionary For weak selection, all strategies have roughly the same av- game dynamics in structured populations, but most analytical erage frequency, 1/n, in the stationary distribution. A strategy is results so far describe the competition of only two strategies. Here favored by selection, if its average frequency is >1/n. Otherwise it we derive a general result that holds for any number of strategies, is opposed by selection. Our main result is the following: Given for a large class of population structures under weak selection. We some mild assumptions (specified in SI Text), strategy k is fa- show that for the purpose of strategy selection any evolutionary vored by selection if process can be characterized by two key parameters that are fi coef cients in a linear inequality containing the payoff values. ðσ1akk þ akÃ− aÃk − σ1aÃÃÞþσ2ðakÃ− aÞ > 0: [1] These structural coefficients, σ1 and σ2, depend on the particular process that is being studied, but not on the number of strategies, a ¼ð =nÞ∑n a Here Ãà 1 i¼1 ii is the average payoff when both individ- n, or the payoff matrix. For calculating these structural coefficients a ¼ð =nÞ∑n a uals use the same strategy, kà 1 i¼1 ki is the average pay- one has to investigate games with three strategies, but more are k a ¼ð =nÞ∑n a off of strategy , Ãk 1 i¼1 ik is the average payoff when not needed. Therefore, n = 3 is the general case. Our main result k a ¼ð =n2Þ∑n ∑n a playing against strategy , and 1 i¼1 j¼1 ij is the aver- has a geometric interpretation: Strategy selection is determined by age payoff in the population. The parameters σ and σ are struc- fi 1 2 the sum of two terms, the rst one describing competition on the tural coefficients that need to be calculated for the specific edges of the simplex and the second one in the center. Our for- evolutionary process that is investigated. These parameters de- mula includes all known weak selection criteria of evolutionary pend on the population structure, the update rule, and the muta- fi games as special cases. As a speci c example we calculate games tion rate, but they do not depend on the number of strategies or on on sets and explore the synergistic interaction between direct rec- the entries of the payoff matrix. iprocity and spatial selection. We show that for certain parameter How can we interpret this result? Let xi denote the frequency of values both repetition and space are needed to promote evolution strategy i. The configuration of the population (just in terms of of cooperation. frequencies of strategies) is given by a point in the simplex Sn, fi ∑n x ¼ which is de ned by i¼1 i 1. The vertices of the simplex cor- volutionary games arise whenever the fitness of individuals respond to population states where only one strategy is present. Eis not constant, but depends on the relative abundance of The edges of the simplex correspond to states where two strategies strategies in the population (1–7). Evolutionary game theory is are present. In the interior of the simplex all strategies are present. a general theoretical framework that can be used to study many Inequality [1] is the sum of two terms, both of which are linear in biological problems including host–parasite interactions, eco- the payoff values. The first term, σ1akk þ akà − aÃk − σ1aÃÃ, systems, animal behavior, social evolution, and human language describes competition on the edges of the simplex that include (8–18). The traditional approach of evolutionary game theory k A fi strategy (Fig. 1 ). In particular, it is an average over all pairwise uses deterministic dynamics describing in nitely large, well- comparisons between strategy k and each other strategy, weighted mixed populations. More recently the framework was expanded fi σ σ ða − aÞ fi by the structural coef cient, 1. The second term, 2 kà , to deal with stochastic dynamics, nite population size, and evaluates the competition between strategy k and all other strat- structured populations (19–32). egies in the center of the simplex, where all strategies have the Here we consider a mutation–selection process acting in same frequency, 1/n (Fig. 1B). a population of finite size. The population structure determines Therefore, the surprising implication of our main result (Eq. who interacts with whom to accumulate payoff and who com- 1) is that strategy selection (in a mutation–selection process in petes with whom for reproduction. Individuals adopt one of n strategies. The payoff for an interaction between any two strat- a structured population) is simply the sum of two competition terms, one that is evaluated on the edges of the simplex and the egies is given by the n × n payoff matrix A =[aij]. The rate of reproduction is proportional to payoff: Individuals that accu- other one in the center of the simplex. The simplicity of this mulate higher payoff are more likely to reproduce. Reproduction result is surprising because an evolutionary process in a struc- is subject to symmetric mutation: With probability 1 − u the tured population has a very large number of possible states; to offspring inherits the strategy of the parent, but with probability describe a particular state it is not enough to list the frequencies u a random strategy is chosen. Our process leads to a stationary of strategies but one also has to specify the population structure. distribution characterizing the mutation–selection equilibrium. Further intuition for our main result is provided by the concept Important questions are the following: What is the average fre- of risk dominance. The classical notion of risk dominance for quency of a strategy in the stationary distribution? Which strat- a game with two strategies in a well-mixed population is as fol- egies are more abundant than others? lows: Strategy i is risk dominant over strategy j if aii + aij > aji + ajj. To make progress, we consider the limit of weak selection. One way to obtain this limit is as follows: The rate of re- production of each individual is proportional to 1 + w Payoff, Author contributions: C.E.T., N.W., and M.A.N. designed research, performed research, where w is a constant that measures the intensity of selection; the contributed new reagents/analytic tools, and wrote the paper. limit of weak selection is then given by w → 0. Weak selection is The authors declare no conflict of interest. not an unnatural situation; it can arise in different ways: i) Payoff *This Direct Submission article had a prearranged editor. differences are small, ii) strategies are similar, and iii) individuals 1C.E.T. and N.W. contributed equally to this work. are confused about payoffs when updating their strategies. In 2To whom correspondence should be addressed. E-mail: [email protected]. such situations, the particular game makes only a small contri- This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10. bution to the overall reproductive success of an individual. 1073/pnas.1016008108/-/DCSupplemental. 2334–2337 | PNAS | February 8, 2011 | vol. 108 | no. 6 www.pnas.org/cgi/doi/10.1073/pnas.1016008108 Downloaded by guest on September 27, 2021 ABcalculate the competition of multiple strategies in a structured population for weak selection but any mutation rate, then all we have to do is to calculate two parameters, σ1 and σ2. This cal- culation can be done for a very simple payoff matrix and n =3 strategies. Once σ1 and σ2 are known, they can be applied to any payoff matrix and any number of strategies. For n = 2 strategies, inequality [1] leads to (a11 − a22)(2σ1 + σ2) +(a12 − a21)(2 + σ2) > 0. If 2 + σ2 ≠ 0, we obtain the well-known condition σa11 + a12 > a21 + σa22 with σ =(2σ1 + σ2)/(2 + σ2). Many σ-values have been calculated characterizing evolutionary Fig. 1. Our main result has a simple geometric interpretation, which is il- games with two strategies in structured populations (31). lustrated here for the case of n = 3 strategies. (A) The first term of inequality For a large, well-mixed population we know that σ1 = 1 and B 1 describes competition on the edges of the simplex. ( ) The second term of σ2 = μ, where μ = Nu is the product of population size and inequality 1 describes competition in the center of the simplex. In general, mutation rate (30). Therefore, if the mutation rate is low, μ → 0, the selective criterion for strategy 1 is the sum of the two terms. then the evolutionary success of a strategy is determined by av- erage pairwise risk dominance, akk þ akà − aÃk − aÃÃ. If the mu- tation rate is high, μ → ∞, then the evolutionary success depends If i and j are engaged in a coordination game, given by aii > aji and on risk dominance, akà − a: ajj > aij, then the risk-dominant strategy has the bigger basin of For any population structure, we can show that low mutation, attraction. In a structured population the risk-dominance condi- μ → σ → fi σa a > a σa σ 0, implies 2 0.
Recommended publications
  • The Determinants of Efficient Behavior in Coordination Games
    The Determinants of Efficient Behavior in Coordination Games Pedro Dal B´o Guillaume R. Fr´echette Jeongbin Kim* Brown University & NBER New York University Caltech May 20, 2020 Abstract We study the determinants of efficient behavior in stag hunt games (2x2 symmetric coordination games with Pareto ranked equilibria) using both data from eight previous experiments on stag hunt games and data from a new experiment which allows for a more systematic variation of parameters. In line with the previous experimental literature, we find that subjects do not necessarily play the efficient action (stag). While the rate of stag is greater when stag is risk dominant, we find that the equilibrium selection criterion of risk dominance is neither a necessary nor sufficient condition for a majority of subjects to choose the efficient action. We do find that an increase in the size of the basin of attraction of stag results in an increase in efficient behavior. We show that the results are robust to controlling for risk preferences. JEL codes: C9, D7. Keywords: Coordination games, strategic uncertainty, equilibrium selection. *We thank all the authors who made available the data that we use from previous articles, Hui Wen Ng for her assistance running experiments and Anna Aizer for useful comments. 1 1 Introduction The study of coordination games has a long history as many situations of interest present a coordination component: for example, the choice of technologies that require a threshold number of users to be sustainable, currency attacks, bank runs, asset price bubbles, cooper- ation in repeated games, etc. In such examples, agents may face strategic uncertainty; that is, they may be uncertain about how the other agents will respond to the multiplicity of equilibria, even when they have complete information about the environment.
    [Show full text]
  • Economics 211: Dynamic Games by David K
    Economics 211: Dynamic Games by David K. Levine Last modified: January 6, 1999 © This document is copyrighted by the author. You may freely reproduce and distribute it electronically or in print, provided it is distributed in its entirety, including this copyright notice. Basic Concepts of Game Theory and Equilibrium Course Slides Source: \Docs\Annual\99\class\grad\basnote7.doc A Finite Game an N player game iN= 1K PS() are probability measure on S finite strategy spaces σ ∈≡Σ iiPS() i are mixed strategies ∈≡×N sSi=1 Si are the strategy profiles σ∈ΣΣ ≡×N i=1 i ∈≡× other useful notation s−−iijijS ≠S σ ∈≡×ΣΣ −−iijij ≠ usi () payoff or utility N uuss()σσ≡ ∑ ()∏ ( ) is expected iijjsS∈ j=1 utility 2 Dominant Strategies σ σ i weakly (strongly) dominates 'i if σσ≥> usiii(,−− )()( u i' i,) s i with at least one strict Nash Equilibrium players can anticipate on another’s strategies σ is a Nash equilibrium profile if for each iN∈1,K uu()σ = maxσ (σ' ,)σ− iiii'i Theorem: a Nash equilibrium exists in a finite game this is more or less why Kakutani’s fixed point theorem was invented σ σ Bi () is the set of best responses of i to −i , and is UHC convex valued This theorem fails in pure strategies: consider matching pennies 3 Some Classic Simultaneous Move Games Coordination Game RL U1,10,0 D0,01,1 three equilibria (U,R) (D,L) (.5U,.5L) too many equilibria?? Coordination Game RL U 2,2 -10,0 D 0,-10 1,1 risk dominance: indifference between U,D −−=− 21011ppp222()() == 13pp22 11,/ 11 13 if U,R opponent must play equilibrium w/ 11/13 if D,L opponent must
    [Show full text]
  • Using Risk Dominance Strategy in Poker
    Journal of Information Hiding and Multimedia Signal Processing ©2014 ISSN 2073-4212 Ubiquitous International Volume 5, Number 3, July 2014 Using Risk Dominance Strategy in Poker J.J. Zhang Department of ShenZhen Graduate School Harbin Institute of Technology Shenzhen Applied Technology Engineering Laboratory for Internet Multimedia Application HIT Part of XiLi University Town, NanShan, 518055, ShenZhen, GuangDong [email protected] X. Wang Department of ShenZhen Graduate School Harbin Institute of Technology Public Service Platform of Mobile Internet Application Security Industry HIT Part of XiLi University Town, NanShan, 518055, ShenZhen, GuangDong [email protected] L. Yao, J.P. Li and X.D. Shen Department of ShenZhen Graduate School Harbin Institute of Technology HIT Part of XiLi University Town, NanShan, 518055, ShenZhen, GuangDong [email protected]; [email protected]; [email protected] Received March, 2014; revised April, 2014 Abstract. Risk dominance strategy is a complementary part of game theory decision strategy besides payoff dominance. It is widely used in decision of economic behavior and other game conditions with risk characters. In research of imperfect information games, the rationality of risk dominance strategy has been proved while it is also wildly adopted by human players. In this paper, a decision model guided by risk dominance is introduced. The novel model provides poker agents of rational strategies which is relative but not equals simply decision of “bluffing or no". Neural networks and specified probability tables are applied to improve its performance. In our experiments, agent with the novel model shows an improved performance when playing against our former version of poker agent named HITSZ CS 13 which participated Annual Computer Poker Competition of 2013.
    [Show full text]
  • Evolutionary Game Theory: Why Equilibrium and Which Equilibrium
    Evolutionary Game Theory: Why Equilibrium and Which Equilibrium Hamid Sabourianand Wei-Torng Juangy November 5, 2007 1 Introduction Two questions central to the foundations of game theory are (Samuelson 2002): (i) Why equilibrium? Should we expect Nash equilibrium play (players choosing best response strategies to the choices of others)? (ii) If so, which equilibrium? Which of the many Nash equilibria that arise in most games should we expect? To address the …rst question the classical game theory approach employs assumptions that agents are rational and they all have common knowledge of such rationality and beliefs. For a variety of reasons there has been wide dissatisfaction with such an approach. One major concern has to do with the plausibility and necessity of rationality and the common knowledge of rationality and beliefs. Are players fully rational, having unbounded com- puting ability and never making mistakes? Clearly, they are not. Moreover, the assumption of common (knowledge of) beliefs begs another question as to how players come to have common (knowledge of) beliefs. As we shall see in later discussion, under a very broad range of situations, a system may reach or converge to an equilibrium even when players are not fully rational (boundedly rational) and are not well-informed. As a result, it may be, as School of Economics, Mathematics and Statistics, Birkbeck College Univerity of Lon- don and Faculty of Economics, University of Cambridge yInstitute of Economics, Academia Sinica, Taipei 115, Taiwan 1 Samuelson (1997) points out, that an equilibrium appears not because agents are rational, “but rather agents appear rational because an equilibrium has been reached.” The classical approach has also not been able to provide a satisfactory so- lution to the second question on selection among multiple equilibria that com- monly arise.
    [Show full text]
  • Prisoners' Other Dilemma
    DISCUSSION PAPER SERIES No. 3856 PRISONERS’ OTHER DILEMMA Matthias Blonski and Giancarlo Spagnolo INDUSTRIAL ORGANIZATION ABCD www.cepr.org Available online at: www.cepr.org/pubs/dps/DP3856.asp www.ssrn.com/xxx/xxx/xxx ISSN 0265-8003 PRISONERS’ OTHER DILEMMA Matthias Blonski, Universität Mannheim Giancarlo Spagnolo, Universität Mannheim and CEPR Discussion Paper No. 3856 April 2003 Centre for Economic Policy Research 90–98 Goswell Rd, London EC1V 7RR, UK Tel: (44 20) 7878 2900, Fax: (44 20) 7878 2999 Email: [email protected], Website: www.cepr.org This Discussion Paper is issued under the auspices of the Centre’s research programme in INDUSTRIAL ORGANIZATION. Any opinions expressed here are those of the author(s) and not those of the Centre for Economic Policy Research. Research disseminated by CEPR may include views on policy, but the Centre itself takes no institutional policy positions. The Centre for Economic Policy Research was established in 1983 as a private educational charity, to promote independent analysis and public discussion of open economies and the relations among them. It is pluralist and non-partisan, bringing economic research to bear on the analysis of medium- and long-run policy questions. Institutional (core) finance for the Centre has been provided through major grants from the Economic and Social Research Council, under which an ESRC Resource Centre operates within CEPR; the Esmée Fairbairn Charitable Trust; and the Bank of England. These organizations do not give prior review to the Centre’s publications, nor do they necessarily endorse the views expressed therein. These Discussion Papers often represent preliminary or incomplete work, circulated to encourage discussion and comment.
    [Show full text]
  • Evolutionary Game Theory: a Renaissance
    games Review Evolutionary Game Theory: A Renaissance Jonathan Newton ID Institute of Economic Research, Kyoto University, Kyoto 606-8501, Japan; [email protected] Received: 23 April 2018; Accepted: 15 May 2018; Published: 24 May 2018 Abstract: Economic agents are not always rational or farsighted and can make decisions according to simple behavioral rules that vary according to situation and can be studied using the tools of evolutionary game theory. Furthermore, such behavioral rules are themselves subject to evolutionary forces. Paying particular attention to the work of young researchers, this essay surveys the progress made over the last decade towards understanding these phenomena, and discusses open research topics of importance to economics and the broader social sciences. Keywords: evolution; game theory; dynamics; agency; assortativity; culture; distributed systems JEL Classification: C73 Table of contents 1 Introduction p. 2 Shadow of Nash Equilibrium Renaissance Structure of the Survey · · 2 Agency—Who Makes Decisions? p. 3 Methodology Implications Evolution of Collective Agency Links between Individual & · · · Collective Agency 3 Assortativity—With Whom Does Interaction Occur? p. 10 Assortativity & Preferences Evolution of Assortativity Generalized Matching Conditional · · · Dissociation Network Formation · 4 Evolution of Behavior p. 17 Traits Conventions—Culture in Society Culture in Individuals Culture in Individuals · · · & Society 5 Economic Applications p. 29 Macroeconomics, Market Selection & Finance Industrial Organization · 6 The Evolutionary Nash Program p. 30 Recontracting & Nash Demand Games TU Matching NTU Matching Bargaining Solutions & · · · Coordination Games 7 Behavioral Dynamics p. 36 Reinforcement Learning Imitation Best Experienced Payoff Dynamics Best & Better Response · · · Continuous Strategy Sets Completely Uncoupled · · 8 General Methodology p. 44 Perturbed Dynamics Further Stability Results Further Convergence Results Distributed · · · control Software and Simulations · 9 Empirics p.
    [Show full text]
  • Equilibrium Selection in N-Person Coordination Games
    GAMES AND ECONOMIC BEHAVIOR 15, 203–227 (1996) ARTICLE NO. 0066 Equilibrium Selection in n-Person Coordination Games Youngse Kim Department of Economics, Queen Mary and Westfield College, University of London, London E1 4NS, England September 1, 1993 This paper investigates several approaches to equilibrium selection and the relationships between them. The class of games we study are n-person generalized coordination games with multiple Pareto rankable strict Nash equilibria. The main result is that all selection criteria select the same outcome (namely the risk dominant equilibrium) in two-person games, and that most equivalences break for games with more than two players. All criteria select the Pareto efficient equilibrium in voting games, of which pure coordination games are special cases. Journal of Economic Literature Classification Numbers: C70, C72, D82. © 1996 Academic Press, Inc. 1. INTRODUCTION Multiple equilibria are common in economic models. As an example, consider the stag hunt game. There are n identical players who must choose simultane- ously between two actions, H and L. The safe strategy L yields a fixed payoff x (0, 1). The strategy H yields the higher payoff of 1 if at least players choose∈ the same action H, but it yields nothing otherwise. For example, the me- dian rule takes to be the smallest integer larger than n/2, while the minimum rule takes n. These games have two strict Nash equilibria in pure strate- gies, namely,=H (all players choose H) and L (all choose L). Which equilibrium should be selected has provoked much debate. One might argue that the Pareto-dominant equilibrium H is the focal point, but recent experimental results by van Huyck et al.
    [Show full text]
  • Evolutionary Game Theory Notes
    Evolutionary Game Theory Notes James Massey These notes are intended to be a largely self contained guide to everything you need to know for the evolutionary game theory part of the EC341 module. During lectures we will work through these notes, starting with a quick skim through Chapter 2 (which should be a revision of already known material for most of you) before moving on to Chapters 3 and 4 where we will spend most of our time. One notable thing missing from these notes are diagrams. You will find these very useful for making sense of these notes and should make sure to copy these down together with anything else covered in lectures that may help your understanding. These notes also contain many exercises, which I recommend you attempt. Separately I will also give you some further exercises and a sample exam question to give an idea of the kind of thing I might ask in an exam. Good luck! Chapter 1 Overview While non-cooperative game theory assumes hyper-rational agents predicting and best responding to each others’ play to lead to equilibria, evolutionary game theory takes a somewhat different approach. Here we dispose with such assumptions in favour of a milder assumption of evolutionary pressure towards the increasing representation of better strategies and study the re- sults.1. Take for example the question of which side of the road to drive a car (absent any laws which solve the problem). If two drivers are heading in opposite directions towards each other, we can identify two mutually ad- vantageous outcomes: where they pass each other with both driving on the left; and where they pass each other with both driving on the right.
    [Show full text]
  • Cooperation to the Fullest Extent Possible? an Infinitely Repeated Games Experiment
    Cooperation to the Fullest Extent Possible? An Infinitely Repeated Games Experiment Andrew Kloosterman∗ [email protected] University of Virginia P.O. Box 400182 Charlottesville, VA 22904-4182 JEL Classification: C73, C92 Keywords: Repeated Games, Cooperation, Basin of Attraction, Risk Dominance October 24th, 2019 Abstract Laboratory experiments on the infinitely repeated prisoner's dilemma find little cooperation when the discount factor is near the theoretical cutoff discount factor for which cooperation can be supported in equi- librium. The explanation is that non-cooperation is the best response to most beliefs about the other player's strategy. I study a new game that reverses this prediction to understand whether cooperation can be empir- ically observed to the fullest extent that theory says is possible. The main finding is that there is still not pervasive cooperation, less than 50% by the end of the experiments in both treatments. ∗I wish to thank Charlie Holt and participants at the North American ESA Conference 2018, BEEMA V Conference 2019, Uni- versity of Virginia Experimental/Theory seminar, and Appalachian State Experimental Economics seminar for insightful comments. Also, thanks to UVA for financial support. 1 1 Introduction Arguably the foremost contribution of the theory of infinitely repeated games is to show that cooperation may be supported in equilibrium, even when it is not a Nash equilibrium of the stage game. Indeed, there is often a cutoff discount factor such that cooperative outcomes are possible in equilibria of the infinitely repeated game when the discount factor equals or exceeds the cutoff. On the other hand, repetition of the non-cooperative Nash equilibrium of the stage game is also an equilibrium of the infinitely repeated game.
    [Show full text]
  • G5212: Game Theory Mark Dean Spring 2017
    Nash Equilibrium - Justifications, Refinements, Evidence G5212: Game Theory Mark Dean Spring 2017 Nash Equilibrium - Justifications, Refinements, Evidence More on Nash Equilibrium So now we know That (almost) all games have a Nash Equilibrium in mixed strategies How to find these equilibria by calculating best responses Over the next lecture (or so) we will discuss further aspects of NE Justification Refinements Experimental Evidence Nash Equilibrium - Justifications, Refinements, Evidence Justification of Nash Equilibrium Sometime, Nash equilibrium can seem such a natural concept that we don’tthink too hard about its justification However, this can be problematic If we don’tthink about why Nash Equilibrium is a compelling notion, perhaps we don’thave a good idea about when to apply it It is particularly worth thinking about in the context of mixed strategies How do we interpret an equilibrium in mixed strategies? Nash Equilibrium - Justifications, Refinements, Evidence Justification 1: Mixed Strategies as Objects of Choice Perhaps the most obvious justification is that mixed strategies are objects of choice In the same way that people choose pure strategies as a best response After all, in some games it would be a really bad idea to play a pure strategy e.g. Matching pennies Is this a good justification? Nash Equilibrium - Justifications, Refinements, Evidence Justification 1: Mixed Strategies as Objects of Choice Ap B1 p Ap 9, 9 0, 5 B1 p 5, 0 7, 7 NE (i): If player i plays a mixed strategy i, each si such that i (si) > 0 is a best response to i. Then
    [Show full text]
  • Safety in Mechanism Design and Implementation Theory†
    SAFETY IN MECHANISM DESIGN AND IMPLEMENTATION THEORY† GEORGE SHOUKRY¤ ABSTRACT. We introduce safety in implementation theory as robustness of players’ welfare to unexpected deviations by others. Specifically, we define a (®,!)-safe strategy profile to be one at which a deviation by any ® players can result in at most ! victims, and define a victim to be a player who attains an outcome within his least preferred K outcomes, where K is set by the designer. We discuss three notions of implementation: Nash implementation with all Nash equilibria being safe, implementation in safe equilibria, and double implementation in safe and Nash equilibria. Strong safe implementation is the most desirable notion; we show that it is restrictive when no other assumptions are made, but that mild behavioral assumptions unrelated to safety can achieve strong safe implementation from double implementation. We give conditions that are necessary for implementation in safe equilibria and sufficient under mild preference restrictions. We then address double implementation and, allowing for simple transfers, we give conditions that are both necessary and sufficient for double implementation. We prove a “no guarantees” result showing that absolute safety (® n 1 and ! 0) can lead to Æ ¡ Æ non-existence of Nash equilibria in a wide range of environments making safe implementation with guarantees impossible. We show that, in general, safety leads to restrictions in every player’s freedom and to a loss in efficiency. We illustrate the design of a safe mechanism in an example of hiring candidates with multidimensional quality. 1 INTRODUCTION We introduce a notion of safety as robustness of agents’ welfare to unexpected deviations by others.
    [Show full text]
  • Slow to Anger and Fast to Forgive: Cooperation in an Uncertain World
    Slow to Anger and Fast to Forgive: Cooperation in an Uncertain World Drew Fudenberg, David G. Rand, and Anna Dreber* Abstract: We study the experimental play of the repeated prisoner’s dilemma when intended actions are implemented with noise. In treatments where cooperation is an equilibrium, subjects cooperate substantially more than in treatments without cooperative equilibria. In all settings there was considerable strategic diversity, indicating that subjects had not fully learned the distribution of play. Furthermore, cooperative strategies yielded higher payoffs than uncooperative strategies in the treatments with cooperative equilibria. In these treatments successful strategies were “lenient” in not retaliating for the first defection, and many were “forgiving” in trying to return to cooperation after inflicting a punishment. Repeated games with observed actions have a great many equilibrium outcomes when players are patient, as shown by various folk theorems. 1 These theorems show that cooperative play is possible when players are concerned about future rewards and punishments, but since repeated play of a static equilibrium is always an equilibrium of the repeated game, the folk theorems do no predict that cooperation will in fact occur. Intuition and evidence (e.g. Robert Axelrod 1984; Pedro Dal Bó 2005; Anna Dreber et al 2008; Dal Bó and Guillaume Frechette 2009; John Duffy and Jack Ochs 2009) suggest that in repeated games with observed actions players do indeed tend to cooperate when * Fudenberg: Department of Economics, Harvard University, 1805 Cambridge Street, Cambridge MA 02138, USA (email: [email protected]); Rand: Program for Evolutionary Dynamics, Harvard University, 1 Brattle Square Suite 6, Cambridge MA 02138, USA (email: [email protected]); Dreber: SIFR, Drottninggatan 89, 11360 Stockholm, Sweden (email: [email protected]).
    [Show full text]