Lecture 19: Poa for Strong Nash Equilibrium

Total Page:16

File Type:pdf, Size:1020Kb

Lecture 19: Poa for Strong Nash Equilibrium CS 6840, Spring 2020 Lecture 19: PoA for Strong Nash Equilibrium CS 6840 Algorithmic Game Theory March 9, 2020 Lecture 19: PoA for Strong Nash Equilibrium Instructor: Eva´ Tardos Scribe: Abhishek Shetty 1 Price of Anarchy for Strong Nash Equilibrium Consider a cost sharing game with the set of \shareable" elements E and n players with strategies Si ⊆ E. The cost of player i for a strategies given by S = (S1;:::;Sn) is given by X ce ci (S) = χe e2Si where ce is the cost of element e and χe is the number of players j such that e 2 Sj. The social cost SC is defined as n n X X X ce SC (S) = ci = : χe i=1 i=1 e2Si Recall that this game is a potential game with potential Φ given by χe X X ce Φ(S) = : k e2E k=1 Definition 1.1 (Strong Nash Equilibrium, See Notes). Let G be a game with n players and costs ci.A strategy s = (s1; : : : ; sn) is said to be a strong Nash equilibrium if for every subset A ⊆ [n] and every 0 alternate strategy vector sA, we have 0 ci (s) ≤ ci (sA; s−A) for all i 2 A. We will show that in such games social cost of a strong Nash equilibrium, if one exists, is bounded by a Hn factor of the optimal social cost, where Hn is the nth Harmonic number. Recall that Hn ∼ ln n. Also, recall the example given by the following graph. There is a unique Nash equilibrium which is also a strong Nash equilibrium and it has a price of anarchy of Hn, which shows that the result of the following theorem is tight. Theorem 1.1. Consider a cost sharing game as defined above. Let S = (S1;:::;Sn) be a strong Nash ∗ ∗ ∗ equilibrium and let S = (S1 ;:::;Sn) be a strategy of minimum social cost. Then, ∗ SC (S) ≤ Hn · SC (S ) Pn 1 where Hn = k=1 =k is the nth Harmonic number. 1 CS 6840, Spring 2020 Lecture 19: PoA for Strong Nash Equilibrium Proof. From the definition of strong Nash equilibrium, we have that there is a player (which we label n without loss of generality) such that ∗ cn (S) ≤ cn (S ) : Now let An−1 = f1; 2; : : : n − 1g denote the remaining set. We will inductively renumber of players and define the sets A = f1; 2; : : : ig (backwards induction from n). By considering S∗ as the alternative i Ai strategy for the set of players Ai. From the definition of strong Nash equilibrium, there is a player, which we will relabel at player i, such that has at least as large a cost by moving: c (S) ≤ c S∗ ;S : i i Ai −Ai Summing this over i gives us n n X X c (S) ≤ c S∗ ;S : i i Ai −Ai i=1 i=1 We consider a possible extension of the game where certain subsets of players participate in none of the congestible elements (equivalently, they `leave' the game). This can be realized by including the empty set in the set of allowed strategies of every player. For any strategy T and subset B ⊆ [n], denote by TB the strategy that agrees with T on the players indexed by B while the rest of the players play the empty set. Lemma 1.2. For every player i, we have c S∗ ;S ≤ c S∗ : i Ai −Ai i Ai Remark. This lemma can be seen to capture the fact that the game has positive `externalities'. Proof. The proof follows by observing that for every element e, S∗ ;S has more player accessing Ai −Ai e than in S∗ and the cost of each element is monotone decreasing in the number of player accessing Ai each element. Lemma 1.3. For every player i, we have c S∗ = Φ S∗ − Φ S∗ : i Ai Ai Ai−1 Proof. Since the game is a potential game, we have c S∗ − c S∗ = Φ S∗ − Φ S∗ : i Ai i Ai−1 Ai Ai−1 The claim follows by noting that c S∗ = 0, since the strategy of player i here is the empty set. i Ai−1 From the two lemmas above, we get n n X X h i c (S) = Φ S∗ − Φ S∗ i Ai Ai−1 i=1 i=1 = Φ (S∗) ∗ ≤ Hn · SC (S ) where the equation uses the fact that Φ(;) = 0. The last inequality follows from the proof of the bound on the price of stability for cost sharing as shown in class on February 3, 2020. It is an interesting question to construct a potential game with a strong Nash equilibrium, such that the minimizer of the potential is not a strong Nash equilibrium. 2 CS 6840, Spring 2020 Lecture 19: PoA for Strong Nash Equilibrium 2 Core of a Cost Sharing Game In this section, we shall look at a different solution concept for games. In order to motivate this, recall the following game. Note that this game has no strong Nash equilibria. We shall look at a solution concept which does indeed exist for this game. Definition 2.1. Consider a game with n players. Let c : 2[n] ! R be a function such that for every A ⊆ [n], c (A) denotes the cost suffered if players in A cooperate. A vector α is said to be in the core if Pn • j=1 αi = c ([n]) P • For every subset S ⊆ [n], j2S αi ≤ c (S) Remark. The condition for a vector being a core is a set of 2n linear inequalities. Note that in the above game (10; 10) is in the core of the game, thus serving as an example of a game where the core is non-empty but there is no strong Nash equilibrium. Unfortunately, not all games (or even cost sharing games) have a non-empty core. To see this, consider the following example. A B a b c C Figure 1: The cost of each red edge is 1, the black edges are 0. The player source-sink pairs are: (a; A); (b; B); (c; C). To show that the core is empty notice that the min-cost for any two players is only 1. Adding these constraints the three of them total can only pay 1.5, but the total cost of the min-cost solution is the paths 2. 3.
Recommended publications
  • Implementation Theory*
    Chapter 5 IMPLEMENTATION THEORY* ERIC MASKIN Institute for Advanced Study, Princeton, NJ, USA TOMAS SJOSTROM Department of Economics, Pennsylvania State University, University Park, PA, USA Contents Abstract 238 Keywords 238 1. Introduction 239 2. Definitions 245 3. Nash implementation 247 3.1. Definitions 248 3.2. Monotonicity and no veto power 248 3.3. Necessary and sufficient conditions 250 3.4. Weak implementation 254 3.5. Strategy-proofness and rich domains of preferences 254 3.6. Unrestricted domain of strict preferences 256 3.7. Economic environments 257 3.8. Two agent implementation 259 4. Implementation with complete information: further topics 260 4.1. Refinements of Nash equilibrium 260 4.2. Virtual implementation 264 4.3. Mixed strategies 265 4.4. Extensive form mechanisms 267 4.5. Renegotiation 269 4.6. The planner as a player 275 5. Bayesian implementation 276 5.1. Definitions 276 5.2. Closure 277 5.3. Incentive compatibility 278 5.4. Bayesian monotonicity 279 * We are grateful to Sandeep Baliga, Luis Corch6n, Matt Jackson, Byungchae Rhee, Ariel Rubinstein, Ilya Segal, Hannu Vartiainen, Masahiro Watabe, and two referees, for helpful comments. Handbook of Social Choice and Welfare, Volume 1, Edited by K.J Arrow, A.K. Sen and K. Suzumura ( 2002 Elsevier Science B. V All rights reserved 238 E. Maskin and T: Sj'str6m 5.5. Non-parametric, robust and fault tolerant implementation 281 6. Concluding remarks 281 References 282 Abstract The implementation problem is the problem of designing a mechanism (game form) such that the equilibrium outcomes satisfy a criterion of social optimality embodied in a social choice rule.
    [Show full text]
  • Collusion Constrained Equilibrium
    Theoretical Economics 13 (2018), 307–340 1555-7561/20180307 Collusion constrained equilibrium Rohan Dutta Department of Economics, McGill University David K. Levine Department of Economics, European University Institute and Department of Economics, Washington University in Saint Louis Salvatore Modica Department of Economics, Università di Palermo We study collusion within groups in noncooperative games. The primitives are the preferences of the players, their assignment to nonoverlapping groups, and the goals of the groups. Our notion of collusion is that a group coordinates the play of its members among different incentive compatible plans to best achieve its goals. Unfortunately, equilibria that meet this requirement need not exist. We instead introduce the weaker notion of collusion constrained equilibrium. This al- lows groups to put positive probability on alternatives that are suboptimal for the group in certain razor’s edge cases where the set of incentive compatible plans changes discontinuously. These collusion constrained equilibria exist and are a subset of the correlated equilibria of the underlying game. We examine four per- turbations of the underlying game. In each case,we show that equilibria in which groups choose the best alternative exist and that limits of these equilibria lead to collusion constrained equilibria. We also show that for a sufficiently broad class of perturbations, every collusion constrained equilibrium arises as such a limit. We give an application to a voter participation game that shows how collusion constraints may be socially costly. Keywords. Collusion, organization, group. JEL classification. C72, D70. 1. Introduction As the literature on collective action (for example, Olson 1965) emphasizes, groups often behave collusively while the preferences of individual group members limit the possi- Rohan Dutta: [email protected] David K.
    [Show full text]
  • Stability and Median Rationalizability for Aggregate Matchings
    games Article Stability and Median Rationalizability for Aggregate Matchings Federico Echenique 1, SangMok Lee 2, Matthew Shum 1 and M. Bumin Yenmez 3,* 1 Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA 91125, USA; [email protected] (F.E.); [email protected] (M.S.) 2 Department of Economics, Washington University in St. Louis, St. Louis, MO 63130, USA; [email protected] 3 Department of Economics, Boston College, Chestnut Hill, MA 02467, USA * Correspondence: [email protected] Abstract: We develop the theory of stability for aggregate matchings used in empirical studies and establish fundamental properties of stable matchings including the result that the set of stable matchings is a non-empty, complete, and distributive lattice. Aggregate matchings are relevant as matching data in revealed preference theory. We present a result on rationalizing a matching data as the median stable matching. Keywords: aggregate matching; median stable matching; rationalizability; lattice 1. Introduction Following the seminal work of [1], an extensive literature has developed regarding matching markets with non-transferable utility. This literature assumes that there are agent-specific preferences, and studies the existence of stable matchings in which each Citation: Echenique, F.; Lee, S.; agent prefers her assigned partner to the outside option of being unmatched, and there Shum, M.; Yenmez, M.B. Stability and are no pairs of agents that would like to match with each other rather than keeping their Median Rationalizability for assigned partners. Aggregate Matchings. Games 2021, 12, In this paper, we develop the theory of stability for aggregate matchings, which we 33.
    [Show full text]
  • Rationalizable Implementation of Correspondences∗
    Rationalizable Implementation of Correspondences∗ Takashi Kunimotoyand Roberto Serranoz This Version: May 2016 Abstract We come close to characterizing the class of social choice correspon- dences that are implementable in rationalizable strategies. We identify a new condition, which we call set-monotonicity, and show that it is necessary and almost sufficient for rationalizable implementation. Set-monotonicity is much weaker than Maskin monotonicity, which is the key condition for Nash implementation and which also had been shown to be necessary for rationalizable implementation of social choice functions. Set-monotonicity reduces to Maskin monotonicity in the case of functions. We conclude that the conditions for rationalizable implementation are not only starkly differ- ent from, but also much weaker than those for Nash implementation, when we consider social choice correspondences. JEL Classification: C72, D78, D82. Keywords: Complete information, implementation, Maskin monotonicity, rationalizability, set-monotonicity, social choice correspondence. 1 Introduction The design of institutions to be used by rational agents has been an important research agenda in economic theory. As captured by the notion of Nash equilib- rium, rationality is encapsulated in two aspects: these are (i) the best responses of agents to their beliefs, and (ii) that those beliefs are correct, the so-called rational ∗Financial support from the Japan Society for the Promotion of Science (24330078, 25780128) (Kunimoto) is gratefully acknowledged. All remaining errors are our own. ySchool of Economics, Singapore Management University, 90 Stamford Road, Singapore 178903; [email protected] zDepartment of Economics, Brown University, Providence, RI 02912, U.S.A.; roberto [email protected] 1 expectations assumption. One can drop the latter and retain the former, moving then into the realm of rationalizability.
    [Show full text]
  • Implementation and Strong Nash Equilibrium
    LIBRARY OF THE MASSACHUSETTS INSTITUTE OF TECHNOLOGY Digitized by the Internet Archive in 2011 with funding from Boston Library Consortium Member Libraries http://www.archive.org/details/implementationstOOmask : } ^mm working paper department of economics IMPLEMENTATION AND STRONG NASH EQUILIBRIUM Eric Maskin Number 216 January 1978 massachusetts institute of technology 50 memorial drive Cambridge, mass. 021 39 IMPLEMENTATION AND STRONG NASH EQUILIBRIUM Eric Maskin Number 216 January 1978 I am grateful for the financial support of the National Science Foundation. A social choice correspondence (SCC) is a mapping which assoc- iates each possible profile of individuals' preferences with a set of feasible alternatives (the set of f-optima) . To implement *n SCC, f, is to construct a game form g such that, for all preference profiles the equilibrium set of g (with respect to some solution concept) coincides with the f-optimal set. In a recent study [1], I examined the general question of implementing social choice correspondences when Nash equilibrium is the solution concept. Nash equilibrium, of course, is a strictly noncooperative notion, and so it is natural to consider the extent to which the results carry over when coalitions can form. The cooperative counterpart of Nash is the strong equilibrium due to Aumann. Whereas Nash defines equilibrium in terms of deviations only by single individuals, Aumann 's equilibrium incorporates deviations by every conceivable coalition. This paper considers implementation for strong equilibrium. The results of my previous paper were positive. If an SCC sat- isfies a monotonicity property and a much weaker requirement called no veto power, it can be implemented by Nash equilibrium.
    [Show full text]
  • Strong Nash Equilibria and Mixed Strategies
    Strong Nash equilibria and mixed strategies Eleonora Braggiona, Nicola Gattib, Roberto Lucchettia, Tuomas Sandholmc aDipartimento di Matematica, Politecnico di Milano, piazza Leonardo da Vinci 32, 20133 Milano, Italy bDipartimento di Elettronica, Informazione e Bioningegneria, Politecnico di Milano, piazza Leonardo da Vinci 32, 20133 Milano, Italy cComputer Science Department, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, USA Abstract In this paper we consider strong Nash equilibria, in mixed strategies, for finite games. Any strong Nash equilibrium outcome is Pareto efficient for each coalition. First, we analyze the two–player setting. Our main result, in its simplest form, states that if a game has a strong Nash equilibrium with full support (that is, both players randomize among all pure strategies), then the game is strictly competitive. This means that all the outcomes of the game are Pareto efficient and lie on a straight line with negative slope. In order to get our result we use the indifference principle fulfilled by any Nash equilibrium, and the classical KKT conditions (in the vector setting), that are necessary conditions for Pareto efficiency. Our characterization enables us to design a strong–Nash– equilibrium–finding algorithm with complexity in Smoothed–P. So, this problem—that Conitzer and Sandholm [Conitzer, V., Sandholm, T., 2008. New complexity results about Nash equilibria. Games Econ. Behav. 63, 621–641] proved to be computationally hard in the worst case—is generically easy. Hence, although the worst case complexity of finding a strong Nash equilibrium is harder than that of finding a Nash equilibrium, once small perturbations are applied, finding a strong Nash is easier than finding a Nash equilibrium.
    [Show full text]
  • On the Verification and Computation of Strong Nash Equilibrium
    On the Verification and Computation of Strong Nash Equilibrium Nicola Gatti Marco Rocco Tuomas Sandholm Politecnico di Milano Politecnico di Milano Carnegie Mellon Piazza Leonardo da Vinci 32 Piazza Leonardo da Vinci 32 Computer Science Dep. Milano, Italy Milano, Italy 5000 Forbes Avenue [email protected] [email protected] Pittsburgh, PA 15213, USA [email protected] ABSTRACT The NE concept is inadequate when agents can a priori Computing equilibria of games is a central task in computer communicate, being in a position to form coalitions and de- science. A large number of results are known for Nash equi- viate multilaterally in a coordinated way. The strong Nash librium (NE). However, these can be adopted only when equilibrium (SNE) concept strengthens the NE concept by coalitions are not an issue. When instead agents can form requiring the strategy profile to be resilient also to multilat- coalitions, NE is inadequate and an appropriate solution eral deviations, including the grand coalition [2]. However, concept is strong Nash equilibrium (SNE). Few computa- differently from NE, an SNE may not exist. It is known tional results are known about SNE. In this paper, we first that searching for an SNE is NP–hard, but, except for the study the problem of verifying whether a strategy profile is case of two–agent symmetric games, it is not known whether an SNE, showing that the problem is in P. We then design the problem is in NP [8]. Furthermore, to the best of our a spatial branch–and–bound algorithm to find an SNE, and knowledge, there is no algorithm to find an SNE in general we experimentally evaluate the algorithm.
    [Show full text]
  • 4 Social Interactions
    Beta September 2015 version 4 SOCIAL INTERACTIONS Les Joueurs de Carte, Paul Cézanne, 1892-95, Courtauld Institute of Art A COMBINATION OF SELF-INTEREST, A REGARD FOR THE WELLBEING OF OTHERS, AND APPROPRIATE INSTITUTIONS CAN YIELD DESIRABLE SOCIAL OUTCOMES WHEN PEOPLE INTERACT • Game theory is a way of understanding how people interact based on the constraints that limit their actions, their motives and their beliefs about what others will do • Experiments and other evidence show that self-interest, a concern for others and a preference for fairness are all important motives explaining how people interact • In most interactions there is some conflict of interest between people, and also some opportunity for mutual gain • The pursuit of self-interest can lead either to results that are considered good by all participants, or sometimes to outcomes that none of those concerned would prefer • Self-interest can be harnessed for the general good in markets by governments limiting the actions that people are free to take, and by one’s peers imposing punishments on actions that lead to bad outcomes • A concern for others and for fairness allows us to internalise the effects of our actions on others, and so can contribute to good social outcomes See www.core-econ.org for the full interactive version of The Economy by The CORE Project. Guide yourself through key concepts with clickable figures, test your understanding with multiple choice questions, look up key terms in the glossary, read full mathematical derivations in the Leibniz supplements, watch economists explain their work in Economists in Action – and much more.
    [Show full text]
  • Solution Concepts in Cooperative Game Theory
    1 A. Stolwijk Solution Concepts in Cooperative Game Theory Master’s Thesis, defended on October 12, 2010 Thesis Advisor: dr. F.M. Spieksma Mathematisch Instituut, Universiteit Leiden 2 Contents 1 Introduction 7 1.1 BackgroundandAims ................................. 7 1.2 Outline .......................................... 8 2 The Model: Some Basic Concepts 9 2.1 CharacteristicFunction .............................. ... 9 2.2 Solution Space: Transferable and Non-Transferable Utilities . .......... 11 2.3 EquivalencebetweenGames. ... 12 2.4 PropertiesofSolutions............................... ... 14 3 Comparing Imputations 15 3.1 StrongDomination................................... 15 3.1.1 Properties of Strong Domination . 17 3.2 WeakDomination .................................... 19 3.2.1 Properties of Weak Domination . 20 3.3 DualDomination..................................... 22 3.3.1 Properties of Dual Domination . 23 4 The Core 25 4.1 TheCore ......................................... 25 4.2 TheDualCore ...................................... 27 4.2.1 ComparingtheCorewiththeDualCore. 29 4.2.2 Strong ǫ-Core................................... 30 5 Nash Equilibria 33 5.1 Strict Nash Equilibria . 33 5.2 Weak Nash Equilibria . 36 3 4 CONTENTS 6 Stable Sets 39 6.1 DefinitionofStableSets ............................... .. 39 6.2 Stability in A′ ....................................... 40 6.3 ConstructionofStronglyStableSets . ...... 41 6.3.1 Explanation of the Strongly Stable Set: The Standard of Behavior in the 3-personzero-sumgame ............................
    [Show full text]
  • Games in Coalitional Form 1
    GAMES IN COALITIONAL FORM EHUD KALAI Forthcoming in the New Palgrave Dictionary of Economics, second edition Abstract. How should a coalition of cooperating players allocate payo¤s to its members? This question arises in a broad range of situations and evokes an equally broad range of issues. For example, it raises technical issues in accounting, if the players are divisions of a corporation, but involves issues of social justice when the context is how people behave in society. Despite the breadth of possible applications, coalitional game theory o¤ers a uni…ed framework and solutions for addressing such questions. This brief survey presents some of its major models and proposed solutions. 1. Introduction In their seminal book, von Neumann and Morgenstern (1944) introduced two theories of games: strategic and coalitional. Strategic game theory concentrates on the selection of strategies by payo¤-maximizing players. Coalitional game theory concentrates on coalition formation and the distribution of payo¤s. The next two examples illustrate situations in the domain of the coalitional approach. 1.1. Games with no strategic structure. Example 1. Cost allocation of a shared facility. Three municipalities, E, W, and S, need to construct water puri…cation facilities. Costs of individual and joint facilities are described by the cost function c: c(E) = 20, c(W ) = 30, and c(S) = 50; c(E; W ) = 40, c(E; S) = 60, and c(W; S) = 80; c(E; W; S) = 80. For example, a facility that serves the needs of W and S would cost $80 million. The optimal solution is to build, at the cost of 80, one facility that serves all three municipalities.
    [Show full text]
  • THE HUMAN SIDE of MECHANISM DESIGN a Tribute to Leo Hurwicz and Jean-Jacque Laffont
    THE HUMAN SIDE OF MECHANISM DESIGN A Tribute to Leo Hurwicz and Jean-Jacque Laffont Daniel McFadden Department of Economics University of California, Berkeley December 4, 2008 [email protected] http://www.econ.berkeley.edu/~mcfadden/index.shtml ABSTRACT This paper considers the human side of mechanism design, the behavior of economic agents in gathering and processing information and responding to incentives. I first give an overview of the subject of mechanism design, and then examine a pervasive premise in this field that economic agents are rational in their information processing and decisions. Examples from applied mechanism design identify the roles of perceptions and inference in agent behavior, and the influence of systematic irrationalities and sociality on agent responses. These examples suggest that tolerance of behavioral faults be added to the criteria for good mechanism design. In principle-agent problems for example, designers should consider using experimental treatments in contracts, and statistical post-processing of agent responses, to identify and mitigate the effects of agent non-compliance with contract incentives. KEYWORDS: mechanism_design, principal-agent_problem, juries, welfare_theory JEL CLASSIFICATION: D000, D600, D610, D710, D800, C420, C700 THE HUMAN SIDE OF MECHANISM DESIGN A Tribute to Leo Hurwicz and Jean-Jacque Laffont Daniel McFadden1 1. Introduction The study of mechanism design, the systematic analysis of resource allocation institutions and processes, has been the most fundamental development
    [Show full text]
  • Maximin Equilibrium∗
    Maximin equilibrium∗ Mehmet ISMAILy March, 2014. This version: June, 2014 Abstract We introduce a new theory of games which extends von Neumann's theory of zero-sum games to nonzero-sum games by incorporating common knowledge of individual and collective rationality of the play- ers. Maximin equilibrium, extending Nash's value approach, is based on the evaluation of the strategic uncertainty of the whole game. We show that maximin equilibrium is invariant under strictly increasing transformations of the payoffs. Notably, every finite game possesses a maximin equilibrium in pure strategies. Considering the games in von Neumann-Morgenstern mixed extension, we demonstrate that the maximin equilibrium value is precisely the maximin (minimax) value and it coincides with the maximin strategies in two-player zero-sum games. We also show that for every Nash equilibrium that is not a maximin equilibrium there exists a maximin equilibrium that Pareto dominates it. In addition, a maximin equilibrium is never Pareto dominated by a Nash equilibrium. Finally, we discuss maximin equi- librium predictions in several games including the traveler's dilemma. JEL-Classification: C72 ∗I thank Jean-Jacques Herings for his feedback. I am particularly indebted to Ronald Peeters for his continuous comments and suggestions about the material in this paper. I am also thankful to the participants of the MLSE seminar at Maastricht University. Of course, any mistake is mine. yMaastricht University. E-mail: [email protected]. 1 Introduction In their ground-breaking book, von Neumann and Morgenstern (1944, p. 555) describe the maximin strategy1 solution for two-player games as follows: \There exists precisely one solution.
    [Show full text]