Graphical Games: Equilibrium and Extensions 2.3 Graphical Games

Total Page:16

File Type:pdf, Size:1020Kb

Graphical Games: Equilibrium and Extensions 2.3 Graphical Games Computational Economics (Algorithmic Game Theory) Xiang-Yang Li, Lan Zhang School of Computer Science and Technology, USTC Professor, CS Department 2021 Graphical Games: Equilibrium and Extensions 2.3 Graphical Games » 2.3.1 Graphical Games • compact representation » 2.3.2 Computing Nash Equilibria • TreeProp • NashProp : a distributed, message-passing algorithm » 2.3.3 Correlated Equilibria • definition and motivation • representation • computation 3 2.3 Graphical Games » 2.3.1 Graphical Games • compact representation » 2.3.2 Computing Nash Equilibria • TreeProp • NashProp : a distributed, message-passing algorithm » 2.3.3 Correlated Equilibria • definition and motivation • representation • computation 4 Multiplayer Games » Large population games with limit players’ interaction. » Game Theory: • provide sound, rigorous mathematical formulation. • limited attention to problem representation: commonly “flat”, large-size representation that don’t exploit “structure”. • graph-based representation introduced to model interaction. » Multiplayer games Algorithms for computing equilibria in large population games with structured interactions Multiplayer Game Example » A multiplayer game consists of 푛 players, each with a finite set of pure strategies or actions available to them, along with a specification of the payoffs to each player. » Example 1: Pollution game • This game is the extension of Prisoner’s Dilemma to the case of many players. Different » Example 2: Tragedy of the commons. geographic locations Multiplayer Game Normal Form » A multiplayer game consists of n players, each with a finite set of pure strategies or actions available to them, along with a specification of the payoffs to each player. » 푎푖 ∈ {0, 1} : the action chosen by player 푖, and the joint action 푎Ԧ ∈ {0, 1}푛 » 푀푖 ∈ [0, 1] : the payoff to player 푖, indexed by the joint action 푎Ԧ. » The actions 0 and 1 are the pure strategies of each player: • a mixed strategy for player 푖 is given by the probability 푝푖 ∈ [0, 1] that the player will play 0 » For any joint mixed strategy, given by a produce distribution 푝Ԧ, we define the expected payoff to player 푖 as : 푀푖 푝Ԧ = 퐸푎~푝Ԧ[푀푖(푎Ԧ)] 7 Issues with Normal Form » The normal form representation of Multiplayer Game with large player population is not good enough. » Complexity: the number of parameters that must be specified grows exponentially with the size of the population. • Assuming 푛 players and 2 actions, as we have here, leads to the need for: 푛 matrices 푀푖(one for each player) each of size 2푛 » Conceptual: the normal form may fail to capture structure that is present in the strategic interaction: • Strong Influence • Weakly Influence 8 Structure in Multiplayer Game » It is assumed that the payoff 푀푖 for player 푖 is a function of all the components 푎푗, (푗 = 1, … , 푛) in the joint action vector 푎Ԧ » However, the payoff for player 푖 may be dependent only on the actions of a subset of player 푁(푖) • Conditional independence payoff assumption » Perhaps: the payoff of each player are determined by the actions of only a small subpopulation. • Strong influence • The environmental pollution of a country is more affected by neighboring countries. 9 Graphical Model » Graphical Model : models of structed probabilistic interaction. • 푛 points represent 푛 players, for which naïve representation is size : 2푛 • representation size mostly a function of the “degree of local interaction” among points or players. » Graph Model allows: • easy interpretation • compact representation • efficient computation in some cases Graphical Game & Graph Model » Graphical Games adopt a simple Graph Model. » A graphical game is described by an undirected graph 퐺: • players ~ vertices » A player or vertex 푖 has payoffs that are entirely specified by the actions of 푖 and those of its neighbor set in 퐺 • Strong Influence along neighbors » Now the payoff to player 푖 is a function only of the actions of 푖 and its neighbors: • Rather than the actions of the entire population • Reduce Complexity. 11 Graphical Games » Graphical games can capture and exploit locality or sparsity of direct influences. » Graphical Games: • borrow representational ideas from graphical models. • intuitive graph interpretation: a player’s payoff is only a function of its neighborhood. • example : geography, networks • analogy to probabilistic graphical model : special structure. Graphical Games Formal Definition » A graphical game is a pair (퐺, ℳ), where 퐺 is an undirected graph over the vertices {1, … , 푛}, and ℳ is a set of 푛 local game matrices. For any joint action 푎Ԧ, the 푖 local game matrix 푀푖 ∈ ℳ specifies the payoff 푀푖(푎 ) for player 푖, which depends only on the actions by the players in 푁(푖). Graphical Games Definition » 퐺 : undirected graph representing the local interaction » 푀 : a set of 푛 local game matrices » Player 푖’s payoff 푀푖 푎Ԧ is only a function of its neighborhood 푁(푖): implies conditional independence payoff assumption. ′ ′ » Local payoff matrix 푀푖 : 푀푖 푎Ԧ = 푀푖 푎Ԧ 푁 푖 » Graphical game complexity: max degree of local interaction 푘 = 푚푎푥푖 푁 푖 ≪ 푛 representation size 푂(푛2푘) (exponential in max degree) Equilibrium Definition » Nash equilibrium(NE): A Nash equilibrium for the game is a mixed strategy 푝Ԧ such that for any player 푖, and for any value ′ 푝푖 ∈ [0, 1] ′ 푀푖 푝Ԧ ≥ 푀푖(푝Ԧ[푖: 푝푖 ]) We say that 푝푖 is a best response to the rest of 푝Ԧ » 휖-Nash equilibrium: An 휖-Nash equilibrium is a mixed strategy ′ 푝Ԧ such for any player 푖, and for any any value 푝푖 ∈ [0, 1] ′ 푀푖 푝Ԧ + 휖 ≥ 푀푖(푝Ԧ[푖: 푝푖 ]) We say that 푝푖 is an ε-best response to the rest of 푝Ԧ 15 2.3 Graphical Games » 2.3.1 Graphical Games • compact representation » 2.3.2 Computing Nash Equilibria • TreeProp • NashProp » 2.3.3 Correlated Equilibria • definition and motivation • representation • computation 16 TreeNash Notation and Concept » TreeNash is a tree algorithm, which runs in polynomial time and provably computes approximations of all equilibria. » Capital letters: 푈, 푉 푎푛푑 푊 to denote player/vertex to distinguish them from their chosen actions/values(lower letter 푢, 푣, 푤). » Local game matrix: 푀푉 to denote the local game matrix for the player/vertex 푉. TreeNash Notation and Concept » If G is a tree, we choose an arbitrary vertex as the root (which we visualize as being at the bottom, with the leaves Leaf/Parent at the top). » Upstream: any vertex on a path from 푉 to any leaf will be called upstream from 푉: downstream upstream • 푈푃퐺 푉 to denote the set of all vertices in 퐺 that are upstream from 푉 » Downstream: any vertex on the path Root/Child from a vertex 푉 to the root will be called downstream from 푉. TreeProp NE » Suppose that 푉 is the child of 푈 in 퐺. » So, we let 퐺푈 denote the subgraph induced by the vertices in 푈푃퐺(푈) the subtree of 퐺 rooted at 푈 » Let: 푣 ∈ [0, 1] is a mixed strategy for 푈 player/vertex 푉: ℳ푉=푣 will be the subset of payoff matrices in ℳ corresponding to the vertices in 푈푃퐺(푈) TreeProp NE » An NE for the graphical game 푈 푈 (퐺 , ℳ푉=푣) is a conditional equilibrium “upstream” from 푈 – that is an equilibrium for 퐺푈 given that 푉 plays 푣. » Here we are simply exploiting the fact that since 퐺 is a tree, fixing a mixed strategy 푣 for the play of 푉 isolates 퐺푈 from the rest of 퐺. TreeProp Downstream: 푇(푣, 푢) » Now suppose that vertex 푉 has 푘 parents 푈1, 푈2, … , 푈푘 and the single child 푊. » The data structures sent from each 푈푖 to 푉, on the downstream pass of TreeNash , and in turn from 푉 to 푊 : • Each parent 푈 will send to 푉 a 푖 푇(푣, 푢푖) binary-valued “table” 푇(푣, 푢푖) TreeProp Downstream: 푇(푣, 푢) » The table is indexed by the continuum of possible values for the mixed strategies 푣 ∈ [0, 1] of 푉 and 푢푖 ∈ [0, 1] of 푈1, 푈2, … , 푈푘 » The semantics of this table: for any pair (푣, 푢 ), 푇(푣, 푢 ) will be 1 if and 푖 푖 푇(푣, 푢푖) only if there exists an NE for 푈 푈푖 푖 (퐺 , ℳ푉=푣) in which 푈1 = 푢푖 TreeProp Downstream: 푇(푤, 푣) » The data structures sent from 푉 to 푊, on the downstream pass of TreeNash » 푇(푤, 푣) = 1 ⟺ there exists a vector of mixed strategies 푢 = (푢1, … , 푢푘) (called a witness) for the parents 푈 = (푈1, … , 푈푘) of 푉 such that: 푇 푣, 푢푖 = 1 for all 1 ≤ 푖 ≤ 푘 푉 = 푣 is a best response to 푈 = 푢, 푊 = 푤. 푇(푤, 푣) TreeProp Downstream » There may be more than one witness for 푇 (푤, 푣) = 1: • 푉 will also keep a list of the witnesses 푢 for each pair (푤, 푣) for which 푇 (푤, 푣) = 1 • These witness lists will be used on the upstream pass. » The downstream pass of the algorithm terminates at the root 푊. TreeProp Upstream » Begin: Root node W choose any witness (푉1, … , 푉푘) to 푇(푤) = 1, and then passing both w and 푣푖 to each parent 푉푖. • The interpretation is that 푊 will play 푤, and is “instructing” 푉푖 to play 푣푖 • if a vertex 푉 receives a value 푣 to play from its downstream 푇(푤, 푣) neighbor 푊, and the value 푤 that 푊 will play, then it must be that 푇 (푤, 푣) = 1. TreeProp Upstream » 푉 chooses a witness 푢 to 푇 (푤, 푣) = 1, and passes each parent 푈푖 their value 푢푖 as well as 푣 » Note that the semantics of 푇 (푤, 푣) = 1 ensure that 푉 = 푣 is a best response 푇(푣, 푢푖) to 푈 = 푢, 푊 = 푤. TreeProp Algorithm Flow » Downstream Pass: • each node 푉 receives 푇(푣, 푢푖) from each 푈푖; • node 푉 computes 푇(푤, 푣) and witness lists for each 푇(푤, 푣) = 1 » Upstream Pass: • each node 푉 receives value (푤, 푣) from node W, s.t.
Recommended publications
  • Parity Games: Descriptive Complexity and Algorithms for New Solvers
    Imperial College London Department of Computing Parity Games: Descriptive Complexity and Algorithms for New Solvers Huan-Pu Kuo 2013 Supervised by Prof Michael Huth, and Dr Nir Piterman Submitted in part fulfilment of the requirements for the degree of Doctor of Philosophy in Computing of Imperial College London and the Diploma of Imperial College London 1 Declaration I herewith certify that all material in this dissertation which is not my own work has been duly acknowledged. Selected results from this dissertation have been disseminated in scientific publications detailed in Chapter 1.4. Huan-Pu Kuo 2 Copyright Declaration The copyright of this thesis rests with the author and is made available under a Creative Commons Attribution Non-Commercial No Derivatives licence. Researchers are free to copy, distribute or transmit the thesis on the condition that they attribute it, that they do not use it for commercial purposes and that they do not alter, transform or build upon it. For any reuse or redistribution, researchers must make clear to others the licence terms of this work. 3 Abstract Parity games are 2-person, 0-sum, graph-based, and determined games that form an important foundational concept in formal methods (see e.g., [Zie98]), and their exact computational complexity has been an open prob- lem for over twenty years now. In this thesis, we study algorithms that solve parity games in that they determine which nodes are won by which player, and where such decisions are supported with winning strategies. We modify and so improve a known algorithm but also propose new algorithmic approaches to solving parity games and to understanding their descriptive complexity.
    [Show full text]
  • Learning Board Game Rules from an Instruction Manual Chad Mills A
    Learning Board Game Rules from an Instruction Manual Chad Mills A thesis submitted in partial fulfillment of the requirements for the degree of Master of Science University of Washington 2013 Committee: Gina-Anne Levow Fei Xia Program Authorized to Offer Degree: Linguistics – Computational Linguistics ©Copyright 2013 Chad Mills University of Washington Abstract Learning Board Game Rules from an Instruction Manual Chad Mills Chair of the Supervisory Committee: Professor Gina-Anne Levow Department of Linguistics Board game rulebooks offer a convenient scenario for extracting a systematic logical structure from a passage of text since the mechanisms by which board game pieces interact must be fully specified in the rulebook and outside world knowledge is irrelevant to gameplay. A representation was proposed for representing a game’s rules with a tree structure of logically-connected rules, and this problem was shown to be one of a generalized class of problems in mapping text to a hierarchical, logical structure. Then a keyword-based entity- and relation-extraction system was proposed for mapping rulebook text into the corresponding logical representation, which achieved an f-measure of 11% with a high recall but very low precision, due in part to many statements in the rulebook offering strategic advice or elaboration and causing spurious rules to be proposed based on keyword matches. The keyword-based approach was compared to a machine learning approach, and the former dominated with nearly twenty times better precision at the same level of recall. This was due to the large number of rule classes to extract and the relatively small data set given this is a new problem area and all data had to be manually annotated.
    [Show full text]
  • Complexity in Simulation Gaming
    Complexity in Simulation Gaming Marcin Wardaszko Kozminski University [email protected] ABSTRACT The paper offers another look at the complexity in simulation game design and implementation. Although, the topic is not new or undiscovered the growing volatility of socio-economic environments and changes to the way we design simulation games nowadays call for better research and design methods. The aim of this article is to look into the current state of understanding complexity in simulation gaming and put it in the context of learning with and through complexity. Nature and understanding of complexity is both field specific and interdisciplinary at the same time. Analyzing understanding and role of complexity in different fields associated with simulation game design and implementation. Thoughtful theoretical analysis has been applied in order to deconstruct the complexity theory and reconstruct it further as higher order models. This paper offers an interdisciplinary look at the role and place of complexity from two perspectives. The first perspective is knowledge building and dissemination about complexity in simulation gaming. Second, perspective is the role the complexity plays in building and implementation of the simulation gaming as a design process. In the last section, the author offers a new look at the complexity of the simulation game itself and perceived complexity from the player perspective. INTRODUCTION Complexity in simulation gaming is not a new or undiscussed subject, but there is still a lot to discuss when it comes to the role and place of complexity in simulation gaming. In recent years, there has been a big number of publications targeting this problem from different perspectives and backgrounds, thus contributing to the matter in many valuable ways.
    [Show full text]
  • Game Complexity Vs Strategic Depth
    Game Complexity vs Strategic Depth Matthew Stephenson, Diego Perez-Liebana, Mark Nelson, Ahmed Khalifa, and Alexander Zook The notion of complexity and strategic depth within games has been a long- debated topic with many unanswered questions. How exactly do you measure the complexity of a game? How do you quantify its strategic depth objectively? This seminar answered neither of these questions but instead presents the opinion that these properties are, for the most part, subjective to the human or agent that is playing them. What is complex or deep for one player may be simple or shallow for another. Despite this, determining generally applicable measures for estimating the complexity and depth of a given game (either independently or comparatively), relative to the abilities of a given player or player type, can provide several benefits for game designers and researchers. There are multiple possible ways of measuring the complexity or depth of a game, each of which is likely to give a different outcome. Lantz et al. propose that strategic depth is an objective, measurable property of a game, and that games with a large amount of strategic depth continually produce challenging problems even after many hours of play [1]. Snakes and ladders can be described as having no strategic depth, due to the fact that each player's choices (or lack thereof) have no impact on the game's outcome. Other similar (albeit subjective) evaluations are also possible for some games when comparing relative depth, such as comparing Tic-Tac-Toe against StarCraft. However, these comparative decisions are not always obvious and are often biased by personal preference.
    [Show full text]
  • Minimax AI Within Non-Deterministic Environments
    Minimax AI within Non-Deterministic Environments by Joe Dan Davenport, B.S. A Thesis In Computer Science Submitted to the Graduate Faculty Of Texas Tech University in Partial Fulfillment of The Requirements for The Degree of MASTER OF SCIENCE Approved Dr. Nelson J. Rushton Committee Chair Dr. Richard Watson Dr. Yuanlin Zhang Mark Sheridan, Ph.D. Dean of the Graduate School August, 2016 Copyright 2016, Joe Dan Davenport Texas Tech University, Joe Dan Davenport, August 2016 Acknowledgements There are a number of people who I owe my sincerest thanks for arriving at this point in my academic career: First and foremost I wish to thank God, without whom many doors that were opened to me would have remained closed. Dr. Nelson Rushton for his guidance both as a scientist and as a person, but even more so for believing in me enough to allow me to pursue my Master’s Degree when my grades didn’t represent that I should. I would also like to thank Dr. Richard Watson who originally enabled me to come to Texas Tech University and guided my path. I would also like to thank Joshua Archer, and Bryant Nelson, not only for their companionship, but also for their patience and willingness to listen to my random thoughts; as well as my manger, Eric Hybner, for bearing with me through this. Finally I would like to thank some very important people in my life. To my Mother, I thank you for telling me I could be whatever I wanted to be, and meaning it. To Israel Perez for always being there for all of us.
    [Show full text]
  • How Game Complexity Affects the Playing Behavior of Synthetic Agents
    Kiourt, C., Kalles, Dimitris and Kanellopoulos, P., (2017), How game complexity affects the playing behavior of synthetic agents, 15th European Conference on Multi-Agent Systems, Evry, 14-15 December 2017 EUMAS 2017 How game complexity affects the playing behavior of synthetic agents Chairi Kiourt1, Dimitris Kalles1, and Panagiotis Kanellopoulos2 1School of Science and Technology, Hellenic Open University, Patras, Greece, chairik, [email protected] 2CTI Diophantus and University of Patras, Rion, Greece. [email protected] Abstract—Agent based simulation of social organizations, via of the game. In our investigation, we adopted the state-space the investigation of agents’ training and learning tactics and complexity approach, which is the most-known and widely strategies, has been inspired by the ability of humans to learn used [13]–[15]. from social environments which are rich in agents, interactions and partial or hidden information. Such richness is a source of The complexity of a large set of well-known games has complexity that an effective learner has to be able to navigate. been calculated [14], [15] at various levels, but their usability This paper focuses on the investigation of the impact of the envi- in multi-agent systems as regards the impact on the agents’ ronmental complexity on the game playing-and-learning behavior learning/playing progress is still a flourishing research field. of synthetic agents. We demonstrate our approach using two In this article, we study the game complexity impact on independent turn-based zero-sum games as the basis of forming social events which are characterized both by competition and the learning/training progress of synthetic agents, as well as cooperation.
    [Show full text]
  • Cancer's Intelligence
    Int. Journ. of Unconventional Computing, Vol. 16, pp. 41–78 ©2020 Old City Publishing, Inc. Reprints available directly from the publisher Published by license under the OCP Science imprint, Photocopying permitted by license only a member of the Old City Publishing Group Cancer’s Intelligence J. JAMES FROST† BioMolecular Imaging, 3801 Canterbury Road, Ste. 914, Baltimore, Maryland 21218, USA; Phone +1-443-869-2267; E-mail: [email protected] Received: September 15, 2020. Accepted: September 25, 2020. Cancer is analyzed as an intelligent system of collaborating and computing cells. The limitations of the current regime of cancer research and treatment are addressed, and the resultant need for new paradigmatic thinking is pre- sented. Features of intelligence pervade the natural world from humans to animals of all sizes and complexity to microorganisms. Yet, cancer has hith- erto not been investigated as acting with intelligence as it evades the body’s and the oncologist’s failed attempts to eradicate it. In this analysis, concepts of computation, including self computation and the limits of computation; game playing; e-machine analysis; self-aware systems; P and NP-hard problems; and Boolean networks are addressed and related to features of cancer that can be described as intelligent. The implications of the devel- oped theory of cancer’s intelligence are discussed, together with several signposts and recommendations for new cancer research. Keywords: Cancer, intelligence, computation, game theory, Boolean network 1 INTRODUCTION The grim plight of cancer continues to endure in the face of legions of tar- geted drugs, reams of cancer gene data, and multitudes of physicists and mathematicians on the attack (1).
    [Show full text]
  • EVOLUTIONARY AI in BOARD GAMES an Evaluation of the Performance of an Evolutionary Algorithm in Two Perfect Information Board Games with Low Branching Factor
    EVOLUTIONARY AI IN BOARD GAMES An evaluation of the performance of an evolutionary algorithm in two perfect information board games with low branching factor Bachelor Degree Project in Informatics G2E, 22.5 credits, ECTS Spring term 2015 Viktor Öberg Supervisor: Joe Steinhauer Examiner: Anders Dahlbom Abstract It is well known that the branching factor of a computer based board game has an effect on how long a searching AI algorithm takes to search through the game tree of the game. Something that is not as known is that the branching factor may have an additional effect for certain types of AI algorithms. The aim of this work is to evaluate if the win rate of an evolutionary AI algorithm is affected by the branching factor of the board game it is applied to. To do that, an experiment is performed where an evolutionary algorithm known as “Genetic Minimax” is evaluated for the two low branching factor board games Othello and Gomoku (Gomoku is also known as 5 in a row). The performance here is defined as how many times the algorithm manages to win against another algorithm. The results from this experiment showed both some promising data, and some data which could not be as easily interpreted. For the game Othello the hypothesis about this particular evolutionary algorithm appears to be valid, while for the game Gomoku the results were somewhat inconclusive. For the game Othello the performance of the genetic minimax algorithm was comparable to the alpha-beta algorithm it played against up to and including depth 4 in the game tree.
    [Show full text]
  • Combinatorial Game Complexity: an Introduction with Poset Games
    Combinatorial Game Complexity: An Introduction with Poset Games Stephen A. Fenner∗ John Rogersy Abstract Poset games have been the object of mathematical study for over a century, but little has been written on the computational complexity of determining important properties of these games. In this introduction we develop the fundamentals of combinatorial game theory and focus for the most part on poset games, of which Nim is perhaps the best- known example. We present the complexity results known to date, some discovered very recently. 1 Introduction Combinatorial games have long been studied (see [5, 1], for example) but the record of results on the complexity of questions arising from these games is rather spotty. Our goal in this introduction is to present several results— some old, some new—addressing the complexity of the fundamental problem given an instance of a combinatorial game: Determine which player has a winning strategy. A secondary, related problem is Find a winning strategy for one or the other player, or just find a winning first move, if there is one. arXiv:1505.07416v2 [cs.CC] 24 Jun 2015 The former is a decision problem and the latter a search problem. In some cases, the search problem clearly reduces to the decision problem, i.e., having a solution for the decision problem provides a solution to the search problem. In other cases this is not at all clear, and it may depend on the class of games you are allowed to query. ∗University of South Carolina, Computer Science and Engineering Department. Tech- nical report number CSE-TR-2015-001.
    [Show full text]
  • The Shortest Path Game: Complexity and Algorithms Andreas Darmann, Ulrich Pferschy, Joachim Schauer
    The Shortest Path Game: Complexity and Algorithms Andreas Darmann, Ulrich Pferschy, Joachim Schauer To cite this version: Andreas Darmann, Ulrich Pferschy, Joachim Schauer. The Shortest Path Game: Complexity and Algorithms. 8th IFIP International Conference on Theoretical Computer Science (TCS), Sep 2014, Rome, Italy. pp.39-53, 10.1007/978-3-662-44602-7_4. hal-01402026 HAL Id: hal-01402026 https://hal.inria.fr/hal-01402026 Submitted on 24 Nov 2016 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Distributed under a Creative Commons Attribution| 4.0 International License The Shortest Path Game: Complexity and Algorithms ? Andreas Darmann1, Ulrich Pferschy2, and Joachim Schauer2 1 University of Graz, Institute of Public Economics, Universitaetsstr. 15, 8010 Graz, Austria, [email protected] 2 University of Graz, Department of Statistics and Operations Research, Universitaetsstr. 15, 8010 Graz, Austria, fpferschy, [email protected] Abstract. In this work we address a game theoretic variant of the short- est path problem, in which two decision makers (agents/players) move together along the edges of a graph from a given starting vertex to a given destination. The two players take turns in deciding in each vertex which edge to traverse next.
    [Show full text]
  • A New Algorithm for Generating Equilibria in Massive Zero-Sum Games
    A New Algorithm for Generating Equilibria in Massive Zero-Sum Games Martin Zinkevich Michael Bowling Neil Burch Department of Computing Science University of Alberta Edmonton, Alberta, Canada T6G 2E8 Abstract Koller, Megiddo, & von Stengel 1994), which can require time cubic in the number of states. In summary, although In normal scenarios, computer scientists often consider the the size of the state space, branching factor, and informa- number of states in a game to capture the difficulty of learn- ing an equilibrium. However, players do not see games in tion properties are suggestive of difficulty they alone do not the same light: most consider Go or Chess to be more com- make a game challenging. However they are the sole factors plex than Monopoly. In this paper, we discuss a new measure in how solution techniques scale with the problem. of game complexity that links existing state-of-the-art algo- In this paper we suggest a new measure called the range rithms for computing approximate equilibria to a more hu- of skill, which may more accurately capture the human per- man measure. In particular, we consider the range of skill ception of game difficulty. Imagine forming a line of Go in a game, i.e.how many different skill levels exist. We then players where the player at the head of the line can beat ev- modify existing techniques to design a new algorithm to com- eryone else in the line at least 75% of the time. The second pute approximate equilibria whose performance can be cap- player can beat everyone behind her at least 75% of the time, tured by this new measure.
    [Show full text]
  • Dominance Solvability in Random Games
    Dominance Solvability in Random Games Noga Alon∗ Kirill Rudov† Leeat Yariv‡§ May 21, 2021 Abstract. We study the effectiveness of iterated elimination of strictly-dominated actions in random games. We show that dominance solvability of games is vanishingly small as the number of at least one player's actions grows. Furthermore, conditional on dominance solvability, the number of itera- tions required to converge to Nash equilibrium grows rapidly as action sets grow. Nonetheless, when games are highly im- balanced, iterated elimination simplifies the game substan- tially by ruling out a sizable fraction of actions. Technically, we illustrate the usefulness of recent combinatorial methods for the analysis of general games. Keywords: Random Games, Dominance Solvability, Iterated Elimi- nation ∗Department of Mathematics, Princeton University, [email protected] †Department of Economics, Princeton University, [email protected] ‡Department of Economics, Princeton University, [email protected] §We thank Roland B´enabou, Amanda Friedenberg, Faruk Gul, Annie Liang, and Drew Fudenberg for useful feedback. We gratefully acknowledge support from NSF grant SES- 1629613. Dominance Solvability in Random Games 1 1. Introduction 1.1. Overview. First introduced by Moulin(1979) in the context of voting, dominance solvability relies on a straightforward prescription. If a player has an action that generates worse payoffs than another regardless of what other players select|a strictly dominated action|she should never use it. When the structure of the game is commonly known, other players can infer their opponents' strictly dominated actions and assume they will not be played. With those strictly dominated actions eliminated, the resulting, reduced game may have further strictly dominated actions that can then be eliminated, and so on and so forth.
    [Show full text]