DOCSLIB.ORG

Parity Games: Descriptive Complexity and Algorithms for New Solvers

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Parity Games: Descriptive Complexity and Algorithms for New Solvers Imperial College London Department of Computing Parity Games: Descriptive Complexity and Algorithms for New Solvers Huan-Pu Kuo 2013 Supervised by Prof Michael Huth, and Dr Nir Piterman Submitted in part fulfilment of the requirements for the degree of Doctor of Philosophy in Computing of Imperial College London and the Diploma of Imperial College London 1 Declaration I herewith certify that all material in this dissertation which is not my own work has been duly acknowledged. Selected results from this dissertation have been disseminated in scientific publications detailed in Chapter 1.4. Huan-Pu Kuo 2 Copyright Declaration The copyright of this thesis rests with the author and is made available under a Creative Commons Attribution Non-Commercial No Derivatives licence. Researchers are free to copy, distribute or transmit the thesis on the condition that they attribute it, that they do not use it for commercial purposes and that they do not alter, transform or build upon it. For any reuse or redistribution, researchers must make clear to others the licence terms of this work. 3 Abstract Parity games are 2-person, 0-sum, graph-based, and determined games that form an important foundational concept in formal methods (see e.g., [Zie98]), and their exact computational complexity has been an open prob- lem for over twenty years now. In this thesis, we study algorithms that solve parity games in that they determine which nodes are won by which player, and where such decisions are supported with winning strategies. We modify and so improve a known algorithm but also propose new algorithmic approaches to solving parity games and to understanding their descriptive complexity. For all of our contributions, we write our own custom frameworks, in the Scala programming language, to perform tailored experiments and empirical studies to demonstrate and support our theoretical findings. First, we improve on one of the solver algorithms, based on small progress measures [Jur00], by use of concurrency. We show that, for many parity games, it is possible to deliver extra performance using this technique in a multi-core environment. Second, we design algorithms to reduce the computational complexity of parity games, and create implementations to observe and evaluate the behaviours of these reductions in our experimental settings. The measure Rabin index, arising from the design of the said algorithm, is shown to be a new descriptive complexity for parity games. Finally, we define a new family of attractors and derive new parity game 4 solvers from them. Although these new solvers are “partial”, in that they do not solve all parity games completely, our experiments show that they do solve a set of benchmark games (i.e., games with known structures) designed to stress test solvers from PGSolver toolkit [FL10] completely, and some of these partial solvers deliver favourable performance against a known high performance solver in many circumstances. 5 Acknowledgement I would like to express my sincere gratitude to my supervisor Professor Michael Huth, and my external supervisor Dr Nir Piterman. Without Pro- fessor Huth’s advice and guidance, and Dr Piterman’s ability to make sense of the intricate details of this research, the making of this thesis would not have been possible, and I would have suffered a significantly greater deal of hardship in trying. In addition, their patience and willingness in answer- ing my numerous (in the order of thousands) and quite often fundamental emails/questions, have helped me tremendously in the progress of this work. I would also like to thank my good colleagues in Huxley Room 502, Dr Luke Dickens, Dr Jiefei Ma, Dr Ryan Wishart, Dr Dalal Alrajeh, Dr Robert Craven, and Graham Deane. The knowledge and experience they shared with me have eased my transition, from industrial, into academic life, and their friendships have made my stay in the office very fun and enjoyable. Finally, I thank my adopted country the United Kingdom, for making it possible for me to pursue a research career at this stage of my life. 6 This thesis is dedicated to my dear wife Priya, who has stood by me for the duration of the PhD, and endured numerous rehearsals of my talks. 7 Contents 1. Introduction 19 1.1. Applications of parity games . 20 1.1.1. Design synthesis process . 20 1.1.2. Model checking in µ-calculus . 21 1.1.3. Model checking and satisfiability in CTL* . 23 1.2. Recent approaches in speeding up parity game solving . 23 1.3. Objectives . 24 1.4. Publications . 25 1.5. Scope/Assumptions . 26 1.6. Outline of thesis . 27 2. Background 29 2.1. Parity games . 30 2.2. Winning the game . 32 2.3. Strategies . 35 2.4. Dead-ends . 36 2.5. Winning strategies and regions . 37 2.6. Determinacy . 38 2.6.1. Subgames . 38 2.6.2. p-Traps . 39 2.6.3. p-Attractors . 40 2.6.4. p-Paradise . 43 8 2.6.5. Determinacy proof . 43 2.7. Solver algorithms and tools . 48 2.7.1. Zielonka’s recursive solver . 48 2.7.2. The SPM solver . 49 2.7.3. PGSolver . 50 3. Improved Parity Game Solving by Concurrency 52 3.1. Introduction . 52 3.2. Jurdziński’s small progress measures (SPM) . 54 3.2.1. Structure of a small progress measure . 54 3.2.2. Small progress measure comparison . 56 3.2.3. Small progress measure incrementation . 57 3.2.4. Small progress measure algorithm . 58 3.3. Enhancement of SPM through concurrency . 65 3.4. Known concurrent implementation, PW solver . 65 3.5. CSPM: our concurrent solution . 68 3.6. Correctness of CSPM solution . 73 3.7. Experimental evaluation . 79 3.7.1. Experimental assumptions and setup . 79 3.7.2. Experimental results on random games . 84 3.7.3. Experimental results on non-random games . 87 3.8. Conclusion . 89 4. Descriptive Complexity of Parity Games 92 4.1. Introduction . 92 4.2. Background . 96 4.2.1. Descriptive complexity . 96 4.2.2. Cycles and simple cycles . 98 4.2.3. Satisfiability problem . 98 4.2.4. Static colour compression . 100 9 4.3. Colour compression by Rabin index computation . 103 4.3.1. Rabin index computation . 107 4.3.2. Complexity . 114 4.3.3. Abstracting in the Rabin index by over-approximation 117 4.4. Implementation details . 122 4.4.1. Cycle detection using Tarjan’s DFS algorithm . 122 4.4.2. Simple cycle detection using SAT . 123 4.4.3. Implementation of the chosen parity game solver . 131 4.5. Test framework . 132 4.6. Experimental results . 132 4.7. Related work . 135 4.7.1. Priority propagation . 135 4.7.2. Rabin index in parity automata . 136 4.8. Conclusions . 138 5. Partial Solvers 140 5.1. Introduction . 140 5.2. Unique colour solver . 142 5.2.1. Fatal k-attractor . 142 5.2.2. Partial solver psol .................... 144 5.2.3. Complexity . 148 5.3. Buchi solver . 149 5.3.1. Fatal Buchi d-attractor . 149 5.3.2. Partial solver psolB ................... 150 5.3.3. Complexity . 153 5.4. Quantified layered Buchi solver . 153 5.4.1. Quantified layered Buchi q-attractor . 153 5.4.2. Partial solver psolQ ................... 154 5.4.3. Complexity . 166 10 5.5. Layered Buchi solver . 166 5.5.1. Layered Buchi l-attractor . 166 5.5.2. Partial solver psolL ................... 167 5.5.3. Complexity . 172 5.6. Discussion . 173 5.6.1. Partial solvers as preprocessors . 173 5.7. First experimental results . 174 5.7.1. Experimental setup . 174 5.7.2. Running time, edge removal and fatal attractor count comparison . 176 5.7.3. Summary . 192 5.8. Conclusion . 193 6. Evaluation and Conclusions 195 6.1. Code development and validation framework . 195 6.2. Contributions . 196 6.2.1. Concurrent small progress measures . 196 6.2.2. Rabin index in parity games . 197 6.2.3. Fatal attractors . 199 Bibliography 201 Appendices 208 A. Rabin Index 208 B. Partial Solvers 209 11 List of Tables 5.1. Experimental results for Clique[n]. The first table shows the running time in milliseconds. The second shows psol the edge removal, and the detected fatal attractor count. In fatal A column: psol,(psolB), {psolQ}, [psolL]. 177 5.2. Experimental results for Ladder[n]. The first table shows the running time in milliseconds. The second shows psol the edge removal, and the detected fatal attractor count. In fatal A column: psol,(psolB), {psolQ}, [psolL]. 179 5.3. Experimental results for Model Checker Ladder[n]. The first table shows the running time in milliseconds. The second shows psol the edge removal, and the detected fatal attractor count. In fatal A column: psol,(psolB), {psolQ}, [psolL]. 181 5.4. Experimental results for Recursive Ladder[n]. The first ta- ble shows the running time in milliseconds. The second shows psol the edge removal, and the detected fatal attractor count. In fatal A column: psol,(psolB), {psolQ}, [psolL]. 182 5.5. Experimental results for Strategy Impr[n]. The first table shows the running time in milliseconds. The second shows psol the edge removal, and the detected fatal attractor count. In fatal A column: psol,(psolB), {psolQ}, [psolL]. 183 12 5.6. Experimental results for Towers Of Hanoi[n]. The first table shows the running time in milliseconds. The second shows psol the edge removal, and the detected fatal attractor count. In fatal A column: psol,(psolB), {psolQ}, [psolL]. 185 5.7. Experimental results for Elevator Verification[n]. 187 5.8. Experimental results for Jurdzinski[10, m]. 189 5.9. Experimental results for Jurdzinski[n, 10]. 190 5.10. Experimental results for Jurdzinski[n, n].
Load more

Recommended publications
  • Learning Board Game Rules from an Instruction Manual Chad Mills A
    Learning Board Game Rules from an Instruction Manual Chad Mills A thesis submitted in partial fulfillment of the requirements for the degree of Master of Science University of Washington 2013 Committee: Gina-Anne Levow Fei Xia Program Authorized to Offer Degree: Linguistics – Computational Linguistics ©Copyright 2013 Chad Mills University of Washington Abstract Learning Board Game Rules from an Instruction Manual Chad Mills Chair of the Supervisory Committee: Professor Gina-Anne Levow Department of Linguistics Board game rulebooks offer a convenient scenario for extracting a systematic logical structure from a passage of text since the mechanisms by which board game pieces interact must be fully specified in the rulebook and outside world knowledge is irrelevant to gameplay. A representation was proposed for representing a game’s rules with a tree structure of logically-connected rules, and this problem was shown to be one of a generalized class of problems in mapping text to a hierarchical, logical structure. Then a keyword-based entity- and relation-extraction system was proposed for mapping rulebook text into the corresponding logical representation, which achieved an f-measure of 11% with a high recall but very low precision, due in part to many statements in the rulebook offering strategic advice or elaboration and causing spurious rules to be proposed based on keyword matches. The keyword-based approach was compared to a machine learning approach, and the former dominated with nearly twenty times better precision at the same level of recall. This was due to the large number of rule classes to extract and the relatively small data set given this is a new problem area and all data had to be manually annotated.
    [Show full text]
  • Complexity in Simulation Gaming
    Complexity in Simulation Gaming Marcin Wardaszko Kozminski University [email protected] ABSTRACT The paper offers another look at the complexity in simulation game design and implementation. Although, the topic is not new or undiscovered the growing volatility of socio-economic environments and changes to the way we design simulation games nowadays call for better research and design methods. The aim of this article is to look into the current state of understanding complexity in simulation gaming and put it in the context of learning with and through complexity. Nature and understanding of complexity is both field specific and interdisciplinary at the same time. Analyzing understanding and role of complexity in different fields associated with simulation game design and implementation. Thoughtful theoretical analysis has been applied in order to deconstruct the complexity theory and reconstruct it further as higher order models. This paper offers an interdisciplinary look at the role and place of complexity from two perspectives. The first perspective is knowledge building and dissemination about complexity in simulation gaming. Second, perspective is the role the complexity plays in building and implementation of the simulation gaming as a design process. In the last section, the author offers a new look at the complexity of the simulation game itself and perceived complexity from the player perspective. INTRODUCTION Complexity in simulation gaming is not a new or undiscussed subject, but there is still a lot to discuss when it comes to the role and place of complexity in simulation gaming. In recent years, there has been a big number of publications targeting this problem from different perspectives and backgrounds, thus contributing to the matter in many valuable ways.
    [Show full text]
  • Game Complexity Vs Strategic Depth
    Game Complexity vs Strategic Depth Matthew Stephenson, Diego Perez-Liebana, Mark Nelson, Ahmed Khalifa, and Alexander Zook The notion of complexity and strategic depth within games has been a long- debated topic with many unanswered questions. How exactly do you measure the complexity of a game? How do you quantify its strategic depth objectively? This seminar answered neither of these questions but instead presents the opinion that these properties are, for the most part, subjective to the human or agent that is playing them. What is complex or deep for one player may be simple or shallow for another. Despite this, determining generally applicable measures for estimating the complexity and depth of a given game (either independently or comparatively), relative to the abilities of a given player or player type, can provide several benefits for game designers and researchers. There are multiple possible ways of measuring the complexity or depth of a game, each of which is likely to give a different outcome. Lantz et al. propose that strategic depth is an objective, measurable property of a game, and that games with a large amount of strategic depth continually produce challenging problems even after many hours of play [1]. Snakes and ladders can be described as having no strategic depth, due to the fact that each player's choices (or lack thereof) have no impact on the game's outcome. Other similar (albeit subjective) evaluations are also possible for some games when comparing relative depth, such as comparing Tic-Tac-Toe against StarCraft. However, these comparative decisions are not always obvious and are often biased by personal preference.
    [Show full text]
  • Minimax AI Within Non-Deterministic Environments
    Minimax AI within Non-Deterministic Environments by Joe Dan Davenport, B.S. A Thesis In Computer Science Submitted to the Graduate Faculty Of Texas Tech University in Partial Fulfillment of The Requirements for The Degree of MASTER OF SCIENCE Approved Dr. Nelson J. Rushton Committee Chair Dr. Richard Watson Dr. Yuanlin Zhang Mark Sheridan, Ph.D. Dean of the Graduate School August, 2016 Copyright 2016, Joe Dan Davenport Texas Tech University, Joe Dan Davenport, August 2016 Acknowledgements There are a number of people who I owe my sincerest thanks for arriving at this point in my academic career: First and foremost I wish to thank God, without whom many doors that were opened to me would have remained closed. Dr. Nelson Rushton for his guidance both as a scientist and as a person, but even more so for believing in me enough to allow me to pursue my Master’s Degree when my grades didn’t represent that I should. I would also like to thank Dr. Richard Watson who originally enabled me to come to Texas Tech University and guided my path. I would also like to thank Joshua Archer, and Bryant Nelson, not only for their companionship, but also for their patience and willingness to listen to my random thoughts; as well as my manger, Eric Hybner, for bearing with me through this. Finally I would like to thank some very important people in my life. To my Mother, I thank you for telling me I could be whatever I wanted to be, and meaning it. To Israel Perez for always being there for all of us.
    [Show full text]
  • How Game Complexity Affects the Playing Behavior of Synthetic Agents
    Kiourt, C., Kalles, Dimitris and Kanellopoulos, P., (2017), How game complexity affects the playing behavior of synthetic agents, 15th European Conference on Multi-Agent Systems, Evry, 14-15 December 2017 EUMAS 2017 How game complexity affects the playing behavior of synthetic agents Chairi Kiourt1, Dimitris Kalles1, and Panagiotis Kanellopoulos2 1School of Science and Technology, Hellenic Open University, Patras, Greece, chairik, [email protected] 2CTI Diophantus and University of Patras, Rion, Greece. [email protected] Abstract—Agent based simulation of social organizations, via of the game. In our investigation, we adopted the state-space the investigation of agents’ training and learning tactics and complexity approach, which is the most-known and widely strategies, has been inspired by the ability of humans to learn used [13]–[15]. from social environments which are rich in agents, interactions and partial or hidden information. Such richness is a source of The complexity of a large set of well-known games has complexity that an effective learner has to be able to navigate. been calculated [14], [15] at various levels, but their usability This paper focuses on the investigation of the impact of the envi- in multi-agent systems as regards the impact on the agents’ ronmental complexity on the game playing-and-learning behavior learning/playing progress is still a flourishing research field. of synthetic agents. We demonstrate our approach using two In this article, we study the game complexity impact on independent turn-based zero-sum games as the basis of forming social events which are characterized both by competition and the learning/training progress of synthetic agents, as well as cooperation.
    [Show full text]
  • Cancer's Intelligence
    Int. Journ. of Unconventional Computing, Vol. 16, pp. 41–78 ©2020 Old City Publishing, Inc. Reprints available directly from the publisher Published by license under the OCP Science imprint, Photocopying permitted by license only a member of the Old City Publishing Group Cancer’s Intelligence J. JAMES FROST† BioMolecular Imaging, 3801 Canterbury Road, Ste. 914, Baltimore, Maryland 21218, USA; Phone +1-443-869-2267; E-mail: [email protected] Received: September 15, 2020. Accepted: September 25, 2020. Cancer is analyzed as an intelligent system of collaborating and computing cells. The limitations of the current regime of cancer research and treatment are addressed, and the resultant need for new paradigmatic thinking is pre- sented. Features of intelligence pervade the natural world from humans to animals of all sizes and complexity to microorganisms. Yet, cancer has hith- erto not been investigated as acting with intelligence as it evades the body’s and the oncologist’s failed attempts to eradicate it. In this analysis, concepts of computation, including self computation and the limits of computation; game playing; e-machine analysis; self-aware systems; P and NP-hard problems; and Boolean networks are addressed and related to features of cancer that can be described as intelligent. The implications of the devel- oped theory of cancer’s intelligence are discussed, together with several signposts and recommendations for new cancer research. Keywords: Cancer, intelligence, computation, game theory, Boolean network 1 INTRODUCTION The grim plight of cancer continues to endure in the face of legions of tar- geted drugs, reams of cancer gene data, and multitudes of physicists and mathematicians on the attack (1).
    [Show full text]
  • EVOLUTIONARY AI in BOARD GAMES an Evaluation of the Performance of an Evolutionary Algorithm in Two Perfect Information Board Games with Low Branching Factor
    EVOLUTIONARY AI IN BOARD GAMES An evaluation of the performance of an evolutionary algorithm in two perfect information board games with low branching factor Bachelor Degree Project in Informatics G2E, 22.5 credits, ECTS Spring term 2015 Viktor Öberg Supervisor: Joe Steinhauer Examiner: Anders Dahlbom Abstract It is well known that the branching factor of a computer based board game has an effect on how long a searching AI algorithm takes to search through the game tree of the game. Something that is not as known is that the branching factor may have an additional effect for certain types of AI algorithms. The aim of this work is to evaluate if the win rate of an evolutionary AI algorithm is affected by the branching factor of the board game it is applied to. To do that, an experiment is performed where an evolutionary algorithm known as “Genetic Minimax” is evaluated for the two low branching factor board games Othello and Gomoku (Gomoku is also known as 5 in a row). The performance here is defined as how many times the algorithm manages to win against another algorithm. The results from this experiment showed both some promising data, and some data which could not be as easily interpreted. For the game Othello the hypothesis about this particular evolutionary algorithm appears to be valid, while for the game Gomoku the results were somewhat inconclusive. For the game Othello the performance of the genetic minimax algorithm was comparable to the alpha-beta algorithm it played against up to and including depth 4 in the game tree.
    [Show full text]
  • Combinatorial Game Complexity: an Introduction with Poset Games
    Combinatorial Game Complexity: An Introduction with Poset Games Stephen A. Fenner∗ John Rogersy Abstract Poset games have been the object of mathematical study for over a century, but little has been written on the computational complexity of determining important properties of these games. In this introduction we develop the fundamentals of combinatorial game theory and focus for the most part on poset games, of which Nim is perhaps the best- known example. We present the complexity results known to date, some discovered very recently. 1 Introduction Combinatorial games have long been studied (see [5, 1], for example) but the record of results on the complexity of questions arising from these games is rather spotty. Our goal in this introduction is to present several results— some old, some new—addressing the complexity of the fundamental problem given an instance of a combinatorial game: Determine which player has a winning strategy. A secondary, related problem is Find a winning strategy for one or the other player, or just find a winning first move, if there is one. arXiv:1505.07416v2 [cs.CC] 24 Jun 2015 The former is a decision problem and the latter a search problem. In some cases, the search problem clearly reduces to the decision problem, i.e., having a solution for the decision problem provides a solution to the search problem. In other cases this is not at all clear, and it may depend on the class of games you are allowed to query. ∗University of South Carolina, Computer Science and Engineering Department. Tech- nical report number CSE-TR-2015-001.
    [Show full text]
  • The Shortest Path Game: Complexity and Algorithms Andreas Darmann, Ulrich Pferschy, Joachim Schauer
    The Shortest Path Game: Complexity and Algorithms Andreas Darmann, Ulrich Pferschy, Joachim Schauer To cite this version: Andreas Darmann, Ulrich Pferschy, Joachim Schauer. The Shortest Path Game: Complexity and Algorithms. 8th IFIP International Conference on Theoretical Computer Science (TCS), Sep 2014, Rome, Italy. pp.39-53, 10.1007/978-3-662-44602-7_4. hal-01402026 HAL Id: hal-01402026 https://hal.inria.fr/hal-01402026 Submitted on 24 Nov 2016 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Distributed under a Creative Commons Attribution| 4.0 International License The Shortest Path Game: Complexity and Algorithms ? Andreas Darmann1, Ulrich Pferschy2, and Joachim Schauer2 1 University of Graz, Institute of Public Economics, Universitaetsstr. 15, 8010 Graz, Austria, [email protected] 2 University of Graz, Department of Statistics and Operations Research, Universitaetsstr. 15, 8010 Graz, Austria, fpferschy, [email protected] Abstract. In this work we address a game theoretic variant of the short- est path problem, in which two decision makers (agents/players) move together along the edges of a graph from a given starting vertex to a given destination. The two players take turns in deciding in each vertex which edge to traverse next.
    [Show full text]
  • A New Algorithm for Generating Equilibria in Massive Zero-Sum Games
    A New Algorithm for Generating Equilibria in Massive Zero-Sum Games Martin Zinkevich Michael Bowling Neil Burch Department of Computing Science University of Alberta Edmonton, Alberta, Canada T6G 2E8 Abstract Koller, Megiddo, & von Stengel 1994), which can require time cubic in the number of states. In summary, although In normal scenarios, computer scientists often consider the the size of the state space, branching factor, and informa- number of states in a game to capture the difficulty of learn- ing an equilibrium. However, players do not see games in tion properties are suggestive of difficulty they alone do not the same light: most consider Go or Chess to be more com- make a game challenging. However they are the sole factors plex than Monopoly. In this paper, we discuss a new measure in how solution techniques scale with the problem. of game complexity that links existing state-of-the-art algo- In this paper we suggest a new measure called the range rithms for computing approximate equilibria to a more hu- of skill, which may more accurately capture the human per- man measure. In particular, we consider the range of skill ception of game difficulty. Imagine forming a line of Go in a game, i.e.how many different skill levels exist. We then players where the player at the head of the line can beat ev- modify existing techniques to design a new algorithm to com- eryone else in the line at least 75% of the time. The second pute approximate equilibria whose performance can be cap- player can beat everyone behind her at least 75% of the time, tured by this new measure.
    [Show full text]
  • Dominance Solvability in Random Games
    Dominance Solvability in Random Games Noga Alon∗ Kirill Rudov† Leeat Yariv‡§ May 21, 2021 Abstract. We study the effectiveness of iterated elimination of strictly-dominated actions in random games. We show that dominance solvability of games is vanishingly small as the number of at least one player's actions grows. Furthermore, conditional on dominance solvability, the number of itera- tions required to converge to Nash equilibrium grows rapidly as action sets grow. Nonetheless, when games are highly im- balanced, iterated elimination simplifies the game substan- tially by ruling out a sizable fraction of actions. Technically, we illustrate the usefulness of recent combinatorial methods for the analysis of general games. Keywords: Random Games, Dominance Solvability, Iterated Elimi- nation ∗Department of Mathematics, Princeton University, [email protected] †Department of Economics, Princeton University, [email protected] ‡Department of Economics, Princeton University, [email protected] §We thank Roland B´enabou, Amanda Friedenberg, Faruk Gul, Annie Liang, and Drew Fudenberg for useful feedback. We gratefully acknowledge support from NSF grant SES- 1629613. Dominance Solvability in Random Games 1 1. Introduction 1.1. Overview. First introduced by Moulin(1979) in the context of voting, dominance solvability relies on a straightforward prescription. If a player has an action that generates worse payoffs than another regardless of what other players select|a strictly dominated action|she should never use it. When the structure of the game is commonly known, other players can infer their opponents' strictly dominated actions and assume they will not be played. With those strictly dominated actions eliminated, the resulting, reduced game may have further strictly dominated actions that can then be eliminated, and so on and so forth.
    [Show full text]
  • Heuristic Sampling for Fast Plausible Playouts
    Heuristic Sampling for Fast Plausible Playouts Cameron Browne and Fabio Barbero Department of Data Science and Knowledge Engineering Maastricht University Maastricht, The Netherlands [email protected], [email protected] Abstract—This paper proposes Heuristic Sampling (HS) for Specifically, we want a method that produces an observed generating self-play trials for games with a defined state evalu- mean game length Lobs that approximates the expected mean ation function, with speeds comparable to random playouts but game length L of a given rule set within a certain tolerance. game length estimates comparable to those produced by intelli- exp gent AI agents. HS produces plausible results up to thousands For the purposes of this exercise, a value of Lobs between of times faster than more rigorous methods. Lexp=2 and 2 × Lexp is deemed to be acceptable. Index Terms—AI, Board Games, Game Length, Ludii In this paper, we present a simple method called Heuristic Sampling that produces playouts with plausible game lengths I. INTRODUCTION not far off those produced by intelligent play but with speeds This short note addresses a simple and practical question: comparable to random play. what is the fastest way to reliably estimate the average length II. HEURISTIC SAMPLING of games that will occur between humans playing a given rule set? Game length – along with balance and decisiveness – has Heuristic Sampling (HS) applies when a heuristic state eval- emerged as a key indicator of abstract board game quality in uation function is available. It involves successively choosing automated game evaluation [1], [2]. Overly short game lengths for each state Si a high-reward action a from the set of indicate that the rule set may be trivial, flawed or subject available actions Ai and applying it without lookahead search.
    [Show full text]