DOCSLIB.ORG

Extensive-Form Games with Imperfect Information

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Extensive-Form Games with Imperfect Information Extensive-Form Games with Imperfect Information Jeffrey Ely May 6, 2015 Jeffrey Ely Extensive-Form Games with Imperfect Information Example ¨¨ 2, 2 ¨¨ A¨ r ¨¨ 3, 3 ¨¨ C ¨ ¨ ¨ r ¨ ¨¨ Player 1 H Player¨¨ 1 H H ¨ H b H Up ¨ r H H ¨ p D H H ¨ p HH B HH ¨ p 0, 0 H ¨ p PlayerH 2 ¨ 1 p r HH p H p rr H p ¨ 0, 0 H p C ¨¨ Down H p ¨ r H p ¨ HHp¨ Player 1 pH p H prr H D HH H 3, 3 r Jeffrey Ely Extensive-Form Games with Imperfect Information Extensive-Form Games With Imperfect Information Finite No simultaneous moves: each node belongs to a single player (possibly \chance.") Information Sets I The nodes h at which i moves are partitioned into sets H. I The interpretation is that player i knows that it is his move and some node in the set has been reached, he does not know which one. (Behavioral) Strategies Subgames I Always begin with singleton information sets I Can't break information sets I Nash and Subgame Perfect Nash Equilibria Jeffrey Ely Extensive-Form Games with Imperfect Information The Weakness of SPNE 1 ¨¨ HH ¨ b H Stay out ¨ H ¨¨ HHEnter, Red ¨ Enter, Green H ¨¨ HH ¨ H ¨¨ 2 HH ¡A ¡A (0,r 0) rpppppppppppppppppppp rr r Fight ¡ A Fight ¡ A ¡ AAccom. ¡ AAccom. ¡ A ¡ A ¡ A ¡ A ¡ A ¡ A (−1,r−2) (1, −r 1) (−1,r−2) (1, −r 1) This example has no proper subgames so SPNE is just NE. So we need to extend the concept of \sequential rationality" Jeffrey Ely Extensive-Form Games with Imperfect Information Beliefs Does the player's continuation strategy maximize his continuation payoff? We need a way to pose the same question at a non-singleton information set. But what is the continuation payoff at a non-singleton information set? We need to specify the player's beliefs over the nodes in the information set. Definition A system of beliefs is a collection m = (m1, m2, ... , mN ) where mi (·jH) 2 DH specifies a probability distribution over the nodes in any information set H belonging to player i. We interpret m(·jH) 2 DH as i's belief about which node in H has been reached. Jeffrey Ely Extensive-Form Games with Imperfect Information Continuation Payoffs Given a behavioral strategy profile s At any node h belonging to i we can compute the probability distribution over terminal nodes. And thus we can compute the expected payoff to i conditional on having arrived at h, ui (sjh) Now to compute the continuation payoff at a non-singleton information set H, we take expectations with respect to the belief m(·jH): ui (sjH) = ∑ m(hjH)ui (sjh) h2H Jeffrey Ely Extensive-Form Games with Imperfect Information Sequential Rationality Definition A behavioral strategy profile s is sequentially rational relative to a system of beliefs m if for each i and for each information set H belonging to i, 0 ui (sjH) ≥ ui (si , s−i jH) 0 for every alternative strategy si . Jeffrey Ely Extensive-Form Games with Imperfect Information Assessments In extensive form games with imperfect information a solution is described by two objects The strategy profile The system of beliefs A pair (s, m) consisting of the strategy profile s and the system of beliefs m is called an assessment. Solution concepts will impose requirements on the assessment: Sequential rationality Some condition on the beliefs. Jeffrey Ely Extensive-Form Games with Imperfect Information Sequential Rationality 1 ¨¨ HH ¨ b H Stay out ¨¨ HH Enter, Red ¨Enter, Green H ¨¨ HH ¨¨ HH ¨¨ 2 HH ¡A ¡A (0,r 0) rpppppppppppppppppppp rr r Fight ¡ A Fight ¡ A ¡ AAccom. ¡ AAccom. ¡ A ¡ A ¡ A ¡ A ¡ A ¡ A (−1,r−2) (1, −r 1) (−1,r−2) (1, −r 1) Sequential rationality alone restores the intuitive solution of this game. Jeffrey Ely Extensive-Form Games with Imperfect Information Beliefs ¨¨ 1, −1 H ¨ ¨¨ r ¨ Player¨ 1 H ¨¨ H ¨ r H H¨ p T H ¨ p HH ¨ p −1, 1 ¨¨ p Player 2 H 1 p r H p H p b H p ¨ −1, 1 H p H ¨¨ T H p ¨ r H p ¨ HHp¨ Player 1 pH p H prr H T HH H 1, −1 r Jeffrey Ely Extensive-Form Games with Imperfect Information Sequential Rationality Alone Is Not Enough Sequential rationality alone is not enough for this game. Consider the assessment in which both players play T but 2's belief assigns probability greater than 1/2 to the top node. It is sequentially rational. But it isn't even a Nash equilibrium. (This is Matching Pennies) Jeffrey Ely Extensive-Form Games with Imperfect Information Bayes' Rule on the Path Given a behavioral strategy profile, we say that a system of beliefs satisfies Bayes' rule on the path if at every information set H which is arrived at with positive probability, the belief mi (·jH) is the conditional probability distribution. Jeffrey Ely Extensive-Form Games with Imperfect Information (Weak) Perfect Bayesian Equilibrium Definition An assessment (s, m) is a (weak) Perfect Bayesian Equilibrium if it is sequentially rational and satisfies Bayes' rule on the path. So in an extensive form game with imperfect information, to \solve" for a Weak PBE is to State the strategy profile s. State the system of beliefs m. Verify that the system of beliefs is derived from s on the path. Verify that the strategy profile is sequentially rational relative to m. Jeffrey Ely Extensive-Form Games with Imperfect Information Problem with Weak PBE ¨¨ −1/2, 0, 0 ¨¨ A¨ r ¨¨ −1, 1, −1 ¨¨ H ¨ ¨ ¨ r ¨ ¨¨ Player 1 H Player¨¨ 3 H H ¨ H b H ¨ r H H H¨ p T H H ¨ p HH B HH ¨ p 1, −1, 1 H ¨ p PlayerH 2 ¨ 1 p r HH p H p rr H p ¨ 1, −1, 1 H p H ¨¨ T H p ¨ r H p ¨ HHp¨ Player 3 pH p H prr H T HH H −1, 1, −1 r Jeffrey Ely Extensive-Form Games with Imperfect Information Problems with Weak PBE Consider the following assessment: 1 Plays A 2 Plays T 3 plays T 3's belief assigns probability greater than 1/2 to his top node. This is a weak PBE Sequentially rational Satisfies Bayes' rule on the path. But it is not a subgame perfect Nash equilibrium. (The subgame is matching pennies.) The unique SPE has 1 playing B. Jeffrey Ely Extensive-Form Games with Imperfect Information Related Problem ¨¨ 2, 2 ¨¨ A¨ r ¨¨ 3, 0 ¨¨ C ¨ ¨ ¨ r ¨ ¨¨ Player 1 H Player¨¨ 1 H H ¨ H b H Up ¨ r H H ¨ p D H H ¨ p HH B HH ¨ p 0, 3 H ¨ p PlayerH 2 ¨ 1 p r HH p H p rr H p ¨ 0, 3 H p C ¨¨ Down H p ¨ r H p ¨ HHp¨ Player 1 pH p H prr H D HH H 3, 0 r Jeffrey Ely Extensive-Form Games with Imperfect Information Failure of OSDP for Weak PBE Consider the following assessment. 1 Plays (A, C ) 2 Plays Down 1 assigns probability 1 to the top node in his information set. This is not sequentially rational for player 1 he can improve his payoff at the initial node by changing his strategy to B, D. But there is no profitable one stage deviation at any information set. Jeffrey Ely Extensive-Form Games with Imperfect Information A Partial Fix Bayes' rule where possible. i.e. suppose All of the nodes in an information set have a common immediate predecessor And that predecessor is a singleton information set Then the mixed action at that predecessor should define the belief at the information set. There are other examples where it is possible to apply Bayes' rule even at off-path information sets. Applying the \where possible" principle is a bit of a case-by-case matter. Jeffrey Ely Extensive-Form Games with Imperfect Information Application: Take it or leave it offers Single object for sale. Player 1 is the seller, Player 2 is a buyer. The buyer has a value v > 0 for the object. The seller has a prior belief m about v. The seller demands a price p for the good. The buyer accepts or rejects. Payoffs from sale: I v − p for the buyer I p for the seller Payoffs are zero if no sale. Jeffrey Ely Extensive-Form Games with Imperfect Information Extensive Form Game begins with a move by Nature. (By the way this is how we put incomplete information into an extensive-form game.) Nature selects v with an exogenous probability distribution given by the prior m. Player 1 does not observe Nature's move (A single information set includes them all.) Player 2 observes the offer made as well as Nature's move (singleton information set.) Jeffrey Ely Extensive-Form Games with Imperfect Information Sequential Rationality For the Buyer Because all of the buyer's moves are at singleton information sets, sequential rationality pins down his continuation strategy, except when indifferent. The buyer accepts any offer strictly below his value. The buyer rejects any offer strictly above his value. Sequential rationality alone does not restrict his response to prices equaling his value. (Think of the complete information ultimatum game.) Jeffrey Ely Extensive-Form Games with Imperfect Information Binary Values Suppose v can take on two possible values fvl , vhg with vh > vl . With probabilities mh and ml . Bayes' rule now pins down the seller's belief at his information set. Jeffrey Ely Extensive-Form Games with Imperfect Information Sequential Rationality for the Seller We can immediately rule out certain price offers No price offer less than vl can be sequentially rational.
Load more

Recommended publications
  • Game Theory: Static and Dynamic Games of Incomplete Information
    Game Theory: Static and Dynamic Games of Incomplete Information Branislav L. Slantchev Department of Political Science, University of California – San Diego June 3, 2005 Contents. 1 Static Bayesian Games 2 1.1BuildingaPlant......................................... 2 1.1.1Solution:TheStrategicForm............................ 4 1.1.2Solution:BestResponses.............................. 5 1.2Interimvs.ExAntePredictions............................... 6 1.3BayesianNashEquilibrium.................................. 6 1.4 The Battle of the Sexes . 10 1.5AnExceedinglySimpleGame................................ 12 1.6TheLover-HaterGame.................................... 13 1.7TheMarketforLemons.................................... 16 2 Dynamic Bayesian Games 18 2.1ATwo-PeriodReputationGame............................... 19 2.2Spence’sEducationGame.................................. 22 3 Computing Perfect Bayesian Equilibria 24 3.1TheYildizGame........................................ 24 3.2TheMyerson-RosenthalGame................................ 25 3.3One-PeriodSequentialBargaining............................. 29 3.4AThree-PlayerGame..................................... 29 3.5RationalistExplanationforWar............................... 31 Thus far, we have only discussed games where players knew about each other’s utility func- tions. These games of complete information can be usefully viewed as rough approximations in a limited number of cases. Generally, players may not possess full information about their opponents. In particular, players may possess
    [Show full text]
  • Game Theory with Sparsity-Based Bounded Rationality∗
    Game Theory with Sparsity-Based Bounded Rationality Xavier Gabaix NYU Stern, CEPR and NBER March 14, 2011 Extremely preliminary and incomplete. Please do not circulate. Abstract This paper proposes a way to enrich traditional game theory via an element of bounded rationality. It builds on previous work by the author in the context of one-agent deci- sion problems, but extends it to several players and a generalization of the concept of Nash equilibrium. Each decision maker builds a simplified representation of the world, which includes only a partial understanding of the equilibrium play of the other agents. The agents’desire for simplificity is modeled as “sparsity” in a tractable manner. The paper formulates the model in the concept of one-shot games, and extends it to sequen- tial games and Bayesian games. It applies the model to a variety of exemplary games: p beauty contests, centipede, traveler’sdilemma, and dollar auction games. The model’s predictions are congruent with salient facts of the experimental evidence. Compared to previous succesful proposals (e.g., models with different levels of thinking or noisy decision making), the model is particularly tractable and yields simple closed forms where none were available. A sparsity-based approach gives a portable and parsimonious way to inject bounded rationality into game theory. Keywords: inattention, boundedly rational game theory, behavioral modeling, sparse repre- sentations, `1 minimization. [email protected]. For very good research assistance I am grateful to Tingting Ding and Farzad Saidi. For helpful comments I thank seminar participants at NYU. I also thank the NSF for support under grant DMS-0938185.
    [Show full text]
  • Learning About Bayesian Games
    Learning to Play Bayesian Games1 Eddie Dekel, Drew Fudenberg and David K. Levine2 First draft: December 23, 1996 Current revision: July 13, 2002 Abstract This paper discusses the implications of learning theory for the analysis of games with a move by Nature. One goal is to illuminate the issues that arise when modeling situations where players are learning about the distribution of Nature’s move as well as learning about the opponents’ strategies. A second goal is to argue that quite restrictive assumptions are necessary to justify the concept of Nash equilibrium without a common prior as a steady state of a learning process. 1 This work is supported by the National Science Foundation under Grants 99-86170, 97-30181, and 97- 30493. We are grateful to Pierpaolo Battigalli, Dan Hojman and Adam Szeidl for helpful comments. 2 Departments of Economics: Northwestern and Tel Aviv Universities, Harvard University and UCLA. 2 1. Introduction This paper discusses the implications of learning theory for the analysis of games with a move by Nature.3 One of our goals is to illuminate some of the issues involved in modeling players’ learning about opponents’ strategies when the distribution of Nature’s moves is also unknown. A more specific goal is to investigate the concept of Nash equilibrium without a common prior, in which players have correct and hence common beliefs about one another’s strategies, but disagree about the distribution over Nature’s moves. This solution is worth considering given the recent popularity of papers that apply it, such as Banerjee and Somanathan [2001], Piketty [1995], and Spector [2000].4 We suggest that Nash equilibrium without a common prior is difficult to justify as the long- run result of a learning process, because it takes very special assumptions for the set of such equilibria to coincide with the set of steady states that could arise from learning.
    [Show full text]
  • Heiko Rauhut: Game Theory. In: "The Oxford Handbook on Offender
    Game theory Contribution to “The Oxford Handbook on Offender Decision Making”, edited by Wim Bernasco, Henk Elffers and Jean-Louis van Gelder —accepted and forthcoming— Heiko Rauhut University of Zurich, Institute of Sociology Andreasstrasse 15, 8050 Zurich, Switzerland [email protected] November 8, 2015 Abstract Game theory analyzes strategic decision making of multiple interde- pendent actors and has become influential in economics, political science and sociology. It provides novel insights in criminology, because it is a universal language for the unification of the social and behavioral sciences and allows deriving new hypotheses from fundamental assumptions about decision making. The first part of the chapter reviews foundations and assumptions of game theory, basic concepts and definitions. This includes applications of game theory to offender decision making in different strate- gic interaction settings: simultaneous and sequential games and signaling games. The second part illustrates the benefits (and problems) of game theoretical models for the analysis of crime and punishment by going in- depth through the “inspection game”. The formal analytics are described, point predictions are derived and hypotheses are tested by laboratory experiments. The article concludes with a discussion of theoretical and practical implications of results from the inspection game. 1 Foundations of game theory Most research on crime acknowledges that offender decision making does not take place in a vacuum. Nevertheless, most analytically oriented research applies decision theory to understand offenders. Tsebelis (1989) illustrates why this is a problem by using two examples: the decision to stay at home when rain is 1 probable and the decision to speed when you are in a hurry.
    [Show full text]
  • Minimax AI Within Non-Deterministic Environments
    Minimax AI within Non-Deterministic Environments by Joe Dan Davenport, B.S. A Thesis In Computer Science Submitted to the Graduate Faculty Of Texas Tech University in Partial Fulfillment of The Requirements for The Degree of MASTER OF SCIENCE Approved Dr. Nelson J. Rushton Committee Chair Dr. Richard Watson Dr. Yuanlin Zhang Mark Sheridan, Ph.D. Dean of the Graduate School August, 2016 Copyright 2016, Joe Dan Davenport Texas Tech University, Joe Dan Davenport, August 2016 Acknowledgements There are a number of people who I owe my sincerest thanks for arriving at this point in my academic career: First and foremost I wish to thank God, without whom many doors that were opened to me would have remained closed. Dr. Nelson Rushton for his guidance both as a scientist and as a person, but even more so for believing in me enough to allow me to pursue my Master’s Degree when my grades didn’t represent that I should. I would also like to thank Dr. Richard Watson who originally enabled me to come to Texas Tech University and guided my path. I would also like to thank Joshua Archer, and Bryant Nelson, not only for their companionship, but also for their patience and willingness to listen to my random thoughts; as well as my manger, Eric Hybner, for bearing with me through this. Finally I would like to thank some very important people in my life. To my Mother, I thank you for telling me I could be whatever I wanted to be, and meaning it. To Israel Perez for always being there for all of us.
    [Show full text]
  • 6 Dynamic Games with Incomplete Information
    22 November 2005. Eric Rasmusen, [email protected]. Http://www.rasmusen.org. 6 Dynamic Games with Incomplete Information 6.1 Perfect Bayesian Equilibrium: Entry Deterrence II and III Asymmetric information, and, in particular, incomplete information, is enormously impor- tant in game theory. This is particularly true for dynamic games, since when the players have several moves in sequence, their earlier moves may convey private information that is relevant to the decisions of players moving later on. Revealing and concealing information are the basis of much of strategic behavior and are especially useful as ways of explaining actions that would be irrational in a nonstrategic world. Chapter 4 showed that even if there is symmetric information in a dynamic game, Nash equilibrium may need to be refined using subgame perfectness if the modeller is to make sensible predictions. Asymmetric information requires a somewhat different refine- ment to capture the idea of sunk costs and credible threats, and Section 6.1 sets out the standard refinement of perfect bayesian equilibrium. Section 6.2 shows that even this may not be enough refinement to guarantee uniqueness and discusses further refinements based on out-of- equilibrium beliefs. Section 6.3 uses the idea to show that a player’s ignorance may work to his advantage, and to explain how even when all players know something, lack of common knowledge still affects the game. Section 6.4 introduces incomplete information into the repeated prisoner’s dilemma and shows the Gang of Four solution to the Chain- store Paradox of Chapter 5. Section 6.5 describes the celebrated Axelrod tournament, an experimental approach to the same paradox.
    [Show full text]
  • Part II Dynamic Games of Complete Information
    Part II Dynamic Games of Complete Information 83 84 This is page 8 Printer: Opaq 10 Preliminaries As we have seen, the normal form representation is a very general way of putting a formal structure on strategic situations, thus allowing us to analyze the game and reach some conclusions about what will result from the particular situation at hand. However, one obvious drawback of the normal form is its difficulty in capturing time. That is, there is a sense in which players’ strategy sets correspond to what they can do, and how the combination of their actions affect each others payoffs, but how is the order of moves captured? More important, if there is a well defined order of moves, will this have an effect on what we would label as a reasonable prediction of our model? Example: Sequencing the Cournot Game: Stackelberg Competition Consider our familiar Cournot game with demand P = 100 − q, q = q1 + q2,and ci(qi)=0for i ∈{1, 2}. We have already solved for the best response choices of each firm, by solving their maximum profit function when each takes the other’s quantity as fixed, that is, taking qj as fixed, each i solves: max (100 − qi − qj)qi , qi 86 10. Preliminaries and the best response is then, 100 − q q = j . i 2 Now lets change a small detail of the game, and assume that first, firm 1 will choose q1, and before firm 2 makes its choice of q2 it will observe the choice made by firm 1. From the fact that firm 2 maximizes its profit when q1 is already known, it should be clear that firm 2 will follow its best response function, since it not only has a belief, but this belief must be correct due to the observation of q1.
    [Show full text]
  • Communication and Content
    Communication and content Prashant Parikh language Topics at the Grammar-Discourse science press Interface 4 Topics at the Grammar-Discourse Interface Editors: Philippa Cook (University of Göttingen), Anke Holler (University of Göttingen), Cathrine Fabricius-Hansen (University of Oslo) In this series: 1. Song, Sanghoun. Modeling information structure in a cross-linguistic perspective. 2. Müller, Sonja. Distribution und Interpretation von Modalpartikel-Kombinationen. 3. Bueno Holle, Juan José. Information structure in Isthmus Zapotec narrative and conversation. 4. Parikh, Prashant. Communication and content. ISSN: 2567-3335 Communication and content Prashant Parikh language science press Parikh, Prashant. 2019. Communication and content (Topics at the Grammar-Discourse Interface 4). Berlin: Language Science Press. This title can be downloaded at: http://langsci-press.org/catalog/book/248 © 2019, Prashant Parikh Published under the Creative Commons Attribution 4.0 Licence (CC BY 4.0): http://creativecommons.org/licenses/by/4.0/ ISBN: 978-3-96110-198-6 (Digital) 978-3-96110-199-3 (Hardcover) ISSN: 2567-3335 DOI:10.5281/zenodo.3243924 Source code available from www.github.com/langsci/248 Collaborative reading: paperhive.org/documents/remote?type=langsci&id=248 Cover and concept of design: Ulrike Harbort Typesetting: Felix Kopecky Proofreading: Ahmet Bilal Özdemir, Brett Reynolds, Catherine Rudin, Christian Döhler, Eran Asoulin, Gerald Delahunty, Jeroen van de Weijer, Joshua Phillips, Ludger Paschen, Prisca Jerono, Sebastian Nordhoff, Trinka
    [Show full text]
  • Hide and Seek in Arizona∗
    Hide and Seek in Arizona¤ RobertW. Rosenthal,y Jason Shachat,z and Mark Walker.x Revised April 5, 2001 Abstract Laboratory subjects repeatedly played one of two variations of a simple two-person zero-sum game of “hide and seek.” Three puzzling departures from the prescriptions of equilibrium theory are found in the data: an asymmetry related to the player’s role in the game; an asymmetry across the game variations; and positive serial correlation in subjects’ play. Possible explanations for these departures are considered. ¤We are grateful to Todd Swarthout for invaluable research assistance and to Kevin Lang, Mark Machina, and John Wooders for helpful comments. Some of the work was done while Rosenthal was visiting the Department of Economics at MIT and the Department of Political Economy at the University of Siena and while Shachat was on the faculty of the University of California at San Diego. All three authors are grateful to the National Science Foundation for financial support of this research. yDepartment of Economics, Boston University; deceased February 27, 2002 zIBM TJ Watson Research Laboratory; [email protected] xDepartment of Economics, University of Arizona; [email protected] 1 Introduction Barry O’Neill’s insightful 1987 paper revived interest in using experimental methods to test the predictive power of mixed-strategy equilibrium. Following O’Neill’s experiment, a number of other researchers have conducted new experiments based on two-person zero- sum games that have unique mixed-strategy equilibria.1 The evidence for and against equilibrium theory has been mixed: while the theory seems to perform better than it did in the experiments done prior to O’Neill’s,2 there have nevertheless been consistent departures from the implications of equilibrium theory in each of the experiments.
    [Show full text]
  • Forward Induction As Confusion Over the Equilibrium Being Played Out
    Forward Induction as Confusion over the Equilibrium Being Played Out 26 January 1991/11 September 2007 Eric Rasmusen Abstract The Nash equilibrium of a game depends on it being common knowledge among the players which particular Nash equilibrium is being played out. This common knowledge arises as the result of some unspecified background process. If there are multiple equilibria, it is important that all players agree upon which one is being played out. This paper models a situation where there is noise in the background process, so that players sometimes are unknowingly at odds in their opinions on which equilibrium is being played out. Incorporating this possibility can reduce the number of equilibria in a way similar but not identical to forward induction and the intuitive criterion. Eric Rasmusen, Dan R. and Catherine M. Dalton Professor, Department of Business Economics and Public Policy, Kelley School of Business, Indiana University. Visitor (07/08), Nuffield College, Oxford University. Office: 011-44-1865 554-163 or (01865) 554-163. Nuffield College, Room C3, New Road, Oxford, England, OX1 1NF. [email protected]. http://www.rasmusen.org. Copies of this paper can be found at: http://www.rasmusen.org/papers/rasmusen-subgame.pdf. I would like to thank Emmanuel Petrakis and participants in the University of Chicago Theory Workshop and the University of Toronto for helpful comments. 1. Introduction The idea here will be: if players observe actions by player Smith that are compatible with Nash equilibrium E1 but not with Nash equilibrium E2, they should believe that Smith will continue to play according to equilibrium E1, even if they themselves were earlier intending to play according to equilibrium E2.
    [Show full text]
  • On the Notion of Perfect Bayesian Equilibrium∗
    July 24, 2015 Pefect bayesian On the Notion of Perfect Bayesian Equilibrium∗ Julio Gonzalez-D´ ´ıaz Departamento de Estad´ıstica e Investigaci´on Operativa, Universidad de Santiago de Compostela Miguel A. Melendez-Jim´ enez´ † Departamento de Teor´ıa e Historia Econ´omica, Universidad de M´alaga Published in TOP 22, 128-143 (2014) Published version available at http://www.springer.com DOI 10.1007/s11750-011-0239-z Abstract Often, perfect Bayesian equilibrium is loosely defined by stating that players should be sequentially rational given some beliefs in which Bayes rule is applied “whenever possible”. We argue that there are situations in which it is not clear what “whenever possible” means. Then, we provide an elementary definition of perfect Bayesian equilibrium for general extensive games that refines both weak perfect Bayesian equilibrium and subgame perfect equilibrium. JEL classification: C72. Keywords: non-cooperative game theory, equilibrium concepts, perfect Bayesian, Bayes rule. 1 Introduction Perfect Bayesian equilibrium is profusely used to analyze the game theoretical models that are derived from a wide variety of economic situations. The common understanding is that a perfect Bayesian equilibrium must be sequentially rational given the beliefs of the players, which have to be computed using Bayes rule “whenever possible”. However, the literature lacks a formal and tractable definition of this equilibrium concept that applies to general extensive games and, hence, it is typically the case that perfect Bayesian equilibrium is used without providing a definition beyond the above common understanding. The main goal of this paper is to make a concise conceptual and pedagogic contribution to the theory of equilibrium refinements.
    [Show full text]
  • A Comparison Between the Usage of Flat and Structured Game Trees for Move Evaluation in Hearthstone
    A Comparison Between the Usage of Flat and Structured Game Trees for Move Evaluation in Hearthstone Master’s Thesis Markus Zopf Knowledge Engineering Group Technische Universität Darmstadt Thesis Statement pursuant to § 22 paragraph 7 of APB TU Darmstadt I herewith formally declare that I have written the submitted thesis independently. I did not use any outside support except for the quoted literature and other sources mentioned in the paper. I clearly marked and separately listed all of the literature and all of the other sources which I employed when producing this academic work, either literally or in content. This thesis has not been handed in or published before in the same or similar form. In the submitted thesis the written copies and the electronic version are identical in content. Darmstadt, April 7, 2015 Markus Zopf Abstract Since the beginning of research in the field of Artificial Intelligence, games provide challenging problems for intelligent systems. Chess, a fully observable zero-sum game without randomness, was one of the first games investigated in detail. In 1997, nearly 50 years after the first paper about computers playing chess, the Deep Blue system won a six-game match against the chess Grandmaster Garry Kasparov. A lot of other games with an even harder setup were investigated since then. For example, the multiplayer card game poker with hidden information and the game Go with an enormous amount of possible game states are still a challenging task. Recently developed Monte Carlo algorithms try to handle the complexity of such games and achieve significantly better results than other approaches have before.
    [Show full text]