A Learning AI Algorithm for Poker with Embedded Opponent Modeling
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
No Limit Holdem Advanced Strategy
No Limit Holdem Advanced Strategy Your Typical No Limit Holdem Game I think there is a problem with most strategy books available for no limit holdem: They are all based on the premise that you are going to be playing against good opponents. Sure there are going to be some decent players at any level -- at least hard to get money out of -- but by and large, you'll be playing against novices. As poker has gotten more popular over the past couple years, there has been a greater flow of information for these new players, which has changed low limit NL holdem games in two ways: First, these new players all think they have an edge because they are playing what they consider to be "tight aggressive." Secondly, the games have changed to have more tighter players than looser players. A little knowledge is dangerous though and with any strategy, there is a counter strategy. Next, let's make a distinction between who your opponents are: You aren't playing against Phil Hellmuth, you are playing against the guy who read his book. You aren't playing against Dolye Brunson, you are playing against the kid who read Super System. You may find yourself in this same category -- which is fine. You are starting out, have read some literature and are trying to apply that to the cash games you play in. Note, this article can be applied to no limit holdem tournaments too, but it is primarily for cash games. One thing you may notice if you play what you consider a tight aggressive game in no limit holdem is that you make a little, but not much. -
“Algoritmos Para Um Jogador Inteligente De Poker” Autor: Vinícius
Universidade Federal De Santa Catarina Centro Tecnológico Bacharelado em Ciências da Computação “Algoritmos para um jogador inteligente de Poker” Autor: Vinícius Sousa Fazio Florianópolis/SC, 2008 Universidade Federal De Santa Catarina Centro Tecnológico Bacharelado em Ciências da Computação “Algoritmos para um jogador inteligente de Poker” Autor: Vinícius Sousa Fazio Orientador: Mauro Roisenberg Banca: Benjamin Luiz Franklin Banca: João Rosaldo Vollertt Junior Banca: Ricardo Azambuja Silveira Florianópolis/SC, 2008 AGRADECIMENTOS Agradeço a todos que me ajudaram no desenvolvimento deste trabalho, em especial ao professor Mauro Roisenberg e aos colegas de trabalho João Vollertt e Benjamin Luiz Franklin e ao Ricardo Azambuja Silveira pela participação na banca avaliadora. Algoritmos para um jogador inteligente de Poker – Vinícius Sousa Fazio 4 RESUMO Poker é um jogo simples de cartas que envolve aposta, blefe e probabilidade de vencer. O objetivo foi inventar e procurar algoritmos para jogadores artificiais evolutivos e estáticos que jogassem bem poker. O jogador evolutivo criado utiliza aprendizado por reforço, onde o jogo é dividido em uma grande matriz de estados com dados de decisões e recompensas. O jogador toma a decisão que obteve a melhor recompensa média em cada estado. Para comparar a eficiência do jogador, várias disputas com jogadores que tomam decisões baseados em fórmulas simples foram feitas. Diversas disputas foram feitas para comparar a eficiência de cada algoritmo e os resultados estão demonstrados graficamente no trabalho. Palavras-Chave: Aprendizado por Reforço, Inteligência Artificial, Poker; Algoritmos para um jogador inteligente de Poker – Vinícius Sousa Fazio 5 SUMÁRIO 1. Introdução........................................................................................................12 2. Fundamentação Teórica..................................................................................15 2.1. Regras do Poker Texas Hold'em................................................................16 2.1.1. -
View Gaming Guide
poker philadelphia.livecasinohotel.com 900 Packer Avenue, Philadelphia, PA 19148 GAMBLING PROBLEM? Call 1-800-GAMBLER 10. In most situations, a player who has no interest POKER GUIDE in the pot should still hold onto their hand although no-one has bet. They should not fold, even in turn, TABLE OF CONTENTS because another player may gain an advantage over 1. Poker Etiquette .......................Pg. 1-2 a competitor by that act. 2. House Policies......................... Pg. 3 11. Arranging one’s chips to conceal higher 3. Buy In . Pg. 3 denominations is not allowed. 4. Table Stake / All In . Pg. 3 12. “Splashing the pot,” throwing chips into the pot 5. Operating Procedure & Policy ........... Pg. 3 so they become mingled with chips that are already 6. Texas Hold ‘Em . .Pg. 4-5 there, making the amount wagered unverifiable, is 7. Omaha Poker........................ Pg. 5-6 inappropriate. 8. Seven Card Stud......................Pg. 7-8 9. Badugi Poker.........................Pg. 8-9 13. If a player expects to be leaving the game for a long 10. 2-7 (Deuce to Seven) ................... Pg. 9 time, a supervisor should be notified. 11. Poker Hand Rankings ..................Pg. 10 14. A player is entitled to quit the game any time they 12. Glossary of Poker Terminology ........Pg. 11-14 choose, without suffering criticism. 13. Proper Conduct........................Pg. 14 15. Criticism of the way another player has elected to play their hand, or their general style of play, is POKER ETIQUETTE: impolite and undesirable. 1. Language, dress, hygiene and behavior should be of 16. Lengthy post-mortems about a hand are unwelcome. -
The Game of Texas Hold'em 3
The Intelligent Guide to Texas Hold'em Poker Copyright O 2003 by Intelligent Games Publishing Book cover writing by Susan Kendrick Writing All rights reserved. No part of this book may be used or reproduced in any manner, or distributed through any medium, including photocopying, electronic data stor- age and transmission via the Internet, without written consent from the publisher. Exceptions are usage of brief quotations for the purposes of criticism and review. For information contact: Intelligent Games Publishing P. 0.Box 6705, Towson, MD 21285 Web Site: www.intelligentpoker.com E-mail: [email protected] Write the publisher for bulk price quotes. ISBN 0-9677551-2-3 Library of Congress Control Number: 2003100272 Publisher's Cataloging-in-Publication (Provided by Quality Books, Znc.) Braids, Sam. The intelligent guide to Texas hold'em poker / Sam Braids. p. cm. Includes bibliographical references and index. LCCN 2003 100272 ISBN 0967755 123 1. Poker. 2. Gambling. I. Title. GV 125 1.B73 2003 795.41'2 QBI03-20008 I PLEASE NOTE: The material contained in this book is for informational pur- poses only. In no manner should this book be construed to offer legal advice on the issue of online gambling. It is the reader's responsibility to know and follow the laws that apply in his or her state and jurisdiction. Seek appropriate legal advice from a qualified attorney if unsure. The publisher does not endorse or guarantee any of the services described in this book. The reader assumes all risks and respon- sibility for his or her actions. If you do not agree with these conditions, you may return this book to the publisher for a full refund. -
Pokerface: Emotion Based Game-Play Techniques for Computer Poker Players
University of Kentucky UKnowledge University of Kentucky Master's Theses Graduate School 2004 POKERFACE: EMOTION BASED GAME-PLAY TECHNIQUES FOR COMPUTER POKER PLAYERS Lucas Cockerham University of Kentucky, [email protected] Right click to open a feedback form in a new tab to let us know how this document benefits ou.y Recommended Citation Cockerham, Lucas, "POKERFACE: EMOTION BASED GAME-PLAY TECHNIQUES FOR COMPUTER POKER PLAYERS" (2004). University of Kentucky Master's Theses. 224. https://uknowledge.uky.edu/gradschool_theses/224 This Thesis is brought to you for free and open access by the Graduate School at UKnowledge. It has been accepted for inclusion in University of Kentucky Master's Theses by an authorized administrator of UKnowledge. For more information, please contact [email protected]. ABSTRACT OF THESIS POKERFACE: EMOTION BASED GAME-PLAY TECHNIQUES FOR COMPUTER POKER PLAYERS Numerous algorithms/methods exist for creating computer poker players. This thesis compares and contrasts them. A set of poker agents for the system PokerFace are then introduced. A survey of the problem of facial expression recognition is included in the hopes it may be used to build a better computer poker player. KEYWORDS: Poker, Neural Networks, Arti¯cial Intelligence, Emotion Recognition, Facial Action Coding System Lucas Cockerham 7/30/2004 POKERFACE: EMOTION BASED GAME-PLAY TECHNIQUES FOR COMPUTER POKER PLAYERS By Lucas Cockerham Dr. Judy Goldsmith Dr. Grzegorz Wasilkowski 7/30/2004 RULES FOR THE USE OF THESES Unpublished theses submitted for the Master's degree and deposited in the University of Kentucky Library are as a rule open for inspection, but are to be used only with due regard to the rights of the authors. -
The Mathematics of Poker: Basic Equity Calculations
- MATHEMATICS AND COMPUTER EDUCATION- THE MATHEMATICS OF POKER: BASIC EQUITY CALCULATIONS AND ESTIMATES Mark Farag Gildart Haase School of Computer Sciences and Engineering Fairleigh Dickinson University 1000 River Road, Mail Stop T-BE2-01 Teaneck, New Jersey 07666 [email protected] INTRODUCTION The game of poker has experienced a worldwide boom in popularity in the past decade. This can be attributed to a confiuence of events: the invention of the "lipstick" camera that allows viewing of players' "hole" (hidden) cards for television broadcasts, the growth of online poker rooms, and the increased popularity of "satellite" events that allow players to win their way into larger-money events. The largest single prize awarded in a poker tournament to date, 12 million US dollars, was won by an amateur player in 2006 [2]. Poker is a game of skill that contains an element of chance; it lies somewhere between chess (pure skill) and roulette (pure luck) in the spectrum of games. Since poker is a game of incomplete information, skilled players often use psychology to help them make correct decisions or to infiuence others to make incorrect decisions. Some situations do arise, however, in which mathematical considerations are paramount. It is the purpose of this article to discuss such situations. Since the first section covers the rules of poker in detail, the subsequent discussion should be of interest and accessible to students with only a basic knowledge of combinatorics and probability. THE RULES Modem poker is played with a standard deck of 52 cards, using cards marked with numbers 2 through 10, J (Jack), Q (Queen), K (King), and A (Ace) to indicate, in increasing order, their respective ranks. -
Six Card Bonus for Five Poker Derivatives
Full text of the proposal follows (additions indicated in boldface thus; deletions indicated in brackets [thus]): 13:69E-1.13H Let it ride poker table; physical characteristics (a) (No change.) (b) The layout for a let it ride poker table shall contain, at a minimum: 1. – 4. (No change.) 5. The payout odds for all authorized wagers, including the let it ride bonus wager authorized by N.J.A.C. 13:69F-18.6A, [and] the three-card bonus wager authorized by N.J.A.C. 13:69F-18.6B, the six-card bonus wager authorized by N.J.A.C. 13:69-18.6C, if the casino licensee offers [either] any of the optional [wager] wagers; 6. (No change.) 7. If a casino licensee offers the optional three-card bonus wager authorized by N.J.A.C. 13:69F-18.6B, a separate designated area at each betting position for the placement of the three-card bonus wager; and 8. If a casino licensee offers the optional six-card bonus wager authorized by N.J.A.C. 13:69F-18.C: i. A separate designated area at each betting position for the placement of the six-card bonus wager; and ii. A separate designated area for the placement of the six-card bonus wager community cards. (c) – (e) (No change.) 2 13:69E-1.13P Four-card poker table; physical characteristics (a) - (b) (No change.) (c) If a casino licensee offers the variation of four card poker authorized by N.J.A.C. 19:47-27.10A, the layout for the table shall, at a minimum, contain: 1. -
Early Round Bluffing in Poker Author(S): California Jack Cassidy Source: the American Mathematical Monthly, Vol
Early Round Bluffing in Poker Author(s): California Jack Cassidy Source: The American Mathematical Monthly, Vol. 122, No. 8 (October 2015), pp. 726-744 Published by: Mathematical Association of America Stable URL: http://www.jstor.org/stable/10.4169/amer.math.monthly.122.8.726 Accessed: 23-12-2015 19:20 UTC Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at http://www.jstor.org/page/ info/about/policies/terms.jsp JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact [email protected]. Mathematical Association of America is collaborating with JSTOR to digitize, preserve and extend access to The American Mathematical Monthly. http://www.jstor.org This content downloaded from 128.32.135.128 on Wed, 23 Dec 2015 19:20:53 UTC All use subject to JSTOR Terms and Conditions Early Round Bluffing in Poker California Jack Cassidy Abstract. Using a simplified form of the Von Neumann and Morgenstern poker calculations, the author explores the effect of hand volatility on bluffing strategy, and shows that one should never bluff in the first round of Texas Hold’Em. 1. INTRODUCTION. The phrase “the mathematics of bluffing” often brings a puzzled response from nonmathematicians. “Isn’t that an oxymoron? Bluffing is psy- chological,” they might say, or, “Bluffing doesn’t work in online poker. -
Poker 101 Poker Rules and Concepts for Our Annual Charity Tournament
Poker 101 Poker Rules and Concepts for our Annual Charity Tournament Adapted from MIT 15.S50 Lecture Brainteasers Problem: • (1) In Poker, what is the best hand to go up against Pocket Aces? (other than the other two Aces?) • (2) The situation: heads up on the turn, but before the river comes out you already know you are guaranteed to lose, regardless of what your opponent has. What are your hole cards, and what is on the board? Brainteaser Solution: • (1) In Poker, what is the best hand to go up against Pocket Aces? (other than the other two Aces?) • AA 77.50% 65s 22.50% • (2) The situation: heads up on the turn, but before the river comes out you already know you are guaranteed to lose, regardless of what your opponent has. What are your hole cards, and what is on the board? • Your hole cards: 22 • Board: any quads (5555) Announcements • Annual Charity Poker Tournament – Saturday, 4/15 • Pitch Perfect: A QFS-USWIB Production • Pitch Workshops: 4/11 and 4/18 at 6:30pm • Deadline: 4/18 • Competition: 4/20 • Registration: http://tinyurl.com/qfsuswib • If you are interested but don’t have a team, email us! Poker Rules Texas Hold ‘Em Overview • Texas Hold'em is a community card poker game, with game play focused as much on the betting as on the cards being played • Texas Holdem is played on a single table with 2 to 9 players • You win a pot by having the best hand, or by having all other players fold before the showdown • The structure of Texas Hold'em can be broken up into three main divisions: 1. -
Jan23-Lecture.Pdf
Introduction to the Theory & Practice of Poker Lecture #8 January 23, 2020 Last night’s tourney • 178 players entered • Lasted 3.5 hours • I did not win a single hand (had one chop) • Final table, please stand up! • Winner: Shehrya Haris • Special note: Qualified in both satellites • Freda Zhou, Sam Lebowitz, Claudia Moncaliano Meta game • Should you ever show your hand? • Simple answer is no • You might be providing more information than you think • If you show a strong hand when someone folds • You eliminate some uncertainty they had about whether you were bluffing • They may more correctly label you as TAG • If you show that you folded a strong hand • Because you are trying to prove how good a player you are • First, you shouldn’t let them know if you are a good player • Second, now you will get bullied by the good players • You don’t want anyone to know that you can make good lay downs • you want them to be afraid to bluff you because they think you’re such a moron that you might always call them. • Advanced move: • The “accidental show your cards on purpose” • Some pros make a living with meta-play • Table talk • Selectively showing to advance a particular image There are 2 rules for success in poker 1. Never reveal everything you know Physical tells • I’m not a huge fan of using tells • Too many books • Too many players fake them • Tells are specific to individuals • Bet sizing tells • Bet strong when weak, and vice versa • Some commonly known tells • Stare hard at someone when weak • Hand shakes when strong • Be sure hand doesn’t -
Friendly Partner System of Poker Game with Facial Expressions
Friendly Partner System of Poker Game with Facial Expressions K. Ohsone, Student Member, IEEE and T. Onisawa, Member, IEEE Abstract— This paper aims at the construction of a partner playing system but a partner system, which has a discussion system with facial expressions, which plays a seven-card stud with a human player on game strategy in a seven-card stud poker game with a human player against an opponent player. If poker game cooperating with the player. Furthermore, this a human player needs some advice on a game, the partner system paper also introduces facial expressions to the partner system has various facial expressions according to the current situation. because the partner system is expected to become friendly by Fuzzy theory is applied to decision-making part in the partner system and neural network is applied to the facial expressions the use of not only linguistic expressions but also facial part in the partner system. This paper also performs subject expressions. The presented system is based on the authors’ experiments to confirm the friendliness of the presented partner previous seven-card-stud poker game playing system [12,13], system with facial expressions, where each subject plays games and is extended into from our previous partner system [14]. In with/without facial expressions. this paper friendliness of the presented partner system using linguistic and facial expressions is compared with that of the I. INTRODUCTION previous partner system using only linguistic expressions. In our daily life we are often confronted with The organization of the paper is as follows. In Section 2 a decision-making problems under uncertain situations. -
An Artificial Intelligence Agent for Texas Hold'em Poker
AN ARTIFICIAL INTELL IGENCE AGENT FOR TEXAS HOLD’EM PO KER PATRICK MCCURLEY – 0 62 4 91 7 90 2 An Artificial Intelligence Agent for Texas Hold’em Poker I declare that this document represents my own work except where otherwise stated. Signed …………………………………………………………………………. 08/05/ 2009 Patrick McCurley – 062491790 Introduction 3 TABLE OF CONTENTS 1. Introduction ................................................................................................................................................................ 7 1.1 Problem Description...................................................................................................................................... 7 1.2 Aims and Objectives....................................................................................................................................... 7 1.3 Dissertation Outline ....................................................................................................................................... 8 1.4 Ethics .................................................................................................................................................................... 8 2 Background................................................................................................................................................................10 2.1 Artificial Intelligence and Poker .............................................................................................................10 2.1.1 Problem Domain Realization .........................................................................................................10