Studies in Human and Computer Go: Assessing the Game of Go As a Research Domain for Cognitive Science
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Lesson Plans for Go in Schools
Go Lesson Plans 1 Lesson Plans for Go in Schools By Gordon E. Castanza, Ed. D. October 19, 2011 Published By Rittenberg Consulting Group 7806 108th St. NW Gig Harbor, WA 98332 253-853-4831 ©Gordon E. Castanza, Ed. D. 10/19/11 DRAFT Go Lesson Plans 2 Table of Contents Acknowledgements ......................................................................................................................... 4 Purpose/Rationale ........................................................................................................................... 5 Lesson Plan One ............................................................................................................................. 7 Basic Ideas .................................................................................................................................. 7 Introduction ............................................................................................................................... 11 The Puzzle ................................................................................................................................. 13 Surround to Capture .................................................................................................................. 14 First Capture Go ........................................................................................................................ 16 Lesson Plan Two ........................................................................................................................... 19 Units & -
CSC321 Lecture 23: Go
CSC321 Lecture 23: Go Roger Grosse Roger Grosse CSC321 Lecture 23: Go 1 / 22 Final Exam Monday, April 24, 7-10pm A-O: NR 25 P-Z: ZZ VLAD Covers all lectures, tutorials, homeworks, and programming assignments 1/3 from the first half, 2/3 from the second half If there's a question on this lecture, it will be easy Emphasis on concepts covered in multiple of the above Similar in format and difficulty to the midterm, but about 3x longer Practice exams will be posted Roger Grosse CSC321 Lecture 23: Go 2 / 22 Overview Most of the problem domains we've discussed so far were natural application areas for deep learning (e.g. vision, language) We know they can be done on a neural architecture (i.e. the human brain) The predictions are inherently ambiguous, so we need to find statistical structure Board games are a classic AI domain which relied heavily on sophisticated search techniques with a little bit of machine learning Full observations, deterministic environment | why would we need uncertainty? This lecture is about AlphaGo, DeepMind's Go playing system which took the world by storm in 2016 by defeating the human Go champion Lee Sedol Roger Grosse CSC321 Lecture 23: Go 3 / 22 Overview Some milestones in computer game playing: 1949 | Claude Shannon proposes the idea of game tree search, explaining how games could be solved algorithmically in principle 1951 | Alan Turing writes a chess program that he executes by hand 1956 | Arthur Samuel writes a program that plays checkers better than he does 1968 | An algorithm defeats human novices at Go 1992 -
Residual Networks for Computer Go Tristan Cazenave
Residual Networks for Computer Go Tristan Cazenave To cite this version: Tristan Cazenave. Residual Networks for Computer Go. IEEE Transactions on Games, Institute of Electrical and Electronics Engineers, 2018, 10 (1), 10.1109/TCIAIG.2017.2681042. hal-02098330 HAL Id: hal-02098330 https://hal.archives-ouvertes.fr/hal-02098330 Submitted on 12 Apr 2019 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. IEEE TCIAIG 1 Residual Networks for Computer Go Tristan Cazenave Universite´ Paris-Dauphine, PSL Research University, CNRS, LAMSADE, 75016 PARIS, FRANCE Deep Learning for the game of Go recently had a tremendous success with the victory of AlphaGo against Lee Sedol in March 2016. We propose to use residual networks so as to improve the training of a policy network for computer Go. Training is faster than with usual convolutional networks and residual networks achieve high accuracy on our test set and a 4 dan level. Index Terms—Deep Learning, Computer Go, Residual Networks. I. INTRODUCTION Input EEP Learning for the game of Go with convolutional D neural networks has been addressed by Clark and Storkey [1]. It has been further improved by using larger networks [2]. -
Achieving Master Level Play in 9X9 Computer Go
Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence (2008) Achieving Master Level Play in 9 9 Computer Go × Sylvain Gelly∗ David Silver† Univ. Paris Sud, LRI, CNRS, INRIA, France University of Alberta, Edmonton, Alberta, Canada Abstract simulated, using self-play, starting from the current position. Each position in the search tree is evaluated by the average The UCT algorithm uses Monte-Carlo simulation to estimate outcome of all simulated games that pass through that po- the value of states in a search tree from the current state. However, the first time a state is encountered, UCT has no sition. The search tree is used to guide simulations along knowledge, and is unable to generalise from previous expe- promising paths. This results in a highly selective search rience. We describe two extensions that address these weak- that is grounded in simulated experience, rather than an ex- nesses. Our first algorithm, heuristic UCT, incorporates prior ternal heuristic. Programs using UCT search have outper- knowledge in the form of a value function. The value function formed all previous Computer Go programs (Coulom 2006; can be learned offline, using a linear combination of a million Gelly et al. 2006). binary features, with weights trained by temporal-difference Monte-Carlo tree search algorithms suffer from two learning. Our second algorithm, UCT–RAVE, forms a rapid sources of inefficiency. First, when a position is encoun- online generalisation based on the value of moves. We ap- tered for the first time, no knowledge is available to guide plied our algorithms to the domain of 9 9 Computer Go, the search. -
Computer Go: from the Beginnings to Alphago Martin Müller, University of Alberta
Computer Go: from the Beginnings to AlphaGo Martin Müller, University of Alberta 2017 Outline of the Talk ✤ Game of Go ✤ Short history - Computer Go from the beginnings to AlphaGo ✤ The science behind AlphaGo ✤ The legacy of AlphaGo The Game of Go Go ✤ Classic two-player board game ✤ Invented in China thousands of years ago ✤ Simple rules, complex strategy ✤ Played by millions ✤ Hundreds of top experts - professional players ✤ Until 2016, computers weaker than humans Go Rules ✤ Start with empty board ✤ Place stone of your own color ✤ Goal: surround empty points or opponent - capture ✤ Win: control more than half the board Final score, 9x9 board ✤ Komi: first player advantage Measuring Go Strength ✤ People in Europe and America use the traditional Japanese ranking system ✤ Kyu (student) and Dan (master) levels ✤ Separate Dan ranks for professional players ✤ Kyu grades go down from 30 (absolute beginner) to 1 (best) ✤ Dan grades go up from 1 (weakest) to about 6 ✤ There is also a numerical (Elo) system, e.g. 2500 = 5 Dan Short History of Computer Go Computer Go History - Beginnings ✤ 1960’s: initial ideas, designs on paper ✤ 1970’s: first serious program - Reitman & Wilcox ✤ Interviews with strong human players ✤ Try to build a model of human decision-making ✤ Level: “advanced beginner”, 15-20 kyu ✤ One game costs thousands of dollars in computer time 1980-89 The Arrival of PC ✤ From 1980: PC (personal computers) arrive ✤ Many people get cheap access to computers ✤ Many start writing Go programs ✤ First competitions, Computer Olympiad, Ing Cup ✤ Level 10-15 kyu 1990-2005: Slow Progress ✤ Slow progress, commercial successes ✤ 1990 Ing Cup in Beijing ✤ 1993 Ing Cup in Chengdu ✤ Top programs Handtalk (Prof. -
Reinforcement Learning of Local Shape in the Game of Go
Reinforcement Learning of Local Shape in the Game of Go David Silver, Richard Sutton, and Martin Muller¨ Department of Computing Science University of Alberta Edmonton, Canada T6G 2E8 {silver, sutton, mmueller}@cs.ualberta.ca Abstract effective. They are fast to compute; easy to interpret, modify and debug; and they have good convergence properties. We explore an application to the game of Go of Secondly, weights are trained by temporal difference learn- a reinforcement learning approach based on a lin- ing and self-play. The world champion Checkers program ear evaluation function and large numbers of bi- Chinook was hand-tuned by expert players over 5 years. nary features. This strategy has proved effective When weights were trained instead by self-play using a tem- in game playing programs and other reinforcement poral difference learning algorithm, the program equalled learning applications. We apply this strategy to Go the performance of the original version [7]. A similar ap- by creating over a million features based on tem- proach attained master level play in Chess [1]. TD-Gammon plates for small fragments of the board, and then achieved world class Backgammon performance after train- use temporal difference learning and self-play. This ingbyTD(0)andself-play[13]. A program trained by method identifies hundreds of low level shapes with TD(λ) and self-play outperformed an expert, hand-tuned ver- recognisable significance to expert Go players, and sion at the card game Hearts [11]. Experience generated provides quantitive estimates of their values. We by self-play was also used to train the weights of the world analyse the relative contributions to performance of champion Othello and Scrabble programs, using least squares templates of different types and sizes. -
Curriculum Guide for Go in Schools
Curriculum Guide 1 Curriculum Guide for Go In Schools by Gordon E. Castanza, Ed. D. October 19, 2011 Published By: Rittenberg Consulting Group 7806 108th St. NW Gig Harbor, WA 98332 253-853-4831 © 2005 by Gordon E. Castanza, Ed. D. Curriculum Guide 2 Table of Contents Acknowledgements ......................................................................................................................... 4 Purpose and Rationale..................................................................................................................... 5 About this curriculum guide ................................................................................................... 7 Introduction ..................................................................................................................................... 8 Overview ................................................................................................................................. 9 Building Go Instructor Capacity ........................................................................................... 10 Developing Relationships and Communicating with the Community ................................. 10 Using Resources Effectively ................................................................................................. 11 Conclusion ............................................................................................................................ 11 Major Trends and Issues .......................................................................................................... -
Weiqi, Baduk): a Beautiful Game
Go (Weiqi, Baduk): A Beautiful Game Description Go is a strategy board game originating from China more than two thousand years ago. Though its rules are simple, the game is intractably complex; a top professional can easily defeat the best supercomputers today. It was considered one of the four essential skills of a Chinese scholar. The game spread to Korea and Japan, has flourished in East Asia, and is becoming more well-known in the West. Today, Go is enjoyed by more than 40 million players in the world. Objectives Students will learn the rules of go and become able to play at an intermediate level. They will also understand the game in a historical and/or mathematical context. We hope (but do not require) that students will be able to play at a single-digit kyu level (1k-9k). Students will also learn something significant from one of the following (or both): ◦ The culture and history of go, including its origins, historical figure, and presence in East Asia and the western world. ◦ Some mathematical results of go, including a treatment of go using combinatorial game theory. This will offer enough flexibility for students of all majors. Prerequisites None. We expect all students to be able to understand the course material. The course is designed to suit students of all majors. This course is not designed for dan-level players. We will not allow dan-level players to take this course. Course Format This course will be taught by Joshua Wu in both lecture and interactive formats. We hope to emphasize student participation. -
Cognitive Reflection and Theory of Mind of Go Players Marc Oliver Rieger1and Mei Wang2
RESEARCH ARTICLE ADVANCES IN COGNITIVE PSYCHOLOGY Cognitive Reflection and Theory of Mind of Go Players Marc Oliver Rieger1and Mei Wang2 1 University of Trier 2 WHU – Otto Beisheim School of Management ABSTRACT Go is a classical Chinese mind game and a highly popular intellectual pursuit in East Asia. In a survey KEYWORDS at two Go tournaments (one of them the largest in Europe), we measured cognitive reflection and cognitive reflection test decision in strategic games (using the classical “beauty contest” game) (N = 327). We found that Go theory of mind players in our survey had outstanding average cognitive reflection test (CRT) scores: 2.51 among all patience participants and 2.80 among players of high master level (dan). This value easily outperforms previ- board games ous measurements, for example, of undergraduates at top universities. The CRT score was closely Go related to the playing strength, but not to the frequency of playing. On the other hand, frequent weiqi players tended to have higher theory of mind, regardless of their playing strengths. However, self- baduk reported patience was not statistically significantly correlated with Go strength or playing frequency. chess INTRODUCTION Human behavior is influenced by cognitive ability. Traditionally, these playing strategic games that require adopting the other person’s point abilities have been summarized in one dimension, intelligence, but of view, for example, the famous “beauty contest game or “Keynesian subsequent research focused on finding more and more facets of intel- beauty contest” (Nagel, 1995).1 The name of this game is inspired by ligence that are important for specific tasks. -
The Way to Go Is a Copyrighted Work
E R I C M A N A G F O O N How to U I O N D A T www.usgo.org www.agfgo.org play the Asian game of Go The Way to by Karl Baker American Go Association Box 397 Old Chelsea Station New York, NY 10113 GO Legal Note: The Way To Go is a copyrighted work. Permission is granted to make complete copies for personal use. Copies may be distributed freely to others either in print or electronic form, provided no fee is charged for distribution and all copies contain this copyright notice. The Way to Go by Karl Baker American Go Association Box 397 Old Chelsea Station New York, NY 10113 http://www.usgo.org Cover print: Two Immortals and the Woodcutter A watercolor by Seikan. Date unknown. How to play A scene from the Ranka tale: Immortals playing go as the the ancient/modern woodcutter looks on. From Japanese Prints and the World of Go by William Pinckard at: Asian Game of Go http://www.kiseido.com/printss/cover.htm Dedicated to Ann All in good time there will come a climax which will lift one to the heights, but first a foundation must be laid, INSPIRED BY HUNDREDS broad, deep and solid... OF BAFFLED STUDENTS Winfred Ernest Garrison © Copyright 1986, 2008 Preface American Go Association The game of GO is the essence of simplicity and the ultimate in complexity all at the same time. It is taught earnestly at military officer training schools in the Orient, as an exercise in military strategy. -
Eyespace Values in Go
Games of No Chance MSRI Publications Volume 29, 1996 Eyespace Values in Go HOWARD A. LANDMAN Abstract. Most of the application of combinatorial game theory to Go has been focussed on late endgame situations and scoring. However, it is also possible to apply it to any other aspect of the game that involves counting. In particular, life-and-death situations often involve counting eyes. Assuming all surrounding groups are alive, a group that has two or more eyes is alive, and a group that has one eye or less is dead. This naturally raises the question of which game-theoretical values can occur for an eyemaking game. We define games that provide a theoretical framework in which this question can be asked precisely, and then give the known results to date. For the single-group case, eyespace values include 0, R R R R R 1 1 3 1 1, 2, 2 , 1 2 , 4 , 1 4 , 1 ,andseveralko-relatedloopygames,aswell ∗ R 1 as some seki-related values. The 2 eye is well-understood in traditional R R R R 1 3 1 Go theory, and 1 2 only a little less so, but 4 , 1 4 ,and 1 may be new discoveries, even though they occur frequently in actual games.∗ For a battle between two or more opposed groups, the theory gets more complicated. 1. Go 1.1. Rules of Go. Go is played on a square grid with Black and White stones. The players alternate turns placing a stone on an unoccupied intersection. Once placed, a stone does not move, although it may sometimes be captured and removed from the board. -
What Is the Project Title
Artificial Intelligence for Go CIS 499 Senior Design Project Final Report Kristen Ying Advisors: Dr. Badler and Dr. Likhachev University of Pennsylvania PROJECT ABSTRACT Go is an ancient board game, originating in China – where it is known as weiqi - before 600 B.C. It spread to Japan (where it is also known as Go), to Korea as baduk, and much more recently to Europe and America [American Go Association]. This game, in which players take turn placing stones on a 19x19 board in an attempt to capture territory, is polynomial-space hard [Reyzin]. Checkers is also polynomial-space hard, and is a solved problem [Schaeffer]. However, the sheer magnitude of options (and for intelligent algorithms, sheer number of possible strategies) makes it infeasible to create even passable novice AI with an exhaustive pure brute-force approach on modern hardware. The board is 19 x19, which, barring illegal moves, allows for about 10171 possible ways to execute a game. This number is about 1081 times greater than the believed number of elementary particles contained in the known universe [Keim]. Previously investigated approaches to creating AI for Go include human-like models such as pattern recognizers and machine learning [Burmeister and Wiles]. There are a number of challenges to these approaches, however. Machine learning algorithms can be very sensitive to the data and style of play with which they are trained, and approaches modeling human thought can be very sensitive to the designer‟s perception of how one thinks during a game. Professional Go players seem to have a very intuitive sense of how to play, which is difficult to model.