Scalable Search in Computer Chess Computational Intelligence Edited by Wolfgang Hillel and Rudolf Kruse

Total Page:16

File Type:pdf, Size:1020Kb

Scalable Search in Computer Chess Computational Intelligence Edited by Wolfgang Hillel and Rudolf Kruse Ernst A. Heinz Scalable Search in Computer Chess Computational Intelligence edited by Wolfgang Hillel and Rudolf Kruse The books In .this series conthDute to the long-" r~nge goal pfumlerstanrung and rea­ li zing intelligent behaviour in some envI ronment. 'Thus t!;ley' covertopics from the disCiplines ofArtificial1ntetl,genceandCogni!:tve Science, combined also caJled In- ' tellectics, as well as from fi erds interdJsciplinarilyieJ:at'ed with these. Computati(}' nallnteUigence cOmprises ba ~ic k~Owl edge as'wellas applications. Das rechnende Gehlrn by Patricia S. Church land 'lnd Terrence:r. Sejnows~ i Neuronale Netze und Fuzzy..systeme by DetlefNauck,Frank Klawonn and Rudolf Kruse Fuzzy-Clusteranalyse by Frank Hoppner,. Frank KlaW\Jnn.and Rudol f Kruse Elnfiihrung In Evolutloniire,Algorlthmen by Volker Nissen Neuronale Netze by Andreas Scher.er Sehen und die Verarbeltung~vl.ueller Informatlonen by Hanspeter A. Mallo! Betriebswlrtscbaftllche.Anwendungen des Soft Computing by Biethabn et al. (Ed.) Fuzzy Theorle und Stochastlk by Rudolf Seising (Ed.) MultiobJecflve Heuristic Search by Pa llab Dasgupta, P. P. Chakrabarti and S. C. DeSarkar The Efflclence ofTheorem Proving Strategies by David A. Plaisted an~ Yunshan Zhu Scalable Search in Computer Chess by Ernst A. He inz Among others the followi ng books were published in the series of ArtiRciallntelligence Automated Theorem Proving by Wolfgang Bi bel (out of print) Fuzzy Sets and Fuzzy Logic Foundation of Application - from a Mathematical Point of View by Siegfried Gottwald . Fuzzy Systems In Computer Science edited by Rudolf Kruse, Jorg G'ebhard arid {{ainerPalm Automatlsche Spracherkennung by Ernst Gunter Sthukat-Talamazzinl ; Deduktive Datenbanken by Armin B. Cremers, UJrike Grielhahn and RaJf Hinze Wissensreprasentation und Inferenz l by Wolfgang Bibel, Steffen Holldobler and Torsten ~Chaub . Ernst A. Heinz Scalable Search in Computer Chess Algorithmic Enhancements and Experiments at High Search Dephts IIvleweg Die Deutsche Bibliothek - CIP-Cataloguing-in-Publication-Data A catalogue record for this publication is available from Die Deutsche Bibliothek (http://www.ddb.de ) ISBN 978-3-528-05732-9 ISBN 978-3-322-90178-1 (eBook) DOI 10.1007/978-3-322-90 I 78- I Authors adress: [email protected] 1sl Edition 2000 All rights reserved © Springer Fachmedien Wiesbaden 2000 Originally published by Friedr. Vieweg & Sohn Verlagsgesellschaft mbH, Braunschweig/ Wiesbaden,in 2000. No part of this publication may be reproduced, stored in a retrieval system or transmitted, mechanical, photocopying or otherwise without prior permission of the copyright holder. Printed on aCid-free paper v Preface This book presents the results of our past two-and-a-half years of research aimed at increasing the scalability and performance of game-tree search in computer chess. We elaborate on our respective works in the areas of (I) selective forward pruning, (II) the efficient application of game-theoretical knowledge, and (III) the behaviour of the search at increasing depths. The broad range of topics covered by the three distinct parts of the book seek to provide interesting material for everybody interested in the field of "Compu­ tational Intelligence", regardless of their individual focus (researcher, student, or other). The text does not require readers to know about chess and computer game-playing beforehand. The initial chapter entitled "Computer-Chess Primer" introduces all the necessary basics and fundamentals thereof. The remaining chapters, however, go far beyond those topics. They show how to make sophisticated game-tree searchers still more scalable at ever higher depths. Throughout the whole book, our high-speed and master-strength chess program DARKTHOUGHT serves as a realistic test vehicle to conduct numerous experiments at unprecedented search depths. The extensive experimental evalu­ ations provide convincing empirical evidence for the practical usefulness of the techniques presented by us. These results will certainly be of special interest to researchers and programmers of computer strategy-games alike (chess, checkers, Go, and Othello in particular). Last but not least, I like to mention that I am most grateful to the series editors for offering me the opportunity to publish my book under their auspices. Ernst A. Heinz - September 1999 VII Thanks • Prof. Dr. Walter F. Tichy remained committed to serve as my supervisor and provided continued support even after I switched topics from parallel com­ puting to computer chess in late 1996. From him I learned how to contribute to science and how to embrace the scientific community. • Prof. Dr. T. Anthony Marsland agreed to serve as my co-supervisor although he hardly knew me at the time of my request. In the end, he even shortened his personal holidays for the sake of letting me schedule my thesis defence smoothly. • Prof. Dr. Jaap van den Herik superbly edited my articles in the ICCA Jour­ nal. Our most pleasant and constructive cooperation markedly improved the quality of my writing. • Markus M. Gille dedicated much of his spare time to improve the implemen­ tation of our chess program DARKTHOUGHT. • Pawel Lukowicz and I first met in October 1987, shortly before our first term in Computer Science began at the University of Karlsruhe. We then lived together in the same flat for 6 years, earned our M.Sc. degrees together in early 1992, worked together in the same bureau for 7 years, and finally finished our Ph.D. studies together in mid-1999. We always had fun together and our fruitful discussions mostly clarified topics to the very last detail. • My parents Jutta Heinz and Prof. Dr. Ernst Heinz shielded me against hardship throughout my whole life. • Marianne J. S. Hardt makes it all worthwhile. She cheered me up when I was down although she had to endure my countless days of late-night work on computer chess during the past years. VIn Acknowledgements • A.s.E. GmbH loaned additional RAM for free during the 13th World Micro­ computer-Chess Championship (October 1995) and a 433 MHz DEC Alpha- 21164a PC-l64 workstation for free during the 14th World Microcomputer­ Chess Championship (October 1996). • DELTA Computer Products GmbH loaned a 500 MHz Compaq Alpha-21264 XP-lOOO workstation with 1 GB SDRAM for free during the 9th World Computer-Chess Championship (June 1999) and the 16th World Micro­ computer-Chess Championship (June 1999) thanks to the courtesy of Heinz­ Dieter Schutt, then Chief Marketing Officer of DELTA. • Digital Equipment Corp. (DEC) paid for two 500 MHz DEC Alpha-21164a PC-l64 workstations in March 1997 under external technology research con­ tract DE-0032-97 entitled "Optimization and Fine-Tuning of a Sophisticated Tree-Searching Application for 64-bit Alpha CPUs" as negotiated by the courtesy of Dr. Frank Severin, then Head of Digital's External Technology Group Europe. • Digital Equipment Corp. 's Workstation Division (in close collaboration with KryoTech Inc., see below) shipped a cooled 767 MHz Alpha-21164a Digital Personal Workstation prototype with 512 MB SDRAM from the USA to France and back for use by DARKTHOUGHT during the 15th World Micro­ computer-Chess Championship (October 1997). Together with the prototype they sent Jeff Forsythe over to Paris to attend the week-long championship where he provided superb service to anybody who needed help. Furthermore, Digital Equipment Corp. shipped an identically equipped 600 MHz Alpha- 21164a workstation from the USA to Germany for the final preparations of our team. Digital Equipment Corp. did all of the above for free thanks to the courtesy of Ron Locklin, then Vice President of Digital's World-Wide Workstation Marketing Division. • KryoTech Inc. (in close collaboration with Digital Equipment Corp., see above) provided a cooled 767 MHz Alpha-21164a Digital Personal Worksta­ tion prototype for use by DARKTHOUGHT during the 15th World Micro­ computer-Chess Championship (October 1997) thanks to the courtesy and greatly appreciated personal efforts of Rob diGiacomo, then Executive Vice President and Chief Marketing Officer of KryoTech Inc. Acknow ledgements IX • Sun Microsystems Inc. donated a 167 MHz UltraSparc Creator workstation for program development and 64-bit Sparc V9 benchmarking in February 1996 due to the courtesy of Eckhard Schaumann, then Head of Sun's German University Cooperation Unit. • The Gunther & Ingrid Schroff Foundation (administered by the Chancellor of the University of Karlsruhe), the Karlsruher Hochschulvereinigung, and the Institute for Program Structures and Data Organization (IPD, Chair Prof. Tichy) awarded several generous travel grants on the occasions of tour­ nament participations from the 8th World Computer-Chess Championship (May 1995) onwards. • The Institute for Program Structures and Data Organization (IPD, Chair Prof. Tichy) at the University of Karlsruhe provided abundant computing resources for our exclusive use throughout the whole work. Without these plentiful resources our extensive experiments with DARKTHOUGHT would have been impossible to undertake. • The International Computer-Chess Association (ICCA) paid for our air fares from Germany to Indonesia on the occasion of the 14th World Micro­ computer-Chess Championship (October 1996). • The editorial staff of the ICCA Journal provided outstanding cooperation and superb editing of my published material. • Peter W. Gillgasch, a former co-founder of IPD's computer chess group, belonged to the DARKTHOUGHT team until April 1996. His various con­ tributions are highly appreciated until
Recommended publications
  • Best-First Minimax Search Richard E
    Artificial Intelligence ELSEVIER Artificial Intelligence 84 ( 1996) 299-337 Best-first minimax search Richard E. Korf *, David Maxwell Chickering Computer Science Department, University of California, Los Angeles, CA 90024, USA Received September 1994; revised May 1995 Abstract We describe a very simple selective search algorithm for two-player games, called best-first minimax. It always expands next the node at the end of the expected line of play, which determines the minimax value of the root. It uses the same information as alpha-beta minimax, and takes roughly the same time per node generation. We present an implementation of the algorithm that reduces its space complexity from exponential to linear in the search depth, but at significant time cost. Our actual implementation saves the subtree generated for one move that is still relevant after the player and opponent move, pruning subtrees below moves not chosen by either player. We also show how to efficiently generate a class of incremental random game trees. On uniform random game trees, best-first minimax outperforms alpha-beta, when both algorithms are given the same amount of computation. On random trees with random branching factors, best-first outperforms alpha-beta for shallow depths, but eventually loses at greater depths. We obtain similar results in the game of Othello. Finally, we present a hybrid best-first extension algorithm that combines alpha-beta with best-first minimax, and performs significantly better than alpha-beta in both domains, even at greater depths. In Othello, it beats alpha-beta in two out of three games. 1. Introduction and overview The best chess machines, such as Deep-Blue [lo], are competitive with the best humans, but generate billions of positions per move.
    [Show full text]
  • A World-Championship-Level » Othello Program*
    ARTIFICIAL 279 A World-Championship-Level » Othello Program* Paul S. Rosenbloom Department of Computer Science. Carnegie-Mellon University. Pittsburgh. PA 15213, U.S.A. Recommended by Jacques Pitrat ABSTRACT Othello is a recent addition to the collection of games that have been examined within artificial intelligence. Advances have been rapid, yielding programs that have reached the level of world- championship play. This article describes the current champion Othello program, iago. The work described here includes: (I) a task analysis of Othello; (2) the implementation of a program based on this analysis and state-of-the-art AI game-playing techniques: and (3) an evaluation of the program's performance through games played against other programs and comparisons with expert human play. 1. Introduction The game of Othello1 is a modern variation of the 19th century board game Reversi. It was developed in its current form in 1974 by Goro Hasegawa (see [16] for more details), and up until recently it has been played primarily in Japan, where it is the second most popular board game (next to Go). Othello is similar to backgammon in its appeal; the rules are simple, an enjoyable game can be played by beginners, and there is a great deal of complexity that must *This research was sponsored by the Defense Advanced Research Projects Agency (DOD), ARPA Order No. 3597, monitored by the Air Force Avionics Laboratory Under Contract F33615-78-C-1551. The views and conclusions contained in this document are those of the author and should not be interpreted as representing the official policies, either expressed or implied, of the Defense Advanced Research Projects Agency or the US Government.
    [Show full text]
  • Playing Othello by Deep Learning Neural Network
    Playing Othello By Deep Learning Neural Network Playing Othello By Deep Learning Neural Network Ng Argens The University of Hong Kong Author Note Argens Ng, BEng (Comp. Sc.), The University of Hong Kong (UID.: 3035072143) This paper was prepared in partial fulfillment of the Final Year Project (COMP 4801) required by the curriculum of Bachelor of Engineering (Computer Science) Playing Othello By Deep Learning Neural Network 2 Table of Contents Abstract .............................................................................................................................. 8 Acknowledgement ............................................................................................................. 9 Playing Othello By Deep Learning Neural Network ................................................... 10 Previous Work – AlphaGo ............................................................................................... 11 Overall Structure ........................................................................................................... 11 Artificial Neural Network ............................................................................................. 12 Value Network. ......................................................................................................... 12 Policy Network. ........................................................................................................ 12 Rollout Policy. ..........................................................................................................
    [Show full text]
  • Understanding Sampling-Based Adversarial Search Methods
    UNDERSTANDING SAMPLING-BASED ADVERSARIAL SEARCH METHODS A Dissertation Presented to the Faculty of the Graduate School of Cornell University in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy by Raghuram Ramanujan August 2012 c 2012 Raghuram Ramanujan ALL RIGHTS RESERVED UNDERSTANDING SAMPLING-BASED ADVERSARIAL SEARCH METHODS Raghuram Ramanujan, Ph.D. Cornell University 2012 Until 2007, the best computer programs for playing the board game Go per- formed at the level of a weak amateur, while employing the same Minimax algo- rithm that had proven so successful in other games such as Chess and Checkers. Thanks to a revolutionary new sampling-based planning approach named Up- per Confidence bounds applied to Trees (UCT), today’s best Go programs play at a master level on full-sized 19 × 19 boards. Intriguingly, UCT’s spectacular success in Go has not been replicated in domains that have been the traditional stronghold of Minimax-style approaches. The focus of this thesis is on under- standing this phenomenon. We begin with a thorough examination of the vari- ous facets of UCT in the games of Chess and Mancala, where we can contrast the behavior of UCT to that of the better understood Minimax approach. We then introduce the notion of shallow search traps — positions in games where short winning strategies for the opposing player exist — and demonstrate that these are distributed very differently in different games, and that this has a significant impact on the performance of UCT. Finally, we study UCT and Minimax in two novel synthetic game settings that permit mathematical analysis.
    [Show full text]
  • Evolving Heuristic Based Game Playing Strategies for Board Games Using Genetic Programming
    Evolving Heuristic Based Game Playing Strategies for Board Games Using Genetic Programming by Clive Andre’ Frankland Submitted in fulfilment of the academic requirements for the degree of Master of Science in the School of Mathematics, Statistics, and Computer Science, University of KwaZulu-Natal, Pietermaritzburg January 2018 As the candidate’s supervisor, I have/have not approved this thesis/dissertation for submission. Name: Prof. Nelishia Pillay Signed: _______________________ Date: _______________________ i Preface The experimental work described in this dissertation was carried out in the School of Mathematics, Statistics, and Computer Science, University of KwaZulu-Natal, Pietermartizburg, from February 2015 to January 2018, under the supervision of Professor Nelishia Pillay. These studies represent original work by the author and have not otherwise been submitted in any form for any degree or diploma to any tertiary institution. Where use has been made of the work of others it is duly acknowledged in the text. _______________________ Clive Andre’ Frankland – Candidate (Student Number 791790207) _______________________ Prof. Nelishia Pillay – Supervisor ii Declaration 1 – Plagiarism I, Clive Andre’ Frankland (Student Number: 791790207) declare that: 1. The research reported in this dissertation, except where otherwise indicated or acknowledged, is my original work. 2. This dissertation has not been submitted in full or in part for any degree or examination to any other university. 3. This dissertation does not contain other persons’ data, pictures, graphs or other information, unless specifically acknowledged as being sourced from other persons. 4. This dissertation does not contain other persons’ writing, unless specifically acknowledged as being sourced from other researchers. Where other written sources have been quoted, then: a.
    [Show full text]
  • 縮小盤オセロにおける完全解析 Perfect Analysis in Miniature Othello
    情報処理学会研究報告 IPSJ SIG Technical Report 縮小盤オセロにおける完全解析 †1 †1 †1 †2 竹下祐輝 池田諭 坂本眞人 伊藤隆夫 1993 年,数学者ファインシュタイン (J. Feinstein) が縮小盤 6×6 盤オセロの後手必勝,及び,パーフェクトプレイ「黒 16 白 20」を発見した.それから 20 年以上が経過し,コンピュータオセロは,今や,人間を遥かに凌いでいるが,標 準盤 8×8 盤オセロは未だ,先手必勝,後手必勝,引き分けの何れになるかが分かっていない.そこで本稿では,4×4 盤,4×6 盤,4×8 盤,4×10 盤,6×6 盤オセロの完全解析結果から,それ以上の盤のゲームの性質について考察する. また,6×6 盤オセロの完全解析について,ファインシュタインの追試を実行する. Perfect Analysis in miniature Othello YUKI TAKESHITA†1 SATOSHI IKEDA†1 MAKOTO SAKAMOTO†1 TAKAO ITO†2 More than 20 years has passed since J. Feinstein (1993) found that a perfect play on 6×6 board of Othello gives a 16-20 win for the second player. A computer Othello surpasses a much more human now. However, standard 8×8 board remain unsolved. In this paper, we show the perfect play in miniature Othello (4×4, 4×6, 4×8, 4×10 and 6×6 boards). From these results, we discuss the feature of the Othello larger than or equal to 8×8 board. In addition, in the 6×6 board, we confirm the result of Feinstein. の盤の中央 4 マスに両者が 2 つずつ任意で配置して始まる 1. はじめに のに対し,オセロは初期配置が決まっている(図 2-1 参照). オセロは,二人零和有限確定完全情報ゲーム[1]に分類さ れる.このクラスに分類されるゲームの性質は,必ず,先 手必勝,後手必勝,引き分けの何れかになる[2]. 1993 年,数学者ファインシュタイン(Joel Feinstein)が, 縮小盤 6×6 盤オセロの後手必勝,及び,パーフェクトプレ イ「黒 16 白 20」を発見した[3].このとき,彼はムーブオー ダリングを用いたアルファ・ベータ法により,約 400 億の 局面を,およそ 2 週間で探索したと記述している.ただし, (a)オセロ盤 (b)リバーシ盤 この結果はイギリスオセロ協会のニューズレター上で報告 (a) Othello board. (b) Reversi board. されたため,論文としては残っていない. 図 2-1 初期配置 それから 20 年以上が経過し,コンピュータオセロは,今 Fig.
    [Show full text]
  • The History of Computer Games
    City University of New York (CUNY) CUNY Academic Works Publications and Research CUNY Graduate Center 2006 The History of Computer Games Jill Cirasella CUNY Graduate Center Danny Kopec CUNY Brooklyn College How does access to this work benefit ou?y Let us know! More information about this work at: https://academicworks.cuny.edu/gc_pubs/174 Discover additional works at: https://academicworks.cuny.edu This work is made publicly available by the City University of New York (CUNY). Contact: [email protected] The History of Computer Games by Jill Cirasella, Computational Sciences Specialist Library, Brooklyn College and IM Dr. Danny Kopec, Associate Professor Computer and Information Science, Brooklyn College Milestones in Computer Backgammon 1979: BKG 9.8, the first strong backgammon player (written by Hans Berliner of Carnegie Mellon University), defeated world champion Luigi Villa in an exhibition match. However, it is widely accepted that Villa played better and that the computer got better rolls. 1989: Gerald Tesauro’s neural network-based Neurogammon, which was trained with a database of games played by expert human players, won the backgammon championship at the 1989 International Computer Olympiad. All top backgammon programs since Neurogammon have been based on neural networks. Search-based algorithms are not currently feasible for backgammon because the game has a branching factor of several hundred. 1991: Gerald Tesauro’s TD-Gammon debuted. Instead of being trained with a database of moves, TD-Gammon was trained by playing itself. This approach was challenging because individual moves are not rewarded: the reward is delayed until the end of the game, and credit for winning must then be distributed among the various moves.
    [Show full text]