Journal of Artificial Intelligence Research 49 (2014) 527-568 Submitted 10/13; published 03/14 Large-Scale Optimization for Evaluation Functions with Minimax Search Kunihito Hoki
[email protected] Department of Communication Engineering and Informatics The University of Electro-Communications Tomoyuki Kaneko
[email protected] Department of Graphics and Computer Sciences The University of Tokyo Abstract This paper presents a new method, Minimax Tree Optimization (MMTO), to learn a heuristic evaluation function of a practical alpha-beta search program. The evaluation function may be a linear or non-linear combination of weighted features, and the weights are the parameters to be optimized. To control the search results so that the move de- cisions agree with the game records of human experts, a well-modeled objective function to be minimized is designed. Moreover, a numerical iterative method is used to find local minima of the objective function, and more than forty million parameters are adjusted by using a small number of hyper parameters. This method was applied to shogi, a major variant of chess in which the evaluation function must handle a larger state space than in chess. Experimental results show that the large-scale optimization of the evaluation function improves the playing strength of shogi programs, and the new method performs significantly better than other methods. Implementation of the new method in our shogi program Bonanza made substantial contributions to the program's first-place finish in the 2013 World Computer Shogi Championship. Additionally, we present preliminary evidence of broader applicability of our method to other two-player games such as chess.