[4N4-IS-1c] Knowledge engineering (3/3)

[4N4-IS-1c-05] Connect6 Opening Leveraging AlphaZero and Job-Level Computing

〇Shao-Xiong Zheng^1,2, Wei-Yuan Hsu^1,2, Kuo-Chan Huang³, I-Chen Wu^1,2,4 (1. Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu, Taiwan, 2. Research Center for IT Innovation, Academia Sinica, Taiwan, 3. Department of Computer Science, National Taichung University of Education, Hsinchu, Taiwan, 4. Pervasive Artificial Intelligence Research (PAIR) Labs, Taiwan)

Keywords:AlphaZero, Games, Job-level computing, Opening book generation, Connect6

For most board games, players commonly learn to increase strengths by following the opening moves played by experts, usually in the first stage of playing. In the past, many efforts have been made to use game-specific knowledge to construct opening books. Recently, DeepMind developed AlphaZero (2017) that can master game playing without domain knowledge. In this paper, we present an approach based on AlphaZero to constructing an opening book. To demonstrate the approach, we use a Connect6 program trained based on AlphaZero for evaluating positions, and then expand the opening game tree based on a job-level computing algorithm, called JL-UCT (job-level Upper Confidence Tree), developed by Wu et al. (2013) and Wei et al. (2015). In our experiment, the strengths of the Connect6 programs using this opening book are significantly improved, namely, the one with the opening book has a win rate of 65% against the one without using the book. In addition, the one without opening lost to Polygames in the Connect6 tournament of TCGA 2020 competitions, while the one with opening won against Polygames in TAAI and Computer Olympiad competitions later in 2020.