arrow
返回

World-class interpretable poker

delete2022-06-09
delete1
delete
OA
AI
D
Dimitris Bertsimas *
A
Alex Paskov
DOI:10.1007/s10994-022-06179-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We address the problem of interpretability in iterative game solving for imperfect-information games such as poker. This lack of interpretability has two main sources: first, the use of an uninterpretable feature representation, and second, the use of black box methods such as neural networks, for the fitting procedure. In this paper, we present advances on both fronts. Namely, first we propose a novel, compact, and easy-to-understand game-state feature representation for Heads-up No-limit (HUNL) Poker. Second, we make use of globally optimal decision trees, paired with a counterfactual regret minimization (CFR) self-play algorithm, to train our poker bot which produces an entirely interpretable agent. Through experiments against Slumbot, the winner of the most recent Annual Computer Poker Competition, we demonstrate that our approach yields a HUNL Poker agent that is capable of beating the Slumbot. Most exciting of all, the resulting poker bot is highly interpretable, allowing humans to learn from the novel strategies it discovers.
Keyword:
Optimal decision trees
Game solving
Deep reinforcement learning
Artificial intelligence
Interpretability
Poker
Regret minimization

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
引用论文

引用论文

S1-Leitlinie Post-COVID/Long-COVIDS1-Leitlinie后COVID/Long-COVID
err2021-09-02
err0
errOAAI
errAndreas Rembert Koczulla; Tobias Ankermann; Uta Behrends; Peter Berlit; Sebastian Böing; Folke Brinkmann; Christian Franke; Rainer Glöckl; Christian Gogoll; Thomas Hummel; Juliane Kronsbein; Thomas Maibaum; Eva M. J. Peters; Michael Pfeifer; Thomas Platz; Matthias Pletz; Georg Pongratz; Frank Powitz; Klaus F. Rabe; Carmen Scheibenbogen; Andreas Stallmach; Michael Stegbauer; Hans Otto Wagner; Christiane Waller; Hubert Wirtz; Andreas Zeiher; Ralf Harun Zwick
err分享
err收藏
Machine Learning for Dynamic Incentive Problems
err2018-01-01
err0
errOAAI
errPhilipp Johannes Renner; Simon Scheidegger
err分享
err收藏
Calibration of Discrete-Element-Method Parameters for Cohesive Materials Using Dynamic-Yield-Strength and Shear-Cell Experiments
err2019-05-13
err0
errOAAI
errSubhodh Karkala; Nathan Davis; Carl Wassgren; Yanxiang Shi; Xue Liu; Christian Riemann; Gary Yacobian; Rohit Ramachandran
err分享
err收藏
Optimal classification trees最优分类树
err2017-04-03
err416
errOAAI
errBertsimas, Dimitris; Dunn, Jack
err分享
err收藏
学者 查看更多内容