arrow
Return

World-class interpretable poker

delete2022-06-09
delete1
delete
OA
AI
D
Dimitris Bertsimas *
A
Alex Paskov
DOI:10.1007/s10994-022-06179-8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We address the problem of interpretability in iterative game solving for imperfect-information games such as poker. This lack of interpretability has two main sources: first, the use of an uninterpretable feature representation, and second, the use of black box methods such as neural networks, for the fitting procedure. In this paper, we present advances on both fronts. Namely, first we propose a novel, compact, and easy-to-understand game-state feature representation for Heads-up No-limit (HUNL) Poker. Second, we make use of globally optimal decision trees, paired with a counterfactual regret minimization (CFR) self-play algorithm, to train our poker bot which produces an entirely interpretable agent. Through experiments against Slumbot, the winner of the most recent Annual Computer Poker Competition, we demonstrate that our approach yields a HUNL Poker agent that is capable of beating the Slumbot. Most exciting of all, the resulting poker bot is highly interpretable, allowing humans to learn from the novel strategies it discovers.
Keywords:
Optimal decision trees
Game solving
Deep reinforcement learning
Artificial intelligence
Interpretability
Poker
Regret minimization

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

C
Columbia University
Scholars:
7.1W
Papers: 6.4W
Citations: 263
Cited Papers

Cited Papers

S1-Leitlinie Post-COVID/Long-COVID
err2021-09-02
err0
errOAAI
errAndreas Rembert Koczulla; Tobias Ankermann; Uta Behrends; Peter Berlit; Sebastian Böing; Folke Brinkmann; Christian Franke; Rainer Glöckl; Christian Gogoll; Thomas Hummel; Juliane Kronsbein; Thomas Maibaum; Eva M. J. Peters; Michael Pfeifer; Thomas Platz; Matthias Pletz; Georg Pongratz; Frank Powitz; Klaus F. Rabe; Carmen Scheibenbogen; Andreas Stallmach; Michael Stegbauer; Hans Otto Wagner; Christiane Waller; Hubert Wirtz; Andreas Zeiher; Ralf Harun Zwick
errShare
errSave
errShare
errSave
Machine Learning for Dynamic Incentive Problems
err2018-01-01
err0
errOAAI
errPhilipp Johannes Renner; Simon Scheidegger
errShare
errSave
Calibration of Discrete-Element-Method Parameters for Cohesive Materials Using Dynamic-Yield-Strength and Shear-Cell Experiments
err2019-05-13
err0
errOAAI
errSubhodh Karkala; Nathan Davis; Carl Wassgren; Yanxiang Shi; Xue Liu; Christian Riemann; Gary Yacobian; Rohit Ramachandran
errShare
errSave
Optimal classification trees
err2017-04-03
err416
errOAAI
errBertsimas, Dimitris; Dunn, Jack
errShare
errSave
researcher View more