arrow
Return

Outperforming Classical PI Tuning Methods via AlphaZero Algorithm

delete2025-12-01
delete0
PRE
AI
K
Kurios Queiroz *
S
Samaherni Dias
T
Tiago Roux Oliveira
A
Aldayr Araújo
DOI:10.1007/s40313-025-01225-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper introduces AlphaTune, a novel method for tuning proportional-integral (PI) controllers based on the AlphaZero reinforcement learning algorithm. The method formulates the controller tuning problem as a two-player game, where an agent plays against itself to optimize the controller parameters kp\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$k_p$$\end{document} and ki\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$k_i$$\end{document}. The search space is constrained using the Signature Method to ensure that exploration occurs only within the stabilizing set of gains. AlphaTune is designed to meet time-domain performance specifications, specifically, settling time, overshoot, and control signal constraints, which are often unaddressed by analytical methods. Simulation results demonstrate that AlphaTune outperforms established classical tuning techniques such as Ziegler-Nichols, CC, CHR, IMC, and SIMC. To the best of our knowledge, this represents the first application of the AlphaZero algorithm to the problem of controller tuning, offering a powerful and flexible new approach for control system design.
Keywords:
PI controllers
Reinforcement learning
AlphaZero
Tuning method
Artificial intelligence

Journal

J
Journal of Control Automation and Electrical Systems
IF:
1.3
Papers:
103
Citations:
1.1K

Organization

U
universidade federal do rio grande do norte
Scholars:
481
Papers: 173
Citations: 0
Universidade do Estado do Rio de Janeiro cover
Universidade do Estado do Rio de Janeiro
Scholars:
8.7K
Papers: 6.2K
Citations: 3.6K