.png){kind=icon}
返回
Efficient Q-learning hyperparameter tuning using FOX optimization algorithm
.png){kind=icon}
OA
AI
DOI：10.1016/j.rineng.2025.104341.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Reinforcement learning is a branch of artificial intelligence in which agents learn optimal actions through interactions with their environment. Hyperparameter tuning is crucial for optimizing reinforcement learning algorithms and involves the selection of parameters that can significantly impact learning performance and reward. Conventional Q-learning relies on fixed hyperparameter without tuning throughout the learning process, which is sensitive to the outcomes and can hinder optimal performance. In this paper, a new adaptive hyperparameter tuning method, called Q-learning-FOX (Q-FOX), is proposed. This method utilizes the FOX Optimizer-an optimization algorithm inspired by the hunting behaviour of red foxes-to adaptively optimize the learning rate (alpha) and discount factor (gamma) in the Q-learning. Furthermore, a novel objective function is proposed that maximizes the average Q-values. The FOX utilizes this function to select the optimal solutions with maximum fitness, thereby enhancing the optimization process. The effectiveness of the proposed method is demonstrated through evaluations conducted on two OpenAI Gym control tasks: Cart Pole and Frozen Lake. The proposed method achieved superior cumulative reward compared to established optimization algorithms, as well as fixed and random hyperparameter tuning methods. The fixed and random methods represent the conventional Qlearning. However, the proposed Q-FOX method consistently achieved an average cumulative reward of 500 (the maximum possible) for the Cart Pole task and 0.7389 for the Frozen Lake task across 30 independent runs, demonstrating a 23.37% higher average cumulative reward than conventional Q-learning, which uses established optimization algorithms in both control tasks. Ultimately, the study demonstrates that Q-FOX is superior to tuning hyperparameters adaptively in Q-learning, outperforming established methods.
Keyword:
FOX optimization algorithm
Hyperparameter
Optimization
Q-learning
Reinforcement learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.9
论文数:
1.1W
被引数:
1.7W
机构
引用论文
.png){kind=icon}
分享收藏A Q-learning based multi-strategy integrated artificial bee colony algorithm with application in unmanned vehicle path planning基于Q学习的多策略集成人工蜂群算法及其在无人车路径规划中的应用OAAI
OAAI分享收藏Adsorption of Pb2+ and Cd2+ onto Spirulina platensis harvested by polyacrylamide in single and binary solution systems在单和二元溶液系统中，聚丙烯酰胺收获的螺旋藻对Pb2和Cd2的吸附
PREAI
分享收藏Ecdysteroid levels and developmental events during larval moulting in the silkworm, Bombyx mori
PREAI
分享收藏
查看更多内容