返回
Efficient Parameter Search for Chaotic Dynamical Systems Using Lyapunov-Based Reinforcement Learning
DOI:10.3390/sym17111832.png)
摘要
En 中文
This study applies reinforcement learning to search parameter regimes that yield chaotic dynamics across six systems: the Logistic map, the H & eacute;non map, the Lorenz system, Chua's circuit, the Lorenz-Haken model, and a custom 5D hyperchaotic design. The largest Lyapunov exponent (LLE) is used as a scalar reward to guide exploration toward regions with high sensitivity to initial conditions. Under matched evaluation budgets, the approach reduces redundant simulations relative to grid scans and accelerates discovery of parameter sets with large positive LLE. Experiments report learning curves, parameter heatmaps, and representative phase portraits that are consistent with Lyapunov-based assessments. Q-learning typically reaches high-reward regions earlier, whereas SARSA shows smoother improvements over iterations. Several evaluated systems possess equation-level symmetry-most notably sign-reversal invariance in the Lorenz system and Chua's circuit models and a coordinate-wise sign pattern in the Lorenz-Haken equations-which manifests as mirror attractors and paired high-reward regions; one representative is reported for each symmetric pair. Overall, Lyapunov-guided reinforcement learning serves as a practical complement to grid and random search for chaos identification in both discrete maps and continuous flows, and transfers with minimal changes to higher-dimensional settings. The framework provides an efficient method for identifying high-complexity parameters for applications in chaos-based cryptography and for assessing stability boundaries in engineering design.
Keyword:
chaotic systems
Lyapunov exponent
parameter exploration
reinforcement learning
Q-learning
SARSA
期刊
S
IF:
2.2
论文数:
1.4K
被引数:
0
机构
暂无机构信息
引用论文
On-policy and Off-policy Q-learning algorithms with policy iteration for two-wheeled inverted pendulum systems基于策略迭代的两轮倒立摆系统的在策略与离策略Q学习算法
Computationally efficient parameter estimation for high-dimensional ocean biogeochemical models高维海洋生物地球化学模型的计算有效参数估计
El Wafi, M.; Youssefi, M.A.; Dakir, R.; Bakir, M. Intelligent Robot in Unknown Environments: Walk Path Using Q-Learning and Deep Q-Learning. Automation 2025, 6, 12. [Google Scholar] [CrossRef]El Wafi, M.; Youssefi, M.A.; Dakir, R.; Bakir, M. 未知环境中的智能机器人:基于Q-Learning和深度Q-Learning的行走路径。Automation 2025, 6, 12. [Google Scholar] [CrossRef]

