.png){kind=icon}
返回
Safe Multiagent Learning With Soft Constrained Policy Optimization in Real Robot Control
.png){kind=icon}
PRE
AI
DOI：10.1109/TII.2024.3391934.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Due to a lack of safety considerations, a wide range of multiagent reinforcement learning (MARL) applications are limited in real-world environments. Thus, ensuring MARL safety is essential and urgent in the domain. However, merely a few studies consider the safe MARL problem, and the investigation of real-world applications using safe MARL algorithms still needs to be improved. To fill this gap, we provide a framework with soft constrained policy optimization, in which we develop practical algorithms to address the problem in a cooperative game setting. First, the problem formulation of safe MARL is introduced. Second, the safe policy optimization of safe MARL algorithms based on soft constrained optimization is analyzed, and we further propose a safe learning framework for safe MARL. The framework can be plugged into MARL algorithms without manually fine-tuning safety bounds. Third, we investigate the sim-to-real problems, and conduct simulation and real-world experiments to evaluate the effectiveness of our algorithms. Finally, the comprehensive experimental results indicate that our method has significant benefits regarding the balance between reward and safety performance and outperforms several strong baselines.
Keyword:
Multiagent systems
real-robot control
safe reinforcement learning
期刊
IF:
9.9
论文数:
8.7K
被引数:
6.0W
机构
引用论文
.png){kind=icon}
Does modified Otago Exercise Program improves balance in older people? A systematic review改良的奥塔哥锻炼计划能改善老年人的平衡吗？一项系统综述
OAAI
OAAI分享收藏
查看更多内容