.png){kind=icon}
返回
Smart Train Operation Algorithms Based on Expert Knowledge and Reinforcement Learning
.png){kind=icon}
OA
AI
DOI：10.1109/TSMC.2020.3000073.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
During decades, the automatic train operation (ATO) system has been gradually adopted in many subway systems for its low-cost and intelligence. This article proposes two smart train operation (STO) algorithms by integrating the expert knowledge with reinforcement learning algorithms. Compared with previous works, the proposed algorithms can realize the control of continuous action for the subway system and optimize multiple critical objectives without using an offline speed profile. First, through learning historical data of experienced subway drivers, we extract the expert knowledge rules and build inference methods to guarantee the riding comfort, the punctuality, and the safety of the subway system. Then we develop two algorithms for optimizing the energy efficiency of train operation. One is the STO algorithm based on deep deterministic policy gradient named (STOD) and the other is the STO algorithm based on normalized advantage function (STON). Finally, we verify the performance of proposed algorithms via some numerical simulations with the real field data from the Yizhuang Line of the Beijing Subway and illustrate that the developed STO algorithm are better than expert manual driving and existing ATO algorithms in terms of energy efficiency. Moreover, STOD and STON can adapt to different trip times and different resistance conditions.
Keyword:
Public transportation
Resistance
Inference algorithms
Rail transportation
Mathematical model
Force
Safety
Expert knowledge
reinforcement learning
smart train operation (STO)
subway
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Energy-Efficient Train Operation in Urban Rail Transit Using Real-Time Traffic Information基于实时交通信息的城市轨道交通列车节能运行
PREAI
分享收藏Multiobjective Optimization for Train Speed Trajectory in CTCS High-Speed Railway With Hybrid Evolutionary Algorithm基于混合进化算法的CTCS高速铁路列车速度轨迹多目标优化
PREAI
分享收藏Energy-efficient train control: From local convexity to global optimization and uniqueness.png)
AUTOMATICA
AUTOMATICAIF5.9
PREAI
分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏
查看更多内容