arrow
返回

Double-DQN-Based Path-Tracking Control Algorithm for Orchard Traction Spraying Robot

delete2022-11-10
delete4
delete
OA
AI
Z
Zhigang Ren
刘志杰 (Zhijie Liu)
M
Minxin Yuan
H
Heng Liu
W
Wang Wang
J
Jifeng Qin
F
Fuzeng Yang *
DOI:10.3390/agronomy12112803delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The precise path-tracking control of tractors and trailers is the key to realizing agricultural automation. In order to improve the path-tracking control accuracy and driving stability of orchard traction spraying robots, this study proposed a navigation path-tracking control algorithm based on Double Deep Q-Network (Double DQN). Drawing on the driver's driving experience and referring to the principle of radar scanning and the principle of image recognition, a virtual radar model was constructed to generate a virtual radar map. The virtual radar map was used to describe the position relationship between the traction spraying robot and the planned path. Combined with the deep reinforcement learning method, all possible robot driving actions under the current virtual radar map were scored, and the best driving action was selected as the output of the network. In this study, a path-tracking algorithm was self-developed with a deep Q-network trained by driving the traction spraying robot in a simulated virtual environment. The algorithm was tested in both simulations and in a field to follow a typical 'U'-shaped path. The simulation results showed that the proposed algorithm was able to achieve accurate path-tracking control of the spraying trailer. The field tests showed that when the vehicle speed was 0.36 m/s and 0.75 m/s, the maximum lateral deviation of the algorithm was 0.233 m and 0.266 m, the average lateral deviation was 0.071 m and 0.076 m, and the standard deviation was 0.051 m and 0.057 m, respectively. Compared with the algorithm based on the virtual radar model, the maximum lateral deviation was reduced by 56.37% and 51.54%, the average lateral deviation was reduced by 7.8% and 5.0%, and the standard deviation was reduced by 20.31% and 8.1%, respectively. The results showed that the Double-DQN-based navigation path-tracking control algorithm for the traction spraying robot in the orchard had higher path-tracking accuracy and driving stability, which could meet the actual operational requirements of traditional orchards.
Keyword:
conventional orchard
spraying trailer
navigation
path tracking
reinforcement learning

期刊

A
Agronomy-Basel
IF:
3.4
论文数:
1.7W
被引数:
5.0W

机构

N
northwest a&f university - china
学者数:
3.6W
论文数: 2.1W
被引数: 34
引用论文

引用论文

Model predictive control with discrete actuators: Theory and application
err2017-04-01
err62
PREAI
errRawlings, James B.; Risbeck, Michael J.
err分享
err收藏
A Reinforcement Learning-Based Adaptive Path Tracking Approach for Autonomous Driving
err2020-10-01
err84
PREAI
errShan, Yunxiao; Zheng, Boli; Chen, Longsheng; Chen, Long; Chen, De
err分享
err收藏
Optimizing donor selection in a cord blood bank
err2004-01-06
err0
PREAI
errPilar Solves; Alfredo Perales; Vicente Mirabet; Ignacio Blasco; Amando Blanquer; D. Planelles; Luis Larrea; Javier Monleon; F. Carbonell‐Uberos; M. Angeles Soler
err分享
err收藏
学者 查看更多内容