arrow
返回

Supervised Neural Q_learning based Motion Control for Bionic Underwater Robots

delete2010-12-01
delete32
PRE
AI
L
Longxin Lin *
H
Haibin Xie
L
Lincheng Shen
DOI:10.1016/S1672-6529(09)60233-Xdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Bionic underwater robots have been a hot research area in recent years. The motion control methods for a kind of bionic underwater robot with two undulating fins are discussed in this paper. The equations of motion for the bionic underwater robot are described. To apply the reinforcement learning to the actual robot control, a Supervised Neural Q_learning (SNQL) algorithm is put forward. This algorithm is based on conventional Q_learning algorithm, but has three remarkable distinctions: (1) using a feedforward neural network to approximate the Q_function table; (2) adopting a learning sample database to speed up learning and improve the stability of learning system; (3) introducing a supervised control in the earlier stage of learning for safety and to speed up learning again. Experiments of swimming straightforward are carried out with SNQL algorithm. Results indicate that the SNQL algorithm is more effective than pure neural Q_learning or supervised control. It is a feasible approach to figure out the motion control for bionic underwater robots.
Keyword:
bionic underwater robot
reinforcement learning
Q_learning
neural network
supervised control
undulating fin
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Bionic Engineering 封面图
Journal of Bionic Engineering
IF:
5.8
论文数:
2.0K
被引数:
4.8K

机构

N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
引用论文

引用论文

New thiazolidine-2,4-diones as effective anti-proliferative and anti-VEGFR-2 agents: Design, synthesis, in vitro, docking, MD simulations, DFT, ADMET, and toxicity studies
err2023-12-01
err0
PREAI
errHazem Elkady; Abdelrahman A. Abuelkhir; Mahmoud Rashed; Mohammed S. Taghour; Mohammed A. Dahab; Hazem A. Mahdy; Alaa Elwan; Hanan A. Al-ghulikah; Eslam B. Elkaeed; Ibrahim M. Ibrahim; Dalal Z. Husein; Ahmed Metwaly; Ibrahim H. Eissa
err分享
err收藏
err分享
err收藏
Modeling ADMET
err2016-06-17
err0
PREAI
errJayeeta Ghosh; Michael S. Lawless; Marvin Waldman; Vijay Gombar; Robert Fraczkiewicz
err分享
err收藏
Open-Loop Control of a Multifin Biorobotic Rigid Underwater Vehicle
err2008-04-01
err42
PREAI
errMenozzi, Alberico; Leinhos, Henry A.; Beal, David N.; Bandyopadhyay, Promode R.
err分享
err收藏
学者 查看更多内容