arrow
返回

Fuzzy Double Deep Q-Network-Based Gait Pattern Controller for Humanoid Robots

delete2022-01-01
delete11
PRE
AI
T
Tzuu‐Hseng S. Li *
P
Ping‐Huan Kuo
L
Lin-Han Chen
C
Chia-Ching Hung
P
Po‐Chien Luan
H
Hao-Ping Hsu
C
Chien-Hsin Chang
Y
Yi‐Ting Hsieh
W
Wen-Hsun Lin
DOI:10.1109/TFUZZ.2020.3033141delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this article, the adaptive-network-based fuzzy inference system (ANFIS) is combined with the double deep Q-network (DDQN) to realize a fuzzy DDQN (FDDQN) such that a humanoid robot can generate a linear inverted pendulum model-based gait pattern in real time. The FDDQN not only allows the humanoid robot to correct the gait pattern instantly but also improves its stability. The proposed scheme is designed and implemented in a toddler-sized humanoid robot called Louis. First, four pressure sensors are installed on the bottom of the sole and one inertial measurement unit is set up on the trunk of the robot. A wireless communication chip is employed to transfer the data to a computer to determine the required parameters for the robot. Next, a control system based on the Linux operating system is developed. The values of the center of pressure and acceleration obtained with the ANFIS are adopted to train the DDQN. The proposed neural network comprises four layers, and the model is cautiously selected to avoid overfitting. The proposed scheme is verified using a robot simulator and then real-time-tested on Louis. The experimental results indicate that the FDDQN can provide the robot timely feedback during walking as well as helps it in adjusting the gait pattern independently. The balancing of the robot through effective dynamic feedback is similar to the balancing ability of an infant learning to walk.
Keyword:
Humanoid robots
Legged locomotion
Robot sensing systems
Control systems
Neural networks
Force
Adaptive-network-based fuzzy inference system (ANFIS)
double deep Q-network (DDQN)
dynamic gait balance
humanoid robot

期刊

IEEE Transactions on Fuzzy Systems 封面图
IEEE Transactions on Fuzzy Systems
IF:
11.9
论文数:
5.0K
被引数:
2.9W

机构

N
National Cheng Kung University
学者数:
2.6W
论文数: 2.3W
被引数: 1.7W
引用论文

引用论文

Learning to Adjust and Refine Gait Patterns for a Biped Robot
err2015-12-01
err31
PREAI
errHwang, Kao-Shing; Lin, Jin-Ling; Yeh, Keng-Hao
err分享
err收藏
Recurrent Mechanism and Impulse Noise Filter for Establishing ANFIS
err2018-04-01
err28
PREAI
errSy Dzung Nguyen; Choi, Seung-Bok; Seo, Tae-Il
err分享
err收藏
Water Body Survey, Inspection, and Monitoring Using Amphibious Hybrid Unmanned Aerial Vehicle
err2021-02-04
err0
PREAI
errDinesh Manoharan; S. Rajesh; S. Vignesh; S. Vignesh; G.D. Bhuvaneshwaran; G.D. Bhuvaneshwaran; Tharik Mohammed; John Gunaseelan; C. Gajendran; M.K. Padmanabhan
err分享
err收藏
学者 查看更多内容