arrow
Return

Fuzzy Double Deep Q-Network-Based Gait Pattern Controller for Humanoid Robots

delete2022-01-01
delete11
PRE
AI
T
Tzuu‐Hseng S. Li *
P
Ping‐Huan Kuo
L
Lin-Han Chen
C
Chia-Ching Hung
P
Po‐Chien Luan
H
Hao-Ping Hsu
C
Chien-Hsin Chang
Y
Yi‐Ting Hsieh
W
Wen-Hsun Lin
DOI:10.1109/TFUZZ.2020.3033141delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this article, the adaptive-network-based fuzzy inference system (ANFIS) is combined with the double deep Q-network (DDQN) to realize a fuzzy DDQN (FDDQN) such that a humanoid robot can generate a linear inverted pendulum model-based gait pattern in real time. The FDDQN not only allows the humanoid robot to correct the gait pattern instantly but also improves its stability. The proposed scheme is designed and implemented in a toddler-sized humanoid robot called Louis. First, four pressure sensors are installed on the bottom of the sole and one inertial measurement unit is set up on the trunk of the robot. A wireless communication chip is employed to transfer the data to a computer to determine the required parameters for the robot. Next, a control system based on the Linux operating system is developed. The values of the center of pressure and acceleration obtained with the ANFIS are adopted to train the DDQN. The proposed neural network comprises four layers, and the model is cautiously selected to avoid overfitting. The proposed scheme is verified using a robot simulator and then real-time-tested on Louis. The experimental results indicate that the FDDQN can provide the robot timely feedback during walking as well as helps it in adjusting the gait pattern independently. The balancing of the robot through effective dynamic feedback is similar to the balancing ability of an infant learning to walk.
Keywords:
Humanoid robots
Legged locomotion
Robot sensing systems
Control systems
Neural networks
Force
Adaptive-network-based fuzzy inference system (ANFIS)
double deep Q-network (DDQN)
dynamic gait balance
humanoid robot

Journal

IEEE Transactions on Fuzzy Systems cover
IEEE Transactions on Fuzzy Systems
IF:
11.9
Papers:
5.0K
Citations:
2.9W

Organization

N
National Cheng Kung University
Scholars:
2.6W
Papers: 2.3W
Citations: 1.7W
Cited Papers

Cited Papers

Learning to Adjust and Refine Gait Patterns for a Biped Robot
err2015-12-01
err31
PREAI
errHwang, Kao-Shing; Lin, Jin-Ling; Yeh, Keng-Hao
errShare
errSave
Recurrent Mechanism and Impulse Noise Filter for Establishing ANFIS
err2018-04-01
err28
PREAI
errSy Dzung Nguyen; Choi, Seung-Bok; Seo, Tae-Il
errShare
errSave
Water Body Survey, Inspection, and Monitoring Using Amphibious Hybrid Unmanned Aerial Vehicle
err2021-02-04
err0
PREAI
errDinesh Manoharan; S. Rajesh; S. Vignesh; S. Vignesh; G.D. Bhuvaneshwaran; G.D. Bhuvaneshwaran; Tharik Mohammed; John Gunaseelan; C. Gajendran; M.K. Padmanabhan
errShare
errSave
researcher View more