1
Return

A Unified Reinforcement Learning Framework for Payload-Aware Humanoid Control With Integrated Inertial and State Estimation

delete2026-01-22
delete0
PRE
AI
S
Shenghao Ji
Z
Ziyu Chen
C
Chiyu Zhang
J
Jie Gao
H
Hong Qiao
DOI:10.1109/tmech.2025.3648874delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article presents an integrated reinforcement learning framework for payload-aware humanoid control that enables online adaptation to varying loads. Unlike conventional modular designs, our approach employs a single proprioception-driven policy network that unifies three core functions–motion control, inertial parameter identification, and state estimation–within a cohesive architecture, thereby avoiding inter-module coupling and simplifying the overall system. To support accurate inertial identification across diverse gait patterns, we design parameterized gait templates based on phase-locked oscillators and polynomial interpolation, providing structured excitation while ensuring kinematic feasibility. The control policy is trained in simulation using privileged supervision, yet operates without explicit dynamic models or extensive domain randomization. Hardware experiments on a full-scale humanoid validate four key capabilities: Accurate online payload identification using only onboard sensors; improved motion tracking via load-aware control adaptation; robust dual-arm payload transport of up to 20 kg, outperforming existing baselines; and enhanced disturbance rejection via emergent postural strategies. By embedding physical parameter awareness into end-to-end policy learning, this framework offers a scalable and robust solution for real-world humanoid control under dynamic load conditions.
Keywords:
Humanoid control
inertial parameter identification
payload adaptation
reinforcement learning
state estimation

Journal

I
IEEE-ASME Transactions on Mechatronics
IF:
7.3
Papers:
5.4K
Citations:
2.4W

Organization

C
chinese academy of sciences
Scholars:
54.9W
Papers: 44.5W
Citations: 703
Cited Papers

Cited Papers

Citing Papers

Citing Papers