arrow
Return

Motion Capture-Based Robotic Imitation: A Keyframeless Implementation Method Using Multivariate Empirical Mode Decomposition

delete2024-01-01
delete0
PRE
AI
董然 (Ran Dong)
Q
Qiong Chang
M
Meng Joo Er *
J
Junpei Zhong
S
Soichiro Ikuno
DOI:10.1109/TMECH.2024.3440642delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Robotic imitation faces challenges due to the lack of nuanced movements when employing keyframe methods, which can potentially lead to the uncanny valley effect due to constraints in fitting data within motor speed capacities. This research proposes a keyframeless motion-transferring method for robotic imitation using motion capture data. Initially, we implement motion capture data into the NAO 6 robot, retargeting the joint angles from a hierarchical human body structure to the motor rotations. Second, to biomechanically optimize robotic imitation, we adopt multivariate empirical mode decomposition (MEMD) to decompose and analyze the motion capture data in the frequency domain. Third, we demonstrate that MEMD outperforms the Fourier transform (FT) in motion-capture-based robotic imitation and introduce an optimization algorithm. Finally, we evaluate four types of robotic motion imitations (picking-up, walking, punching, and Bunraku puppet motion) across five implementation methods (original data implementation, Laban keyframe method, FT, convolutional neural network autoencoder, and our method) using both NAO 6 robot sensors and a motion capture system. The results indicated that our proposed keyframeless motion-transferring method outperforms others in applying and controlling complex, nuanced nonlinear motion capture data for robotic imitation, offering a potential approach to studying the uncanny valley issue.
Keywords:
Robots
Motion capture
Motors
Frequency-domain analysis
Robot motion
Legged locomotion
Humanoid robots
Biomechanics
deep learning
empirical mode decomposition (EMD)
frequency control
motion measurement
robot motion

Journal

I
IEEE-ASME Transactions on Mechatronics
IF:
7.3
Papers:
5.4K
Citations:
2.4W

Organization

I
Institute of Science Tokyo
Scholars:
3.2W
Papers: 2.7W
Citations: 117
T
Tokyo Institute of Technology
Scholars:
1.1W
Papers: 9.0K
Citations: 1.9W
Chukyo University cover
Chukyo University
Scholars:
261
Papers: 283
Citations: 140
T
Tokyo University of Technology
Scholars:
733
Papers: 606
Citations: 382
D
Dalian Maritime University
Scholars:
1.2W
Papers: 7.8K
Citations: 6.3K
researcher View more organizations