arrow
Return

Relation-balanced graph convolutional network for 3D human pose estimation

delete2023-12-01
delete1
PRE
AI
L
Lu Chen
刘
刘琼 (Qiong Liu) *
DOI:10.1016/j.imavis.2023.104841delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph convolutional networks (GCNs) have been applied to 2D-to-3D human pose estimation (HPE) and have shown encouraging performance. However, existing GCNs model the relations between joints via individual kernels, which can be overly flexible and fail to capture common relational patterns due to the symmetric nature of the human body. Although some GCNs share kernels to capture common relations, the unified way for all neighbors limits relational diversity to some extent. In order to balance the diversity and commonality of relations, we conduct a comprehensive study of existing kernel-sharing strategies and propose a Relation-balanced Graph Convolutional Network (RbGC-Net). RbGC-Net introduces the Part-Specific Kernel-Sharing strategy (PSKS) that assigns kernels based on the semantic meanings of neighbors to establish specific relational patterns for different types of neighborhoods. Furthermore, RbGC-Net incorporates a Local-Global Feature Fusion module (LGFF) that extracts the local relations among joints and balances them with the final global relations to improve the interactions between joints. Compared with state-of-the-art methods for 3D HPE, our RbGC-Net achieves the optimal balance between model size and estimation errors. Results on two benchmark Human3.6 M and MPIINF-3DHP datasets demonstrate the excellent performance and strong generalization ability of our pure GCNbased method.
Keywords:
3D human pose estimation
Graph convolutional network
Relation modeling
Feature fusion

Journal

Image and Vision Computing cover
Image and Vision Computing
IF:
4.2
Papers:
4.1K
Citations:
6.7K

Organization

S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
Cited Papers

Cited Papers

Single image based 3D human pose estimation via uncertainty learning
err2022-12-01
err21
PREAI
errHan, Chuchu; Yu, Xin; Gao, Changxin; Sang, Nong; Yang, Yi
errShare
errSave
Graph convolutional network with structure pooling and joint-wise channel attention for action recognition
err2020-07-01
err50
PREAI
errChen, Yuxin; Ma, Gaoqun; Yuan, Chunfeng; Li, Bing; Zhang, Hui; Wang, Fangshi; Hu, Weiming
errShare
errSave
Double chain networks for monocular 3D human pose estimation
err2022-07-01
err5
PREAI
errBai, Guihu; Luo, Yanmin; Pan, Xueliang; Wang, Youjie; Wang, Jia; Guo, Jingming
errShare
errSave
QTL mapping in rice
err1995-12-01
err0
errOAAI
errSusan R. McCough; Rebecca W. Doerge
errShare
errSave
High expression of the circadian gene mPer2 diminishes the radiosensitivity of NIH 3T3 cells
err2009-09-04
err0
errOAAI
errL. Chang; Y.Y. Liu; B. Zhu; Y. Li; H. Hua; Y.H. Wang; J. Zhang; Z. Jiang; Z.R. Wang
errShare
errSave
errShare
errSave
Sustained Hyperparathyroidism Among Patients Treated With Lithium
err2016-04-01
err0
PREAI
errRoberto Lozano; Reyes Marin; Maria-Jesus Santacruz; Asunción Pascual
errShare
errSave
Preschool children's vision screening in New Zealand: a retrospective evaluation of referral accuracy
err2015-11-27
err0
errOAAI
errMiriam A Langeslag-Smith; Alain C Vandal; Vincent Briane; Benjamin Thompson; Nicola S Anstice
errShare
errSave
Plasma and Urinary Tanshinol from Salvia miltiorrhiza (Danshen) Can Be Used as Pharmacokinetic Markers for Cardiotonic Pills, a Cardiovascular Herbal Medicine
err2008-08-01
err0
PREAI
errTong Lu; Junling Yang; Xiumei Gao; Ping Chen; Feifei Du; Yan Sun; Fengqing Wang; Fang Xu; Hongcai Shang; Yuhong Huang; Yi Wang; Renzhong Wan; Changxiao Liu; Boli Zhang; Chuan Li
errShare
errSave
researcher View more