arrow
Return

Macro-micro mutual learning inside compositional model for human pose estimation

delete2021-08-01
delete9
PRE
AI
L
Lu Zhou
陈盈盈 (Yingying Chen) *
C
Congqi Cao
Y
Yakui Chu
J
Jinqiao Wang
卢汉清 (Hanqing Lu)
DOI:10.1016/j.neucom.2021.03.061delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we propose to perform mutual learning inside the compositional model for human pose estimation. We conduct inference of the human pose in a compositional model which is composed of parts and subparts networks to better capture intrinsic prior knowledge. A macro-micro mutual learning mechanism is put forward to promote the information interaction between human limbs (parts) and joints (subparts). At first, a macro mutual learning module is proposed to conduct the information interaction macroscopically. Features representing the whole human body are leveraged in this case. Secondly, a micro mutual learning module is proposed to promote the information interaction within each limb triplet group to refine corresponding features microcosmically. Combining the macro and micro mutual learning modules promotes the information interaction across different levels. Besides, a novel Balanced Masked Mean Square Error (BMMSE) loss is put forward to solve the positive-negative samples imbalance problem which is more apparent in compositional model. Effectiveness of the method is evaluated on MPII, LSP and COCO benchmarks. Our algorithm achieves leading positions on the leader board of these three datasets. (c) 2021 Published by Elsevier B.V.
Keywords:
Mutual learning
Macro-micro
BMMSE
Human pose estimation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

U
university of chinese academy of sciences, cas
Scholars:
4.1W
Papers: 3.8W
Citations: 75
C
chinese academy of sciences
Scholars:
56.4W
Papers: 44.9W
Citations: 704