arrow
Return

ATF: An Alternating Training Framework for Weakly Supervised Face Alignment

delete2023-01-01
delete3
PRE
AI
X
Xing Lan
胡庆浩 cover
胡庆浩 (Qinghao Hu)
J
Jian Cheng *
DOI:10.1109/TMM.2022.3164798delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In recent years, various face-landmark datasets have been published. Intuitively, it is significant to integrate multiple labeled datasets to achieve higher performance. Due to the different annotation schemes of datasets, it is hard to directly train models using them together. Although numerous efforts have been made in the joint use of datasets, there remain three shortages in previous methods, i.e., additional computation, limitation of the markups scheme, and limited support for the regression method. To solve the above issues, we proposed a novel Alternating Training Framework (ATF), which leverages the similarity and diversity across multiple datasets for a more robust detector. ATF mainly contains two sub-modules: Alternating Training with Decreasing Proportions (ATDP) and Mixed Branch Loss (L-MB). In particular, ATDP trains multiple datasets simultaneously via a weakly supervised way to take advantage of the diversity among them, and L-MB utilizes similar landmark pairs to constrain different branches of the corresponding datasets. Besides, we extend the framework to easily handle three situations: single target detector, joint detector, and novel detector. Extensive experiments demonstrate the effectiveness of our framework for both heatmap-based and direct coordinate regression. Moreover, we have achieved a joint detector that outperforms state-of-the-art methods on each benchmark.
Keywords:
Face alignment
multi-task learning
weakly supervised

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

U
university of chinese academy of sciences, cas
Scholars:
4.1W
Papers: 3.8W
Citations: 75
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Complete genome sequence of Nitratifractor salsuginis type strain (E9I37-1T)
err2011-07-01
err0
errOAAI
errIain Anderson; Johannes Sikorski; Ahmet Zeytun; Matt Nolan; Alla Lapidus; Susan Lucas; Nancy Hammon; Shweta Deshpande; Jan-Fang Cheng; Roxanne Tapia; Cliff Han; Lynne Goodwin; Sam Pitluck; Konstantinos Liolios; Ioanna Pagani; Natalia Ivanova; Marcel Huntemann; Konstantinos Mavromatis; Galina Ovchinikova; Amrita Pati; Amy Chen; Krishna Palaniappan; Miriam Land; Loren Hauser; Evelyne-Marie Brambilla; Olivier D. Ngatchou-Djao; Manfred Rohde; Brian J. Tindall; Markus Göker; John C. Detter; Tanja Woyke; James Bristow; Jonathan A. Eisen; Victor Markowitz; Philip Hugenholtz; Hans-Peter Klenk; Nikos C. Kyrpides
errShare
errSave
Corneal shrinkage induced by nonmechanical Q-switched erbium:YAG laser trephination for penetrating keratoplasty in porcine eyes
err2003-07-17
err0
PREAI
errMilenko Stojkovic; Berthold Seitz; Michael Küchle; Achim Langenbucher; Arne Viestenz; Anja Viestenz; Carmen Hofmann-Rummelt; Gottfried O. H. Naumann
errShare
errSave
Deep learning in neural networks: An overview
err2015-01-01
err1.3W
errOAAI
errSchmidhuber, Juergen
errShare
errSave
Requirement for Croquemort in Phagocytosis of Apoptotic Cells in Drosophila
err1999-06-18
err0
PREAI
errNathalie C. Franc; Pascal Heitzler; R. Alan B.; Ezekowitz; Kristin White
errShare
errSave
Thalamocortical Long-Term Potentiation Becomes Gated after the Early Critical Period in the Auditory Cortex
err2013-04-24
err0
errOAAI
errSungkun Chun; Ildar T. Bayazitov; Jay A. Blundon; Stanislav S. Zakharenko
errShare
errSave
researcher View more