Multi-task face analyses through adversarial learning

Shangfei Wang

doi:10.1016/j.patcog.2021.107837

Multi-task face analyses through adversarial learning

2021-06-01

8

PRE

AI

王

王上飞 (Shangfei Wang) *

DOI：10.1016/j.patcog.2021.107837

Original

Original request for help

Save

Abstract

En 中文

The inherent relations among multiple face analysis tasks, such as landmark detection, head pose estimation, gender recognition and face attribute estimation are crucial to boost the performance of each task, but have not been thoroughly explored since typically these multiple face analysis tasks are handled as separate tasks. In this paper, we propose a novel deep multi-task adversarial learning method to localize facial landmark, estimate head pose and recognize gender jointly or estimate multiple face attributes simultaneously through exploring their dependencies from both image representation-level and label-level. Specifically, the proposed method consists of a deep recognition network R and a discriminator D. The deep recognition network is used to learn the shared middle-level image representation and conducts multiple face analysis tasks simultaneously. Through multi-task learning mechanism, the recognition network explores the dependencies among multiple face analysis tasks from image representation-level. The discriminator is introduced to enforce the distribution of the multiple face analysis tasks to converge to that inherent in the ground-truth labels. During training, the recognizer tries to confuse the discriminator, while the discriminator competes with the recognizer through distinguishing the predicted label combination from the ground-truth one. Though adversarial learning, we explore the dependencies among multiple face analysis tasks from label-level. Experimental results on benchmark databases demonstrate the effectiveness of the proposed method for multi-task face analyses. (C) 2021 Elsevier Ltd. All rights reserved.

Keywords:

Multi-task learning

Adversarial learning

Face analyses

Multi-task face analyses through adversarial learning

Abstract

AI Summary

Journal

Organization

Cited Papers