Multi-level landmark-guided deep network for face super-resolution

doi:10.1016/j.neunet.2022.04.026

Multi-level landmark-guided deep network for face super-resolution

2022-08-01

13

PRE

AI

张凯兵 (Kaibing Zhang) *

李正 (Zheng Li)

J

Jian Lü

DOI：10.1016/j.neunet.2022.04.026

Original

Original request for help

Save

Abstract

En 中文

Recent years deep learning-based methods incorporating facial prior knowledge for face super resolution (FSR) are advancing and have gained impressive performance. However, some important priors such as facial landmarks are not fully exploited in existing methods, leading to noticeable artifacts in the resultant SR face images especially under large magnification. In this paper, we propose a novel multi-level landmark-guided deep network (MLGDN) for FSR. More specifically, to fully exploit the dependencies between low and high resolution images and to reduce network parameters as well as capture more reliable feature representation, we introduce a recursive back-projection network with a particular feedback mechanism for coarse-to-fine FSR. Furthermore, we incorporate an attention fusion module in the front of backbone network to strengthen face components and a feature modulation module to refine features in the middle of backbone network. By this way, the facial landmarks extracted from face images can be fully shared by the modules in different levels, which benefit to produce more faithful facial details. Both quantitative and qualitative performance evaluations on two benchmark databases demonstrate that the proposed MLGDN can achieve more impressive SR results than other state-of-the-art competitors. Code will be available at https://github. com/zhuangcheng31/MLG_Face.git/(C) 2022 Elsevier Ltd. All rights reserved.

Keywords:

Facial component

Facial landmarks

Super-resolution reconstruction

Recursive feedback deep network

Multi-level landmark-guided deep network for face super-resolution

Abstract

Journal

Organization