Attention-Driven Graph Neural Network for Deep Face Super-Resolution

Qiqi Bao

doi:10.1109/TIP.2022.3212311

2022-01-01

PRE

DOI：10.1109/TIP.2022.3212311

原文链接

原文求助

摘要

En 中文

With the help of convolutional neural networks (CNNs), deep learning-based methods have achieved remarkable performance in face super-resolution (FSR) task. Despite their success, most of the existing methods neglect non-local correlations of face images, leaving much room for improvement. In this paper, we introduce a novel end-to-end trainable attention-driven graph neural network (AD-GNN) for more discriminative feature extraction and feature relation modeling. This is achieved by two major components. The first component is a cross-scale dynamic graph (CDG) block. The CDG block considers cross-scale relationships of patches in distant areas and employs two dynamic graphs to construct enhanced features. The second component is a series of channel attention and spatial dynamic graph (CASDG) blocks. A CASDG block has a channel-wise attention unit and a spatial-aware dynamic graph (SDG) unit. The SDG unit extracts informative features by exploring spatial non-local self-similarity information of the patches using dynamic graph convolution. Using these two components, facial details can be effectively reconstructed with the help of information supplemented by similar but spatially remote patches and structural information of faces. Extensive experiments on two public benchmarks demonstrate the superiority of AD-GNN over the state-of-the-art FSR methods.

Keyword:

Faces

Feature extraction

Superresolution

Convolution

Task analysis

Correlation

Graph neural networks

Face super-resolution

attention-driven graph neural network

dynamic graph

dynamic adjacency matrix