arrow
Return

Multi-attention augmented network for single image super-resolution

delete2022-02-01
delete44
PRE
AI
R
Rui Chen *
H
Heng Zhang
J
Jixin Liu
DOI:10.1016/j.patcog.2021.108349delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
How to improve the representational power of visual features extracted by deep convolutional neural networks is of crucial importance for high-quality image super-resolution. To address this issue, we propose a multi-attention augmented network, which mainly consists of content-, orientation-and position-aware modules. Specifically, we develop an attention augmented U-net structure to form the content-aware module in order to learn and combine multi-scale informative features within a large receptive field. To better reconstruct image details in different directions, we design a set of pre-defined sparse kernels to construct the orientation-aware module, which can extract more representative multi-orientation features and enhance the discriminative capacity in stacked convolutional stages. Then these extracted features are adaptively fused through channel attention mechanism. In upscale stage, the position-aware module adopts a novel self-attention to reweight the element-wise value of final low-resolution feature maps, for further suppressing the possible artifacts. Experimental results demonstrate that our method obtains better reconstruction accuracy and perceptual quality against state-of-the-art methods. (c) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Super-resolution
Multi-scale U-net
pre-defined sparse kernels
Attention mechanism

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

T
tianjin university
Scholars:
8.0W
Papers: 5.8W
Citations: 88
Cited Papers

Cited Papers

Blind single image super-resolution with a mixture of deep networks
err2020-06-01
err20
PREAI
errWang, Yifan; Wang, Lijun; Wang, Hongyu; Li, Peihua; Lu, Huchuan
errShare
errSave
Ensemble based deep networks for image super-resolution
err2017-08-01
err60
PREAI
errWang, Lingfeng; Huang, Zehao; Gong, Yongchao; Pan, Chunhong
errShare
errSave
Simultaneous color-depth super-resolution with conditional generative adversarial networks
err2019-04-01
err68
PREAI
errZhao, Lijun; Bai, Huihui; Liang, Jie; Zeng, Bing; Wang, Anhong; Zhao, Yao
errShare
errSave
errShare
errSave
Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling
err2013-04-01
err354
errOAAI
errDong, Weisheng; Zhang, Lei; Lukac, Rastislav; Shi, Guangming
errShare
errSave
errShare
errSave
researcher View more