arrow
Return

Advanced Binary Neural Network for Single Image Super Resolution

delete2023-04-18
delete5
PRE
AI
J
Jingwei Xin
N
Nannan Wang *
X
Xinrui Jiang
J
Jie Li
X
Xinbo Gao
DOI:10.1007/s11263-023-01789-8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Binary neural network (BNN) is an effective approach to accelerate the model inference and has been initially applied in the field of single image super resolution (SISR). However, the optimization of efficiency and accuracy remains a major challenge for achieving further improvements. While existing BNN-based SR methods solve the SISR problems by proposing a residual block-oriented quantization mechanism, the quantization process in the up-sampling stage and the representation tendency of binary super resolution networks are ignored. In this paper, we propose an Advanced Binary Super Resolution (ABSR) method to optimize the binary generator in terms of quantization mechanism and up-sampling strategy. Specifically, we first design an excitation-selection mechanism for binary inference, which could distinctively implement self-adjustment of activation and significantly reduce inference errors. Furthermore, we construct a binary up-sampling strategy that achieves performance almost equal to that of real-valued up-sampling modules, and fully frees up the inference speed of the binary network. Extensive experiments show that the ABSR not only reaches state-of-the-art BNN-based SR performance in terms of objective metrics and visual quality, but also reduces computational consumption drastically.
Keywords:
Image super resolution
Model binarization
Computational consumption
Inference mechanism
Up-sampling operation

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

C
chongqing university of posts & telecommunications
Scholars:
6.7K
Papers: 5.3K
Citations: 5
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K