arrow
Return

Toward Pixel-Level Precision for Binary Super-Resolution With Mixed Binary Representation

delete2024-03-01
delete7
PRE
AI
X
Xinrui Jiang
王南南 cover
王南南 (Nannan Wang) *
J
Jingwei Xin
K
Keyu Li
X
Xi Yang
J
Jie Li
X
Xinbo Gao
DOI:10.1109/TNNLS.2022.3201528delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Binary neural network (BNN) is an effective method for reducing model computational and memory cost, which has achieved much progress in the super-resolution (SR) field. However, there is still a noticeable performance gap between a binary SR network and its full-precision counterpart. Considering that the information density in quantization features is far lower than full-precision features, we aim to improve the precision of quantization features to produce rich-enough output activations for SR task. First, we make several observations that a multibit value could be approximated by multiple 1-bit values, and the computation power of binary convolution could be improved by approximating the multibit convolution process. Then, we propose a mixed binary representation set to approximate multibit activations, which is effective in compensating the quantization precision loss. Finally, we present a new precision-driven binary convolution (PDBC) module, which increases the convolution precision and protects image detail information without extra computation. Compared with normal binary convolution, our method could largely reduce the information loss caused by binarization. In experiments, our methods consistently show superior performance over the baseline models and can surpass state-of-the-art methods in terms of peak signal to noise ratio (PSNR) and visual quality.
Keywords:
Convolution
Task analysis
Quantization (signal)
Computational modeling
Visualization
Superresolution
PSNR
Binary neural network (BNN)
lightweight network
mixed binary representation
single-image super-resolution (SISR)

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

C
chongqing university of posts & telecommunications
Scholars:
6.7K
Papers: 5.3K
Citations: 5
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K