arrow
Return

Learned Image Compression Using Cross-Component Attention Mechanism

delete2023-01-01
delete3
PRE
AI
W
Wenhong Duan
Z
Zheng Chang
C
Chuanmin Jia *
王苫社 cover
王苫社 (Shanshe Wang)
马思伟 (Siwei Ma) *
李松 (Li Song)
高雯 (Wen Gao)
DOI:10.1109/TIP.2023.3319275delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Learned image compression methods have achieved satisfactory results in recent years. However, existing methods are typically designed for RGB format, which are not suitable for YUV420 format due to the variance of different formats. In this paper, we propose an information-guided compression framework using cross-component attention mechanism, which can achieve efficient image compression in YUV420 format. Specifically, we design a dual-branch advanced information-preserving module (AIPM) based on the information-guided unit (IGU) and attention mechanism. On the one hand, the dual-branch architecture can prevent changes in original data distribution and avoid information disturbance between different components. The feature attention block (FAB) can preserve the important information. On the other hand, IGU can efficiently utilize the correlations between Y and UV components, which can further preserve the information of UV by the guidance of Y. Furthermore, we design an adaptive cross-channel enhancement module (ACEM) to reconstruct the details by utilizing the relations from different components, which makes use of the reconstructed Y as the textural and structural guidance for UV components. Extensive experiments show that the proposed framework can achieve the state-of-the-art performance in image compression for YUV420 format. More importantly, the proposed framework outperforms Versatile Video Coding (VVC) with 8.37% BD-rate reduction on common test conditions (CTC) sequences on average. In addition, we propose a quantization scheme for context model without model retraining, which can overcome the cross-platform decoding error caused by the floating-point operations in context model and provide a reference approach for the application of neural codec on different platforms.
Keywords:
Image coding
Context modeling
Transforms
Decoding
Standards
Image reconstruction
Transform coding
Image compression
cross-component
information-guided unit
attention mechanism
information-preserving

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

S
shanghai jiao tong university
Scholars:
15.6W
Papers: 11.6W
Citations: 159
I
institute of computing technology, cas
Scholars:
1.0K
Papers: 877
Citations: 1
P
peking university
Scholars:
11.8W
Papers: 8.7W
Citations: 146
C
chinese academy of sciences
Scholars:
56.5W
Papers: 44.9W
Citations: 704
researcher View more organizations