.png){kind=icon}
返回
Saliency Segmentation Oriented Deep Image Compression With Novel Bit Allocation
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2024.3504282.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Image compression distortion can cause performance degradation of machine analysis tasks, therefore recent years have witnessed fast progress in developing deep image compression methods optimized for machine perception. However, the investigation still lacks for saliency segmentation. First, in this paper we propose a deep compression network increasing local signal fidelity of important image pixels for saliency segmentation, which is different from existing methods utilizing the analysis network loss for backward propagation. By this means, these two types of networks can be decoupled to improve the compatibility of proposed compression method for diverse saliency segmentation networks. Second, pixel-level bit weights are modeled with probability distribution in the proposed bit allocation method. The ascending cosine roll-down (ACRD) function allocates bits to those important pixels, which fits the essence that saliency segmentation can be regarded as the pixel-level bi-classification task. Third, the compression network is trained without the help of saliency segmentation, where latent representations are decomposed into base and enhancement channels. Base channels are retained in the whole image, while enhancement channels are utilized only for important pixels, and therefore more bits can benefit saliency segmentation via enhancement channels. Extensive experimental results demonstrate that the proposed method can save an average of 10.34% bitrate compared with the state-of-the-art deep image compression method, where the rate-accuracy (R-A) performances are evaluated on sixteen downstream saliency segmentation networks with five conventional SOD datasets. The code will be available at: https://openi.pcl.ac.cn/OpenAICoding/SaliencyIC and https://github.com/AkeLiLi/SaliencyIC.
Keyword:
Image coding
Image segmentation
Bit rate
Object segmentation
Distortion
Image reconstruction
Entropy
Training
Semantics
Degradation
Deep image compression
saliency segmentation
novel bit allocation
pixel-level image fidelity enhancement
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
LID, LEED, and Alternative Rating Systems—Integrating Low Impact Development Techniques with Green Building DesignLID，LEED和替代评级系统-将低影响开发技术与绿色建筑设计相结合
PREAI
分享收藏分享收藏U2-Net: Going deeper with nested U-structure for salient object detectionU2-Net: 基于嵌套U结构的显著性目标检测.png)
PATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏
查看更多内容