arrow
Return

Entropy Optimized Deep Feature Compression

delete2021-01-01
delete10
PRE
AI
B
Benben Niu
X
Xiaoran Cao *
Z
Ziwei Wei
Y
Yun He
DOI:10.1109/LSP.2021.3052097delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This letter focuses on the compression of deep features. With the rapid expansion of deep feature data in various CNN-based analysis and processing tasks, the demand for efficient compression continues to increase. Product quantization (PQ) is widely used in the compact expression of features. In the quantization process, feature vectors are mapped into fixed-length codes based on a pre-trained codebook. However, PQ is not specifically designed for data compression, and the fixed-length codes are not suitable for further compression such as entropy coding. In this letter, we propose an entropy-optimized compression scheme for deep features. By introducing entropy into the loss function in the training process of quantization, the quantization and entropy coding modules are jointly optimized to minimize the total coding cost. We evaluate the proposed methods in retrieval tasks. Compared with fixed-length coding, the proposed scheme can be generally combined with PQ and its extended method and can achieve a better compression performance consistently.
Keywords:
Quantization (signal)
Indexes
Entropy coding
Task analysis
Entropy
Measurement
Signal processing algorithms
Entropy coding
feature vector
joint optimization
product quantization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

T
tsinghua university
Scholars:
11.8W
Papers: 10.0W
Citations: 137