arrow
Return

Adaptive bit allocation product quantization

delete2016-01-01
delete6
PRE
AI
Q
Qin-Zhen Guo *
Z
Zhi Zeng
S
Shuwu Zhang
G
Guixuan Zhang
Y
Yuan Zhang
DOI:10.1016/j.neucom.2015.07.062delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Product quantization (PQ) is a popular vector quantization method for approximate nearest neighbor search. The key idea of PQ is to decompose the original data space into the Cartesian product of some low-dimensional subspaces and then every subspace is quantized separately with the same number of codewords. However, the performance of PQ depends largely on the distribution of the original data. If the energies of subspaces are extremely unbalanced, PQ will achieve bad results. In this paper, we propose an adaptive bit allocation product quantization (BAPQ) method to deal with the problem of unbalanced energies of subspaces in PQ. In BAPQ we adaptively allocate different numbers of codewords (or bits) to subspaces to quantize data for minimizing the total quantization distortion. The essence of our method is to find the optimal bit allocation scheme. To this end, we formulate an objective function about minimizing quantization distortion with respect to bit allocation scheme and adopt a greedy algorithm to find the near-optimal solution. BAPQ can achieve lower quantization distortion than PQ and optimized product quantization (OPQ). Besides, both bias and variance of difference between the true distance and the BAPQs estimated distance are reduced from those of PQ and OPQ Extensive experiments have verified the superiority of BAPQ over state-of-the-art approaches. (C) 2015 Elsevier B.V. All rights reserved.
Keywords:
Vector quantization
Product quantization
Adaptive bit allocation
Approximate nearest neighbor search
Image retrieval
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

I
institute of automation, cas
Scholars:
2.2K
Papers: 2.1K
Citations: 2
C
chinese academy of sciences
Scholars:
56.3W
Papers: 44.8W
Citations: 704