arrow
Return

Optimized Cartesian K-Means

delete2015-01-01
delete54
delete
OA
AI
J
Jianfeng Wang *
J
Jingdong Wang
Jingkuan Song cover
Jingkuan Song (Jingkuan Song)
X
Xin-Shun Xu
申恒涛 cover
申恒涛 (Heng Tao Shen)
S
Shipeng Li
DOI:10.1109/TKDE.2014.2324592delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Product quantization-based approaches are effective to encode high-dimensional data points for approximate nearest neighbor search. The space is decomposed into a Cartesian product of low-dimensional subspaces, each of which generates a sub codebook. Data points are encoded as compact binary codes using these sub codebooks, and the distance between two data points can be approximated efficiently from their codes by the precomputed lookup tables. Traditionally, to encode a subvector of a data point in a subspace, only one sub codeword in the corresponding sub codebook is selected, which may impose strict restrictions on the search accuracy. In this paper, we propose a novel approach, named optimized cartesian K-means (ock-means), to better encode the data points for more accurate approximate nearest neighbor search. In ock-means, multiple sub codewords are used to encode the subvector of a data point in a subspace. Each sub codeword stems from different sub codebooks in each subspace, which are optimally generated with regards to the minimization of the distortion errors. The high-dimensional data point is then encoded as the concatenation of the indices of multiple sub codewords from all the subspaces. This can provide more flexibility and lower distortion errors than traditional methods. Experimental results on the standard real-life data sets demonstrate the superiority over state-of-the-art approaches for approximate nearest neighbor search.
Keywords:
Clustering
cartesian product
nearest neighbor search

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 74
M
Microsoft Research Asia
Scholars:
421
Papers: 407
Citations: 2
M
Microsoft
Scholars:
3.0K
Papers: 2.7K
Citations: 7
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Semantic hashing
err2009-07-01
err939
errOAAI
errSalakhutdinov, Ruslan; Hinton, Geoffrey
errShare
errSave
Induction of Suicidal Erythrocyte Death by Listeriolysin from <i>Listeria monocytogenes</i>
err2007-10-30
err0
errOAAI
errMichael Föller; Ekaterina Shumilina; Rebecca Lam; Walid Mohamed; Ravi Kasinathan; Stephan Huber; Trinad Chakraborty; Florian Lang
errShare
errSave
Characterization of biosensors based on membranes containing a conducting polymer
err1989-01-01
err0
PREAI
errM. Battilotti; C. Colapicchioni; I. Giannini; F. Porcelli; L. Campanella; M. Cordatore; F. Mazzei; M. Tomassetti
errShare
errSave
Gender Composition and Group Cohesion in U.S. Army Units: A Comparision across Five Studies
err1999-04-01
err0
PREAI
errLeora N. Rosen; Paul D. Bliese; Kathleen A. Wright; Robert K. Gifford
errShare
errSave
errShare
errSave
High-pulse repetition frequency ultrashort pulse laser processing of copper
err2015-02-26
err0
errOAAI
errJoerg Schille; Lutz Schneider; Peter Lickschat; Udo Loeschner; Robby Ebert; Horst Exner
errShare
errSave
Sparse Hashing for Fast Multimedia Search
err2013-05-17
err113
PREAI
errZhu, Xiaofeng; Huang, Zi; Cheng, Hong; Cui, Jiangtao; Shen, Heng Tao
errShare
errSave
no more