arrow
返回

Online Product Quantization

delete2018-01-01
delete19
delete
OA
AI
D
Donna Xu *
I
Ivor W. Tsang
张颖 封面图
张颖 (Ying Zhang)
DOI:10.1109/TKDE.2018.2817526delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Approximate nearest neighbor (ANN) search has achieved great success in many tasks. However, existing popular methods for ANN search, such as hashing and quantization methods, are designed for static databases only. They cannot handle well the database with data distribution evolving dynamically, due to the high computational effort for retraining the model based on the new database. In this paper, we address the problem by developing an online product quantization (online PQ) model and incrementally updating the quantization codebook that accommodates to the incoming streaming data. Moreover, to further alleviate the issue of large scale computation for the online PQ update, we design two budget constraints for the model to update partial PQ codebook instead of all. We derive a loss bound which guarantees the performance of our online PQ model. Furthermore, we develop an online PQ model over a sliding window with both data insertion and deletion supported, to reflect the real-time behavior of the data. The experiments demonstrate that our online PQ model is both time-efficient and effective for ANN search in dynamic large scale databases compared with baseline methods and the idea of partial PQ codebook update further reduces the update cost.
Keyword:
Online indexing model
product quantization
nearest neighbour search
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
引用论文

引用论文

err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Host Resources MIB
err
IF0
err2000-03-01
err0
PREAI
errS. Waldbusser; P. Grillo
err分享
err收藏
Ingestion of corrosive acids
err1989-09-01
err0
PREAI
errShowkat Ali Zargar; Rakesh Kochhar; Birender Nagi; Saroj Mehta; Satish Kumar Mehta
err分享
err收藏
Distributed Adaptive Binary Quantization for Fast Nearest Neighbor Search
err2017-11-01
err64
PREAI
errLiu, Xianglong; Li, Zhujin; Deng, Cheng; Tao, Dacheng
err分享
err收藏
Structure Sensitive Hashing With Adaptive Product Quantization
err2016-10-01
err58
PREAI
errLiu, Xianglong; Du, Bowen; Deng, Cheng; Liu, Ming; Lang, Bo
err分享
err收藏
Distributive impacts of demand-based modelling
err2011-05-01
err0
PREAI
errKarel Martens; Eyal Hurvitz
err分享
err收藏
Effects of various medium formulations and attachment substrata on the performance of cultured ruminant hepatocytes in biotransformation studies
err2008-09-22
err0
PREAI
errG. A. E. Van ‘t Klooster; F. M. A. Woutersen-Van Nijnanten; W. R. Klein; B. J. Blaauboer; J. Noordhoek; A. S. J. P. A. M. Van Miert
err分享
err收藏
学者 查看更多内容