arrow
Return

Data-Driven Lightweight Interest Point Selection for Large-Scale Visual Search

delete2018-10-01
delete6
PRE
AI
F
Feng Gao
X
Xinfeng Zhang
Y
Yi‐Cheng Huang
Y
Yong Luo
X
Xiaoming Li
L
Ling‐Yu Duan *
DOI:10.1109/TMM.2018.2818012delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the explosive increase of images and videos, visual analysis has become an essential technique in dealing with the big visual data, which utilizes the visual feature descriptors to search or recognize the images or frames with target objects or events. Subject to the constraints of resources (e.g., memory, bandwidth, storage, etc.), interest point selection is crucial to generate robust compact descriptors for high-efficiency visual analysis by selecting and aggregating the most discriminative local feature descriptors, which has been demonstrated in the state-of-the-art low bit rate visual search works. In this paper, we propose a data-driven lightweight interest point selection approach to significantly improve the performance of visual search, while ameliorating the efficiency of extracting feature descriptors. Comprehensive experimental results over benchmarks have shown that the proposed interest point selection algorithm has significantly improved image matching and retrieval performance in the completed MPEG Compact Descriptors for Visual Search (CDVS) standard as well as the emerging MPEG Compact Descriptors for Video Analytics (CDVA) standard, say 20% mAP gain by data-driven selection against random selection of interest points. In particular, the presented data-driven interest point selection has been adopted by MPEG-CDVS and MPEG-CDVA as a normative technique to improve the aggregation of handcrafted features, which has contributed to the combination of handcrafted features and deep learning (CNN) features as well.
Keywords:
Visual search
interest point selection
compact descriptors
regression
classification
feature selection
MPEG-CDVS
MPEG-CDVA
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

U
university of southern california
Scholars:
4.6W
Papers: 3.8W
Citations: 51
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
P
peking university
Scholars:
11.8W
Papers: 8.7W
Citations: 146
researcher View more organizations