.png){kind=icon}
返回
Deep Multiple Instance Hashing for Fast Multi-Object Image Search
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2021.3112011.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multi-keyword query is widely supported in text search engines. However, an analogue in image retrieval systems, multi-object query, is rarely studied. Meanwhile, traditional object-based image retrieval methods often involve multiple steps separately. In this work, we propose a weakly-supervised Deep Multiple Instance Hashing (DMIH) approach for multi-object image retrieval. Our DMIH approach, which leverages a popular CNN model to build the end-to-end relation between a raw image and the binary hash codes of its multiple objects, can support multi-object queries effectively and integrate object detection with hashing learning seamlessly. We treat object detection as a binary multiple instance learning (MIL) problem and such instances are automatically extracted from multi-scale convolutional feature maps. We also design a conditional random field (CRF) module to capture both the semantic and spatial relations among different class labels. For hashing training, we sample image pairs to learn their semantic relationships in terms of hash codes of the most probable proposals for owned labels as guided by object predictors. The two objectives benefit each other in a multi-task learning scheme. Finally, a two-level inverted index method is proposed to further speed up the retrieval of multi-object queries. Our DMIH approach outperforms state-of-the-arts on public benchmarks for object-based image retrieval and achieves promising results for multi-object queries.
Keyword:
Training
Image retrieval
Semantics
Supervised learning
Object detection
Benchmark testing
Search engines
Hashing learning
multiple instance learning
indexing
image retrieval
conditional random field
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
.png){kind=icon}
分享收藏Dynamic Changes in Myofibroblasts Affect the Carcinogenesis and Prognosis of Bladder Cancer Associated With Tumor Microenvironment Remodeling肌成纤维细胞的动态变化与肿瘤微环境重塑对膀胱癌发生及预后的影响
OAAI
OAAI分享收藏分享收藏
查看更多内容