arrow
Return

Visual instance mining from the graph perspective

delete2017-02-04
delete0
PRE
AI
李伟 (Wei Li)
J
Jianmin Li
C
Changhu Wang *
张磊 cover
张磊 (Lei Zhang)
B
Bo Zhang
DOI:10.1007/s00530-016-0533-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we address the problem of visual instance mining, which is to automatically discover frequently appearing visual instances from a large collection of images. We propose a scalable mining method by leveraging the graph structure with images as vertices. Different from most existing approaches that focus on either instance-level similarities or image-level context properties, our method captures both information. In the proposed framework, the instance-level information is integrated during the construction of a sparse instance graph based on the similarity between augmented local features, while the image-level context is explored with a greedy breadth-first search algorithm to discover clusters of visual instances from the graph. This framework can tackle the challenges brought by small visual instances, diverse intra-class variations, as well as noise in large-scale image databases. To further improve the robustness, we integrate two techniques into the basic framework. First, to better cope with the increasing noise of large databases, weak geometric consistency is adopted to efficiently combine the geometric information of local matches into the construction of the instance graph. Second, we propose the layout embedding algorithm, which leverages the algorithm originally designed for graph visualization to fully explore the image database structure. The proposed method was evaluated on four annotated data sets with different characteristics, and experimental results showed the superiority over state-of-the-art algorithms on all data sets. We also applied our framework on a one-million Flickr data set and proved its scalability.
Keywords:
Visual instance mining
Instance graph
Local features
Weak geometric consistency
Layout embedding
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Multimedia Systems cover
Multimedia Systems
IF:
3.1
Papers:
2.7K
Citations:
2.7K

Organization

T
tsinghua university
Scholars:
11.8W
Papers: 10.0W
Citations: 137
M
Microsoft
Scholars:
3.0K
Papers: 2.7K
Citations: 7
M
microsoft china
Scholars:
129
Papers: 111
Citations: 0
researcher View more organizations