arrow
Return

Exploiting sublimated deep features for image retrieval

delete2024-03-01
delete7
PRE
AI
刘
刘广海 (Guanghai Liu) *
李佐勇 cover
李佐勇 (Zuoyong Li)
杨敬钰 cover
杨敬钰 (Jingyu Yang)
章典 cover
章典 (David Zhang)
DOI:10.1016/j.patcog.2023.110076delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep learning techniques can be used to describe image content, which is a good way to reduce the semantic gap between low-level and high-level features. However, convolutional neural networks (CNNs) exhibit texture bias and largely ignore global object shape. This does not conform to human perception and can fail to gain the advantages of both low-level features and deep features. To address this problem, in this work, the main focus was shifted from using simple deep features to the use of sublimated deep features, which incorporate global object shape and color features. Along these lines, in this work, a novel image retrieval method named the sublimated deep feature histogram (SDFH) was proposed. The main highlights are: 1) An effect orientation feature was introduced, namely, orientation-selective feature, to mimic the orientation-selection mechanism. This provides a good representation of global object shape and reduces the side-effects of texture bias. 2) A new concept was developed, namely color perceptual feature, to address the shortcoming of deep features-that they discard color features. This includes color cues in the deep features and provides a more discriminating representation. 3) The orientation selective and color perception mechanisms were effectively mimicked to provide a compact yet efficient representation, and propose an effective transfer learning method called gain whitening learning. By carrying out comparative experiments, it was demonstrated that sublimated deep features can provide highly competitive retrieval performance (in terms of mean average precision) using a pre-trained CNN model applied to well-known benchmark datasets. Our results provide new insights into image retrieval based on the mechanisms of the primary visual cortex (V1). Furthermore, the method is more in line with human perception than other methods.
Keywords:
Image retrieval
Deep feature
Orientation-selective mechanism
Sublimated deep feature histogram
Gain whitening learning

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

M
Minjiang University
Scholars:
1.9K
Papers: 1.9K
Citations: 3.1K
G
Guangxi Normal University
Scholars:
7.7K
Papers: 4.9K
Citations: 5.1K
T
The Chinese University of Hong Kong, Shenzhen
Scholars:
4.3K
Papers: 4.0K
Citations: 7
researcher View more organizations
Cited Papers

Cited Papers

Multichannel Decoded Local Binary Patterns for Content-Based Image Retrieval
err2016-09-01
err148
PREAI
errDubey, Shiv Ram; Singh, Satish Kumar; Singh, Rajat Kumar
errShare
errSave
errShare
errSave
Content-based image retrieval using computational visual attention model
err2015-08-01
err196
PREAI
errLiu, Guang-Hai; Yang, Jing-Yu; Li, ZuoYong
errShare
errSave
Nanocrystalline silicon films as multifunctional material for optoelectronic and photovoltaic applications
err2006-10-01
err0
PREAI
errS. Pizzini; M. Acciarri; S. Binetti; D. Cavalcoli; A. Cavallini; D. Chrastina; L. Colombo; E. Grilli; G. Isella; M. Lancin; A. Le Donne; A. Mattoni; K. Peter; B. Pichaud; E. Poliani; M. Rossi; S. Sanguinetti; M. Texier; H. von Känel
errShare
errSave
Mesothelioma in blood related subjects: Report of 11 clusters among 1954 Italy cases and review of the literature
err2007-04-03
err0
PREAI
errValeria Ascoli; Domenica Cavone; Enzo Merler; Pietro Gino Barbieri; Luciano Romeo; Francesco Nardi; Marina Musti
errShare
errSave
Image retrieval based on the texton co-occurrence matrix
err2008-12-01
err145
PREAI
errLiu, Guang-Hai; Yang, Jing-Yu
errShare
errSave
errShare
errSave
researcher View more