arrow
返回

Exploiting sublimated deep features for image retrieval

delete2024-03-01
delete7
PRE
AI
刘
刘广海 (Guanghai Liu) *
李佐勇 封面图
李佐勇 (Zuoyong Li)
杨敬钰 封面图
杨敬钰 (Jingyu Yang)
章典 封面图
章典 (David Zhang)
DOI:10.1016/j.patcog.2023.110076delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning techniques can be used to describe image content, which is a good way to reduce the semantic gap between low-level and high-level features. However, convolutional neural networks (CNNs) exhibit texture bias and largely ignore global object shape. This does not conform to human perception and can fail to gain the advantages of both low-level features and deep features. To address this problem, in this work, the main focus was shifted from using simple deep features to the use of sublimated deep features, which incorporate global object shape and color features. Along these lines, in this work, a novel image retrieval method named the sublimated deep feature histogram (SDFH) was proposed. The main highlights are: 1) An effect orientation feature was introduced, namely, orientation-selective feature, to mimic the orientation-selection mechanism. This provides a good representation of global object shape and reduces the side-effects of texture bias. 2) A new concept was developed, namely color perceptual feature, to address the shortcoming of deep features-that they discard color features. This includes color cues in the deep features and provides a more discriminating representation. 3) The orientation selective and color perception mechanisms were effectively mimicked to provide a compact yet efficient representation, and propose an effective transfer learning method called gain whitening learning. By carrying out comparative experiments, it was demonstrated that sublimated deep features can provide highly competitive retrieval performance (in terms of mean average precision) using a pre-trained CNN model applied to well-known benchmark datasets. Our results provide new insights into image retrieval based on the mechanisms of the primary visual cortex (V1). Furthermore, the method is more in line with human perception than other methods.
Keyword:
Image retrieval
Deep feature
Orientation-selective mechanism
Sublimated deep feature histogram
Gain whitening learning

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

M
Minjiang University
学者数:
1.9K
论文数: 1.9K
被引数: 3.1K
G
Guangxi Normal University
学者数:
7.7K
论文数: 4.9K
被引数: 5.1K
T
The Chinese University of Hong Kong, Shenzhen
学者数:
4.3K
论文数: 4.0K
被引数: 7
学者 查看更多机构
引用论文

引用论文

Multichannel Decoded Local Binary Patterns for Content-Based Image Retrieval
err2016-09-01
err148
PREAI
errDubey, Shiv Ram; Singh, Satish Kumar; Singh, Rajat Kumar
err分享
err收藏
err分享
err收藏
Content-based image retrieval using computational visual attention model
err2015-08-01
err196
PREAI
errLiu, Guang-Hai; Yang, Jing-Yu; Li, ZuoYong
err分享
err收藏
Nanocrystalline silicon films as multifunctional material for optoelectronic and photovoltaic applications纳米硅薄膜作为光电和光伏应用的多功能材料
err2006-10-01
err0
PREAI
errS. Pizzini; M. Acciarri; S. Binetti; D. Cavalcoli; A. Cavallini; D. Chrastina; L. Colombo; E. Grilli; G. Isella; M. Lancin; A. Le Donne; A. Mattoni; K. Peter; B. Pichaud; E. Poliani; M. Rossi; S. Sanguinetti; M. Texier; H. von Känel
err分享
err收藏
Mesothelioma in blood related subjects: Report of 11 clusters among 1954 Italy cases and review of the literature
err2007-04-03
err0
PREAI
errValeria Ascoli; Domenica Cavone; Enzo Merler; Pietro Gino Barbieri; Luciano Romeo; Francesco Nardi; Marina Musti
err分享
err收藏
Image retrieval based on the texton co-occurrence matrix
err2008-12-01
err145
PREAI
errLiu, Guang-Hai; Yang, Jing-Yu
err分享
err收藏
err分享
err收藏
学者 查看更多内容