arrow
Return

Image Retrieval Using Multilayer Feature Aggregation Histogram

delete2024-08-27
delete1
PRE
AI
F
Fen Lu
刘
刘广海 (Guanghai Liu) *
X
Xiao‐Zhi Gao
DOI:10.1007/s12559-024-10334-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Aggregating the diverse features into a compact representation is a hot issue in image retrieval. However, aggregating the differential feature of multilayer into a discriminative representation remains challenging. Inspired by the value-guided neural mechanisms, a novel representation method, namely, the multilayer feature aggregation histogram was proposed to image retrieval. It can aggregate multilayer features, such as low-, mid-, and high-layer features, into a discriminative yet compact representation via simulating the neural mechanisms that mediate the ability to make value-guided decisions. The highlights of the proposed method have the following: (1) A detail-attentive map was proposed to represent the aggregation of low- and mid-layer features. It can be well used to evaluate the distinguishable detail feature. (2) A simple yet straightforward aggregation method is proposed to re-evaluate the distinguishable high-layer feature. It can provide aggregated features including detail, object, and semantic by using semantic-attentive map. (3) A novel whitening method, namely difference whitening, is introduced to reduce dimensionality. It did not need to seek a training dataset of semantical similarity and can provide a compact yet discriminative representation. Experiments on the popular benchmark datasets demonstrate the proposed method can obviously increase retrieval performance in terms of mAP metric. The proposed method using 128-dimensionality representation can provide significantly higher mAPs than the DSFH, DWDF, and OSAH methods by 0.083, 0.043, and 0.022 on the Oxford5k dataset and by 0.195, 0.036, and 0.071 on the Paris6k dataset. The difference whitening method can conveniently transfer the deep learning model to a new task. Our method provided competitive performance compared with the existing aggregation methods and can retrieve scene images with similar colors, objects, and semantics.
Keywords:
Image retrieval
Deep feature
Difference whitening
Value-guided neural mechanisms
Multilayer feature aggregation histogram

Journal

Cognitive Computation cover
Cognitive Computation
IF:
4.3
Papers:
1.6K
Citations:
3.6K

Organization

G
Guangxi Normal University
Scholars:
7.7K
Papers: 4.9K
Citations: 5.1K
U
University of Eastern Finland
Scholars:
1.4W
Papers: 1.2W
Citations: 1.5W
Cited Papers

Cited Papers

CLINICAL APPROACH TO DIAGNOSIS OF SYNCOPE
err1997-05-01
err0
PREAI
errDavid G. Benditt; Keith G. Lurie; William H. Fabian
errShare
errSave
Co-occurrence of deep convolutional features for image search
err2020-05-01
err16
errOAAI
errForcen, J., I; Pagola, Miguel; Barrenechea, Edurne; Bustince, Humberto
errShare
errSave
Exploiting sublimated deep features for image retrieval
err2024-03-01
err7
PREAI
errLiu, Guang-Hai; Li, Zuo-Yong; Yang, Jing-Yu; Zhang, David
errShare
errSave
Hierarchical Representation for Chromatic Processing across Macaque V1, V2, and V4
errNEURON
IF15
err2020-11-01
err40
errOAAI
errLiu, Ye; Li, Ming; Zhang, Xian; Lu, Yiliang; Gong, Hongliang; Yin, Jiapeng; Chen, Zheyuan; Qian, Liling; Yang, Yupeng; Andolina, Ian Max; Shipp, Stewart; Mcloughlin, Niall; Tang, Shiming; Wang, Wei
errShare
errSave
Neural mechanisms underlying the hierarchical construction of perceived aesthetic value
err2023-01-24
err13
errOAAI
errIigaya, Kiyohito; Yi, Sanghyun; Wahle, Iman A.; Tanwisuth, Sandy; Cross, Logan; O'Doherty, John P.
errShare
errSave
errShare
errSave
researcher View more