arrow
返回

Similarity-based face image retrieval using sparsely embedded deep features and binary code learning

delete2024-07-08
delete0
PRE
AI
A
Abdessamad Elboushaki *
R
Rachida Hannane
K
Karim Afdel
DOI:10.1007/s13735-024-00337-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Human face retrieval has long been established as one of the most interesting research topics in computer vision. With the recent development of deep learning, many researchers have addressed this problem by building deep hashing models to learn binary code from face images, while performing face retrieval as a classification task. Nevertheless, the performance is still unsatisfactory since these models are incapable of handling inter-class variation between multiple persons, as we need to make a class label for each identity. In this backdrop, we propose in this paper an effective deep learning-based framework for face image retrieval. The key to our framework is mainly based on the matching of face pairs, where a two-stream network, named chi Net+chi Match\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\chi Net+\chi Match$$\end{document}, is designed to learn similarities in terms of person identity. Such similarities are investigated by embedding both deep local representation via face components, and deep global face representation via the whole face image. Since the similarities captured over face components are supposed to diversify due to variation in pose, expression and occlusion, we also introduce a Sparse Score Fusion layer that learns automatically the weight of each component according to its contribution to face matching. To allow fast retrieval, we farther propose a method that generates binary codes corresponding to the groups of similar faces through the hierarchical k-means, where the path down binary tree is exploited as a binary code for indexing. The final retrieval is then conducted within a privileged subset of images in the database. Our experiments on different challenging datasets show that our approach obtains outstanding results while outperforming most existing methods.
Keyword:
Face image retrieval
Face matching
Deep face representation
Sparse score fusion
Binary code learning

期刊

International Journal of Multimedia Information Retrieval 封面图
International Journal of Multimedia Information Retrieval
IF:
2.9
论文数:
279
被引数:
866

机构

C
Cadi Ayyad University of Marrakech
学者数:
4.3K
论文数: 3.2K
被引数: 1
引用论文

引用论文

err分享
err收藏
err分享
err收藏
err分享
err收藏
Heterogeneous Hashing Network for Face Retrieval Across Image and Video Domains
err2019-03-01
err24
PREAI
errJing, Chenchen; Dong, Zhen; Pei, Mingtao; Jia, Yunde
err分享
err收藏
A 183 GHz Metamorphic HEMT Low-Noise Amplifier With 3.5 dB Noise Figure
err2015-09-01
err0
errOAAI
errGiuseppe Moschetti; Arnulf Leuther; Herman Massler; Beatriz Aja; Markus Rosch; Michael Schlechtweg; Oliver Ambacher; Ville Kangas; Marie Genevieve-Perichaud
err分享
err收藏
Association between Epstein-Barr virus serological reactivation and psychological distress: a cross-sectional study of Japanese community-dwelling older adults
err2022-10-21
err0
errOAAI
errHirotomo Yamanashi; Shogo Akabame; Jun Miyata; Yukiko Honda; Fumiaki Nonaka; Yuji Shimizu; Seiko Nakamichi; Shin-Ya Kawashiri; Mami Tamai; Kazuhiko Arima; Atsushi Kawakami; Kiyoshi Aoyagi; Takahiro Maeda
err分享
err收藏
学者 查看更多内容