arrow
Return

Joint Metric Learning-Based Class-Specific Representation for Image Set Classification

delete2024-05-01
delete22
PRE
AI
X
Xizhan Gao
S
Sijie Niu *
W
Wei Dong
X
Xingrui Liu
T
Tingwei Wang
F
Fa Zhu
J
Jiwen Dong
孙权森 (Quansen Sun)
DOI:10.1109/TNNLS.2022.3212703delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the rapid advances in digital imaging and communication technologies, recently image set classification has attracted significant attention and has been widely used in many real-world scenarios. As an effective technology, the class-specific representation theory-based methods have demonstrated their superior performances. However, this type of methods either only uses one gallery set to measure the gallery-to-probe set distance or ignores the inner connection between different metrics, leading to the learned distance metric lacking robustness, and is sensitive to the size of image sets. In this article, we propose a novel joint metric learning-based class-specific representation framework (JMLC), which can jointly learn the related and unrelated metrics. By iteratively modeling probe set and related or unrelated gallery sets as affine hull, we reconstruct this hull sparsely or collaboratively over another image set. With the obtained representation coefficients, the combined metric between the query set and the gallery set can then be calculated. In addition, we also derive the kernel extension of JMLC and propose two new unrelated set constituting strategies. Specifically, kernelized JMLC (KJMLC) embeds the gallery sets and probe sets into the high-dimensional Hilbert space, and in the kernel space, the data become approximately linear separable. Extensive experiments on seven benchmark databases show the superiority of the proposed methods to the state-of-the-art image set classifiers.
Keywords:
Measurement
Kernel
Probes
Image reconstruction
Feature extraction
Computational modeling
Data models
Image set classification
joint metric learning
kernel trick
spares or collaborative representation
unrelated set

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

U
University of Jinan
Scholars:
1.6W
Papers: 1.1W
Citations: 1.4W
N
Nanjing Forestry University
Scholars:
2.0W
Papers: 1.6W
Citations: 3.2W