arrow
Return

Grassmannian learning mutual subspace method for image set recognition

delete2023-01-01
delete6
delete
OA
AI
L
Lincon S. Souza *
N
Naoya Sogi
B
Bernardo B. Gatto
T
Takumi Kobayashi
K
Kazuhiro Fukui
DOI:10.1016/j.neucom.2022.10.040delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This paper addresses the problem of object recognition given a set of images as input (e.g., multiple cam-era sources and video frames). Convolutional neural network (CNN)-based frameworks do not exploit these sets effectively, processing a pattern as observed, not capturing the underlying feature distribution as it does not consider the variance of images in the set. To address this issue, we propose the Grassmannian learning mutual subspace method (G-LMSM), a NN layer embedded on top of CNNs that can process image sets more effectively and can be trained in an end-to-end manner. The image set is first represented by a low-dimensional input subspace and then this input subspace is matched with dic-tionary subspaces by a similarity of their canonical angles, an interpretable and easy to compute metric. The key idea of G-LMSM is that the dictionary subspaces are learned as points on the Grassmann man-ifold, optimized with Riemannian stochastic gradient descent. This learning is stable, efficient and theo-retically well-grounded. We demonstrate the effectiveness of our proposed method on hand shape recognition, face identification, and facial emotion recognition.(c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Grassmannian learning mutual subspace
method
Learning subspace methods
Subspace learning
Image recognition
Deep neural networks
Manifold optimization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

U
University of Tsukuba
Scholars:
1.8W
Papers: 1.5W
Citations: 1.7W