1
Return

Zero-Shot Face Authentication in Multi-User Scenarios Using mmWave Signals

delete2026-05-29
delete0
PRE
AI
J
Junlin Yang
俞嘉地 (Jiadi Yu)
H
Hao Kong
Y
Yuxin Zhu
DOI:10.1109/tmc.2026.3698153delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Face authentication has become an increasingly attractive and prevalent technology in human-computer interaction. Recent works have explored radio frequency (RF) signals for illumination-robust and privacy-preserving face authentication. However, these approaches require all users to undergo compulsory prior registration and cannot effectively handle unregistered users, which restricts their practical applicability in real-world scenarios. In this paper, we present a <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">mm</u>Wave-based <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">m</u>ulti-user face authentication system, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">m<sup>3</sup>FacePass</i>, which performs zero-shot face authentication in complex multi-user scenarios using a commercial off-the-shelf (COTS) mmWave radar. First, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">m<sup>3</sup>FacePass</i> collects mmWave signals and reconstructs spatial mappings by generating 3D heatmaps. Based on the 3D heatmaps, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">m<sup>3</sup>FacePass</i> detects and separates faces in multi-user scenarios through template matching. Then, unique facial features are extracted and transformed to a hypersphere manifold, which reserves feature space for unregistered users. By introducing dummy classifiers in the authentication model, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">m<sup>3</sup>FacePass</i> optimizes decision boundaries between registered and unregistered users. Furthermore, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">m<sup>3</sup>FacePass</i> enhances its generalization ability for zero-shot authentication by incorporating pseudo unknowns during model training. Extensive experiments in real-world environments demonstrate that <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">m<sup>3</sup>FacePass</i> achieves an authentication accuracy of 96.6% for registered users and 91.1% for unregistered users in multi-user scenarios.
Keywords:
MmWave signals
face authentication
multi-user scenarios
zero-shot learning
wireless sensing

Journal

IEEE Transactions on Mobile Computing cover
IEEE Transactions on Mobile Computing
IF:
9.2
Papers:
5.6K
Citations:
1.8W

Organization

S
shanghai jiao tong university
Scholars:
15.1W
Papers: 11.5W
Citations: 159
S
shanghai university
Scholars:
3.8W
Papers: 2.7W
Citations: 52
Cited Papers

Cited Papers

Citing Papers

Citing Papers