arrow
Return

Video-based face outline recognition

delete2024-08-01
delete1
PRE
AI
X
Xingbo Dong
J
Jiewen Yang
A
Andrew Beng Jin Teoh *
D
Dahai Yu
李晓孟 cover
李晓孟 (Xiaomeng Li)
Z
Zhe Jin
DOI:10.1016/j.patcog.2024.110482delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a novel approach for individual recognition that uses the motion traits from face outlineanonymised videos as the id entity signatures; we call this type of signature a Temporal-iD . To extract a robust Temporal-iD, a highly lightweight transformer-based model, namely the Temporal-iD-ViT ( TiDViT ), is devised to capture and aggregate Temporal-iD features from videos. The TiDViT is equipped with a custom-designed multi-head temporal-spatial joint attention module that establishes interaction between the current frame input and the previous hidden state, thereby temporally aggregating the temporal features. The TiDViT processes the face video frame by frame instead of in a fixed batch-wise manner, which requires less computational memory. Moreover, the TiDViT can extract the temporal features of unconstrained face videos and considers ethical and privacy concerns. Extensive experimental results show that the proposed TiDViT model achieves a decent performance on this highly challenging task.
Keywords:
Face outline motion recognition
Video recognition
Recurrent transformer
Behavioural biometric
Soft biometric

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

Y
Yonsei University
Scholars:
4.8W
Papers: 4.6W
Citations: 5.2W
A
anhui university
Scholars:
1.9W
Papers: 1.2W
Citations: 24
Cited Papers

Cited Papers

Client ahead‐of‐time compiler for embedded Java platforms
err2008-08-05
err0
PREAI
errSunghyun Hong; Jin‐Chul Kim; Soo‐Mook Moon; Jin Woo Shin; Jaemok Lee; Hyeong‐Seok Oh; Hyung‐Kyu Choi
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
errShare
errSave
Dynamic Texture Comparison Using Derivative Sparse Representation: Application to Video-Based Face Recognition
err2017-12-01
err20
PREAI
errHajati, Farshid; Tavakolian, Mohammad; Gheisari, Soheila; Gao, Yongsheng; Mian, Ajmal S.
errShare
errSave
Incremental Learning from Low-lab elle d Stream Data in Open-Set Video Face Recognition
err2022-11-01
err9
errOAAI
errLopez-Lopez, Eric; Pardo, Xose M.; V. Regueiro, Carlos
errShare
errSave
errShare
errSave
Deep face recognition: A survey
err2021-03-01
err441
errOAAI
errWang, Mei; Deng, Weihong
errShare
errSave
researcher View more