arrow
Return

FACES: Facial Analysis with Compressed Efficient Systems

delete2026-02-26
delete0
delete
OA
AI
R
Romanela Lajić *
P
Peter Peer
V
Vitomir Štruc
D
Dong Seog Han
B
Blaž Meden
Ž
Žiga Emeršič
DOI:10.1016/j.icte.2026.02.008delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Due to their promising performance vision transformers are increasingly being incorporated into various biometric solutions, mainly in the domain of face analysis. However, their size and computational expense remain the biggest challenge when it comes to their full utilization and there is a high demand for optimization of these models. In this paper we propose a novel pruning technique for face analysis vision transformers aimed at reducing their memory and computational cost. The method uses existing transformer parameters as importance scores, which allows for a simple one-shot pruning and retraining approach. By testing the method on the SWINFace transformer for both verification and attribute recognition tasks, we show that the models compressed up to 50% sparsity level maintain the performance or even outperform the original model, while also outperforming state-of-the-art vision transformer pruning methods and showing versatility for different face analysis tasks.
Keywords:
Face analysis
Neural network compression
Pruning
Vision transformers
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ICT Express cover
ICT Express
IF:
4.2
Papers:
990
Citations:
2.5K

Organization

U
University of Ljubljana
Scholars:
1.5W
Papers: 1.3W
Citations: 1.7W
K
Kyungpook National University
Scholars:
3.1K
Papers: 1.4K
Citations: 1.7W