.png){kind=icon}
Return
Frame-Level Temporal Difference Learning for Partial Deepfake Speech Detection
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2025.3592111.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Detecting partial deepfake speech is essential due to its potential for subtle misinformation. However, existing methods depend on costly frame-level annotations during training, limiting real-world scalability. Also, they focus on detecting transition artifacts between bonafide and deepfake segments. As deepfake generation techniques increasingly smooth these transitions, detection has become more challenging. To address this, our work introduces a new perspective by analyzing frame-level temporal differences and reveals that deepfake speech exhibits erratic directional changes and unnatural local transitions compared to bonafide speech. Based on this finding, we propose a Temporal Difference Attention Module (TDAM) that redefines partial deepfake detection as identifying unnatural temporal variations, without relying on explicit boundary annotations. A dual-level hierarchical difference representation captures temporal irregularities at both fine and coarse scales, while adaptive average pooling preserves essential patterns across variable-length inputs to minimize information loss. Our TDAM-AvgPool model achieves state-of-the-art performance, with an EER of 0.59% on the PartialSpoof dataset and 0.03% on the HAD dataset, which significantly outperforms the existing methods without requiring frame-level supervision.
Keywords:
Deepfake speech detection
partial speech deepfake
anti-spoofing
Journal
IF:
9.6
Papers:
1.1W
Citations:
1.7W
Organization
Cited Papers
Coarse-to-Fine Proposal Refinement Framework for Audio Temporal Forgery Detection and Localization
PREAI
ShareSaveLocal Self-attention-based Hybrid Multiple Instance Learning for Partial Spoof Speech Detection
PREAI
ShareSave
Fake Audio Detection Based On Unsupervised Pretraining Models.png)
ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)IF0
PREAI
ShareSaveShareSaveShareSave
View more