arrow
返回

Test-time Forgery Detection with Spatial-Frequency Prompt Learning

delete2024-08-13
delete0
PRE
AI
J
Junxian Duan
Y
Yuang Ai
J
Jipeng Liu
S
Shenyuan Huang
黄
黄怀波 (Huaibo Huang)
J
Jie Cao
赫然 封面图
赫然 (Ran He) *
DOI:10.1007/s11263-024-02208-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The significance of face forgery detection has grown substantially due to the emergence of facial manipulation technologies. Recent methods have turned to face detection forgery in the spatial-frequency domain, resulting in improved overall performance. Nonetheless, these methods are still not guaranteed to cover various forgery technologies, and the networks trained on public datasets struggle to accurately quantify their uncertainty levels. In this work, we design a Dynamic Dual-spectrum Interaction Network that allows test-time training with uncertainty guidance and spatial-frequency prompt learning. RGB and frequency features are first interacted in multi-level by using a Frequency-guided Attention Module. Then these multi-modal features are merged with a Dynamic Fusion Module. As a bias in the fusion weight of uncertain data during dynamic fusion, we further exploit uncertain perturbation as guidance during the test-time training phase. Furthermore, we propose a spatial-frequency prompt learning method to effectively enhance the generalization of the forgery detection model. Finally, we curate a novel, extensive dataset containing images synthesized by various diffusion and non-diffusion methods. Comprehensive evaluations of experiments show that our method achieves more appealing results for face forgery detection than recent state-of-the-art methods.
Keyword:
Face forgery detection
Spatial-frequency prompt learning
Test-time training
Generalization
Diffusion model

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

I
institute of automation, cas
学者数:
2.2K
论文数: 2.1K
被引数: 2
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Gesture Recognition in Patients with Aphasia
err1982-02-01
err0
PREAI
errJoanne Kelsch Daniloff; J. Douglas Noll; Macalyne Fristoe; Lyle L. Lloyd
err分享
err收藏
The prevalence and consequences of obesity in athletes
err2016-03-01
err0
PREAI
errJordyn Ramsey Griffin; Tanya M. Maxwell; Letha Griffin
err分享
err收藏
Cascaded Split-and-Aggregate Learning with Feature Recombination for Pedestrian Attribute Recognition
err2021-07-18
err16
errOAAI
errYang, Yang; Tan, Zichang; Tiwari, Prayag; Pandey, Hari Mohan; Wan, Jun; Lei, Zhen; Guo, Guodong; Li, Stan Z.
err分享
err收藏
OASIS: Only Adversarial Supervision for Semantic Image Synthesis
err2022-09-17
err18
errOAAI
errSushko, Vadim; Schoenfeld, Edgar; Zhang, Dan; Gall, Juergen; Schiele, Bernt; Khoreva, Anna
err分享
err收藏
Elements of Quaternions四元数的元素
err
IF0
err2015-07-05
err0
PREAI
errWilliam Rowan Hamilton
err分享
err收藏
学者 查看更多内容