.png){kind=icon}
返回
Deep Convolutional Pooling Transformer for Deepfake Detection
.png){kind=icon}
OA
AI
DOI：10.1145/3588574.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recently, Deepfake has drawn considerable public attention due to security and privacy concerns in social media digital forensics. As the wildly spreading Deepfake videos on the Internet become more realistic, traditional detection techniques have failed in distinguishing between real and fake. Most existing deep learning methods mainly focus on local features and relations within the face image using convolutional neural networks as a backbone. However, local features and relations are insufficient for model training to learn enough general information for Deepfake detection. Therefore, the existing Deepfake detection methods have reached a bottleneck to further improve the detection performance. To address this issue, we propose a deep convolutional Transformer to incorporate the decisive image features both locally and globally. Specifically, we apply convolutional pooling and re-attention to enrich the extracted features and enhance efficacy. Moreover, we employ the barely discussed image keyframes in model training for performance improvement and visualize the feature quantity gap between the key and normal image frames caused by video compression. We finally illustrate the transferability with extensive experiments on several Deepfake benchmark datasets. The proposed solution consistently outperforms several state-of-the-art baselines on both within- and cross-dataset experiments.
Keyword:
Deepfake detection
image keyframes
transformer
期刊
IF:
6
论文数:
2.0K
被引数:
5.4K
机构
引用论文
An Efficient Framework for Compressed Domain Watermarking in P Frames of High-Efficiency Video Coding (HEVC)-Encoded Video高效视频编码 (HEVC) 编码视频的P帧压缩域水印的有效框架
PREAI
分享收藏分享收藏Deepfakes and beyond: A Survey of face manipulation and fake detectionDeepfakes and beyond: 面部操纵和虚假检测的调查.png)
INFORMATION FUSION
OAAI
INFORMATION FUSIONIF15.5
OAAI分享收藏Combating Deepfake Videos Using Blockchain and Smart Contracts使用区块链和智能合约打击Deepfake视频IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏Age-Effect on Intra-Annual δ13C-Variability within Scots Pine Tree-Rings from Central SiberiaForestsOAAI
ForestsIF0
OAAI分享收藏分享收藏
查看更多内容