.png){kind=icon}
返回
Deepfake Detection Using Spatiotemporal Transformer
.png){kind=icon}
OA
AI
DOI：10.1145/3643030.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recent advances in generative models and the availability of large-scale benchmarks have made deepfake video generation and manipulation easier. Nowadays, the number of new hyper-realistic deepfake videos used for negative purposes is dramatically increasing, thus creating the need for effective deepfake detection methods. Although many existing deepfake detection approaches, particularly CNN-based methods, show promising results, they suffer from several drawbacks. In general, poor generalization results have been obtained under unseen/new deepfake generation methods. The crucial reason for the above defect is that CNN-based methods focus on the local spatial artifacts, which are unique for every manipulation method. Therefore, it is hard to learn the general forgery traces of different manipulation methods without considering the dependencies that extend beyond the local receptive field. To address this problem, this article proposes a framework that combines Convolutional Neural Network (CNN) with Vision Transformer (ViT) to improve detection accuracy and enhance generalizability. Our method, named HCiT, exploits the advantages of CNNs to extract meaningful local features, as well as the ViT's self-attention mechanism to learn discriminative global contextual dependencies in a frame-level image explicitly. In this hybrid architecture, the high-level feature maps extracted from the CNN are fed into the ViT model that determines whether a specific video is fake or real. Experiments were performed on Faceforensics++, DeepFake Detection Challenge preview, Celeb datasets, and the results show that the proposed method significantly outperforms the state-of-the-art methods. In addition, the HCiT method shows a great capacity for generalization on datasets covering various techniques of deepfake generation. The source code is available at: https://github.com/KADDAR-Bachir/HCiT
Keyword:
Deepfake video
detection
convolutional neural network
vision transformer
期刊
IF:
6
论文数:
2.0K
被引数:
5.4K
机构
引用论文
Effect of viscosity on the electrical properties of conducting thermoplastic composites made by compression molding of a powder mixture粘度对通过粉末混合物的压缩成型制成的导电热塑性复合材料的电性能的影响
PREAI
分享收藏Modelling dengue fever risk in the State of Yucatan, Mexico using regional-scale satellite-derived sea surface temperature.png)
Acta Tropica
OAAI
Acta TropicaIF0
OAAI分享收藏Deepfakes generation and detection: state-of-the-art, open challenges, countermeasures, and way forwardDeepfakes的产生和检测: 最先进的，开放的挑战，对策和前进的方向APPLIED INTELLIGENCE
APPLIED INTELLIGENCEIF3.5
PREAI
分享收藏
查看更多内容