arrow
返回

Generalized Fake Image Detection Method Based on Gated Hierarchical Multi-Task Learning

delete2023-01-01
delete3
PRE
AI
Y
Yanjiang Zhou
何
何沛松 (Peisong He) *
W
Weichuang Li
Y
Yun Cao
X
Xinghao Jiang
DOI:10.1109/LSP.2023.3336570delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, the abuse of image generation techniques based on artificial intelligence has posed a great threat to the integrity of digital images. However, existing detection methods are hard to provide generalized detection capability of fake images generated by unseen models. To address this issue, we propose a generalized fake image detection framework based on gated hierarchical multi-task learning, which is supervised by well-designed forensics sub-tasks. Firstly, a global artifact learning task is constructed as binary classification with region masking augmentation. Besides, a block-wise spatial correlation learning task is designed by solving jigsaw puzzle cooperated with color jitter operations, which aims to explore common artifacts of various generators. Finally, a hierarchical multi-task learning paradigm is developed with multi-gate structures, which can adjust the importance of different forensics clues and jointly enhance detection performance. Extensive experiments have been conducted to evaluate the superiority of the proposed method on the open-set scenario with unseen generators.
Keyword:
Image forensics
fake image detection
hierarchical multi-task learning
multi-gate structure

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
H
Hong Kong University of Science and Technology (Guangzhou)
学者数:
1.0K
论文数: 866
被引数: 1
S
sichuan university
学者数:
12.1W
论文数: 7.8W
被引数: 100
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Hemispheric dominance in the processing of J. S. Bach fugues: a transcranial Doppler sonography (TCD) study with musicians
err1998-09-01
err0
PREAI
errJuliane Vollmer-Haase; Kathrin Finke; Wolfgang Hartje; Michael Bulla-Hellwig
err分享
err收藏
New Finding and Unified Framework for Fake Image Detection
err2023-01-01
err3
PREAI
errDeng, Xin; Zhao, Bihe; Guan, Zhenyu; Xu, Mai
err分享
err收藏
Learning Cooperative Personalized Policies from Gaze Data
err2019-10-17
err0
PREAI
errChristoph Gebhardt; Brian Hecox; Bas van Opheusden; Daniel Wigdor; James Hillis; Otmar Hilliges; Hrvoje Benko
err分享
err收藏
err分享
err收藏
The evolution of social behaviour in Blaberid cockroaches with diverse habitats and social systems: phylogenetic analysis of behavioural sequences
err2013-11-22
err0
errOAAI
errFrédéric Legendre; Cyrille A. D'Haese; Pierre Deleporte; Roseli Pellens; Michael F. Whiting; Klaus Schliep; Philippe Grandcolas
err分享
err收藏
Influence of large amount Zn on mechanical properties and corrosion resistance of 5083 hot rolled aluminum alloy
err2020-08-18
err0
PREAI
errXiaojing Xu; Xiaopeng Jin; Zheng Liu; Bin Zhang; Rikai Zhang; Yuan Zhuang; Peng Zhang; Hongbo Wei
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容