返回
Generalized Fake Image Detection Method Based on Gated Hierarchical Multi-Task Learning
DOI:10.1109/LSP.2023.3336570.png)
摘要
En 中文
Recently, the abuse of image generation techniques based on artificial intelligence has posed a great threat to the integrity of digital images. However, existing detection methods are hard to provide generalized detection capability of fake images generated by unseen models. To address this issue, we propose a generalized fake image detection framework based on gated hierarchical multi-task learning, which is supervised by well-designed forensics sub-tasks. Firstly, a global artifact learning task is constructed as binary classification with region masking augmentation. Besides, a block-wise spatial correlation learning task is designed by solving jigsaw puzzle cooperated with color jitter operations, which aims to explore common artifacts of various generators. Finally, a hierarchical multi-task learning paradigm is developed with multi-gate structures, which can adjust the importance of different forensics clues and jointly enhance detection performance. Extensive experiments have been conducted to evaluate the superiority of the proposed method on the open-set scenario with unseen generators.
Keyword:
Image forensics
fake image detection
hierarchical multi-task learning
multi-gate structure
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
引用论文
Sensorless Control of Z Source Inverter fed BLDC Motor Drive by FOC - DTC Hybrid Control Strategy Using Fuzzy Logic Controller采用模糊逻辑控制器的foc-dtc混合控制策略的Z源逆变器馈电BLDC电机驱动的无传感器控制
The Effect of 40-Hz Light Therapy on Amyloid Load in Patients with Prodromal and Clinical Alzheimer’s Disease40Hz光疗法对前驱和临床阿尔茨海默病患者淀粉样蛋白负荷的影响
Oxidative stress in liver of grass carp Ctenopharyngodon idella naturally infected with Saprolegnia parasitica and its influence on disease pathogenesis天然感染水蚤的草鱼肝脏氧化应激及其对疾病发病机制的影响

