arrow
返回

Exploring weakly-supervised image manipulation localization with tampering Edge-based class activation map

delete2024-09-01
delete1
PRE
AI
Y
Yang Zhou
H
Hongxia Wang *
R
Rui Zhang
S
Sijiang Meng
DOI:10.1016/j.eswa.2024.123501delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent investigations concerning manipulated image localization, prevailing methodologies have relied on Convolutional Neural Networks (CNNs) to facilitate supervised learning predicated upon manipulated images and their corresponding ground -truth annotations. Nevertheless, these methods produce high false detection rates when detecting unaltered images due to the limited availability of authentic images. In this paper, we initiate our inquiry by scrutinizing the distribution characteristics of class activation maps within the context of image manipulation detection and the inherent patterns of alterations within this domain. We then introduce the novel concept of a tampering Edge -based Class Activation Map (EdgeCAM) tailored for detecting tampering within manipulated images. Leveraging EdgeCAM, we formulate a framework for localizing tampered regions in images through a weakly -supervised approach, relying solely on image -level annotations. Ultimately, we establish a fundamental benchmark for weakly -supervised image manipulation localization by utilizing genuine tampered images collected from real -world scenarios. The empirical results highlight the notable efficacy of our proposed method, outperforming current weakly -supervised methods for detecting image manipulation by a significant margin of 12.7% on the average combined F1 metrics across various generic datasets. This result also achieves performance comparable to supervised methods for image manipulation localization.
Keyword:
Image manipulation localization
Image-level tempering detection
Weakly-supervised learning
Class activation map

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

S
sichuan university
学者数:
12.1W
论文数: 7.8W
被引数: 100
引用论文

引用论文

Large-scale evaluation of splicing localization algorithms for web images
err2016-09-01
err111
PREAI
errZampoglou, Markos; Papadopoulos, Symeon; Kompatsiaris, Yiannis
err分享
err收藏
Image Forgery Localization via Fine-Grained Analysis of CFA Artifacts
err2012-10-01
err366
errOAAI
errFerrara, Pasquale; Bianchi, Tiziano; De Rosa, Alessia; Piva, Alessandro
err分享
err收藏
LayerCAM: Exploring Hierarchical Class Activation Maps for Localization
err2021-01-01
err369
PREAI
errJiang, Peng-Tao; Zhang, Chang-Bin; Hou, Qibin; Cheng, Ming-Ming; Wei, Yunchao
err分享
err收藏
Determining image origin and integrity using sensor noise
err2008-01-01
err670
errOAAI
errChen, Mo; Fridrich, Jessica; GoIjan, Miroslav; Lukas, Jan
err分享
err收藏
Using noise inconsistencies for blind image forensics
err2009-09-01
err296
PREAI
errMahdian, Babak; Saic, Stanislav
err分享
err收藏
学者 查看更多内容