arrow
返回

Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification

delete2022-01-01
delete8
PRE
AI
施
施澄 (Cheng Shi)
L
Li Fang *
M
Minghua Zhao
Z
Zhiyong Lv
Q
Qiguang Miao
C
Chi‐Man Pun
DOI:10.1109/TGRS.2022.3208337delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep neural networks have strong feature learning ability, but their vulnerability cannot be ignored. Current research shows that deep learning models are threatened by adversarial examples in remote sensing (RS) classification tasks, and their robustness drops sharply in the face of adversarial attacks. Therefore, many adversarial attack methods have been studied to predict the risks faced by a network. However, the existing adversarial attack methods mainly focus on single-modal image classification networks, and the rapid growth of RS data makes multimodal RS image classification a research hotspot. Generating multimodal adversarial examples needs to consider a high attack success rate, subtle perturbation, and collaborative attack ability between different modalities. In this article, we investigate the vulnerability of multimodal RS classification networks and propose a multifeature collaborative adversarial network (MFCANet) for generating multimodal adversarial examples. Two modality-specific generators are designed to generate the multimodal collaborative perturbations with strong attack ability, and two modality-specific discriminators make the generated multimodal adversarial examples closer to the real instances. In addition, a modality-specific generative loss and a modality-specific discriminative loss are proposed, and an alternating optimization strategy is designed for training the proposed MFCANet. Extensive experiments are carried out on the International Society for Photogrammetry and Remote Sensing (ISPRS) Vaihingen 2D dataset and ISPRS Potsdam 2D dataset. The results show that the attack performance of the proposed method is stronger than that of the fast gradient sign method (FGSM), project gradient descent (PGD), and Carlini and Wagner (C&W) attack methods.
Keyword:
Perturbation methods
Collaboration
Task analysis
Training
Mathematical models
Generators
Deep learning
Generative adversarial networks (GANs)
multimodal adversarial attack
multimodal remote sensing (RS) image classification

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
U
University of Macau
学者数:
1.1W
论文数: 1.3W
被引数: 2.0W
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Mask-guided noise restriction adversarial attacks for image classification
err2021-01-01
err13
PREAI
errDuan, Yexin; Zhou, Xingyu; Zou, Junhua; Qiu, Junyang; Zhang, Jin; Pan, Zhisong
err分享
err收藏
学者 查看更多内容