返回
Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification
DOI:10.1109/TGRS.2022.3208337.png)
摘要
En 中文
Deep neural networks have strong feature learning ability, but their vulnerability cannot be ignored. Current research shows that deep learning models are threatened by adversarial examples in remote sensing (RS) classification tasks, and their robustness drops sharply in the face of adversarial attacks. Therefore, many adversarial attack methods have been studied to predict the risks faced by a network. However, the existing adversarial attack methods mainly focus on single-modal image classification networks, and the rapid growth of RS data makes multimodal RS image classification a research hotspot. Generating multimodal adversarial examples needs to consider a high attack success rate, subtle perturbation, and collaborative attack ability between different modalities. In this article, we investigate the vulnerability of multimodal RS classification networks and propose a multifeature collaborative adversarial network (MFCANet) for generating multimodal adversarial examples. Two modality-specific generators are designed to generate the multimodal collaborative perturbations with strong attack ability, and two modality-specific discriminators make the generated multimodal adversarial examples closer to the real instances. In addition, a modality-specific generative loss and a modality-specific discriminative loss are proposed, and an alternating optimization strategy is designed for training the proposed MFCANet. Extensive experiments are carried out on the International Society for Photogrammetry and Remote Sensing (ISPRS) Vaihingen 2D dataset and ISPRS Potsdam 2D dataset. The results show that the attack performance of the proposed method is stronger than that of the fast gradient sign method (FGSM), project gradient descent (PGD), and Carlini and Wagner (C&W) attack methods.
Keyword:
Perturbation methods
Collaboration
Task analysis
Training
Mathematical models
Generators
Deep learning
Generative adversarial networks (GANs)
multimodal adversarial attack
multimodal remote sensing (RS) image classification
期刊
IF:
8.6
论文数:
2.2W
被引数:
10.7W
机构
引用论文
X-ModalNet: A semi-supervised deep cross-modal network for classification of remote sensing dataX-modalnet: 用于遥感数据分类的半监督深度跨模态网络
Attention Multibranch Convolutional Neural Network for Hyperspectral Image Classification Based on Adaptive Region Search基于自适应区域搜索的注意力多分支卷积神经网络高光谱图像分类
Welding characteristics of aluminum, copper, nickel and aluminum alloy with alumina coating using ultrasonic complex vibration welding equipments铝、铜、镍及铝合金氧化铝涂层超声复合振动焊接特性研究
Enhanced Reactivity of Dinuclear Copper(I) Acetylides in Dipolar Cycloadditions偶极环加成反应中双核乙炔铜 (I) 的反应性增强

