.png){kind=icon}
返回
Multiloss Adversarial Attacks for Multimodal Remote Sensing Image Classification
.png){kind=icon}
PRE
AI
DOI：10.1109/TGRS.2024.3384927.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The challenge of classifying multimodal remote sensing images has garnered significant interest in light of the growing diversity of remote sensing image data modalities. Current studies primarily concentrate on increasing the classification task's accuracy by improving the fusion strategy or incorporating auxiliary architectures. However, there is currently a lack of research in the area of adversarial attacks for multimodal remote sensing image classification models as compared to the study of unimodal classification models. To overcome this issue, our research first investigates the adversarial robustness of multimodal remote sensing image classification under different fusion strategies, which adopts the improved classical adversarial attack methods to test the adversarial robustness of multimodal remote sensing image classification model architectures with three different fusion strategies. Then, a new multimodal adversarial attack method is proposed for the multimodal model, which adopts balanced perturbation loss and cooperative adversarial loss, in which the balanced perturbation loss is used to balance the level of perturbation of different modalities, and the cooperative adversarial loss is used to reduce the conflict of different modality perturbations on the classification result. By combining balanced perturbation loss and cooperative adversarial loss to attack multimodal models, the cooperation between modalities is continuously optimized. Finally, the study demonstrates the weak adversarial robustness of the multimodal remote sensing image classification model, the robustness of which is easily influenced by the fusion strategies and the attack methods. Additionally, a better attack effect is obtained by the multimodal multiloss cooperative adversarial attack method proposed in this article.
Keyword:
Remote sensing
Perturbation methods
Image classification
Robustness
Feature extraction
Task analysis
Deep learning
Adversarial attack
multimodal
remote sensing image classification
robustness
期刊
IF:
8.6
论文数:
2.2W
被引数:
10.7W
机构
引用论文
Pixel-level image fusion: A survey of the state of the art像素级图像融合: 最新技术综述.png)
INFORMATION FUSION
INFORMATION FUSIONIF15.5
PREAI
分享收藏Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification
PREAI
分享收藏X-ModalNet: A semi-supervised deep cross-modal network for classification of remote sensing dataX-modalnet: 用于遥感数据分类的半监督深度跨模态网络
OAAI
OAAI分享收藏Boosting smallholder production for food security: some approaches and evidence from studies in sub-Saharan AfricaAgrekonOAAI
AgrekonIF0
OAAI分享收藏Threatening Patch Attacks on Object Detection in Optical Remote Sensing Images对光学遥感图像中目标检测的威胁性补丁攻击
OAAI
OAAI分享收藏Efficient Multiple-Feature Learning-Based Hyperspectral Image Classification With Limited Training Samples有限训练样本下基于多特征学习的高光谱图像高效分类
PREAI
分享收藏
查看更多内容