.png){kind=icon}
返回
Stealthy Targeted Backdoor Attacks Against Image Captioning
.png){kind=icon}
OA
AI
DOI：10.1109/TIFS.2024.3402179.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In recent years, there is an explosive growth in multimodal learning. Image captioning, a classical multimodal task, has demonstrated promising applications and attracted extensive research attention. However, recent studies have shown that image caption models are vulnerable to some security threats such as backdoor attacks. Existing backdoor attacks against image captioning typically pair a trigger either with a predefined sentence or a single word as the targeted output, yet they are unrelated to the image content, making them easily noticeable as anomalies by humans. In this paper, we present a novel method to craft targeted backdoor attacks against image caption models, which are designed to be stealthier than prior attacks. Specifically, our method first learns a special trigger by leveraging universal perturbation techniques for object detection, then places the learned trigger in the center of some specific source object and modifies the corresponding object name in the output caption to a predefined target name. During the prediction phase, the caption produced by the backdoored model for input images with the trigger can accurately convey the semantic information of the rest of the whole image, while incorrectly recognizing the source object as the predefined target. Extensive experiments demonstrate that our approach can achieve a high attack success rate while having a negligible impact on model clean performance. In addition, we show our method is stealthy in that the produced backdoor samples are indistinguishable from clean samples in both image and text domains, which can successfully bypass existing backdoor defenses, highlighting the need for better defensive mechanisms against such stealthy backdoor attacks.
Keyword:
Perturbation methods
Detectors
Task analysis
Predictive models
Biological system modeling
Electronic mail
Data models
Backdoor attack
image caption
deep learning
期刊
IF:
8
论文数:
5.3K
被引数:
2.3W
机构
引用论文
Genetic Relationships Between the G Protein βγ Complex, Ste5p, Ste20p and Cdc42p: Investigation of Effector Roles in the Yeast Pheromone Response Pathway.png)
Genetics
OAAI
GeneticsIF0
OAAI分享收藏BadNets: Evaluating Backdooring Attacks on Deep Neural NetworksBadNets: 评估对深度神经网络的后台攻击IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏分享收藏Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现Indoor AirOAAI
Indoor AirIF0
OAAI分享收藏Welding characteristics of aluminum, copper, nickel and aluminum alloy with alumina coating using ultrasonic complex vibration welding equipments铝、铜、镍及铝合金氧化铝涂层超声复合振动焊接特性研究
PREAI
分享收藏
查看更多内容