arrow
Return

Boosting Adversarial Transferability via Commonality-Oriented Gradient Optimization

delete2026-01-01
delete0
PRE
AI
Y
Yanting Gao
Y
Yepeng Liu
L
Liu, Junming
Q
Qi Zhang
H
Hongyun Zhang
D
Duoqian Miao *
赵
赵才荣 (Cairong Zhao)
DOI:10.1007/978-981-95-5693-9_5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Exploring effective and transferable adversarial examples is vital for understanding the characteristics and mechanisms of Vision Transformers (ViTs). However, adversarial examples generated from surrogate models often exhibit weak transferability in black-box settings due to overfitting. Existing methods improve transferability by diversifying perturbation inputs or applying uniform gradient regularization within surrogate models, yet they have not fully leveraged the shared and unique features of surrogate models trained on the same task, leading to suboptimal transfer performance. Therefore, enhancing perturbations of common information shared by surrogate models and suppressing those tied to individual characteristics offers an effective way to improve transferability. Accordingly, we propose a commonality-oriented gradient optimization strategy (COGO) consisting of two components: Commonality Enhancement (CE) and Individuality Suppression (IS). CE perturbs the mid-to-low frequency regions, leveraging the fact that ViTs trained on the same dataset tend to rely more on mid-to-low frequency information for classification. IS employs adaptive thresholds to evaluate the correlation between backpropagated gradients and model individuality, assigning weights to gradients accordingly. Extensive experiments demonstrate that COGO significantly improves the transfer success rates of adversarial attacks, outperforming current state-of-the-art methods.
Keywords:
Adversarial Example
Vision Transformer

Journal

P
PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2025, PT II
IF:
0
Papers:
27
Citations:
0

Organization

State University System of Florida cover
State University System of Florida
Scholars:
12.8W
Papers: 10.9W
Citations: 130
T
tongji university
Scholars:
7.9W
Papers: 6.0W
Citations: 98
Cited Papers

Cited Papers

Segment Anything Model Is a Good Teacher for Local Feature Learning
err2025-01-01
err0
PREAI
errWu,Jingqian; Xu,Rongtao; Wood-Doughty,Zach; Wang,Changwei; Xu,Shibiao; Lam,Edmund Y.
errShare
errSave
Rethinking the Inception Architecture for Computer Vision
err2016-06-01
err0
errOAAI
errChristian Szegedy; Vincent Vanhoucke; Sergey Ioffe; Jon Shlens; Zbigniew Wojna
errShare
errSave
Rethinking Spatial Dimensions of Vision Transformers
err2021-10-01
err0
errOAAI
errByeongho Heo; Sangdoo Yun; Dongyoon Han; Sanghyuk Chun; Junsuk Choe; Seong Joon Oh
errShare
errSave
Boosting Adversarial Attacks with Momentum
err2018-06-01
err0
errOAAI
errYinpeng Dong; Fangzhou Liao; Tianyu Pang; Hang Su; Jun Zhu; Xiaolin Hu; Jianguo Li
errShare
errSave
ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
ConViT: improving vision transformers with soft convolutional inductive biases*
err2022-11-24
err0
errOAAI
errStéphane d’Ascoli; Hugo Touvron; Matthew L Leavitt; Ari S Morcos; Giulio Biroli; Levent Sagun
errShare
errSave
Going deeper with Image Transformers
err2021-10-01
err0
errOAAI
errHugo Touvron; Matthieu Cord; Alexandre Sablayrolles; Gabriel Synnaeve; Herve Jegou
errShare
errSave
MRFTrans: Multimodal Representation Fusion Transformer for monocular 3D semantic scene completion
err2024-11-01
err2
PREAI
errXu, Rongtao; Zhang, Jiguang; Sun, Jiaxi; Wang, Changwei; Wu, Yifan; Xu, Shibiao; Meng, Weiliang; Zhang, Xiaopeng
errShare
errSave
researcher View more