arrow
Return

Toward Robust Discriminative Projections Learning Against Adversarial Patch Attacks

delete2024-12-01
delete5
PRE
AI
Z
Zheng Wang
聂飞平 (Feiping Nie) *
H
Hua Wang
H
Heng Huang
F
Fei Wang
DOI:10.1109/TNNLS.2023.3321606delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
As one of the most popular supervised dimensionality reduction methods, linear discriminant analysis (LDA) has been widely studied in machine learning community and applied to many scientific applications. Traditional LDA minimizes the ratio of squared l(2) norms, which is vulnerable to the adversarial examples. In recent studies, many l(1) -norm-based robust dimensionality reduction methods are proposed to improve the robustness of model. However, due to the difficulty of l(1) -norm ratio optimization and weakness on defending a large number of adversarial examples, so far, scarce works have been proposed to utilize sparsity-inducing norms for LDA objective. In this article, we propose a novel robust discriminative projections learning (rDPL) method based on the l(1,2) -norm trace-ratio minimization optimization algorithm. Minimizing the l(1,2) -norm ratio problem directly is a much more challenging problem than the traditional methods, and there is no existing optimization algorithm to solve such nonsmooth terms ratio problem. We derive a new efficient algorithm to solve this challenging problem and provide a theoretical analysis on the convergence of our algorithm. The proposed algorithm is easy to implement and converges fast in practice. Extensive experiments on both synthetic data and several real benchmark datasets show the effectiveness of the proposed method on defending the adversarial patch attack by comparison with many state-of-the-art robust dimensionality reduction methods.
Keywords:
Robustness
Optimization
Dimensionality reduction
Computational modeling
Principal component analysis
Iterative algorithms
Data models
l(1,2 )-norm ratio optimization
adversarial patch attacks
robust dimensionality reduction
robust image classification

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

C
Colorado School of Mines
Scholars:
5.6K
Papers: 5.5K
Citations: 1.0W
N
Northwestern Polytechnical University
Scholars:
4.6W
Papers: 3.7W
Citations: 5.3W
U
University of Pittsburgh
Scholars:
4.5W
Papers: 3.6W
Citations: 7.1W
P
pennsylvania commonwealth system of higher education (pcshe)
Scholars:
12.9W
Papers: 11.7W
Citations: 177
researcher View more organizations