Return
Toward Robust Discriminative Projections Learning Against Adversarial Patch Attacks
DOI:10.1109/TNNLS.2023.3321606.png)
Abstract
En 中文
As one of the most popular supervised dimensionality reduction methods, linear discriminant analysis (LDA) has been widely studied in machine learning community and applied to many scientific applications. Traditional LDA minimizes the ratio of squared l(2) norms, which is vulnerable to the adversarial examples. In recent studies, many l(1) -norm-based robust dimensionality reduction methods are proposed to improve the robustness of model. However, due to the difficulty of l(1) -norm ratio optimization and weakness on defending a large number of adversarial examples, so far, scarce works have been proposed to utilize sparsity-inducing norms for LDA objective. In this article, we propose a novel robust discriminative projections learning (rDPL) method based on the l(1,2) -norm trace-ratio minimization optimization algorithm. Minimizing the l(1,2) -norm ratio problem directly is a much more challenging problem than the traditional methods, and there is no existing optimization algorithm to solve such nonsmooth terms ratio problem. We derive a new efficient algorithm to solve this challenging problem and provide a theoretical analysis on the convergence of our algorithm. The proposed algorithm is easy to implement and converges fast in practice. Extensive experiments on both synthetic data and several real benchmark datasets show the effectiveness of the proposed method on defending the adversarial patch attack by comparison with many state-of-the-art robust dimensionality reduction methods.
Keywords:
Robustness
Optimization
Dimensionality reduction
Computational modeling
Principal component analysis
Iterative algorithms
Data models
l(1,2 )-norm ratio optimization
adversarial patch attacks
robust dimensionality reduction
robust image classification
Journal
IF:
8.9
Papers:
7.5K
Citations:
7.2W

