arrow
Return

Class-Level Logit Perturbation

delete2024-10-01
delete1
delete
OA
AI
M
Mengyang Li
F
Fengguang Su
O
Ou Wu *
J
Ji Zhang
DOI:10.1109/TNNLS.2023.3273355delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Features, logits, and labels are the three primary data when a sample passes through a deep neural network. Feature perturbation and label perturbation receive increasing attention in recent years. They have been proven to be useful in various deep learning approaches. For example, (adversarial) feature perturbation can improve the robustness or even generalization capability of learned models. However, limited studies have explicitly explored for the perturbation of logit vectors. This work discusses several existing methods related to class-level logit perturbation. A unified viewpoint between positive/negative data augmentation and loss variations incurred by logit perturbation is established. A theoretical analysis is provided to illuminate why class-level logit perturbation is useful. Accordingly, new methodologies are proposed to explicitly learn to perturb logits for both single-label and multi-label classification tasks. Extensive experiments on benchmark image classification data sets and their long-tail versions indicated the competitive performance of our learning method. As it only perturbs on logit, it can be used as a plug-in to fuse with any existing classification algorithms. All the codes are available at https://github.com/limengyang1992/lpl.
Keywords:
Adversarial training
data augmentation
long-tail classification
multilabel classification

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.6K
Citations:
7.2W

Organization

T
tianjin university
Scholars:
8.0W
Papers: 5.8W
Citations: 88
U
University of Southern Queensland
Scholars:
4.1K
Papers: 4.8K
Citations: 18
Cited Papers

Cited Papers

Core–Shell Catalyst CuO–ZnO–Al2O3@Al2O3 for Dimethyl Ether Synthesis from Syngas
err2013-04-05
err0
PREAI
errYan Wang; Wenli Wang; Yuexian Chen; Jinghong Ma; Jiajun Zheng; Ruifeng Li
errShare
errSave
Evolution of ungulate mating systems: Integrating social and environmental factors
err2020-04-15
err0
errOAAI
errR. Terry Bowyer; Dale R. McCullough; Janet L. Rachlow; Simone Ciuti; Jericho C. Whiting
errShare
errSave
Role of interferon-γ in Vα14+ natural killer T cell-mediated host defense against Streptococcus pneumoniae infection in murine lungs
err2007-03-01
err0
PREAI
errMasashi Nakamatsu; Natsuo Yamamoto; Masumitsu Hatta; Chikara Nakasone; Takeshi Kinjo; Kazuya Miyagi; Kaori Uezu; Kiwamu Nakamura; Toshinori Nakayama; Masaru Taniguchi; Yoichiro Iwakura; Mitsuo Kaku; Jiro Fujita; Kazuyoshi Kawakami
errShare
errSave
Introduction
err2005-08-25
err0
PREAI
errMary Coleman; Catalina Betancur
errShare
errSave
Non-Circadian Expression Masking Clock-Driven Weak Transcription Rhythms in U2OS Cells
err2014-07-09
err0
errOAAI
errJulia Hoffmann; Laura Symul; Anton Shostak; Tamás Fischer; Felix Naef; Michael Brunner
errShare
errSave
A survey on computational models for predicting protein-protein interactions
err2021-03-05
err88
PREAI
errHu, Lun; Wang, Xiaojuan; Huang, Yu-An; Hu, Pengwei; You, Zhu-Hong
errShare
errSave
researcher View more