arrow
返回

Class-Level Logit Perturbation

delete2024-10-01
delete1
delete
OA
AI
M
Mengyang Li
F
Fengguang Su
O
Ou Wu *
J
Ji Zhang
DOI:10.1109/TNNLS.2023.3273355delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Features, logits, and labels are the three primary data when a sample passes through a deep neural network. Feature perturbation and label perturbation receive increasing attention in recent years. They have been proven to be useful in various deep learning approaches. For example, (adversarial) feature perturbation can improve the robustness or even generalization capability of learned models. However, limited studies have explicitly explored for the perturbation of logit vectors. This work discusses several existing methods related to class-level logit perturbation. A unified viewpoint between positive/negative data augmentation and loss variations incurred by logit perturbation is established. A theoretical analysis is provided to illuminate why class-level logit perturbation is useful. Accordingly, new methodologies are proposed to explicitly learn to perturb logits for both single-label and multi-label classification tasks. Extensive experiments on benchmark image classification data sets and their long-tail versions indicated the competitive performance of our learning method. As it only perturbs on logit, it can be used as a plug-in to fuse with any existing classification algorithms. All the codes are available at https://github.com/limengyang1992/lpl.
Keyword:
Adversarial training
data augmentation
long-tail classification
multilabel classification

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
U
University of Southern Queensland
学者数:
4.1K
论文数: 4.8K
被引数: 18
引用论文

引用论文

Core–Shell Catalyst CuO–ZnO–Al2O3@Al2O3 for Dimethyl Ether Synthesis from Syngas
err2013-04-05
err0
PREAI
errYan Wang; Wenli Wang; Yuexian Chen; Jinghong Ma; Jiajun Zheng; Ruifeng Li
err分享
err收藏
Evolution of ungulate mating systems: Integrating social and environmental factors
err2020-04-15
err0
errOAAI
errR. Terry Bowyer; Dale R. McCullough; Janet L. Rachlow; Simone Ciuti; Jericho C. Whiting
err分享
err收藏
Role of interferon-γ in Vα14+ natural killer T cell-mediated host defense against Streptococcus pneumoniae infection in murine lungs
err2007-03-01
err0
PREAI
errMasashi Nakamatsu; Natsuo Yamamoto; Masumitsu Hatta; Chikara Nakasone; Takeshi Kinjo; Kazuya Miyagi; Kaori Uezu; Kiwamu Nakamura; Toshinori Nakayama; Masaru Taniguchi; Yoichiro Iwakura; Mitsuo Kaku; Jiro Fujita; Kazuyoshi Kawakami
err分享
err收藏
Introduction
err2005-08-25
err0
PREAI
errMary Coleman; Catalina Betancur
err分享
err收藏
Non-Circadian Expression Masking Clock-Driven Weak Transcription Rhythms in U2OS Cells
err2014-07-09
err0
errOAAI
errJulia Hoffmann; Laura Symul; Anton Shostak; Tamás Fischer; Felix Naef; Michael Brunner
err分享
err收藏
学者 查看更多内容