arrow
Return

Deep label embedding learning for classification

delete2024-09-01
delete0
PRE
AI
P
Paraskevi Nousi *
A
Anastasios Tefas
DOI:10.1016/j.asoc.2024.111925delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The one-hot 0/1 encoding method is the most popularized encoding method of class labels for classification tasks. Despite its simplicity and popularity, it comes with limitations and weaknesses, like failing to capture the inherent uncertainty in data labels, and making classifiers more prone to overfitting. In this paper, these shortcomings are tackled with a framework for learning soft label embeddings. Two variants are proposed: first, a learnable general-class embedding which aims to capture information regarding inter-class similarities, and second, a neural architecture which can be added to any neural classifier and aims to learn inter-instance similarities. The inherent uncertainty in data labels is thus somewhat alleviated, allowing the network to focus on incorrectly classified samples, instead of difficult but correctly classified ones. The experimental study on multiple classification benchmarks of increasing difficulty, using neural networks of varying depth and width, show that the proposed method leads to better classification accuracy, highlighting its ability to generalize to unseen samples.
Keywords:
Label embedding
Soft labels
Class similarities
Instance similarities

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

A
aristotle university of thessaloniki
Scholars:
2.6W
Papers: 2.0W
Citations: 19
Cited Papers

Cited Papers

errShare
errSave
Co-attention network with label embedding for text classification
err2022-01-01
err42
PREAI
errLiu, Minqian; Liu, Lizhao; Cao, Junyi; Du, Qing
errShare
errSave
Deep learning algorithms for discriminant autoencoding
err2017-11-01
err15
PREAI
errNousi, Paraskevi; Tefas, Anastasios
errShare
errSave
The use of facial motion and facial form during the processing of identity
err2003-08-01
err0
PREAI
errBarbara Knappmeyer; Ian M Thornton; Heinrich H Bülthoff
errShare
errSave
Delving Deep Into Label Smoothing
err2021-01-01
err137
errOAAI
errZhang, Chang-Bin; Jiang, Peng-Tao; Hou, Qibin; Wei, Yunchao; Han, Qi; Li, Zhen; Cheng, Ming-Ming
errShare
errSave
Asian American Cancer Patients' Pain Experience
err2008-05-01
err0
PREAI
errEun-Ok Im; Yi Liu; Young Hee Kim; Wonshik Chee
errShare
errSave
researcher View more