Merge Loss Calculation Method for Highly Imbalanced Data Multiclass Classification

doi:10.1109/TNNLS.2023.3321753

Merge Loss Calculation Method for Highly Imbalanced Data Multiclass Classification

2024-12-01

0

OA

AI

DOI：10.1109/TNNLS.2023.3321753

Original

Original request for help

Save

Abstract

En 中文

In real classification scenarios, the number distribution of modeling samples is usually out of proportion. Most of the existing classification methods still face challenges in comprehensive model performance for imbalanced data. In this article, a novel theoretical framework is proposed that establishes a proportion coefficient independent of the number distribution of modeling samples and a general merge loss calculation method independent of class distribution. The loss calculation method of the imbalanced problem focuses on both the global and batch sample levels. Specifically, the loss function calculation introduces the true-positive rate (TPR) and the false-positive rate (FPR) to ensure the independence and balance of loss calculation for each class. Based on this, global and local loss weight coefficients are generated from the entire dataset and batch dataset for the multiclass classification problem, and a merge weight loss function is calculated after unifying the weight coefficient scale. Furthermore, the designed loss function is applied to different neural network models and datasets. The method shows better performance on imbalanced datasets than state-of-the-art methods.

Keywords:

Cost-sensitive factor

deep neural network

highly imbalanced data classification

receiver operating characteristics

weighted uncorrelated constraint

Merge Loss Calculation Method for Highly Imbalanced Data Multiclass Classification

Abstract

Journal

Organization