Robust Simplex-Based Multinomial Logistic Regression

doi:10.1007/s40304-025-00459-0

Robust Simplex-Based Multinomial Logistic Regression

2026-03-01

0

PRE

AI

DOI：10.1007/s40304-025-00459-0

Original

Original request for help

Save

Abstract

En 中文

The multicategory logistic regression (MLR) is one of the most popular large-margin classifiers in machine learning. Although it has been successfully applied in various fields, some intrinsic problems still remain. In particular, the existing MLR models suffer from the over-specification of decision functions or the choice of reference category and are very sensitive to the potential outliers due to the unbounded loss function. In this article, utilizing the prevalent simplex-based framework, we propose three robust MLR models based on truncated loss function, weighted learning and label-adjusted learning, respectively. Moreover, the first two approaches achieve robustness by removing potential outliers and the latter obtains robustness by adaptively relabeling outliers. Theoretical properties including Fisher consistency, probability estimation and breakdown point are well established. Intensive numerical studies demonstrate that the proposed methods are very competitive for problems with potential outliers.

Keywords:

Fisher consistency

Multicategory classification

Probability estimation

Robustness

Simplex-based framework

Robust Simplex-Based Multinomial Logistic Regression

Abstract

Journal

Organization