Does Tail Label Help for Large-Scale Multi-Label Learning?

Tong Wei

doi:10.1109/TNNLS.2019.2935143

Does Tail Label Help for Large-Scale Multi-Label Learning?

2019-01-01

29

PRE

AI

DOI：10.1109/TNNLS.2019.2935143

Original

Original request for help

Save

Abstract

En 中文

Large-scale multi-label learning (LMLL) annotates relevant labels for unseen data from a huge number of candidate labels. It is perceived that labels exhibit a long tail distribution in which a significant number of labels are tail labels. Most previous studies consider that the performance would benefit from incorporating tail labels. Nonetheless, it is not quantified how tail labels impact the performance. In this article, we disclose that whatever labels are randomly missing or misclassified, the impact of labels on commonly used LMLL evaluation metrics (Propensity Score Precision (PSP)@k and Propensity Score nDCG (PSnDCG)@k) is directly related to the product of the label weights and the label frequencies. In particular, when labels share equal weights, tail labels impact much less than common labels due to the scarcity of relevant examples. Based on such observation, we propose to develop low-complexity LMLL methods with the goal of facilitating fast prediction time and compact model size by restraining less performance-influential labels. With the consideration that discarding labels may cause the loss of predictive capability, we further propose to preserve dominant model parameters for the less performance-influential labels. Experiments clearly justify that both the prediction time and the model size are significantly reduced without sacrificing much predictive performance.

Keywords:

Predictive models

Measurement

Training

Prediction algorithms

Correlation

Sparse matrices

Learning systems

Large-scale multi-label learning (LMLL)

performance metric

scalability

tail label

Does Tail Label Help for Large-Scale Multi-Label Learning?

Abstract

AI Summary

Journal

Organization