arrow
Return

Statistical topic models for multi-label document classification

delete2011-12-29
delete229
delete
OA
AI
T
Timothy N. Rubin *
A
America Chambers
P
Padhraic Smyth
M
Mark Steyvers
DOI:10.1007/s10994-011-5272-5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Machine learning approaches to multi-label document classification have to date largely relied on discriminative modeling techniques such as support vector machines. A drawback of these approaches is that performance rapidly drops off as the total number of labels and the number of labels per document increase. This problem is amplified when the label frequencies exhibit the type of highly skewed distributions that are often observed in real-world datasets. In this paper we investigate a class of generative statistical topic models for multi-label documents that associate individual word tokens with different labels. We investigate the advantages of this approach relative to discriminative models, particularly with respect to classification problems involving large numbers of relatively rare labels. We compare the performance of generative and discriminative approaches on document labeling tasks ranging from datasets with several thousand labels to datasets with tens of labels. The experimental results indicate that probabilistic generative models can achieve competitive multi-label classification performance compared to discriminative methods, and have advantages for datasets with many labels and skewed label frequencies.
Keywords:
Topic models
LDA
Multi-label classification
Document modeling
Text classification
Graphical models
Probabilistic generative models
Dependency-LDA

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
U
university of california irvine
Scholars:
2.3W
Papers: 1.7W
Citations: 55
Cited Papers

Cited Papers

Multilabel classification via calibrated label ranking
err2008-08-06
err753
errOAAI
errFuernkranz, Johannes; Huellermeier, Eyke; Mencia, Eneldo Loza; Brinker, Klaus
errShare
errSave
Scanning electron microscopy of different vulval structures in a Mexican Haemonchus contortus isolate
err2021-12-01
err0
PREAI
errCintli Martínez-Ortiz-de-Montellano; Juan Felipe de Jesús Torres-Acosta; Carlos Alfredo Sandoval-Castro; Isabelle Fourquaux; Hervé Hoste
errShare
errSave
researcher View more