arrow
返回

Online multi-label dependency topic models for text classification

delete2017-12-15
delete44
delete
OA
AI
S
Sophie Burkhardt *
S
Stefan Krämer
DOI:10.1007/s10994-017-5689-6delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Multi-label text classification is an increasingly important field as large amounts of text data are available and extracting relevant information is important in many application contexts. Probabilistic generative models are the basis of a number of popular text mining methods such as Naive Bayes or Latent Dirichlet Allocation. However, Bayesian models for multi-label text classification often are overly complicated to account for label dependencies and skewed label frequencies while at the same time preventing overfitting. To solve this problem we employ the same technique that contributed to the success of deep learning in recent years: greedy layer-wise training. Applying this technique in the supervised setting prevents overfitting and leads to better classification accuracy. The intuition behind this approach is to learn the labels first and subsequently add a more abstract layer to represent dependencies among the labels. This allows using a relatively simple hierarchical topic model which can easily be adapted to the online setting. We show that our method successfully models dependencies online for large-scale multi-label datasets with many labels and improves over the baseline method not modeling dependencies. The same strategy, layer-wise greedy training, also makes the batch variant competitive with existing more complex multi-label topic models.
Keyword:
Multi-label classification
Online learning
LDA
Topic model
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

J
Johannes Gutenberg University of Mainz
学者数:
2.4W
论文数: 1.8W
被引数: 28
引用论文

引用论文

err分享
err收藏
Statistical topic models for multi-label document classification
err2011-12-29
err229
errOAAI
errRubin, Timothy N.; Chambers, America; Smyth, Padhraic; Steyvers, Mark
err分享
err收藏
学者 查看更多内容