arrow
返回

Distributional Features for Text Categorization

delete2009-03-01
delete67
PRE
AI
X
Xiaobing Xue *
Z
Zhihua Zhou
DOI:10.1109/TKDE.2008.166delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Text categorization is the task of assigning predefined categories to natural language text. With the widely used bag-of-word representation, previous researches usually assign a word with values that express whether this word appears in the document concerned or how frequently this word appears. Although these values are useful for text categorization, they have not fully expressed the abundant information contained in the document. This paper explores the effect of other types of values, which express the distribution of a word in the document. These novel values assigned to a word are called distributional features, which include the compactness of the appearances of the word and the position of the first appearance of the word. The proposed distributional features are exploited by a tfidf style equation, and different features are combined using ensemble learning techniques. Experiments show that the distributional features are useful for text categorization. In contrast to using the traditional term frequency values solely, including the distributional features requires only a little additional cost, while the categorization performance can be significantly improved. Further analysis shows that the distributional features are especially useful when documents are long and the writing style is casual.
Keyword:
Text categorization
text mining
machine learning
distributional feature
tfidf
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.9K
被引数:
3.2W

机构

N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
引用论文

引用论文

Mechanism of neutral carrier mediated ion transport through ion-selective bulk membranes
err2002-05-01
err0
PREAI
errA. P. Thoma; A. Viviani-Nauer; S. Arvanitis; W. E. Morf; W. Simon
err分享
err收藏
err分享
err收藏
Preparation of water-dispersible TiO2 nanoparticles from titanium tetrachloride using urea hydrogen peroxide as an oxygen donor
err2013-01-01
err0
errOAAI
errNaoko Watanabe; Taichi Kaneko; Yuko Uchimaru; Sayaka Yanagida; Atsuo Yasumori; Yoshiyuki Sugahara
err分享
err收藏
err分享
err收藏
学者 查看更多内容