返回
Distributional Features for Text Categorization
DOI:10.1109/TKDE.2008.166.png)
摘要
En 中文
Text categorization is the task of assigning predefined categories to natural language text. With the widely used bag-of-word representation, previous researches usually assign a word with values that express whether this word appears in the document concerned or how frequently this word appears. Although these values are useful for text categorization, they have not fully expressed the abundant information contained in the document. This paper explores the effect of other types of values, which express the distribution of a word in the document. These novel values assigned to a word are called distributional features, which include the compactness of the appearances of the word and the position of the first appearance of the word. The proposed distributional features are exploited by a tfidf style equation, and different features are combined using ensemble learning techniques. Experiments show that the distributional features are useful for text categorization. In contrast to using the traditional term frequency values solely, including the distributional features requires only a little additional cost, while the categorization performance can be significantly improved. Further analysis shows that the distributional features are especially useful when documents are long and the writing style is casual.
Keyword:
Text categorization
text mining
machine learning
distributional feature
tfidf
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.4
论文数:
6.9K
被引数:
3.2W
机构
引用论文
Enhancing the production of biogas through anaerobic co-digestion of agricultural waste and chemical pre-treatments
Chemosphere
IF0
Coordination complexes of niobium and tantalum. V. Eight-coordinated di- and triperoxoniobates(V) and -tantalates(V) with some nitrogen and oxygen bidentate ligands铌和钽的配合物。五。具有一些氮和氧双齿配体的八配位的二过氧化物和三过氧化物铌酸盐 (V) 和钽酸盐 (V)
Text categorization with support vector machines.: How to represent texts in input space?
MACHINE LEARNING
IF2.9
Preparation of water-dispersible TiO2 nanoparticles from titanium tetrachloride using urea hydrogen peroxide as an oxygen donor
CrystEngComm
IF0

