arrow
返回

Modified frequency-based term weighting schemes for text classification

delete2017-09-01
delete80
PRE
AI
T
Thabit Sabbah
A
Ali Selamat *
F
Fawaz S. Al–Anzi
E
Enrique Herrera‐Viedma
O
Ondřej Krejcar
H
Hamido Fujita
DOI:10.1016/j.asoc.2017.04.069delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the rapid growth of textual content on the Internet, automatic text categorization is a comparatively more effective solution in information organization and knowledge management. Feature selection, one of the basic phases in statistical-based text categorization, crucially depends on the term weighting methods In order to improve the performance of text categorization, this paper proposes four modified frequency-based term weighting schemes namely; mTF, mTFIDF, TFmIDF, and mTFmIDF. The proposed term weighting schemes take the amount of missing terms into account calculating the weight of existing terms. The proposed schemes show the highest performance for a SVM classifier with a micro-average F1 classification performance value of 97%. Moreover, benchmarking results on Reuters-21578, 20Newsgroups, and WebKB text-classification datasets, using different classifying algorithms such as SVM and KNN show that the proposed schemes mTF, mTFIDF, and mTFmIDF outperform other weighting schemes such as TF, TFIDF, and Entropy. Additionally, the statistical significance tests show a significant enhancement of the classification performance based on the modified schemes. (C) 2017 Elsevier B.V. All rights reserved.
Keyword:
Term-weighting
Missing features
Absent terms
Vector Space Model
Text classification
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

K
King Abdulaziz University
学者数:
2.0W
论文数: 1.9W
被引数: 3.3W
I
iwate prefectural university
学者数:
108
论文数: 199
被引数: 0
U
Universiti Teknologi Malaysia
学者数:
1.4W
论文数: 1.1W
被引数: 85
U
University of Granada
学者数:
2.3W
论文数: 1.9W
被引数: 24
学者 查看更多机构
引用论文

引用论文

An unsupervised approach to generating generic summaries of documents
err2015-09-01
err31
PREAI
errAlguliyev, Rasim M.; Aliguliyev, Ramiz M.; Isazade, Nijat R.
err分享
err收藏
REFORE: A recommender system for researchers based on bibliometrics
err2015-05-01
err44
PREAI
errTejeda-Lorente, A.; Porcel, C.; Bernabe-Moreno, J.; Herrera-Viedma, E.
err分享
err收藏
err分享
err收藏
Effects of anticholinesterase drugs on biomarkers and behavior of pumpkinseed, Lepomis gibbosus (Linnaeus, 1758)
err2012-01-01
err0
PREAI
errSara Rodrigues; Sara C. Antunes; Fátima P. Brandão; Bruno B. Castro; Fernando Gonçalves; Bruno Nunes
err分享
err收藏
The Chinese text categorization system with association rule and category priority
err2008-07-01
err16
PREAI
errChiang, Ding-An; Keh, Huan-Chao; Huang, Hui-Hua; Chyr, Derming
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容