arrow
返回

Learning to Weight for Text Classification

delete2020-02-01
delete16
delete
OA
AI
A
Alejandro Moreo *
A
Andrea Esuli
F
Fabrizio Sebastiani
DOI:10.1109/TKDE.2018.2883446delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In information retrieval (IR) and related tasks, term weighting approaches typically consider the frequency of the term in the document and in the collection in order to compute a score reflecting the importance of the term for the document. In tasks characterized by the presence of training data (such as text classification) it seems logical that the term weighting function should take into account the distribution (as estimated from training data) of the term across the classes of interest. Although supervised term weighting approaches that use this intuition have been described before, they have failed to show consistent improvements. In this article, we analyze the possible reasons for this failure, and call consolidated assumptions into question. Following this criticism, we propose a novel supervised term weighting approach that, instead of relying on any predefined formula, learns a term weighting function optimized on the training set of interest; we dub this approach Learning to Weight (LTW). The experiments that we run on several well-known benchmarks, and using different learning methods, show that our method outperforms previous term weighting approaches in text classification.
Keyword:
Training data
Task analysis
Training
Neural networks
Feature extraction
Time-frequency analysis
Information retrieval
Term weighting
supervised term weighting
text classification
neural networks
deep learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

C
consiglio nazionale delle ricerche (cnr)
学者数:
6.2W
论文数: 5.7W
被引数: 48
引用论文

引用论文

err分享
err收藏
Effects of anticholinesterase drugs on biomarkers and behavior of pumpkinseed, Lepomis gibbosus (Linnaeus, 1758)
err2012-01-01
err0
PREAI
errSara Rodrigues; Sara C. Antunes; Fátima P. Brandão; Bruno B. Castro; Fernando Gonçalves; Bruno Nunes
err分享
err收藏
Charge-Transfer and Energy-Transfer Processes in π-Conjugated Oligomers and Polymers:  A Molecular Picture
err2004-09-28
err0
PREAI
errJean-Luc Brédas; David Beljonne; Veaceslav Coropceanu; Jérôme Cornil
err分享
err收藏
Population Size and Migration of Anopheles gambiae in the Bancoumana Region of Mali and Their Significance for Efficient Vector Control
err2010-04-21
err0
errOAAI
errIbrahima Baber; Moussa Keita; Nafomon Sogoba; Mamadou Konate; M'Bouye Diallo; Seydou Doumbia; Sékou F. Traoré; José M. C. Ribeiro; Nicholas C. Manoukis
err分享
err收藏
学者 查看更多内容