arrow
返回

Noise reduction through summarization for web-page classification

delete2007-11-01
delete20
delete
OA
AI
Qiang Yang 封面图
Qiang Yang (Qiang Yang)
Z
Zheng Chen
DOI:10.1016/j.ipm.2007.01.013delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Due to a large variety of noisy information embedded in Web pages, Web-page classification is much more difficult than pure-text classification. In this paper, we propose to improve the Web-page classification performance by removing the noise through summarization techniques. We first give empirical evidence that ideal Web-page summaries generated by human editors can indeed improve the performance of Web-page classification algorithms. We then put forward a new Web-page summarization algorithm based on Web-page layout and evaluate it along with several other state-of-the-art text summarization algorithms on the LookSmart Web directory. Experimental results show that the classification algorithms (NB or SVM) augmented by any summarization approach can achieve an improvement by more than 5.0% as compared to pure-text-based classification algorithms. We further introduce an ensemble method to combine the different summarization algorithms. The ensemble summarization method achieves more than 12.0% improvement over pure-text based methods. (C) 2007 Published by Elsevier Ltd.
Keyword:
web-page categorization
web-page summarization
content body
noise reduction
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
Information Processing and Management
IF:
6.9
论文数:
5.2K
被引数:
1.4W

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
Support-vector networks支持向量网络
err1995-09-01
err0
errOAAI
errCorinna Cortes; Vladimir Vapnik
err分享
err收藏
学者 查看更多内容