arrow
返回

Learning to recognize webpage genres

delete2009-09-01
delete28
PRE
AI
E
Efstathios Stamatatos *
DOI:10.1016/j.ipm.2009.05.003delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Webpages are mainly distinguished by their topic (e.g., politics, sports etc.) and genre (e.g., blogs, homepages, e-shops, etc.). Automatic detection of webpage genre could considerably enhance the ability of modern search engines to focus on the requirements of the user's information need. In this paper, we present an approach to webpage genre detection based on a fully-automated extraction of the feature set that represents the style of webpages. The features we propose (character n-grams of variable length and HTML tags) are language-independent and easily-extracted while they can be adapted to the properties of the still evolving web genres and the noisy environment of the web. Experiments based on two publicly-available corpora show that the performance of the proposed approach is superior in comparison to previously reported results. It is also shown that character n-grams are better features than words when the dimensionality increases while the binary representation is more effective than the term-frequency representation for both feature types. Moreover, we perform a series of cross-check experiments (e.g., training using a genre palette and testing using a different genre palette as well as using the features extracted from one corpus to discriminate the genres of the other corpus) to illustrate the robustness of our approach and its ability to capture the general stylistic properties of genre categories even when the feature set is not optimized for the given corpus. (C) 2009 Elsevier Ltd. All rights reserved.
Keyword:
Web genre classification
Webpage representation
Character n-grams
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
Information Processing and Management
IF:
6.9
论文数:
5.2K
被引数:
1.4W

机构

U
University of Aegean
学者数:
1.8K
论文数: 1.6K
被引数: 5
引用论文

引用论文

Analysis of Voltage Distortions in the Power Grid Arising from Agricultural Biogas Plant Operation
err2023-08-25
err0
errOAAI
errMaciej Kuboń; Zbigniew Skibko; Sylwester Tabor; Urszula Malaga-Toboła; Andrzej Borusiewicz; Wacław Romaniuk; Janusz Zarajczyk; Pavel Neuberger
err分享
err收藏
Theoretical and empirical analysis of ReliefF and RReliefF
err2003-01-01
err2.4K
errOAAI
errRobnik-Sikonja, M; Kononenko, I
err分享
err收藏
学者 查看更多内容