arrow
返回

Learning to crawl: Comparing classification schemes

delete2005-10-01
delete94
PRE
AI
G
Gautam Pant
P
Padmini Srinivasan
DOI:10.1145/1095872.1095875delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Topical crawling is a young and creative area of research that holds the promise of benefiting from several sophisticated data mining techniques. The use of classification algorithms to guide topical crawlers has been sporadically suggested in the literature. No systematic study, however, has been done on their relative merits. Using the lessons learned from our previous crawler evaluation studies, we experiment with multiple versions of different classification schemes. The crawling process is modeled as a parallel best-first search over a graph defined by the Web. The classifiers provide heuristics to the crawler thus biasing it towards certain portions of the Web graph. Our results show that Naive Bayes is a weak choice for guiding a topical crawler when compared with Support Vector Machine or Neural Network. Further, the weak performance of Naive Bayes can be partly explained by extreme skewness of posterior probabilities generated by it. We also observe that despite similar performances, different topical crawlers cover subspaces on the Web with low overlap.
Keyword:
topical crawlers
focused crawlers
classifiers
machine learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Information Systems 封面图
ACM Transactions on Information Systems
IF:
9.1
论文数:
1.2K
被引数:
4.7K

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
Stereotyped: Investigating Gender in Introductory Science Courses刻板印象: 在入门科学课程中调查性别
err2013-03-01
err0
errOAAI
errShanda Lauer; Jennifer Momsen; Erika Offerdahl; Mila Kryjevskaia; Warren Christensen; Lisa Montplaisir
err分享
err收藏
学者 查看更多内容