arrow
返回

TEXT: Automatic Template Extraction from Heterogeneous Web Pages

delete2011-04-01
delete25
PRE
AI
K
Kyuseok Shim
DOI:10.1109/TKDE.2010.140delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
World Wide Web is the most useful source of information. In order to achieve high productivity of publishing, the webpages in many websites are automatically populated by using the common templates with contents. The templates provide readers easy access to the contents guided by consistent structures. However, for machines, the templates are considered harmful since they degrade the accuracy and performance of web applications due to irrelevant terms in templates. Thus, template detection techniques have received a lot of attention recently to improve the performance of search engines, clustering, and classification of web documents. In this paper, we present novel algorithms for extracting templates from a large number of web documents which are generated from heterogeneous templates. We cluster the web documents based on the similarity of underlying template structures in the documents so that the template for each cluster is extracted simultaneously. We develop a novel goodness measure with its fast approximation for clustering and provide comprehensive analysis of our algorithm. Our experimental results with real-life data sets confirm the effectiveness and robustness of our algorithm compared to the state of the art for template detection algorithms.
Keyword:
Template extraction
clustering
minimum description length principle
MinHash
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.9K
被引数:
3.2W

机构

S
seoul national university (snu)
学者数:
7.2W
论文数: 6.6W
被引数: 86
引用论文

引用论文

Overexpression of Contactin 1 promotes growth, migration and invasion in Hs578T breast cancer cells
err2018-04-19
err0
errOAAI
errNan Chen; Sai He; Jie Geng; Zhang-Jun Song; Pi-Hua Han; Juan Qin; Zheng Zhao; Yong-Chun Song; Hu-Xia Wang; Cheng-Xue Dang
err分享
err收藏
Treatment of Keratoacanthomas with Oral 13-cis-Retinoic Acid
err1980-09-04
err0
PREAI
errRichard P. Haydey; Michael L. Reed; Leonard M. Dzubow; Jerome L. Shupack
err分享
err收藏
Value of Continuous Passive Motion in Total Knee Arthroplasty
err1990-03-01
err0
PREAI
errStephen A Wasilewski; Lee C Woods; William R Torgerson; William L Healy
err分享
err收藏
Mössbauer spectroscopical investigation of the exchange biased Fe/MnF2 interface
err2006-10-27
err0
PREAI
errB. Sahoo; W. A. A. Macedo; W. Keune; V. Kuncser; J. Eisenmenger; J. Nogués; I. K. Schuller; I. Felner; Kai Liu; R. Röhlsberger
err分享
err收藏
BCL-2 Expression in Childhood Leukemia Versus Spontaneous Apoptosis, Drug Induced Apoptosis, and in vitro Drug Resistance
err1999-01-01
err0
PREAI
errE. G. Haarman; G. J. L. Kaspers; R. Pieters; C. H. van Zantwijk; G. J. Broekema; K. Hählen; A. J. P. Veerman
err分享
err收藏
学者 查看更多内容