.png){kind=icon}
返回
Stratified sampling for data mining on the deep web
.png){kind=icon}
PRE
AI
DOI：10.1007/s11704-012-2859-3.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In recent years, the deep web has become extremely popular. Like any other data source, data mining on the deep web can produce important insights or summaries of results. However, data mining on the deep web is challenging because the databases cannot be accessed directly, and therefore, data mining must be performed by sampling the datasets. The samples, in turn, can only be obtained by querying deep web databases with specific inputs. In this paper, we target two related data mining problems, association mining and differential rule mining. These are proposed to extract high-level summaries of the differences in data provided by different deep web data sources in the same domain. We develop stratified sampling methods to perform these mining tasks on a deep web source. Our contributions include a novel greedy stratification approach, which recursively processes the query space of a deep web data source, and considers both the estimation error and the sampling costs. We have also developed an optimized sample allocation method that integrates estimation error and sampling costs. Our experimental results show that our algorithms effectively and consistently reduce sampling costs, compared with a stratified sampling method that only considers estimation error. In addition, compared with simple random sampling, our algorithm has higher sampling accuracy and lower sampling costs.
Keyword:
deep web
associate rule mining
stratified sampling
期刊
IF:
4.6
论文数:
1.6K
被引数:
2.8K
机构
引用论文
Distributed Bayesian Computation and Self-Organized Learning in Sheets of Spiking Neurons with Local Lateral Inhibition.png)
PLOS ONE
OAAI
PLOS ONEIF0
OAAI分享收藏分享收藏分享收藏Inherited arrhythmias and gene therapy: Are there any ethical considerations to take into account?
OAAI
OAAI分享收藏
查看更多内容