.png){kind=icon}
返回
Convergence Diagnostics for Entity Resolution
.png){kind=icon}
OA
AI
DOI：10.1146/annurev-statistics-040522-114848.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Entity resolution is the process of merging and removing duplicate records from multiple data sources, often in the absence of unique identifiers. Bayesian models for entity resolution allow one to include a priori information, quantify uncertainty in important applications, and directly estimate a partition of the records. Markov chain Monte Carlo (MCMC) sampling is the primary computational method for approximate posterior inference in this setting, but due to the high dimensionality of the space of partitions, there are no agreed upon standards for diagnosing nonconvergence of MCMC sampling. In this article, we review Bayesian entity resolution, with a focus on the specific challenges that it poses for the convergence of a Markov chain. We review prior methods for convergence diagnostics, discussing their weaknesses. We provide recommendations for using MCMC sampling for Bayesian entity resolution, focusing on the use of modern diagnostics that are commonplace in applied Bayesian statistics. Using simulated data, we find that a commonly used Gibbs sampler performs poorly compared with two alternatives.
Keyword:
convergence diagnostics
duplicate detection
entity resolution
Markov chain Monte Carlo
partition
record linkage
期刊
IF:
8.7
论文数:
211
被引数:
2.4K
机构
引用论文
.png){kind=icon}
分享收藏
查看更多内容