arrow
返回

VChunkJoin: An Efficient Algorithm for Edit Similarity Joins

delete2013-08-01
delete46
PRE
AI
王伟 封面图
王伟 (Wei Wang) *
J
Jianbin Qin
C
Chuan Xiao
林学民 (Xuemin Lin)
H
Heng Tao Shen
DOI:10.1109/TKDE.2012.79delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Similarity joins play an important role in many application areas, such as data integration and cleaning, record linkage, and pattern recognition. In this paper, we study efficient algorithms for similarity joins with an edit distance constraint. Currently, the most prevalent approach is based on extracting overlapping grams from strings and considering only strings that share a certain number of grams as candidates. Unlike these existing approaches, we propose a novel approach to edit similarity join based on extracting nonoverlapping substrings, or chunks, from strings. We propose a class of chunking schemes based on the notion of tail-restricted chunk boundary dictionary. A new algorithm, VChunkJoin, is designed by integrating existing filtering methods and several new filters unique to our chunk-based method. We also design a greedy algorithm to automatically select a good chunking scheme for a given data set. We demonstrate experimentally that the new algorithm is faster than alternative methods yet occupies less space.
Keyword:
Edit similarity joins
approximate string matching
prefix filtering
q-gram
edit distance
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

N
Nagoya University
学者数:
3.3W
论文数: 2.5W
被引数: 2.6W
U
University of Queensland
学者数:
5.0W
论文数: 5.1W
被引数: 9.2W
引用论文

引用论文

The Tumour Suppressor TMEM127 Is a Nedd4-Family E3 Ligase Adaptor Required by Salmonella SteD to Ubiquitinate and Degrade MHC Class II Molecules
err2020-07-01
err0
errOAAI
errEric Alix; Camilla Godlee; Ondrej Cerny; Samkeliso Blundell; Romina Tocci; Sophie Matthews; Mei Liu; Jonathan N. Pruneda; Kirby N. Swatek; David Komander; Tabitha Sleap; David W. Holden
err分享
err收藏
err分享
err收藏
Calibration and application of marine sedimentary physical properties using a multi-sensor core logger
err1997-01-01
err0
PREAI
errMichael E. Weber; Frank Niessen; Gerhard Kuhn; Michael Wiedicke
err分享
err收藏
err分享
err收藏
学者 查看更多内容