arrow
返回

Speeding up correlation search for binary data

delete2013-10-01
delete4
delete
OA
AI
L
Lian Duan *
W
W. Nick Street
Y
Yanchi Liu
DOI:10.1016/j.patrec.2013.05.027delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Searching correlated pairs in a collection of items is essential for many problems in commercial, medical, and scientific domains. Recently, a lot of progress has been made to speed up the search for pairs that have a high Pearson correlation (phi-coefficient). However, phi-coefficient is not the only or the best correlation measure. In this paper, we aim at an alternative task: finding correlated pairs of any good correlation measure which satisfies the three widely-accepted correlation properties in Section 2.1. In this paper, we identify a 1-dimensional monotone property of the upper bound of any good correlation measure, and different 2-dimensional monotone properties for different types of correlation measures. We can either use the 2-dimensional search algorithm to retrieve correlated pairs above a certain threshold, or our new token-ring algorithm to find top-k correlated pairs to prune many pairs without computing their correlations. The experimental results show that our robust algorithm can efficiently search correlated pairs under different situations and is an order of magnitude faster than the brute-force method. (c) 2013 Elsevier B.V. All rights reserved.
Keyword:
Correlation search
Correlation upper bound
Token-ring algorithm
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition Letters 封面图
Pattern Recognition Letters
IF:
3.3
论文数:
8.0K
被引数:
1.6W

机构

U
University of Iowa
学者数:
2.8W
论文数: 2.3W
被引数: 600
N
New Jersey Institute of Technology
学者数:
4.2K
论文数: 4.5K
被引数: 4.6K
引用论文

引用论文

Adverse Drug Effect Detection
err2013-03-01
err23
errOAAI
errDuan, Lian; Khoshneshin, Mohammad; Street, W. Nick; Liu, Mei
err分享
err收藏
MBA imaginaries: Projections of internationalization
err2011-12-15
err0
PREAI
errCarole Elliott; Sarah Robinson
err分享
err收藏
Interestingness measures for data mining: A survey
err2006-09-30
err706
PREAI
errGeng, Liqiang; Hamilton, Howard J.
err分享
err收藏
Inherited variation in immune response genes in follicular lymphoma and diffuse large B-cell lymphoma
err2015-07-07
err0
PREAI
errKaspar Rene Nielsen; Rudi Steffensen; Thure Mors Haunstrup; Julie Støve Bødker; Karen Dybkær; John Baech; Martin Bøgsted; Hans Erik Johnsen
err分享
err收藏
err分享
err收藏
Discovering significant patterns
err2007-04-14
err173
errOAAI
errWebb, Geoffrey I.
err分享
err收藏
err分享
err收藏
学者 查看更多内容