arrow
Return

Paradoxical Correlation Pattern Mining

delete2018-08-01
delete3
delete
OA
AI
周文君 (Wenjun Zhou)
H
Hui Xiong *
L
Lian Duan
K
Keli Xiao
R
Robert W. Mee
DOI:10.1109/TKDE.2018.2791602delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Given a large transactional database, correlation computing/association analysis aims at efficiently finding strongly correlated items. For traditional association analysis, relationships among variables are usually measured at a global level. In this study, we investigate confounding factors that can help to capture abnormal correlation behaviors at a local level. Indeed, many real-world phenomena are localized to specific markets or subpopulations. Such local relationships may not be visible or may be miscalculated when collectively analyzing the entire data. In particular, confounding effects that change the direction of correlation are a most severe problem because the global correlations alone leads to errant conclusions. To this end, we propose CONFOUND, an efficient algorithm to identify paradoxical correlation patterns (i.e., where controlling for a third item changes the direction of association for strongly correlated pairs) using effective pruning strategies. Moreover, we also provide an enhanced version of this algorithm, called CONFOUND+, which substantially speeds up the confounder search step. Finally, experimental results showed that our proposed CONFOUND and CONFOUND+ algorithms can effectively identify confounders and the computational performance is orders of magnitude faster than benchmark methods.
Keywords:
Correlation coefficient
correlation computing
partial correlation
local patterns
confounder
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

R
rutgers university - newark
Scholars:
2.1K
Papers: 1.6K
Citations: 2
R
rutgers university system
Scholars:
4.1W
Papers: 3.7W
Citations: 53
U
University of Tennessee Knoxville
Scholars:
1.1W
Papers: 9.4K
Citations: 17
University of Tennessee System cover
University of Tennessee System
Scholars:
2.9W
Papers: 2.6W
Citations: 115
researcher View more organizations
Cited Papers

Cited Papers

Adverse Drug Effect Detection
err2013-03-01
err23
errOAAI
errDuan, Lian; Khoshneshin, Mohammad; Street, W. Nick; Liu, Mei
errShare
errSave
errShare
errSave
Fertilization and early embryology: Detection of fertilization in embryos with accelerated cleavage by fluorescent in-situ hybridization (FISH)
err1994-09-01
err0
PREAI
errJoyce C. Harper; Fiona Robinson; Suzy Duffy; Darren K. Griffin; AlanH. Handyside; Joy D.A. Delhanty; Robert M.L. Winston
errShare
errSave
errShare
errSave
Bioactivity Evaluation of Plant Extracts Used in Indigenous Medicine against the Snail,Biomphalaria glabrata, and the Larvae ofAedes aegypti
err2012-01-01
err0
errOAAI
errEdilson Alves dos Santos; Cenira M. de Carvalho; Ana L. S. Costa; Adilva S. Conceição; Flávia de B. Prado Moura; Antônio Euzébio Goulart Santana
errShare
errSave
researcher View more