arrow
返回

Statistically Significant Pattern Mining With Ordinal Utility

delete2023-09-01
delete0
delete
OA
AI
T
Thien Q. Tran *
K
Kazuto Fukuchi
Y
Youhei Akimoto
J
Jun Sakuma
DOI:10.1109/TKDE.2022.3208626delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Statistically significant pattern mining (SSPM), which evaluates each pattern via a hypothesis test, is an essential and challenging data mining task for knowledge discovery. We introduce a preference relation between patterns and aim to discover the most preferred patterns under the constraint of statistical significance, which has never been considered in existing SSPM problems. We propose an iterative multiple testing procedure that can alternately reject a hypothesis and safely ignore the less useful hypotheses than the rejected one. By filtering out patterns with low utility, we can avoid the significance budget consumption of rejecting useless (uninteresting) patterns and focus the significance budget on more useful patterns, leading to more useful discoveries. We show that the proposed method can control the familywise error rate (FWER) under certain assumptions, which can be satisfied by a realistic problem class in SSPM. We also show that the proposed method always discovers equally or more useful patterns than Tarone-Bonferroni and Subfamily-wise Multiple Testing (SMT). Finally, we conducted several experiments with both synthetic and real-world data to evaluate the performance of our method. The proposed method discovered many more useful patterns in the experiments with real-world datasets than the existing method for all five conducted tasks.
Keyword:
High-utility pattern
multiple testing
significant pattern mining

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

U
University of Tsukuba
学者数:
1.8W
论文数: 1.5W
被引数: 1.7W
引用论文

引用论文

err分享
err收藏
ENSEMBLE-ADJUSTED P-VALUES
err1983-11-01
err52
PREAI
errROSENTHAL, R; RUBIN, DB
err分享
err收藏
A Novel Family of Magnesium Transport Genes in Arabidopsis
err2001-12-01
err0
PREAI
errLegong Li; Ana F. Tutone; Revel S. M. Drummond; Richard C. Gardner; Sheng Luan
err分享
err收藏
err分享
err收藏
Sequential selection procedures and false discovery rate control
err2015-07-08
err106
errOAAI
errG'Sell, Max Grazier; Wager, Stefan; Chouldechova, Alexandra; Tibshirani, Robert
err分享
err收藏
In situ Foaming Evolution of Flexible Polyurethane Foam Nanocomposites
err2011-03-07
err0
errOAAI
errM. Mar Bernal; Miguel Angel Lopez‐Manchado; Raquel Verdejo
err分享
err收藏
学者 查看更多内容