arrow
Return

Discovering significant patterns

delete2007-04-14
delete173
delete
OA
AI
G
Geoffrey I. Webb *
DOI:10.1007/s10994-007-5006-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Pattern discovery techniques, such as association rule discovery, explore large search spaces of potential patterns to find those that satisfy some user-specified constraints. Due to the large number of patterns considered, they suffer from an extreme risk of type-1 error, that is, of finding patterns that appear due to chance alone to satisfy the constraints on the sample data. This paper proposes techniques to overcome this problem by applying well-established statistical practices. These allow the user to enforce a strict upper limit on the risk of experimentwise error. Empirical studies demonstrate that standard pattern discovery techniques can discover numerous spurious patterns when applied to random data and when applied to real-world data result in large numbers of patterns that are rejected when subjected to sound statistical evaluation. They also reveal that a number of pragmatic choices about how such tests are performed can greatly affect their power.
Keywords:
pattern discovery
statistical evaluation
association rules

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

No organization information available
Cited Papers

Cited Papers

Chlorpromazine and human sleep
err1971-01-01
err0
PREAI
errBoyd K. Lester; Joe D. Coulter; Lawrence C. Cowden; Harold L. Williams
errShare
errSave
errShare
errSave
Greater uterine artery blood flow during pregnancy in multigenerational (Andean) than shorter-term (European) high-altitude residents
err2007-09-01
err0
PREAI
errMegan J. Wilson; Miriam Lopez; Marco Vargas; Colleen Julian; Wilma Tellez; Armando Rodriguez; Abigail Bigham; J. Fernando Armaza; Susan Niermeyer; Mark Shriver; Enrique Vargas; Lorna G. Moore
errShare
errSave
errShare
errSave
Acute Nicotine Administration Increases BOLD fMRI Signal in Brain Regions Involved in Reward Signaling and Compulsive Drug Intake in Rats
err2014-10-31
err0
errOAAI
errA. W. Bruijnzeel; J. C. Alexander; P. D. Perez; R. Bauzo-Rodriguez; G. Hall; R. Klausner; V. Guerra; H. Zeng; M. Igari; M. Febo
errShare
errSave
Über die Existenz von Aeetylphosphiten
err2010-08-31
err0
PREAI
errAngelika Piehl; Jochen Neels; Manfred Meisel
errShare
errSave
researcher View more