arrow
Return

Wallenius Bayes

delete2018-02-22
delete7
delete
OA
AI
E
Enric Junqué de Fortuny *
D
David Martens
F
Foster Provost
DOI:10.1007/s10994-018-5699-zdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This paper introduces a new event model appropriate for classifying (binary) data generated by a destructive choice process, such as certain human behavior. In such a process, making a choice removes that choice from future consideration yet does not influence the relative probability of other choices in the choice set. The proposed Wallenius event model is based on a somewhat forgotten non-central hypergeometric distribution introduced by Wallenius (Biased sampling: the non-central hypergeometric probability distribution. Ph.D. thesis, Stanford University, 1963). We discuss its relationship with models of how human choice behavior is generated, highlighting a key (simple) mathematical property. We use this background to describe specifically why traditional multivariate Bernoulli naive Bayes and multinomial naive Bayes each are suboptimal for such data. We then present an implementation of naive Bayes based on the Wallenius event model, and show experimentally that for data where we would expect the features to be generated via destructive choice behavior Wallenius Bayes indeed outperforms the traditional versions of naive Bayes for prediction based on these features. Furthermore, we also show that it is competitive with non-naive methods (in particular, support-vector machines). In contrast, we also show that Wallenius Bayes underperforms when the data generating process is not based on destructive choice.
Keywords:
Naive Bayes
Wallenius distribution
Destructive choice
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

U
University of Antwerp
Scholars:
2.1W
Papers: 1.9W
Citations: 2.6W
N
New York University
Scholars:
4.4W
Papers: 3.9W
Citations: 5.8W
N
NYU Shanghai
Scholars:
501
Papers: 577
Citations: 11
researcher View more organizations