arrow
Return

Efficient model selection for probabilistic K nearest neighbour classification

delete2015-02-01
delete14
delete
OA
AI
J
Ji Won Yoon *
N
Nial Friel
DOI:10.1016/j.neucom.2014.07.023delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Probabilistic K-nearest neighbour (PKNN) classification has been introduced to improve the performance of the original K-nearest neighbour (KNN) classification algorithm by explicitly modelling uncertainty in the classification of each feature vector. However, an issue common to both KNN and PKNN is to select the optimal number of neighbours, K. The contribution of this paper is to incorporate the uncertainty in K into the decision making, and consequently to provide improved classification with Bayesian model averaging. Indeed the problem of assessing the uncertainty in K can be viewed as one of statistical model selection which is one of the most important technical issues in the statistics and machine learning domain. In this paper, we develop a new functional approximation algorithm to reconstruct the density of the model (order) without relying on time consuming Monte Carlo simulations. In addition, the algorithms avoid cross validation by adopting Bayesian framework. The performance of the proposed approaches is evaluated on several real experimental datasets. (C) 2014 Elsevier B.V. All rights reserved.
Keywords:
Bayesian inference
Model averaging
K-free model order estimation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

K
Korea University
Scholars:
3.6W
Papers: 3.8W
Citations: 4.4W
U
university college dublin
Scholars:
2.6W
Papers: 2.2W
Citations: 22