A novel combining classifier method based on Variational Inference

doi:10.1016/j.patcog.2015.06.016

Return

A novel combining classifier method based on Variational Inference

2016-01-01

PRE

Tien Thanh Nguyen

Nguyễn Thị Thu Thủy

Xuan Cuong Pham

Alan Wee‐Chung Liew *

DOI：10.1016/j.patcog.2015.06.016

Original

Original request for help

Save

Abstract

En 中文

In this paper, we propose a combining classifier method based on the Bayesian inference framework. Specifically, the outputs of base classifiers (called Level1 data or meta-data) are utilized in a combiner to produce the final classification. In our ensemble system, each class in the training set induces a distribution on the Level1 data, which is modeled by a multivariate Gaussian distribution. Traditionally, the parameters of the Gaussian are estimated using a maximum likelihood approach. However, maximum likelihood estimation cannot be applied since the covariance matrix of Level1 data of each class is not full rank. Instead, we propose to estimate the multivariate Gaussian distribution of Level1 data of each class by using the Variational Inference method. Experiments conducted on eighteen UCI Machine Learning Repository datasets and a selected 10-class CLEF2009 medical imaging database demonstrated the advantage of our method compared with several well-known ensemble methods. (C) 2015 Elsevier Ltd. All rights reserved.

Keywords:

Ensemble method

Multi classifier system

Mixture of experts

Classifier fusion

Combining classifier algorithm

Variational Inference

Multivariate Gaussian distribution

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.