Multi-layer boosting for pattern recognition

François Fleuret

doi:10.1016/j.patrec.2008.09.012

Return

Multi-layer boosting for pattern recognition

2009-02-01

François Fleuret *

DOI：10.1016/j.patrec.2008.09.012

Original

Save

View PDF

Abstract

En 中文

We extend the standard boosting procedure to train a two-layer classifier dedicated to handwritten character recognition. The scheme we propose relies on a hidden layer which extracts feature vectors on a fixed number of points of interest, and an output layer which combines those feature vectors and the point of interest locations into a final classification decision. Our main contribution is to show that the classical AdaBoost procedure can be extended to train such a multi-layered structure by propagating the error through the output layer. Such an extension allows for the selection of optimal weak learners by minimizing a weighted error, in both the output layer and the hidden layer. We provide experimental results on the MNIST database and compare to a classical unsupervised EM-based feature extraction. (C) 2008 Elsevier B.V. All rights reserved.

Keywords:

Boosting

Multi-layer perceptron

Functional gradient descent

Convolutional network

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.