arrow
Return

Class separability estimation and incremental learning using boundary methods

delete2000-11-01
delete8
PRE
AI
J
José-Luis Sancho
W
William E. Pierson
B
Batu Ulug
A
Anı́bal R. Figueiras-Vidal
S
Stanley C. Ahalt
DOI:10.1016/S0925-2312(00)00293-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper we discuss the use of boundary methods (BMs) for distribution analysis. We view these methods as tools which can be used to extract useful information from sample distributions. We believe that the information thus extracted has utility for a number of applications, but in particular we discuss the use of BMs as a mechanism for class separability estimation and as an aid to constructing robust and efficient neural networks (NNs) to solve classification problems. In the first case, BMs can establish the utility of a data set for classification. We demonstrate experimentally that the derived ranking is consistent with alternative ranking techniques based on Bayes error (epsilon). Finally, BMs are used as sample selection (SS) mechanism to train NN by means of gradient algorithms. In particular, elliptic BMs (EBMs) are used to select samples so that the initial partial training set is linearly separable. In a progressive way, new samples are added to the training set solving the problem in an incremental manner. Multi-layer perceptrons (MLPs) and radial basis functions (RBFs) have been used in this work. Our results show that the probability of being trapped in a local minimum is clearly reduced when EBMs are used, making the training independent of the initial weight values. Also, the effect of the very noisy samples and outliers is reduced when the SS-EBM algorithm is employed, so we propose this method as a robust procedure to train NNs by means of a gradient learning rule. (C) 2000 Elsevier Science B.V. All rights reserved.
Keywords:
classification neural systems
class separability estimation
Bayes' error estimation
gradient algorithms
sample selection strategies

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

No organization information available
Cited Papers

Cited Papers

A hysteresis loop in electrical resistance of NbHx observed above the β−λ transition temperature
err2019-01-28
err0
errOAAI
errYuki Sasahara; Ryota Shimizu; Hiroyuki Oguchi; Kazunori Nishio; Shohei Ogura; Hitoshi Morioka; Shin-ichi Orimo; Katsuyuki Fukutani; Taro Hitosugi
errShare
errSave
errShare
errSave
Sub-Block Urban Function Recognition with the Integration of Multi-Source Data
err2022-10-16
err0
errOAAI
errBaihua Liu; Yingbin Deng; Xin Li; Miao Li; Wenlong Jing; Ji Yang; Zhehua Chen; Tao Liu
errShare
errSave
Cytomegalovirus myocarditis in transplanted heart verified by endomyocardial biopsy
err2009-02-04
err0
PREAI
errJ. Partanen; M. S. Nieminen; L. Krogerus; A. Geagea; I. Lautenschlager; P. Aarnio; S. Mattila
errShare
errSave
Microscopic characterization of petiole anatomy of Asteraceous taxa of Western Himalaya‐Pakistan
err2021-09-17
err0
PREAI
errAnam Akhtar; Mushtaq Ahmad; Tariq Mahmood; Amir Muhammad Khan; Muhammad Arfan; Qamar Abbas; Muhammad Zafar; Shazia Sultana; Rabia Batool; Anam Fatima; Siraj Khan; Sher Aman Ullah; Amjad Khan
errShare
errSave
Exchange Splitting of Electron Spins in Copper-Based Kondo Alloys
err1972-09-01
err0
PREAI
errP. T. Coleridge; G. B. Scott; I. M. Templeton
errShare
errSave
researcher View more