返回
Class separability estimation and incremental learning using boundary methods
DOI:10.1016/S0925-2312(00)00293-9.png)
摘要
En 中文
In this paper we discuss the use of boundary methods (BMs) for distribution analysis. We view these methods as tools which can be used to extract useful information from sample distributions. We believe that the information thus extracted has utility for a number of applications, but in particular we discuss the use of BMs as a mechanism for class separability estimation and as an aid to constructing robust and efficient neural networks (NNs) to solve classification problems. In the first case, BMs can establish the utility of a data set for classification. We demonstrate experimentally that the derived ranking is consistent with alternative ranking techniques based on Bayes error (epsilon). Finally, BMs are used as sample selection (SS) mechanism to train NN by means of gradient algorithms. In particular, elliptic BMs (EBMs) are used to select samples so that the initial partial training set is linearly separable. In a progressive way, new samples are added to the training set solving the problem in an incremental manner. Multi-layer perceptrons (MLPs) and radial basis functions (RBFs) have been used in this work. Our results show that the probability of being trapped in a local minimum is clearly reduced when EBMs are used, making the training independent of the initial weight values. Also, the effect of the very noisy samples and outliers is reduced when the SS-EBM algorithm is employed, so we propose this method as a robust procedure to train NNs by means of a gradient learning rule. (C) 2000 Elsevier Science B.V. All rights reserved.
Keyword:
classification neural systems
class separability estimation
Bayes' error estimation
gradient algorithms
sample selection strategies
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
暂无机构信息
引用论文
A hysteresis loop in electrical resistance of NbHx observed above the β−λ transition temperature
AIP Advances
IF0
Dysfunctions of decision‐making and cognitive control as transdiagnostic mechanisms of mental disorders: advances, gaps, and needs in current research作为精神障碍的跨诊断机制的决策和认知控制功能障碍: 当前研究的进展,差距和需求

