Incremental learning with multi-level adaptation

doi:10.1016/j.neucom.2010.12.017

Return

Incremental learning with multi-level adaptation

2011-05-01

PRE

Abdelhamid Bouchachia *

DOI：10.1016/j.neucom.2010.12.017

Original

Original request for help

Save

Abstract

En 中文

Self-adaptation is an inherent part of any natural and intelligent system. Specifically, it is about the ability of a system to reconcile its requirements or goal of existence with the environment it is interacting with, by adopting an optimal behavior. Self-adaptation becomes crucial when the environment changes dynamically over time. In this paper, we investigate self-adaptation of classification systems at three levels: (1) natural adaptation of the base learners to change in the environment, (2) contributive adaptation when combining the base learners in an ensemble, and (3) structural adaptation of the combination as a form of dynamic ensemble. The present study focuses on neural network classification systems to handle a special facet of self-adaptation, that is, incremental learning (IL). With IL, the system self-adjusts to accommodate new and possibly non-stationary data samples arriving over time. The paper discusses various IL algorithms and shows how the three adaptation levels are inherent in the system's architecture proposed and how this architecture is efficient in dealing with dynamic change in the presence of various types of data drift when applying these IL algorithms. (C) 2011 Elsevier B.V. All rights reserved.

Keywords:

Adaptation

Incremental learning

Classification

Ensemble learning

Dynamic environments

Drift

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.