arrow
Return

Data stream classification using a deep transfer learning method based on extreme learning machine and recurrent neural network

delete2024-01-11
delete0
PRE
AI
M
Mehdi Eskandari
H
Hassan Khotanlou *
DOI:10.1007/s11042-023-18075-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep learning-based approaches have gained popularity for many applications in recent years and have become the state-of-the-art method in machine learning applications. However, most deep learning applications manipulate static data sets that do not vary over time. This is not the case for several significant recent applications, particularly for online learning on data streams that require real-time adjustment to the latest data context. This paper presents an architecture derived from the theory of transfer learning utilizing Extreme Learning Machine (ELM) and Recurrent Neural Network (RNN) methods. Unlike most data stream applications, when receiving high volumes of data at a high velocity, the proposed method does not store and reuse previous observations. The proposed model uses a Deep Echo State Network (DeepESN) for the primary classification task to compensate for the lack of past data. More precisely, instead of the data itself, we propagate generative models so that historical training data that is not stored can be regenerated. Before the DeepESN block, a layer of pre-trained ELMs was used to have generic feature engineering. The proposed method was tested on well-known benchmark data sets, and it outperformed the state-of-the-art models by an accuracy improvement ranging from 0.02 to 3.3 percent. The impact of data set regeneration on the learning process was studied using different RNN approaches.
Keywords:
Data streams
Deep learning
Adaptive learning
Transfer learning

Journal

Multimedia Tools and Applications cover
Multimedia Tools and Applications
IF:
3
Papers:
2.0W
Citations:
3.2W

Organization

B
bu ali sina university
Scholars:
3.1K
Papers: 3.1K
Citations: 34
Cited Papers

Cited Papers

errShare
errSave
Tailored conditions for controlled and fast growth of surface-grafted PNIPAM brushes
err2016-08-01
err0
PREAI
errA. Pomorska; K. Wolski; A. Puciul-Malinowska; S. Zapotoczny
errShare
errSave
Data Stream Classification Based on Extreme Learning Machine: Review
err2022-11-01
err10
PREAI
errZheng, Xiulin; Li, Peipei; Wu, Xindong
errShare
errSave
A novel semi-supervised classification approach for evolving data streams
err2023-04-01
err13
PREAI
errLiao, Guobo; Zhang, Peng; Yin, Hongpeng; Deng, Xuanhong; Li, Yanxia; Zhou, Han; Zhao, Dandan
errShare
errSave
Managed honeybee colony losses of the Eastern honeybee (Apis cerana) in China (2011–2014)
err2017-05-29
err0
errOAAI
errChao Chen; Zhiguang Liu; Yuexiong Luo; Zheng Xu; Shunhai Wang; Xuewen Zhang; Rongguo Dai; Jinglin Gao; Xiao Chen; Haikun Guo; Huihua Wang; Jiao Tang; Wei Shi
errShare
errSave
A Survey on Concept Drift Adaptation
err2014-03-01
err2.0K
errOAAI
errGama, Joao; Zliobaite, Indre; Bifet, Albert; Pechenizkiy, Mykola; Bouchachia, Abdelhamid
errShare
errSave
researcher View more