arrow
返回

Adaptive one-pass passive-aggressive radial basis function for classification problems

delete2022-06-01
delete0
PRE
AI
M
Maedeh Kafiyan-Safari
M
Modjtaba Rouhani *
DOI:10.1016/j.neucom.2022.03.047delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper presents a novel adaptive one-pass Passive-Aggressive Radial Basis Function (APARBF) for classification problems. The APARBF uses elliptic Gaussian neurons followed by a Softmax layer and cross-entropy loss function. This network tries to overcome the elasticity-plasticity dilemma by using the Passive-Aggressive (PA) algorithm and adapting the hidden layer structure. The weight updates have to be plastic to acquire the most information from each sample and at the same time need to be elastic to retrain the information from the past instances. Inspired by PA, a novel update formula for cross-entropy loss minimization has been derived. The adaptive design of the network lets it start with zero hidden neurons and grow or shrink according to the data. For kernel parameters, the adaptive structure determines the correct number of hidden neurons and updates recursively each neuron's center and covariance matrix. To evaluate our network, we perform two series of experiments. The first experiments compare the proposed APARBF with other recently developed one-pass algorithms (i.e., OVIG, OBHT, SCW, AROW, OGD, and PA). The subsequent experiments include comparing the proposed algorithm with some online adaptive structures such as FGAP-RBF, C-Mantec, McNN, and PBL-McNN, based on their mean classification error and the number of hidden neurons. Wilcoxon sign rank test and Friedman test clearly show the superiority of the proposed network's results compared with its competitors in one-pass classification problems.(c) 2022 Elsevier B.V. All rights reserved.
Keyword:
One-pass algorithms
Adaptive structure neural network
Passive-aggressive algorithm
Radial basis function
Cross-entropy

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

F
Ferdowsi University Mashhad
学者数:
8.1K
论文数: 7.5K
被引数: 44
引用论文

引用论文

A review of novelty detection新颖性检测综述
err2014-06-01
err1.2K
PREAI
errPimentel, Marco A. F.; Clifton, David A.; Clifton, Lei; Tarassenko, Lionel
err分享
err收藏
Frequency and Determinants of Flare and Persistently Active Disease in a Large Multinational Prospective Lupus Cohort系统性红斑狼疮大型跨国前瞻性队列中flare和持续性活动性疾病的频率与决定因素
err2025-02-26
err0
errOAAI
errHao, YJ; Hansen, D; Louthrenoo, W; Chen, YH; Cho, JC; Lateef, A; Hamijoyo, L; Luo, SF; Wu, YJ; Navarra, S; Zamora, L; Li, ZG; Sockalingam, S; Katsumata, Y; Harigai, M; Ji, LL; Zhang, ZL; Chan, M; Kikuchi, J; Takeuchi, T; Bae, SC; Goldblatt, F; O'Neill, S; Ng, K; Basnayake, BMDB; Tugnet, N; Ohkubo, N; Tanaka, Y; Tee, C; Tee, M; Lau, CS; Li, N; Golder, V; Hoi, A; Kandane-Rathnayake, R; Morand, E; Oon, S; Nikpour, M; Asia Pacific Lupus Collaboration
err分享
err收藏
Adaptive regularization of weight vectors
err2013-03-22
err203
errOAAI
errCrammer, Koby; Kulesza, Alex; Dredze, Mark
err分享
err收藏
err分享
err收藏
Impact of Flax Fiber Reinforcement on Mechanical Properties of Solid and Foamed Geopolymer Concrete
err2020-09-08
err0
errOAAI
errKinga Korniejenko; Michał Łach; Maria Hebdowska-Krupa; Janusz Mikuła
err分享
err收藏
Water quality control in a closed re-circulating system of Pacific white shrimp (Penaeus vannamei) postlarvae co-cultured with immobilized Spirulina mat
err2013-12-20
err0
PREAI
errSiriphorn Sombatjinda; Chalermraj Wantawin; Somkiet Techkarnjanaruk; Boonsirm Withyachumnarnkul; Marasri Ruengjitchatchawalya
err分享
err收藏
err分享
err收藏
Metacognitive Sedenion-Valued Neural Network and its Learning Algorithm
err2020-01-01
err11
errOAAI
errSaoud, Lyes Saad; Al-Marzouqi, Hasan
err分享
err收藏
学者 查看更多内容