arrow
Return

Effective Active Learning Method for Spiking Neural Networks

delete2024-09-01
delete0
PRE
AI
X
Xiurui Xie
B
Bei Yu
刘贵松 cover
刘贵松 (Guisong Liu) *
占求港 cover
占求港 (Qiugang Zhan)
H
Huajin Tang
DOI:10.1109/TNNLS.2023.3257333delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A large quantity of labeled data is required to train high-performance deep spiking neural networks (SNNs), but obtaining labeled data is expensive. Active learning is proposed to reduce the quantity of labeled data required by deep learning models. However, conventional active learning methods in SNNs are not as effective as that in conventional artificial neural networks (ANNs) because of the difference in feature representation and information transmission. To address this issue, we propose an effective active learning method for a deep SNN model in this article. Specifically, a loss prediction module ActiveLossNet is proposed to extract features and select valuable samples for deep SNNs. Then, we derive the corresponding active learning algorithm for deep SNN models. Comprehensive experiments are conducted on CIFAR-10, MNIST, Fashion-MNIST, and SVHN on different SNN frameworks, including seven-layer CIFARNet and 20-layer ResNet-18. The comparison results demonstrate that the proposed active learning algorithm outperforms random selection and conventional ANN active learning methods. In addition, our method converges faster than conventional active learning methods.
Keywords:
Biological system modeling
Neurons
Learning systems
Predictive models
Training
Task analysis
Integrated circuit modeling
Active learning method
deep learning
feature representation
spiking neural network (SNN)

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

S
southwestern university of finance & economics - china
Scholars:
3.0K
Papers: 3.4K
Citations: 4
Z
zhejiang university
Scholars:
17.6W
Papers: 12.1W
Citations: 152