.png){kind=icon}
返回
Multi-attribute dynamic attenuation learning improved spiking actor network
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2024.128819.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep reinforcement learning (DRL) has shown promising results in solving robotic control and decision tasks, which can learn the high-dimensional state and action information well. Despite their successes, conventional neural-based DRL models are criticized for low energy efficiency, making them laborious to be widely applied in low-power electronics. With more biologically plausible plasticity principles, spiking neural networks (SNNs) are now considered an energy-efficient and robust alternative. The most existing dynamics and learning paradigms for spiking neurons with a common Leaky Integrate-and-Fire (LIF) neuron model often result in relatively low efficiency and poor robustness. To address these limitations, we propose a multi-attribute dynamic attenuation learning improved spiking actor network (MADA-SAN) for reinforcement learning to achieve effective decision-making. The resistance, membrane voltage and membrane current of spiking neurons are updated from a fixed value into dynamic attenuation. By enhancing the temporal relation dependencies in neurons, this model can learn the spatio-temporal relevance of complex continuous information well. Extensive experimental results show MADA-SAN performs better than its counterpart deep actor network on six continuous control tasks from OpenAI gym. Besides, we further validated the proposed MADA-LIF can achieve comparable performance with other state-of-the-art algorithms on MNIST and DVS-gesture recognition tasks.
Keyword:
Deep reinforcement learning
Spiking neural networks
Continuous control tasks
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
An adaptive threshold neuron for recurrent spiking neural networks with nanodevice hardware implementation.png)
NATURE COMMUNICATIONS
OAAI
NATURE COMMUNICATIONSIF15.7
OAAI分享收藏Spontaneous and Stimulated Emission from GaAs Diodes with Three-Layer Structures三层结构GaAs二极管的自发与受激辐射
PREAI
分享收藏
查看更多内容