.png){kind=icon}
返回
Deep multi-threshold spiking-UNet for image processing
.png){kind=icon}
OA
AI
DOI：10.1016/j.neucom.2024.127653.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
U -Net, known for its simple yet efficient architecture, is widely utilized for image processing tasks and is particularly suitable for deployment on neuromorphic chips. This paper introduces the novel concept of Spiking-UNet for image processing, which combines the power of Spiking Neural Networks (SNNs) with the U -Net architecture. To achieve an efficient Spiking-UNet, we face two primary challenges: ensuring highfidelity information propagation through the network via spikes and formulating an effective training strategy. To address the issue of information loss, we introduce multi -threshold spiking neurons, which improve the efficiency of information transmission within the Spiking-UNet. For the training strategy, we adopt a conversion and fine-tuning pipeline that leverage pre -trained U -Net models. During the conversion process, significant variability in data distribution across different parts is observed when utilizing skip connections. Therefore, we propose a connection -wise normalization method to prevent inaccurate firing rates. Furthermore, we adopt a flow -based training method to fine-tune the converted models, reducing time steps while preserving performance. Experimental results show that, on image segmentation and denoising, our Spiking-UNet achieves comparable performance to its non -spiking counterpart, surpassing existing SNN methods. Compared with the converted Spiking-UNet without fine-tuning, our Spiking-UNet reduces inference time by approximately 90%. This research broadens the application scope of SNNs in image processing and is expected to inspire further exploration in the field of neuromorphic engineering. The code for our Spiking-UNet implementation is available at https://github.com/SNNresearch/Spiking-UNet.
Keyword:
U-Net
Spiking neural network
Multi-threshold spiking neuron
Weight normalization
Image segmentation
Image denoising
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Contributions of evacuation proctography and anorectal manometry to evaluation of adults with constipation and defecatory difficulty排空直肠造影和肛门直肠测压对成人便秘和排便困难的评估的贡献
PREAI
分享收藏Optical flow estimation from event-based cameras and spiking neural networks来自基于事件的相机和尖峰神经网络的光流估计OAAI
OAAI分享收藏Global-Feature Encoding U-Net (GEU-Net) for Multi-Focus Image Fusion用于多聚焦图像融合的全局特征编码u-net (geu-net)
PREAI
分享收藏StereoSpike: Depth Learning With a Spiking Neural NetworkStereoSpike: 使用尖峰神经网络进行深度学习.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏分享收藏
查看更多内容