arrow
返回

NeuroSEE: A Neuromorphic Energy-Efficient Processing Framework for Visual Prostheses

delete2022-08-01
delete3
PRE
AI
C
Chuanqing Wang
J
Jie Yang
M
Mohamad Sawan *
DOI:10.1109/JBHI.2022.3172306delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Visual prostheses with both comprehensive visual signal processing capability and energy efficiency are becoming increasingly demanded in the age of intelligent personal healthcare, particularly with the rise of wearable and implantable devices. To address this trend, we propose NeuroSEE, a neuromorphic energy-efficient processing framework that combines a spike representation encoding technique and a bio-inspired processing method. This framework first utilizes sparse spike trains to represent visual information, and then a bio-inspired spiking neural network (SNN) is adopted to process the spike trains. The SNN model makes use of an IF neuron with multiple spike-firing rates to decrease the energy consumption without compensating for prediction performance. The experimental results indicate that when predicting the response of the primary visual cortex, the framework achieves a state-of-the-art Pearson correlation coefficient performance. Spike-based recording and processing methods simplify the storage and transmission of redundant scene information and complex calculation processes. It could reduce power consumption by 15 times compared with the existing Convolutional neural network (CNN) processing framework. The proposed NeuroSEE framework predicts the response of the primary visual cortex in an energy efficient manner, making it a powerful tool for visual prostheses.
Keyword:
Visual prosthesis
Visualization
Biological system modeling
Retina
Predictive models
Image restoration
Image edge detection
Visual prostheses
bio-inspired processing
spiking neural network
Age-related macular degeneration
retinitis pigmentosa
wearable devices

期刊

IEEE Journal of Biomedical and Health Informatics 封面图
IEEE Journal of Biomedical and Health Informatics
IF:
6.8
论文数:
4.5K
被引数:
2.0W

机构

F
fudan university
学者数:
11.7W
论文数: 7.7W
被引数: 121
W
westlake university
学者数:
5.3K
论文数: 3.7K
被引数: 8