arrow
Return

NeuroSEE: A Neuromorphic Energy-Efficient Processing Framework for Visual Prostheses

delete2022-08-01
delete3
PRE
AI
C
Chuanqing Wang
J
Jie Yang
M
Mohamad Sawan *
DOI:10.1109/JBHI.2022.3172306delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Visual prostheses with both comprehensive visual signal processing capability and energy efficiency are becoming increasingly demanded in the age of intelligent personal healthcare, particularly with the rise of wearable and implantable devices. To address this trend, we propose NeuroSEE, a neuromorphic energy-efficient processing framework that combines a spike representation encoding technique and a bio-inspired processing method. This framework first utilizes sparse spike trains to represent visual information, and then a bio-inspired spiking neural network (SNN) is adopted to process the spike trains. The SNN model makes use of an IF neuron with multiple spike-firing rates to decrease the energy consumption without compensating for prediction performance. The experimental results indicate that when predicting the response of the primary visual cortex, the framework achieves a state-of-the-art Pearson correlation coefficient performance. Spike-based recording and processing methods simplify the storage and transmission of redundant scene information and complex calculation processes. It could reduce power consumption by 15 times compared with the existing Convolutional neural network (CNN) processing framework. The proposed NeuroSEE framework predicts the response of the primary visual cortex in an energy efficient manner, making it a powerful tool for visual prostheses.
Keywords:
Visual prosthesis
Visualization
Biological system modeling
Retina
Predictive models
Image restoration
Image edge detection
Visual prostheses
bio-inspired processing
spiking neural network
Age-related macular degeneration
retinitis pigmentosa
wearable devices

Journal

IEEE Journal of Biomedical and Health Informatics cover
IEEE Journal of Biomedical and Health Informatics
IF:
6.8
Papers:
4.5K
Citations:
2.0W

Organization

F
fudan university
Scholars:
11.7W
Papers: 7.7W
Citations: 121
W
westlake university
Scholars:
5.3K
Papers: 3.7K
Citations: 8