.png){kind=icon}
返回
Event-Driven Heterogeneous Network for Video Deraining
.png){kind=icon}
PRE
AI
DOI：10.1007/s11263-024-02148-x.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Restoring clear frames from rainy videos poses a significant challenge due to the swift motion of rain streaks. Traditional frame-based visual sensors, which record dense scene content synchronously, struggle to capture the fast-moving rain information. Conversely, the novel bio-inspired event camera, known for its high temporal resolution and low latency, effectively records the motion trajectories of rapidly falling rain through asynchronously generated sparse event sequences. In light of these attributes, we introduce a novel event-driven convolutional spiking network for video deraining. For video restoration, we employ a Convolutional Neural Network as the backbone, extracting dense features from video sequences to map rain-soaked frames to clear ones. To remove rain, we meticulously design a bio-inspired Spiking Neural Network that adapts to the sparse event sequences, capturing features of falling rain. We then establish a bimodal feature fusion module that combines dense convolutional features with sparse spiking features. This fusion aids the backbone in accurately pinpointing rain streaks across spatiotemporal dimensions. Thus, our diverse network extracts and collaborates information from both events and videos, enhancing deraining performance. Experiments conducted on synthetic and real-world datasets prove that our network markedly surpasses existing video deraining techniques.
Keyword:
Video deraining
Event camera
Spiking neural network
Heterogeneous network
期刊
IF:
9.3
论文数:
3.9K
被引数:
2.8W
机构
引用论文
Dispersal in the Wood Frog (Rana sylvatica): Implications for Genetic Population Structure.png)
Evolution
EvolutionIF0
PREAI
分享收藏The influence of stacking fault energy and adhesion on the wear of copper and aluminum bronzeWear
WearIF0
PREAI
分享收藏Disruption of integrin-dependent adhesion and survival of endothelial cells by recombinant adenovirus expressing isolated β integrin cytoplasmic domainsGene Therapy
Gene TherapyIF0
PREAI
分享收藏分享收藏
查看更多内容