.png){kind=icon}
返回
Improved Event-Based Image De-Occlusion
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2024.3427730.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Reconstructing clear scene images in the presence of foreground occlusions remains a formidable challenge for cameras constrained by a single viewpoint. Synthetic aperture imaging (SAI) has emerged as a solution by integrating visual information from multiple viewpoints, thus overcoming occlusions. Event cameras, characterized by their high temporal resolution, exceptional dynamic range, low power consumption, and resistance to motion blur, offer a promising avenue for capturing intricate details of background objects within a limited range of motion. Leveraging these capabilities, several event-camera-based SAI methodologies have been proposed to effectively tackle dense occlusions. Despite these advancements, existing methodologies encounter obstacles stemming from the hybrid model they employ, comprising a spiking neural network (SNN) encoder and a convolutional neural network (CNN) decoder. Challenges include information degradation within the SNN encoder due to the quantization of full-precision data into binary spikes, as well as insufficient training data for the CNN decoder to adequately learn feature extraction. In response, we present an enhanced event-based image de-occlusion approach. Our method introduces a novel full-precision leaky integrate-and-fire (FP-LIF) mechanism to mitigate information loss within the SNN encoder. Additionally, we propose an isomorphic network knowledge distillation method to augment the feature extraction capabilities of the CNN decoder. Experimental results demonstrate the efficacy of our approach in enhancing event-camera-based SAI methodologies.
Keyword:
Decoding
Feature extraction
Membrane potentials
Training data
Cameras
Task analysis
Streams
Event camera
image de-occlusion
knowledge distillation
spiking neural network
synthetic aperture imaging
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
引用论文
Studies in North American Peronosporales-II. Phytophthoreae and Rhysotheceae北美霜霉目研究-II. Phytophthoreae和Rhysotheceae
OAAI
OAAI分享收藏The Effect of 40-Hz Light Therapy on Amyloid Load in Patients with Prodromal and Clinical Alzheimer’s Disease40Hz光疗法对前驱和临床阿尔茨海默病患者淀粉样蛋白负荷的影响
OAAI
OAAI分享收藏Progressive privilege d knowle dge distillation for online action detection.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Tentamen florae Germanicae; continens enumerationem plantarum in Germania sponte nascentium《德国植物志考试》；包含在德国自然生长的植物的列举OAAI
IF0
OAAI分享收藏Quality Verification of Volunteered Geographic Information Using OSM Notes Data in a Global ContextOAAI
OAAI分享收藏Visual-to-EEG cross-modal knowledge distillation for continuous emotion recognitionPATTERN RECOGNITIONOAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏分享收藏A phenetic investigation of Vicia section Peregrinae Kupicha (Leguminosae, Papilionoideae, Vicieae)对Vicia section Peregrinae Kupicha（Leguminosae, Papilionoideae, Vicieae）的数值分类学研究
PREAI
分享收藏
查看更多内容