.png){kind=icon}
返回
Learning event guided network for salient object detection
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patrec.2021.08.034.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Salient object detection (SOD) focuses on mimicking the attention mechanism in human vision system. Due to the limited information provided from the traditional image data, the image-based SOD advances are very challenging in some complex scenes. Inspired by the emerging event cameras that provide asynchronous measurements of local temporal contrast over a large dynamic range, we propose a new idea to extract more effective information from the combination of event flow and RGB images. In this paper, we construct an end-to-end joint network for salient object detection (ERSOD-Net), which simultaneously supervise the RGB image and the event data within the corresponding image exposure time. To fully exploit temporal information of event data, Long Short-Term Memory module is utilized to effectively process event and learn salient object event surfaces. Moreover, multi-level feature interaction is designed to fuse two complementary branches of image and event and to predict significance mapping. Finally, to demonstrate the effectiveness of our model, a real Event-RGB SOD dataset (ERSOD) is built by DAVIS camera. Experiments on both benchmark and ERSOD datasets show that the proposed event guided network greatly improves the SOD performance in different evaluation metrics. The code and datasets will be released later at https://github.com/jxr326/ERSOD-Net. (c) 2021 Elsevier B.V. All rights reserved.
Keyword:
Salient object detection
Event-based vision
Long short-term memory
Image saliency
Visual attention
期刊
IF:
3.3
论文数:
8.0K
被引数:
1.6W
机构
引用论文
分享收藏
STA3D: Spatiotemporally attentive 3D network for video saliency predictionSTA3D: 用于视频显著性预测的时空关注3D网络
PREAI
分享收藏EF-Net: A novel enhancement and fusion network for RGB-D saliency detectionEf-net: 一种用于rgb-d显著性检测的新型增强和融合网络.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏 没有更多内容
没有更多内容