.png){kind=icon}
Return
Lightweight three-stream encoder–decoder network for multi-modal salient object detection
.png){kind=icon}
PRE
AI
DOI：10.1016/j.jvcir.2025.104523.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Salient object detection technique can identify the most attractive objects in a scene. In recent years, multi-modal salient object detection (SOD) has shown promising prospects. However, most of the existing multi-modal SOD models ignore modal size and computational cost in pursuit of comprehensive cross-modality feature fusion. To enhance the feasibility of high accuracy model in practical applications, we propose a Lightweight Three-stream Encoder–Decoder Network (TENet) for multi-modal salient object detection. Specifically, we design three decoders to explore saliency clues embedded in different multi-modal features and leverage a hierarchical decoding structure to alleviate the negative effects of low-quality images. To reduce the difference among modalities, we propose a lightweight modal information-guided fusion (MIGF) module to enhance the correlation between RGB-D and RGB-T modalities, thus laying the groundwork for triple-modal fusion. Furthermore, to utilize multi-scale information, we propose the semantic interaction (SI) module and the semantic feature enhancement (SFE) module to integrate specific hierarchical information embedded in high- and low-level features. Extensive experiments on the VDT-2048 dataset show that TENet has a model size of 37 MB, an inference speed of 38FPS, and achieves comparable accuracy to 16 state-of-the-art multi-modal methods.
Journal
IF:
3.1
Papers:
547
Citations:
5.6K
Organization
Cited Papers
ShareSaveMulti-modal interactive attention and dual progressive decoding network for RGB-D/T salient object detection.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
ShareSaveShareSaveShareSaveJL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detection
OAAI
OAAIShareSaveA Review of Machine Learning and Deep Learning for Object Detection, Semantic Segmentation, and Human Action Recognition in Machine and Robotic VisionTechnologies
OAAI
TechnologiesIF0
OAAIShareSaveCGMDRNet: Cross-Guided Modality Difference Reduction Network for RGB-T Salient Object Detection
PREAI
ShareSave
View more