arrow
Return

CDNet: Complementary Depth Network for RGB-D Salient Object Detection

delete2021-01-01
delete126
PRE
AI
W
Wenda Jin
J
Jun Xu
Q
Qi Han
Y
Yi Zhang *
M
Ming‐Ming Cheng
DOI:10.1109/TIP.2021.3060167delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Current RGB-D salient object detection (SOD) methods utilize the depth stream as complementary information to the RGB stream. However, the depth maps are usually of low-quality in existing RGB-D SOD datasets. Most RGB-D SOD networks trained with these datasets would produce error-prone results. In this paper, we propose a novel Complementary Depth Network (CDNet) to well exploit saliency-informative depth features for RGB-D SOD. To alleviate the influence of low-quality depth maps to RGB-D SOD, we propose to select saliency-informative depth maps as the training targets and leverage RGB features to estimate meaningful depth maps. Besides, to learn robust depth features for accurate prediction, we propose a new dynamic scheme to fuse the depth features extracted from the original and estimated depth maps with adaptive weights. What's more, we design a two-stage cross-modal feature fusion scheme to well integrate the depth features with the RGB ones, further improving the performance of our CDNet on RGB-D SOD. Experiments on seven benchmark datasets demonstrate that our CDNet outperforms state-of-the-art RGB-D SOD methods. The code is publicly available at https://github.com/blanclist/CDNet.
Keywords:
Feature extraction
Ions
Fuses
Task analysis
Object detection
Streaming media
Predictive models
RGB-D salient object detection
depth estimation
cross-modal feature fusion
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

T
tianjin university
Scholars:
7.9W
Papers: 5.7W
Citations: 88
N
nankai university
Scholars:
4.7W
Papers: 3.2W
Citations: 74