arrow
返回

Global-and-Local Collaborative Learning for Co-Salient Object Detection

delete2023-03-01
delete48
delete
OA
AI
R
Runmin Cong
N
Ning Yang
C
Chongyi Li *
H
Huazhu Fu
赵
赵耀 (Yao Zhao)
Q
Qingming Huang
S
Sam Kwong
DOI:10.1109/TCYB.2022.3169431delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The goal of co-salient object detection (CoSOD) is to discover salient objects that commonly appear in a query group containing two or more relevant images. Therefore, how to effectively extract interimage correspondence is crucial for the CoSOD task. In this article, we propose a global-and-local collaborative learning (GLNet) architecture, which includes a global correspondence modeling (GCM) and a local correspondence modeling (LCM) to capture the comprehensive interimage corresponding relationship among different images from the global and local perspectives. First, we treat different images as different time slices and use 3-D convolution to integrate all intrafeatures intuitively, which can more fully extract the global group semantics. Second, we design a pairwise correlation transformation (PCT) to explore similarity correspondence between pairwise images and combine the multiple local pairwise correspondences to generate the local interimage relationship. Third, the interimage relationships of the GCM and LCM are integrated through a global-and-local correspondence aggregation (GLA) module to explore more comprehensive interimage collaboration cues. Finally, the intra and inter features are adaptively integrated by an intra-and-inter weighting fusion (AEWF) module to learn co-saliency features and predict the co-saliency map. The proposed GLNet is evaluated on three prevailing CoSOD benchmark datasets, demonstrating that our model trained on a small dataset (about 3k images) still outperforms 11 state-of-the-art competitors trained on some large datasets (about 8k-200k images).
Keyword:
Semantics
Task analysis
Feature extraction
Convolution
Object detection
Computational modeling
Collaborative work
3-D convolution
co-salient object detection (CoSOD)
global correspondence modeling (GCM)
local correspondence modeling (LCM)

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

U
university of chinese academy of sciences, cas
学者数:
4.1W
论文数: 3.8W
被引数: 75
B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
A
a*star - institute of high performance computing (ihpc)
学者数:
1.5K
论文数: 1.3K
被引数: 3
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
A
agency for science technology & research (a*star)
学者数:
2.2W
论文数: 1.9W
被引数: 57
学者 查看更多机构
引用论文

引用论文

Are Covert DDoS Attacks Facing Multi-Feature Detectors Feasible?
err2022-01-20
err0
PREAI
errAmir Reza Ramtin; Don Towsley; Philippe Nain; Edmundo de Souza e Silva; Daniel S. Menasche
err分享
err收藏
err分享
err收藏
Saliency Detection for Stereoscopic Images Based on Depth Confidence Analysis and Multiple Cues Fusion
err2016-06-01
err211
errOAAI
errCong, Runmin; Lei, Jianjun; Zhang, Changqing; Huang, Qingming; Cao, Xiaochun; Hou, Chunping
err分享
err收藏
Dynamic Selective Network for RGB-D Salient Object Detection用于rgb-d显著目标检测的动态选择性网络
err2021-01-01
err66
PREAI
errWen, Hongfa; Yan, Chenggang; Zhou, Xiaofei; Cong, Runmin; Sun, Yaoqi; Zheng, Bolun; Zhang, Jiyong; Bao, Yongjun; Ding, Guiguang
err分享
err收藏
Video Saliency Detection via Sparsity-Based Reconstruction and Propagation
err2019-10-01
err81
PREAI
errCong, Runmin; Lei, Jianjun; Fu, Huazhu; Porikli, Fatih; Huang, Qingming; Hou, Chunping
err分享
err收藏
学者 查看更多内容