返回
Collaborative compensative transformer network for salient object detection
DOI:10.1016/j.patcog.2024.110600.png)
摘要
En 中文
Salient object detection (SOD) is of high significance for various computer vision applications but is a challenging task due to the complicated scenes in real -world images. Most state-of-the-art SOD methods aim to build long-range dependency for improving global contrast modeling in complicated scenes. However, most of them suffer from the prior assumption of treating image patches as visual tokens for building long-range dependency. This is because this assumption leads to localizing salient regions with uncertain boundaries due to the lost object structure information. In this paper, to address this issue, we re -construct the prior assumption of treating both patches and superpixels as visual tokens for building long-range dependency, which takes into account the properties of superpixels and patches in preserving detailed structural -aware information and local context information, respectively. Based on the re -constructed prior assumption, we propose a Collaborative Compensative Transformer Network (CCTNet) for the SOD task. CCTNet firstly alternates the computation within the same kind of vision tokens and among different vision tokens to build their dependencies. By this means, the relationship between multi -level global context and detailed structure representation can be explicitly modeled for consistent semantic and object structure understanding. Then, CCTNet performs feature joint decoding for SOD by fusing the complementary global context and detailed structure for locating objects with certain boundaries. Extensive experiments were conducted to validate the effectiveness of the proposed modules. Furthermore, the experiments on ten benchmark datasets demonstrated the state-of-the-art performance of CCTNet on both RGB and RGB-D SOD.
Keyword:
Salient object detection
Collaborative relation transformer
Collaborative embedding
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
LID, LEED, and Alternative Rating Systems—Integrating Low Impact Development Techniques with Green Building DesignLID,LEED和替代评级系统-将低影响开发技术与绿色建筑设计相结合
Urban Green Space and the Pursuit of Health Equity in Parts of the United States美国部分地区的城市绿地与对健康公平的追求
Encoder deep interleaved network with multi-scale aggregation for RGB-D salient object detection
PATTERN RECOGNITION
IF7.6

