.png){kind=icon}
返回
Semantic-Constraint Matching for transformer-based weakly supervised object localization
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2024.110971.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Weakly supervised object localization (WSOL) strives to localize objects with only image-level supervision. WSOL often faces challenges such as incomplete localization due to classifier bias and over-localization in real scenes where objects and backgrounds are strongly associated or structurally similar. While the latest Transformer-based methods effectively enhance localization performance by leveraging long-range feature dependencies, they may inadvertently amplify divergent background activation and remain susceptible to classification bias. To this end, we proposed a novel Se mantic-Constraint C onstraint M atching (SeCM) plug-in module tailored for transformer-based approaches. In detail, a local patch shuffle strategy is first introduced to disentangle partial contextual linkages, thereby creating image pairs. Then a semantic matching module extracts co-object knowledge from the primal-shuffled image pairs, drives the network to identify the association of foreground with semantic label to suppress divergent activation. Moreover, to alleviate incomplete localization and prevent excessive suppression of activation, we propose leveraging multi-modal class-specific textual representations to guide object localization by complementing intra-class priori diverse knowledge. Extensive experimental results conducted on CUB-200-2011 and ILSVRC datasets show that our method can achieve the new state-of-the-art performance.
Keyword:
Weakly-supervised object localization
Vision transformer
Image matching
Vision language model
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Complementary adversarial mechanisms for weakly-supervised temporal action localization.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏A multi-strategy contrastive learning framework for weakly supervised semantic segmentation一种用于弱监督语义分割的多策略对比学习框架PATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏
查看更多内容