.png){kind=icon}
返回
Text-guided patch-level exemplar selection for zero-shot counting
.png){kind=icon}
PRE
AI
DOI：10.1016/j.engappai.2026.113986.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Text-guided zero-shot object counting aims to estimate object counts in images via text prompts. Existing methods face two key challenges. Firstly, current exemplar modeling methods overlook cross-modal fusion, whether using text as exemplars or selecting visuals based on text. Secondly, image–exemplar feature interaction suffers from semantic shift, causing models to focus on incorrect regions. To address the above issues, we propose a text-guided patch-level exemplar selection counting method (TPECount), which is based on Contrastive Language–Image Pretraining (CLIP). It mitigates the absence of visual appearance details while preserving textual semantic information in selected exemplar features and generates high-quality correlation features for density map regression. Specifically, TPECount comprises two well-designed modules: Visual Exemplar Optimization Module (VEOM) and Similarity-Guided Interaction Module (SGIM). VEOM leverages cross-modal feature fusion between images and text to model and select patch-level exemplar features, enabling TPECount to simultaneously leverage relevant exemplar visual appearance features and text features. SGIM is a novel interaction module that consists of our well-designed multi-layer transformer decoder blocks for image–exemplar feature interaction. By leveraging learnable image–exemplar similarity as global supervision, SGIM mitigates the impact of semantic shift and compute correlation features. Extensive experiments on three counting datasets demonstrate that our method achieves superior performance and generalizability. The code is available at https://github.com/aHui3/TPECount .
期刊
IF:
8
论文数:
5.8K
被引数:
3.5W
机构
引用论文
Zhu, H., Yuan, J., Yang, Z., Guo, Y., Wang, Z., Zhong, X., & He, S. (2025). Zero-shot object counting with good exemplars. In European conference on computer vision (pp. 368–385). Springer.Zhu, H., Yuan, J., Yang, Z., Guo, Y., Wang, Z., Zhong, X., & He, S. (2025). 零样本对象计数方法研究良好范例。载于欧洲计算机视觉会议（第368-385页）。Springer出版。.png)
IF0
PREAI
分享收藏
分享收藏Vision Transformer Off-the-Shelf: A Surprising Baseline for Few-Shot Class-Agnostic Counting
IF0
PREAI
分享收藏Towards generalizable object counting via dual-prompted cross-modality fusion network通过双提示跨模态融合网络实现通用对象计数Information Fusion
Information FusionIF15.5
PREAI
分享收藏
查看更多内容