返回
Universal Relocalizer forWeakly Supervised Referring Expression Grounding
DOI:10.1145/3656045.png)
摘要
En 中文
This article introduces the Universal Relocalizer, a novel approach designed for weakly supervised referring expression grounding. Our method strives to pinpoint a target proposal that corresponds to a specific query, eliminating the need for region-level annotations during training. To bolster the localization precision and enrich the semantic understanding of the target proposal, we devise three key modules: the category module, the color module, and the spatial relationship module. The category and color modules assign respective category and color labels to region proposals, enabling the computation of category and color scores. Simultaneously, the spatial relationship module integrates spatial cues, yielding a spatial score for each proposal to enhance localization accuracy further. By adeptly amalgamating the category, color, and spatial scores, we derive a refined grounding score for every proposal. Comprehensive evaluations on the RefCOCO, RefCOCO+, and RefCOCOg datasets manifest the prowess of the Universal Relocalizer, showcasing its formidable performance across the board.
Keyword:
Weakly supervised referring expression grounding
universal relocalizer
refined grounding score
期刊
IF:
6
论文数:
2.0K
被引数:
5.4K
机构
引用论文
Rethinking and Improving Feature Pyramids for One-Stage Referring Expression Comprehension一阶段指称表达理解的特征金字塔的反思与改进
Communication and reproductive behaviour in North American Jerusalem crickets (
Stenopelmatus
) (Orthoptera: Stenopelmatidae).北美耶路撒冷蟋蟀的交流和生殖行为 (
Stenopelmatus
) (直翅目: Stenopelmatidae)。

