arrow
返回

Universal Relocalizer forWeakly Supervised Referring Expression Grounding

delete2024-05-16
delete0
delete
OA
AI
P
Panpan Zhang
M
Meng Liu *
X
Xuemeng Song *
曹达 封面图
曹达 (Da Cao)
高赞 封面图
高赞 (Zan Gao)
Liqiang Nie 封面图
Liqiang Nie (Liqiang Nie)
DOI:10.1145/3656045delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article introduces the Universal Relocalizer, a novel approach designed for weakly supervised referring expression grounding. Our method strives to pinpoint a target proposal that corresponds to a specific query, eliminating the need for region-level annotations during training. To bolster the localization precision and enrich the semantic understanding of the target proposal, we devise three key modules: the category module, the color module, and the spatial relationship module. The category and color modules assign respective category and color labels to region proposals, enabling the computation of category and color scores. Simultaneously, the spatial relationship module integrates spatial cues, yielding a spatial score for each proposal to enhance localization accuracy further. By adeptly amalgamating the category, color, and spatial scores, we derive a refined grounding score for every proposal. Comprehensive evaluations on the RefCOCO, RefCOCO+, and RefCOCOg datasets manifest the prowess of the Universal Relocalizer, showcasing its formidable performance across the board.
Keyword:
Weakly supervised referring expression grounding
universal relocalizer
refined grounding score

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
Q
Qilu University of Technology
学者数:
1.1W
论文数: 8.9K
被引数: 16
S
shandong jianzhu university
学者数:
4.3K
论文数: 3.1K
被引数: 3
H
hunan university
学者数:
4.5W
论文数: 3.3W
被引数: 70
S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
学者 查看更多机构
引用论文

引用论文

Climate change discourse among Iranian farmers
err2016-07-16
err0
PREAI
errTahereh Zobeidi; Masoud Yazdanpanah; Masoumeh Forouzani; Bahman Khosravipour
err分享
err收藏
Cycle-Free Weakly Referring Expression Grounding With Self-Paced Learning
err2023-01-01
err16
PREAI
errSun, Mingjie; Xiao, Jimin; Lim, Eng Gee; Zhao, Yao
err分享
err收藏
err分享
err收藏
Outbreaks of Serratia marcescens and Serratia rubidaea bacteremia in a central Kathmandu hospital following the 2015 earthquakes
err2018-08-11
err0
errOAAI
errAbhilasha Karkey; Niva Joshi; Shiva Chalise; Suchita Joshi; Shrijana Shrestha; To Nguyen Thi Nguyen; Sabina Dongol; Buddha Basnyat; Stephen Baker; Christine J Boinett
err分享
err收藏
学者 查看更多内容