arrow
返回

Structured Attention Network for Referring Image Segmentation

delete2022-01-01
delete25
PRE
AI
Lin Liang 封面图
Lin Liang (Liang Lin)
徐
徐肖倩 (Xiaoqian Xu)
S
Sibei Yang
K
Kun Zeng
G
Guanbin Li *
DOI:10.1109/TMM.2021.3074008delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Referring image segmentation aims at segmenting out the object or stuff referred to by a natural language expression. The challenge of this task lies in the requirement of understanding both vision and language. The linguistic structure of a referring expression can provide an intuitive and explainable layout for reasoning over visual and linguistic concepts. In this paper, we propose a structured attention network (SANet) to explore the multimodal reasoning over the dependency tree parsed from the referring expression. Specifically, SANet implements the multimodal reasoning using an attentional multimodal tree-structure recurrent module (AMTreeGRU) in a bottom-up manner. In addition, for spatial detail improvement, SANet further incorporates the semantics-guided low-level features into high-level ones using the proposed attentional skip connection module. Extensive experiments on four public benchmark datasets demonstrate the superiority of our proposed SANet with more explainable visualization examples.
Keyword:
Visualization
Linguistics
Image segmentation
Cognition
Feature extraction
Semantics
Task analysis
Referring image segmentation
vision and language
cross-modal reasoning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

H
hong kong polytechnic university
学者数:
3.0W
论文数: 4.1W
被引数: 921
S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
引用论文

引用论文

A retrospective 5-year review of rubella in South Africa prior to the introduction of a rubella-containing vaccine
err2022-05-05
err0
errOAAI
errHeather Hong; Susan Malfeld; Sheilagh Smit; Lillian Makhathini; Mirriam Fortuin; Tshepo Motsamai; Dipolelo Tselana; Morubula Jack Manamela; Nkengafac Villyen Motaze; Genevie Ntshoe; Mercy Kamupira; Ester Khosa-Lesola; Sibongile Mokoena; Thulasizwe Buthelezi; Elizabeth Maseti; Melinda Suchard
err分享
err收藏
Whipple Limbic Encephalitis
err2011-11-01
err0
errOAAI
errFrédéric Blanc
err分享
err收藏
Enhancement of pyramid solar distiller performance using reflectors, cooling cycle, and dangled cords of wicks
err2021-06-01
err0
PREAI
errF.A. Essa; Wissam H. Alawee; Suha A. Mohammed; A.S. Abdullah; Z.M. Omara
err分享
err收藏
学者 查看更多内容