arrow
返回

Visual saliency prediction using multi-scale attention gated network

delete2021-05-19
delete8
PRE
AI
孙
孙玉宝 (Yubao Sun)
M
Mengyang Zhao
胡
胡凯 (Kai Hu) *
S
Shaojing Fan
DOI:10.1007/s00530-021-00796-4delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Predicting human visual attention cannot only increase our understanding of the underlying biological mechanisms, but also bring new insights for other computer vision-related tasks such as autonomous driving and human-computer interaction. Current deep learning-based methods often place emphasis on high-level semantic feature for prediction. However, high-level semantic feature lacks fine-scale spatial information. Ideally, a saliency prediction model should include both spatial and semantic features. In this paper, we propose a multi-scale attention gated network (we refer to as MSAGNet) to fuse semantic features with different spatial resolutions for visual saliency prediction. Specifically, we adopt the high-resolution net (HRNet) as the backbone to extract the multi-scales semantic features. A multi-scale attention gating module is designed to adaptively fuse these multi-scale features in a hierarchical way. Different from the conventional way of feature concatenation from multiple layers or multi-scale inputs, this module calculates a spatial attention map from high-level semantic feature and then fuses it with the low-level spatial feature through gating operation. Through the hierarchical gating fusion, final saliency prediction is achieved at the finest scale. Extensive experimental analyses on three benchmark datasets demonstrate the superior performance of the proposed method.
Keyword:
Saliency prediction
Multi-scale attention
Gating fusion
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
引用论文

引用论文

cDNA expressed sequence tags of Trypanosoma brucei rhodesiense provide new insights into the biology of the parasite
err1995-07-01
err0
PREAI
errNajib M.A. El-Sayed; Clara M. Alarcon; John C. Beck; Val C. Sheffield; John E. Donelson
err分享
err收藏
err分享
err收藏
Assessing the Thermal Performance of Temporary Shelters
err2016-01-01
err0
errOAAI
errYing Yu; Enshen Long; Yuan Shen; Hongxing Yang
err分享
err收藏
学者 查看更多内容