arrow
返回

Model-Guided Multi-Path Knowledge Aggregation for Aerial Saliency Prediction

delete2020-01-01
delete5
delete
OA
AI
K
Kui Fu
李嘉 封面图
李嘉 (Jia Li) *
Y
Yu Zhang
H
Hongze Shen
Y
Yonghong Tian
DOI:10.1109/TIP.2020.2998977delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
As an emerging vision platform, a drone can look from many abnormal viewpoints which brings many new challenges into the classic vision task of video saliency prediction. To investigate these challenges, this paper proposes a large-scale video dataset for aerial saliency prediction, which consists of ground-truth salient object regions of 1,000 aerial videos, annotated by 24 subjects. To the best of our knowledge, it is the first large-scale video dataset that focuses on visual saliency prediction on drones. Based on this dataset, we propose a Model-guided Multi-path Network (MM-Net) that serves as a baseline model for aerial video saliency prediction. Inspired by the annotation process in eye-tracking experiments, MM-Net adopts multiple information paths, each of which is initialized under the guidance of a classic saliency model. After that, the visual saliency knowledge encoded in the most representative paths is selected and aggregated to improve the capability of MM-Net in predicting spatial saliency in aerial scenarios. Finally, these spatial predictions are adaptively combined with the temporal saliency predictions via a spatiotemporal optimization algorithm. Experimental results show that MM-Net outperforms ten state-of-the-art models in predicting aerial video saliency.
Keyword:
Predictive models
Visualization
Computational modeling
Drones
Solid modeling
Prediction algorithms
Adaptation models
Multi-path CNNs
knowledge transfer
visual saliency
aerial video
eye-tracking
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
P
Peng Cheng Laboratory
学者数:
1.7K
论文数: 1.8K
被引数: 2.0K
P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
学者 查看更多机构
引用论文

引用论文

Assessing the Thermal Performance of Temporary Shelters
err2016-01-01
err0
errOAAI
errYing Yu; Enshen Long; Yuan Shen; Hongxing Yang
err分享
err收藏
Visual saliency guided video compression algorithm
err2013-10-01
err34
PREAI
errGupta, Rupesh; Khanna, Meera Thapar; Chaudhury, Santanu
err分享
err收藏
学者 查看更多内容