arrow
返回

Video Salient Object Detection Using Spatiotemporal Deep Features

delete2018-10-01
delete75
delete
OA
AI
T
Trung-Nghia Le *
A
Akihiro Sugimoto
DOI:10.1109/TIP.2018.2849860delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This paper presents a method for detecting salient objects in videos, where temporal information in addition to spatial information is fully taken into account. Following recent reports on the advantage of deep features over conventional handcrafted features, we propose a new set of spatiotemporal deep (STD) features that utilize local and global contexts over frames. We also propose new spatiotemporal conditional random field (STCRF) to compute saliency from STD features. STCRF is our extension of CRF to the temporal domain and describes the relationships among neighboring regions both in a frame and over frames. STCRF leads to temporally consistent saliency maps over frames, contributing to accurate detection of salient objects' boundaries and noise reduction during detection. Our proposed method first segments an input video into multiple scales and then computes a saliency map at each scale level using STD features with STCRF. The final saliency map is computed by fusing saliency maps at different scale levels. Our experiments, using publicly available benchmark datasets, confirm that the proposed method significantly outperforms the state-of-the-art methods. We also applied our saliency computation to the video object segmentation task, showing that our method outperforms existing video object segmentation methods.
Keyword:
Video saliency
salient object detection
spatiotemporal deep feature
spatiotemporal CRF
video object segmentation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

G
graduate university for advanced studies - japan
学者数:
3.4K
论文数: 2.6K
被引数: 0
R
research organization of information & systems (rois)
学者数:
2.8K
论文数: 3.2K
被引数: 2
引用论文

引用论文

EVALUATION OF LOW LEVEL LASER THERAPY ON OPEN WOUND HEALING OF THE TEAT IN DAIRY CATTLE
err1994-01-01
err0
errOAAI
errSeyed Mehdi Ghamsari; Haruo Yamada; Jezie A. Acorda; Naoya Unno
err分享
err收藏
Immuno-PET Imaging of HER3 in a Model in which HER3 Signaling Plays a Critical Role
err2015-11-16
err0
errOAAI
errQinghua Yuan; Takako Furukawa; Takahiro Tashiro; Kouki Okita; Zhao-Hui Jin; Winn Aung; Aya Sugyo; Kotaro Nagatsu; Hiroko Endo; Atsushi B. Tsuji; Ming-Rong Zhang; Takashi Masuko; Masahiro Inoue; Yasuhisa Fujibayashi; Tsuneo Saga
err分享
err收藏
Spatial Perspectives on Coworking Spaces and Related Practices in Beijing
err2020-02-09
err0
PREAI
errHe Huang; Yangfanqi Liu; Yuebing Liang; David Vargas; Lu Zhang
err分享
err收藏
Climate policy: Steps to China's carbon peak气候政策: 迈向中国碳峰值的步骤
err2015-06-17
err0
errOAAI
errZhu Liu; Dabo Guan; Scott Moore; Henry Lee; Jun Su; Qiang Zhang
err分享
err收藏
Urban green spaces and the influence on vehicular traffic noise control
err2018-10-01
err0
errOAAI
errGuillermo Angel Perez Lopez; Léa Cristina Lucas de Souza
err分享
err收藏
学者 查看更多内容