arrow
Return

Consistent Video Saliency Using Local Gradient Flow Optimization and Global Refinement

delete2015-11-01
delete343
delete
OA
AI
王文冠 cover
王文冠 (Wenguan Wang)
沈
沈建冰 (Jianbing Shen) *
Ling Shao cover
Ling Shao (Ling Shao)
DOI:10.1109/TIP.2015.2460013delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We present a novel spatiotemporal saliency detection method to estimate salient regions in videos based on the gradient flow field and energy optimization. The proposed gradient flow field incorporates two distinctive features: 1) intra-frame boundary information and 2) inter-frame motion information together for indicating the salient regions. Based on the effective utilization of both intra-frame and inter-frame information in the gradient flow field, our algorithm is robust enough to estimate the object and background in complex scenes with various motion patterns and appearances. Then, we introduce local as well as global contrast saliency measures using the foreground and background information estimated from the gradient flow field. These enhanced contrast saliency cues uniformly highlight an entire object. We further propose a new energy function to encourage the spatiotemporal consistency of the output saliency maps, which is seldom explored in previous video saliency methods. The experimental results show that the proposed algorithm outperforms state-of-the-art video saliency detection methods.
Keywords:
Video saliency
energy optimization
gradient flow field
spatiotemporal saliency energy
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

B
beijing institute of technology
Scholars:
5.5W
Papers: 4.0W
Citations: 63
N
Northumbria University
Scholars:
5.6K
Papers: 6.8K
Citations: 9.5K
Cited Papers

Cited Papers

errShare
errSave
Modeling attention to salient proto-objects
err2006-11-01
err1.0K
PREAI
errWalther, Dirk; Koch, Christof
errShare
errSave
The promoter for a variant surface glycoprotein gene expression site in Trypanosoma brucei.
err1990-09-01
err0
errOAAI
errJ. C. Zomerdijk; M. Ouellette; A. L. ten Asbroek; R. Kieft; A. M. Bommer; C. E. Clayton; P. Borst
errShare
errSave
Spatial Perspectives on Coworking Spaces and Related Practices in Beijing
err2020-02-09
err0
PREAI
errHe Huang; Yangfanqi Liu; Yuebing Liang; David Vargas; Lu Zhang
errShare
errSave
Improved seam carving for video retargeting
err2008-08-01
err602
PREAI
errRubinstein, Michael; Shamir, Ariel; Avidan, Shai
errShare
errSave
researcher View more