arrow
Return

Visual Attention Modeling for Stereoscopic Video: A Benchmark and Computational Model

delete2017-10-01
delete56
PRE
AI
Y
Yuming Fang
C
Chi Zhang
李菁 cover
李菁 (Jing Li)
雷建军 (Jianjun Lei) *
M
Matthieu Perreira Da Silva
P
Patrick Le Callet
DOI:10.1109/TIP.2017.2721112delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we investigate the visual attention modeling for stereoscopic video from the following two aspects. First, we build one large-scale eye tracking database as the benchmark of visual attention modeling for stereoscopic video. The database includes 47 video sequences and their corresponding eye fixation data. Second, we propose a novel computational model of visual attention for stereoscopic video based on Gestalt theory. In the proposed model, we extract the low-level features, including luminance, color, texture, and depth, from discrete cosine transform coefficients, which are used to calculate feature contrast for the spatial saliency computation. The temporal saliency is calculated by the motion contrast from the planar and depth motion features in the stereoscopic video sequences. The final saliency is estimated by fusing the spatial and temporal saliency with uncertainty weighting, which is estimated by the laws of proximity, continuity, and common fate in Gestalt theory. Experimental results show that the proposed method outperforms the state-of-the-art stereoscopic video saliency detection models on our built large-scale eye tracking database and one other database (DML-ITRACK-3D).
Keywords:
Visual attention
stereoscopic video
spatiotemporal
saliency detection
gestalt theory
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

T
tianjin university
Scholars:
7.9W
Papers: 5.7W
Citations: 88
N
nantes universite
Scholars:
1.7W
Papers: 1.2W
Citations: 125