arrow
Return

Visual saliency guided video compression algorithm

delete2013-10-01
delete34
PRE
AI
R
Rupesh Gupta
M
Meera Thapar Khanna *
S
Santanu Chaudhury
DOI:10.1016/j.image.2013.07.003delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recently Saliency maps from input images are used to detect interesting regions in images/videos and focus on processing these salient regions. This paper introduces a novel, macroblock level visual saliency guided video compression algorithm. This is modelled as a 2 step process viz, salient region detection and frame foveation. Visual saliency is modelled as a combination of low level, as well as high level features which become important at the higher-level visual cortex. A relevance vector machine is trained over 3 dimensional feature vectors pertaining to global, local and rarity measures of conspicuity, to yield probabilistic values which form the saliency map. These saliency values are used for non-uniform bit-allocation over video frames. To achieve these goals, we also propose a novel video compression architecture, incorporating saliency, to save tremendous amount of computation. This architecture is based on thresholding of mutual information between successive frames for flagging frames requiring re-computation of saliency, and use of motion vectors for propagation of saliency values. (c) 2013 Elsevier B.V. All rights reserved.
Keywords:
Visual saliency
Feature maps
Mutual information
QP tuning
Machine learning
Motion vector
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

S
Signal Processing and Image Communication
IF:
2.7
Papers:
2.8K
Citations:
4.2K

Organization

Purdue University System cover
Purdue University System
Scholars:
3.9W
Papers: 3.6W
Citations: 66
P
Purdue University
Scholars:
2.7W
Papers: 2.1W
Citations: 147
Cited Papers

Cited Papers

Marking for QoS improvement
err2001-01-01
err0
PREAI
errI Yeom; A.L.N Reddy
errShare
errSave
Preparation and Characterization of Tung Oil Loaded Melamine Formaldehyde Microcapsules
err2023-12-28
err0
errOAAI
errTülin Gürkan Polat; Ahmet Gençer; Meltem Asiltürk; Yılmaz Aksu
errShare
errSave
Impact of biological therapy on body composition of patients with Chron's disease
err2017-05-01
err0
errOAAI
errJulianne Campos dos Santos; Carla Malaguti; Fernando de Azevedo Lucca; Andrea Lemos Cabalzar; Tarsila Campanha da Rocha Ribeiro; Pedro Duarte Gaburri; Liliana Andrade Chebli; Julio Maria Fonseca Chebli
errShare
errSave
Visual attention guided bit allocation in video compression
err2011-01-01
err209
PREAI
errLi, Zhicheng; Qin, Shiyin; Itti, Laurent
errShare
errSave
errShare
errSave
researcher View more