arrow
Return

An Optical Flow-Based Full Reference Video Quality Assessment Algorithm

delete2016-06-01
delete88
PRE
AI
K
K. Manasa
S
Sumohana S. Channappayya *
DOI:10.1109/TIP.2016.2548247delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present a simple yet effective optical flow-based full-reference video quality assessment (FR-VQA) algorithm for assessing the perceptual quality of natural videos. Our algorithm is based on the premise that local optical flow statistics are affected by distortions and the deviation from pristine flow statistics is proportional to the amount of distortion. We characterize the local flow statistics using the mean, the standard deviation, the coefficient of variation (CV), and the minimum eigenvalue (lambda(min)) of the local flow patches. Temporal distortion is estimated as the change in the CV of the distorted flow with respect to the reference flow, and the correlation between lambda(min) of the reference and of the distorted patches. We rely on the robust multi-scale structural similarity index for spatial quality estimation. The computed temporal and spatial distortions, thus, are then pooled using a perceptually motivated heuristic to generate a spatio-temporal quality score. The proposed method is shown to be competitive with the state-of-the-art when evaluated on the LIVE SD database, the EPFL Polimi SD database, and the LIVE Mobile HD database. The distortions considered in these databases include those due to compression, packet-loss, wireless channel errors, and rate-adaptation. Our algorithm is flexible enough to allow for any robust FR spatial distortion metric for spatial distortion estimation. In addition, the proposed method is not only parameter-free but also independent of the choice of the optical flow algorithm. Finally, we show that the replacement of the optical flow vectors in our proposed method with the much coarser block motion vectors also results in an acceptable FR-VQA algorithm. Our algorithm is called the flow similarity index.
Keywords:
Full reference video quality assessment
optical flow
MS-SSIM
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

I
indian institute of technology system (iit system)
Scholars:
9.5W
Papers: 9.9W
Citations: 93
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Detection of respiratory viruses in nasopharyngeal secretions and middle ear fluid from children with acute otitis media
err2009-07-08
err0
PREAI
errHisakazu Yano; Naohiro Okitsu; Toru Hori; Oshi Watanabe; Tomoko Kisu; Etsuko Hatagishi; Akira Suzuki; Michiko Okamoto; Akira Ohmi; Mitsuko Suetake; Syun Sagai; Toshimitsu Kobayashi; Hidekazu Nishimura
errShare
errSave
RT‐Hpro‐PCR: A MicroRNA Detection System Using a Primer with a DNA Tag
err2019-11-07
err0
errOAAI
errFumie Takei; Misaki Akiyama; Asako Murata; Ayako Sugai; Kazuhiko Nakatani; Ichiro Yamashita
errShare
errSave
errShare
errSave
researcher View more