arrow
Return

Optical Flow Based Co-Located Reference Frame for Video Compression

delete2020-01-01
delete9
PRE
AI
B
Bohan Li *
J
Jingning Han
Y
Yaowu Xu
K
Kenneth Rose
DOI:10.1109/TIP.2020.3014723delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper proposes a novel bi-directional motion compensation framework that extracts existing motion information associated with the reference frames and interpolates an additional reference frame candidate that is co-located with the current frame. The approach generates a dense motion field by performing optical flow estimation, so as to capture complex motion between the reference frames without recourse to additional side information. The estimated optical flow is then complemented by transmission of offset motion vectors to correct for possible deviation from the linearity assumption in the interpolation. Various optimization schemes specifically tailored to the video coding framework are presented to further improve the performance. To accommodate applications where decoder complexity is a cardinal concern, a block-constrained speed-up algorithm is also proposed. Experimental results show that the main approach and optimization methods yield significant coding gains across a diverse set of video sequences. Further experiments focus on the trade-off between performance and complexity, and demonstrate that the proposed speed-up algorithm offers complexity reduction by a large factor while maintaining most of the performance gains.
Keywords:
Estimation
Decoding
Optical imaging
Complexity theory
Optical distortion
Bidirectional control
Video coding
Optical flow
video coding
hierarchical structure
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

U
University of California Santa Barbara
Scholars:
1.2W
Papers: 9.6K
Citations: 3.6W
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K