.png){kind=icon}
.png){kind=icon}
Return
Deep Video Harmonization by Improving Spatial-temporal Consistency
.png){kind=icon}
PRE
AI
DOI：10.1007/s11633-023-1447-3.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Video harmonization is an important step in video editing to achieve visual consistency by adjusting foreground appearances in both spatial and temporal dimensions. Previous methods always only harmonize on a single scale or ignore the inaccuracy of flow estimation, which leads to limited harmonization performance. In this work, we propose a novel architecture for video harmonization by making full use of spatiotemporal features and yield temporally consistent harmonized results. We introduce multiscale harmonization by using nonlocal similarity on each scale to make the foreground more consistent with the background. We also propose a foreground temporal aggregator to dynamically aggregate neighboring frames at the feature level to alleviate the effect of inaccurate estimated flow and ensure temporal consistency. The experimental results demonstrate the superiority of our method over other state-of-the-art methods in both quantitative and visual comparisons.
Keywords:
Harmonization
temporal consistency
video editing
video composition
nonlocal similarity
Journal
IF:
8.7
Papers:
301
Citations:
882