arrow
Return

Multiframe-to-Multiframe Network for Video Denoising

delete2022-01-01
delete16
PRE
AI
H
Huaian Chen
金
金毅 (Yi Jin) *
K
Kai Xu
Y
Yuxuan Chen
C
Changan Zhu
DOI:10.1109/TMM.2021.3077140delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Most existing studies performed video denoising by using multiple adjacent noisy frames to recover one clean frame; however, despite achieving relatively good quality for each individual frame, these approaches may result in visual flickering when the denoised frames are considered in sequence. In this paper, instead of separately restoring each clean frame, we propose a multiframe-to-multiframe (MM) denoising scheme that simultaneously recovers multiple clean frames from consecutive noisy frames. The proposed MM denoising scheme uses a training strategy that optimizes the denoised video from both the spatial and temporal dimensions, enabling better temporal consistency in the denoised video. Furthermore, we present an MM network (MMNet), which adopts a spatiotemporal convolutional architecture that considers both the interframe similarity and single-frame characteristics. Benefiting from the underlying parallel mechanism of the MM denoising scheme, MMNet achieves a highly competitive denoising efficiency. Extensive analyses and experiments demonstrate that MMNet outperforms the state-of-the-art video denoising methods, yielding temporal consistency improvements of at least 13.3% and running more than 2 times faster than the other methods.
Keywords:
Video denoising
multiframe to multiframe
denoising efficiency
temporal consistency
spatiotemporal
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.6K
Citations:
2.4W

Organization

C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Arthroscopic Shoulder Surgery in Female Professional Tennis Players
err2017-07-01
err0
PREAI
errSimon W. Young; Jodie Dakic; Kathleen Stroia; Michael L. Nguyen; Marc R. Safran
errShare
errSave
errShare
errSave
Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss
err2018-06-01
err1.1K
errOAAI
errYang, Qingsong; Yan, Pingkun; Zhang, Yanbo; Yu, Hengyong; Shi, Yongyi; Mou, Xuanqin; Kalra, Mannudeep K.; Zhang, Yi; Sun, Ling; Wang, Ge
errShare
errSave
researcher View more