arrow
返回

Video reconstruction from a single motion blurred image using learned dynamic phase coding

delete2023-08-21
delete5
delete
OA
AI
E
Erez Yosef *
S
Shay Elmalem
R
Raja Giryes
DOI:10.1038/s41598-023-40297-0delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Video reconstruction from a single motion-blurred image is a challenging problem, which can enhance the capabilities of existing cameras. Recently, several works addressed this task using conventional imaging and deep learning. Yet, such purely digital methods are inherently limited, due to direction ambiguity and noise sensitivity. Some works attempt to address these limitations with non-conventional image sensors, however, such sensors are extremely rare and expensive. To circumvent these limitations by simpler means, we propose a hybrid optical-digital method for video reconstruction that requires only simple modifications to existing optical systems. We use learned dynamic phase-coding in the lens aperture during image acquisition to encode motion trajectories, which serve as prior information for the video reconstruction process. The proposed computational camera generates a sharp frame burst of the scene at various frame rates from a single coded motion-blurred image, using an image-to-video convolutional neural network. We present advantages and improved performance compared to existing methods, with both simulations and a real-world camera prototype. We extend our optical coding to video frame interpolation and present robust and improved results for noisy videos.
Keyword:
CODED-APERTURE
EXPOSURE
DEPTH
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Scientific Reports 封面图
Scientific Reports
IF:
3.9
论文数:
28.0W
被引数:
83.5W

机构

T
Tel Aviv University
学者数:
3.7W
论文数: 3.0W
被引数: 3.6W
引用论文

引用论文

Ex-PRESS Glaucoma Shunt Dislocation Into the Anterior Chamber
err2008-12-01
err0
PREAI
errChristopher C. Teng; Nathan Radcliffe; Jennifer E. Huang; Edmund Farris
err分享
err收藏
Target-to-User Association in ISAC Systems With Vehicle-Lodged RIS
err2023-09-01
err0
errOAAI
errMarouan Mizmizi; Dario Tagliaferri; Damiano Badini; Umberto Spagnolini
err分享
err收藏
Correlating TEM images of damage in irradiated materials to molecular dynamics simulations
err2002-12-01
err0
PREAI
errR. Schaeublin; M.-J. Caturla; M. Wall; T. Felter; M. Fluss; B.D. Wirth; T. Diaz de la Rubia; M. Victoria
err分享
err收藏
NMR studies in orthorhombic Fe3B1−xCx (0.1≤x≤0.4)
err1987-04-15
err0
PREAI
errY. D. Zhang; J. I. Budnick; F. H. Sanchez; W. A. Hines; D. P. Yang; J. D. Livingston
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Learned phase coded aperture for the benefit of depth of field extension
err2018-06-04
err67
errOAAI
errElmalem, Shay; Giryes, Raja; Marom, Emanuel
err分享
err收藏
学者 查看更多内容