.png){kind=icon}
返回
Optical implementation and robustness validation for multi-scale masked autoencoder
.png){kind=icon}
OA
AI
DOI：10.1063/5.0139050.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Masked Autoencoders (MAEs), the state-of-the-art self-supervised neural network architecture in miscellaneous vision tasks, show surprisingly effective potential in reconstructing images distorted by random masking. This paper first introduces an optical implementation of MAEs, employing digital micromirror devices in the optical path to capture partially blocked images. MAEs with multi-scale patches are deployed in the reconstruction procedure. By using an optical-specialized version of the reconstruction network, the system can reconstruct original scenes of high quality. Simulations and experimental measurements showed a significant performance, achieving 24.41 dB average peak-signal-to-noise on Davis2017 datasets and 29.92 dB (masked areas) on authentic captured images under 70% of pixels being blocked. This paves the way for the application of low-bandwidth sampling of high-throughput high-resolution images.
期刊
IF:
5.3
论文数:
1.5K
被引数:
5.5K
机构
引用论文
Snapshot temporal compressive microscopy using an iterative algorithm with untrained neural networks.png)
OPTICS LETTERS
OPTICS LETTERSIF3.3
PREAI
分享收藏From compressive sampling to compressive tasking: retrieving semantics in compressed domain with low bandwidthPHOTONIXOAAI
PHOTONIXIF19.1
OAAI分享收藏分享收藏Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising超越高斯去噪器: 深度CNN的残差学习用于图像去噪
OAAI
OAAI分享收藏
查看更多内容