arrow
返回

Deep Self-Supervised Hyperspectral Image Reconstruction

delete2022-11-01
delete5
PRE
AI
Z
Zhe Liu *
X
Xian‐Hua Han
DOI:10.1145/3510373delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Reconstructing a high-resolution hyperspectral (HR-HS) image via merging a low-resolution hyperspectral (LR-HS) image and a high-resolution RGB (HR-RGB) image has become a hot research topic, and can greatly benefit for different subsequent high-level vision tasks. Recently, deep learning-based approaches have evolved for HS image reconstruction and validated impressive performance. However, to learn a good reconstruction model in the deep learning-based methods, it is mandatory to previously collect large-scale training triplets consisting of the LR-HS, HR-RGB, and HR-HS images, which is difficult to be collected in real applications. This study proposes a deep self-supervised HS image reconstruction framework (DSSH), which does not have to depend on any handcrafted prior and previously collected training triplets at all. The proposed DSSH method leverages the designed network architecture itself for capturing the prior of the underlying structure in the latent HR-HS image and employs the observed LR-HS and HR-RGB images only for network parameter learning. Experiments on two benchmark HS image datasets validated that the proposed DSSH method manifests very impressive reconstruction performance, and is even better than some state-of-the-art supervised learning approaches.
Keyword:
Deep learning
hyperspectral image reconstruction
hyperspectral and RGB image fusion
self-supervised learning

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

Y
Yamaguchi University
学者数:
5.8K
论文数: 4.4K
被引数: 3.3K
引用论文

引用论文

Properties, characteristics and application of grinded Malpighia emarginata seeds in the removal of toxic metals from water
err2018-03-01
err0
PREAI
errAdrielli C.P. Silva; Alexandre O. Jorgetto; Marcos H.P. Wondracek; Rodrigo M. Galera; José F. Schneider; Margarida J. Saeki; Valber A. Pedrosa; Luiz F. Zara; Gustavo R. Castro
err分享
err收藏
Preparation, characterization and comparison of antibacterial property of polyethersulfone composite membrane containing zerovalent iron or magnetite nanoparticles
err2017-01-25
err0
PREAI
errNadir Dizge; Yasin Ozay; U. Bulut Simsek; H. Elif Gulsen; Ceyhun Akarsu; Meral Turabik; Ali Unyayar; Kasim Ocakoglu
err分享
err收藏
学者 查看更多内容