arrow
返回

Endmember-Assisted Camera Response Function Learning, Toward Improving Hyperspectral Image Super-Resolution Performance

delete2022-01-01
delete3
delete
OA
AI
J
Jiangsan Zhao *
渠
渠瀛 (Ying Qu)
S
S. Ninomiya
W
Wei Guo
DOI:10.1109/TGRS.2022.3182425delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The camera response function (CRF) that projects hyperspectral radiance to the corresponding RGB images is important for most hyperspectral image super-resolution (HSI-SR) models. In contrast to most studies that focus on improving HSI-SR performance through new architectures, we aim to prevent the model performance drop by learning the CRF of any given HSIs and RGB image from the same scene in an unsupervised manner, independent of the HSI-SR network. Accordingly, we first decompose the given RGB image into endmembers and an abundance map using the Dirichlet autoencoder architecture. Thereafter, a linear CRF learning network is optimized to project the reference HSIs to the RGB image that can be similarly decomposed like the given RGB, assuming that objects in both images share the same endmembers and abundance map. The quality of the RGB images generated from the learned CRFs is compared with that of the corresponding ground-truth images based on the true CRFs of two consumer-level cameras Nikon 700D and Canon 500D. We demonstrate that the effectively learned CRFs can prevent significant performance drop in three popular HSI-SR models on RGB images from different categories of standard datasets of CAVE, ICVL, Chikusei, Cuprite, Salinas, and KSC. The successfully learned CRF using the method proposed in this study would largely promote a wider implementation of HSI-SR models since tremendous performance drop can be prevented practically.
Keyword:
Cameras
Hyperspectral imaging
Image reconstruction
Spatial resolution
Imaging
Superresolution
Image color analysis
Abundance map
camera response function (CRF)
endmember
hyperspectral image (HSI)
super-resolution
unsupervised deep learning

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

U
University of Tokyo
学者数:
7.1W
论文数: 6.5W
被引数: 2.2K
University of Tennessee System 封面图
University of Tennessee System
学者数:
2.9W
论文数: 2.7W
被引数: 115
引用论文

引用论文

Trench gap-filling copper by ion beam sputter deposition
err2006-05-01
err0
PREAI
errSheng Han; Tzu-Li Lee; Ching-Jung Yang; Han C. Shih
err分享
err收藏
Monitoring osteoarthritis progression using near infrared (NIR) spectroscopy
err2017-09-13
err32
errOAAI
errAfara, Isaac O.; Prasadam, Indira; Arabshahi, Zohreh; Xiao, Yin; Oloyede, Adekunle
err分享
err收藏
Small towns shrinkage in the Jilin Province: A comparison between China and developed countries
err2020-04-13
err0
errOAAI
errYao Tong; Wei Liu; Chenggu Li; Jing Zhang; Zuopeng Ma
err分享
err收藏
err分享
err收藏
学者 查看更多内容