arrow
返回

Efficient Hyperspectral Image Reconstruction Using Lightweight Separate Spectral Transformers

delete2026-01-01
delete0
PRE
AI
李佳男 (Jianan Li)
W
Wangcai Zhao
T
Tingfa Xu
DOI:10.1109/TCI.2026.3653323delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Hyperspectral imaging (HSI) is essential across various disciplines for its capacity to capture rich spectral information. However, efficiently reconstructing hyperspectral images from compressive sensing measurements presents significant challenges. To tackle these, we adopt a divide-and-conquer strategy that capitalizes on the unique spectral and spatial characteristics of hyperspectral images. We introduce the Lightweight Separate Spectral Transformer (LSST), an innovative architecture tailored for efficient hyperspectral image reconstruction. This architecture consists of Separate Spectral Transformer Blocks (SSTB) for modeling spectral relationships and Lightweight Spatial Convolution Blocks (LSCB) for spatial processing. The SSTB employs Grouped Spectral Self-attention and a Spectrum Shuffle operation to effectively manage both local and non-local spectral relationships. Simultaneously, the LSCB utilizes depth-wise separable convolutions and strategic ordering to enhance spatial information processing. Furthermore, we implement the Focal Spectrum Loss, a novel loss weighting mechanism that dynamically adjusts during training to improve reconstruction across spectrally complex bands. Extensive testing demonstrates that our LSST achieves superior performance while requiring fewer FLOPs and parameters, underscoring its efficiency and effectiveness.
Keyword:
Hyperspectral imaging
efficient reconstruction
attention mechanism

期刊

I
IEEE Transactions on Computational Imaging
IF:
4.8
论文数:
129
被引数:
0

机构

B
Beijing Institute of Technology
学者数:
5.2K
论文数: 2.1K
被引数: 6.0W
引用论文

引用论文

Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction
err2022-06-01
err0
errOAAI
errYuanhao Cai; Jing Lin; Xiaowan Hu; Haoqian Wang; Xin Yuan; Yulun Zhang; Radu Timofte; Luc Van Gool
err分享
err收藏
Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction
err2022-10-24
err0
PREAI
errYuanhao Cai; Jing Lin; Xiaowan Hu; Haoqian Wang; Xin Yuan; Yulun Zhang; Radu Timofte; Luc Van Gool
err分享
err收藏
A ConvNet for the 2020s21世纪20年代的ConvNet
err2022-06-01
err0
PREAI
errZhuang Liu; Hanzi Mao; Chao-Yuan Wu; Christoph Feichtenhofer; Trevor Darrell; Saining Xie
err分享
err收藏
HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging
err2022-06-01
err0
errOAAI
errXiaowan Hu; Yuanhao Cai; Jing Lin; Haoqian Wang; Xin Yuan; Yulun Zhang; Radu Timofte; Luc Van Gool
err分享
err收藏
学者 查看更多内容