arrow
返回

Transferring Deep Models for Cloud Detection in Multisensor Images via Weakly Supervised Learning

delete2024-01-01
delete4
PRE
AI
S
Shaocong Zhu
李
李志伟 (Zhiwei Li)
H
Huanfeng Shen *
DOI:10.1109/TGRS.2024.3358824delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Recently, deep learning has been widely used for cloud detection in satellite images; however, due to radiometric and spatial resolution differences in images from different sensors and time-consuming process of manually labeling cloud detection datasets, it is difficult to effectively generalize deep learning models for cloud detection in multisensor images. This article propose a weakly supervised learning method for transferring deep models for cloud detection in multisensor images (TransMCD), which leverages the generalization of deep models and the spectral features of clouds to construct pseudo-label dataset to improve the generalization of models. A deep model is first pretrained using a well-annotated cloud detection dataset, which is used to obtain a rough cloud mask of unlabeled target image. The rough mask can be used to determine the spectral threshold adaptively for cloud segmentation of target image. Block-level pseudo labels with high confidence in target image are selected using the rough mask and spectral mask. Unsupervised segmentation technique is used to construct a high-quality pixel-level pseudo-label dataset. Finally, the pseudo-label dataset is used as supervised information for transferring the pretrained model to target image. The TransMCD method was validated by transferring model trained on 16-m Gaofen-1 wide field of view(WFV)images to 8-m Gaofen-1, 4-m Gaofen-2, and 10-m Sentinel-2 images. The F1-score of the transferred models on target images achieves improvements of 1.23%-9.63% over the pretrained models, which is comparable to the fully-supervised models trained with well-annotated target images, suggesting the efficiency of the TransMCD method for cloud detection in multisensor images.
Keyword:
Cloud computing
Clouds
Sensors
Predictive models
Supervised learning
Image segmentation
Deep learning
Cloud detection
deep learning
multisensor images
weakly supervised learning

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

H
hong kong polytechnic university
学者数:
3.0W
论文数: 4.1W
被引数: 921
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
引用论文

引用论文

err分享
err收藏
Multi-feature combined cloud and cloud shadow detection in GaoFen-1 wide field of view imagery
err2017-03-01
err242
errOAAI
errLi, Zhiwei; Shen, Huanfeng; Li, Huifang; Xia, Guisong; Gamba, Paolo; Zhang, Liangpei
err分享
err收藏
Automated masking of cloud and cloud shadow for forest change analysis using Landsat images
err2010-10-21
err164
PREAI
errHuang, Chengquan; Thomas, Nancy; Goward, Samuel N.; Masek, Jeffrey G.; Zhu, Zhiliang; Townshend, John R. G.; Vogelmann, James E.
err分享
err收藏
err分享
err收藏
A hybrid generative adversarial network for weakly-supervised cloud detection in multispectral images
err2022-10-01
err33
errOAAI
errLi, Jun; Wu, Zhaocong; Sheng, Qinghong; Wang, Bo; Hu, Zhongwen; Zheng, Shaobo; Campus-Valls, Gustau; Molinier, Matthieu
err分享
err收藏
学者 查看更多内容