arrow
返回

ISTD-diff: Infrared Small Target Detection via Conditional Diffusion Models

delete2024-01-01
delete1
PRE
AI
N
Nini Du *
G
Gong Xue-mei
刘椰 封面图
刘椰 (Ye Liu)
DOI:10.1109/LGRS.2024.3401838delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Infrared small-target detection (IRSTD), which is to extract tiny and dim targets that are hidden in noisy and messy backgrounds, is a challenging task in computer vision. Inspired by the recently powerful deep generative models, we formulate the IRSTD as a generative task and design a conditional denoising (DE) model termed ISTD-diff to iteratively generate the target mask from the noisy one. In addition, ISTD-diff employs a two-pathway architecture, consisting of a conditional prior (CP) stream for encoding the input infrared image prior and a DE stream for cleaning up the noisy masks. Both streams are equipped with several cascaded innovative channel-dimension transformer (CDT) layers, which capture the global correlations efficiently and reduce computational demands effectively. Moreover, to strengthen the DE learning process, we proposed a simple, but powerful method named attention injection module (AIM), which provides detailed control over the DE stream. Extensive experiments finely demonstrate the superior performance of our ISTD-diff beyond the current representative segmentation-based state-of-the-art (SOTA) algorithms.
Keyword:
Streaming media
Task analysis
Noise reduction
Transformers
Correlation
Object detection
Noise measurement
Diffusion model
dual-dimension transformer
feature injection
infrared small-object detection

期刊

IEEE Geoscience and Remote Sensing Magazine 封面图
IEEE Geoscience and Remote Sensing Magazine
IF:
16.4
论文数:
1.0W
被引数:
5.1K

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
N
Ningbo University of Technology
学者数:
2.2K
论文数: 2.0K
被引数: 5.0K
引用论文

引用论文

err分享
err收藏
SRDiff: Single image super-resolution with diffusion probabilistic modelsSRDiff: 具有扩散概率模型的单幅图像超分辨率
err2022-03-01
err330
errOAAI
errLi, Haoying; Yang, Yifan; Chang, Meng; Chen, Shiqi; Feng, Huajun; Xu, Zhihai; Li, Qi; Chen, Yueting
err分享
err收藏
err分享
err收藏
A Local Contrast Method for Small Infrared Target Detection
err2014-01-01
err951
PREAI
errChen, C. L. Philip; Li, Hong; Wei, Yantao; Xia, Tian; Tang, Yuan Yan
err分享
err收藏
学者 查看更多内容