返回
FusionDiff: Multi-focus image fusion using denoising diffusion probabilistic models
DOI:10.1016/j.eswa.2023.121664.png)
摘要
En 中文
Multi-focus image fusion (MFIF) is an image enhancement technology with broad application prospects that can effectively extend the depth-of-field of optical lenses. This paper presents a novel MFIF method, named FusionDiff, based on denoising diffusion probabilistic models (DDPM). FusionDiff uses DDPM to fuse two source images by iteratively performing multiple denoising operations. To predict noise accurately and train the model efficiently, a lightweight U-Net architecture is designed as the conditional noise predictor. FusionDiff does not depend on any specific activity level measurement method, fusion rule or complex feature extraction network. It overcomes many algorithm design and training difficulties in existing image fusion methods. FusionDiff is noise-resistant and can still produce outstanding fusion results from source images with noise interference. In addition, FusionDiff is a few-shot learning method, which makes it suitable for image fusion tasks where training samples are relatively scarce. Experiments show that FusionDiff outperforms representative state-of-the-art methods in both visual perception and quantitative metrics. The code is available at https://github.com/lmn-ning/ImageFusionhttps://github.com/lmn-ning/ImageFusion
Keyword:
Multi-focus image fusion
Denoising diffusion probabilistic models
Few-shot learning
Noise-robust method
期刊
IF:
7.5
论文数:
3.0W
被引数:
10.2W
机构
引用论文
SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin TransformerSwinFusion: 通过Swin变压器进行通用图像融合的跨域远程学习
Environmental safety in the countries bordering Kazakhstan in the context of sustainable development可持续发展背景下哈萨克斯坦周边国家的环境安全
What is the extent of exposure to periods of match congestion in professional soccer players?职业足球运动员在比赛拥堵期间的暴露程度如何?
MDFN: Mask deep fusion network for visible and infrared image fusion without reference ground-truth?
Deep learning for pixel-level image fusion: Recent advances and future prospects像素级图像融合的深度学习: 最新进展和未来展望
INFORMATION FUSION
IF15.5
Multi-Focus Image Fusion Using U-Shaped Networks With a Hybrid Objective基于混合目标U形网络的多聚焦图像融合
IEEE SENSORS JOURNAL
IF4.5

