arrow
返回

FusionDiff: Multi-focus image fusion using denoising diffusion probabilistic models

delete2024-03-01
delete12
PRE
AI
L
Li, Mining
T
Tianyou Zheng
Y
Yang Zhang
付
付伟伟 (Weiwei Fu) *
DOI:10.1016/j.eswa.2023.121664delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-focus image fusion (MFIF) is an image enhancement technology with broad application prospects that can effectively extend the depth-of-field of optical lenses. This paper presents a novel MFIF method, named FusionDiff, based on denoising diffusion probabilistic models (DDPM). FusionDiff uses DDPM to fuse two source images by iteratively performing multiple denoising operations. To predict noise accurately and train the model efficiently, a lightweight U-Net architecture is designed as the conditional noise predictor. FusionDiff does not depend on any specific activity level measurement method, fusion rule or complex feature extraction network. It overcomes many algorithm design and training difficulties in existing image fusion methods. FusionDiff is noise-resistant and can still produce outstanding fusion results from source images with noise interference. In addition, FusionDiff is a few-shot learning method, which makes it suitable for image fusion tasks where training samples are relatively scarce. Experiments show that FusionDiff outperforms representative state-of-the-art methods in both visual perception and quantitative metrics. The code is available at https://github.com/lmn-ning/ImageFusionhttps://github.com/lmn-ning/ImageFusion
Keyword:
Multi-focus image fusion
Denoising diffusion probabilistic models
Few-shot learning
Noise-robust method

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

U
university of science & technology of china, cas
学者数:
3.2W
论文数: 2.7W
被引数: 74
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Environmental safety in the countries bordering Kazakhstan in the context of sustainable development可持续发展背景下哈萨克斯坦周边国家的环境安全
err2021-03-19
err0
errOAAI
errZeinegul Yessymkhanova; Shakizada Niyazbekova; Zhanar Dauletkhanova; Nurdin Dzholdoshev; Tamara Dzholdosheva
err分享
err收藏
Ecological problems of modern central Kazakhstan: challenges and possible solutions
err2020-03-20
err0
errOAAI
errТurgai Alimbaev; Zhanna Mazhitova; Bibizhamal Omarova; Bekzhan Kamzayev; Kuralai Atanakova
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Multi-Focus Image Fusion Using U-Shaped Networks With a Hybrid Objective基于混合目标U形网络的多聚焦图像融合
err2019-11-01
err48
PREAI
errLi, Huaguang; Nie, Rencan; Cao, Jinde; Guo, Xiaopeng; Zhou, Dongming; He, Kangjian
err分享
err收藏
学者 查看更多内容