arrow
Return

FusionDiff: Multi-focus image fusion using denoising diffusion probabilistic models

delete2024-03-01
delete12
PRE
AI
L
Li, Mining
T
Tianyou Zheng
Y
Yang Zhang
付
付伟伟 (Weiwei Fu) *
DOI:10.1016/j.eswa.2023.121664delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multi-focus image fusion (MFIF) is an image enhancement technology with broad application prospects that can effectively extend the depth-of-field of optical lenses. This paper presents a novel MFIF method, named FusionDiff, based on denoising diffusion probabilistic models (DDPM). FusionDiff uses DDPM to fuse two source images by iteratively performing multiple denoising operations. To predict noise accurately and train the model efficiently, a lightweight U-Net architecture is designed as the conditional noise predictor. FusionDiff does not depend on any specific activity level measurement method, fusion rule or complex feature extraction network. It overcomes many algorithm design and training difficulties in existing image fusion methods. FusionDiff is noise-resistant and can still produce outstanding fusion results from source images with noise interference. In addition, FusionDiff is a few-shot learning method, which makes it suitable for image fusion tasks where training samples are relatively scarce. Experiments show that FusionDiff outperforms representative state-of-the-art methods in both visual perception and quantitative metrics. The code is available at https://github.com/lmn-ning/ImageFusionhttps://github.com/lmn-ning/ImageFusion
Keywords:
Multi-focus image fusion
Denoising diffusion probabilistic models
Few-shot learning
Noise-robust method

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 74
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
err2022-07-01
err482
PREAI
errMa, Jiayi; Tang, Linfeng; Fan, Fan; Huang, Jun; Mei, Xiaoguang; Ma, Yong
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Environmental safety in the countries bordering Kazakhstan in the context of sustainable development
err2021-03-19
err0
errOAAI
errZeinegul Yessymkhanova; Shakizada Niyazbekova; Zhanar Dauletkhanova; Nurdin Dzholdoshev; Tamara Dzholdosheva
errShare
errSave
Ecological problems of modern central Kazakhstan: challenges and possible solutions
err2020-03-20
err0
errOAAI
errТurgai Alimbaev; Zhanna Mazhitova; Bibizhamal Omarova; Bekzhan Kamzayev; Kuralai Atanakova
errShare
errSave
What is the extent of exposure to periods of match congestion in professional soccer players?
err2015-10-13
err0
PREAI
errChristopher Carling; Alan McCall; Franck Le Gall; Gregory Dupont
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Deep learning for pixel-level image fusion: Recent advances and future prospects
err2018-07-01
err561
PREAI
errLiu, Yu; Chen, Xun; Wang, Zengfu; Wang, Z. Jane; Ward, Rabab K.; Wang, Xuesong
errShare
errSave
Multi-Focus Image Fusion Using U-Shaped Networks With a Hybrid Objective
err2019-11-01
err48
PREAI
errLi, Huaguang; Nie, Rencan; Cao, Jinde; Guo, Xiaopeng; Zhou, Dongming; He, Kangjian
errShare
errSave
researcher View more