返回
Multi-focus image fusion using structure-guided flow
DOI:10.1016/j.imavis.2023.104814.png)
摘要
En 中文
Existing deep learning based methods have shown their advantages in multi-focus image fusion task. However, most methods still suffer from inaccurate focus region detection. In this paper, we employ the property of partwhole relationships embedded by the Capsule Network (CapsNet) to solve the problem. Specifically, we introduce CapsNet in multi-focus image fusion task, and design a structure-guided flow module, which fully utilizes structure information to help locate focus regions. CapsNet is introduced to extract structure features by supervising gradient information of the image. Compared with traditional convolutional neural networks (CNNs), CapsNet takes into account the correlation of features from different positions, such that it encodes more compact features. Once structure features are obtained, a flow alignment module is introduced to learn flow field between structure and image features, and propagate effectively structure features to image features to make confident focus region detection. Experimental results show the proposed method achieves robust fusion performance on three publicly available multi-focus datasets, and outperforms or is comparable to the state-of-the-art methods.
Keyword:
Multi-focus image fusion
Capsule network
Structure information
Flow alignment module
期刊
IF:
4.2
论文数:
4.1K
被引数:
6.7K
机构
引用论文
Multifocus image fusion using the nonsubsampled contourlet transform使用非下采样contourlet变换的多聚焦图像融合
SIGNAL PROCESSING
IF3.6
An α-Matte Boundary Defocus Model-Based Cascaded Network for Multi-Focus Image Fusion基于 α-亚光边界离焦模型的级联网络多聚焦图像融合
Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure使用四叉树结构中基于形态学的聚焦度量的多聚焦图像融合
INFORMATION FUSION
IF15.5
Multi-Focus Image Fusion Using U-Shaped Networks With a Hybrid Objective基于混合目标U形网络的多聚焦图像融合
IEEE SENSORS JOURNAL
IF4.5
Semantics lead all: Towards unified image registration and fusion from a semantic perspective语义引领所有人: 从语义角度走向统一的图像配准与融合
INFORMATION FUSION
IF15.5

