arrow
返回

Multi-focus image fusion using structure-guided flow

delete2023-10-01
delete2
PRE
AI
Z
Zhao Duan
X
Xiaoliu Luo
T
Taiping Zhang *
DOI:10.1016/j.imavis.2023.104814delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Existing deep learning based methods have shown their advantages in multi-focus image fusion task. However, most methods still suffer from inaccurate focus region detection. In this paper, we employ the property of partwhole relationships embedded by the Capsule Network (CapsNet) to solve the problem. Specifically, we introduce CapsNet in multi-focus image fusion task, and design a structure-guided flow module, which fully utilizes structure information to help locate focus regions. CapsNet is introduced to extract structure features by supervising gradient information of the image. Compared with traditional convolutional neural networks (CNNs), CapsNet takes into account the correlation of features from different positions, such that it encodes more compact features. Once structure features are obtained, a flow alignment module is introduced to learn flow field between structure and image features, and propagate effectively structure features to image features to make confident focus region detection. Experimental results show the proposed method achieves robust fusion performance on three publicly available multi-focus datasets, and outperforms or is comparable to the state-of-the-art methods.
Keyword:
Multi-focus image fusion
Capsule network
Structure information
Flow alignment module

期刊

Image and Vision Computing 封面图
Image and Vision Computing
IF:
4.2
论文数:
4.1K
被引数:
6.7K

机构

C
Chongqing University
学者数:
5.1W
论文数: 4.1W
被引数: 6.0W
引用论文

引用论文

Graph Convolutional Networks for Hyperspectral Image Classification用于高光谱图像分类的图卷积网络
err2021-07-01
err1.3K
errOAAI
errHong, Danfeng; Gao, Lianru; Yao, Jing; Zhang, Bing; Plaza, Antonio; Chanussot, Jocelyn
err分享
err收藏
Multi-Focus Image Fusion Using U-Shaped Networks With a Hybrid Objective基于混合目标U形网络的多聚焦图像融合
err2019-11-01
err48
PREAI
errLi, Huaguang; Nie, Rencan; Cao, Jinde; Guo, Xiaopeng; Zhou, Dongming; He, Kangjian
err分享
err收藏
Pixel- and region-based image fusion with complex wavelets基于像素和区域的复小波图像融合
err2007-04-01
err729
PREAI
errLewis, John J.; O'Callaghan, Robert J.; Nikolov, Stavri G.; Bull, David R.; Canagarajah, Nishan
err分享
err收藏
Semantics lead all: Towards unified image registration and fusion from a semantic perspective语义引领所有人: 从语义角度走向统一的图像配准与融合
err2023-10-01
err28
PREAI
errXie, Housheng; Zhang, Yukuan; Qiu, Junhui; Zhai, Xiangshuai; Liu, Xuedong; Yang, Yang; Zhao, Shan; Luo, Yongfang; Zhong, Jianbo
err分享
err收藏
学者 查看更多内容