arrow
返回

Convolutional Analysis Operator Learning: Acceleration and Convergence

delete2020-01-01
delete34
delete
OA
AI
I
Il Yong Chun *
J
Jeffrey A. Fessler
DOI:10.1109/TIP.2019.2937734delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Convolutional operator learning is gaining attention in many signal processing and computer vision applications. Learning kernels has mostly relied on so-called patch-domain approaches that extract and store many overlapping patches across training signals. Due to memory demands, patch-domain methods have limitations when learning kernels from large datasets - particularly with multi-layered structures, e.g., convolutional neural networks - or when applying the learned kernels to high-dimensional signal recovery problems. The so-called convolution approach does not store many overlapping patches, and thus overcomes the memory problems particularly with careful algorithmic designs; it has been studied within the synthesis signal model, e.g., convolutional dictionary learning. This paper proposes a new convolutional analysis operator learning (CAOL) framework that learns an analysis sparsifying regularizer with the convolution perspective, and develops a new convergent Block Proximal Extrapolated Gradient method using a Majorizer (BPEG-M) to solve the corresponding block multi-nonconvex problems. To learn diverse filters within the CAOL framework, this paper introduces an orthogonality constraint that enforces a tight-frame filter condition, and a regularizer that promotes diversity between filters. Numerical experiments show that, with sharp majorizers, BPEG-M significantly accelerates the CAOL convergence rate compared to the state-of-the-art block proximal gradient (BPG) method. Numerical experiments for sparse-view computational tomography show that a convolutional sparsifying regularizer learned via CAOL significantly improves reconstruction quality compared to a conventional edge-preserving regularizer. Using more and wider kernels in a learned regularizer better preserves edges in reconstructed images.
Keyword:
Convolution
Training
Kernel
Convolutional codes
Computed tomography
Convergence
Image reconstruction
Convolutional regularizer learning
convolutional dictionary learning
convolutional neural networks
unsupervised machine learning algorithms
nonconvex-nonsmooth optimization
block coordinate descent
inverse problems
X-ray computed tomography
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
university of michigan system
学者数:
9.1W
论文数: 8.6W
被引数: 133
引用论文

引用论文

Small Silencing RNAs in Plants Are Mobile and Direct Epigenetic Modification in Recipient Cells
err2010-05-14
err0
PREAI
errAttila Molnar; Charles W. Melnyk; Andrew Bassett; Thomas J. Hardcastle; Ruth Dunn; David C. Baulcombe
err分享
err收藏
Stability of cylindrical bodies in the theory of surface diffusion
err1995-12-01
err0
PREAI
errBernard D. Coleman; Richard S. Falk; Maher Moakher
err分享
err收藏
LEARN: Learned Experts' Assessment-Based Reconstruction Network for Sparse-Data CT学习: 基于专家评估的稀疏数据CT重建网络
err2018-06-01
err307
errOAAI
errChen, Hu; Zhang, Yi; Chen, Yunjin; Zhang, Junfeng; Zhang, Weihua; Sun, Huaiqiang; Lv, Yang; Liao, Peixi; Zhou, Jiliu; Wang, Ge
err分享
err收藏
学者 查看更多内容