arrow
返回

Metalearning-Based Alternating Minimization Algorithm for Nonconvex Optimization

delete2023-09-01
delete21
delete
OA
AI
J
Jingyuan Xia
S
Shengxi Li
黄
黄俊杰 (Junjie Huang) *
Z
Zhixiong Yang
I
Imad M. Jaimoukha
D
Denız Gündüz
DOI:10.1109/TNNLS.2022.3165627delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this article, we propose a novel solution for nonconvex problems of multiple variables, especially for those typically solved by an alternating minimization (AM) strategy that splits the original optimization problem into a set of subproblems corresponding to each variable and then iteratively optimizes each subproblem using a fixed updating rule. However, due to the intrinsic nonconvexity of the original optimization problem, the optimization can be trapped into a spurious local minimum even when each subproblem can be optimally solved at each iteration. Meanwhile, learning-based approaches, such as deep unfolding algorithms, have gained popularity for nonconvex optimization; however, they are highly limited by the availability of labeled data and insufficient explainability. To tackle these issues, we propose a meta-learning based alternating minimization (MLAM) method that aims to minimize a part of the global losses over iterations instead of carrying minimization on each subproblem, and it tends to learn an adaptive strategy to replace the handcrafted counterpart resulting in advance on superior performance. The proposed MLAM maintains the original algorithmic principle, providing certain interpretability. We evaluate the proposed method on two representative problems, namely, bilinear inverse problem: matrix completion and nonlinear problem: Gaussian mixture models. The experimental results validate the proposed approach outperforms AM-based methods.
Keyword:
Optimization
Minimization
Task analysis
Deep learning
Neural networks
Signal processing algorithms
Iterative algorithms
Alternating minimization (AM)
deep unfolding
gaussian mixture model (GMM)
matrix completion
meta-learning (ML)

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
I
Imperial College London
学者数:
8.3W
论文数: 7.3W
被引数: 11.1W
N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
学者 查看更多机构
引用论文

引用论文

Deep Learning Approach for Sparse Aperture ISAR Imaging and Autofocusing Based on Complex-Valued ADMM-Net
err2021-02-01
err78
PREAI
errLi, Ruize; Zhang, Shuanghui; Zhang, Chi; Liu, Yongxiang; Li, Xiang
err分享
err收藏
A quantitative theory of coherent delocalization
err2014-03-05
err0
errOAAI
errFederico Levi; Florian Mintert
err分享
err收藏
err分享
err收藏
Angiopoietin Balance in Septic Shock Patients With Acute Kidney Injury: Effects of Direct Hemoperfusion With Polymyxin B‐Immobilized Fiber
err2016-08-15
err0
PREAI
errItaru Ebihara; Kouichi Hirayama; Miho Nagai; Eri Shiina; Megumi Koda; Masanobu Gunji; Yuki Okubo; Chihiro Sato; Joichi Usui; Kunihiro Yamagata; Masaki Kobayashi
err分享
err收藏
学者 查看更多内容