A Simple Neural Network for Sparse Optimization With l1 Regularization

doi:10.1109/TNSE.2021.3114426

A Simple Neural Network for Sparse Optimization With l1 Regularization

2021-10-01

7

PRE

AI

马丽涛 (Litao Ma)

W

Wei Bian *

DOI：10.1109/TNSE.2021.3114426

Original

Original request for help

Save

Abstract

En 中文

This paper considers a class of sparse optimization problems with l(1)-norm regularization and general convex constraints, in which the individual functions involved are differential except l(1) regularization term. Firstly, a sufficient and necessary condition for the subgradients of l(1)-norm is discussed. Subsequently, a sufficient and necessary optimality condition for the considered problem is obtained. According to this condition, a simple neural network with differential equation structure is proposed. Secondly, positive invariance and exponential convergence of state trajectory to the set of equality constraints are studied. In addition, the intermediate state variable is always non-negative when its initial value is so. Moreover, boundedness, global existence and stability in the sense of Lyapunov of state solution to the proposed neural network are guaranteed. Thirdly, the proposed network is globally convergent to an optimal solution of the considered problem from any initial point. At last, sufficient experiments including two numerical experiments, signal recovery, data classification and image restoration problems with real data sets are provided to show the efficiency of this approach.

Keywords:

l(1)-norm

Sparse optimization

Neurodynamic approach

General convex constraints

Projection operator

A Simple Neural Network for Sparse Optimization With l1 Regularization

Abstract

Journal

Organization