arrow
Return

Parameterized L0 Image Smoothing With Unsupervised Learning

delete2024-04-01
delete1
PRE
AI
Y
Yang Yang
L
Ling Tang
严涛 cover
严涛 (Tao Yan)
L
Lanling Zeng
X
Xiang‐Jun Shen
Y
Yongzhao Zhan *
DOI:10.1109/TETCI.2024.3359060delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The traditional L-0 filter shows exquisite smoothing quality, but it suffers from high computational cost. In this paper, we propose an efficient solution to the L-0 -regularized optimization problem based on deep unsupervised learning. The L-0-norm involves a discrete counting scheme, which can not be directly optimized with gradient descent. Therefore, in this paper, we propose to decompose the problem into a series of optimization problems based on a truncated L-1-norm with varying parameters. Comparedwith the truncated L-2-norm explored in traditional L-0 filter, the truncated L-1 -norm promotes the capabilities in structure- and edge-preserving smoothing, reduces the number of iterations, and facilitates the deep learning-based optimization. Furthermore, we propose a deep learning-based parameterized approach to solve the truncated L-1 -regularized problems so that we only need to train a single fully convolutional network to support varying smoothing parameters. We are not trying to reproduce the traditional L-0 filter in this paper. Instead, we show that the proposed deep L-0 filter provides a better smoothing quality. Experimental results indicate that the proposed filter outperforms the state-of-the-art on various applications, including edge-preserving smoothing, non-photorealistic rendering, texture removal, edge extraction, image composition, and compression artifact removal. Moreover, our filter is efficient, it is able to process 720P color images at interactive rates on a modern GPU.
Keywords:
Computational photography
image smoothing
L-0 filter
unsupervised learning

Journal

I
IEEE Transactions on Emerging Topics in Computational Intelligence
IF:
6.5
Papers:
1.4K
Citations:
4.5K

Organization

J
Jiangsu University
Scholars:
4.0W
Papers: 2.8W
Citations: 5.5W
J
Jiangnan University
Scholars:
3.9W
Papers: 2.7W
Citations: 4.7W