.png){kind=icon}
.png){kind=icon}
Return
Positive Sparse Signal Denoising: What Does a CNN Learn?
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2022.3160372.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Convolutional neural networks (CNNs) provide impressive empirical success in various tasks; however, their inner workings generally lack interpretability. In this paper, we interpret shallow CNNs that we have trained for the task of positive sparse signal denoising. We identify and analyze common structures among the trained CNNs. We show that the learned CNN denoisers can be interpreted as a nonlinear locally-adaptive thresholding procedure, which is an empirical approximation of the minimum mean square error estimator. Based on our interpretation, we train constrained CNN denoisers and demonstrate no loss in performance despite having fewer trainable parameters. The interpreted CNN denoiser is an instance of a multivariate spline regression model, and a generalization of classical proximal thresholding operators.
Keywords:
Noise reduction
Convolutional neural networks
Smoothing methods
Neural networks
Task analysis
Training
Signal denoising
Convolutional neural network (CNN)
deep learning
sparse denoising
multivariate spline regression
proximal operator
Journal
IF:
9.6
Papers:
1.1W
Citations:
1.7W