arrow
Return

Neural network pruning and simultaneous feature and structure selection

delete2026-04-13
delete0
delete
OA
AI
X
Xinyue Zhang *
H
Hong Gu
T
Toby Kenney
DOI:10.1016/j.neunet.2026.108977delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Neural network pruning makes large neural networks more portable and smaller neural networks more interpretable with minimal loss of predictive accuracy. We propose a pruning method that reformulates the neural-network LASSO problem as a standard weighted regression or classification problem with a LASSO penalty. We apply this method starting from a dense neural network structure that includes all possible feed-forward networks as subnetworks. This efficiently removes substantial redundancy. To further refine the network, we develop a second step, which cycles over all remaining links, one at a time, removing those that do not sufficiently improve the model fit.
Keywords:
Neural network
Feature selection
Model selection
LASSO
Neural network architecture
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.3K
Citations:
3.0W

Organization

No organization information available
Cited Papers

Cited Papers

Sparse optimization guided pruning for neural networks
err2024-03-01
err3
PREAI
errShi, Yong; Tang, Anda; Niu, Lingfeng; Zhou, Ruizhi
errShare
errSave
Smooth Group L1/2 Regularization for Pruning Convolutional Neural Networks
err2022-01-13
err0
errOAAI
errYuan Bao; Zhaobin Liu; Zhongxuan Luo; Sibo Yang
errShare
errSave
RePaIR: Repaired pruning at initialization resilience
err2025-04-01
err0
PREAI
errZhao, Haocheng; Guan, Runwei; Man, Ka Lok; Yu, Limin; Yue, Yutao
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more