arrow
返回

Neural network input feature selection using structured l2 - norm penalization

delete2022-07-02
delete5
delete
OA
AI
N
Nathaniel Egwu *
T
Thomas Mrziglod
A
Andreas Schuppert
DOI:10.1007/s10489-022-03539-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Artificial neural networks are referred to as universal approximators due to their inherent ability to reconstruct complex linear and nonlinear output maps conceived as input-output relationships from data sets. This can be done by reducing large networks via regularization in order to establish compact models containing fewer parameters aimed at describing vital dependencies in data sets. In situations where the data sets contain non-informative input features, devising a continuous, optimal input feature selection technique can lead to improved prediction or classification. We propose a continuous input selection technique through a dimensional reduction mechanism using a 'structured' l(2) - norm regularization. The implementation is done by identifying the most informative feature subsets from a given data set via an adaptive training mechanism. The adaptation involves introducing a novel, modified gradient approach during training to deal with the non-differentiability associated with the gradient of the structured norm penalty. When the method is applied to process data sets, results indicate that the most informative inputs of artificial neural networks can be selected using a structured l(2) - norm penalization.
Keyword:
Input optimization
Sparsity
Regularization
Structured penalty
Feature selection
Deep learning

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

R
RWTH Aachen University
学者数:
3.5W
论文数: 2.6W
被引数: 3.6W
B
Bayer AG
学者数:
7.4K
论文数: 4.6K
被引数: 45
引用论文

引用论文

Cytotoxicity and biological effects of functional nanomaterials delivered to various cell lines
err2009-09-16
err0
PREAI
errMeena Mahmood; Daniel A. Casciano; Teodora Mocan; Cornel Iancu; Yang Xu; Lucian Mocan; Dana Todea Iancu; Enkeleda Dervishi; Zhongrui Li; Mustafa Abdalmuhsen; Alexandru R. Biris; Nawab Ali; Paul Howard; Alexandru S. Biris
err分享
err收藏
Molecular hydrogels of therapeutic agents
err2009-01-01
err0
PREAI
errFan Zhao; Man Lung Ma; Bing Xu
err分享
err收藏
学者 查看更多内容