arrow
Return

Variable selection based on squared derivative averages

delete2021-05-01
delete4
PRE
AI
C
Changming Cheng
E
Er‐Wei Bai *
DOI:10.1016/j.automatica.2021.109491delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Identification of a nonlinear nonparametric system is not easy. On the other hand, many systems are sparse in the sense that some variables do not contribute and some contribute only marginally. If these variables that do not contribute or contribute marginally can be detected and removed, the identification problem becomes lower dimensional and is relatively easy to deal with. The first goal of the paper is to develop an overlap group Lasso method to detect which variables contribute and which variables do not. The algorithm developed favors sparsity in terms of partial derivatives and provides a necessary and sufficient condition for a variable to contribute. Once contributing variables are identified, the second goal of the paper is to rank the importance of these variables based on the squared derivative averages. Since both the function and its derivatives are unknown, how to estimate the squared derivative averages is a concern. To this end, two methods are proposed with convergence results. The first one is nonparametric based on the Fourier transform of some intermediate variables. The other is to cast the problem in a Reproducing Kernel Hilbert Space (RKHS). (C) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Variable selection
Nonlinear identification
Kernel
Non-parametric systems

Journal

Automatica cover
Automatica
IF:
5.9
Papers:
1.2W
Citations:
5.2W

Organization

U
University of Iowa
Scholars:
2.8W
Papers: 2.3W
Citations: 600
S
shanghai jiao tong university
Scholars:
15.7W
Papers: 11.7W
Citations: 159
Cited Papers

Cited Papers

Least angle regression
err2004-04-01
err7.5K
errOAAI
errEfron, B; Hastie, T; Johnstone, I; Tibshirani, R
errShare
errSave
A New Kernel-Based Approach for NonlinearSystem Identification
err2011-12-01
err86
PREAI
errPillonetto, Gianluigi; Quang, Minh Ha; Chiuso, Alessandro
errShare
errSave
Kernel-based local order estimation of nonlinear nonparametric systems
err2015-01-01
err26
errOAAI
errZhao, Wenxiao; Chen, Han-Fu; Bai, Er-wei; Li, Kang
errShare
errSave
researcher View more