arrow
返回

LEVEL SET LEARNING WITH PSEUDOREVERSIBLE NEURAL NETWORKS FOR NONLINEAR DIMENSION REDUCTION IN FUNCTION APPROXIMATION

delete2023-06-05
delete2
delete
OA
AI
Y
Yuankai Teng
Z
Zhu Wang
L
Lili Ju *
A
Anthony Gruber
G
Guannan Zhang
DOI:10.1137/21M1459198delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Due to the curse of dimensionality and the limitation on training data, approximating high-dimensional functions is a very challenging task even for powerful deep neural networks. Inspired by the Nonlinear Level-set Learning (NLL) method, which uses the reversible residual network (RevNet), in this paper, we propose a new method of Dimension Reduction via Learning Level Sets (DRiLLS) for function approximation. Our method contains two major components: one is the pseudoreversible neural network (PRNN) module, which effectively transforms high-dimensional input variables to low-dimensional active variables, and the other is the synthesized regression module for approximating function values based on the transformed data in the low-dimensional space. The PRNN not only relaxes the invertibility constraint of the nonlinear transformation present in the NLL method due to the use of RevNet but also adaptively weights the influence of each sample and controls the sensitivity of the function to the learned active variables. The synthesized regression uses Euclidean distance in the input space to select neighboring samples whose projections on the space of active variables are used to perform local least-squares polynomial fitting. This helps to resolve numerical oscillation issues present in traditional local and global regressions. Extensive experimental results demonstrate that our DRiLLS method outperforms both the NLL and active subspace methods, especially when the target function possesses critical points in the interior of its input domain.
Keyword:
function approximation
dimension reduction
pseudoreversible neural network
level set learning
synthesized regression
sparse data

期刊

SIAM Journal on Scientific Computing 封面图
SIAM Journal on Scientific Computing
IF:
2.6
论文数:
5.1K
被引数:
1.8W

机构

State University System of Florida 封面图
State University System of Florida
学者数:
12.8W
论文数: 10.9W
被引数: 130
U
university of south carolina columbia
学者数:
9.6K
论文数: 8.5K
被引数: 7
U
University of South Carolina System
学者数:
1.6W
论文数: 1.5W
被引数: 27
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
13C NMR investigation of carbon nanotubes and derivatives碳纳米管及其衍生物的13C NMR研究
err2001-08-01
err0
PREAI
errC. Goze Bac; P. Bernier; S. Latil; V. Jourdain; A. Rubio; S.H. Jhang; S.W. Lee; Y.W. Park; M. Holzinger; A. Hirsch
err分享
err收藏
学者 查看更多内容