1
Return

Operator Learning Using Random Features: A Tool for Scientific Computing

delete2024-08-08
delete2
PRE
AI
N
Nicholas H. Nelsen *
A
Andrew M. Stuart
DOI:10.1137/24M1648703delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Supervised operator learning centers on the use of training data, in the form of inputoutput pairs, to estimate maps between infinite-dimensional spaces. It is emerging as a powerful tool to complement traditional scientific computing, which may often be framed in terms of operators mapping between spaces of functions. Building on the classical random features methodology for scalar regression, this paper introduces the function-valued random features method. This leads to a supervised operator learning architecture that is practical for nonlinear problems yet is structured enough to facilitate efficient training through the optimization of a convex, quadratic cost. Due to the quadratic structure, the trained model is equipped with convergence guarantees and error and complexity bounds, properties that are not readily available for most other operator learning architectures. At its core, the proposed approach builds a linear combination of random operators. This turns out to be a low-rank approximation of an operator-valued kernel ridge regression algorithm, and hence the method also has strong connections to Gaussian process regression. The paper designs function-valued random features that are tailored to the structure of two nonlinear operator learning benchmark problems arising from parametric partial differential equations. Numerical results demonstrate the scalability, discretization invariance, and transferability of the function-valued random features method.
Keywords:
scientific machine learning
operator learning
random feature
surrogate model
kernel ridge regression
parametric partial differential equation

Journal

SIAM Review cover
SIAM Review
IF:
6.1
Papers:
888
Citations:
1.2W

Organization

C
California Institute of Technology
Scholars:
2.9W
Papers: 2.5W
Citations: 4.9W
Cited Papers

Cited Papers

Citing Papers

Citing Papers