Hypothesis spaces for deep learning

doi:10.1016/j.neunet.2025.107995

Hypothesis spaces for deep learning

2025-08-21

0

OA

AI

DOI：10.1016/j.neunet.2025.107995

Original

Original request for help

Save

Abstract

En 中文

This paper introduces a hypothesis space for deep learning based on deep neural networks (DNNs). By treating a DNN as a function of two variables—the input variable and the parameter variable—we consider the set of DNNs where the parameter variable belongs to a space of weight matrices and biases determined by a prescribed depth and layer widths. To construct a Banach space of functions of the input variable, we take the weak* closure of the linear span of this DNN set. We prove that the resulting Banach space is a reproducing kernel Banach space (RKBS) and explicitly construct its reproducing kernel. Furthermore, we investigate two learning models—regularized learning and the minimum norm interpolation (MNI) problem—within the RKBS framework by establishing representer theorems. These theorems reveal that the solutions to these learning problems can be expressed as a finite sum of kernel expansions based on training data.

Keywords:

Reproducing kernel Banach space

Deep learning

Deep neural network

Representer theorem for deep learning

Hypothesis spaces for deep learning

Abstract

Journal

Organization