.png){kind=icon}
Return
A kinetic-based regularization method for data science applications
.png){kind=icon}
PRE
AI
DOI：doi:10.1088/2632-2153/adf93a.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We propose a physics-based regularization technique for function learning, inspired by statistical mechanics. By drawing an analogy between optimizing the parameters of an interpolator and minimizing the energy of a system, we introduce corrections that impose constraints on the lower-order moments of the data distribution. This minimizes the discrepancy between the discrete and continuum representations of the data, in turn allowing to access more favorable energy landscapes, thus improving the accuracy of the interpolator. Our approach improves performance in both interpolation and regression tasks, even in high-dimensional spaces. Unlike traditional methods, it does not require empirical parameter tuning, making it particularly effective for handling noisy data. We also show that thanks to its local nature, the method offers computational and memory efficiency advantages over Radial Basis Function interpolators, especially for large datasets.
Keywords:
physics-based regularization
statistical mechanics
function learning
moment constraints
interpolator accuracy
Journal
M
IF:
4.6
Papers:
1.1K
Citations:
3.4K
Organization
Cited Papers
ShareSaveNoise injection for training artificial neural networks: A comparison with weight decay and early stopping.png)
MEDICAL PHYSICS
OAAI
MEDICAL PHYSICSIF3.2
OAAIShareSave
View more