arrow
返回

A kinetic-based regularization method for data science applications

delete2025-08-19
delete0
PRE
AI
A
Abhisek Ganguly
A
Alessandro Gabbana *
V
Vybhav Rao
S
Sauro Succi
S
Santosh Ansumali
DOI:doi:10.1088/2632-2153/adf93adelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
我们提出了一种基于物理学的正则化技术用于函数学习,该技术受统计力学启发。通过将优化插值器参数与最小化系统能量进行类比,我们引入了修正项,这些修正项对数据分布的低阶矩施加约束。这最小化了数据离散表示和连续表示之间的差异,进而能够访问更有利的能量景观,从而提高插值器的准确性。我们的方法在插值和回归任务中均能提升性能,即使在多维空间中也如此。与传统的正则化方法不同,它不需要经验参数调优,因此在处理噪声数据时尤为有效。我们还表明,由于该方法的局部特性,它在计算和内存效率方面优于径向基函数插值器,尤其对于大规模数据集而言。
Keyword:
physics-based regularization
statistical mechanics
function learning
moment constraints
interpolator accuracy

期刊

M
Machine Learning-Science and Technology
IF:
4.6
论文数:
1.1K
被引数:
3.4K

机构

I
Istituto Italiano di Tecnologia and La Sapienza
学者数:
1
论文数: 1
被引数: 0
引用论文

引用论文

Minimal entropic kinetic models for hydrodynamics
err2007-01-02
err0
errOAAI
errS Ansumali; I. V Karlin; H. C Öttinger
err分享
err收藏
Maximum Entropy Principle for Lattice Kinetic Equations
err1998-07-06
err0
PREAI
errIliya V. Karlin; Alexander N. Gorban; S. Succi; V. Boffi
err分享
err收藏
Noise injection for training artificial neural networks: A comparison with weight decay and early stopping
err2009-09-25
err155
errOAAI
errZur, Richard M.; Jiang, Yulei; Pesce, Lorenzo L.; Drukker, Karen
err分享
err收藏
Highly accurate protein structure prediction with AlphaFold基于AlphaFold的高精度蛋白质结构预测
err2021-07-15
err0
errOAAI
errJohn Jumper; Richard Evans; Alexander Pritzel; Tim Green; Michael Figurnov; Olaf Ronneberger; Kathryn Tunyasuvunakool; Russ Bates; Augustin Žídek; Anna Potapenko; Alex Bridgland; Clemens Meyer; Simon A. A. Kohl; Andrew J. Ballard; Andrew Cowie; Bernardino Romera-Paredes; Stanislav Nikolov; Rishub Jain; Jonas Adler; Trevor Back; Stig Petersen; David Reiman; Ellen Clancy; Michal Zielinski; Martin Steinegger; Michalina Pacholska; Tamas Berghammer; Sebastian Bodenstein; David Silver; Oriol Vinyals; Andrew W. Senior; Koray Kavukcuoglu; Pushmeet Kohli; Demis Hassabis
err分享
err收藏
学者 查看更多内容