arrow
Return

Deconstructing the generalization gap

delete2023-12-18
delete0
PRE
AI
A
Andrey Gromov *
DOI:10.1038/s42256-023-00766-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
New research reveals a duality between neural network weights and neuron activities that enables a geometric decomposition of the generalization gap. The framework provides a way to interpret the effects of regularization schemes such as stochastic gradient descent and dropout on generalization - and to improve upon these methods.

Journal

Nature Machine Intelligence cover
Nature Machine Intelligence
IF:
23.9
Papers:
1.3K
Citations:
1.5W

Organization

University System of Maryland cover
University System of Maryland
Scholars:
6.4W
Papers: 5.6W
Citations: 113