arrow
Return

Deconstructing the generalization gap

delete2023-12-18
delete0
PRE
AI
A
Andrey Gromov *
DOI:10.1038/s42256-023-00766-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
New research reveals a duality between neural network weights and neuron activities that enables a geometric decomposition of the generalization gap. The framework provides a way to interpret the effects of regularization schemes such as stochastic gradient descent and dropout on generalization - and to improve upon these methods.

Journal

Nature Machine Intelligence cover
Nature Machine Intelligence
IF:
23.9
Papers:
1.3K
Citations:
1.5W

Organization

University System of Maryland cover
University System of Maryland
Scholars:
6.5W
Papers: 5.6W
Citations: 113
Cited Papers

Cited Papers

Solar modulation of North Atlantic central Water formation at multidecadal timescales during the late Holocene
err2011-08-01
err0
PREAI
errAudrey Morley; Michael Schulz; Yair Rosenthal; Stefan Mulitza; André Paul; Carsten Rühlemann
errShare
errSave