arrow
Return

Learning with risks based on M-location

delete2022-08-25
delete2
delete
OA
AI
M
Matthew J. Holland *
DOI:10.1007/s10994-022-06217-5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this work, we study a new class of risks defined in terms of the location and deviation of the loss distribution, generalizing far beyond classical mean-variance risk functions. The class is easily implemented as a wrapper around any smooth loss, it admits finite-sample stationarity guarantees for stochastic gradient methods, it is straightforward to interpret and adjust, with close links to M-estimators of the loss location, and has a salient effect on the test loss distribution, giving us control over symmetry and deviations that are not possible under naive ERM.
Keywords:
Risk-sensitive learning
Non-convex non-smooth risk minimization
Stochastic optimization

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

O
osaka university
Scholars:
2.6W
Papers: 1.9W
Citations: 30