arrow
Return

Robustness and generalization

delete2011-11-15
delete246
delete
OA
AI
H
Huan Xu *
S
Shie Mannor
DOI:10.1007/s10994-011-5268-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We derive generalization bounds for learning algorithms based on their robustness: the property that if a testing sample is similar to a training sample, then the testing error is close to the training error. This provides a novel approach, different from complexity or stability arguments, to study generalization of learning algorithms. One advantage of the robustness approach, compared to previous methods, is the geometric intuition it conveys. Consequently, robustness-based analysis is easy to extend to learning in non-standard setups such as Markovian samples or quantile loss. We further show that a weak notion of robustness is both sufficient and necessary for generalizability, which implies that robustness is a fundamental property that is required for learning algorithms to work.
Keywords:
Generalization
Robust
Non-IID sample
Quantile loss

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

T
Technion Israel Institute of Technology
Scholars:
1.6W
Papers: 1.5W
Citations: 2.0W
N
National University of Singapore
Scholars:
7.6W
Papers: 6.5W
Citations: 11.4W
Cited Papers

Cited Papers

Personality of patients with pseudoseizures
err1986-05-01
err0
PREAI
errC. W. Vanderzant; B. Giordani; S. Berent; F. E. Dreifuss; J. C. Sackellares
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Financial Distress and its Predicting Factors among Iranian Cancer Patients
err2015-03-09
err0
errOAAI
errAbazar Fathollahzade; Azad Rahmani; Abbas Dadashzadeh; Akram Gahramanian; Ali Esfahani; Leila Javanganji; Leila Nabiolahi
errShare
errSave
Compression of single-crystal magnesium oxide to 118 GPa and a ruby pressure gauge for helium pressure media
err2008-11-01
err0
PREAI
errS. D. Jacobsen; C. M. Holl; K. A. Adams; R. A. Fischer; E. S. Martin; C. R. Bina; J.-F. Lin; V. B. Prakapenka; A. Kubo; P. Dera
errShare
errSave
Thin polycrystalline zinc oxide films obtained by oxidation of metallic zinc films
err2005-02-01
err0
PREAI
errYa.I. Alivov; A.V. Chernykh; M.V. Chukichev; R.Y. Korotkov
errShare
errSave
researcher View more