arrow
Return

PolieDRO: a novel classification and regression framework with non-parametric data-driven regularization

delete2024-04-15
delete0
PRE
AI
T
Tomás Gutierrez *
D
Davi Valladão
B
Bernardo K. Pagnoncelli
DOI:10.1007/s10994-024-06544-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
PolieDRO is a novel analytics framework for classification and regression that harnesses the power and flexibility of data-driven distributionally robust optimization (DRO) to circumvent the need for regularization hyperparameters. Recent literature shows that traditional machine learning methods such as SVM and (square-root) LASSO can be written as Wasserstein-based DRO problems. Inspired by those results we propose a hyperparameter-free ambiguity set that explores the polyhedral structure of data-driven convex hulls, generating computationally tractable regression and classification methods for any convex loss function. Numerical results based on 100 real-world databases and an extensive experiment with synthetically generated data show that our methods consistently outperform their traditional counterparts.
Keywords:
Data-driven distributionally robust optimization
Hyperparameter-free
Regression
Classification
Machine learning

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

P
pontificia universidade catolica do rio de janeiro
Scholars:
2.2K
Papers: 1.7K
Citations: 0