arrow
Return

Holistic deep learning

delete2023-12-07
delete2
delete
OA
AI
D
Dimitris Bertsimas *
K
Kimberly Villalobos Carballo
L
Léonard Boussioux
M
Michael Lingzhi Li
A
Alex Paskov
I
Ivan Paskov
DOI:10.1007/s10994-023-06482-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper presents a novel holistic deep learning framework that simultaneously addresses the challenges of vulnerability to input perturbations, overparametrization, and performance instability from different train-validation splits. The proposed framework holistically improves accuracy, robustness, sparsity, and stability over standard deep learning models, as demonstrated by extensive experiments on both tabular and image data sets. The results are further validated by ablation experiments and SHAP value analysis, which reveal the interactions and trade-offs between the different evaluation metrics. To support practitioners applying our framework, we provide a prescriptive approach that offers recommendations for selecting an appropriate training loss function based on their specific objectives. All the code to reproduce the results can be found at https://github.com/kimvc7/HDL.
Keywords:
Deep learning
Optimization
Robustness
Sparsity
Stability
Regularization

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

H
Harvard University
Scholars:
26.5W
Papers: 22.0W
Citations: 28.7W
Cited Papers

Cited Papers

The L‐arginine inhibition of rat middle cerebral artery contractile responses is mediated by inducible nitric oxide synthase
err2008-10-09
err0
PREAI
errM. J. Alonso; M. A. Rodríguez‐Martínez; J. Martínez‐Orgado; J. Marín; M. Salaices
errShare
errSave
The Early Cambrian Mianyang-Changning Intracratonic Sag and Its Control on Petroleum Accumulation in the Sichuan Basin, China
err2017-01-01
err0
errOAAI
errShugen Liu; Bin Deng; Luba Jansa; Yong Zhong; Wei Sun; Jinmin Song; Guozhi Wang; Juan Wu; Zhiwu Li; Yanhong Tian
errShare
errSave
Sparse Regression: Scalable Algorithms and Empirical Performance
err2020-11-01
err49
errOAAI
errBertsimas, Dimitris; Pauphilet, Jean; Van Parys, Bart
errShare
errSave
How Complex Is Your Classification Problem?: A Survey on Measuring Classification Complexity
err2019-09-13
err140
PREAI
errLorena, Ana C.; Garcia, Luis P. F.; Lehmann, Jens; Souto, Marcilio C. P.; Ho, Tin Kam
errShare
errSave
Preparation of zinc oxide free, transparent rubber nanocomposites using a layered double hydroxide filler
err2011-01-01
err0
PREAI
errAmit Das; De-Yi Wang; Andreas Leuteritz; Kalaivani Subramaniam; H. Chris Greenwell; Udo Wagenknecht; Gert Heinrich
errShare
errSave
Real-Time Analysis of a Modified State Observer for Sensorless Induction Motor Drive Used in Electric Vehicle Applications
err2017-07-25
err0
errOAAI
errMohan Krishna S.; Febin Daya J.L.; Sanjeevikumar Padmanaban; Lucian Mihet-Popa
errShare
errSave
errShare
errSave
researcher View more