Return
Holistic deep learning
DOI:10.1007/s10994-023-06482-y.png)
Abstract
En 中文
This paper presents a novel holistic deep learning framework that simultaneously addresses the challenges of vulnerability to input perturbations, overparametrization, and performance instability from different train-validation splits. The proposed framework holistically improves accuracy, robustness, sparsity, and stability over standard deep learning models, as demonstrated by extensive experiments on both tabular and image data sets. The results are further validated by ablation experiments and SHAP value analysis, which reveal the interactions and trade-offs between the different evaluation metrics. To support practitioners applying our framework, we provide a prescriptive approach that offers recommendations for selecting an appropriate training loss function based on their specific objectives. All the code to reproduce the results can be found at https://github.com/kimvc7/HDL.
Keywords:
Deep learning
Optimization
Robustness
Sparsity
Stability
Regularization
Journal
IF:
2.9
Papers:
2.7K
Citations:
3.4W
Organization
Cited Papers
The Early Cambrian Mianyang-Changning Intracratonic Sag and Its Control on Petroleum Accumulation in the Sichuan Basin, China
Geofluids
IF0
Real-Time Analysis of a Modified State Observer for Sensorless Induction Motor Drive Used in Electric Vehicle Applications
Energies
IF0

