.png){kind=icon}
返回
Improving the Accuracy of Progress Indication for Constructing Deep Learning Models
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3181493.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
For many machine learning tasks, deep learning greatly outperforms all other existing learning algorithms. However, constructing a deep learning model on a big data set often takes days or months. During this long process, it is preferable to provide a progress indicator that keeps predicting the model construction time left and the percentage of model construction work done. Recently, we developed the first method to do this that permits early stopping. That method revises its predicted model construction cost using information gathered at the validation points, where the model's error rate is computed on the validation set. Due to the sparsity of validation points, the resulting progress indicators often have a long delay in gathering information from enough validation points and obtaining relatively accurate progress estimates. In this paper, we propose a new progress indication method to overcome this shortcoming by judiciously inserting extra validation points between the original validation points. We implemented this new method in TensorFlow. Our experiments show that compared with using our prior method, using this new method reduces the progress indicator's prediction error of the model construction time left by 57.5% on average. Also, with a low overhead, this new method enables us to obtain relatively accurate progress estimates faster.
Keyword:
Computational modeling
Predictive models
Costs
Deep learning
Error analysis
Data models
Delays
Progress indicator
deep learning
TensorFlow
model construction
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
分享收藏Progress Indication for Deep Learning Model Training: A Feasibility Demonstration.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏A North American Registry for Epilepsy and Pregnancy, a Unique Public/Private Partnership of Health SurveillanceEpilepsiaOAAI
EpilepsiaIF0
OAAI分享收藏
查看更多内容