.png){kind=icon}
返回
TBEM: Testing-Based GPU-Memory Consumption Estimation for Deep Learning
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3164510.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep Learning (DL) has been successfully implemented and deployed to various software service applications. During the training process of DL, a large amount of GPU computing resources is required, but it is difficult for developers to accurately calculate the GPU resources that the model may consume before running, which brings great inconvenience to the development of DL systems. Especially in today's cloud-based model training. Therefore, it is very important to estimate the GPU memory resources that the DL model may use in a certain computing framework. Existing work has focused on static analysis methods to assess GPU memory consumption, highly coupled with the framework, and lack of research on low-coupled GPU memory consumption of the framework. In this article, we propose TBEM, which is a test-based method for estimating the memory usage of the DL model. First, TBEM generates enough DL models using an orthogonal array testing strategy and a classical neural network design pattern. Then, TBEM generates DL model tested in a real environment to obtain the real-time GPU memory usage values corresponding to the model. After obtaining the data of different models and corresponding GPU usage values, the data is analyzed by regression.
Keyword:
Deep learning
Neural networks
Graphics processing units
Training
Computational modeling
Analytical models
Static analysis
Deep learning
program static analysis
automated testing
bug detection
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
.png){kind=icon}
Metal to Insulator Transition in Epitaxial Graphene Induced by Molecular Doping分子掺杂诱导外延石墨烯的金属-绝缘体转变OAAI
OAAI分享收藏Automatic Test Case and Test Oracle Generation Based on Functional Scenarios in Formal Specifications for Conformance Testing基于一致性测试正式规范中的功能场景自动生成测试用例和测试Oracle
PREAI
分享收藏Higher order visual areas enhance stimulus responsiveness in mouse primary visual cortex高阶视觉区域增强小鼠初级视觉皮层的刺激反应性OAAI
OAAI分享收藏
查看更多内容