.png){kind=icon}
返回
MMDataLoader: Reusing Preprocessed Data Among Concurrent Model Training Tasks
.png){kind=icon}
PRE
AI
DOI：10.1109/TC.2023.3336161.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Data preprocessing plays an important role in deep learning, which directly affects the training efficiency. Data preprocessing is performed on the CPU. The preprocessed data are then fed to the models that are trained on the GPU. We observe that data preprocessing on the CPU can potentially create a bottleneck in the entire process of a model training task. In order to tackle this issue, we have developed MMDataLoader, which enables reusing preprocessed data among multiple model training tasks. MMDataLoader automatically constructs a data preprocessing pipeline based on each task's specific preprocessing workflow, allowing for maximum data reuse and reduced computing workload on the CPU. Unlike conventional data loaders that operate at the task level and provide data provision services to specific training tasks, MMDataLoader operates at the server level and provides data for all concurrently running tasks. We have conducted extensive experiments. The results show that MMDataLoader can significantly increase preprocessing throughput without affecting model convergence when compared to conventional methods where model training tasks are executed concurrently. For instance, with three tasks running, the preprocessing throughput can increase by 1.6x to 3.15x, depending on the tasks being executed and the proportion of preprocessing operations that are shared among them.
Keyword:
Deep learning
Training data
preprocessing
concurrent training
branch pipeline
期刊
IF:
3.8
论文数:
5.4K
被引数:
9.8K
机构
引用论文
Developing Wind and/or Solar Powered Crop Irrigation Systems for the Great Plains为大平原开发风能和/或太阳能作物灌溉系统
PREAI
分享收藏Ada-boundary: accelerating DNN training via adaptive boundary batch selection.png)
MACHINE LEARNING
OAAI
MACHINE LEARNINGIF2.9
OAAI分享收藏The Effect of 40-Hz Light Therapy on Amyloid Load in Patients with Prodromal and Clinical Alzheimer’s Disease40Hz光疗法对前驱和临床阿尔茨海默病患者淀粉样蛋白负荷的影响OAAI
OAAI分享收藏Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系？
PREAI
分享收藏Reveal training performance mystery between TensorFlow and PyTorch in the single GPU environment揭示TensorFlow和PyTorch在单GPU环境中的训练性能之谜
PREAI
分享收藏
查看更多内容