.png){kind=icon}
返回
Infrastructure-level Support for GPU-Enabled Deep Learning in DATAVIEW
.png){kind=icon}
OA
AI
DOI：10.1016/j.future.2022.12.014.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Scientific workflow has become a common practice for scientists to effectively formalize and structure complex scientific processes, which in turn has accelerated scientific discoveries in numerous research fields. With the recent thriving of deep learning in broad range of scientific projects, there is a rising need for deep learning support in scientific workflow infrastructures - SWFMSs. However, current GPU-enabled deep learning frameworks are developed separately, not suitable for direct exploitation in SWFMSs, which forces scientists to handle deep learning outside of SWFMSs and then integrate in workflows in an ad-hoc manner. What workflow users pressingly need today is a user-friendly and well-integrated SWFMS to facilitate GPU-enabled deep learning as native workflows so that they can conveniently design, train, reuse, and integrate deep learning models in comprehensive workflows. In this paper, We report our latest research progress in supporting GPU-enabled deep learning at infrastructure-level in a popular SWFMS - DATAVIEW, which facilitates: (1) fast design, train, reuse neural networks as native workflows per Deep-Learning-as -a-Workflow (DLaaW) or integrate pre -trained neural network models with ordinary Tasks in one comprehensive workflow via JAVA API or WebBench GUI; (2) flexibly leverage various types of GPU resources for executing deep learning workflows. Our approach and implementations are thoroughly evaluated through experiments that demonstrate the efficacy and efficiency as compared to conventional Pytorch-based implementations. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
SWFMS
Neural network
GPGPU
CUDA
GPU cluster
Deep-learning-as-a-workflow
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
F
IF:
6.1
论文数:
6.8K
被引数:
2.3W
机构
引用论文
The late‐stage “ferruginization” of the Ediacara Member (Rawnsley Quartzite, South Australia): Insights from uranium isotopes.png)
GeobiologyOAAI
GeobiologyIF0
OAAI分享收藏A characterization of workflow management systems for extreme-scale applications用于极端规模应用程序的工作流管理系统的特征OAAI
OAAI分享收藏myExperiment: a repository and social network for the sharing of bioinformatics workflowsNUCLEIC ACIDS RESEARCHOAAI
NUCLEIC ACIDS RESEARCHIF13.1
OAAI分享收藏
查看更多内容