arrow
返回

Augmented access pattern-based I/O performance prediction using directed acyclic graph regression

delete2024-10-14
delete0
PRE
AI
M
Manish Kumar
S
Sunggon Kim *
DOI:10.1007/s10586-024-04719-6delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the rise of big data processing is creating a new challenge i.e., keeping pace with the flow of information and efficient I/O performance is the key here. However, analyzing I/O performance is a complex task due to the many layers involved, from applications and libraries to the operating system, storage devices, and everything in between. In this paper, we propose a convolutional neural networks (CNN)-based directed acyclic graph regression (DAGR) network to predict the I/O performance of applications. The system first gathers I/O request information directly from the storage layer (block storage). This information is then converted into a visual representation (graph image) and augmented using various techniques to create additional training data. The core of the system is a CNN-based prediction model designed to identify potential I/O performance patterns by analyzing the generated graph images. Evaluations using real-world application benchmarks demonstrate that the proposed method can accurately predict the performance of various applications, including file servers, databases, mail servers, and video servers, with an accuracy of up to 99.73%.
Keyword:
Deep learning
Directed acyclic graph
High performance computing
Image augmentation
Machine learning

期刊

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
论文数:
5.1K
被引数:
7.5K

机构

暂无机构信息
引用论文

引用论文

Brief introduction of medical database and data mining technology in big data era大数据时代医学数据库与数据挖掘技术简介
err2020-02-22
err364
errOAAI
errYang, Jin; Li, Yuanjie; Liu, Qingqing; Li, Li; Feng, Aozi; Wang, Tianyi; Zheng, Shuai; Xu, Anding; Lyu, Jun
err分享
err收藏
6R-[3H]Tetrahydrobiopterin Binding Activities in Rat Brain
err1993-01-01
err0
PREAI
errYumiko Watanabe; Hiroshi Morii; Yasuo Nemoto; Bernd Mayer; Ernst R. Werner; Soichi Miwa; Yasuyoshi Watanabe
err分享
err收藏
err分享
err收藏
学者 查看更多内容