arrow
Return

Predicting Runtime in Spark-Like Systems With Allocation-Aware Deterministic Models

delete2026-09-21
delete0
delete
OA
AI
H
Hina Tariq *
O
Olivia Das
DOI:10.1002/spe.70097delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Apache Spark is widely used for distributed data processing, but accurately predicting application execution time remains challenging because performance depends on application structure, resource configuration, and executor-allocation behavior. This article presents two deterministic, graph-based simulation models for predicting the execution time of Spark applications under static and dynamic executor allocation.
Keywords:
apache spark
big data analytics
deterministic modeling
dynamic resource allocation
execution time prediction
performance modeling
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

S
SOFTWARE-PRACTICE & EXPERIENCE
IF:
2.7
Papers:
47
Citations:
0

Organization

T
toronto metropolitan university
Scholars:
1.1K
Papers: 649
Citations: 0
Cited Papers

Cited Papers

Social media big data analytics: A survey
err2019-12-01
err229
PREAI
errGhani, Norjihan Abdul; Hamid, Suraya; Hashem, Ibrahim Abaker Targio; Ahmed, Ejaz
errShare
errSave
Computational Health Informatics in the Big Data Age: A Survey
err2016-06-14
err135
PREAI
errFang, Ruogu; Pouyanfar, Samira; Yang, Yimin; Chen, Shu-Ching; Iyengar, S. S.
errShare
errSave
Predicting the performance of big data applications on the cloud
err2020-05-15
err0
PREAI
errD. Ardagna; E. Barbierato; E. Gianniti; M. Gribaudo; T. B. M. Pinto; A. P. C. da Silva; J. M. Almeida
errShare
errSave
Big Data and Its Technical Challenges
err2014-07-01
err647
PREAI
errJagadish, H. V.; Gehrke, Johannes; Labrinidis, Alexandros; Papakonstantinou, Yannis; Patel, Jignesh M.; Ramakrishnan, Raghu; Shahabi, Cyrus
errShare
errSave
Apache Spark: A Unified Engine for Big Data Processing
err2016-10-28
err1.7K
PREAI
errZaharia, Matei; Xin, Reynold S.; Wendell, Patrick; Das, Tathagata; Armbrust, Michael; Dave, Ankur; Meng, Xiangrui; Rosen, Josh; Venkataraman, Shivaram; Franklin, Michael J.; Ghodsi, Ali; Gonzalez, Joseph; Shenker, Scott; Stoica, Ion
errShare
errSave
researcher View more