arrow
Return

A survey on the Distributed Computing stack

delete2021-11-01
delete7
delete
OA
AI
C
Cristian Ramon-Cortes *
P
Pol Álvarez
F
Francesc Lordan
J
J. Álvarez Cid-Fuentes
J
Jorge Ejarque
R
Rosa M. Badía
DOI:10.1016/j.cosrev.2021.100422delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we review the background and the state of the art of the Distributed Computing software stack. We aim to provide the readers with a comprehensive overview of this area by supplying a detailed big-picture of the latest technologies. First, we introduce the general background of Distributed Computing and propose a layered top-bottom classification of the latest available software. Next, we focus on each abstraction layer, i.e. Application Development (including Task-based Workflows, Dataflows, and Graph Processing), Platform (including Data Sharing and Resource Management), Communication (including Remote Invocation, Message Passing, and Message Queuing), and Infrastructure (including Batch and Interactive systems). For each layer, we give a general background, discuss its technical challenges, review the latest programming languages, programming models, frameworks, libraries, and tools, and provide a summary table comparing the features of each alternative. Finally, we conclude this survey with a discussion of open problems and future directions. (C) 2021 Elsevier Inc. All rights reserved.
Keywords:
Distributed systems
Distributed programming models
Distributed Computing
Cloud computing
Task-based Workflows
Dataflows
Graph Processing
Streaming
Data Sharing
Resource Management
Infrastructure managers

Journal

Computer Science Review cover
Computer Science Review
IF:
12.7
Papers:
2.3K
Citations:
5.2K

Organization

U
universitat politecnica de catalunya
Scholars:
1.9W
Papers: 1.6W
Citations: 17
Cited Papers

Cited Papers

PyCOMPSs: Parallel computational workflows in Python
err2016-07-27
err90
errOAAI
errTejedor, Enric; Becerra, Yolanda; Alomar, Guillem; Queralt, Anna; Badia, Rosa M.; Torres, Jordi; Cortes, Toni; Labarta, Jesus
errShare
errSave
Sexual compulsivity, anxiety, depression, and sexual risk behavior among treatment-seeking men in São Paulo, Brazil
err2018-06-11
err0
errOAAI
errMarco D.T. Scanavino; Ana Ventuneac; Carmita H.N. Abdo; Hermano Tavares; Maria L.S. Amaral; Bruna Messina; Sirlene C. Reis; João P.L.B. Martins; Jeffrey T. Parsons
errShare
errSave
Developing and Evaluating Intermodal E-Sharing Services–A Multi-method Approach
err2014-01-01
err0
errOAAI
errJörn-Ole Schröder; Christine Weiß; Martin Kagerbauer; Nicolas Reiß; Christian Reuter; Rimbert Schürmann; Steven Pfisterer
errShare
errSave
The International Exascale Software Project roadmap
err2011-01-06
err395
errOAAI
errDongarra, Jack; Beckman, Pete; Moore, Terry; Aerts, Patrick; Aloisio, Giovanni; Andre, Jean-Claude; Barkai, David; Berthou, Jean-Yves; Boku, Taisuke; Braunschweig, Bertrand; Cappello, Franck; Chapman, Barbara; Chi, Xuebin; Choudhary, Alok; Dosanjh, Sudip; Dunning, Thom; Fiore, Sandro; Geist, Al; Gropp, Bill; Harrison, Robert; Hereld, Mark; Heroux, Michael; Hoisie, Adolfy; Hotta, Koh; Jin, Zhong; Ishikawa, Yutaka; Johnson, Fred; Kale, Sanjay; Kenway, Richard; Keyes, David; Kramer, Bill; Labarta, Jesus; Lichnewsky, Alain; Lippert, Thomas; Lucas, Bob; Maccabe, Barney; Matsuoka, Satoshi; Messina, Paul; Michielse, Peter; Mohr, Bernd; Mueller, Matthias S.; Nagel, Wolfgang E.; Nakashima, Hiroshi; Papka, Michael E.; Reed, Dan; Sato, Mitsuhisa; Seidel, Ed; Shalf, John; Skinner, David; Snir, Marc; Sterling, Thomas; Stevens, Rick; Streitz, Fred; Sugar, Bob; Sumimoto, Shinji; Tang, William; Taylor, John; Thakur, Rajeev; Trefethen, Anne; Valero, Mateo; van der Steen, Aad; Vetter, Jeffrey; Williams, Peg; Wisniewski, Robert; Yelick, Kathy
errShare
errSave
Effects of Naloxone on Estrogen-Induced Changes in Hypothalamic Gonadotropin-Releasing Hormone Pulse Generator Activity in the Rhesus Monkey
err2008-04-08
err0
PREAI
errPeter M. Grosser; Kevin T. O’Byrne; Cynthia L. Williams; Jean-Christophe Thalabard; Julane Hotchkiss; Ernst Knobil
errShare
errSave
researcher View more