A load balancing tool for distributed parallel loops

Ricolindo L. Cariño

doi:10.1007/s10586-005-4098-y

Return

A load balancing tool for distributed parallel loops

2005-10-01

PRE

Ricolindo L. Cariño

Ioana Banicescu

DOI：10.1007/s10586-005-4098-y

Original

Original request for help

Save

Abstract

En 中文

Large scale applications typically contain parallel loops with many iterates. The iterates of a parallel loop may have variable execution times which translate into performance degradation of an application due to load imbalance. This paper describes a tool for load balancing parallel loops on distributed-memory systems. The tool assumes that the data for a parallel loop to be executed is already partitioned among the participating processors. The tool utilizes the MPI library for interprocessor coordination, and determines processor workloads by loop scheduling techniques. The tool was designed independent of any application; hence, it must be supplied with a routine that encapsulates the computations for a chunk of loop iterates, as well as the routines to transfer data and results between processors. Performance evaluation on a Linux cluster indicates that the tool reduces the cost of executing a simulated irregular loop without load balancing by up to 81%. The tool is useful for parallelizing sequential applications with parallel loops, or as an alternate load balancing routine for existing parallel applications.

Keywords:

dynamic load balancing

adaptive loop scheduling

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.