An Adaptive Parallel Pipeline Pattern for Grids

Abstract

This paper introduces an adaptive parallel pipeline pattern which follows the GRASP (grid-adaptive structured parallelism) methodology. GRASP is a generic methodology to incorporate structural information at compile time into a parallel program that enables it to adapt automatically to dynamic variations in resource performance. GRASP instruments the pipeline with a series of pragmatic rules, which depend on particular performance thresholds based on the computation/communication patterns of the program and the availability of resources in the grid. Our parallel pipeline pattern is implemented as a parameterisable C/MPI API using a variable-size input data vector and a stage function array. We have evaluated its efficiency using a numerical benchmark stage function in a non-dedicated computational grid environment.

Original document

The different versions of the original document can be found in:

• https://www.pure.ed.ac.uk/ws/files/13622006/evaluate.pdf

• http://xplorestaging.ieee.org/ielx5/4519061/4536075/04536264.pdf?arnumber=4536264,

http://dx.doi.org/10.1109/ipdps.2008.4536264

• https://dblp.uni-trier.de/db/conf/ipps/ipdps2008.html#Gonzalez-VelezC08,

http://yadda.icm.edu.pl/yadda/element/bwmeta1.element.ieee-000004536264,

http://trap.ncirl.ie/949,

https://ieeexplore.ieee.org/document/4536264,

http://ieeexplore.ieee.org/document/4536264,

https://www.research.ed.ac.uk/portal/files/13622006/evaluate.pdf,

https://www.research.ed.ac.uk/portal/en/publications/an-adaptive-parallel-pipeline-pattern-for-grids(b4d091ac-f9ba-4fce-a2d2-071c48c105f3).html,

http://norma.ncirl.ie/949,

https://academic.microsoft.com/#/detail/2154267220

• https://www.research.ed.ac.uk/portal/en/publications/an-adaptive-parallel-pipeline-pattern-for-grids(b4d091ac-f9ba-4fce-a2d2-071c48c105f3).html,

https://doi.org/10.1109/IPDPS.2008.4536264,

http://hdl.handle.net/20.500.11820/b4d091ac-f9ba-4fce-a2d2-071c48c105f3,

https://www.pure.ed.ac.uk/ws/files/13622006/evaluate.pdf,

http://www.scopus.com/inward/record.url?scp=51049109021&partnerID=8YFLogxK,

http://homepages.inf.ed.ac.uk/s0340602/tmp/ipdps08R-comments.pdf