Patterns for Overlapping Communication and Computation

Workshop on Parallel Programming Patterns (ParaPLoP) 2009

Pulication Type: Paper

Download: pdf ps

Abstract

Parallel applications commonly face the problem of sitting idle while waiting for remote data to become available. Even for problems where plenty of parallelism is available and good load balance is achievable, performance may be disappointing if local work cannot be overlapped with communication. We describe three patterns for achieving the overlap of communication with computation: overdecomposition, non-blocking communication, and speculation.

Research Areas

Text Ref

Aaron Becker, Ramprasad Venkataraman and Laxmikant V. Kale, Patterns for Overlapping Communication and Computation, Workshop on Parallel Programming Patterns (ParaPLOP 2009), 2009

BibTex

@inproceedings{OverlapPatterns09,
  author    = "Aaron Becker, Ramprasad Venkataraman and Laxmikant V. Kale",
  title	    = "{Patterns for Overlapping Communication and Computation}",
  booktitle = "Workshop on Parallel Programming Patterns (ParaPLOP 2009)",
  month     = {June},
  year      = "2009"
}