Home // International Journal On Advances in Systems and Measurements, volume 9, numbers 3 and 4, 2016 // View article

Butterfly-like Algorithms for GASPI Split Phase Allreduce

Authors:
Vanessa End
Ramin Yahyapour
Christian Simmendinger
Thomas Alrutz

Keywords: GASPI; Allreduce; Partitioned Global Address Space (PGAS); Collective Communication; Algorithms

Abstract:
Collective communication routines pose a significant bottleneck of highly parallel programs. Research on different algorithms for disseminating information among all participating processes in a collective communication has brought forth many different algorithms, some of which have a butterfly-like communication scheme. While these algorithms have been abandoned from usage in collective communication routines with larger messages, due to the congestion that arises from their use, these algorithms have ideal properties for split-phase allreduce routines: all processes are involved in the computation of the result in each communication round and they have few communication rounds. This article will present several different algorithms with a butterfly-like communication scheme and examine their usability for a GASPI allreduce library routine. The library routines will be compared to state-of-the-art MPI implementations and also to a tree-based allreduce algorithm.

Pages: 132 to 141

Copyright: Copyright (c) to authors, 2016. Used with permission.

Publication date: December 31, 2016

Published in: journal

ISSN: 1942-261x