Efficient MPI-based Communication for GPU-Accelerated Dask Applications

1 code implementation • 21 Jan 2021 • Aamir Shafi, Jahanzeb Maqbool Hashmi, Hari Subramoni, Dhabaleswar K., Panda

This paper presents the design and implementation of a new communication backend for Dask -- called MPI4Dask -- that is targeted for modern HPC clusters built with GPUs.

Blocking Distributed Computing