no code implementations • 17 Jan 2024 • Daniele De Sensi, Tommaso Bonato, David Saam, Torsten Hoefler
The allreduce collective operation accounts for a significant fraction of the runtime of workloads running on distributed systems.
