no code implementations • 20 Dec 2023 • Jonathan Brokman, Roy Betser, Rotem Turjeman, Tom Berkov, Ido Cohen, Guy Gilboa
Our modeling can improve training efficiency and lower communication overhead, as shown by our preliminary experiments in the context of federated learning.
no code implementations • 18 Dec 2022 • Rotem Turjeman, Tom Berkov, Ido Cohen, Guy Gilboa
We propose in this work a model based on the correlation of the parameters' dynamics, which dramatically reduces the dimensionality.