no code implementations • 17 May 2022 • Paul Wimmer, Jens Mehnert, Alexandru Paul Condurache
By freezing weights, the number of trainable parameters is shrunken which reduces gradient computations and the dimensionality of the model's optimization space.
no code implementations • CVPR 2022 • Paul Wimmer, Jens Mehnert, Alexandru Paul Condurache
Finally, we show that advances of IP are due to improved trainability and superior generalization ability.
no code implementations • 27 Jul 2021 • Paul Wimmer, Jens Mehnert, Alexandru Condurache
The combinatorial optimization problem given by COPS is relaxed on a linear program (LP).
no code implementations • 28 Nov 2020 • Paul Wimmer, Jens Mehnert, Alexandru Condurache
On the classification tasks MNIST and CIFAR-10/100 we outperform SNIP, in this setting the best reported one-shot pruning method, applied before training.