1 code implementation • AAAI 2022 • Linhang Cai, Zhulin An, Chuanguang Yang, Yangchun Yan, Yongjun Xu
In detail, the proposed PGMPF selectively suppresses the gradient of those ”unimportant” parameters via a prior gradient mask generated by the pruning criterion during fine-tuning.
no code implementations • 6 Nov 2020 • Yangchun Yan, Rongzuo Guo, Chao Li, Kang Yang, Yongjun Xu
However, these methods ignore a small part of weights in the next layer which disappears as the feature map is removed.