no code implementations • 14 Apr 2021 • Hongyi Pan, Diaa Dabawi, Ahmet Enis Cetin
In this paper, we propose a novel layer based on fast Walsh-Hadamard transform (WHT) and smooth-thresholding to replace $1\times 1$ convolution layers in deep neural networks.