Search Results for author: Dayal Singh

Found 1 papers, 0 papers with code

Initializing ReLU networks in an expressive subspace of weights

no code implementations23 Mar 2021 Dayal Singh, G J Sreejith

Using a mean-field theory of signal propagation, we analyze the evolution of correlations between two signals propagating forward through a deep ReLU network with correlated weights.

Unity

Cannot find the paper you are looking for? You can Submit a new open access paper.