Search Results for author:
Found 3 papers, 1 papers with code
Neural Tangent Kernel Beyond the Infinite-Width Limit: Effects of Depth and Initialization
We derive exact expressions for the NTK dispersion in the infinite-depth-and-width limit in all three phases and conclude that the NTK variability grows exponentially with depth at the EOC and in the chaotic phase but not in the ordered phase.
Analyzing Finite Neural Networks: Can We Trust Neural Tangent Kernel Theory?
We find out that whether a network is in the NTK regime depends on the hyperparameters of random initialization and the network's depth.
Towards Large-Scale Exploratory Search over Heterogeneous Sources
Since time immemorial, people have been looking for ways to organize scientific knowledge into some systems to facilitate search and discovery of new ideas.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
