A Fully Rigorous Proof of the Derivation of Xavier and He's Initialization for Deep ReLU Networks

21 Jan 2021  ·  Quynh Nguyen ·

A fully rigorous proof of the derivation of Xavier/He's initialization for ReLU nets is given.

PDF Abstract
No code implementations yet. Submit your code now

Tasks


Datasets


  Add Datasets introduced or used in this paper

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods