1 code implementation • 26 Oct 2020 • Simon Mattsson, Eric J. Michaud, Erik Hoel
Specifically, we introduce the effective information (EI) of a feedforward DNN, which is the mutual information between layer input and output following a maximum-entropy perturbation.