Power Laws

concepts · 1 notes linked

Related: Weightwatcher · Deep Learning Theory · Neural Network Analysis

Notes

• Deep Learning and Effective Correlation Spaces — Power-law ESD tails in DNN layers indicate optimal generalization via SETOL