Neural Network Analysis

concepts · 2 notes linked

Related: Weightwatcher · Spectral Norms · Simpsons Paradox · Deep Learning Theory · Power Laws

Notes

• Deep Learning and Effective Correlation Spaces — Power-law ESD tails in DNN layers indicate optimal generalization via SETOL
• Simpson's Paradox and Deep Learning Metrics with Weightwatcher — WeightWatcher power-law metrics resolving Simpson's paradox in DNN evaluation