Weightwatcher

entities · 2 notes linked

Related: Neural Network Analysis · Spectral Norms · Simpsons Paradox · Deep Learning Theory · Power Laws

Notes

• Deep Learning and Effective Correlation Spaces — Power-law ESD tails in DNN layers indicate optimal generalization via SETOL
• Simpson's Paradox and Deep Learning Metrics with Weightwatcher — WeightWatcher power-law metrics resolving Simpson's paradox in DNN evaluation