Regularization

concepts · 7 notes linked

Related: Machine Learning · Ordinary Least Squares · Andrey Tikhonov · Ridge Regression · Bias Variance Tradeoff · Linear Algebra · Google · Deepmind

Notes

• A New Study by Google and DeepMind Introduces Geometric Complexity (GC) for Neural Network Analysis and Understanding of Deep Learning Models — Geometric Complexity measure explains regularization and double-descent in neural networks
• Geometrical Interpretation of Linear Regression in Machine Learning versus Classical Statistics — Geometric view of OLS, MLE, and regularization in linear regression
• Machine Learning Done Wrong — Seven common practitioner mistakes in applied machine learning modeling
• Machine Learning Video Library — Caltech indexed video segments covering core ML topics
• Monday, December 11, 2006 — Simon Funk's Netflix Prize SVD collaborative filtering algorithm explained
• Ridge regression - Wikipedia — L2 regularization adding penalty to stabilize ill-conditioned regression
• Vector Norms: A Quick Guide | Built In — L1, L2, Lp, and Linfinity vector norms explained for ML