Linear Regression

concepts · 5 notes linked

Related: Gradient Descent · Stata · Linear Algebra · Matrix Transformations · Cosine Similarity · Correlation · Inner Product · Regularization

Notes

• Cosine similarity, Pearson correlation, and OLS coefficients — Unified inner-product view of cosine similarity, correlation, and OLS
• Geometrical Interpretation of Linear Regression in Machine Learning versus Classical Statistics — Geometric view of OLS, MLE, and regularization in linear regression
• Gradient descent for linear regression using PyTorch — PyTorch tutorial implementing minibatch SGD for least-squares linear regression
• Gradient descent for linear regression¶ — GD, SGD, and minibatch SGD implementations for least-squares linear regression
• Understanding matrices intuitively, part 1 - The Stata Blog — Visual grid-transformation method for intuiting matrix operations