Stochastic Gradient Descent

concepts · 4 notes linked

Related: Yann LeCun · Backpropagation · Michael Nielsen · Neural Networks · Gradient Descent · Facebook · Geoffrey Hinton · Baidu

Notes

• Facebook's Quest to Build an Artificial Brain Depends on This Guy — Yann LeCun pioneers convolutional neural networks and leads Facebook AI lab
• Gradient descent for linear regression¶ — GD, SGD, and minibatch SGD implementations for least-squares linear regression
• Neural Networks and Deep Learning — Introductory neural network tutorial using MNIST handwritten digit recognition
• neural-networks-and-deep-learning/src/network.py at master · mnielsen/neural-networks-and-deep-learning — Michael Nielsen's minimal readable feedforward neural network with SGD and backpropagation in Python