Fast AI

entities · 3 notes linked

Related: Deep Learning · Andrej Karpathy · Jeremy Howard · Pytorch · Matrix Calculus · Backpropagation · Gradient Descent · Tiktoken

Notes

• Let's Build the GPT Tokenizer — A Complete Guide to Tokenization in LLMs — Karpathy tokenizer video as book chapter
• Swift: Google's bet on differentiable programming — Google's Swift for TensorFlow project integrating native differentiable programming
• The Matrix Calculus You Need For Deep Learning — Matrix calculus tutorial covering gradients and Jacobians for neural network training