Neural Network Optimization

concepts · 2 notes linked

Related: Tinygrad · Tiny Corp · George Hotz · Deep Learning Frameworks · AI Hardware · Arxiv · Loss Landscape · Skip Connections

Notes

• Visualizing the Loss Landscape of Neural Nets — Filter normalization method reveals how architecture shapes neural loss geometry
• tinygrad — Minimal neural network framework and companion ML hardware boxes