large batch sizes

3 papers

• AmorLIP: Efficient Language-Image Pretraining via Amortization
• Improving Energy Natural Gradient Descent through Woodbury, Momentum, and Randomization
• Through the River: Understanding the Benefit of Schedule-Free Methods for Language Model Training