language model training

3 papers

• Critical Batch Size Revisited: A Simple Empirical Approach to Large-Batch Language Model Training
• Let Me Think! A Long Chain of Thought Can Be Worth Exponentially Many Short Ones
• Through the River: Understanding the Benefit of Schedule-Free Methods for Language Model Training