Will Merrill

3 papers Ai2 / TTIC

• A Little Depth Goes a Long Way: The Expressive Power of Log-Depth Transformers
• Critical Batch Size Revisited: A Simple Empirical Approach to Large-Batch Language Model Training
• Exact Expressive Power of Transformers with Padding