information exponent

3 papers

• Emergence and scaling laws in SGD learning of shallow neural networks
• From Information to Generative Exponent: Learning Rate Induces Phase Transitions in SGD
• Learning Orthogonal Multi-Index Models: A Fine-Grained Information Exponent Analysis