optimization landscape
- A geometric framework for momentum-based optimizers for low-rank training
- Accelerating Block Coordinate Descent for LLM Finetuning via Landscape Expansion
- Integration Matters for Learning PDEs with Backwards SDEs
- Neural Collapse under Gradient Flow on Shallow ReLU Networks for Orthogonally Separable Data