stability enhancement

3 papers

• Efficient Last-Iterate Convergence in Solving Extensive-Form Games
• Enhancing Optimizer Stability: Momentum Adaptation of The NGN Step-size
• SUMO: Subspace-Aware Moment-Orthogonalization for Accelerating Memory-Efficient LLM Training