memory-efficient optimization

3 papers

• Continuous Subspace Optimization for Continual Learning
• MISA: Memory-Efficient LLMs Optimization with Module-wise Importance Sampling
• Theoretical Investigation of Adafactor for Non-Convex Smooth Optimization