gradient approximation

3 papers

• AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections
• Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training
• Private Zeroth-Order Optimization with Public Data