low-rank matrices

3 papers

• AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections
• Beyond Higher Rank: Token-wise Input-Output Projections for Efficient Low-Rank Adaptation
• TransMLA: Migrating GQA Models to MLA with Full DeepSeek Compatibility and Speedup