multi-head latent attention

4 papers

• Multi-head Temporal Latent Attention
• Tensor Product Attention Is All You Need
• TransMLA: Migrating GQA Models to MLA with Full DeepSeek Compatibility and Speedup
• Zebra-Llama: Towards Extremely Efficient Hybrid Models