hybrid language models

3 papers

• Efficient Hybrid Language Model Compression through Group-Aware SSM Pruning
• Routing Mamba: Scaling State Space Models with Mixture-of-Experts Projection
• Zebra-Llama: Towards Extremely Efficient Hybrid Models