routing mechanisms

3 papers

• Dense Backpropagation Improves Training for Sparse Mixture-of-Experts
• Gatekeeper: Improving Model Cascades Through Confidence Tuning
• PT-MoE: An Efficient Finetuning Framework for Integrating Mixture-of-Experts into Prompt Tuning