expert specialization

4 papers

• Advancing Expert Specialization for Better MoE
• Advancing Expert Specialization for Better MoE
• Learning to Specialize: Joint Gating-Expert Training for Adaptive MoEs in Decentralized Settings
• Who Speaks for the Trigger? Dynamic Expert Routing in Backdoored Mixture-of-Experts Transformers