gating mechanism
- Continuous Domain Generalization
- On Linear Mode Connectivity of Mixture-of-Experts Architectures
- On Linear Mode Connectivity of Mixture-of-Experts Architectures
- On the Expressive Power of Mixture-of-Experts for Structured Complex Tasks
- SeerAttention: Self-distilled Attention Gating for Efficient Long-context Prefilling
- Who Speaks for the Trigger? Dynamic Expert Routing in Backdoored Mixture-of-Experts Transformers