MEGADance: Mixture-of-Experts Architecture for Genre-Aware 3D Dance Generation

Ziqiao Peng (Renmin University of China) · Hongyan Liu (Tsinghua University, Tsinghua University) · Jun He (SUN YAT-SEN UNIVERSITY) · kaixing yang (Renmin University of China) · Xulong Tang (Malou Tech Inc) · Yuxuan Hu (Renmin University of China)
aist++ datasetchoreographydance generalityfinedance datasetfinite scalar quantizationgenre conditioninggenre specificitygenre-aware dance generationhigh-fidelity dance quantizationkinematic-dynamic constraintsmamba-transformer hybrid backbonemegadancemixture-of-experts mechanismmusic-driven 3d dance generationmusic-motion synchronizationrhythmic transitions

Music-driven 3D dance generation has attracted increasing attention in recent years, with promising applications in choreography, virtual reality, and creative content creation. Previous research has generated promising realistic dance movement from audio signals. However, traditional methods underutilize genre conditioning, often treating it as auxiliary modifiers rather than core semantic drivers. This oversight compromises music-motion synchronization and disrupts dance genre continuity, particularly during complex rhythmic transitions, thereby leading to visually unsatisfactory effects. To address the challenge, we propose MEGADance, a novel architecture for music-driven 3D dance generation. By decoupling choreographic consistency into dance generality and genre specificity, MEGADance demonstrates significant dance quality and strong genre controllability. It consists of two stages: (1) High-Fidelity Dance Quantization Stage (HFDQ), which encodes dance motions into a latent representation by Finite Scalar Quantization (FSQ) and reconstructs them with kinematic-dynamic constraints, and (2) Genre-Aware Dance Generation Stage (GADG), which maps music into the latent representation by synergistic utilization of Mixture-of-Experts (MoE) mechanism with Mamba-Transformer hybrid backbone. Extensive experiments on the FineDance and AIST++ dataset demonstrate the state-of-the-art performance of MEGADance both qualitatively and quantitatively. Code will be released upon acceptance.