BINBINLIU

3 papers ByteDance Inc.

• Exploring Polyglot Harmony: On Multilingual Data Allocation for Large Language Models Pretraining
• MoORE: SVD-based Model MoE-ization for Conflict- and Oblivion-Resistant Multi-Task Adaptation
• MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining