zhou Xun

3 papers ByteDance Inc.

• HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization
• Model Merging in Pre-training of Large Language Models
• Stepsize anything: A unified learning rate schedule for budgeted-iteration training