open-sourced llms

3 papers

• Exploring Polyglot Harmony: On Multilingual Data Allocation for Large Language Models Pretraining
• Superposition Yields Robust Neural Scaling
• Your Pre-trained LLM is Secretly an Unsupervised Confidence Calibrator