long-context tasks

3 papers

• LongMagpie: A Self-synthesis Method for Generating Large-scale Long-context Instructions
• Skrull: Towards Efficient Long Context Fine-tuning through Dynamic Data Scheduling
• SkyLadder: Better and Faster Pretraining via Context Window Scheduling