Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models

Bryan Catanzaro (NVIDIA) · Yicheng Liu (Nanjing University) · Limin Wang (Nanjing University) · Guo Chen (Nanjing University) · Tong Lu (Nanjing University) · Shihao Wang (Hong Kong Polytechnic University) · Wonmin Byeon (NVIDIA Research) · Jan Kautz (NVIDIA) · Zhiqi Li (Nanjing University) · Jindong Jiang (NVIDIA) · Lidong Lu (Nanjing University) · De-An Huang (NVIDIA) · Matthieu Le (Arterys) · Max Ehrlich (University of Maryland, College Park) · Andrew Tao (Nvidia Corporation) · Zhiding Yu (NVIDIA) · Guilin Liu (NVIDIA)
automatic degrade samplingclip-level annotationscommercial modelscontextual integrityeagle-video-110keagle2.5efficiency optimizationshigh-resolution image understandingimage area preservationlong-context data traininglong-context multimodal learningmultimodal benchmarksstory-level annotationsvideo comprehensionvision-language modelvisual details

We introduce Eagle2.5, a frontier vision-language model (VLM) for long-context multimodal learning. Our work addresses the challenges in long video comprehension and high-resolution image understanding, introducing a generalist framework for both tasks. The proposed training framework incorporates Automatic Degrade Sampling and Image Area Preservation, two techniques that preserve contextual integrity and visual details. The framework also includes numerous efficiency optimizations in the pipeline for long-context data training. Finally, we propose Eagle-Video-110K, a novel dataset that integrates both story-level and clip-level annotations, facilitating long-video understanding. Eagle2.5 demonstrates substantial improvements on long-context multimodal benchmarks, providing a robust solution to the limitations of existing VLMs. Notably, our best model Eagle2.5-8B achieves 72.4\% on Video-MME with 512 input frames, matching the results of top-tier commercial model such as GPT-4o and large-scale open-source models like Qwen2.5-VL-72B and InternVL2.5-78B.