compute budget
The constraints on computational resources available for training or deploying models, affecting choices around model complexity, dataset size, and training duration.
- Audits Under Resource, Data, and Access Constraints: Scaling Laws For Less Discriminatory Alternatives
- Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
- Complexity Scaling Laws for Neural Models using Combinatorial Optimization
- Computational Budget Should Be Considered in Data Selection
- Dynamic Risk Assessments for Offensive Cybersecurity Agents
- Know What You Don't Know: Uncertainty Calibration of Process Reward Models