confidence calibration
The process of adjusting a model's predicted probabilities to better reflect the true likelihood of outcomes, ensuring that the model's confidence aligns with actual performance levels. It is particularly important for high-stakes applications where accurate uncertainty assessments are critical.
- AI Debate Aids Assessment of Controversial Claims
- Introducing FOReCAst: The Future Outcome Reasoning and Confidence Assessment Benchmark
- Reasoning Models Better Express Their Confidence
- SteerConf: Steering LLMs for Confidence Elicitation
- Your Pre-trained LLM is Secretly an Unsupervised Confidence Calibrator