Question Answering on TriviaQA (Calibration and Uncertainty Metrics)
5.9Error Rate (ER)Verbalized
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| VerbalizedLLM=Gemini 2.5 Flash2026.05 | 5.9 | 4.9 | 74.3 | 53.2 | 5.4 | 1.6 | 50.3 | 11.3 | 6.2 | |
| Seq. Post.LLM=Gemini 2.5 Flash2026.05 | 6.4 | 6.6 | 85.5 | 20.9 | 5.7 | 1.5 | 21.3 | 12.1 | 6.4 | |
| Is TrueLLM=Gemini 2.5 Flash2026.05 | 6.4 | 5.3 | 81.3 | 58.8 | 5.3 | 3.1 | 44.9 | 11.7 | 8.1 | |
| VerbalizedLLM=Gemini 2.5 Flash Lite2026.05 | 10.8 | 6.8 | 85.3 | 44.5 | 8 | 2.4 | 46.2 | 18.8 | 10.9 | |
| Seq. Post.LLM=Gemini 2.5 Flash Lite2026.05 | 11.9 | 4.3 | 89.1 | 23.2 | 6.3 | 2.5 | 27.2 | 18.2 | 12 | |
| Is TrueLLM=Gemini 2.5 Flash Lite2026.05 | 11.9 | 8.9 | 88.1 | 62.5 | 8.7 | 2.6 | 57.3 | 20.5 | 13.2 | |
| VerbalizedLLM=Ministral-3-8B-Instruct-25122026.05 | 23.1 | 15.9 | 65.8 | 57.9 | 19.1 | 67.3 | 59.4 | 42.2 | 23.3 | |
| Seq. Post.LLM=Ministral-3-8B-Instruct-25122026.05 | 23.7 | 30.6 | 88 | 87.4 | 23.4 | 22.7 | 58.4 | 47.1 | 26 | |
| Is TrueLLM=Ministral-3-8B-Instruct-25122026.05 | 23.7 | 6.3 | 89.5 | 37.3 | 10.9 | 7.3 | 43 | 34.7 | 24.3 | |
| VerbalizedLLM=Qwen3.5 9B2026.05 | 24.6 | 20.3 | 75.6 | 80 | 21.2 | 10.1 | 82.3 | 45.9 | 24.8 | |
| Seq. Post.LLM=Qwen3.5 9B2026.05 | 25.1 | 16.4 | 92.3 | 40.3 | 13.2 | 7 | 48.4 | 38.2 | 25.2 | |
| Is TrueLLM=Qwen3.5 9B2026.05 | 25.1 | 10.9 | 88.9 | 42.2 | 13.9 | 6.1 | 49.6 | 38.9 | 25.3 |