Question Answering on TruthfulQA (AUROC and ECE Metrics)
0.871AUROCDISCOUQ-Learn
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DISCOUQ-LearnID=M32026.03 | 0.871 | 0.074 | |
| DISCOUQ-LLMID=M12026.03 | 0.867 | 0.062 | |
| Embed Centr.ID=B52026.03 | 0.807 | 0.155 | |
| LLM Agg.ID=B62026.03 | 0.805 | 0.102 | |
| Vote CountID=B12026.03 | 0.798 | 0.037 | |
| Vote EntropyID=B22026.03 | 0.798 | 0.096 | |
| Self-Consist.ID=B42026.03 | 0.798 | 0.096 | |
| DISCOUQ-EmbedID=M22026.03 | 0.798 | 0.039 | |
| Verb. Conf.ID=B32026.03 | 0.733 | 0.122 | |
| RALCSignal=Sem. Uncertainty2026.05 | 0.664 | — | |
| RALCSignal=Token Probability2026.05 | 0.63 | — | |
| Hedged QA2026.05 | 0.627 | — | |
| Original Response2026.05 | 0.61 | — | |
| RALCSignal=Ling. Confidence2026.05 | 0.6 | — |