TruthfulQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
TruthfulQA (test)
0.574Spearman Correlation
14
TruthfulQA
28.2TruthfulQA Score
12
TruthfulQA
24.3TruthfulQA Score
12
TruthfulQA
48.76TruthfulQA Accuracy
12
TruthfulQA
41.74MC1 Score
12
TruthfulQA MC1
86.7Elicitation Accuracy
12
TruthfulQA
72.05Accuracy
12
TruthfulQA monolingual and cross-lingual
86.16Accuracy@3
12
TruthfulQA no-context abstention stress test 100-item
100Correctness
12
TruthfulQA
40.15Accuracy
12
TruthfulQA
34.64Accuracy (MC1 Delta)
12
TruthfulQA
0.776MCC
12
TruthfulQA
82.6TruthfulQA Score
12
TruthfulQA
81MA.
12
TruthfulQA
0.824Acc
12
TruthfulQA
91.4Accuracy
12
TruthfulQA
0.748BLEURT
12
TruthfulQA
64.3Factuality Score (0-shot)
12
TruthfulQA matched-N (test)
31.67Accuracy
11
TruthfulQA
13.57Brier Score
11
TruthfulQA (val)
54Accuracy
11
TruthfulQA
93.67ACC
11
TruthfulQA 25% random (test)
0.877AUROC
11
TruthfulQA
72TruthfulQA Capability
10
TruthfulQA
1.62NLL
10