TruthfulQA
Benchmarks
TaskDatasetSOTA resultTrendResults
TruthfulQA
0.942AUC (ROC)
182
TruthfulQA
86.6Accuracy
164
TruthfulQA
91.5Accuracy
145
TruthfulQA (test)
89.5AUC-ROC
112
TruthfulQA
75Accuracy
108
TruthfulQA
94.3MC2
103
TruthfulQA
97.55Truthfulness Accuracy
98
TruthfulQA
0.885AUROC
91
TruthfulQA
58.5MC1 Accuracy
83
TruthfulQA
72.36Truthfulness Accuracy
78
TruthfulQA
86.64Accuracy
73
TruthfulQA
0.744ROC-AUC
66
TruthfulQA MC2
56.46MC2 Accuracy
66
TruthfulQA
63TruthfulQA Score
61
TruthfulQA
84.7T·I Score
59
TruthfulQA MC1
88.8MC1 Accuracy
54
TruthfulQA
98.38TPR@FPR-1% (ChatGLM)
54
TruthfulQA
81.1Performance Score
52
TruthfulQA
70.13BLEURT Score
48
TruthfulQA
0.727AUROC
48
TruthfulQA (test)
84.7True*Info (%)
44
TruthfulQA
68.25MC2
43
TruthfulQA (test)
62.69AURC
42
TruthfulQA
26.8PRR
42
TruthfulQA
75.76Score
42