LIAR
Benchmarks
TaskDatasetSOTA resultTrendResults
LIAR
0.277Somers' D
45
LIAR
69Accuracy@1
33
LIAR RAW
50.59Macro F1
32
LIAR
79Accuracy
28
LIAR
68.6F1 Score
24
LIAR Open
46.81Accuracy
23
LIAR Closed
79.15Accuracy
23
LIAR Closed
26.99Accuracy
22
LIAR Open
84.21Accuracy
22
LIAR (test)
65.2Accuracy
21
LIAR-RAW
77.38Precision
20
LIAR (val)
27.7Accuracy
13
LIAR (test)
46.8Precision
12
LIAR RAW
2.09Informativeness (MAR)
12
LIAR-RAW (test)
43.83Precision
12
LIAR Ambiguity-Augmented subset of 200 samples
69Accuracy@1
11
LIAR ambiguity-augmented
68.9Accuracy
11
LIAR (test)
68.2Accuracy
11
LIAR-RAW (test)
25.5ROU-1
11
LIAR (test)
100Fidelity
8
LIAR-NEW Perplexity
19.95Attack Success Rate (ASR)
7
LIAR ClaimBuster NEW
97.02Attack Success Rate (ASR)
7
LIAR-NEW Verifact
40.34Attack Success Rate
7
LIAR ICL NEW
30.35Attack Success Rate
7
LIAR RAW
2.29Meaningfulness Score
7