Ranking Stability Analysis on SimpleQA and 4 Hallucination Benchmarks benchmark leaderboard · SOTA2 Research

Ranking Stability Analysis on SimpleQA and 4 Hallucination Benchmarks

0.9Kendall's WF-score

Evaluation Results

Method	Links
F-score2025.10		0.9	0
Correct Answer Rate2025.10		0.87	0
Weighted2025.10		0.87	0.33
Refusal Rate2025.10		0.86	0.18
C / A2025.10		0.69	0.33
C / A2025.10		0.63	0.61
Weighted2025.10		0.6	0.33
RI2025.10		0.5	0.33
RI2025.10		0.49	0.37
Correct Answer Rate2025.10		0.48	0.48
F-score2025.10		0.48	0.48
RI2025.10		0.47	0.47
Refusal Rate2025.10		0.44	0.61
C / A2025.10		0.4	0.48
Correct Answer Rate2025.10		0.39	1
F-score2025.10		0.39	0.52
C / A2025.10		0.37	0.61
RI2025.10		0.35	0.61
Weighted2025.10		0.32	0.61
Refusal Rate2025.10		0.3	1
Random Value2025.10		0.25	0.61
Random Value2025.10		0.25	0.61
Random Value2025.10		0.25	0.61
Random Value2025.10		0.25	0.61
Weighted2025.10		0.25	0.37
F-score2025.10		0.1	0.18
Correct Answer Rate2025.10		0	1
Refusal Rate2025.10		0	1