Causal Reasoning
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
64.2XCOPA Causal Reasoning Score
8
Mar 24, 2026
94.8Overall Acc
7
Feb 26, 2026
84.8Parity
6
May 28, 2026
0.038BLEU
5
Apr 24, 2026
0.9Collapse Rate
5
Feb 26, 2026
76.4Final Accuracy
4
Jun 24, 2026
60.4Accuracy
3
May 8, 2026
60Accuracy
3
Feb 26, 2026
80.5Accuracy
3
Feb 26, 2026
60.5Accuracy
3
Feb 26, 2026
93.5Accuracy
3
Feb 26, 2026
57.37Average Accuracy (Zero-Shot)
2
Jun 24, 2026
61.46Average Score
2
Jun 24, 2026
49.3Accuracy
2
May 7, 2026
—
—Primary metric
0
May 12, 2026
—
—Primary metric
0
May 12, 2026
—
—Accuracy
0
Feb 26, 2026