Zero-shot Classification
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
69.8Zero-shot Accuracy (%)
90
Mar 16, 2026
81.65BoolQ Accuracy
87
Apr 16, 2026
74.83Top-1 Accuracy
65
May 20, 2026
91.8Top-1 Clean Acc
62
May 20, 2026
64.7Accuracy
60
Feb 26, 2026
79.48Accuracy
55
Jun 1, 2026
68.59Average Accuracy (Zero-Shot Suite)
51
Apr 16, 2026
77.7PIQA
39
Feb 26, 2026
62U Score
34
Jul 7, 2026
68.1Top-1 Accuracy
34
Feb 26, 2026
76.88Avg Zero-shot Acc
31
Feb 26, 2026
92.59ARC-e Accuracy
30
May 19, 2026
47.7Accuracy (Zero-shot)
30
Apr 30, 2026
80.79PIQA Acc
30
Feb 26, 2026
73.9Accuracy
27
Apr 1, 2026
87.2Top-1 Clean Acc
24
Jun 11, 2026
70.7Top-1 Clean Acc
21
May 20, 2026
97.6Top-1 Clean Acc
21
May 20, 2026
68.5Top-1 Clean Accuracy
21
May 19, 2026
76.61SUN Accuracy
20
May 19, 2026
98Accuracy (%)
20
Mar 31, 2026
0.667Top-1 Clean Accuracy
20
May 19, 2026
95.08Accuracy (Zero-shot)
20
May 20, 2026
89.86Top-1 Clean Acc
19
Mar 6, 2026
37.1MMLU (5-shot)
18
Feb 26, 2026