BeyondAIME
Benchmarks
TaskDatasetSOTA resultTrendResults
BeyondAIME
69Pass@16
39
BeyondAIME
61.7avg@16
23
BeyondAIME
21Mean@8 Score
18
BeyondAIME
82.5Accuracy
18
BeyondAIME (test)
1.202SNR Gain
15
BeyondAIME
70.38Pass@1
14
BeyondAIME
42.8Avg@16
12
BeyondAIME
74.8Accuracy
10
BeyondAIME
86.5Score
9
BeyondAIME
66.56Avg@10
9
BeyondAIME
8.3Pass@1
8
BeyondAIME
39Score
7
BeyondAIME
0.301SNR Gain
7
BeyondAIME
41Pass@1
6
BeyondAIME
71.8Mean@10
4
BeyondAIME
31.3pass@64
3
BeyondAIME
2Turn 1 Score
2