HMMT25
Benchmarks
TaskDatasetSOTA resultTrendResults
HMMT25
86.7Accuracy
119
HMMT25
92.5Accuracy (%)
115
HMMT25
17.9Avg@32
34
HMMT25
53.3Pass@16
24
HMMT25
48.1Avg@12 Accuracy
21
HMMT25
16.3Accuracy (HMMT25)
21
HMMT25
34.9Accuracy (HMMT25)
21
HMMT25
13.33Mean Score (8 samples)
18
HMMT25
33.6Accuracy
16
HMMT25
66.7Pass@8
14
HMMT25
44.5Avg@16
12
HMMT25
46.4Average Score
12
HMMT25
82.2Accuracy avg@32
6
HMMT25
16.83Throughput (Req/s)
6
HMMT25
53.33Pass@8
5
HMMT25 Nov.
15.83Mean@8
4