GAIA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GAIA Text-Only
84.5Score
7
GAIA
12.73Accuracy
7
GAIA n=50
0.594Accuracy
7
GAIA (held-out)
47.7EM
6
GAIA
75.73Pass@3
6
GAIA (unseen)
13.21Level 1 Score
6
GAIA (official)
78.2Exact Match
6
GAIA
24.8Pass@1
5
GAIA 2 (held-out)
37Pass Rate
5
GAIA
40.77Score
5
GAIA (test)
0.946Mean Spearman Rho
5
GAIA
71.3GAIA Score
4
GAIA (test)
31Level 1 Accuracy
4
GAIA
48.5Online Deployment Accuracy
4
GAIA Text
18.4Accuracy
4
GAIA Round 2
20Level 1 Evo. Pass@1
4
GAIA
25.07F1 Score
4
GAIA Avg@4
57.9F1 (Lv.1)
4
GAIA-127
58.3Accuracy
3
GAIA (test)
54.9Pass@3
3
GAIA
70.9Pass@3
3
GAIA
344.1Average Latency (s)
3
GAIA text-103
70.9Accuracy
3
GAIA (OOD)
32.5Avg@4
3
GAIA (full)
38.8Pass@1
3