GAIA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GAIA
70.9Accuracy
14
GAIA Search
96.9Accuracy
14
GAIA Out-of-Distribution
47Accuracy
14
GAIA text-only
0.757Score
14
GAIA 2
43.7Score
14
GAIA
40.8GAIA (WS)
14
GAIA
88.68Pass@1 (L1)
13
GAIA
80Accuracy
13
GAIA
72.7Accuracy
12
GAIA File
79Score
12
GAIA
39EM (Exact Match)
12
GAIA L3
28.7Accuracy
12
GAIA L2
49.8Accuracy
12
GAIA L1
69.5Accuracy
12
GAIA text
80.3Score
12
GAIA
80.3Success Rate
12
GAIA
54.4Accuracy (Text-only)
12
GAIA
64.1Text Success Rate
12
GAIA
87.4Pass@1
12
GAIA
105,170Research And Data Score
12
GAIA (test)
114,725Research And Data
12
GAIA
87.1Extra Task Completion Rate
12
GAIA (val)
80Pass@1
12
GAIA text-only (val)
81.6Inference Accuracy
12
TRAIL-annotated GAIA 1.0 (test)
54.7Category F1
11