GAIA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GAIA Open-web via SERPER (test)
46.8Pass@4
18
GAIA
57.3Pass@1
18
GAIA
76.4Pass@1
18
GAIA Full
60.12Accuracy
18
GAIA (File/Reasoning/Others)
56.21Accuracy
18
GAIA (Web)
63.33Accuracy
18
GAIA Text-Only
80.1Score
17
GAIA
67.4Pass@1 Accuracy
17
GAIA (val)
86.06Average Score
17
GAIA
76.36Average Score
16
GAIA
11.2Latency (Research And Data)
16
GAIA 103-question text-only
75.7Pass@1
16
GAIA
51.46Pass@1
16
GAIA Text
81.6Overall Score
15
GAIA
100Accuracy (A)
15
GAIA Level 2
14.24Pass@1
15
GAIA
70.5Pass@1
15
GAIA Level 3 original (test)
37.5Performance
15
GAIA Level 2 original (test)
59.3Perf (%)
15
GAIA Level 1 original (test)
83.02Performance (%)
15
GAIA All levels original (test)
63.19Performance (%)
15
GAIA
46.7Success Rate
15
GAIA Text-Only
0.874Accuracy
15
GAIA-127
23.6Accuracy
14
GAIA (test)
46.06Overall Accuracy
14