Tool-use Agent on GAIA
64.1Text Success RateAutoAgent
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AutoAgentBackbone=gemini-3-pro2026.03 | 64.1 | 50 | 31.6 | 54.5 | |
| AutoAgentBackbone=gemini-3-pro-thinking2026.03 | 62.1 | 58.3 | 23.7 | 52.7 | |
| Direct AnswerBackbone=gemini-3-pro-thinking2026.03 | 44.7 | 25 | 13.2 | 34.5 | |
| AutoAgentBackbone=gpt-4o2026.03 | 43.7 | 25 | 31.6 | 38.2 | |
| Direct AnswerBackbone=gemini-3-pro2026.03 | 42.7 | 16.7 | 15.8 | 32.7 | |
| DeepAgentBackbone=gpt-4o2026.03 | 42.5 | 24.6 | 31.6 | 37.6 | |
| DeepAgentBackbone=gemini-3-pro2026.03 | 38.8 | 16.7 | 2.6 | 27.3 | |
| ReActBackbone=gemini-3-pro2026.03 | 36.9 | 16.7 | 34.2 | 33.3 | |
| ReActBackbone=gemini-3-pro-thinking2026.03 | 32 | 12.5 | 39.5 | 30.9 | |
| DeepAgentBackbone=gemini-3-pro-thinking2026.03 | 32 | 20.8 | 0 | 23 | |
| ReActBackbone=gpt-4o2026.03 | 26.2 | 20.8 | 26.3 | 25.5 | |
| Direct AnswerBackbone=gpt-4o2026.03 | 10.7 | 0 | 2.6 | 7.3 |