Agentic Reasoning on GAIA Text
18.4AccuracyOctoTools
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| OctoToolsBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Agentic, Visual Understanding=false, Numerical Calculation=true, Knowledge Retrieval=true, Multi-step Reasoning=true2025.02 | 18.4 | 9.7 | 10 | |
| OctoToolsbaseBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Agentic, Visual Understanding=false, Numerical Calculation=true, Knowledge Retrieval=true, Multi-step Reasoning=true2025.02 | 9.7 | — | — | |
| 0-shotBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Agentic, Visual Understanding=false, Numerical Calculation=true, Knowledge Retrieval=true, Multi-step Reasoning=true2025.02 | 8.7 | — | — | |
| CoTBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Agentic, Visual Understanding=false, Numerical Calculation=true, Knowledge Retrieval=true, Multi-step Reasoning=true2025.02 | 8.4 | — | — |