General AI Assistant Tasks on GAIA Level 1 original (test)
83.02Performance (%)EvoRoute
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| EvoRouteFramework=CK-Pro, Setting=Ours2026.01 | 83.02 | 26.5 | 6.1 | |
| EvoRouteFramework=Smolagent, Setting=Ours2026.01 | 73.91 | 3.7 | 2.9 | |
| Claude-4Framework=CK-Pro, Setting=Manual2026.01 | 67.92 | 96.46 | 6.83 | |
| MasRouterFramework=CK-Pro, Setting=Routing2026.01 | 67.92 | 27.8 | 9.8 | |
| GPT-4oFramework=CK-Pro, Setting=Manual2026.01 | 59.91 | 27.56 | 7.35 | |
| PromptLLMFramework=CK-Pro, Setting=Routing2026.01 | 58.91 | 31.27 | 10.88 | |
| GraphRouterFramework=CK-Pro, Setting=Routing2026.01 | 58.13 | 28.5 | 10.2 | |
| GPT-4.1Framework=CK-Pro, Setting=Manual2026.01 | 56.29 | 16.96 | 7.46 | |
| Claude-4Framework=Smolagent, Setting=Manual2026.01 | 56.26 | 21.2 | 12.8 | |
| GPT-4.1Framework=Smolagent, Setting=Manual2026.01 | 55 | 5.7 | 3.2 | |
| MasRouterFramework=Smolagent, Setting=Routing2026.01 | 49.82 | 4 | 6.8 | |
| PromptLLMFramework=Smolagent, Setting=Routing2026.01 | 49.8 | 4.1 | 6.5 | |
| GraphRouterFramework=Smolagent, Setting=Routing2026.01 | 47.95 | 3.7 | 6 | |
| Qwen3-14bFramework=CK-Pro, Setting=Manual2026.01 | 16.77 | 1.06 | 6.23 | |
| Qwen3-14bFramework=Smolagent, Setting=Manual2026.01 | 15.35 | 0.3 | 3 |