General AI Assistant Tasks on GAIA Level 2 original (test)
59.3Perf (%)EvoRoute
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| EvoRouteFramework=CK-Pro, Setting=Ours2026.01 | 59.3 | 33.6 | 18.3 | |
| Claude-4Framework=CK-Pro, Setting=Manual2026.01 | 58.14 | 192.64 | 25.35 | |
| EvoRouteFramework=Smolagent, Setting=Ours2026.01 | 53.73 | 6.2 | 4.8 | |
| MasRouterFramework=CK-Pro, Setting=Routing2026.01 | 49.74 | 77.4 | 28.15 | |
| GPT-4.1Framework=CK-Pro, Setting=Manual2026.01 | 49.73 | 35.26 | 10.87 | |
| PromptLLMFramework=CK-Pro, Setting=Routing2026.01 | 47.65 | 80.24 | 30.93 | |
| GraphRouterFramework=CK-Pro, Setting=Routing2026.01 | 46.23 | 72.1 | 28.9 | |
| Claude-4Framework=Smolagent, Setting=Manual2026.01 | 46.23 | 41.6 | 14.5 | |
| MasRouterFramework=Smolagent, Setting=Routing2026.01 | 42.07 | 8.5 | 3.7 | |
| PromptLLMFramework=Smolagent, Setting=Routing2026.01 | 40.92 | 8.9 | 3.8 | |
| GraphRouterFramework=Smolagent, Setting=Routing2026.01 | 39.78 | 8 | 3.5 | |
| GPT-4oFramework=CK-Pro, Setting=Manual2026.01 | 39.22 | 43.86 | 21.5 | |
| GPT-4.1Framework=Smolagent, Setting=Manual2026.01 | 36.3 | 8.9 | 2.6 | |
| Qwen3-14bFramework=CK-Pro, Setting=Manual2026.01 | 10.34 | 2.58 | 14.9 | |
| Qwen3-14bFramework=Smolagent, Setting=Manual2026.01 | 4.73 | 0.42 | 1.2 |