General AI Assistant Tasks on GAIA All levels original (test)
63.19Performance (%)EvoRoute
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| EvoRouteFramework=CK-Pro, Setting=Ours2026.01 | 63.19 | 85.4 | 38.75 | |
| Claude-4Framework=CK-Pro, Setting=Manual2026.01 | 58.28 | 359.32 | 45.14 | |
| EvoRouteFramework=Smolagent, Setting=Ours2026.01 | 56.36 | 15.6 | 8.9 | |
| MasRouterFramework=CK-Pro, Setting=Routing2026.01 | 53.5 | 120.15 | 52.95 | |
| GPT-4.1Framework=CK-Pro, Setting=Manual2026.01 | 48.48 | 61.84 | 23.04 | |
| PromptLLMFramework=CK-Pro, Setting=Routing2026.01 | 47.88 | 128.15 | 57.7 | |
| GraphRouterFramework=CK-Pro, Setting=Routing2026.01 | 46.67 | 116.1 | 53.32 | |
| Claude-4Framework=Smolagent, Setting=Manual2026.01 | 46.06 | 76.9 | 29.1 | |
| GPT-4oFramework=CK-Pro, Setting=Manual2026.01 | 42.42 | 82.86 | 35.43 | |
| MasRouterFramework=Smolagent, Setting=Routing2026.01 | 40.61 | 17 | 12.3 | |
| PromptLLMFramework=Smolagent, Setting=Routing2026.01 | 40 | 17.5 | 12.2 | |
| GPT-4.1Framework=Smolagent, Setting=Manual2026.01 | 39.39 | 18.1 | 7.9 | |
| GraphRouterFramework=Smolagent, Setting=Routing2026.01 | 38.79 | 15.7 | 11.3 | |
| Qwen3-14bFramework=Smolagent, Setting=Manual2026.01 | 11.52 | 0.82 | 8.6 | |
| Qwen3-14bFramework=CK-Pro, Setting=Manual2026.01 | 10.91 | 4.16 | 24.67 |