General AI Assistant Reasoning on GAIA-Text-103 1.0 (test)
62.1Overall AccuracyClaude-3.7-Sonnet
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Claude-3.7-SonnetModel Type=Proprietary2026.02 | 62.1 | 76.9 | 57.7 | 33.3 | |
| WebShaperModel Size=72B2025.08 | 60.1 | 69.2 | 63.4 | 16.6 | |
| WebSailorModel Size=72B2025.08 | 55.4 | — | — | — | |
| WebShaperModel Size=32B2025.08 | 53.3 | 69.2 | 50 | 16.6 | |
| WebSailorModel Size=32B2025.08 | 53.2 | — | — | — | |
| WebDancerModel Size=32B, Evaluation Protocol=Pass@1 (Alternative Config)2025.08 | 51.5 | 61.5 | 50 | 25 | |
| CSOBase Model=CK-Pro-8B, Post-Training Method=Critical Step Optimization2026.02 | 49.5 | 61.5 | 48.1 | 16.7 | |
| Cognitive Kernel-ProModel Size=8B, Evaluation Protocol=Pass@32025.08 | 49.3 | 61.5 | 44.2 | 16.7 | |
| WebThinker-RLModel Size=32B2025.08 | 48.5 | 56.4 | 50 | 16.7 | |
| GPT-4.1Model Type=Proprietary2026.02 | 45.6 | 56.4 | 44.2 | 16.7 | |
| WebThinker-BaseModel Size=32B2025.08 | 44.7 | 53.8 | 44.2 | 16.7 | |
| IPRBase Model=CK-Pro-8B, Post-Training Method=Iterative Process Refinement2026.02 | 44.6 | 56.4 | 42.3 | 16.7 | |
| Cognitive Kernel-ProModel Size=8B, Backbone=Qwen-3-8B, Evaluation Protocol=Pass@12025.08 | 43.7 | 56.4 | 42.3 | 8.33 | |
| Cognitive Kernel-ProModel Size=8B, Evaluation Protocol=Voting2025.08 | 41.1 | 53.8 | 34.6 | 16.7 | |
| WebDancerModel Size=32B, Evaluation Protocol=Pass@12025.08 | 40.7 | 46.1 | 44.2 | 8.3 | |
| ETOBase Model=CK-Pro-8B, Post-Training Method=Exploration-based Trajectory Optimization2026.02 | 38.9 | 51.2 | 36.5 | 8.3 | |
| Step-DPOBase Model=CK-Pro-8B, Post-Training Method=Step-wise DPO2026.02 | 38.9 | 53.3 | 34.6 | 8.3 | |
| WebSailorModel Size=7B2025.08 | 37.9 | — | — | — | |
| CK-Pro-8BMode=SFT2026.02 | 35.9 | 46.2 | 34.6 | 8.3 | |
| RFTBase Model=CK-Pro-8B, Post-Training Method=Rejection Sampling Fine-Tuning2026.02 | 34.9 | 51.2 | 28.8 | 8.3 | |
| WebDancerModel Size=7B, Evaluation Protocol=Pass@32025.08 | 34 | — | — | — | |
| WebDancerModel Size=7B, Evaluation Protocol=Pass@12025.08 | 31 | 41 | 30.7 | 0 | |
| Search-o1Model Size=32B2025.08 | 28.2 | 33.3 | 25 | 0 | |
| Qwen3-8BModel Type=Open-Source Baseline2026.02 | 20.4 | 35.9 | 13.5 | 0 | |
| R1-SearcherModel Size=7B2025.08 | 20.4 | 28.2 | 19.2 | 8.3 | |
| Search-o1Model Size=7B2025.08 | 17.5 | 23.1 | 17.3 | 0 |