Reasoning on PhantomWiki 2025 (test)
51.2ScoreDOLORES
Evaluation results
| Method | Links | |
|---|---|---|
| DOLORESBase Model=Llama-3.3 70B Instruct2026.05 | 51.2 | |
| CodeActBase Model=Llama-3.3 70B Instruct2026.05 | 38.1 | |
| DOLORESBase Model=Qwen3 32B Thinking2026.05 | 36.9 | |
| RLMBase Model=Llama-3.3 70B Instruct2026.05 | 27 | |
| CodeActBase Model=Qwen3 32B Thinking2026.05 | 25.2 | |
| ReActBase Model=Llama-3.3 70B Instruct2026.05 | 24.4 | |
| Deep ResearchBase Model=Qwen3 32B Thinking2026.05 | 21.2 | |
| DOLORESBase Model=Qwen3 8B Thinking2026.05 | 17.2 | |
| ReActBase Model=Qwen3 32B Thinking2026.05 | 16.7 | |
| RLMBase Model=Qwen3 32B Thinking2026.05 | 16 | |
| Deep ResearchBase Model=Llama-3.3 70B Instruct2026.05 | 16 | |
| CodeActBase Model=Qwen3 8B Thinking2026.05 | 15.3 | |
| ReActBase Model=Qwen3 8B Thinking2026.05 | 14.4 | |
| Deep ResearchBase Model=Qwen3 8B Thinking2026.05 | 12 | |
| RLMBase Model=Qwen3 8B Thinking2026.05 | 4.3 |