Reasoning on SynthWorlds
48Reasoning Score (SynthWorlds)CodeAct
Evaluation results
| Method | Links | |
|---|---|---|
| CodeActModel=Llama-3.3 70B Instruct2026.05 | 48 | |
| RLMModel=Llama-3.3 70B Instruct2026.05 | 40.1 | |
| DOLORESModel=Llama-3.3 70B Instruct2026.05 | 35.9 | |
| DOLORESModel=Qwen3 32B Thinking2026.05 | 34.6 | |
| Deep ResearchModel=Llama-3.3 70B Instruct2026.05 | 30.8 | |
| DOLORESModel=Qwen3 8B Thinking2026.05 | 30.5 | |
| ReActModel=Llama-3.3 70B Instruct2026.05 | 30 | |
| CodeActModel=Qwen3 32B Thinking2026.05 | 28.1 | |
| Deep ResearchModel=Qwen3 32B Thinking2026.05 | 27.5 | |
| CodeActModel=Qwen3 8B Thinking2026.05 | 26.8 | |
| ReActModel=Qwen3 32B Thinking2026.05 | 22.8 | |
| Deep ResearchModel=Qwen3 8B Thinking2026.05 | 20.6 | |
| ReActModel=Qwen3 8B Thinking2026.05 | 17.6 | |
| RLMModel=Qwen3 32B Thinking2026.05 | 16.9 | |
| RLMModel=Qwen3 8B Thinking2026.05 | 5.8 |