Agent Task on BlocksWorld (SR, AUV)
100Success Rategpt-oss-120b
Evaluation results
| Method | Links | ||
|---|---|---|---|
| gpt-oss-120bModel Category=Thinking Model2026.02 | 100 | 73.7 | |
| DeepSeek-R1Model Category=Thinking Model2026.02 | 100 | 74.9 | |
| Gemini 2.5 ProModel Category=Thinking Model2026.02 | 100 | 75.2 | |
| Gemini 2.5 FlashModel Category=Non-thinking Model2026.02 | 99 | 72 | |
| DeepSeek-V3.2Model Category=Non-thinking Model2026.02 | 98 | 71.1 | |
| Qwen3-30B-A3B-ThinkingModel Category=Thinking Model2026.02 | 98 | 69.8 | |
| Llama-3.3-70B-InstructModel Category=Non-thinking Model2026.02 | 96 | 68.2 | |
| GLM-4-32B-0414Model Category=Non-thinking Model2026.02 | 83 | 57.5 | |
| Qwen3-4B-ThinkingModel Category=Thinking Model2026.02 | 77 | 47.9 | |
| Ministral-3-14B-InstructModel Category=Non-thinking Model2026.02 | 72 | 39 | |
| Phi-4-reasoningModel Category=Thinking Model2026.02 | 68 | 51.3 | |
| Qwen3-30B-A3B-InstructModel Category=Non-thinking Model2026.02 | 64 | 45.4 | |
| Phi-4Model Category=Non-thinking Model2026.02 | 56 | 41.2 | |
| Qwen3-4B-InstructModel Category=Non-thinking Model2026.02 | 40 | 30.8 | |
| Llama-3.1-8B-InstructModel Category=Non-thinking Model2026.02 | 32 | 21.9 | |
| GLM-4-9B-ChatModel Category=Non-thinking Model2026.02 | 23 | 18.2 | |
| Mistral-7B-InstructModel Category=Non-thinking Model2026.02 | 7 | 5 |