Agent Behavior Adaptation on BlocksWorld (BW) (test)
51Loop RatioMistral-7B-Instruct
Evaluation results
| Method | Links | |
|---|---|---|
| Mistral-7B-InstructModel Type=Non-thinking Model2026.02 | 51 | |
| Qwen3-4B-ThinkingModel Type=Thinking Model2026.02 | 28.5 | |
| Qwen3-4B-InstructModel Type=Non-thinking Model2026.02 | 15.8 | |
| Phi-4Model Type=Non-thinking Model2026.02 | 12.3 | |
| Glm-4-9B-ChatModel Type=Non-thinking Model2026.02 | 7.6 | |
| Ministral-3-14B-InstructModel Type=Non-thinking Model2026.02 | 6 | |
| Phi-4-reasoningModel Type=Thinking Model2026.02 | 5.2 | |
| Llama-3.1-8B-InstructModel Type=Non-thinking Model2026.02 | 3.2 | |
| Qwen3-30B-A3B-ThinkingModel Type=Thinking Model2026.02 | 2 | |
| Glm-4-32B-0414Model Type=Non-thinking Model2026.02 | 1.2 | |
| Qwen3-30B-A3B-InstructModel Type=Non-thinking Model2026.02 | 1 | |
| gpt-oss-120bModel Type=Thinking Model2026.02 | 1 | |
| Llama-3.3-70B-InstructModel Type=Non-thinking Model2026.02 | 0 | |
| DeepSeek-V3.2Model Type=Non-thinking Model2026.02 | 0 | |
| Gemini 2.5 FlashModel Type=Non-thinking Model2026.02 | 0 | |
| DeepSeek-R1Model Type=Thinking Model2026.02 | 0 | |
| Gemini 2.5 ProModel Type=Thinking Model2026.02 | 0 |