Agent Behavior Adaptation on Sudoku (Su) (test)
34.3Loop RatioQwen3-4B-Thinking
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-4B-ThinkingModel Type=Thinking Model2026.02 | 34.3 | |
| Qwen3-4B-InstructModel Type=Non-thinking Model2026.02 | 22.5 | |
| Phi-4Model Type=Non-thinking Model2026.02 | 21 | |
| Mistral-7B-InstructModel Type=Non-thinking Model2026.02 | 15.7 | |
| Llama-3.1-8B-InstructModel Type=Non-thinking Model2026.02 | 14.7 | |
| Glm-4-9B-ChatModel Type=Non-thinking Model2026.02 | 9.5 | |
| Ministral-3-14B-InstructModel Type=Non-thinking Model2026.02 | 6.9 | |
| Glm-4-32B-0414Model Type=Non-thinking Model2026.02 | 5.8 | |
| Qwen3-30B-A3B-InstructModel Type=Non-thinking Model2026.02 | 4.2 | |
| Llama-3.3-70B-InstructModel Type=Non-thinking Model2026.02 | 2.7 | |
| Qwen3-30B-A3B-ThinkingModel Type=Thinking Model2026.02 | 2.2 | |
| Phi-4-reasoningModel Type=Thinking Model2026.02 | 1 | |
| Gemini 2.5 FlashModel Type=Non-thinking Model2026.02 | 0.6 | |
| DeepSeek-V3.2Model Type=Non-thinking Model2026.02 | 0.1 | |
| Gemini 2.5 ProModel Type=Thinking Model2026.02 | 0.1 | |
| gpt-oss-120bModel Type=Thinking Model2026.02 | 0 | |
| DeepSeek-R1Model Type=Thinking Model2026.02 | 0 |