Agent Task on FrozenLake
100Success RateGemini 2.5 Pro
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini 2.5 ProModel Category=Thinking Model2026.02 | 100 | 75 | |
| gpt-oss-120bModel Category=Thinking Model2026.02 | 99 | 73.8 | |
| DeepSeek-V3.2Model Category=Non-thinking Model2026.02 | 97 | 73.1 | |
| Gemini 2.5 FlashModel Category=Non-thinking Model2026.02 | 97 | 70.7 | |
| DeepSeek-R1Model Category=Thinking Model2026.02 | 96 | 72.6 | |
| Qwen3-30B-A3B-ThinkingModel Category=Thinking Model2026.02 | 93 | 68 | |
| Qwen3-4B-ThinkingModel Category=Thinking Model2026.02 | 91 | 66.7 | |
| GLM-4-32B-0414Model Category=Non-thinking Model2026.02 | 67 | 49.9 | |
| Phi-4Model Category=Non-thinking Model2026.02 | 66 | 50.8 | |
| Phi-4-reasoningModel Category=Thinking Model2026.02 | 62 | 48.8 | |
| Qwen3-30B-A3B-InstructModel Category=Non-thinking Model2026.02 | 61 | 49 | |
| Qwen3-4B-InstructModel Category=Non-thinking Model2026.02 | 59 | 46.1 | |
| Ministral-3-14B-InstructModel Category=Non-thinking Model2026.02 | 56 | 35.8 | |
| Llama-3.3-70B-InstructModel Category=Non-thinking Model2026.02 | 44 | 34.7 | |
| Llama-3.1-8B-InstructModel Category=Non-thinking Model2026.02 | 12 | 8.4 | |
| GLM-4-9B-ChatModel Category=Non-thinking Model2026.02 | 10 | 7.2 | |
| Mistral-7B-InstructModel Category=Non-thinking Model2026.02 | 6 | 4.6 |