Logical Reasoning on Frozen Lake
69Pass@1 Success RateGemini-3.1-Flash-Lite + ETCHR
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini-3.1-Flash-Lite + ETCHRTemperature=02026.05 | 69 | |
| Gemini-3.1-Flash-LiteTemperature=02026.05 | 62.5 | |
| Kimi K2.5 + ETCHRTemperature=02026.05 | 57 | |
| Kimi K2.5Temperature=02026.05 | 52.5 | |
| ThinkMorph-7BTemperature=0, Max image generations=102026.05 | 31 | |
| Qwen3-VL-8B + ETCHRTemperature=02026.05 | 13.5 | |
| Qwen3-VL-8BTemperature=02026.05 | 9.5 | |
| ThymeTemperature=0, Max tool invocations=102026.05 | 2 | |
| Bagel-Zebra-CoTTemperature=0, Max image generations=102026.05 | 1.5 | |
| DeepEyesV2Temperature=0, Max tool invocations=102026.05 | 0 |