Maze Traversal on 10x10 Mazes (10 runs)
10Correct Count (out of 10)gpt-4.1
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| gpt-4.1Tools=True2026.04 | 10 | 100 | 127.299 | 21.4 | |
| gpt-4.1-miniTools=True2026.04 | 10 | 100 | 513.433 | 26.5 | |
| o3-miniTools=False2026.04 | 10 | 100 | 46.548 | — | |
| o4-miniTools=False2026.04 | 10 | 100 | 43.007 | — | |
| gpt-4o-miniTools=True2026.04 | 8 | 80 | 144.971 | 22.125 | |
| gpt-4oTools=True2026.04 | 6 | 60 | 135.196 | 15.1 | |
| gpt-4oTools=False2026.04 | 1 | 10 | 14.159 | — | |
| gpt-4.1Tools=False2026.04 | 1 | 10 | 13.06 | — | |
| gpt-4o-miniTools=False2026.04 | 0 | 0 | 27.541 | — | |
| gpt-4.1-miniTools=False2026.04 | 0 | 0 | 72.22 | — | |
| gpt-4.1-nanoTools=True2026.04 | 0 | 0 | 277.074 | 16.2 | |
| gpt-4.1-nanoTools=False2026.04 | 0 | 0 | 13.013 | — |