Algorithm Reinvention Test Suite
80.9Average RSRQwen3-4B-Thinking-2507
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-4B-Thinking-2507Hint Level=level 22026.04 | 80.9 | 100 | 100 | 100 | 92.2 | 98.4 | 100 | 100 | 100 | 18 | 0 | |
| Qwen3-4B-Thinking-2507Hint Level=level 12026.04 | 48.5 | 60.9 | 87.5 | 0 | 64.8 | 83.6 | 80.5 | 97.7 | 0 | 10.2 | 0 | |
| Qwen3-4B-Instruct-2507Hint Level=level 22026.04 | 30.6 | 0.8 | 25.8 | 46.1 | 54.7 | 80.3 | 89.1 | 7.8 | 1.6 | 0 | 0 | |
| Ministral-3-14B-Reasoning-2512Hint Level=level 22026.04 | 26.5 | 3.2 | 33.9 | 53.9 | 19.6 | 92.2 | 46.9 | 5.5 | 9.6 | 0 | 0 | |
| Qwen3-4B-Thinking-2507Hint Level=no hint2026.04 | 21.8 | 70.3 | 0 | 0 | 15.6 | 22.7 | 44.5 | 64.8 | 0 | 0 | 0 | |
| Ministral-3-14B-Reasoning-2512Hint Level=level 12026.04 | 15.6 | 0 | 3.1 | 34.5 | 23.4 | 69.9 | 18 | 6.2 | 0.8 | 0 | 0 | |
| Qwen3-4B-Instruct-2507Hint Level=level 12026.04 | 9.2 | 0.8 | 15.6 | 0 | 36.7 | 14.1 | 22.7 | 2.3 | 0 | 0 | 0 | |
| Ministral-3-14B-Reasoning-2512Hint Level=no hint2026.04 | 3.9 | 3.9 | 1.6 | 19.5 | 3.9 | 1.6 | 3.1 | 5.5 | 0 | 0 | 0 | |
| Qwen3-4B-Instruct-2507Hint Level=no hint2026.04 | 0.2 | 0.8 | 0 | 0 | 0 | 0 | 0 | 1.6 | 0 | 0 | 0 |