Reasoning on BOOTCAMP-EVAL
60.2Graphical PuzzlesQwen2.5-32B-Instruct
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5-32B-Instructtraining=Bootcamp-SFT2025.08 | 60.2 | 55.4 | 61.5 | 56 | 60.3 | 87.7 | 56.6 | 69.3 | 61.1 | |
| Qwen2.5-32B-Instructtraining=Bootcamp-SFT-RL2025.08 | 52.4 | 61.3 | 64.1 | 47.5 | 63.7 | 87.5 | 44.4 | 77.3 | 59.5 | |
| Qwen3-235B-A22B2025.08 | 49.5 | 55.8 | 54.5 | 54 | 56.9 | 81.3 | 49.1 | 56.3 | 54.5 | |
| DeepSeek-R1-05282025.08 | 47.2 | 46.6 | 50.9 | 61.1 | 57 | 75.7 | 45.8 | 67.7 | 51 | |
| Qwen3-32B2025.08 | 45.9 | 53.7 | 53.7 | 45.8 | 56.4 | 81.5 | 51.5 | 39.7 | 52.1 | |
| QwQ-32B2025.08 | 45.2 | 53.8 | 56.7 | 37.6 | 60.4 | 72.5 | 42.3 | 44.7 | 51.4 | |
| DS-R1-Distilled-Qwen-32Btraining=Bootcamp-RL2025.08 | 41.8 | 61.3 | 70.4 | 36.7 | 70.6 | 80.8 | 45.1 | 52 | 55.7 | |
| DeepSeek-V3-03242025.08 | 33 | 57.4 | 50.4 | 36.2 | 50.7 | 75.2 | 46.8 | 37 | 46.5 | |
| DS-R1-Distilled-Qwen-32B2025.08 | 31.5 | 20.3 | 49.8 | 25.4 | 32.8 | 52 | 27.7 | 25 | 31.5 | |
| Qwen2.5-32B-Instructtraining=Bootcamp-RL2025.08 | 25.7 | 60.1 | 67.4 | 18.5 | 36.8 | 59.5 | 48.4 | 72 | 46.9 | |
| Qwen2.5-32B-Instruct2025.08 | 13.4 | 30.4 | 43.3 | 12.4 | 10.9 | 24.2 | 29.9 | 10 | 24.4 |