Mathematical Problem Solving on John O'Bryan Competition (Overall)
651Total ProblemsDeepSeek-R1 (Teacher)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DeepSeek-R1 (Teacher)2026.06 | 651 | 594 | 91.4 | — | — | — | |
| Qwen2.5-7B Base2026.06 | 651 | 421 | 64.67 | — | — | — | |
| Qwen2.5-7BIterations=1000, Status=overfit2026.06 | 651 | 440 | 67.59 | — | — | — | |
| Qwen2.5-7BIterations=200, Aggregate=mean2026.06 | 651 | — | 69.43 | 70 | 71 | 64.3 | |
| Qwen2.5-7BIterations=200, Seed=422026.06 | 651 | 452 | 69.43 | — | — | — | |
| Qwen2.5-7BIterations=200, Seed=1232026.06 | 651 | 451 | 69.28 | — | — | — | |
| Qwen2.5-7BIterations=200, Seed=2562026.06 | 651 | 452 | 69.43 | — | — | — | |
| Qwen2.5-7BIterations=200, Seed=5122026.06 | 651 | 453 | 69.58 | — | — | — | |
| Qwen2.5-7BIterations=200, Seed=9992026.06 | 651 | 452 | 69.43 | — | — | — |