Geometry Problem Solving on OlympiadBench (BoN@3 Accuracy)
45.69BoN@3 AccuracyGeometryZero-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| GeometryZero-7BModel Size=7B2025.06 | 45.69 | |
| Qwen2.5-7B-Instruct + ToRLModel Size=7B2025.06 | 44.08 | |
| Qwen2.5-7B-Instruct + SFTModel Size=7B2025.06 | 41.93 | |
| Qwen2.5-7B-Instruct + GRPOModel Size=7B2025.06 | 40.32 | |
| Qwen2.5-7B-InstructModel Size=7B2025.06 | 39.24 | |
| GeometryZero-3BModel Size=3B2025.06 | 35.48 | |
| GNS-Llava-1.5-7BModel Size=7B2025.06 | 33.54 | |
| Qwen2.5-3B-Instruct + ToRLModel Size=3B2025.06 | 32.87 | |
| Qwen2.5-3B-InstructModel Size=3B2025.06 | 32.25 | |
| Qwen2.5-3B-Instruct + GRPOModel Size=3B2025.06 | 31.72 | |
| Qwen2.5-3B-Instruct + SFTModel Size=3B2025.06 | 30.64 | |
| G-Llava-7BModel Size=7B2025.06 | 27.82 | |
| GeometryZero-1.5BModel Size=1.5B2025.06 | 16.47 | |
| Qwen2.5-1.5B-Instruct + SFTModel Size=1.5B2025.06 | 14.51 | |
| Qwen2.5-1.5B-Instruct + GRPOModel Size=1.5B2025.06 | 14.51 | |
| Qwen2.5-1.5B-InstructModel Size=1.5B2025.06 | 13.44 | |
| Qwen2.5-1.5B-Instruct + ToRLModel Size=1.5B2025.06 | 11.29 |