Geometry Problem Solving on Geometry3K
88.8AccuracyMARS-GPS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MARS-GPSCategory=Ours2026.04 | 88.8 | — | — | |
| LANS (Diagram GT)Category=Neural Methods, trained on the larger PGPS9K dataset=true2026.04 | 82.3 | — | — | |
| GPT-5Decoding=Greedy (τ=0), Normalization=Exact-match, Resolution=224x224, Prompting strategy=Identical prompts2026.02 | 79.03 | — | — | |
| Pi-GPSCategory=Neural-symbolic Methods2026.04 | 77.8 | — | — | |
| Gemini-2.5-ProDecoding=Greedy (τ=0), Normalization=Exact-match, Resolution=224x224, Prompting strategy=Identical prompts2026.02 | 77.04 | — | — | |
| SCA-GPSCategory=Neural Methods2026.04 | 76.7 | — | — | |
| PGPSNet-v2-SCategory=Neural Methods, trained on the larger PGPS9K dataset=true2026.04 | 76.4 | — | — | |
| Claude 4.5 SonnetCategory=Proprietary LLMs2026.04 | 75.8 | — | — | |
| GeometryZero-VL-7BTraining=GCPO2025.06 | 74.68 | — | — | |
| Qwen2.5-VL-7B-Instruct + GRPOTraining=GRPO2025.06 | 73.46 | — | — | |
| GPT-5.2Category=Proprietary LLMs2026.04 | 73.1 | — | — | |
| Qwen2.5-VL-7B-Instruct + ToRLTraining=ToRL2025.06 | 72.39 | — | — | |
| Qwen2.5-VL-7B-Instruct + SFTTraining=SFT2025.06 | 69.54 | — | — | |
| Qwen3-VLModel detail=Qwen3-VL-32B-Thinking, Decoding=Greedy (τ=0), Normalization=Exact-match, Resolution=224x224, Prompting strategy=Identical prompts2026.02 | 68.89 | — | — | |
| GeoDRLCategory=Neural-symbolic Methods2026.04 | 68.4 | — | — | |
| E-GPSCategory=Neural-symbolic Methods2026.04 | 67.9 | — | — | |
| Qwen2.5-VL-7B-InstructBase Model=Qwen2.5-VL-7B-Instruct2025.06 | 65.38 | — | — | |
| GOLDCategory=Neural Methods, trained on the larger PGPS9K dataset=true2026.04 | 62.7 | — | — | |
| GPT-5Category=Proprietary LLMs2026.04 | 61.5 | — | — | |
| Gemini 2Category=MLLMs2026.04 | 60.7 | — | — | |
| GeoformerCategory=Neural Methods2026.04 | 59.3 | — | — | |
| NGSCategory=Neural Methods2026.04 | 58.8 | — | — | |
| GPT-4oCategory=MLLMs2026.04 | 58.6 | — | — | |
| Inter-GPSCategory=Neural-symbolic Methods2026.04 | 57.5 | — | — | |
| Claude 3.5 SonnetCategory=MLLMs2026.04 | 56.4 | — | — | |
| GRPOBase Model=Qwen2.5-VL-7B-Instruct2026.03 | 55.49 | 54.06 | — | |
| GeometryZeroBase Model=Qwen2.5-VL-7B-Instruct2026.03 | 53.72 | 54.07 | — | |
| A²POBase Model=Qwen2.5-VL-7B-Instruct2026.03 | 53.61 | 55.76 | — | |
| ToRLBase Model=Qwen2.5-VL-7B-Instruct2026.03 | 53.5 | 52.92 | — | |
| A²POBase Model=Qwen2.5-VL-3B-Instruct2026.03 | 53.05 | 48.22 | — | |
| GeometryZeroBase Model=Qwen2.5-VL-3B-Instruct2026.03 | 52.72 | 46.35 | — | |
| VAPOModel Scale=7B2025.09 | 51.3 | — | — | |
| GRPOBase Model=Qwen2.5-VL-3B-Instruct2026.03 | 50.72 | 47.01 | — | |
| MM-EurekaModel Scale=7B2025.09 | 50.2 | — | — | |
| PAPOModel Scale=7B, Decoding Strategy=greedy decoding2025.09 | 49.7 | — | — | |
| VL-RethinkerModel Scale=7B2025.09 | 49.6 | — | — | |
| ToRLBase Model=Qwen2.5-VL-3B-Instruct2026.03 | 47.06 | 44.71 | — | |
| SFTBase Model=Qwen2.5-VL-7B-Instruct2026.03 | 46.17 | 49.02 | — | |
| SFTBase Model=Qwen2.5-VL-3B-Instruct2026.03 | 39.4 | 39.56 | — | |
| Base ModelModel Scale=7B2025.09 | 38.5 | — | — | |
| Qwen-VLCategory=MLLMs2026.04 | 26.7 | — | — | |
| G-Llava-7BModel Size=7B2025.06 | — | — | 49.31 | |
| GeometryZero-1.5BModel Size=1.5B2025.06 | — | — | 60.24 | |
| GeometryZero-3BModel Size=3B2025.06 | — | — | 79.25 | |
| GeometryZero-7BModel Size=7B2025.06 | — | — | 78.81 | |
| GNS-Llava-1.5-7BModel Size=7B2025.06 | — | — | 62 | |
| Qwen2.5-1.5B-InstructModel Size=1.5B2025.06 | — | — | 41.76 | |
| Qwen2.5-1.5B-Instruct + GRPOModel Size=1.5B2025.06 | — | — | 53.35 | |
| Qwen2.5-1.5B-Instruct + SFTModel Size=1.5B2025.06 | — | — | 44.25 | |
| Qwen2.5-1.5B-Instruct + ToRLModel Size=1.5B2025.06 | — | — | 57.01 | |
| Qwen2.5-3B-InstructModel Size=3B2025.06 | — | — | 65.83 | |
| Qwen2.5-3B-Instruct + GRPOModel Size=3B2025.06 | — | — | 75.87 | |
| Qwen2.5-3B-Instruct + SFTModel Size=3B2025.06 | — | — | 71.65 | |
| Qwen2.5-3B-Instruct + ToRLModel Size=3B2025.06 | — | — | 76.31 | |
| Qwen2.5-7B-InstructModel Size=7B2025.06 | — | — | 70.99 | |
| Qwen2.5-7B-Instruct + GRPOModel Size=7B2025.06 | — | — | 79.03 | |
| Qwen2.5-7B-Instruct + SFTModel Size=7B2025.06 | — | — | 75.98 | |
| Qwen2.5-7B-Instruct + ToRLModel Size=7B2025.06 | — | — | 78.75 |