Geometry Problem Solving on PGPS9K (test)
92.7Choice AccuracyBiNSGPS
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BiNSGPSBase Model=Qwen3-VL-Plus, Solver Type=Neural-Symbolic Solvers2026.06 | 92.7 | 90.1 | — | — | |
| BiNSGPSBase Model=Qwen3-VL-32B, Solver Type=Neural-Symbolic Solvers2026.06 | 89.2 | 87.6 | — | — | |
| SD-GPSType=Symbolic and Neuro-symbolic Solver2026.06 | 84.5 | 79.8 | — | — | |
| AutoGPSBase Model=Qwen3-VL-Plus, Solver Type=Neural-Symbolic Solvers2026.06 | 81.8 | 75.7 | — | — | |
| AutoGPSAgent Backbone=GPT-4o2025.05 | 81.5 | 75.3 | — | — | |
| AutoGPSBase Model=GPT-4o, Solver Type=Neural-Symbolic Solvers2026.06 | 81.5 | 75.3 | — | — | |
| Auto-GPSType=Symbolic and Neuro-symbolic Solver2026.06 | 81.5 | 75.4 | — | — | |
| Kimi-K2.5Type=MLLM2026.06 | 79.8 | 73 | — | — | |
| AutoGPSAgent Backbone=InternVL32025.05 | 79.2 | 72.3 | — | — | |
| GPT-5.2Solver Type=MLLMs2026.06 | 78.1 | 72.5 | — | — | |
| AutoGPSAgent Backbone=Qwen2.52025.05 | 78 | 70.7 | — | — | |
| LANSSolver Type=Neural Solvers2026.06 | 74 | 66.7 | — | — | |
| LANSType=Neural Solver, Diagram GT=true2026.06 | 74 | 66.7 | — | — | |
| LANSModel Type=Neural Solver2025.05 | 73.8 | 66.1 | — | — | |
| Qwen3-VL-PlusSolver Type=MLLMs2026.06 | 72.2 | 58.4 | — | — | |
| Auto-GPSType=Symbolic and Neuro-symbolic Solver, OCR=true2026.06 | 71.9 | 62.9 | — | — | |
| PGPSNet2023.02 | 70.4 | 62.7 | 79.5 | — | |
| PGPSNetModel Type=Neural Solver2025.05 | 70.4 | 62.7 | — | — | |
| PGPSNetType=Neural Solver2026.06 | 70.4 | 62.7 | — | — | |
| Pi-GPSSolver Type=Neural-Symbolic Solvers2026.06 | 69.8 | 61.4 | — | — | |
| Pi-GPSType=Symbolic and Neuro-symbolic Solver2026.06 | 69.8 | 61.4 | — | — | |
| PGPSNetSolver Type=Neural Solvers2026.06 | 69.4 | 62.7 | — | — | |
| PGPSNet-v2-SType=Neural Solver2026.06 | 69.2 | 60.3 | — | — | |
| InterGPS (Diagram GT)Input Mode=text parser and ground truth diagram, re-produced=true2023.02 | 68 | 59.8 | — | — | |
| GeoDRLType=Symbolic and Neuro-symbolic Solver2026.06 | 66.7 | 55.6 | — | — | |
| InterGPSModel Type=Symbolic Solver2025.05 | 66.2 | 57.4 | — | — | |
| InterGPSSolver Type=Symbolic Solvers2026.06 | 66.2 | 57.4 | — | — | |
| Pi-GPSType=Symbolic and Neuro-symbolic Solver, OCR=true2026.06 | 64.2 | 56.3 | — | — | |
| InternVL3-78BModel Type=MLLM2025.05 | 61.1 | 48.9 | — | — | |
| InternVL3-78BSolver Type=MLLMs2026.06 | 61.1 | 48.9 | — | — | |
| InternVL3-78BType=MLLM2026.06 | 61.1 | 48.9 | — | — | |
| GLM-4.6VType=MLLM2026.06 | 60.8 | 47.7 | — | — | |
| GOLDType=Neural Solver2026.06 | 60.6 | — | — | — | |
| GPT-4oType=MLLM2026.06 | 56.8 | 38.2 | — | — | |
| Qwen2.5-VL-32BModel Type=MLLM2025.05 | 56.1 | 43.5 | — | — | |
| Qwen2.5-VL-32BSolver Type=MLLMs2026.06 | 56.1 | 43.5 | — | — | |
| Qwen2.5-VL-32BType=MLLM2026.06 | 56.1 | 43.5 | — | — | |
| InternVL2.5-78BModel Type=MLLM2025.05 | 51.3 | 28.1 | — | — | |
| InternVL2.5-78BSolver Type=MLLMs2026.06 | 51.3 | 28.1 | — | — | |
| InternVL2.5-78BType=MLLM2026.06 | 51.3 | 28.1 | — | — | |
| Vision-R1-7BModel Type=MLLM2025.05 | 49.6 | 36.8 | — | — | |
| Vision-R1-7BSolver Type=MLLMs2026.06 | 49.6 | 36.8 | — | — | |
| Vision-R1-7BType=MLLM2026.06 | 49.6 | 36.8 | — | — | |
| Geoformerre-implemented=true2023.02 | 47.3 | 35.6 | 62.3 | — | |
| GeoformerModel Type=Neural Solver2025.05 | 47.3 | 35.6 | — | — | |
| GeoformerSolver Type=Neural Solvers2026.06 | 47.3 | 35.6 | — | — | |
| GeoformerType=Neural Solver2026.06 | 47.3 | 35.6 | — | — | |
| NGSre-implemented=true2023.02 | 46.1 | 34.1 | 60.9 | — | |
| NGSModel Type=Neural Solver2025.05 | 46.1 | 34.1 | — | — | |
| NGSSolver Type=Neural Solvers2026.06 | 46.1 | 34.1 | — | — | |
| NGSType=Neural Solver2026.06 | 46.1 | 34.1 | — | — | |
| GPT-4oModel Type=MLLM2025.05 | 46 | 37.2 | — | — | |
| GPT-4oSolver Type=MLLMs2026.06 | 46 | 37.2 | — | — | |
| QwenVL3-2BType=MLLM2026.06 | 45.4 | 27.2 | — | — | |
| Qwen3-VL-7BSolver Type=MLLMs2026.06 | 44.9 | 43 | — | — | |
| G-LLaVA-13BModel Type=MLLM2025.05 | 27 | 0 | — | — | |
| G-LLaVA-13BType=MLLM2026.06 | 27 | 0 | — | — | |
| GeoformerGround Truth diagram annotations=false2024.05 | — | — | — | 35.6 | |
| GeoGen-SFT-3BParams=3B, Data Scale=224K2026.06 | — | — | — | 44.7 | |
| GeoGen-SFT-3BParams=3B, Data Scale=224K2026.06 | — | — | — | 44.7 | |
| GeoGen-SFT-7BParams=7B, Data Scale=224K2026.06 | — | — | — | 54.3 | |
| GeoGen-SFT-7BParams=7B, Data Scale=224K2026.06 | — | — | — | 54.3 | |
| GOLDGround Truth diagram annotations=false2024.05 | — | — | — | 60.6 | |
| GOLDGround Truth diagram annotations=true2024.05 | — | — | — | 65.8 | |
| InterGPSGround Truth diagram annotations=false2024.05 | — | — | — | 38.3 | |
| InterGPSGround Truth diagram annotations=true2024.05 | — | — | — | 59.8 | |
| InternVL2.5-8BParams=8B, Data Scale=-2026.06 | — | — | — | 37.4 | |
| NGSGround Truth diagram annotations=false2024.05 | — | — | — | 34.1 | |
| PGPSNetGround Truth diagram annotations=false2024.05 | — | — | — | 58.8 | |
| PGPSNetGround Truth diagram annotations=true2024.05 | — | — | — | 62.7 | |
| Qwen2-VL-7B/8BParams=7B/8B, Data Scale=-2026.06 | — | — | — | 35 | |
| Qwen2.5-VL-7B-InstructParams=7B, Data Scale=-, Training=LoRA fine-tuned, Inference=beam search (num_beams=5, top-1)2026.06 | — | — | — | 42.4 | |
| Qwen2.5-VL-7B-InstructParams=7B2026.06 | — | — | — | 42.4 | |
| VeriGeoParams=7B, Data Scale=8.7k2026.06 | — | — | — | 59.4 | |
| VeriGeo-beam5Params=7B, Data Scale=8.7k, Inference=beam52026.06 | — | — | — | 59.4 | |
| VeriGeo-greedyParams=7B, Data Scale=8.7k, Inference=greedy2026.06 | — | — | — | 56.9 |