Geometry Problem Solving on Geometry3K (test)
95.2Choice AccuracyBiNSGPS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BiNSGPSBase Model=Qwen3-VL-Plus, Solver Type=Neural-Symbolic Solvers2026.06 | 95.2 | 90.5 | — | |
| Human Expert2023.02 | 90.9 | — | — | |
| SD-GPSType=Symbolic and Neuro-symbolic Solver2026.06 | 90.4 | 86.4 | — | |
| BiNSGPSBase Model=Qwen3-VL-32B, Solver Type=Neural-Symbolic Solvers2026.06 | 90.3 | 87 | — | |
| Kimi-K2.5Type=MLLM2026.06 | 87.2 | 82.9 | — | |
| GPT-5.2Solver Type=MLLMs2026.06 | 84.5 | 77.9 | — | |
| LANSModel Type=Neural Solver2025.05 | 82.3 | 7,130 | — | |
| LANSSolver Type=Neural Solvers2026.06 | 82.3 | 72.1 | — | |
| LANSType=Neural Solver, Diagram GT=true2026.06 | 82.3 | 72.1 | — | |
| AutoGPSAgent Backbone=GPT-4o2025.05 | 81.6 | 7,540 | — | |
| AutoGPSBase Model=GPT-4o, Solver Type=Neural-Symbolic Solvers2026.06 | 81.6 | 75.4 | — | |
| Auto-GPSType=Symbolic and Neuro-symbolic Solver2026.06 | 81.6 | 75.4 | — | |
| AutoGPSBase Model=Qwen3-VL-Plus, Solver Type=Neural-Symbolic Solvers2026.06 | 81.1 | 74.8 | — | |
| AutoGPSAgent Backbone=Qwen2.52025.05 | 78.2 | 7,100 | — | |
| PGPSNet2023.02 | 77.9 | 65 | 80.7 | |
| PGPSNetModel Type=Neural Solver2025.05 | 77.9 | 6,500 | — | |
| PGPSNetSolver Type=Neural Solvers2026.06 | 77.9 | 65.2 | — | |
| PGPSNetType=Neural Solver2026.06 | 77.9 | 65 | — | |
| Pi-GPSSolver Type=Neural-Symbolic Solvers2026.06 | 77.8 | 70.6 | — | |
| Pi-GPSType=Symbolic and Neuro-symbolic Solver2026.06 | 77.8 | 70.6 | — | |
| AutoGPSAgent Backbone=InternVL32025.05 | 77.6 | 7,020 | — | |
| PGPSNet-v2-SType=Neural Solver2026.06 | 76.4 | 65.2 | — | |
| InterGPS (All GT)Input Mode=ground truth text and diagram, re-produced=true2023.02 | 75.9 | 69 | — | |
| Auto-GPSType=Symbolic and Neuro-symbolic Solver, OCR=true2026.06 | 75.2 | 65.6 | — | |
| InternVL3-78BModel Type=MLLM2025.05 | 74.5 | 5,740 | — | |
| InternVL3-78BSolver Type=MLLMs2026.06 | 74.5 | 57.4 | — | |
| InternVL3-78BType=MLLM2026.06 | 74.5 | 57.4 | — | |
| Pi-GPSType=Symbolic and Neuro-symbolic Solver, OCR=true2026.06 | 73.1 | 66.1 | — | |
| InterGPS (Diagram GT)Input Mode=text parser and ground truth diagram, re-produced=true2023.02 | 71.7 | 64.2 | — | |
| GOLDGround Truth diagram annotations=true2024.05 | 69.1 | — | — | |
| GeoDRLModel Type=Symbolic Solver2025.05 | 68.4 | — | — | |
| GeoDRLSolver Type=Symbolic Solvers2026.06 | 68.4 | — | — | |
| GeoDRLType=Symbolic and Neuro-symbolic Solver2026.06 | 68.4 | 57.9 | — | |
| E-GPSModel Type=Symbolic Solver2025.05 | 67.9 | — | — | |
| E-GPSSolver Type=Symbolic Solvers2026.06 | 67.9 | — | — | |
| E-GPSType=Symbolic and Neuro-symbolic Solver2026.06 | 67.9 | — | — | |
| Qwen2.5-VL-32BModel Type=MLLM2025.05 | 67.6 | 4,190 | — | |
| Qwen2.5-VL-32BType=MLLM2026.06 | 67.6 | 41.9 | — | |
| Qwen3-VL-PlusSolver Type=MLLMs2026.06 | 67.4 | 59.8 | — | |
| GLM-4.6VType=MLLM2026.06 | 65.3 | 53.7 | — | |
| PGPSNetGround Truth diagram annotations=true2024.05 | 65 | — | — | |
| InterGPSGround Truth diagram annotations=true2024.05 | 64.2 | — | — | |
| InterGPSModel Type=Symbolic Solver2025.05 | 63.5 | 5,060 | — | |
| InterGPSSolver Type=Symbolic Solvers2026.06 | 63.5 | 50.6 | — | |
| GOLDGround Truth diagram annotations=false2024.05 | 62.7 | — | — | |
| GOLDType=Neural Solver2026.06 | 62.7 | — | — | |
| InternVL2.5-78BModel Type=MLLM2025.05 | 60.9 | 3,610 | — | |
| InternVL2.5-78BSolver Type=MLLMs2026.06 | 60.9 | 36.1 | — | |
| InternVL2.5-78BType=MLLM2026.06 | 60.9 | 36.1 | — | |
| PGPSNetGround Truth diagram annotations=false2024.05 | 59.5 | — | — | |
| Geoformerre-implemented=true2023.02 | 59.3 | 36.8 | 62.5 | |
| GeoformerModel Type=Neural Solver2025.05 | 59.3 | 3,680 | — | |
| GeoformerSolver Type=Neural Solvers2026.06 | 59.3 | 36.8 | — | |
| GeoformerType=Neural Solver2026.06 | 59.3 | 36.8 | — | |
| NGSre-implemented=true2023.02 | 58.8 | 35.3 | 62 | |
| NGSModel Type=Neural Solver2025.05 | 58.8 | 3,530 | — | |
| NGSSolver Type=Neural Solvers2026.06 | 58.8 | 35.3 | — | |
| NGSType=Neural Solver2026.06 | 58.8 | 35.3 | — | |
| Qwen2.5-VL-32BSolver Type=MLLMs2026.06 | 58.6 | 46.3 | — | |
| GPT-4oType=MLLM2026.06 | 58.6 | 34.8 | — | |
| Inter-GPSType=Symbolic and Neuro-symbolic Solver2026.06 | 57.5 | 43.4 | — | |
| Vision-R1-7BModel Type=MLLM2025.05 | 57.1 | 4,380 | — | |
| GPT-4oModel Type=MLLM2025.05 | 57.1 | 4,630 | — | |
| Vision-R1-7BSolver Type=MLLMs2026.06 | 57.1 | 43.8 | — | |
| GPT-4oSolver Type=MLLMs2026.06 | 57.1 | 46.3 | — | |
| Vision-R1-7BType=MLLM2026.06 | 57.1 | 43.8 | — | |
| InterGPS (Predict)Input Mode=diagram and text formal language are predicted, re-produced=true2023.02 | 56.9 | 44.6 | — | |
| GNSBase Model=LLaVA-1.5-13B, Solver Type=Neural-Symbolic Solvers2026.06 | 53.8 | — | — | |
| QwenVL3-2BType=MLLM2026.06 | 52.5 | 36.6 | — | |
| Qwen3-VL-7BSolver Type=MLLMs2026.06 | 50.1 | 44.8 | — | |
| InterGPSGround Truth diagram annotations=false2024.05 | 48.6 | — | — | |
| GeoformerGround Truth diagram annotations=false2024.05 | 36.8 | — | — | |
| Baseline (Neural Solver)2023.02 | 35.9 | — | — | |
| NGSGround Truth diagram annotations=false2024.05 | 35.3 | — | — | |
| G-LLaVA-13BModel Type=MLLM2025.05 | 29 | 30 | — | |
| G-LLaVA-13BType=MLLM2026.06 | 29 | 0.3 | — | |
| SCA-GPSType=Neural Solver2026.06 | — | 76.7 | — |