Geometric Perception on GePBench 1.0 (Hard)
99.3ExistenceHuman
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| HumanModel Size (Parameters)=-, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 99.3 | 99.7 | 98.9 | 98.5 | 99.8 | 98.8 | |
| GPT-5.2Model Size (Parameters)=-, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 81 | 72.1 | 26 | 74.1 | 73.1 | 75.5 | |
| Qwen3-VLModel Size (Parameters)=235B-A22B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 79.5 | 73.1 | 64.4 | 83 | 79.7 | 79.7 | |
| Qwen3.5Model Size (Parameters)=397B-A17B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 74.9 | 72.1 | 85.3 | 83 | 77.5 | 69.9 | |
| InternVL3Model Size (Parameters)=8B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 73.8 | 56.2 | 31.6 | 71 | 75.3 | 53.8 | |
| GPT-4oModel Size (Parameters)=-, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 73.3 | 63.5 | 18.1 | 65.2 | 74.2 | 65 | |
| InternVL3Model Size (Parameters)=78B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 73.3 | 66.3 | 48 | 75.9 | 81.3 | 68.5 | |
| Qwen2.5-VLModel Size (Parameters)=72B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 71.3 | 66.3 | 30.5 | 69.6 | 79.1 | 68.5 | |
| InternVL2.5Model Size (Parameters)=78B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 71.3 | 66.3 | 30.5 | 69.6 | 79.1 | 68.5 | |
| Gemini-2.5-proModel Size (Parameters)=-, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 70.8 | 75 | 78.5 | 76.8 | 72 | 86 | |
| Qwen3.5Model Size (Parameters)=9B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 70.8 | 73.1 | 32.8 | 80.4 | 83.5 | 80.4 | |
| Qwen2-VLModel Size (Parameters)=72B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 69.2 | 65.9 | 17.5 | 76.8 | 76.9 | 65.7 | |
| Qwen3-VLModel Size (Parameters)=8B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 69.2 | 66.8 | 29.4 | 73.7 | 80.2 | 70.6 | |
| LLaVA-OneVisionModel Size (Parameters)=72B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 68.7 | 58.2 | 24.3 | 66.1 | 75.8 | 62.9 | |
| QVQ-previewModel Size (Parameters)=72B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 67.2 | 65.9 | 31.1 | 53.6 | 59.9 | 53.1 | |
| Qwen2.5-VLModel Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 66.7 | 61.1 | 21.5 | 71 | 70.9 | 56.6 | |
| MiniCPM-V-2.6Model Size (Parameters)=8B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 65.1 | 56.2 | 30.5 | 55.4 | 68.1 | 55.2 | |
| Qwen2-VLModel Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 65.1 | 61.1 | 11.9 | 53.6 | 73.6 | 53.8 | |
| InternVL2.5Model Size (Parameters)=8B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 62.6 | 58.7 | 14.1 | 59.8 | 58.8 | 67.8 | |
| LLaMA-3.2-VisionModel Size (Parameters)=90B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 60 | 54.8 | 16.9 | 51.8 | 67.6 | 65 | |
| LLaVA-OneVisionModel Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 60 | 56.7 | 23.7 | 54 | 57.7 | 53.1 | |
| mPLUG-Owl3Model Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 57.4 | 51.4 | 22.6 | 31.2 | 54.9 | 51 | |
| Mantis-Idefics2Model Size (Parameters)=8B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 55.9 | 47.1 | 14.7 | 41.5 | 58.2 | 46.2 | |
| GLM-4VModel Size (Parameters)=9B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 53.3 | 51.4 | 13.6 | 53.1 | 69.8 | 45.5 | |
| Math-LLaVAModel Size (Parameters)=13B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 46.2 | 21.2 | 19.2 | 34.4 | 47.3 | 42 | |
| Math-PUMAModel Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 45.1 | 33.7 | 27.7 | 28.6 | 60.4 | 49.7 | |
| InstructBLIPModel Size (Parameters)=3B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 42.1 | 23.6 | 17.5 | 25.9 | 42.9 | 37.1 | |
| LLaVA-1.5Model Size (Parameters)=13B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 42.1 | 30.3 | 15.3 | 39.3 | 44 | 48.3 | |
| BLIP2Model Size (Parameters)=3B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 41 | 15.9 | 34.5 | 25 | 37.9 | 44.1 | |
| LLaVA-1.5Model Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 32.8 | 25.5 | 22 | 32.1 | 38.5 | 50.3 | |
| G-LLaVAModel Size (Parameters)=13B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 29.2 | 26.9 | 26.6 | 25.9 | 34.1 | 25.2 | |
| MiniGPTv2Model Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 28.2 | 32.2 | 26 | 26.3 | 25.8 | 28.7 | |
| Random guessingModel Size (Parameters)=-, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 25 | 25 | 25 | 25 | 25 | 25 | |
| G-LLaVAModel Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.12 | 22.1 | 20.7 | 32.2 | 27.2 | 24.2 | 27.3 |