List your company
ResearchFormerly WizWand

Geometric Perception on GePBench 1.0 (Overall)

99.3Average ScoreHuman
22.02842.08962.1582.211Dec 30, 2024
Updated 4mo ago

Evaluation results

MethodLinks
HumanModel Size (Parameters)=-, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1299.3
Qwen3.5Model Size (Parameters)=397B-A17B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1279.2
Qwen3-VLModel Size (Parameters)=235B-A22B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1278.8
Gemini-2.5-proModel Size (Parameters)=-, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1278.6
Qwen3.5Model Size (Parameters)=9B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1271.2
GPT-5.2Model Size (Parameters)=-, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1271
InternVL3Model Size (Parameters)=78B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1271
Qwen3-VLModel Size (Parameters)=8B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1267.8
InternVL2.5Model Size (Parameters)=78B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1267.7
Qwen2.5-VLModel Size (Parameters)=72B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1266
Qwen2-VLModel Size (Parameters)=72B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1265.3
InternVL3Model Size (Parameters)=8B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1264
LLaVA-OneVisionModel Size (Parameters)=72B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1263.6
GPT-4oModel Size (Parameters)=-, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1263.2
Qwen2.5-VLModel Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1262.4
Qwen2-VLModel Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1258.6
MiniCPM-V-2.6Model Size (Parameters)=8B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1257.9
QVQ-previewModel Size (Parameters)=72B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1257
InternVL2.5Model Size (Parameters)=8B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1255.9
LLaVA-OneVisionModel Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1255.8
LLaMA-3.2-VisionModel Size (Parameters)=90B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1255.4
GLM-4VModel Size (Parameters)=9B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1252.8
Mantis-Idefics2Model Size (Parameters)=8B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1247.7
mPLUG-Owl3Model Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1247.5
Math-PUMAModel Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1244.3
LLaVA-1.5Model Size (Parameters)=13B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1239.1
Math-LLaVAModel Size (Parameters)=13B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1238.2
LLaVA-1.5Model Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1237.1
BLIP2Model Size (Parameters)=3B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1233.9
InstructBLIPModel Size (Parameters)=3B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1233.5
G-LLaVAModel Size (Parameters)=13B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1229.2
MiniGPTv2Model Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1228.9
G-LLaVAModel Size (Parameters)=7B, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1226.5
Random guessingModel Size (Parameters)=-, Zero-shot manner=true, Temperature=0, Image Resolution=640x6402024.1225