List your company

Spatial Understanding on SpatialScore OpenSource Subset

87.66Overall ScoreHuman-level
22.45239.38156.3173.239May 22, 2025

Evaluation results

MethodLinks
Human-level2025.0587.6696.8789.7281.4992.1584.0590.3475.5892.9989.4184.19
GPT-52025.0559.0978.0857.5956.3354.0456.8570.9742.2267.0747.2962.13
Gemini-2.5-Pro2025.0556.773.3864.0651.0646.4154.769.8943.8364.6345.5756.25
Qwen3-VL-235B-A22B2025.0554.8257.2765.1952.8452.4756.8566.944.2867.3838.4249.63
Qwen3-VL-32B2025.0551.8643.461.1651.1850.2257.8167.1346.4761.2834.7347.79
Qwen3-VL-8BAgent Core=SpatialAgent, Paradigm=ReAct2025.0550.0144.353.4951.5545.7451.3958.6237.9257.6251.9751.84
Qwen3-VL-8BAgent Core=SpatialAgent, Paradigm=Plan-Execute (PE)2025.0549.5850.1154.4850.9943.554.8462.338.4358.2340.6443.38
Qwen3-VL-8BTraining Data=SpatialCorpus2025.0548.7257.2752.6758.5936.7749.8455.440.5154.8837.9344.85
Qwen3-VL-30B-A3B2025.0548.646.3158.8645.0647.9853.8761.3833.6556.140.3945.59
InternVL3-78B2025.0548.2350.3459.1944.4645.7444.7865.9835.7457.3237.9343.75
Qwen3-VL-4BTraining Data=SpatialCorpus2025.0546.7465.5552.2453.8733.8634.5252.1837.2755.4940.8944.85
Qwen3-VL-4BAgent Core=SpatialAgent, Paradigm=ReAct2025.0546.4946.5353.4647.3639.0145.1554.4831.8653.0554.9342.28
Qwen2.5-VL-72B2025.0545.4453.6949.4955.8836.147.2160.9232.1353.9637.9322.43
Qwen3-VL-4BAgent Core=SpatialAgent, Paradigm=Plan-Execute (PE)2025.0545.2856.1554.9842.436.5550.0558.8528.9257.3231.5338.24
Claude-4.5-Sonnet2025.0544.6451.0149.6748.3239.9150.0250.5736.3153.3527.5941.18
Qwen3-VL-8BMode=Zero-shot2025.0542.9738.2650.3543.5837.6748.6155.8631.4551.5234.4841.54
Qwen3-VL-4BMode=Zero-shot2025.0540.3937.8148.2236.8134.7543.754.7126.9250.6135.9638.24
Qwen3-VL-8BMode=Blind (text only)2025.0527.8121.717.2127.7130.4939.3841.6126.3319.2126.1120.59
Chance-level (Random)2025.0526.1223.7122.820.1931.8424.7634.9421.8325.326.628.68
Qwen3-VL-4BMode=Blind (text only)2025.0524.9627.2911.225.6325.3437.2927.8222.7423.1722.6620.22