Embodied Spatial Reasoning on S3-Eval (real part) benchmark leaderboard · SOTA2 Research

Embodied Spatial Reasoning on S3-Eval (real part)

82.1Overall ScoreHuman level

Evaluation Results

Method	Links
Human level2026.03		82.1	69.1	90.8	69.1	74.7	91.5	68.5	77.5	91.9	91.3	95.6	75.8	69.1	74.3	91.9	96.1
AMF-VLM2026.03		57.8	41	37	48.2	50.1	71.8	45.1	77.5	75.5	59.7	44.5	49.7	70.9	64	64.4	72
cambrian-s2026.03		51	38.4	33	41.9	44.7	65.1	38.8	55.2	70.9	54.8	48.2	45.4	58.2	59.3	54.8	56.2
streaming-vlm2026.03		49.1	35.2	30.4	38.6	41.3	62.3	35.5	51.9	67.4	51.9	46.1	42.9	54.4	61.8	52.6	64.8
cambrian-s2026.03		45.1	39.8	34.7	25.3	45	65.9	40.4	32.3	69.9	46.7	44.4	34.9	60.8	43.2	37.2	64.8
vlm-3r2026.03		42.1	34.1	28.5	30	33.9	53	30.4	39	59.2	48.1	44.4	41	42.8	52.5	45.8	51
GPT-4o2026.03		41.7	28.1	29.8	31.5	25.8	59.3	25.5	39.5	61.8	51.4	44.7	48.2	27.8	54.7	52.2	49.5
InternVL2-26B2026.03		41.3	35.8	29.1	30.6	32.5	56.8	32.7	19.4	58.6	49.2	53.2	42.9	22.8	55	50.6	50.1
InternVL2-8B2026.03		40.5	19.7	27.8	37.5	35	53.8	26.6	38.6	58	47.6	44.3	43.9	24.6	55.2	50.4	42.5
Gemini-1.5-pro2026.03		40.4	20.8	22.7	22.9	39.9	45.2	36.7	29.8	69.5	46.7	44.1	49.5	53	41.5	59.1	37.4
Qwen2-VL-7B2026.03		39	25.3	27.7	27.6	23.7	57.3	22.1	36.1	59.8	49.3	41.6	48.5	25	51.9	50	47.3
Gemini-1.5-flash2026.03		38.2	24.6	27.2	26.7	22.9	56.3	21.9	36.2	57.2	48.2	41.6	47.2	23.1	51.4	48.9	46.6
Qwen2-VL-72B2026.03		37.3	34.1	25.2	38.1	28.2	53	35.6	29.6	57.5	42.9	54.1	46.2	21.9	48.3	28.5	6.3
InternVL2-1B2026.03		36.2	20.5	36.6	17.8	21.8	51.2	13.6	39.1	62.3	45.5	44.2	33.7	20.9	52.2	47	36.1
llava-video2026.03		34.9	14.8	33.1	11.5	21.2	52.3	18.6	32.6	63.4	46.9	44	18.2	17.9	51.3	49.3	38.4
llava-ov-1.5-72B2026.03		34.2	17.3	27.1	21.1	31.1	49.6	24.3	38.4	53.7	44.3	41.2	19.6	18.3	36.6	44.6	32.8
llava-ov-1.5-7B2026.03		30.1	1.7	29.1	23.8	11.8	44	0.6	61.4	45.5	39.6	44.5	22.1	3.8	42.1	41.2	24.8
Qwen2-VL-2B2026.03		29.9	23.9	21.9	29	28.2	39.5	18.1	30.7	31.7	25.3	28.4	37.7	25	49.5	26.6	46
Frequent2026.03		29	25.3	25.8	32.6	34	25.9	33.5	24.1	25.9	26.1	33.7	11	29.5	37.5	26.9	26.8
Random2026.03		26.1	—	23.1	—	—	25.2	—	—	25.1	24.6	34.4	—	—	—	24.5	23.5