Streaming Spatial Reasoning on S3-Eval Sim benchmark leaderboard · SOTA2 Research

Streaming Spatial Reasoning on S3-Eval Sim

80.5Overall AccuracyHuman level

Evaluation Results

Method	Links
Human level2026.03		80.5	71.1	92.6	70.4	70.9	93	71.3	71.7	98.6	92.6	97.1	73.4	70.9	66.1	66	93.5	92.8
AMF-VLM2026.03		62.9	57.6	35	55.6	59.4	70.4	70.8	67.7	75.6	72.8	46.3	67	68.1	70.8	61.8	60.9	60.6
cambrian-s*†2026.03		57.8	52.1	33.5	51.3	53.2	62.4	59.8	62.1	70.5	67.8	45.9	58.4	61.3	64.3	59.2	58.3	58.8
streaming-vlm*2026.03		56	54.9	31	51.8	45.2	58.3	66	60.9	67	65.6	40	59.1	60.1	63.2	55.8	55.2	55
GPT-5.22026.03		44.9	38.4	29.7	37.4	34.6	41.8	35.9	45.5	61.4	58.6	44.4	35.6	44.4	51.5	53.4	49.6	52.7
cambrian-s2026.03		44.8	29.2	22.8	48.1	50.1	37.9	30.3	58.7	50.4	52.5	37.3	58	38.8	43.4	58.1	39.2	56.3
Gemini-3-pro2026.03		43.1	27.1	32.5	47.6	24.2	58.3	24.9	32.2	69.1	59	31.4	53.7	58	36.7	37.8	55.5	37.6
Gemini-3-flash2026.03		41.9	35.6	27.6	34.5	31.5	38.8	32.7	42.3	58.1	55.5	41.5	32.5	41.6	48.5	49.6	46.8	49.6
vlm-3r2026.03		41.9	31.6	27.1	35.2	32.3	40.8	32.5	41.1	56.2	53.6	41.1	41.4	43	49.2	49.1	44.5	47.3
Qwen3-VL-8B2026.03		41.1	36	25.8	34	29.7	39.6	32	41.1	56.7	54.2	40.2	32.5	41.5	48.1	48.8	45.4	49.1
InternVL3.5-8B2026.03		37.7	23.3	25.6	39.9	27.7	42	31.9	34	49.9	45.8	46.7	28.9	42.9	13.8	56.4	43.9	48.9
Qwen3-VL-32B2026.03		37.4	34	27.1	37.8	31.9	37.9	38.5	40	52.2	48.8	50.1	46.8	43.4	1.53	42.9	13.2	40.2
Frequent2026.03		35.6	46.1	26.1	47.6	46.7	26	33	39.3	26.9	27.7	37.1	37.6	35.9	46.5	39.6	26.8	25.8
InternVL3.5-38B2026.03		35.2	43.4	27.1	28.4	27.2	41.5	21.1	37.4	37.9	44.2	52	23.3	36.3	0.16	52.7	39.4	49.4
llava-video2026.03		31.6	7.03	22.8	11.4	29.7	38.4	21.3	15.5	50.6	45.5	46.3	14	29.2	39.2	52.6	35.5	47.1
Qwen3-VL-4B2026.03		30.8	27.5	20.7	35.6	30.2	26.5	27	41	14.8	19.2	26.5	31.4	36.5	43.7	42.1	38.9	31.7
llava-ov-1.5-8B2026.03		28.8	7.89	24.6	16.2	33.8	38.6	26.1	5.73	32.3	41.2	41.7	12.1	31.9	42	31	34.4	44
InternVL3.5-1B2026.03		26.4	17.7	26.1	12.9	11.8	35.9	10.5	22.2	49.2	43.1	43	0.94	20.3	0.22	52.4	31.8	44.3
Random2026.03		25.6	—	21	—	—	29.1	—	—	23.7	22.2	30.7	—	—	—	—	26.2	26.6
llava-ov-1.5-4B2026.03		22.4	5.53	27.4	26.5	16.6	38.1	2.71	2.22	31.6	36.6	39.8	7.32	30.4	0.61	29	29	37.1