Visual Planning on FrozenLake (Levels 3-8) benchmark leaderboard · SOTA2 Research

Visual Planning on FrozenLake (Levels 3-8)

100Success Rate (Level 3)Gemini-3-Flash

Evaluation Results

Method	Links
Gemini-3-Flash2026.06		100	100	99	96	84	97	96
Gemini-2.5-Pro2026.06		99	97	81	46	44	48	69.2
Qwen3-VL-32B-Thinking2026.06		98	79	59	35	28	21	53.3
Kimi-K2.52026.06		93	77	75	54	48	51	66.3
GPT-52026.06		92	65	53	30	38	32	51.7
Gemini-2.5-Flash2026.06		92	91	74	58	37	33	64.2
Symbolic-Input Qwen3-VL-8B2026.06		82	72	65	39	43	46	57.8
Symbolic-Input Qwen3-VL-4B2026.06		79	62	51	40	28	26	47.7
MGSD-8B2026.06		78	61	58	39	35	40	51.8
Qwen3-VL-235B-A22B-Instruct2026.06		77	56	44	20	20	18	39.2
MGSD-4B2026.06		76	56	60	27	27	24	45
GPT-4o2026.06		61	38	28	15	12	13	27.8
Claude-4.5-Haiku2026.06		49	41	29	17	10	6	25.3
Qwen3-VL-8B-Instruct2026.06		42	30	27	18	16	13	24.3
Qwen3-VL-4B-Instruct2026.06		33	29	19	5	3	5	15.7
InternVL3-8B2026.06		30	18	14	10	7	9	14.7
Qwen2.5-VL-7B-Instruct2026.06		18	18	11	8	7	6	11.3
Qwen2.5-VL-3B-Instruct2026.06		14	8	11	7	4	4	8
LLaVA-OneVision-7B2026.06		13	8	4	3	3	1	5.3