Embodied Task Planning on VoTa-Bench 1.0 (Unseen) benchmark leaderboard · SOTA2 Research

Embodied Task Planning on VoTa-Bench 1.0 (Unseen)

82.27Examine&Light SRD2PO

Evaluation Results

Method	Links
D2PO2025.03		82.27	66.47	64.47	55.34	7.14	5.69	53.1	51.52	58.09	57.59	57.8	55.79	57.59	52.27
D2PO2025.03		77.3	62.67	56.58	49.56	11.43	8.66	55.75	55.75	72.79	72.79	68.81	68.51	61.46	57.16
D2PO2025.03		77.3	58.98	60.53	49.3	14.29	10.38	60.18	60.18	69.12	68.9	65.14	64.46	61.61	55.78
DPO2025.03		75.89	51.53	60.53	45.25	7.14	4.62	56.64	56.21	65.44	64.61	63.3	63.12	58.82	51.23
DPO2025.03		74.47	61.4	64.47	54.16	7.14	5.63	45.13	43.76	51.47	50.33	53.21	51.41	52.32	47.39
DPO2025.03		73.76	60.17	53.95	46.95	7.14	5.15	52.21	52.21	66.18	66.18	66.97	66.97	57.59	53.65
LLaMA-3.2 (11B)2025.03		70.92	58.75	53.95	46.25	7.14	4.61	51.33	50.02	47.06	46.85	52.29	50.81	50.31	46.02
Qwen2-VL (7B)2025.03		68.79	56.93	52.63	44.46	4.29	2.61	43.36	43.37	62.5	62.29	49.54	47.38	50.77	46.7
LLaVA-1.6 (7B)2025.03		64.54	52.41	57.89	51.39	4.29	3	42.48	41.61	56.62	56.16	44.04	43.51	48.14	44.33
Qwen2-VL (7B)2025.03		26.95	12.2	3.95	1.69	0	0	0	0	0	0	0	0	6.35	2.86
Qwen2-VL (7B)2025.03		25.53	9.34	15.79	9.58	0	0	0	0	0	0	0	0	7.43	3.18
LLaMA-3.2 (11B)2025.03		12.06	2.1	0	0	0	0	0	0	0	0	0	0	2.63	0.46
LLaMA-3.2 (11B)2025.03		9.22	1.48	5.26	0.83	0	0	0	0	0	0	0	0	2.63	0.42
LLaVA-1.6 (7B)2025.03		4.26	0.77	6.58	1.14	0	0	0	0	0	0	0	0	1.7	0.3
LLaVA-1.6 (7B)2025.03		2.84	0.45	2.63	1.07	0	0	0	0	0	0	0	0	0.93	0.23