Task Completion on L-IVA 1.0 (test) benchmark leaderboard · SOTA2 Research

Task Completion on L-IVA 1.0 (test)

73.8Task Success Rate - KitORCA

Evaluation Results

Method	Links
ORCA2025.12		73.8	58.4	80.4	81.5	61	71	3.53	3.68	3.93	3.77	3.67	3.72	64	70	54	63	70	64
Open-Loop2025.12		72.3	72.3	72.7	46.2	47.9	62.3	3.57	3.5	3.27	2.92	2.6	3.17	57	72	53	64	65	62
VAGEN2025.12		70.8	63.6	61.1	60	50.4	61.2	3.56	3.59	3.67	2.54	2.73	3.22	64	63	59	58	68	62
Reactive2025.12		56.7	58.7	45.8	55	38.1	50.9	3.47	3.05	3.13	3.08	2.8	3.11	53	56	41	61	63	55