List your company

Interactive Planning on ALFRED unseen (val)

67.8Success Rate (SR)Qwen2-VL-72B
4.900821.230437.5653.8896Mar 18, 2024Apr 17, 2024May 18, 2024Jun 18, 2024Jul 18, 2024Aug 18, 2024Sep 18, 2024

Evaluation results

MethodLinks
Qwen2-VL-72BModel Parameters=72B2024.0967.875.8—
Previous SOTA2024.0967.775.3—
Scene-LLMStep-by-step instructions=false2024.0322.3538.8679.63
HLSMStep-by-step instructions=false2024.0318.2831.2470.17
LLM-PlannerStep-by-step instructions=true2024.0315.3629.8868.31
LLM-PlannerStep-by-step instructions=false2024.0312.9225.3555.85
HITUTStep-by-step instructions=false2024.0310.2320.71—
E.T.Step-by-step instructions=true2024.037.3220.87—
FILMStep-by-step instructions=true2024.03——54.93