Open Vocabulary Mobile Pick and Place on OVMM Home Robot (val)
69.47Find Object Success RateUniLM-Nav
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| UniLM-NavMLLM backend=Gemini-3-Flash-Preview2026.07 | 69.47 | 66.22 | 54.55 | — | 23.77 | 53.5 | |
| UniLM-NavMLLM backend=RoboBrain-2.5-4B2026.07 | 68.97 | 63.05 | 52.38 | — | 19.19 | 50.9 | |
| MoTo2026.07 | 66.67 | 60.95 | 49.87 | — | 20.64 | 49.53 | |
| HomeRobot (RL)Policy type=RL2026.07 | 66.6 | 61.1 | 50.9 | — | 14.8 | 48.3 | |
| UniTeam2026.07 | 66.13 | 62.65 | 54.69 | — | 17.96 | 50.36 | |
| MoManipVLA2026.07 | 66.1 | 62.6 | 53.1 | — | 15.8 | 49.4 | |
| HomeRobot (Heuristic)Policy type=Heuristic2026.07 | 65.4 | 54.8 | 43.7 | — | 7.3 | 42.8 | |
| HELIOSNumber of picks=Unlim.2025.09 | 42.3 | 30.5 | 18.6 | 6.3 | 3.2 | — | |
| HELIOSNumber of picks=52025.09 | 39.2 | 28.7 | 17.4 | 5.8 | 3.1 | — | |
| W/o global search objectiveNumber of picks=Unlim.2025.09 | 29.6 | 22 | 13.2 | 5 | 2.3 | — | |
| HomeRobot H/R/RSkill Configuration (Nav/Gaze/Place)=H/R/R2025.09 | 29.4 | 13.2 | 5.8 | — | 0.5 | — | |
| HomeRobot H/N/HSkill Configuration (Nav/Gaze/Place)=H/N/H2025.09 | 28.7 | 15.2 | 5.3 | — | 0.4 | — | |
| W/o global search objectiveNumber of picks=52025.09 | 27.8 | 21.2 | 12.8 | 4.9 | 2.3 | — | |
| HELIOSNumber of picks=12025.09 | 23.8 | 17.2 | 10 | 3.3 | 2.5 | — | |
| MoManipVLA2025.09 | 23.7 | 12.7 | 7.1 | — | 1.7 | — | |
| HomeRobot R/N/HSkill Configuration (Nav/Gaze/Place)=R/N/H2025.09 | 21.9 | 11.5 | 6 | — | 0.6 | — | |
| Trusting agentNumber of picks=Unlim.2025.09 | 21.9 | 19.3 | 10.8 | 3.3 | 1.8 | — | |
| HomeRobot R/R/RSkill Configuration (Nav/Gaze/Place)=R/R/R2025.09 | 21.7 | 10.2 | 6.2 | — | 0.4 | — | |
| Trusting agentNumber of picks=52025.09 | 20.4 | 18.3 | 10.2 | 3.2 | 1.8 | — | |
| W/o global search objectiveNumber of picks=12025.09 | 16.8 | 12 | 6.8 | 2.6 | 1.7 | — | |
| Trusting agentNumber of picks=12025.09 | 13.7 | 12.3 | 6.8 | 2.1 | 1.3 | — |