Reference Task on RoboMME Reference
92Pick HighL Success RateHuman Performance
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human Performance2026.03 | 92 | 92 | 98 | 90 | |
| MME-VLA (GroundSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=Oracle2026.03 | 83.33 | 97.33 | 100 | 100 | |
| MemER2026.03 | 70.67 | 25.33 | 30 | 26 | |
| MME-VLA (SimpleSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=Oracle2026.03 | 44 | 27.78 | 31.33 | 26 | |
| MME-VLA (FrameSamp)Memory Representation Type=Perceptual Memory, Integration Mechanism=Modul2026.03 | 22.89 | 30.44 | 60 | 32 | |
| MME-VLA (TokenDrop)Memory Representation Type=Perceptual Memory, Integration Mechanism=Modul2026.03 | 21.33 | 22 | 59.56 | 36 | |
| MME-VLA (TokenDrop)Memory Representation Type=Perceptual Memory, Integration Mechanism=Context2026.03 | 20.67 | 17.78 | 31.11 | 25.33 | |
| MME-VLA (TTT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Context2026.03 | 20.44 | 13.11 | 34.22 | 20.22 | |
| MME-VLA (SimpleSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=Gemini2026.03 | 20 | 15 | 26 | 29 | |
| MME-VLA (TokenDrop)Memory Representation Type=Perceptual Memory, Integration Mechanism=Expert2026.03 | 19.33 | 20.89 | 36.44 | 24.67 | |
| MME-VLA (FrameSamp)Memory Representation Type=Perceptual Memory, Integration Mechanism=Expert2026.03 | 19.11 | 23.11 | 30 | 24.22 | |
| MME-VLA (FrameSamp)Memory Representation Type=Perceptual Memory, Integration Mechanism=Context2026.03 | 17.67 | 15.22 | 30 | 20.89 | |
| SAM2Act+2026.03 | 17.33 | 5.33 | 24.67 | 20 | |
| MME-VLA (SimpleSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=QwenVL2026.03 | 17.11 | 25.33 | 33.33 | 25.11 | |
| MME-VLA (RMT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Modul2026.03 | 17.11 | 4.22 | 32 | 31.11 | |
| MME-VLA (GroundSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=QwenVL2026.03 | 15.11 | 25.33 | 54 | 31.78 | |
| MME-VLA (TTT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Modul2026.03 | 14.56 | 12.11 | 32.67 | 22.33 | |
| MME-VLA (RMT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Context2026.03 | 14 | 3.78 | 32 | 29.11 | |
| pi_0.5past actions=true2026.03 | 12.33 | 8.67 | 24 | 18.67 | |
| MME-VLA (TTT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Expert2026.03 | 12.22 | 9.56 | 34 | 22.89 | |
| MME-VLA (RMT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Expert2026.03 | 11.78 | 0.22 | 24.22 | 22.67 | |
| pi_0.52026.03 | 11.33 | 0.44 | 31.11 | 25.78 | |
| MME-VLA (GroundSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=Gemini2026.03 | 9 | 17 | 12 | 7 |