Robotic Memory Manipulation on RoboMME Overall
90.5Average Success RateHuman Performance
Evaluation Results
| Method | Links | |
|---|---|---|
| Human Performance2026.03 | 90.5 | |
| MME-VLA (GroundSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=Oracle2026.03 | 84.08 | |
| MME-VLA (SimpleSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=Oracle2026.03 | 49.58 | |
| MME-VLA (FrameSamp)Memory Representation Type=Perceptual Memory, Integration Mechanism=Modul2026.03 | 44.51 | |
| MemER2026.03 | 42.38 | |
| MME-VLA (TokenDrop)Memory Representation Type=Perceptual Memory, Integration Mechanism=Modul2026.03 | 38.04 | |
| MME-VLA (FrameSamp)Memory Representation Type=Perceptual Memory, Integration Mechanism=Expert2026.03 | 36.25 | |
| MME-VLA (TokenDrop)Memory Representation Type=Perceptual Memory, Integration Mechanism=Expert2026.03 | 34.86 | |
| MME-VLA (TokenDrop)Memory Representation Type=Perceptual Memory, Integration Mechanism=Context2026.03 | 34.5 | |
| MME-VLA (GroundSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=QwenVL2026.03 | 32.7 | |
| MME-VLA (FrameSamp)Memory Representation Type=Perceptual Memory, Integration Mechanism=Context2026.03 | 30.68 | |
| MME-VLA (SimpleSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=QwenVL2026.03 | 29 | |
| MME-VLA (SimpleSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=Gemini2026.03 | 23.25 | |
| MME-VLA (TTT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Expert2026.03 | 22.35 | |
| MME-VLA (TTT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Context2026.03 | 22.28 | |
| MME-VLA (TTT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Modul2026.03 | 21.96 | |
| SAM2Act+2026.03 | 21.37 | |
| MME-VLA (RMT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Modul2026.03 | 20.17 | |
| pi_0.5past actions=true2026.03 | 19.73 | |
| MME-VLA (RMT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Context2026.03 | 19.46 | |
| MME-VLA (RMT)Memory Representation Type=Recurrent Memory, Integration Mechanism=Expert2026.03 | 18.15 | |
| pi_0.52026.03 | 17.93 | |
| MME-VLA (GroundSG)Memory Representation Type=Symbolic Memory, Integration Mechanism=Gemini2026.03 | 11.56 |