Reference Task on RoboMME Reference benchmark leaderboard · SOTA2 Research

Reference Task on RoboMME Reference

92Pick HighL Success RateHuman Performance

Evaluation Results

Method	Links
Human Performance2026.03		92	92	98	90
MME-VLA (GroundSG)2026.03		83.33	97.33	100	100
MemER2026.03		70.67	25.33	30	26
MME-VLA (SimpleSG)2026.03		44	27.78	31.33	26
MME-VLA (FrameSamp)2026.03		22.89	30.44	60	32
MME-VLA (TokenDrop)2026.03		21.33	22	59.56	36
MME-VLA (TokenDrop)2026.03		20.67	17.78	31.11	25.33
MME-VLA (TTT)2026.03		20.44	13.11	34.22	20.22
MME-VLA (SimpleSG)2026.03		20	15	26	29
MME-VLA (TokenDrop)2026.03		19.33	20.89	36.44	24.67
MME-VLA (FrameSamp)2026.03		19.11	23.11	30	24.22
MME-VLA (FrameSamp)2026.03		17.67	15.22	30	20.89
SAM2Act+2026.03		17.33	5.33	24.67	20
MME-VLA (SimpleSG)2026.03		17.11	25.33	33.33	25.11
MME-VLA (RMT)2026.03		17.11	4.22	32	31.11
MME-VLA (GroundSG)2026.03		15.11	25.33	54	31.78
MME-VLA (TTT)2026.03		14.56	12.11	32.67	22.33
MME-VLA (RMT)2026.03		14	3.78	32	29.11
pi_0.52026.03		12.33	8.67	24	18.67
MME-VLA (TTT)2026.03		12.22	9.56	34	22.89
MME-VLA (RMT)2026.03		11.78	0.22	24.22	22.67
pi_0.52026.03		11.33	0.44	31.11	25.78
MME-VLA (GroundSG)2026.03		9	17	12	7