Multimodal on MMMU Pro (train)
57.83Success Rate (SR)MemQ
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MemQModel=Gemma-4-E4B-it2026.05 | 57.83 | 63.39 | |
| MemRLModel=Gemma-4-E4B-it2026.05 | 57.68 | 62.93 | |
| MemPModel=Gemma-4-E4B-it2026.05 | 51.37 | 53.47 | |
| RAGModel=Gemma-4-E4B-it2026.05 | 49.98 | 51.81 | |
| Self-RAGModel=Gemma-4-E4B-it2026.05 | 49.33 | 62.04 | |
| Mem0Model=Gemma-4-E4B-it2026.05 | 49.18 | 53.4 | |
| No Mem.Model=Gemma-4-E4B-it2026.05 | 48.92 | — |