List your company

Multimodal on MMMU Pro (test)

54.43Success RateMemQ
48.221249.833151.44553.0569May 8, 2026

Evaluation results

MethodLinks
MemQModel=Gemma-4-E4B-it2026.0554.43
MemPModel=Gemma-4-E4B-it2026.0554.24
RAGModel=Gemma-4-E4B-it2026.0553.76
MemRLModel=Gemma-4-E4B-it2026.0553.66
Self-RAGModel=Gemma-4-E4B-it2026.0553.57
Mem0Model=Gemma-4-E4B-it2026.0549.9
No Mem.Model=Gemma-4-E4B-it2026.0548.46