ResearchBenchmarksMultimodal on MMMU Pro (test)Follow54.43Success RateMemQ48.221249.833151.44553.0569May 8, 2026Evaluation ResultsMethodMethodLinksSuccess RateMemQModel=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0554.43MemPModel=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0554.24RAGModel=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0553.76MemRLModel=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0553.66Self-RAGModel=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0553.57Mem0Model=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0549.9No Mem.Model=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0548.46