ResearchBenchmarksCoding on LiveCodeBench (train)Follow61.79Success Rate (SR)MemQ45.25449.54753.8458.133May 8, 2026Evaluation ResultsMethodMethodLinksSuccess Rate (SR)Cumulative Success Rate (CSR)MemQModel=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0561.7967.62MemRLModel=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0558.9366.19MemPModel=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0553.0455.48RAGModel=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0551.9657.38Mem0Model=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0549.5256.19No Mem.Model=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0547.14—Self-RAGModel=Gemma-4-E4B-itModel=Gemma-4-E4B-it2026.0545.8965