Long Context Retrieval on MRCR v2
66.4AccuracyGemma 4 31B
Evaluation results
| Method | Links | |
|---|---|---|
| Gemma 4 31BModel size=31B, Thinking mode=true, Number of needles=8, Context window length=128k2026.07 | 66.4 | |
| Gemma 4 26B-A4BModel size=26B-A4B, Thinking mode=true, Number of needles=8, Context window length=128k2026.07 | 44.1 | |
| Gemma 4 12BModel size=12B, Thinking mode=true, Number of needles=8, Context window length=128k2026.07 | 43.4 | |
| Gemma 4 E4BModel size=E4B, Thinking mode=true, Number of needles=8, Context window length=128k2026.07 | 25.4 | |
| Gemma 4 E2BModel size=E2B, Thinking mode=true, Number of needles=8, Context window length=128k2026.07 | 19.1 | |
| Gemma 3 27BModel size=27B, Thinking mode=false, Number of needles=8, Context window length=128k2026.07 | 13.5 |