Scientific Reasoning on SciCode
43AccuracyGemma 4 31B
Evaluation results
| Method | Links | |
|---|---|---|
| Gemma 4 31BModel size=31B, Thinking mode=true2026.07 | 43 | |
| SuperPrecision=BF162026.07 | 42.3 | |
| SuperPrecision=NVFP42026.07 | 41.5 | |
| Puzzle-75B-A9BPrecision=BF162026.07 | 40.6 | |
| Puzzle-75B-A9BPrecision=NVFP42026.07 | 40.3 | |
| Gemma 4 26B-A4BModel size=26B-A4B, Thinking mode=true2026.07 | 40 | |
| Gemma 4 12BModel size=12B, Thinking mode=true2026.07 | 38 | |
| Gemma 4 E4BModel size=E4B, Thinking mode=true2026.07 | 24 | |
| Gemma 4 E2BModel size=E2B, Thinking mode=true2026.07 | 21 | |
| Gemma 3 27BModel size=27B, Thinking mode=false2026.07 | 21 |