Scientific Reasoning on GPQA (Acc (%), ECE)
0.3817Accuracygemma3-27b-slerp
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| gemma3-27b-slerpType / λ=0.72025.10 | 0.3817 | 0.35 | |
| gemma3-27b-slerpType / λ=0.62025.10 | 0.3784 | 0.305 | |
| gemma3-27b-slerpType / λ=0.82025.10 | 0.3784 | 0.403 | |
| gemma3-27b-slerpType / λ=0.52025.10 | 0.3742 | 0.266 | |
| gemma3-27b-slerpType / λ=0.42025.10 | 0.3733 | 0.219 | |
| gemma3-27b-slerpType / λ=0.92025.10 | 0.3708 | 0.455 | |
| gemma3-27b-slerpType / λ=0.12025.10 | 0.3691 | 0.088 | |
| gemma3-27b-linearType / λ=0.12025.10 | 0.3674 | 0.088 | |
| gemma3-27b-linearType / λ=0.22025.10 | 0.3649 | 0.135 | |
| gemma-3-27b-itType / λ=Base IT2025.10 | 0.3624 | 0.59 | |
| gemma3-27b-slerpType / λ=0.22025.10 | 0.3616 | 0.14 | |
| gemma3-12b-linearType / λ=0.22025.10 | 0.3582 | 0.121 | |
| gemma3-12b-slerpType / λ=0.22025.10 | 0.3574 | 0.123 | |
| gemma3-12b-dare_tiesType / λ=0.42025.10 | 0.3565 | 0.229 | |
| gemma3-12b-linearType / λ=0.12025.10 | 0.3557 | 0.093 | |
| gemma3-27b-slerpType / λ=0.32025.10 | 0.3549 | 0.192 | |
| gemma3-12b-slerpType / λ=0.32025.10 | 0.3532 | 0.175 | |
| gemma3-12b-slerpType / λ=0.42025.10 | 0.3532 | 0.224 | |
| gemma3-12b-linearType / λ=0.42025.10 | 0.3532 | 0.224 | |
| gemma3-12b-dare_tiesType / λ=0.12025.10 | 0.3532 | 0.084 | |
| gemma3-12b-dare_tiesType / λ=0.32025.10 | 0.3532 | 0.174 | |
| gemma3-12b-slerpType / λ=0.52025.10 | 0.3523 | 0.272 | |
| gemma3-12b-linearType / λ=0.52025.10 | 0.3515 | 0.274 | |
| gemma3-12b-dare_tiesType / λ=0.52025.10 | 0.3515 | 0.279 | |
| gemma3-12b-linearType / λ=0.32025.10 | 0.3507 | 0.178 | |
| gemma-3-27b-ptType / λ=Base PT2025.10 | 0.3498 | 0.068 | |
| gemma3-12b-slerpType / λ=0.72025.10 | 0.349 | 0.368 | |
| gemma3-12b-dare_tiesType / λ=0.22025.10 | 0.349 | 0.126 | |
| gemma3-12b-slerpType / λ=0.12025.10 | 0.3482 | 0.087 | |
| gemma3-12b-linearType / λ=0.62025.10 | 0.3482 | 0.326 | |
| gemma-3-12b-ptType / λ=Base PT2025.10 | 0.3465 | 0.046 | |
| gemma3-12b-linearType / λ=0.72025.10 | 0.3456 | 0.371 | |
| gemma3-12b-slerpType / λ=0.62025.10 | 0.344 | 0.329 | |
| gemma3-12b-dare_tiesType / λ=0.82025.10 | 0.3414 | 0.424 | |
| gemma3-12b-linearType / λ=0.82025.10 | 0.3406 | 0.419 | |
| gemma3-12b-dare_tiesType / λ=0.62025.10 | 0.3381 | 0.327 | |
| gemma3-12b-dare_tiesType / λ=0.72025.10 | 0.3381 | 0.371 | |
| gemma-3-12b-itType / λ=Base IT2025.10 | 0.3364 | 0.597 | |
| gemma3-12b-slerpType / λ=0.82025.10 | 0.3364 | 0.423 | |
| gemma3-12b-dare_tiesType / λ=0.92025.10 | 0.3356 | 0.463 | |
| gemma3-12b-slerpType / λ=0.92025.10 | 0.3305 | 0.471 | |
| gemma3-12b-linearType / λ=0.92025.10 | 0.328 | 0.476 |