Reasoning on BBH (Accuracy and ECE)
67.56Accuracygemma3-27b-slerp
Evaluation results
| Method | Links | ||
|---|---|---|---|
| gemma3-27b-slerpType / λ=0.82025.10 | 67.56 | 0.209 | |
| gemma3-27b-slerpType / λ=0.92025.10 | 67.52 | 0.232 | |
| gemma3-27b-slerpType / λ=0.62025.10 | 67.23 | 0.161 | |
| gemma-3-27b-itType / λ=Base IT2025.10 | 67.21 | 0.302 | |
| gemma3-27b-slerpType / λ=0.52025.10 | 67.12 | 0.133 | |
| gemma3-27b-slerpType / λ=0.72025.10 | 67.07 | 0.189 | |
| gemma3-27b-slerpType / λ=0.42025.10 | 66.69 | 0.104 | |
| gemma3-27b-slerpType / λ=0.32025.10 | 65.86 | 0.075 | |
| gemma3-27b-slerpType / λ=0.22025.10 | 65.28 | 0.037 | |
| gemma3-27b-linearType / λ=0.22025.10 | 65.18 | 0.038 | |
| gemma3-27b-slerpType / λ=0.12025.10 | 64.03 | 0.015 | |
| gemma3-27b-linearType / λ=0.12025.10 | 63.79 | 0.017 | |
| gemma-3-12b-itType / λ=Base IT2025.10 | 63.27 | 0.325 | |
| gemma3-12b-linearType / λ=0.82025.10 | 63.2 | 0.228 | |
| gemma3-12b-slerpType / λ=0.82025.10 | 62.91 | 0.229 | |
| gemma3-12b-linearType / λ=0.62025.10 | 62.85 | 0.17 | |
| gemma3-12b-slerpType / λ=0.62025.10 | 62.66 | 0.172 | |
| gemma3-12b-slerpType / λ=0.72025.10 | 62.63 | 0.202 | |
| gemma3-12b-linearType / λ=0.72025.10 | 62.59 | 0.203 | |
| gemma3-12b-dare_tiesType / λ=0.62025.10 | 62.51 | 0.172 | |
| gemma3-12b-linearType / λ=0.92025.10 | 62.49 | 0.259 | |
| gemma3-12b-dare_tiesType / λ=0.72025.10 | 62.47 | 0.203 | |
| gemma3-12b-slerpType / λ=0.92025.10 | 62.45 | 0.26 | |
| gemma3-12b-dare_tiesType / λ=0.52025.10 | 62.02 | 0.135 | |
| gemma3-12b-dare_tiesType / λ=0.82025.10 | 61.88 | 0.236 | |
| gemma3-12b-slerpType / λ=0.52025.10 | 61.74 | 0.146 | |
| gemma3-12b-linearType / λ=0.52025.10 | 61.66 | 0.147 | |
| gemma-3-27b-ptType / λ=Base PT2025.10 | 61.66 | 0.049 | |
| gemma3-12b-dare_tiesType / λ=0.92025.10 | 61.34 | 0.291 | |
| gemma3-12b-slerpType / λ=0.42025.10 | 61.08 | 0.112 | |
| gemma3-12b-linearType / λ=0.42025.10 | 60.81 | 0.116 | |
| gemma3-12b-dare_tiesType / λ=0.42025.10 | 60.39 | 0.118 | |
| gemma3-12b-slerpType / λ=0.32025.10 | 60.06 | 0.083 | |
| gemma3-12b-linearType / λ=0.32025.10 | 59.76 | 0.085 | |
| gemma3-12b-dare_tiesType / λ=0.32025.10 | 59.16 | 0.089 | |
| gemma3-12b-slerpType / λ=0.22025.10 | 57.82 | 0.059 | |
| gemma3-12b-dare_tiesType / λ=0.22025.10 | 57.79 | 0.059 | |
| gemma3-12b-linearType / λ=0.22025.10 | 57.75 | 0.064 | |
| gemma3-12b-slerpType / λ=0.12025.10 | 55.89 | 0.034 | |
| gemma3-12b-dare_tiesType / λ=0.12025.10 | 55.89 | 0.035 | |
| gemma3-12b-linearType / λ=0.12025.10 | 55.84 | 0.032 | |
| gemma-3-12b-ptType / λ=Base PT2025.10 | 54.31 | 0.022 |