List your company
ResearchFormerly WizWand

Instruction Following on IFEval (accuracy (greedy))

98.9Accuracy (Greedy)Gemma 4 31B
16.230437.692759.15580.6173Oct 20, 2025Dec 1, 2025Jan 13, 2026Feb 24, 2026Apr 8, 2026May 20, 2026Jul 2, 2026
Updated 3mo ago

Evaluation results

MethodLinks
Gemma 4 31BModel size=31B, Thinking mode=true2026.0798.9
Gemma 4 26B-A4BModel size=26B-A4B, Thinking mode=true2026.0798.5
Gemma 4 12BModel size=12B, Thinking mode=true2026.0797.2
Gemma 4 E4BModel size=E4B, Thinking mode=true2026.0796.7
Gemma 4 E2BModel size=E2B, Thinking mode=true2026.0794.6
Gemma 3 27BModel size=27B, Thinking mode=false2026.0790.4
Qwen3-30B-A3B-Instruct-2507# Bits=BF162026.0583.18
FlexRound+LFQ# Bits=W4g1282026.0582.99
FlexRound# Bits=W4g1282026.0582.44
GPTQ# Bits=W4g1282026.0582.26
gemma-3-27b-itType / λ=Base IT2025.1080.59
gemma3-27b-slerpType / λ=0.92025.1077.63
gemma-3-12b-itType / λ=Base IT2025.1077.08
gemma3-12b-slerpType / λ=0.92025.1076.16
gemma3-27b-slerpType / λ=0.82025.1075.6
gemma3-12b-linearType / λ=0.92025.1075.05
gemma3-12b-dare_tiesType / λ=0.92025.1073.75
gemma3-12b-linearType / λ=0.82025.1067.65
gemma3-12b-slerpType / λ=0.82025.1067.1
gemma3-12b-dare_tiesType / λ=0.82025.1065.99
gemma3-27b-slerpType / λ=0.72025.1063.96
gemma3-12b-dare_tiesType / λ=0.72025.1056.19
gemma3-12b-slerpType / λ=0.72025.1055.45
gemma3-12b-linearType / λ=0.72025.1055.45
gemma3-27b-slerpType / λ=0.62025.1052.31
gemma3-27b-slerpType / λ=0.52025.1051.94
gemma3-12b-dare_tiesType / λ=0.62025.1050.09
gemma3-12b-linearType / λ=0.62025.1049.17
gemma3-12b-dare_tiesType / λ=0.42025.1048.98
gemma3-12b-slerpType / λ=0.62025.1048.24
gemma3-27b-slerpType / λ=0.42025.1048.24
gemma3-12b-slerpType / λ=0.52025.1047.5
gemma3-12b-linearType / λ=0.52025.1046.4
gemma3-12b-dare_tiesType / λ=0.52025.1045.66
gemma3-12b-linearType / λ=0.42025.1041.4
gemma3-12b-slerpType / λ=0.42025.1040.67
gemma3-27b-slerpType / λ=0.32025.1040.67
gemma3-12b-slerpType / λ=0.32025.1035.49
gemma3-12b-dare_tiesType / λ=0.32025.1035.3
gemma3-12b-linearType / λ=0.32025.1034.75
gemma3-27b-slerpType / λ=0.22025.1030.68
gemma3-27b-linearType / λ=0.22025.1030.5
gemma3-12b-slerpType / λ=0.22025.1026.62
gemma3-12b-linearType / λ=0.22025.1026.43
gemma3-12b-dare_tiesType / λ=0.22025.1025.88
gemma3-27b-linearType / λ=0.12025.1024.58
gemma3-27b-slerpType / λ=0.12025.1022.92
gemma3-12b-linearType / λ=0.12025.1022
gemma3-12b-slerpType / λ=0.12025.1020.89
gemma3-12b-dare_tiesType / λ=0.12025.1020.52
gemma-3-27b-ptType / λ=Base PT2025.1020.33
gemma-3-12b-ptType / λ=Base PT2025.1019.41