General Knowledge on MMLU Stem (Accuracy)
82.39MMLU Stem GK AccuracyBaseline
Evaluation results
| Method | Links | |
|---|---|---|
| BaselineModel=Qwen3 32B2026.03 | 82.39 | |
| 50% KV PredModel=Qwen3 32B2026.03 | 74.21 | |
| BaselineModel=Falcon3 10B2026.03 | 68.47 | |
| 50% KV PredModel=Falcon3 10B2026.03 | 61.9 | |
| BaselineModel=Llama3.1 8B2026.03 | 58.7 | |
| 50% KV PredModel=Llama3.1 8B2026.03 | 44.53 |