Language Understanding on MMLU (MMLU Score and Retention)
59.39MMLU ScoreBaseline
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BaselineTokens kept=100%, V groups kept=100%, Total KV=100.0%2026.04 | 59.39 | 100 | |
| EA + Sub-tokenTokens kept=75%, V groups kept=50%, Total KV=56.2%2026.04 | 59.39 | 100 | |
| EA + Sub-tokenTokens kept=50%, V groups kept=50%, Total KV=37.5%2026.04 | 59.34 | 99.9 | |
| EA + Sub-tokenTokens kept=75%, V groups kept=75%, Total KV=65.6%2026.04 | 59.29 | 99.8 |