Multiple-choice Question Answering on MMLU-Pro Zipf 1.4
87.4AccuracyMemBoost
Evaluation results
| Method | Links | |
|---|---|---|
| MemBoostMeta-Controller=Qwen3.5-2B2026.03 | 87.4 | |
| Qwen3-14B-FP8-dynamic (Oracle)Model Type=Baseline / Oracle2026.03 | 85 | |
| MemBoostMeta-Controller=Ministral-3-3B-Instruct-25122026.03 | 85 | |
| MemBoostMeta-Controller=Qwen3-4B-Instruct-2507-FP82026.03 | 85 | |
| Qwen3-4B-Instruct-2507-FP8Model Type=Baseline2026.03 | 80.5 | |
| Ministral-3-3B-Instruct-2512Model Type=Baseline2026.03 | 38.2 | |
| Qwen3.5-2BModel Type=Baseline2026.03 | 37.1 |