Multiple-choice Reasoning on MMLU
32.8AccuracyFineWeb-Edu
Evaluation results
| Method | Links | |
|---|---|---|
| FineWeb-Edu2026.04 | 32.8 | |
| NAG_Qwen3-1.7BTarget Setting=Single-Target, Backbone=Qwen3-1.7B2026.04 | 32.2 | |
| NAG_Llama-3.2-3BTarget Setting=Single-Target, Backbone=Llama-3.2-3B2026.04 | 31.5 | |
| NAG_Qwen3-1.7BTarget Setting=Multi-Target, Backbone=Qwen3-1.7B2026.04 | 31.5 | |
| NAG_Llama-3.2-3BTarget Setting=Multi-Target, Backbone=Llama-3.2-3B2026.04 | 31.4 | |
| NAG_SmolLM3-3BTarget Setting=Single-Target, Backbone=SmolLM3-3B2026.04 | 31.2 | |
| BETRTarget Setting=Single-Target2026.04 | 31.1 | |
| NAG_SmolLM3-3BTarget Setting=Multi-Target, Backbone=SmolLM3-3B2026.04 | 30.6 | |
| Random2026.04 | 30.2 | |
| BETRTarget Setting=Multi-Target2026.04 | 29.9 |